title: ReLU Networks as Surrogate Models in Mixed-Integer Linear Programs

abstract: We consider the embedding of piecewise-linear deep neural networks (ReLU networks) as surrogate models in mixed-integer linear programming (MILP) problems. A MILP formulation of ReLU networks has recently been applied by many authors to probe for various model properties subject to input bounds. The formulation is obtained by programming each ReLU operator with a binary variable and applying the big-M method. The efficiency of the formulation hinges on the tightness of the bounds defined by the big-M values. When ReLU networks are embedded in a larger optimization problem, the presence of output bounds can be exploited in bound tightening. To this end, we devise and study several bound tightening procedures that consider both input and output bounds. Our numerical results show that bound tightening may reduce solution times considerably, and that small-sized ReLU networks are suitable as surrogate models in mixed-integer linear programs.


title: AutoCompress: An Automatic DNN Structured Pruning Framework for Ultra-High Compression Rates

abstract: Structured weight pruning is a representative model compression technique of DNNs to reduce the storage and computation requirements and accelerate inference. An automatic hyperparameter determination process is necessary due to the large number of flexible hyperparameters. This work proposes AutoCompress, an automatic structured pruning framework with the following key performance improvements: (i) effectively incorporate the combination of structured pruning schemes in the automatic process; (ii) adopt the state-of-art ADMM-based structured weight pruning as the core algorithm, and propose an innovative additional purification step for further weight reduction without accuracy loss; and (iii) develop effective heuristic search method enhanced by experience-based guided search, replacing the prior deep reinforcement learning technique which has underlying incompatibility with the target pruning problem. Extensive experiments on CIFAR-10 and ImageNet datasets demonstrate that AutoCompress is the key to achieve ultra-high pruning rates on the number of weights and FLOPs that cannot be achieved before. As an example, AutoCompress outperforms the prior work on automatic model compression by up to 33x in pruning rate (120x reduction in the actual parameter count) under the same accuracy. Significant inference speedup has been observed from the AutoCompress framework on actual measurements on smartphone. We release all models of this work at anonymous link: http://bit.ly/2VZ63dS.


title: Indestructibility of the tree property

abstract: In the first part of the paper, we show that if $\omega \le \kappa < \lambda$ are cardinals, $\kappa^{<\kappa} = \kappa$, and $\lambda$ is weakly compact, then in $V[\M(\kappa,\lambda)]$ the tree property at $\lambda = \kappa^{++V[\M(\kappa,\lambda)]}$ is indestructible under all $\kappa^+$-cc forcing notions which live in $V[\Add(\kappa,\lambda)]$, where $\Add(\kappa,\lambda)$ is the Cohen forcing for adding $\lambda$-many subsets of $\kappa$ and $\M(\kappa,\lambda)$ is the standard Mitchell forcing for obtaining the tree property at $\lambda = (\kappa^{++})^{V[\M(\kappa,\lambda)]}$. This result has direct applications to Prikry-type forcing notions and generalized cardinal invariants. In the second part, we assume that $\lambda$ is supercompact and generalize the construction and obtain a model $V^*$, a generic extension of $V$, in which the tree property at $(\kappa^{++})^{V^*}$ is indestructible under all $\kappa^+$-cc forcing notions living in $V[\Add(\kappa,\lambda)]$, and in addition by all forcing notions living in $V^*$ which are $\kappa^+$-closed and ``liftable'' in a prescribed sense (such as $\kappa^{++}$-directed closed forcings or well-met forcings which are $\kappa^{++}$-closed with the greatest lower bounds).


title: Diachronic Embedding for Temporal Knowledge Graph Completion

abstract: Knowledge graphs (KGs) typically contain temporal facts indicating relationships among entities at different times. Due to their incompleteness, several approaches have been proposed to infer new facts for a KG based on the existing ones-a problem known as KG completion. KG embedding approaches have proved effective for KG completion, however, they have been developed mostly for static KGs. Developing temporal KG embedding models is an increasingly important problem. In this paper, we build novel models for temporal KG completion through equipping static models with a diachronic entity embedding function which provides the characteristics of entities at any point in time. This is in contrast to the existing temporal KG embedding approaches where only static entity features are provided. The proposed embedding function is model-agnostic and can be potentially combined with any static model. We prove that combining it with SimplE, a recent model for static KG embedding, results in a fully expressive model for temporal KG completion. Our experiments indicate the superiority of our proposal compared to existing baselines.


title: Thermal expansion of {\alpha}-boron and some boron-rich pnictides

abstract: Thermal expansion of {\alpha}-rhombohedral boron ({\alpha}-B12) and two isostructural boron-rich pnictides (B12P2 and B12As2) has been studied between 298 and 1280 K by high-temperature synchrotron X-ray diffraction. For all studied phases no temperature-induced phase transitions have been observed. The observed temperature dependencies of the lattice parameters and unit cell volumes were found to be quasi-linear. Variation of the thermal expansion coefficients in the group of boron-rich pnictides (B13N2 - B12P2 - B12As2) was analyzed.


title: On diagonal equations over finite fields via walks in NEPS of graphs

abstract: In this paper, we obtain an explicit combinatorial formula for the number of solutions $(x_1,\ldots,x_r)\in \mathbb{F}_{p^{ab}}$ to the diagonal equation $x_{1}^k+\cdots+x_{r}^k=\alpha$ over the finite field $\mathbb{F}_{p^{ab}}$, with $k=\frac{p^{ab}-1}{b(p^a-1)}$ and $b>1$ by using the number of $r$-walks in NEPS of complete graphs.


title: A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms

abstract: A key challenge in intelligent robotics is creating robots that are capable of directly interacting with the world around them to achieve their goals. The last decade has seen substantial growth in research on the problem of robot manipulation, which aims to exploit the increasing availability of affordable robot arms and grippers to create robots capable of directly interacting with the world to achieve their goals. Learning will be central to such autonomous systems, as the real world contains too much variation for a robot to expect to have an accurate model of its environment, the objects in it, or the skills required to manipulate them, in advance. We aim to survey a representative subset of that research which uses machine learning for manipulation. We describe a formalization of the robot manipulation learning problem that synthesizes existing research into a single coherent framework and highlight the many remaining research opportunities and challenges.


title: HTP-complete rings of rational numbers

abstract: For a ring $R$, Hilbert's Tenth Problem $HTP(R)$ is the set of polynomial equations over $R$, in several variables, with solutions in $R$. We view $HTP$ as an enumeration operator, mapping each set $W$ of prime numbers to $HTP(\mathbb Z[W^{-1}])$, which is naturally viewed as a set of polynomials in $\mathbb Z[X_1,X_2,\ldots]$. It is known that for almost all $W$, the jump $W'$ does not $1$-reduce to $HTP(R_W)$. In contrast, we show that every Turing degree contains a set $W$ for which such a $1$-reduction does hold: these $W$ are said to be "HTP-complete." Continuing, we derive additional results regarding the impossibility that a decision procedure for $W'$ from $HTP(\mathbb Z[W^{-1}])$ can succeed uniformly on a set of measure $1$, and regarding the consequences for the boundary sets of the $HTP$ operator in case $\mathbb Z$ has an existential definition in $\mathbb Q$.


title: Morphology Formation in Binary Mixtures upon Gradual Destabilisation

abstract: Spontaneous liquid-liquid phase separation is commonly understood in terms of phenomenological mean-field theories. These theories correctly predict the structural features of the fluid at sufficiently long time scales and wavelengths. However, these conditions are not met in various examples in biology and materials science where the mixture is slowly destabilised, and phase separation takes place close to the critical point. Using kinetic Monte Carlo and molecular dynamics simulations of a binary surface fluid under these conditions, we show that the characteristic length scale of the emerging structure decreases, in 2D, with the 4/15 dynamic critical exponent of the quench rate rather than the mean-field 1/6th power. Hence, the dynamics of cluster formation governed by thermodynamically undriven Brownian motion is much more sensitive on the rate of destabilisation than expected from mean-field theory. We discuss the expected implications of this finding to 3D systems with ordering liquid crystals, as well as phase-separating passive or active particles.


title: Intelligent Systems Design for Malware Classification Under Adversarial Conditions

abstract: The use of machine learning and intelligent systems has become an established practice in the realm of malware detection and cyber threat prevention. In an environment characterized by widespread accessibility and big data, the feasibility of malware classification without the use of artificial intelligence-based techniques has been diminished exponentially. Also characteristic of the contemporary realm of automated, intelligent malware detection is the threat of adversarial machine learning. Adversaries are looking to target the underlying data and/or algorithm responsible for the functionality of malware classification to map its behavior or corrupt its functionality. The ends of such adversaries are bypassing the cyber security measures and increasing malware effectiveness. The focus of this research is the design of an intelligent systems approach using machine learning that can accurately and robustly classify malware under adversarial conditions. Such an outcome ultimately relies on increased flexibility and adaptability to build a model robust enough to identify attacks on the underlying algorithm.


title: Effective Field Theory of Dark Energy: a Review

abstract: The discovery of cosmic acceleration has triggered a consistent body of theoretical work aimed at modeling its phenomenology and understanding its fundamental physical nature. In recent years, a powerful formalism that accomplishes both these goals has been developed, the so-called effective field theory of dark energy. It can capture the behavior of a wide class of modified gravity theories and classify them according to the imprints they leave on the smooth background expansion history of the Universe and on the evolution of linear perturbations. The effective field theory of dark energy is based on a Lagrangian description of cosmological perturbations which depends on a number of functions of time, some of which are non-minimal couplings representing genuine deviations from General Relativity. Such a formalism is thus particularly convenient to fit and interpret the wealth of new data that will be provided by future galaxy surveys. Despite its recent appearance, this formalism has already allowed a systematic investigation of what lies beyond the General Relativity landscape and provided a conspicuous amount of theoretical predictions and observational results. In this review, we report on these achievements.


title: Improved global well-posedness for defocusing sixth-order Boussinesq equations

abstract: This article studies the global well-posedness for a class of defocusing, generalized sixth-order Boussinesq equations, extending a previous result obtained by Wang and Esfahani for the case when the nonlinear term is cubic.


title: Search for MSSM Higgs bosons decaying to $\mu^+\mu^-$ in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: A search is performed for neutral non-standard-model Higgs bosons decaying to two muons in the context of the minimal supersymmetric standard model (MSSM). Proton-proton collision data recorded by the CMS experiment at the CERN Large Hadron Collider at a center-of-mass energy of 13 TeV were used, corresponding to an integrated luminosity of 35.9 fb$^{-1}$. The search is sensitive to neutral Higgs bosons produced via the gluon fusion process or in association with a $\mathrm{b\overline{b}}$ quark pair. No significant deviations from the standard model expectation are observed. Upper limits at 95% confidence level are set in the context of the $m_\mathrm{h}^{\text{mod+}}$ and phenomenological MSSM scenarios on the parameter $\tan\beta$ as a function of the mass of the pseudoscalar A boson, in the range from 130 to 600 GeV. The results are also used to set a model-independent limit on the product of the branching fraction for the decay into a muon pair and the cross section for the production of a scalar neutral boson, either via gluon fusion, or in association with b quarks, in the mass range from 130 to 1000 GeV.


title: The revisited knockoffs method for variable selection in L1-penalised regressions

abstract: We consider the problem of variable selection in regression models. In particular, we are interested in selecting explanatory covariates linked with the response variable and we want to determine which covariates are relevant, that is which covariates are involved in the model. In this framework, we deal with L1-penalised regression models. To handle the choice of the penalty parameter to perform variable selection, we develop a new method based on the knockoffs idea. This revisited knockoffs method is general, suitable for a wide range of regressions with various types of response variables. Besides, it also works when the number of observations is smaller than the number of covariates and gives an order of importance of the covariates. Finally, we provide many experimental results to corroborate our method and compare it with other variable selection methods.


title: The saturation number of powers of graded ideals

abstract: Let $S=K[x_1,\ldots,x_n]$ be the polynomial ring in $n$ variables over a field $K$ with maximal ideal $\frak{m}=(x_1,...,x_n)$, and let $I$ be a graded ideal of $S$. In this paper, we define the saturation number $\sat(I)$ of $I$ to be the smallest non-negative integer $k$ such that $I:\mm^{k+1}= I:\mm^k$. We show that $f(k)$ is linearly bounded, and that $f(k)$ is a quasi-linear function for $k\gg 0$, if $I$ is a monomial ideal. Furthermore, we show that $\sat(I^k)=k$ if $I$ is a principal Borel ideal and prove that $\sat(I_{d,n}^k) =\max\{l\:\; (kd-l)/(k-l) \leq n\},$ where $I_{d,n}$ is the squarefree Veronese ideal generated in degree $d$. \end{abstract}


title: Learning a latent pattern of heterogeneity in the innovation rates of a time series of counts

abstract: We develop a Bayesian hierarchical semiparametric model for phenomena related to time series of counts. The main feature of the model is its capability to learn a latent pattern of heterogeneity in the distribution of the process innovation rates, which are softly clustered through time with the help of a Dirichlet process placed at the top of the model hierarchy. The probabilistic forecasting capabilities of the model are put to test in the analysis of crime data in Pittsburgh, with favorable results.


title: Riemann-Hilbert Problem for the Matrix Laguerre Biorthogonal Polynomials: Eigenvalue Problems and the Matrix Discrete Painlev\'e IV

abstract: In this paper the Riemann-Hilbert problem, with jump supported on a appropriate curve on the complex plane with a finite endpoint at the origin, is used for the study of corresponding matrix biorthogonal polynomials associated with Laguerre type matrices of weights ---which are constructed in terms of a given matrix Pearson equation. First and second order differential systems for the fundamental matrix, solution of the mentioned Riemann-Hilbert problem are derived. An explicit and general example is presented to illustrate the theoretical results of the work. Related matrix eigenvalue problems for second order matrix differential operators and non-Abelian extensions of a family of discrete Painlev\'e IV equations are discussed.


title: Attosecond helical pulses

abstract: We find a solution of the wave equation in the paraxial approximation that describes the attosecond pulses with spatiotemporal helical structure in the phase and in the intensity recently generated by means of highly nonlinear optical processes driven by visible or infrared femtosecond vortex pulses. Having a simple analytical model for these helical pulses will greatly facilitate the study of their predicted applications, particularly their interaction with matter after their generation. It also follows from our analysis that the topological charge dispersion inherent to helical pulses allows to beat the minimum duration to which a pulsed vortex without charge dispersion is limited.


title: $\gamma$-Graphs of Trees

abstract: For a graph $G = (V, E)$, the $\gamma$-graph of $G$, denoted $G(\gamma) = (V(\gamma), E(\gamma))$, is the graph whose vertex set is the collection of minimum dominating sets, or $\gamma$-sets of $G$, and two $\gamma$-sets are adjacent in $G(\gamma)$ if they differ by a single vertex and the two different vertices are adjacent in $G$. In this paper, we consider $\gamma$-graphs of trees. We develop an algorithm for determining the $\gamma$-graph of a tree, characterize which trees are $\gamma$-graphs of trees, and further comment on the structure of $\gamma$-graphs of trees and its connections with Cartesian product graphs, the set of graphs which can be obtained from the Cartesian product of graphs of order at least two.


title: Observational signature of circumstellar interaction and $\rm ^{56}$Ni-mixing in the Type II Supernova 2016gfy

abstract: The optical and ultra-violet broadband photometric and spectroscopic observations of the Type II supernova (SN) 2016gfy are presented. The $V$-band light curve (LC) shows a distinct plateau phase with a slope, $s_2$ $\sim$ 0.12 mag / 100 d and a duration of 90 $\pm$ 5 d. Detailed analysis of SN 2016gfy provided a mean $\rm^{56}Ni$ mass of 0.033 $\pm$ 0.003 $\rm M_{\odot}$, a progenitor radius of $\sim$ 350-700 $\rm R_{\odot}$, a progenitor mass of $\sim$ 12-15 $\rm M_{\odot}$ and an explosion energy of 0.9-1.4$\rm \times 10^{51}\ erg\ s^{-1}$. The P-Cygni profile of H$\rm \alpha$ in the early phase spectra ($\sim$ 11-21 d) shows a boxy emission. Assuming that this profile arises from the interaction of the SN ejecta with the pre-existing circumstellar material (CSM), it is inferred that the progenitor underwent a recent episode (30-80 years prior to the explosion) of enhanced mass loss. Numerical modeling suggests that the early LC peak is reproduced better with an existing CSM of 0.15 $\rm M_{\odot}$ spread out to $\sim$ 70 AU. A late-plateau bump is seen in the $VRI$ LCs during $\sim$ 50-95 d. This bump is explained as a result of the CSM interaction and/or partial mixing of radioactive $\rm ^{56}Ni$ in the SN ejecta. Using strong-line diagnostics, a sub-solar oxygen abundance is estimated for the supernova H II region (12 + log(O/H) = 8.50 $\pm$ 0.11), indicating an average metallicity for the host of a Type II SN. A star formation rate of $\sim$ 8.5 $\rm M_{\odot}\ yr^{-1}$ is estimated for NGC 2276 using the archival $GALEX$ FUV data.


title: On the observational behaviour of the highly polarized Type IIn supernova SN 2017hcc

abstract: We present the results based on photometric ($Swift$ UVOT), broad-band polarimetric ($V$ and $R$-band) and optical spectroscopic observations of the Type IIn supernova (SN) 2017hcc. Our study is supplemented with spectropolarimetric data available in literature for this event. The post-peak light curve evolution is slow ($\sim$0.2 mag 100 d$^{-1}$ in $b$-band). The spectrum of $\sim$+27 d shows a blue continuum with narrow emission lines, typical of a Type IIn SN. Archival polarization data along with the $Gaia$ DR2 distances have been utilized to evaluate the interstellar polarization (ISP) towards the SN direction which is found to be $P_{ISP}$ = 0.17 $\pm$ 0.02 per cent and $\theta_{ISP}$ = 140$^{\circ}$ $\pm$ 3$^{\circ}$. To extract the intrinsic polarization of SN 2017hcc, both the observed and the literature polarization measurements were corrected for ISP. We noticed a significant decline of $\sim$3.5 per cent ($V$-band) in the intrinsic level of polarization spanning a period of $\sim$2 months. In contrast, the intrinsic polarization angles remain nearly constant at all epochs. Our study indicates a substantial variation in the degree of asymmetry in either the ejecta and/or the surrounding medium of SN 2017hcc. We also estimate a mass-loss rate of $\dot M$ = 0.12 M$_{\odot}$ yr$^{-1}$ (for $v_w$ = 20 km s$^{-1}$) which suggests that the progenitor of SN 2017hcc is most likely a Luminous Blue Variable.


title: The impact of baryonic physics and massive neutrinos on weak lensing peak statistics

abstract: We study the impact of baryonic processes and massive neutrinos on weak lensing peak statistics that can be used to constrain cosmological parameters. We use the BAHAMAS suite of cosmological simulations, which self-consistently include baryonic processes and the effect of massive neutrino free-streaming on the evolution of structure formation. We construct synthetic weak lensing catalogues by ray-tracing through light-cones, and use the aperture mass statistic for the analysis. The peaks detected on the maps reflect the cumulative signal from massive bound objects and general large-scale structure. We present the first study of weak lensing peaks in simulations that include both baryonic physics and massive neutrinos (summed neutrino mass $M_{\nu} =$ 0.06, 0.12, 0.24, and 0.48 eV assuming normal hierarchy), so that the uncertainty due to physics beyond the gravity of dark matter can be factored into constraints on cosmological models. Assuming a fiducial model of baryonic physics, we also investigate the correlation between peaks and massive haloes, over a range of summed neutrino mass values. As higher neutrino mass tends to suppress the formation of massive structures in the Universe, the halo mass function and lensing peak counts are therefore modified as a function of $M_{\nu}$. Over most of the S/N range, the impact of fiducial baryonic physics is greater (less) than neutrinos for 0.06 and 0.12 (0.24 and 0.48) eV models. Both baryonic physics and massive neutrinos should be accounted for when deriving cosmological parameters from weak lensing observations.


title: Combinatorial separation algorithms for the continuous knapsack polyhedra with divisible capacities

abstract: It is important to design separation algorithms of low computational complexity in mixed integer programming. We study the separation problems of the two continuous knapsack polyhedra with divisible capacities. The two polyhedra are the convex hulls of the sets which consist of $ n $ nonnegative integer variables, one unbounded continuous, $ m $ bounded continuous variables, and one linear constraint in either $ \geq $ or $ \leq $ form where the coefficients of integer variables are integer and divisible. Wolsey and Yaman (Math Program 156: 1--20, 2016) have shown that the polyhedra can be described by adding the two closely related families of partition inequalities. However, no combinatorial separation algorithm is known yet for the polyhedra. In this paper, for each polyhedron, we provide a combinatorial separation algorithm with the complexity of $ \mathcal{O}(nm+m\log m ) $. In particular, we solve the separation problem for the continuous $ \geq $-knapsack polyhedron by presenting a polynomial-time separation algorithm for the family of $ \geq $-partition inequalities. For the continuous $ \leq $-knapsack polyhedron, we derive the complemented partition inequalities, which dominate the $ \leq $-partition inequalities. The continuous $ \leq $-knapsack polyhedron is completely described with the addition of the proposed inequalities. We again show that the family of the proposed inequalities can be separated in polynomial time.


title: Error Probability Bounds for Gaussian Channels under Maximal and Average Power Constraints

abstract: This paper studies the performance of block coding on an additive white Gaussian noise channel under different power limitations at the transmitter. Lower bounds are presented for the minimum error probability of codes satisfying maximal and average power constraints. These bounds are tighter than previous results in the finite blocklength regime, and yield a better understanding on the structure of good codes under an average power limitation. Evaluation of these bounds for short and moderate blocklengths is also discussed.


title: Towards Debugging Deep Neural Networks by Generating Speech Utterances

abstract: Deep neural networks (DNN) are able to successfully process and classify speech utterances. However, understanding the reason behind a classification by DNN is difficult. One such debugging method used with image classification DNNs is activation maximization, which generates example-images that are classified as one of the classes. In this work, we evaluate applicability of this method to speech utterance classifiers as the means to understanding what DNN "listens to". We trained a classifier using the speech command corpus and then use activation maximization to pull samples from the trained model. Then we synthesize audio from features using WaveNet vocoder for subjective analysis. We measure the quality of generated samples by objective measurements and crowd-sourced human evaluations. Results show that when combined with the prior of natural speech, activation maximization can be used to generate examples of different classes. Based on these results, activation maximization can be used to start opening up the DNN black-box in speech tasks.


title: Unsupervised cycle-consistent deformation for shape matching

abstract: We propose a self-supervised approach to deep surface deformation. Given a pair of shapes, our algorithm directly predicts a parametric transformation from one shape to the other respecting correspondences. Our insight is to use cycle-consistency to define a notion of good correspondences in groups of objects and use it as a supervisory signal to train our network. Our method does not rely on a template, assume near isometric deformations or rely on point-correspondence supervision. We demonstrate the efficacy of our approach by using it to transfer segmentation across shapes. We show, on Shapenet, that our approach is competitive with comparable state-of-the-art methods when annotated training data is readily available, but outperforms them by a large margin in the few-shot segmentation scenario.


title: Algebraic algorithms for even circuits in graphs

abstract: We present an algebraic algorithm to detect the existence of and to list all indecomposable even circuits in a given graph. We also discuss an application of our work to the study of directed cycles in digraphs.


title: Exploring difference in public perceptions on HPV vaccine between gender groups from Twitter using deep learning

abstract: In this study, we proposed a convolutional neural network model for gender prediction using English Twitter text as input. Ensemble of proposed model achieved an accuracy at 0.8237 on gender prediction and compared favorably with the state-of-the-art performance in a recent author profiling task. We further leveraged the trained models to predict the gender labels from an HPV vaccine related corpus and identified gender difference in public perceptions regarding HPV vaccine. The findings are largely consistent with previous survey-based studies.


title: Structure determination of the tetracene dimer in helium nanodroplets using femtosecond strong-field ionization

abstract: Dimers of tetracene molecules are formed inside helium nanodroplets and identified through covariance analysis of the emission directions of kinetic tetracene cations stemming from femtosecond laser-induced Coulomb explosion. Next, the dimers are aligned in either one or three dimensions under field-free conditions by a nonresonant, moderately intense laser pulse. The experimental angular covariance maps of the tetracene ions are compared to calculated covariance maps for seven different dimer conformations and found to be consistent with four of these. Additional measurements of the alignment-dependent strong-field ionization yield of the dimer narrows the possible conformations down to either a slipped-parallel or parallel-slightly-rotated structure. According to our quantum chemistry calculations, these are the two most stable gas-phase conformations of the dimer and one of them is favorable for singlet fission.


title: Measurement of $\Upsilon(1{\rm S})$ elliptic flow at forward rapidity in Pb-Pb collisions at $\sqrt{s_{\rm{NN}}}=5.02$ TeV

abstract: The first measurement of the $\Upsilon(1{\rm S})$ elliptic flow coefficient ($v_2$) is performed at forward rapidity (2.5 $<$ $y$ $<$ 4) in Pb-Pb collisions at $\sqrt{s_{\rm NN}} = 5.02$ TeV with the ALICE detector at the LHC. The results are obtained with the scalar product method and are reported as a function of transverse momentum ($p_{\rm{T}}$) up to 15 GeV/$c$ in the 5-60% centrality interval. The measured $\Upsilon(1{\rm S})$ $v_2$ is consistent with zero and with the small positive values predicted by transport models within uncertainties. The $v_2$ coefficient in 2 $<$ $p_{\rm T}$ $<$ 15 GeV/$c$ is lower than that of inclusive J/$\psi$ mesons in the same $p_{\rm{T}}$ interval by 2.6 standard deviations. These results, combined with earlier suppression measurements, are in agreement with a scenario in which the $\Upsilon$(1S) production in Pb-Pb collisions at LHC energies is dominated by dissociation limited to the early stage of the collision whereas in the J/$\psi$ case there is substantial experimental evidence of an additional regeneration component.


title: Convergence Analysis of a Collapsed Gibbs Sampler for Bayesian Vector Autoregressions

abstract: We study the convergence properties of a collapsed Gibbs sampler for Bayesian vector autoregressions with predictors, or exogenous variables. The Markov chain generated by our algorithm is shown to be geometrically ergodic regardless of whether the number of observations in the underlying vector autoregression is small or large in comparison to the order and dimension of it. In a convergence complexity analysis, we also give conditions for when the geometric ergodicity is asymptotically stable as the number of observations tends to infinity. Specifically, the geometric convergence rate is shown to be bounded away from unity asymptotically, either almost surely or with probability tending to one, depending on what is assumed about the data generating process. This result is one of the first of its kind for practically relevant Markov chain Monte Carlo algorithms. Our convergence results hold under close to arbitrary model misspecification.


title: Realization of all-optical vortex switching in exciton-polariton condensates

abstract: Vortices are topological objects representing the circular motion of a fluid. With their additional degree of freedom, the 'vorticity', they have been widely investigated in many physical systems and different materials for fundamental interest and for applications in data storage and information processing. Vortices have also been observed in non-equilibrium exciton-polariton condensates in planar semiconductor microcavities. There they appear spontaneously or can be created and pinned in space using ring-shaped optical excitation profiles. However, using the vortex state for information processing not only requires creation of a vortex but also efficient control over the vortex after its creation. Here we demonstrate a simple approach to control and switch a localized polariton vortex between opposite states. In our scheme, both the optical control of vorticity and its detection through the orbital angular momentum of the emitted light are implemented in a robust and practical manner.


title: Quantum implications of non-extensive statistics

abstract: Exploring the analogy between quantum mechanics and statistical mechanics we formulate an integrated version of the Quantropy functional [1]. With this prescription we compute the propagator associated to Boltzmann-Gibbs statistics in the semiclassical approximation as $K=F(T) \exp\left(i S_{cl}/\hbar\right)$. We determine also propagators associated to different non-additive statistics; those are the entropies depending only on the probability $S_{\pm}$ [2] and Tsallis entropy $S_q$ [3]. For $S_{\pm}$ we obtain a power series solution for the probability vs. the energy, which can be analytically continued to the complex plane, and employed to obtain the propagators. Our work is motivated by [4] where a modified q-Schr\"odinger equation is obtained; that provides the wave function for the free particle as a q-exponential. The modified q-propagator obtained with our method, leads to the same q-wave function for that case. The procedure presented in this work allows to calculate q-wave functions in problems with interactions; determining non-linear quantum implications of non-additive statistics. In a similar manner the corresponding generalized wave functions associated to $S_{\pm}$ can also be constructed. The corrections to the original propagator are explicitly determined in the case of a free particle and the harmonic oscillator for which the semi-classical approximation is exact.


title: Plug-n-Play Alternating Projection Algorithm for Large-scale Security Constraint Optimal Power Flow

abstract: In this paper, we present an optimization algorithm based on an alternating projection method to solve the large-scale security constraint optimal power flow (SCOPF) problem in power systems. The SCOPF is first partitioned into sub-problems, which share common power components. The proposed algorithm is fundamentally a distributed computing algorithm, which optimizes power flow in each electrical bus. The output of the local optimization problem will be exchanged among neighboring buses for the overall solution for the whole power system. We performed the algorithm against a modified 14-bus power system and demonstrated that the method is competitive with the commercial products regarding the CPU computation time.


title: Complex conductivity of monolayer graphene and Zitterbewegung

abstract: A recently derived formula for complex conductivity of the monolayer graphene is analyzed. We show that the real and imaginary parts in this formula obey the Kramers and Kronig dispersion relations which are a good test for validity of the formula for complex conductivity of monolayer graphene. We consider also an additional test for this formula, sensitive to the integral characteristic of the conductance such as the famous f sum rule. We write it in the two dimensional form and show that it fulfils identically if we admit the cyclotron mass as an effective one and take the principal value of the integral. We find a deep relation between the graphene complex optical conductivity singularities and electrons Zitterbewegung in graphene. Namely, the value of Zitterbewegung frequency is related with the recently found magnitudes of the inductance L and capacitance C by the Thomson formula.


title: Inverse Compton Cascades in Pair-Producing Gaps: Effects of Triplet Pair Production

abstract: Inverse Compton-pair cascades are initiated when gamma-rays are absorbed on an ambient soft photon field to produce relativistic pairs, which in turn up-scatter the same soft photons to produce more gamma-rays. If the Compton scatterings take place in the deep Klein-Nishina regime, then triplet pair production ($e\gamma_b \rightarrow ee^{+}e^{-}$) becomes relevant and may even regulate the development of the cascade. We investigate the properties of pair-Compton cascades with triplet pair production in accelerating gaps, i.e., regions with an unscreened electric field. Using the method of transport equations for the particle evolution, we compute the growth rate of the pair cascade as a function of the accelerating electric field in the presence of black-body and power-law ambient photon fields. Informed by the numerical results, we derive simple analytical expressions for the peak growth rate and the corresponding electric field. We show that for certain parameters, which can be realized in the vicinity of accreting supermassive black holes at the centers of active galactic nuclei, the pair cascade may well be regulated by inverse Compton scattering in the deep Klein-Nishina regime and triplet pair production. We present indicative examples of the escaping gamma-ray radiation from the gap, and discuss our results in application to the TeV observations of radio galaxy M87.


title: Is gravity getting weaker at low z? Observational evidence and theoretical implications

abstract: Dynamical observational probes of the growth of density perturbations indicate that gravity may be getting weaker at low redshifts $z$. This evidence is at about $2-3\sigma$ level and comes mainly from weak lensing data that measure the parameter $S_8=\sigma_8 \sqrt{\Omega_{0m}/0.3}$ and redshift space distortion data that measure the growth rate times the amplitude of the linear power spectrum parameter $f\sigma_8 (z)$. The measured $f\sigma_8$ appears to be lower than the prediction of General Relativity (GR) in the context of the standard $\Lambda$CDM model as defined by the Planck best fit parameter values. This is the well known $f\sigma_8$ tension of $\Lambda$CDM, which constitutes one of the two main large scale challenges of the model along with the $H_0$ tension. We review the observational evidence that leads to the $f\sigma_8$ tension and discuss some theoretical implications. If this tension is not a systematic effect it may be an early hint of modified gravity with an evolving effective Newton's constant $G_{eff}$ and gravitational slip parameter $\eta$. We discuss such best fit parametrizations of $G_{eff}(z)$ and point out that they can not be reproduced by simple scalar-tensor and $f(R)$ modified gravity theories because these theories generically predict stronger gravity than General Relativity (GR) at low $z$ in the context of a $\Lambda$CDM background $H(z)$. Finally, we show weak evidence for an evolving reduced absolute magnitude of the SnIa of the Pantheon dataset at low redshifts ($z<0.1$) which may also be explained by a reduced strength of gravity and may help resolve the $H_0$ tension.


title: Placement Delivery Arrays from Combinations of Strong Edge Colorings

abstract: It has recently been pointed out in both of the works [C. Shanguan, Y. Zhang, and G. Ge, {\em IEEE Trans. Inform. Theory}, 64(8):5755-5766 (2018)] and [Q. Yan, X. Tang, Q. Chen, and M. Cheng, {\em IEEE Commun. Lett.}, 22(2):236-239 (2018)] that placement delivery arrays (PDAs), as coined in [Q. Yan, M. Cheng, X. Tang, and Q. Chen, {\em IEEE Trans. Inform. Theory}, 63(9):5821-5833 (2017)], are equivalent to strong edge colorings of bipartite graphs. In this paper we consider various methods of combining two or more strong edge colorings of bipartite graphs to obtain new ones, and therefore new PDAs. Combining PDAs in certain ways also gives a framework for obtaining PDAs with more robust and flexible parameters. We investigate how the parameters of certain strong edge colorings change after being combined with others and, after comparing the parameters of the resulting PDAs with those of the initial ones, find that subpacketization levels thusly can often be improved.


title: XGBoostLSS -- An extension of XGBoost to probabilistic forecasting

abstract: We propose a new framework of XGBoost that predicts the entire conditional distribution of a univariate response variable. In particular, XGBoostLSS models all moments of a parametric distribution (i.e., mean, location, scale and shape [LSS]) instead of the conditional mean only. Choosing from a wide range of continuous, discrete and mixed discrete-continuous distribution, modelling and predicting the entire conditional distribution greatly enhances the flexibility of XGBoost, as it allows to gain additional insight into the data generating process, as well as to create probabilistic forecasts from which prediction intervals and quantiles of interest can be derived. We present both a simulation study and real world examples that demonstrate the virtues of our approach.


title: Weakly-supervised Knowledge Graph Alignment with Adversarial Learning

abstract: This paper studies aligning knowledge graphs from different sources or languages. Most existing methods train supervised methods for the alignment, which usually require a large number of aligned knowledge triplets. However, such a large number of aligned knowledge triplets may not be available or are expensive to obtain in many domains. Therefore, in this paper we propose to study aligning knowledge graphs in fully-unsupervised or weakly-supervised fashion, i.e., without or with only a few aligned triplets. We propose an unsupervised framework to align the entity and relation embddings of different knowledge graphs with an adversarial learning framework. Moreover, a regularization term which maximizes the mutual information between the embeddings of different knowledge graphs is used to mitigate the problem of mode collapse when learning the alignment functions. Such a framework can be further seamlessly integrated with existing supervised methods by utilizing a limited number of aligned triples as guidance. Experimental results on multiple datasets prove the effectiveness of our proposed approach in both the unsupervised and the weakly-supervised settings.


title: Analytical Solutions for N-Electron Interacting System Confined in Graph of Coupled Electrostatic Semiconductor and Superconducting Quantum Dots in Tight-Binding Model with Focus on Quantum Information Processing

abstract: Analytical solutions for a tight-binding model are presented for a position-based qubit and N interacting qubits realized by quasi-one-dimensional network of coupled quantum dots expressed by connected or disconnected graphs of any topology in 2 and 3 dimensions where one electron is presented at each separated graphs. Electron(s) quantum dynamic state is described under various electromagnetic circumstances with an omission spin degree-of-freedom. The action of Hadamard and phase rotating gate is given by analytical formulas derived and formulated for any case of physical field evolution preserving the occupancy of two-energy level system. The procedure for heating up and cooling down of the quantum state placed in position based qubit is described. The interaction of position-based qubit with electromagnetic cavity is described. In particular non-local communication between position based qubits is given. It opens the perspective of implementation of quantum internet among electrostatic CMOS quantum computers (quantum chips). The interface between superconducting Josephson junction and semiconductor position-based qubit implemented in coupled semiconductor q-dots is described such that it can be the base for electrostatic interface between superconducting and semiconductor quantum computer. Modification of Andreev Bound State in Josephson junction by the presence of semiconductor qubit in its proximity and electrostatic interaction with superconducting qubit is spotted by the minimalistic tight-binding model. The obtained results allow in creating interface between semiconductor quantum computer and superconducting quantum computer. They open the perspective of construction of QISKIT like software that will describe both types of quantum computers as well as their interface.


title: Instabilities and Turbulence in Low-$\beta$ Guide Field Reconnection Exhausts with Kinetic Riemann Simulations

abstract: The role of turbulence in low-$\beta$, guide-field reconnection exhausts is explored in 2D reconnection and 2D and 3D Riemann simulations. The structure of the exhaust and associated turbulence is controlled by a pair of rotational discontinuities (RDs) at the exhaust boundary and a pair of slow shocks (SSs) that are generated by counterstreaming ions beams. In 2D the exhaust develops large-amplitude striations at the ion Larmor radius scale that are produced by electron-beam-driven ion cyclotron waves. The electron beams driving the instability are injected into the exhaust from one of the RDs. However, in 3D Riemann simulations, the additional dimension (in the out-of-plane direction) results in strong Buneman and electron-electron streaming instabilities at the RD which suppress electron beam formation and therefore the striations in the exhaust. The strength of the streaming instabilities at the RD are controlled by the ratio of the electron thermal speed to Alfv\'en speed, lower thermal speed being more unstable. In the 3D simulations an ion-ion streaming instability acts to partially thermalize the counterstreaming ion beams at the SSs. This instability is controlled by the ratio of the sound speed to Alfv\'en speed and is expected to be stable in the low $\beta$ solar corona. The results suggest that in a guide field reconnection exhaust with $1 \gg \beta > m_e/m_i$, the kinetic-scale turbulence that develops will be too weak to play a significant role in energy conversion and particle acceleration. Therefore, the energy conversion will be mostly controlled by laminar physics or multi-x-line reconnection.


title: Towards Testing Monotonicity of Distributions Over General Posets

abstract: In this work, we consider the sample complexity required for testing the monotonicity of distributions over partial orders. A distribution $p$ over a poset is monotone if, for any pair of domain elements $x$ and $y$ such that $x \preceq y$, $p(x) \leq p(y)$. To understand the sample complexity of this problem, we introduce a new property called bigness over a finite domain, where the distribution is $T$-big if the minimum probability for any domain element is at least $T$. We establish a lower bound of $\Omega(n/\log n)$ for testing bigness of distributions on domains of size $n$. We then build on these lower bounds to give $\Omega(n/\log{n})$ lower bounds for testing monotonicity over a matching poset of size $n$ and significantly improved lower bounds over the hypercube poset. We give sublinear sample complexity bounds for testing bigness and for testing monotonicity over the matching poset. We then give a number of tools for analyzing upper bounds on the sample complexity of the monotonicity testing problem.


title: Correlated timing noise and high precision pulsar timing: Measuring frequency second derivatives as an example

abstract: We investigate the impact of noise processes on high-precision pulsar timing. Our analysis focuses on the measurability of the second spin frequency derivative $\ddot{\nu}$. This $\ddot{\nu}$ can be induced by several factors including the radial velocity of a pulsar. We use Bayesian methods to model the pulsar times-of-arrival in the presence of red timing noise and dispersion measure variations, modelling the noise processes as power laws. Using simulated times-of-arrival that both include red noise, dispersion measure variations and non-zero $\ddot{\nu}$ values, we find that we are able to recover the injected $\ddot{\nu}$, even when the noise model used to inject and recover the input parameters are different. Using simulations, we show that the measurement uncertainty on $\ddot{\nu}$ decreases with the timing baseline $T$ as $T^\gamma$, where $\gamma=-7/2+\alpha/2$ for power law noise models with shallow power law indices $\alpha$ ($0<\alpha<4$). For steep power law indices ($\alpha>8$), the measurement uncertainty reduces with $T^{-1/2}$. We applied this method to times-of-arrival from the European Pulsar Timing Array and the Parkes Pulsar Timing Array and determined $\ddot{\nu}$ probability density functions for 49 millisecond pulsars. We find a statistically significant $\ddot{\nu}$ value for PSR\,B1937+21 and consider possible options for its origin. Significant (95 per cent C.L.) values for $\ddot{\nu}$ are also measured for PSRs\,J0621+1002 and J1022+1001, thus future studies should consider including it in their ephemerides. For binary pulsars with small orbital eccentricities, like PSR\,J1909$-$3744, extended ELL1 models should be used to overcome computational issues. The impacts of our results on the detection of gravitational waves are also discussed.


title: Demonstration of a time scale based on a stable optical carrier

abstract: We demonstrate a time scale based on a phase stable optical carrier that accumulates an estimated time error of $48\pm94$ ps over 34 days of operation. This all-optical time scale is formed with a cryogenic silicon cavity exhibiting improved long-term stability and an accurate $^{87}$Sr lattice clock. We show that this new time scale architecture outperforms existing microwave time scales, even when they are steered to optical frequency standards. Our analysis indicates that this time scale is capable of reaching a stability below $1\times10^{-17}$ after a few months of averaging, making timekeeping at the $10^{-18}$ level a realistic prospect.


title: Strict quantization of coadjoint orbits

abstract: We obtain a family of strict $\hat G$-invariant products on the space of holomorphic functions on a semisimple coadjoint orbit of a complex connected semisimple Lie group $\hat G$. By restriction, we also obtain strict $G$-invariant products $*_\hbar$ on a space $A(O)$ of certain analytic functions on a semisimple coadjoint orbit $O$ of a real connected semisimple Lie group $G$. The space $A(O)$ endowed with one of the products $*_\hbar$ is a Fr\'echet algebra, and the formal expansion of the products around $\hbar = 0$ determines a formal deformation quantization of $O$, which is of Wick type if $G$ is compact. We study a generalization of a Wick rotation, which provides isomorphisms between the quantizations obtained for different real orbits with the same complexification. Our construction relies on an explicit computation of the canonical element of the Shapovalov pairing between generalized Verma modules, and complex analytic results on the extension of holomorphic functions.


title: Bayesian Nonparametric Nonhomogeneous Poisson Process with Applications to USGS Earthquake Data

abstract: Intensity estimation is a common problem in statistical analysis of spatial point pattern data. This paper proposes a nonparametric Bayesian method for estimating the spatial point process intensity based on mixture of finite mixture (MFM) model. MFM approach leads to a consistent estimate of the intensity of spatial point patterns in different areas while considering heterogeneity. An efficient Markov chain Monte Carlo (MCMC) algorithm is proposed for our method. Extensive simulation studies are carried out to examine empirical performance of the proposed method. The usage of our proposed method is further illustrated with the analysis of the Earthquake Hazards Program of United States Geological Survey (USGS) earthquake data.


title: Applying a Pre-trained Language Model to Spanish Twitter Humor Prediction

abstract: Our entry into the HAHA 2019 Challenge placed $3^{rd}$ in the classification task and $2^{nd}$ in the regression task. We describe our system and innovations, as well as comparing our results to a Naive Bayes baseline. A large Twitter based corpus allowed us to train a language model from scratch focused on Spanish and transfer that knowledge to our competition model. To overcome the inherent errors in some labels we reduce our class confidence with label smoothing in the loss function. All the code for our project is included in a GitHub repository for easy reference and to enable replication by others.


title: A new family of series expansions for $1/\pi$ and a binomial identity

abstract: A doubly infinite set of series expansion for $1/\pi$ are reported. They follow trivially from a formal expansion for the quotient of the values taken by the gamma function for two (complex) arguments differing by an integer plus one half, obtained by an alternative computation of the Wronskian of the modified Bessel functions. The same formal expansion allows to discover also a new binomial identity.


title: I Am Not What I Write: Privacy Preserving Text Representation Learning

abstract: Online users generate tremendous amounts of textual information by participating in different activities, such as writing reviews and sharing tweets. This textual data provides opportunities for researchers and business partners to study and understand individuals. However, this user-generated textual data not only can reveal the identity of the user but also may contain individual's private information (e.g., age, location, gender). Hence, "you are what you write" as the saying goes. Publishing the textual data thus compromises the privacy of individuals who provided it. The need arises for data publishers to protect people's privacy by anonymizing the data before publishing it. It is challenging to design effective anonymization techniques for textual information which minimizes the chances of re-identification and does not contain users' sensitive information (high privacy) while retaining the semantic meaning of the data for given tasks (high utility). In this paper, we study this problem and propose a novel double privacy preserving text representation learning framework, DPText, which learns a textual representation that (1) is differentially private, (2) does not contain private information and (3) retains high utility for the given task. Evaluating on two natural language processing tasks, i.e., sentiment analysis and part of speech tagging, we show the effectiveness of this approach in terms of preserving both privacy and utility.


title: Testing Mixtures of Discrete Distributions

abstract: There has been significant study on the sample complexity of testing properties of distributions over large domains. For many properties, it is known that the sample complexity can be substantially smaller than the domain size. For example, over a domain of size $n$, distinguishing the uniform distribution from distributions that are far from uniform in $\ell_1$-distance uses only $O(\sqrt{n})$ samples. However, the picture is very different in the presence of arbitrary noise, even when the amount of noise is quite small. In this case, one must distinguish if samples are coming from a distribution that is $\epsilon$-close to uniform from the case where the distribution is $(1-\epsilon)$-far from uniform. The latter task requires nearly linear in $n$ samples [Valiant 2008, Valian and Valiant 2011]. In this work, we present a noise model that on one hand is more tractable for the testing problem, and on the other hand represents a rich class of noise families. In our model, the noisy distribution is a mixture of the original distribution and noise, where the latter is known to the tester either explicitly or via sample access; the form of the noise is also known a priori. Focusing on the identity and closeness testing problems leads to the following mixture testing question: Given samples of distributions $p, q_1,q_2$, can we test if $p$ is a mixture of $q_1$ and $q_2$? We consider this general question in various scenarios that differ in terms of how the tester can access the distributions, and show that indeed this problem is more tractable. Our results show that the sample complexity of our testers are exactly the same as for the classical non-mixture case.


title: TEAGS: Time-aware Text Embedding Approach to Generate Subgraphs

abstract: Contagions (e.g. virus, gossip) spread over the nodes in propagation graphs. We can use the temporal and textual data of the nodes to compute the edge weights and then generate subgraphs with highly relevant nodes. This is beneficial to many applications. Yet, challenges abound. First, the propagation pattern between each pair of nodes may change by time. Second, not always the same contagion propagates. Hence, the state-of-the-art text mining approaches including topic-modeling cannot effectively compute the edge weights. Third, since the propagation is affected by time, the word-word co-occurrence patterns may differ in various temporal dimensions, that can decrease the effectiveness of word embedding approaches. We argue that multi-aspect temporal dimensions (hour, day, etc) should be considered to better calculate the correlation weights between the nodes. In this work, we devise a novel framework that on the one hand, integrates a neural network based time-aware word embedding component to construct the word vectors through multiple temporal facets, and on the other hand, uses a temporal generative model to compute the weights. Subsequently, we propose a Max-Heap Graph cutting algorithm to generate subgraphs. We validate our model through comprehensive experiments on real-world datasets. The results show that our model can retrieve the subgraphs more effective than other rivals and the temporal dynamics should be noticed both in word embedding and propagation processes.


title: Volume Doubling Condition and a Local Poincar\'e Inequality on Unweighted Random Geometric Graphs

abstract: The aim of this paper is to establish two fundamental measure-metric properties of particular random geometric graphs. We consider $\varepsilon$-neighborhood graphs whose vertices are drawn independently and identically distributed from a common distribution defined on a regular submanifold of $\mathbb{R}^K$. We show that a volume doubling condition (VD) and local Poincar\'e inequality (LPI) hold for the random geometric graph (with high probability, and uniformly over all shortest path distance balls in a certain radius range) under suitable regularity conditions of the underlying submanifold and the sampling distribution.


title: Anyons and Fractional Quantum Hall Effect in Fractal Dimensions

abstract: The fractional quantum Hall effect is a paradigm of topological order and has been studied thoroughly in two dimensions. Here, we construct a new type of fractional quantum Hall system, which has the special property that it lives in fractal dimensions. We provide analytical wave functions and exact few-body parent Hamiltonians, and we show numerically for several different Hausdorff dimensions between 1 and 2 that the systems host anyons. We also find examples of fractional quantum Hall physics in fractals with Hausdorff dimension 1 and ln(4)/ln(5). Our results suggest that the local structure of the investigated fractals is more important than the Hausdorff dimension to determine whether the systems are in the desired topological phase. The study paves the way for further investigations of strongly-correlated topological systems in fractal dimensions.


title: Graph decompositions in projective geometries

abstract: Let PG$(\mathbb{F}_q^v)$ be the $(v-1)$-dimensional projective space over $\mathbb{F}_q$ and let $\Gamma$ be a simple graph of order ${q^k-1\over q-1}$ for some $k$. A 2$-(v,\Gamma,\lambda)$ design over $\mathbb{F}_q$ is a collection $\cal B$ of graphs (\textit{blocks}) isomorphic to $\Gamma$ with the following properties: the vertex set of every block is a subspace of PG$(\mathbb{F}_q^v)$; every two distinct points of PG$(\mathbb{F}_q^v)$ are adjacent in exactly $\lambda$ blocks. This new definition covers, in particular, the well known concept of a 2$-(v,k,\lambda)$ design over $\mathbb{F}_q$ corresponding to the case that $\Gamma$ is complete. In this work of a foundational nature we illustrate how difference methods allow us to get concrete non-trivial examples of $\Gamma$-decompositions over $\mathbb{F}_2$ or $\mathbb{F}_3$ for which $\Gamma$ is a cycle, a path, a prism, a generalized Petersen graph, or a Moebius ladder. In particular, we will discuss in detail the special and very hard case that $\Gamma$ is complete and $\lambda=1$, i.e., the Steiner 2-designs over a finite field. Also, we briefly touch the new topic of near resolvable 2-$(v,2,1)$ designs over $\mathbb{F}_q$. This study has led us to some (probably new) collateral problems concerning difference sets. Supported by multiple examples, we conjecture the existence of infinite families of $\Gamma$-decompositions over a finite field that can be obtained by suitably labeling the vertices of $\Gamma$ with the elements of a Singer difference set.


title: Optimizing Xeon Phi for Interactive Data Analysis

abstract: The Intel Xeon Phi manycore processor is designed to provide high performance matrix computations of the type often performed in data analysis. Common data analysis environments include Matlab, GNU Octave, Julia, Python, and R. Achieving optimal performance of matrix operations within data analysis environments requires tuning the Xeon Phi OpenMP settings, process pinning, and memory modes. This paper describes matrix multiplication performance results for Matlab and GNU Octave over a variety of combinations of process counts and OpenMP threads and Xeon Phi memory modes. These results indicate that using KMP_AFFINITY=granlarity=fine, taskset pinning, and all2all cache memory mode allows both Matlab and GNU Octave to achieve 66% of the practical peak performance for process counts ranging from 1 to 64 and OpenMP threads ranging from 1 to 64. These settings have resulted in generally improved performance across a range of applications and has enabled our Xeon Phi system to deliver significant results in a number of real-world applications.


title: Multimodal Fusion with Deep Neural Networks for Audio-Video Emotion Recognition

abstract: This paper presents a novel deep neural network (DNN) for multimodal fusion of audio, video and text modalities for emotion recognition. The proposed DNN architecture has independent and shared layers which aim to learn the representation for each modality, as well as the best combined representation to achieve the best prediction. Experimental results on the AVEC Sentiment Analysis in the Wild dataset indicate that the proposed DNN can achieve a higher level of Concordance Correlation Coefficient (CCC) than other state-of-the-art systems that perform early fusion of modalities at feature-level (i.e., concatenation) and late fusion at score-level (i.e., weighted average) fusion. The proposed DNN has achieved CCCs of 0.606, 0.534, and 0.170 on the development partition of the dataset for predicting arousal, valence and liking, respectively.


title: Composable Core-sets for Determinant Maximization: A Simple Near-Optimal Algorithm

abstract: ``Composable core-sets'' are an efficient framework for solving optimization problems in massive data models. In this work, we consider efficient construction of composable core-sets for the determinant maximization problem. This can also be cast as the MAP inference task for determinantal point processes, that have recently gained a lot of interest for modeling diversity and fairness. The problem was recently studied in [IMOR'18], where they designed composable core-sets with the optimal approximation bound of $\tilde O(k)^k$. On the other hand, the more practical Greedy algorithm has been previously used in similar contexts. In this work, first we provide a theoretical approximation guarantee of $O(C^{k^2})$ for the Greedy algorithm in the context of composable core-sets; Further, we propose to use a Local Search based algorithm that while being still practical, achieves a nearly optimal approximation bound of $O(k)^{2k}$; Finally, we implement all three algorithms and show the effectiveness of our proposed algorithm on standard data sets.


title: Comment on: Observation of a first order phase transition to metal hydrogen near 425 GPa

abstract: Loubeyre, Occelli, and Dumas (LOD) [1] claim to have produced metallic hydrogen (MH) at a pressure of 425 GPa, without the necessary supporting evidence of an insulator to metal transition. The paper is much ado about nothing. Most of the results have been reported earlier. Zha, Liu, and Hemley [2] studied hydrogen at low temperature up to 360 GPa in 2012; they reported absorption studies up to 0.1eV. Eremets et al [3] studied dense hydrogen up to 480 GPa using standard bevel diamonds. They reported darkening of the sample and electrical conductivity in which they reported semi-metallic behavior around 440 GPa. In 2016 Dias, Noked, and Silvera [4] reported hydrogen was opaque at 420 GPa. In 2017 Dias and Silvera observed atomic metallic hydrogen at 495 GPa in the temperature range 5.5-83 K [5].


title: What graph neural networks cannot learn: depth vs width

abstract: This paper studies the expressive power of graph neural networks falling within the message-passing framework (GNNmp). Two results are presented. First, GNNmp are shown to be Turing universal under sufficient conditions on their depth, width, node attributes, and layer expressiveness. Second, it is discovered that GNNmp can lose a significant portion of their power when their depth and width is restricted. The proposed impossibility statements stem from a new technique that enables the repurposing of seminal results from distributed computing and leads to lower bounds for an array of decision, optimization, and estimation problems involving graphs. Strikingly, several of these problems are deemed impossible unless the product of a GNNmp's depth and width exceeds a polynomial of the graph size; this dependence remains significant even for tasks that appear simple or when considering approximation.


title: Solutions for fourth-order Kirchhoff type elliptic equations involving concave-convex nonlinearities in $\mathbb{R}^{N}$

abstract: In this paper, we show the existence and multiplicity of solutions for the following fourth-order Kirchhoff type elliptic equations \begin{eqnarray*} \Delta^{2}u-M(\|\nabla u\|_{2}^{2})\Delta u+V(x)u=f(x,u),\ \ \ \ \ x\in \mathbb{R}^{N}, \end{eqnarray*} where $M(t):\mathbb{R}\rightarrow\mathbb{R}$ is the Kirchhoff function, $f(x,u)=\lambda k(x,u)+ h(x,u)$, $\lambda\geq0$, $k(x,u)$ is of sublinear growth and $h(x,u)$ satisfies some general 3-superlinear growth conditions at infinity. We show the existence of at least one solution for above equations for $\lambda=0$. For $\lambda>0$ small enough, we obtain at least two nontrivial solutions. Furthermore, if $f(x,u)$ is odd in $u$, we show that above equations possess infinitely many solutions for all $\lambda\geq0$. Our theorems generalize some known results in the literatures even for $\lambda=0$ and our proof is based on the variational methods.


title: Fast and Simple Edge-Coloring Algorithms

abstract: We develop sequential algorithms for constructing edge-colorings of graphs and multigraphs efficiently and using few colors. Our primary focus is edge-coloring arbitrary simple graphs using $d+1$ colors, where $d$ is the largest vertex degree in the graph. Vizing's Theorem states that every simple graph can be edge-colored using $d+1$ colors. Although some graphs can be edge-colored using only $d$ colors, it is NP-hard to recognize graphs of this type [Holyer, 1981]. So using $d+1$ colors is a natural goal. Efficient techniques for $(d+1)$-edge-coloring were developed by Gabow, Nishizeki, Kariv, Leven, and Terada in 1985, and independently by Arjomandi in 1982, leading to algorithms that run in $O(|E| \sqrt{|V| \log |V|})$ time. They have remained the fastest known algorithms for this task. We improve the runtime to $O(|E| \sqrt{|V|})$ with a small modification and careful analysis. We then develop a randomized version of the algorithm that is much simpler to implement and has the same asymptotic runtime, with very high probability. On the way to these results, we give a simple algorithm for $(2d-1)$-edge-coloring of multigraphs that runs in $O(|E|\log d)$ time. Underlying these algorithms is a general edge-coloring strategy which may lend itself to further applications.


title: Evolutionary Algorithm for Sinhala to English Translation

abstract: Machine Translation (MT) is an area in natural language processing, which focus on translating from one language to another. Many approaches ranging from statistical methods to deep learning approaches are used in order to achieve MT. However, these methods either require a large number of data or a clear understanding about the language. Sinhala language has less digital text which could be used to train a deep neural network. Furthermore, Sinhala has complex rules therefore, it is harder to create statistical rules in order to apply statistical methods in MT. This research focuses on Sinhala to English translation using an Evolutionary Algorithm (EA). EA is used to identifying the correct meaning of Sinhala text and to translate it to English. The Sinhala text is passed to identify the meaning in order to get the correct meaning of the sentence. With the use of the EA the translation is carried out. The translated text is passed on to grammatically correct the sentence. This has shown to achieve accurate results.


title: Average Gromov hyperbolicity and the Parisi ansatz

abstract: Gromov hyperbolicity of a metric space measures the distance of the space from a perfect tree-like structure. The measure has a "worst-case" aspect to it, in the sense that it detects a region in the space which sees the maximum deviation from tree-like structure. In this article we introduce an "average-case" version of Gromov hyperbolicity, which detects whether the "most of the space", with respect to a given probability measure, looks like a tree. The main result of the paper is that if this average hyperbolicity is small, then the space can be approximately embedded in a tree. The proof uses a weighted version of Szemeredi's regularity lemma from graph theory. The result applies to Gromov hyperbolic spaces as well, since average hyperbolicity is bounded above by Gromov hyperbolicity. As an application, we give a construction of hierarchically organized pure states in any model of a spin glass that satisfies the Parisi ultrametricity ansatz.


title: Fundamental local equivalences in quantum geometric Langlands

abstract: In quantum geometric Langlands, the Satake equivalence plays a less prominent role than in the classical theory. Gaitsgory--Lurie proposed a conjectural substitute, later termed the fundamental local equivalence. With a few exceptions, we prove this conjecture and its extension to the affine flag variety by using what amount to Soergel module techniques.


title: Oracle Separations Between Quantum and Non-interactive Zero-Knowledge Classes

abstract: We study the relationship between problems solvable by quantum algorithms in polynomial time and those for which zero-knowledge proofs exist. In prior work, Aaronson [arxiv:quant-ph/0111102] showed an oracle separation between BQP and SZK, i.e. an oracle $A$ such that $\mathrm{SZK}^A \not\subseteq \mathrm{BQP}^A$. In this paper we give a simple extension of Aaronson's result to non-interactive zero-knowledge proofs with perfect security. This class, NIPZK, is the most restrictive zero-knowledge class. We show that even for this class we can construct an $A$ with $\mathrm{NIPZK}^A \not\subseteq \mathrm{BQP}^A$.


title: Filaments of crime: Informing policing via thresholded ridge estimation

abstract: Objectives: We introduce a new method for reducing crime in hot spots and across cities through ridge estimation. In doing so, our goal is to explore the application of density ridges to hot spots and patrol optimization, and to contribute to the policing literature in police patrolling and crime reduction strategies. Methods: We make use of the subspace-constrained mean shift algorithm, a recently introduced approach for ridge estimation further developed in cosmology, which we modify and extend for geospatial datasets and hot spot analysis. Our experiments extract density ridges of Part I crime incidents from the City of Chicago during the year 2018 and early 2019 to demonstrate the application to current data. Results: Our results demonstrate nonlinear mode-following ridges in agreement with broader kernel density estimates. Using early 2019 incidents with predictive ridges extracted from 2018 data, we create multi-run confidence intervals and show that our patrol templates cover around 94% of incidents for 0.1-mile envelopes around ridges, quickly rising to near-complete coverage. We also develop and provide researchers, as well as practitioners, with a user-friendly and open-source software for fast geospatial density ridge estimation. Conclusions: We show that ridges following crime report densities can be used to enhance patrolling capabilities. Our empirical tests show the stability of ridges based on past data, offering an accessible way of identifying routes within hot spots instead of patrolling epicenters. We suggest further research into the application and efficacy of density ridges for patrolling.


title: Towards Robust, Locally Linear Deep Networks

abstract: Deep networks realize complex mappings that are often understood by their locally linear behavior at or around points of interest. For example, we use the derivative of the mapping with respect to its inputs for sensitivity analysis, or to explain (obtain coordinate relevance for) a prediction. One key challenge is that such derivatives are themselves inherently unstable. In this paper, we propose a new learning problem to encourage deep networks to have stable derivatives over larger regions. While the problem is challenging in general, we focus on networks with piecewise linear activation functions. Our algorithm consists of an inference step that identifies a region around a point where linear approximation is provably stable, and an optimization step to expand such regions. We propose a novel relaxation to scale the algorithm to realistic models. We illustrate our method with residual and recurrent networks on image and sequence datasets.


title: Braiding photonic topological zero modes

abstract: A remarkable property of quantum mechanics in two-dimensional (2D) space is its ability to support "anyons," particles that are neither fermions nor bosons. Theory predicts that these exotic excitations can be realized as bound states confined near topological defects, like Majorana zero modes trapped in vortices in topological superconductors. Intriguingly, in the simplest cases the nontrivial phase that arises when such defects are "braided" around one another is not intrinsically quantum mechanical; rather, it can be viewed as a manifestation of the geometric (Pancharatnam-Berry) phase in wave mechanics, enabling the simulation of such phenomena in classical systems. Here we report the first experimental measurement in any system, quantum or classical, of the geometric phase due to such a braiding process. These measurements are obtained using an interferometer constructed from highly tunable 2D arrays of photonic waveguides. Our results introduce photonic lattices as a versatile playground for the experimental study of topological defects and their braiding, complementing ongoing efforts in solid-state systems and cold atomic gases.

categories: physics.optics cond-mat.mes-hall cond-mat.quant-gas quant-ph


title: Characterizing Giry-algebras as coseparable super convex spaces

abstract: We investigate the Eilenberg-Moore algebras for the Giry monad defined on the category of measurable spaces using super convex spaces. The category of super convex spaces has a subcategory consisting of the one point extension of the real line, and the truncated Yoneda embedding arising from the full subcategory with that one object is full, although it is not faithful. By restricting to those super convex spaces which are coseparable by the one point extension of the real line, the truncated Yoneda embedding is full and faithful. This permits the construction of a barycenter map used to factorize the Giry monad, and obtain an equivalence of categories.


title: Car following behavioral stochasticity analysis and modelling: Perspective from wave travel time

abstract: This paper analyzes the car following behavioral stochasticity based on two sets of field experimental trajectory data by measuring the wave travel time series of vehicle n. The analysis shows that (i) No matter the speed of leading vehicle oscillates significantly or slightly, wave travel time might change significantly; (ii) A follower's wave travel time can vary from run to run even the leader travels at the same stable speed; (iii) Sometimes, even if the leader speed fluctuates significantly, the follower can keep a nearly constant value of wave travel time. The Augmented Dickey-Fuller test indicates that the time series the changing rate of wave travel time follows a mean reversion process, no matter the oscillations fully developed or not. Based on the finding, a simple stochastic Newell model is proposed. The concave growth pattern of traffic oscillations has been derived analytically. Furthermore, simulation results demonstrate that the new model well captures both macroscopic characteristic of traffic flow evolution and microscopic characteristic of car following.


title: Convolutional dictionary learning based auto-encoders for natural exponential-family distributions

abstract: We introduce a class of auto-encoder neural networks tailored to data from the natural exponential family (e.g., count data). The architectures are inspired by the problem of learning the filters in a convolutional generative model with sparsity constraints, often referred to as convolutional dictionary learning (CDL). Our work is the first to combine ideas from convolutional generative models and deep learning for data that are naturally modeled with a non-Gaussian distribution (e.g., binomial and Poisson). This perspective provides us with a scalable and flexible framework that can be re-purposed for a wide range of tasks and assumptions on the generative model. Specifically, the iterative optimization procedure for solving CDL, an unsupervised task, is mapped to an unfolded and constrained neural network, with iterative adjustments to the inputs to account for the generative distribution. We also show that the framework can easily be extended for discriminative training, appropriate for a supervised task. We demonstrate 1) that fitting the generative model to learn, in an unsupervised fashion, the latent stimulus that underlies neural spiking data leads to better goodness-of-fit compared to other baselines, 2) competitive performance compared to state-of-the-art algorithms for supervised Poisson image denoising, with significantly fewer parameters, and 3) gradient dynamics of shallow binomial auto-encoder.


title: New $N_f=2$ Pseudofermion Action for Monte-Carlo Simulation of Lattice Field Theory with Domain-Wall Fermions

abstract: We construct a novel $ N_f = 2 $ pseudofermion action for Monte-Carlo simulation of lattice gauge theory with domain-wall fermions (DWF), of which the effective four-dimensional lattice Dirac operator is equal to the overlap-Dirac operator with the argument of the sign function equal to $ H = c \gamma_5 D_w (1 + d D_w)^{-1} $, where $ c $ and $ d $ are parameters, and $D_w$ is the standard Wilson-Dirac operator plus a negative parameter $-m_0 \; (0 < m_0 < 2)$. This new action is particularly useful for the challenging simulations of lattice gauge theories with large $N_f = 2n $ DWF, on the large lattices, and in the strong-coupling regime.


title: A constructive proof of Pokrzywa's theorem about perturbations of matrix pencils

abstract: Our purpose is to give new proofs of several known results about perturbations of matrix pencils. Andrzej Pokrzywa (1986) described the closure of orbit of a Kronecker canonical pencil $A-\lambda B$ in terms of inequalities with pencil invariants. In more detail, Pokrzywa described all Kronecker canonical pencils $K-\lambda L$ such that each neighborhood of $A-\lambda B$ contains a pencil whose Kronecker canonical form is $K-\lambda L$. Another solution of this problem was given by Klaus Bongartz (1996) by methods of representation theory. We give a direct and constructive proof of Pokrzywa's theorem. We reduce its proof to the cases of matrices under similarity and of matrix pencils $P-\lambda Q$ that are direct sums of two indecomposable Kronecker canonical pencils. We calculate the Kronecker forms of all pencils in a neighborhood of such a pencil $P-\lambda Q$. In fact, we calculate the Kronecker forms of only those pencils that belong to a miniversal deformation of $P-\lambda Q$, which is sufficient since all pencils in a neighborhood of $P-\lambda Q$ are reduced to them by smooth strict equivalence transformations.


title: Eigenvalue estimates via H\"{o}mander's $L^2$-method

abstract: Under various elliptic boundary conditions, we obtain lower eigenvalue estimates for Dirac operators by using Hormander's weighted $L^2$-technique. Lower bounds in terms of the volume of the underlying manifolds are also deduced from the sharp Sobolev inequality due to Li and Zhu(\cite{LZ}).


title: Stochastic Gradient and Langevin Processes

abstract: We prove quantitative convergence rates at which discrete Langevin-like processes converge to the invariant distribution of a related stochastic differential equation. We study the setup where the additive noise can be non-Gaussian and state-dependent and the potential function can be non-convex. We show that the key properties of these processes depend on the potential function and the second moment of the additive noise. We apply our theoretical findings to studying the convergence of Stochastic Gradient Descent (SGD) for non-convex problems and corroborate them with experiments using SGD to train deep neural networks on the CIFAR-10 dataset.


title: Is supernilpotence super nilpotence?

abstract: We show that the answer to the question in the title is: ``Yes, for finite algebras.''


title: Adaptive Weighting Depth-variant Deconvolution of Fluorescence Microscopy Images with Convolutional Neural Network

abstract: Fluorescence microscopy plays an important role in biomedical research. The depth-variant point spread function (PSF) of a fluorescence microscope produces low-quality images especially in the out-of-focus regions of thick specimens. Traditional deconvolution to restore the out-of-focus images is usually insufficient since a depth-invariant PSF is assumed. This article aims at handling fluorescence microscopy images by learning-based depth-variant PSF and reducing artifacts. We propose adaptive weighting depth-variant deconvolution (AWDVD) with defocus level prediction convolutional neural network (DelpNet) to restore the out-of-focus images. Depth-variant PSFs of image patches can be obtained by DelpNet and applied in the afterward deconvolution. AWDVD is adopted for a whole image which is patch-wise deconvolved and appropriately cropped before deconvolution. DelpNet achieves the accuracy of 98.2%, which outperforms the best-ever one using the same microscopy dataset. Image patches of 11 defocus levels after deconvolution are validated with maximum improvement in the peak signal-to-noise ratio and structural similarity index of 6.6 dB and 11%, respectively. The adaptive weighting of the patch-wise deconvolved image can eliminate patch boundary artifacts and improve deconvolved image quality. The proposed method can accurately estimate depth-variant PSF and effectively recover out-of-focus microscopy images. To our acknowledge, this is the first study of handling out-of-focus microscopy images using learning-based depth-variant PSF. Facing one of the most common blurs in fluorescence microscopy, the novel method provides a practical technology to improve the image quality.


title: Detecting and Directing Single Molecule Binding Events on H-Si(100) with Application to Ultra-dense Data Storage

abstract: Many new material systems are being explored to enable smaller, more capable and energy efficient devices. These bottom up approaches for atomic and molecular electronics, quantum computation, and data storage all rely on a well-developed understanding of materials at the atomic scale. Here, we report a versatile scanning tunneling microscope (STM) charge characterization technique, which reduces the influence of the typically perturbative STM tip field, to develop this understanding even further. Using this technique, we can now observe single molecule binding events to atomically defined reactive sites (fabricated on a hydrogen-terminated silicon surface) through electronic detection. We then developed a new error correction tool for automated hydrogen lithography, directing molecular hydrogen binding events using these sites to precisely repassivate surface dangling bonds (without the use of a scanned probe). We additionally incorporated this molecular repassivation technique as the primary rewriting mechanism in new ultra-dense atomic data storage designs (0.88 petabits per in$^{2}$).


title: Data-Driven Distributionally Robust Appointment Scheduling over Wasserstein Balls

abstract: We study a single-server appointment scheduling problem with a fixed sequence of appointments, for which we must determine the arrival time for each appointment. We specifically examine two stochastic models. In the first model, we assume that all appointees show up at the scheduled arrival times yet their service durations are random. In the second model, we assume that appointees have random no-show behaviors and their service durations are random given that they show up at the appointments. In both models, we assume that the probability distribution of the uncertain parameters is unknown but can be partially observed via a set of historical data, which we view as independent samples drawn from the unknown distribution. In view of the distributional ambiguity, we propose a data-driven distributionally robust optimization (DRO) approach to determine an appointment schedule such that the worst-case (i.e., maximum) expectation of the system total cost is minimized. A key feature of this approach is that the optimal value and the set of optimal schedules thus obtained provably converge to those of the true model, i.e., the stochastic appointment scheduling model with regard to the true probability distribution of the uncertain parameters. While our DRO models are computationally intractable in general, we reformulate them to copositive programs, which are amenable to tractable semidefinite programming problems with high-quality approximations. Furthermore, under some mild conditions, we recast these models as polynomial-sized linear programs. Through an extensive numerical study, we demonstrate that our approach yields better out-of-sample performance than two state-of-the-art methods.


title: Skin Lesion Analyser: An Efficient Seven-Way Multi-Class Skin Cancer Classification Using MobileNet

abstract: Skin cancer, a major form of cancer, is a critical public health problem with 123,000 newly diagnosed melanoma cases and between 2 and 3 million non-melanoma cases worldwide each year. The leading cause of skin cancer is high exposure of skin cells to UV radiation, which can damage the DNA inside skin cells leading to uncontrolled growth of skin cells. Skin cancer is primarily diagnosed visually employing clinical screening, a biopsy, dermoscopic analysis, and histopathological examination. It has been demonstrated that the dermoscopic analysis in the hands of inexperienced dermatologists may cause a reduction in diagnostic accuracy. Early detection and screening of skin cancer have the potential to reduce mortality and morbidity. Previous studies have shown Deep Learning ability to perform better than human experts in several visual recognition tasks. In this paper, we propose an efficient seven-way automated multi-class skin cancer classification system having performance comparable with expert dermatologists. We used a pretrained MobileNet model to train over HAM10000 dataset using transfer learning. The model classifies skin lesion image with a categorical accuracy of 83.1 percent, top2 accuracy of 91.36 percent and top3 accuracy of 95.34 percent. The weighted average of precision, recall, and f1-score were found to be 0.89, 0.83, and 0.83 respectively. The model has been deployed as a web application for public use at (https://saketchaturvedi.github.io). This fast, expansible method holds the potential for substantial clinical impact, including broadening the scope of primary care practice and augmenting clinical decision-making for dermatology specialists.


title: FC$^2$N: Fully Channel-Concatenated Network for Single Image Super-Resolution

abstract: Most current image super-resolution (SR) methods based on convolutional neural networks (CNNs) use residual learning in network structural design, which favors to effective back propagation and hence improves SR performance by increasing model scale. However, residual networks suffer from representational redundancy by introducing identity paths that impede the full exploitation of model capacity. Besides, blindly enlarging network scale can cause more problems in model training, even with residual learning. In this paper, a novel fully channel-concatenated network (FC$^2$N) is presented to make further mining of representational capacity of deep models, in which all interlayer skips are implemented by a simple and straightforward operation, i.e., weighted channel concatenation (WCC), followed by a 1$\times$1 conv layer. Based on the WCC, the model can achieve the joint attention mechanism of linear and nonlinear features in the network, and presents better performance than other state-of-the-art SR models with fewer model parameters. To our best knowledge, FC$^2$N is the first CNN model that does not use residual learning and reaches network depth over 400 layers. Moreover, it shows excellent performance in both largescale and lightweight implementations, which illustrates the full exploitation of the representational capacity of the model.


title: IRNet: A General Purpose Deep Residual Regression Framework for Materials Discovery

abstract: Materials discovery is crucial for making scientific advances in many domains. Collections of data from experiments and first-principle computations have spurred interest in applying machine learning methods to create predictive models capable of mapping from composition and crystal structures to materials properties. Generally, these are regression problems with the input being a 1D vector composed of numerical attributes representing the material composition and/or crystal structure. While neural networks consisting of fully connected layers have been applied to such problems, their performance often suffers from the vanishing gradient problem when network depth is increased. In this paper, we study and propose design principles for building deep regression networks composed of fully connected layers with numerical vectors as input. We introduce a novel deep regression network with individual residual learning, IRNet, that places shortcut connections after each layer so that each layer learns the residual mapping between its output and input. We use the problem of learning properties of inorganic materials from numerical attributes derived from material composition and/or crystal structure to compare IRNet's performance against that of other machine learning techniques. Using multiple datasets from the Open Quantum Materials Database (OQMD) and Materials Project for training and evaluation, we show that IRNet provides significantly better prediction performance than the state-of-the-art machine learning approaches currently used by domain scientists. We also show that IRNet's use of individual residual learning leads to better convergence during the training phase than when shortcut connections are between multi-layer stacks while maintaining the same number of parameters.


title: Mathematical Models of Consciousness

abstract: In recent years, promising mathematical models have been suggested which aim to describe conscious experience and its relation to the physical domain. Whereas the axioms and metaphysical ideas of these theories have been carefully motivated, their mathematical formalism has not. In this article we aim to remedy this situation. We give an account of what warrants mathematical representation of phenomenal experience, derive a general mathematical framework which takes into account consciousness' epistemic context and study which mathematical structures some of the key characteristics of conscious experience imply, showing precisely where mathematical approaches allow to go beyond what the standard methodology can do. The result is a general mathematical framework for models of consciousness that can be employed in the theory-building process.


title: Joint Lifelong Topic Model and Manifold Ranking for Document Summarization

abstract: Due to the manifold ranking method has a significant effect on the ranking of unknown data based on known data by using a weighted network, many researchers use the manifold ranking method to solve the document summarization task. However, their models only consider the original features but ignore the semantic features of sentences when they construct the weighted networks for the manifold ranking method. To solve this problem, we proposed two improved models based on the manifold ranking method. One is combining the topic model and manifold ranking method (JTMMR) to solve the document summarization task. This model not only uses the original feature, but also uses the semantic feature to represent the document, which can improve the accuracy of the manifold ranking method. The other one is combining the lifelong topic model and manifold ranking method (JLTMMR). On the basis of the JTMMR, this model adds the constraint of knowledge to improve the quality of the topic. At the same time, we also add the constraint of the relationship between documents to dig out a better document semantic features. The JTMMR model can improve the effect of the manifold ranking method by using the better semantic feature. Experiments show that our models can achieve a better result than other baseline models for multi-document summarization task. At the same time, our models also have a good performance on the single document summarization task. After combining with a few basic surface features, our model significantly outperforms some model based on deep learning in recent years. After that, we also do an exploring work for lifelong machine learning by analyzing the effect of adding feedback. Experiments show that the effect of adding feedback to our model is significant.


title: Backward Reachability for Polynomial Systems on A Finite Horizon

abstract: A method is presented to obtain an inner-approximation of the backward reachable set (BRS) of a given target tube, along with an admissible controller that maintains trajectories inside this tube. The proposed optimization algorithms are formulated as nonlinear optimization problems, which are decoupled into tractable subproblems and solved by an iterative algorithm using the polynomial S-procedure and sum-of-squares techniques. This framework is also extended to uncertain nonlinear systems with L_2 disturbances and L_{\infty} parametric uncertainties. The effectiveness of the method is demonstrated on several nonlinear robotics and aircraft systems with control saturation.


title: Impact of the Ga flux incidence angle on the growth kinetics of self-assisted GaAs nanowires on Si(111)

abstract: In this work we show that the incidence angle of group-III elements fluxes plays a significant role on the diffusion-controlled growth of III-V nanowires (NWs) by molecular beam epitaxy (MBE). We present a thorough experimental study on the self-assisted growth of GaAs NWs by using a MBE reactor equipped with two Ga cells located at different incidence angles with respect to the surface normal of the substrate, so as to ascertain the impact of such a parameter on the NW growth kinetics. The as-obtained results show a dramatic influence of the Ga flux incidence angle on the NW length and diameter, as well as on the shape and size of the Ga droplets acting as catalysts. In order to interpret the results we developed a semi-empirical analytic model inspired by those already developed for MBE-grown Au-catalyzed GaAs NWs. Numerical simulations performed with the model allow to reproduce thoroughly the experimental results (in terms of NW length and diameter and of droplet size and wetting angle), putting in evidence that under formally the same experimental conditions the incidence angle of the Ga flux is a key parameter which can drastically affect the growth kinetics of the NWs grown by MBE.


title: Graph based Neural Networks for Event Factuality Prediction using Syntactic and Semantic Structures

abstract: Event factuality prediction (EFP) is the task of assessing the degree to which an event mentioned in a sentence has happened. For this task, both syntactic and semantic information are crucial to identify the important context words. The previous work for EFP has only combined these information in a simple way that cannot fully exploit their coordination. In this work, we introduce a novel graph-based neural network for EFP that can integrate the semantic and syntactic information more effectively. Our experiments demonstrate the advantage of the proposed model for EFP.