title: Synthesis of control Lyapunov functions and stabilizing feedback strategies using exit-time optimal control

abstract: This paper studies the problem of constructing control Lyapunov functions (CLFs) and feedback stabilization strategies for deterministic nonlinear control systems described by ordinary differential equations. Many numerical methods for solving the Hamilton-Jacobi-Bellman partial differential equations specifying CLFs typically require dense state space discretizations and consequently suffer from the curse of dimensionality. A relevant direction of attenuating the curse of dimensionality concerns reducing the computation of the values of CLFs and associated feedbacks at any selected states to finite-dimensional nonlinear programming problems. In this work, exit-time optimal control is used for that purpose. First, we state an exit-time optimal control problem with respect to a sublevel set of an appropriate local CLF and establish that, under a number of reasonable conditions, the concatenation of the corresponding value function and the local CLF is a global CLF in the whole domain of asymptotic null-controllability. This leads to a curse-of-dimensionality-free approach to feedback stabilization. We also investigate the formulated optimal control problem. A modification of these constructions for the case when one does not find a suitable local CLF is provided as well. Supporting numerical simulation results that illustrate our development are subsequently presented and discussed. Furthermore, it is pointed out that the curse of complexity may cause significant issues in practical implementation even if the curse of dimensionality is mitigated.


title: Dependence of atmospheric muon flux on seawater depth measured with the first KM3NeT detection units

abstract: KM3NeT is a research infrastructure located in the Mediterranean Sea, that will consist of two deep-sea Cherenkov neutrino detectors. With one detector (ARCA), the KM3NeT Collaboration aims at identifying and studying TeV-PeV astrophysical neutrino sources. With the other detector (ORCA), the neutrino mass ordering will be determined by studying GeV-scale atmospheric neutrino oscillations. The first KM3NeT detection units were deployed at the Italian and French sites between 2015 and 2017. In this paper, a description of the detector is presented, together with a summary of the procedures used to calibrate the detector in-situ. Finally, the measurement of the atmospheric muon flux between 2232-3386 m seawater depth is obtained.


title: Cross sections to flows via intrinsically harmonic forms

abstract: We establish a new criterion for the existence of a global cross section to a non-singular volume-preserving flow on a compact manifold. Namely, if $\Phi$ is a non-singular smooth flow on a compact, connected manifold $M$ with a smooth invariant volume form $\Omega$, then $\Phi$ admits a global cross section if and only if the $(n-1)$-form $i_X \Omega$ is intrinsically harmonic, that is, harmonic with respect to some Riemannian metric on $M$.


title: Leading order corrections to the Bethe-Heitler process in the $\gamma p\rightarrow l^+l^-p$ reaction

abstract: The ratio of di-lepton production cross sections on a proton, using the $\gamma p\rightarrow l^+ l^- p$ process, above and below di-muon production threshold allows to extract the effective lepton-proton interaction, which is required to be identical for electrons and muons if lepton universality is exact. To test for a scenario of broken universality at the percent level, of the size which could explain the different proton charge radii extracted from electron scattering and from muonic hydrogen spectroscopy, we evaluate all one-loop QED corrections to this process, including the full lepton mass dependencies. We furthermore show that two-photon exchange processes with both photons attached to the proton line vanish after averaging over di-lepton angles, and estimate the relatively small radiation off the proton. We compare the full one-loop calculation with a soft-photon approximation of the same order, and present estimates for a planned experiment.


title: Unsupervised Co-Learning on $\mathcal{G}$-Manifolds Across Irreducible Representations

abstract: We introduce a novel co-learning paradigm for manifolds naturally equipped with a group action, motivated by recent developments on learning a manifold from attached fibre bundle structures. We utilize a representation theoretic mechanism that canonically associates multiple independent vector bundles over a common base manifold, which provides multiple views for the geometry of the underlying manifold. The consistency across these fibre bundles provide a common base for performing unsupervised manifold co-learning through the redundancy created artificially across irreducible representations of the transformation group. We demonstrate the efficacy of the proposed algorithmic paradigm through drastically improved robust nearest neighbor search and community detection on rotation-invariant cryo-electron microscopy image analysis.


title: Star Formation Efficiency in Low Surface Brightness Regions

abstract: Low surface brightness regions are found not only in dwarf and ultra-diffuse galaxies, but also on the outer parts of giant spirals, or in galaxy extensions (tidal or ram-pressure tails, outflows or jets). Sometimes molecular gas is detected in sufficient quantities to allow star formation, but the efficiency is much lower than in disk galaxies. This presentation reviews different environments showing low-surface brightness, their gas content and surface densities, and their star formation efficiency. Some interpretations are proposed to account for this low efficiency.


title: Higher-Order Topological Superconductivity of Spin-Polarized Fermions

abstract: We study the superconductivity of spin-polarized electrons in centrosymmetric ferromagnetic metals. Due to the spin-polarization and the Fermi statistics of electrons, the superconducting pairing function naturally has odd parity. According to the parity formula proposed by Fu, Berg, and Sato, odd-parity pairing leads to conventional first-order topological superconductivity when a normal metal has an odd number of Fermi surfaces. Here, we derive generalized parity formulae for the topological invariants characterizing higher-order topology of centrosymmetric superconductors. Based on the formulae, we systematically classify all possible band structures of ferromagnetic metals that can induce inversion-protected higher-order topological superconductivity. Among them, doped ferromagnetic nodal semimetals are identified as the most promising normal state platform for higher-order topological superconductivity. In two dimensions, we show that odd-parity pairing of doped Dirac semimetals induces a second-order topological superconductor. In three dimensions, odd-parity pairing of doped nodal line semimetals generates a nodal line topological superconductor with monopole charges. On the other hand, odd-parity pairing of doped monopole nodal line semimetals induces a three-dimensional third-order topological superconductor. Our theory shows that the combination of superconductivity and ferromagnetic nodal semimetals opens up a new avenue for future topological quantum computations using Majorana zero modes.


title: Flexible Cancer-Associated Chromatin Configuration (CACC) Might Be the Fundamental Reason Why Cancer Is So Difficult to Cure

abstract: We once proposed that cell-type-associated chromatin configurations determine cell types and that cancer cell type is determined by cancer-associated chromatin configuration (CACC). In this paper, we hypothesize that flexible cell-type-associated chromatin configuration is associated with cell potency and has an advantage over inflexible one in regulating genome related activities, such as DNA replication, DNA transcription, DNA repair, and DNA mutagenesis. The reason why cancer is so difficult to treat is because CACC is flexible, which enables cancer cells not only to produce heterogeneous subclones through limited cell differentiation, but also to maximally and efficiently use genome related resources to survive environmental changes. Therefore, to beat cancer, more efforts should be made to restrict the flexibility of CACC or to change CACC so that cancer cells can be turned back to normal or become less malignant.


title: Defect-induced magnetism and Yu-Shiba-Rusinov states in twisted bilayer graphene

abstract: Atomic defects have a significant impact in the low-energy properties of graphene systems. By means of first-principles calculations and tight-binding models we provide evidence that chemical impurities modify both the normal and the superconducting states of twisted bilayer graphene. A single hydrogen atom attached to the bilayer surface yields a triple-point crossing, whereas self-doping and three-fold symmetry-breaking are created by a vacant site. Both types of defects lead to time-reversal symmetry-breaking and the creation of local magnetic moments. Hydrogen-induced magnetism is found to exist also at the doping levels where superconductivity appears in magic angle graphene superlattices. As a result, the coexistence of superconducting order and defect-induced magnetism yields in-gap Yu-Shiba-Rusinov excitations in magic angle twisted bilayer graphene.


title: Dust properties and star formation of approximately a thousand local galaxies

abstract: [ABRIDGED] We derive the dust properties for 753 local galaxies and examine how these relate to some of their physical properties. We model their global dust-SEDs, treated statistically as an ensemble within a hierarchical Bayesian dust-SED modeling approach. The model-derived properties are the dust masses (Mdust), the average interstellar radiation field intensities (Uav), the mass fraction of very small dust grains ('QPAH' fraction), as well as their standard deviations. In addition, we use mid-IR observations to derive SFR and Mstar, quantities independent of the modeling. We derive distribution functions of the properties for the galaxy ensemble and per galaxy type. The mean value of Mdust for the ETGs is lower than that for the LTGs and IRs, despite ETGs and LTGs having Mstar spanning across the whole range observed. The Uav and 'QPAH' fraction show no difference among different galaxy types. When fixing Uav to the Galactic value, the derived 'QPAH' fraction varies across the Galactic value (0.071). The sSFR increases with galaxy type, while this is not the case for the dust-sSFR (=SFR/Mdust), showing an almost constant SFE per galaxy type. The galaxy sample is characterised by a tight relation between Mdust and Mstar for the LTGs and Irs, while ETGs scatter around this relation and tend towards smaller Mdust. While the relation indicates that Mdust may fundamentally be linked to Mstar, metallicity and Uav are the second parameter driving the scatter, which we investigate in a forthcoming work. We use the extended KS law to estimate Mgas and the GDR. The Mgas derived from the extended KS law is on average ~20% higher than that derived from the KS law, and a large standard deviation indicates the importance of the average SF present to regulate star formation and gas supply. The average GDR for the LTGs and IRs is 370, while including the ETGs gives an average of 550. [ABRIDGED]


title: The Navier--Stokes equations in exterior Lipschitz domains: $\mathrm{L}^p$-theory

abstract: We show that the Stokes operator defined on $\mathrm{L}^p_{\sigma} (\Omega)$ for an exterior Lipschitz domain $\Omega \subset \mathbb{R}^n$ $(n \geq 3)$ admits maximal regularity provided that $p$ satisfies $| 1/p - 1/2| < 1/(2n) + \varepsilon$ for some $\varepsilon > 0$. In particular, we prove that the negative of the Stokes operator generates a bounded analytic semigroup on $\mathrm{L}^p_\sigma (\Omega)$ for such $p$. In addition, $\mathrm{L}^p$-$\mathrm{L}^q$-mapping properties of the Stokes semigroup and its gradient with optimal decay estimates are obtained. This enables us to prove the existence of mild solutions to the Navier--Stokes equations in the critical space $\mathrm{L}^{\infty} (0 , T ; \mathrm{L}^3_{\sigma} (\Omega))$ (locally in time and globally in time for small initial data).


title: The CKM unitarity problem: A trace of new physics at the TeV scale?

abstract: After the recent high precision determinations of $V_{us}$ and $V_{ud}$, the first row of the CKM matrix shows more than $4\sigma$ deviation from unitarity. Two possible scenarios beyond the Standard Model can be investigated in order to fill the gap. If a 4th quark $b'$ participates in the mixing, with $\vert V_{ub'} \vert \sim0.04$, then its mass should be no more than 6 TeV or so. A different solution can come from the introduction of the gauge horizontal family symmetry acting between the lepton families and spontaneously broken at the scale of about 6 TeV. Since the gauge bosons of this symmetry contribute to muon decay in positive interference with Standard Model, the Fermi constant is slightly smaller than the muon decay constant so that unitarity is recovered. Also the neutron lifetime problem, that is about $4\sigma$ discrepancy between the neutron lifetimes measured in beam and trap experiments, is discussed in the light of the these determinations of the CKM matrix elements.


title: Visualizing and Measuring the Geometry of BERT

abstract: Transformer architectures show significant promise for natural language processing. Given that a single pretrained model can be fine-tuned to perform well on many different tasks, these networks appear to extract generally useful linguistic features. A natural question is how such networks represent this information internally. This paper describes qualitative and quantitative investigations of one particularly effective model, BERT. At a high level, linguistic features seem to be represented in separate semantic and syntactic subspaces. We find evidence of a fine-grained geometric representation of word senses. We also present empirical descriptions of syntactic representations in both attention matrices and individual word embeddings, as well as a mathematical argument to explain the geometry of these representations.


title: Relating Causal and Probabilistic Approaches to Contextuality

abstract: A primary goal in recent research on contextuality has been to extend this concept to cases of inconsistent connectedness, where observables have different distributions in different contexts. This article proposes a solution within the framework of probabilistic causal models, which extend hidden-variables theories, and then demonstrates an equivalence to the contextuality-by-default (CbD) framework. CbD distinguishes contextuality from direct influences of context on observables, defining the latter purely in terms of probability distributions. Here we take a causal view of direct influences, defining direct influence within any causal model as the probability of all latent states of the system in which a change of context changes the outcome of a measurement. Model-based contextuality (M-contextuality) is then defined as the necessity of stronger direct influences to model a full system than when considered individually. For consistently connected systems, M-contextuality agrees with standard contextuality. For general systems, it is proved that M-contextuality is equivalent to the property that any model of a system must contain "hidden influences", meaning direct influences that go in opposite directions for different latent states, or equivalently signaling between observers that carries no information. This criterion can be taken as formalizing the "no-conspiracy" principle that has been proposed in connection with CbD. M-contextuality is then proved to be equivalent to CbD-contextuality, thus providing a new interpretation of CbD-contextuality as the non-existence of a model for a system without hidden direct influences.


title: Adaptive Gradient-Based Meta-Learning Methods

abstract: We build a theoretical framework for designing and understanding practical meta-learning methods that integrates sophisticated formalizations of task-similarity with the extensive literature on online convex optimization and sequential prediction algorithms. Our approach enables the task-similarity to be learned adaptively, provides sharper transfer-risk bounds in the setting of statistical learning-to-learn, and leads to straightforward derivations of average-case regret bounds for efficient algorithms in settings where the task-environment changes dynamically or the tasks share a certain geometric structure. We use our theory to modify several popular meta-learning algorithms and improve their meta-test-time performance on standard problems in few-shot learning and federated learning.


title: The Contextuality-by-Default View of the Sheaf-Theoretic Approach to Contextuality

abstract: The Sheaf-Theoretic Contextuality (STC) theory developed by Abramsky and colleagues is a very general account of whether multiply overlapping subsets of a set, each of which is endowed with certain "local'" structure, can be viewed as inheriting this structure from a global structure imposed on the entire set. A fundamental requirement of STC is that any intersection of subsets inherit one and the same structure from all intersecting subsets. I show that when STC is applied to systems of random variables, it can be recast in the language of the Contextuality-by-Default (CbD) theory, and this allows one to extend STC to arbitrary systems, in which the requirement in question (called "consistent connectedness'" in CbD) is not necessarily satisfied. When applied to deterministic systems, such as systems of logical statements with fixed truth values, a problem arises of distinguishing lack of consistent connectedness from contextuality. I show that it can be resolved by considering systems with multiple possible deterministic realizations as quasi-probabilistic systems with Bayesian priors assigned to the realizations. Although STC and CbD have distinct native languages and distinct aims and means, the conceptual modifications presented in this paper seem to make them essentially coextensive.


title: Learning Gaussian Graphical Models with Ordered Weighted L1 Regularization

abstract: We address the task of identifying densely connected subsets of multivariate Gaussian random variables within a graphical model framework. We propose two novel estimators based on the Ordered Weighted $\ell_1$ (OWL) norm: 1) The Graphical OWL (GOWL) is a penalized likelihood method that applies the OWL norm to the lower triangle components of the precision matrix. 2) The column-by-column Graphical OWL (ccGOWL) estimates the precision matrix by performing OWL regularized linear regressions. Both methods can simultaneously identify highly correlated groups of variables and control the sparsity in the resulting precision matrix. We formulate GOWL such that it solves a composite optimization problem and establish that the estimator has a unique global solution. In addition, we prove sufficient grouping conditions for each column of the ccGOWL precision matrix estimate. We propose proximal descent algorithms to find the optimum for both estimators. For synthetic data where group structure is present, the ccGOWL estimator requires significantly reduced computation and achieves similar or greater accuracy than state-of-the-art estimators. Timing comparisons are presented and demonstrates the superior computational efficiency of the ccGOWL. We illustrate the grouping performance of the ccGOWL method on a cancer gene expression data set and an equities data set.


title: A Class of Random Recursive Tree Algorithms with Deletion

abstract: We examine a discrete random recursive tree growth process that, at each time step, either adds or deletes a node from the tree with probability $p$ and $1-p$, respectively. Node addition follows the usual uniform attachment model. For node removal, we identify a class of deletion rules guaranteeing the current tree $T_n$ conditioned on its size is uniformly distributed over its range. By using generating function theory and singularity analysis, we obtain asymptotic estimates for the expectation and variance of the tree size of $T_n$ as well as its expected leaf count and root degree. In all cases, the behavior of such trees falls into three regimes determined by the insertion probability: $p < 1/2$, $p = 1/2$ and $p > 1/2$. Interestingly, the results are independent of the specific class member deletion rule used.


title: Energy fluxes in quasi-equilibrium flows

abstract: We examine the relation between the absolute equilibrium state of the spectrally truncated Euler equations (TEE) predicted by Kraichnan (1973) to the forced and dissipated flows of the spectrally truncated Navier-Stokes (TNS) equations. In both of these idealized systems a finite number of Fourier modes is kept contained inside a sphere of radius $k_{max}$ but while the first conserves energy in the second energy is injected by a body-force $\bf{f}$ and dissipated by the viscosity $\nu$. For the TNS system stochastically forced with energy injection rate $\mathcal{I}_\mathcal{E}$ we show, using an asymptotic expansion of the Fokker-Planck equation, that in the limit of small $k_{max}\eta$ (where $\eta=(\nu^3/\mathcal{I}_\mathcal{E})^{1/4}$ the Kolmogorov lengthscale) the flow approaches the absolute equilibrium solution of Kraichnan with such an effective "temperature" so that there is a balance between the energy injection and the energy dissipation rate. Numerical simulations verify the predictions of the model for small values of $k_{max}\eta$. For intermediate values of $k_{max}\eta$ a transition from the quasi-equilibrium "thermal" state to Kolmogorov turbulence is observed. If the forcing is applied at small scales and the dissipation acts only at large scales then the equipartition spectrum appears at all scales for all values of $\nu$. In both cases a finite forward or inverse flux is present even for the cases where the flow is close to the equilibrium state solutions. However, unlike the classical turbulence where an energy cascade develops with a mean energy flux that is large compared to its fluctuations, the quasi-equilibrium state has a mean flux of energy that is subdominant to the large flux fluctuations observed.


title: Boundary conditions and localization on AdS: Part 2 General analysis

abstract: We develop the method of Green's function to evaluate the one loop determinants that arise in localization of supersymmetric field theories on $AdS$ spaces. The theories we study have at least ${\cal N}=2$ supersymmetry and normalisable boundary conditions are consistent with supersymmetry. We then show that under general assumptions the variation of the one loop determinant with respect to the localizing background reduces to a total derivative. Therefore it receives contributions only from the origin of $AdS$ and from asymptotic infinity. From expanding both the Greens function and the quadratic operators at the origin of $AdS$ and asymptotic infinity, we show that the variation of the one loop determinant is proportional to an integer. Furthermore, we show that this integer is an index of a first order differential operator. We demonstrate that these assumptions are valid for Chern-Simons theories coupled to chiral multiplets on $AdS_2\times S^1$. Finally we use our results to show that $U(N_c)$ Chern-Simons theory at level $k$ coupled to $N_f$ chiral multiplets and $N_f$ anti-chiral multiplets in the fundamental obeys level-rank duality on $AdS_2\times S^1$.


title: Search for Neutrinoless Double-Beta Decay with the Complete EXO-200 Dataset

abstract: A search for neutrinoless double-beta decay ($0\nu\beta\beta$) in $^{136}$Xe is performed with the full EXO-200 dataset using a deep neural network to discriminate between $0\nu\beta\beta$ and background events. Relative to previous analyses, the signal detection efficiency has been raised from 80.8% to 96.4$\pm$3.0% and the energy resolution of the detector at the Q-value of $^{136}$Xe $0\nu\beta\beta$ has been improved from $\sigma/E=1.23\%$ to $1.15\pm0.02\%$ with the upgraded detector. Accounting for the new data, the median 90% confidence level $0\nu\beta\beta$ half-life sensitivity for this analysis is $5.0 \cdot 10^{25}$ yr with a total $^{136}$Xe exposure of 234.1 kg$\cdot$yr. No statistically significant evidence for $0\nu\beta\beta$ is observed, leading to a lower limit on the $0\nu\beta\beta$ half-life of $3.5\cdot10^{25}$ yr at the 90% confidence level.


title: G\"odel's incompleteness theorem and universal physics theories

abstract: An ultimate universal theory -- a complete theory that accounts, via few and simple first principles, for all the phenomena already observed and that will ever be observed -- has been, and still is, the aspiration of most physicists and scientists. Yet, a basic principle that is embodied in the results of G\"{o}del's incompleteness theorems is that self-referencing leads to logical conflict or failure, as in the liar paradox or Russell's paradox. In physics theories self-referencing necessarily occurs when it is realized that the observer is also a participant in the experienced phenomena -- we, humans, are part of the universe while observing it. Therefore self-referencing, and consequently logical conflicts, are unavoidable, and any theory pretending to be universal is bound to be incomplete.


title: Non-thermal emission from the reverse shock of the youngest galactic Supernova remnant G1.9+0.3

abstract: Context. The youngest Galactic supernova remnant G1.9+0.3 is an interesting target for next generation gamma-ray observatories. So far, the remnant is only detected in the radio and the X-ray bands, but its young age of ~100 yrs and inferred shock speed of ~14,000 km/s could make it an efficient particle accelerator. Aims. We aim to model the observed radio and X-ray spectra together with the morphology of the remnant. At the same time, we aim to estimate the gamma-ray flux from the source and evaluated the prospects of its detection with future gamma-ray experiments. Methods. We performed spherical symmetric 1-D simulations with the RATPaC code, in which we simultaneously solve the transport equation for cosmic rays, the transport equation for magnetic turbulence, and the hydro-dynamical equations for the gas flow. Separately computed distributions of the particles accelerated at the forward and the reverse shock are then used to calculate the spectra of synchrotron, inverse Compton, and pion-decay radiation from the source. Results. The emission from G1.9+0.3 can be self-consistently explained within the test-particle limit. We find that the X-ray flux is dominated by emission from the forward shock while most of the radio emission originates near the reverse shock, which makes G1.9+0.3 the first remnant with non-thermal radiation detected from the reverse shock. The flux of very-high-energy gamma-ray emission from G1.9+0.3 is expected to be close to the sensitivity threshold of the Cherenkov Telescope Array, CTA. The limited time available to grow large-scale turbulence limits the maximum energy of particles to values below 100 TeV, hence G1.9+0.3 is not a PeVatron.


title: Taming the sign problem of the finite density Hubbard model via Lefschetz thimbles

abstract: We study the sign problem in the Hubbard model on the hexagonal lattice away from half-filling using the Lefschetz thimbles method. We identify the saddle points, reduce their amount, and perform quantum Monte Carlo (QMC) simulations using the holomorphic gradient flow to deform the integration contour in complex space. Finally, the results are compared against exact diagonalization (ED). We show that the sign problem can be substantially weakened, even in the regime with low temperature and large chemical potential, where standard QMC techniques exhibit an exponential decay of the average sign.


title: Soldering spin-3 opposite helicities in $D=2+1$

abstract: Here we present the `soldering' of opposite helicity states of a spin-3 particle, in $D=2+1$, into one parity doublet. The starting points may be either the sixth- or the fifth-order (in derivatives) spin-3 self-dual models of opposite helicities. The high number of derivatives avoids the use of auxiliary fields which has been so far an obstacle for a successful soldering procedure. The resulting doublet model is a new Lagrangian with six orders in derivatives and no auxiliary field. It may be regarded as a spin-3 analogue of the linearized `New Massive Gravity'. We check its particle content via a gauge invariant and Lorentz covariant analysis of the analytic structure of the two-point amplitude with the help of spin-3 analogues of the Barnes and Rivers projection operators. The particle content is alternatively confirmed in a specific non-covariant gauge by a decomposition in helicity variables. The soldered model is ghost free and contains two physical states as expected for a parity doublet.


title: Feature-level and Model-level Audiovisual Fusion for Emotion Recognition in the Wild

abstract: Emotion recognition plays an important role in human-computer interaction (HCI) and has been extensively studied for decades. Although tremendous improvements have been achieved for posed expressions, recognizing human emotions in "close-to-real-world" environments remains a challenge. In this paper, we proposed two strategies to fuse information extracted from different modalities, i.e., audio and visual. Specifically, we utilized LBP-TOP, an ensemble of CNNs, and a bi-directional LSTM (BLSTM) to extract features from the visual channel, and the OpenSmile toolkit to extract features from the audio channel. Two kinds of fusion methods, i,e., feature-level fusion and model-level fusion, were developed to utilize the information extracted from the two channels. Experimental results on the EmotiW2018 AFEW dataset have shown that the proposed fusion methods outperform the baseline methods significantly and achieve better or at least comparable performance compared with the state-of-the-art methods, where the model-level fusion performs better when one of the channels totally fails.


title: 3D-RelNet: Joint Object and Relational Network for 3D Prediction

abstract: We propose an approach to predict the 3D shape and pose for the objects present in a scene. Existing learning based methods that pursue this goal make independent predictions per object, and do not leverage the relationships amongst them. We argue that reasoning about these relationships is crucial, and present an approach to incorporate these in a 3D prediction framework. In addition to independent per-object predictions, we predict pairwise relations in the form of relative 3D pose, and demonstrate that these can be easily incorporated to improve object level estimates. We report performance across different datasets (SUNCG, NYUv2), and show that our approach significantly improves over independent prediction approaches while also outperforming alternate implicit reasoning methods.


title: Current noise geometrically generated by a driven magnet

abstract: We consider a non-equilibrium cross-response phenomenon, whereby a driven magnetization gives rise to electric shot noise (but no d.c. current). This effect is realized on a nano-scale, with a small metallic ferromagnet which is tunnel-coupled to two normal metal leads. The driving gives rise to a precessing magnetization. The geometrically generated noise is related to a non-equilibrium distribution in the ferromagnet. Our protocol provides a new channel for detecting and characterizing ferromagnetic resonance.


title: Spatial Noise Correlations in a Si/SiGe Two-Qubit Device from Bell State Coherences

abstract: We study spatial noise correlations in a Si/SiGe two-qubit device with integrated micromagnets. Our method relies on the concept of decoherence-free subspaces, whereby we measure the coherence time for two different Bell states, designed to be sensitive only to either correlated or anti-correlated noise respectively. From these measurements, we find weak correlations in low-frequency noise acting on the two qubits, while no correlations could be detected in high-frequency noise. A theoretical model and numerical simulations give further insight into the additive effect of multiple independent (anti-)correlated noise sources with an asymmetric effect on the two qubits. Such a scenario is plausible given the data and our understanding of the physics of this system. This work is highly relevant for the design of optimized quantum error correction codes for spin qubits in quantum dot arrays, as well as for optimizing the design of future quantum dot arrays.


title: A Look at the Effect of Sample Design on Generalization through the Lens of Spectral Analysis

abstract: This paper provides a general framework to study the effect of sampling properties of training data on the generalization error of the learned machine learning (ML) models. Specifically, we propose a new spectral analysis of the generalization error, expressed in terms of the power spectra of the sampling pattern and the function involved. The framework is build in the Euclidean space using Fourier analysis and establishes a connection between some high dimensional geometric objects and optimal spectral form of different state-of-the-art sampling patterns. Subsequently, we estimate the expected error bounds and convergence rate of different state-of-the-art sampling patterns, as the number of samples and dimensions increase. We make several observations about generalization error which are valid irrespective of the approximation scheme (or learning architecture) and training (or optimization) algorithms. Our result also sheds light on ways to formulate design principles for constructing optimal sampling methods for particular problems.


title: On the definition of informative vs. ignorable nuisance process

abstract: This paper is an early version. We propose to generalise the notion of "ignoring" a random process as well as the notions of informative and ignorable random processes in a very general setup and for different types of inference (Bayesian or frequentist), and for different purposes (estimation, prediction or testing). We then confront the definitions we propose to mentions or definitions of informative and ignorable processes found in the litterature. To that purpose, we provide a very general statistical framework for survey sampling in order to define precisely the notions of design and selection, and to serve to illustrate and discuss the notions proposed.


title: Inferring black hole spins and probing accretion/ejection flows in AGNs with the Athena X-ray Integral Field Unit

abstract: Active Galactic Nuclei (AGN) display complex X-ray spectra which exhibit a variety of emission and absorption features, that are commonly interpreted as a combination of i) a relativistically smeared reflection component, resulting from the irradiation of an accretion disk by a compact hard X-ray source, ii) one or several warm/ionized absorption components produced by AGN-driven outflows crossing our line of sight, and iii) a non relativistic reflection component produced by more distant material. Disentangling these components via detailed model fitting can thus be used to constrain the black hole spin, the geometry and characteristics of the accretion flow, as well as of the outflows and surroundings of the black hole. We investigate how a high throughput high resolution X-ray spectrometer, such as the Athena X-ray Integral Field Unit (X-IFU) can be used to this aim, using the state of the art reflection model Relxill in a lamp post geometrical configuration. We simulate a representative sample of AGN spectra, including all necessary model complexities, as well as a range of model parameters going from standard to more extreme values, and considered X-ray fluxes that are representative of known AGN and Quasars (QSOs) populations. We also present a method to estimate the systematic errors related to the uncertainties in the calibration of the X-IFU. In a conservative setting, in which the reflection component is computed self consistently by the Relxill model from the pre-set geometry and no iron over abundance, the mean errors on the spin and height of the irradiating source are <0.05 and ~0.2 Rg. Similarly the absorber parameters are measured to an accuracy typically less than ~5%. Extending the simulations to include blue shifted ultra fast outflows, we show that X-IFU could measure their velocity with statistical errors <1% even for high redshift objects (abridged).


title: Residual Flows for Invertible Generative Modeling

abstract: Flow-based generative models parameterize probability distributions through an invertible transformation and can be trained by maximum likelihood. Invertible residual networks provide a flexible family of transformations where only Lipschitz conditions rather than strict architectural constraints are needed for enforcing invertibility. However, prior work trained invertible residual networks for density estimation by relying on biased log-density estimates whose bias increased with the network's expressiveness. We give a tractable unbiased estimate of the log density using a "Russian roulette" estimator, and reduce the memory required during training by using an alternative infinite series for the gradient. Furthermore, we improve invertible residual blocks by proposing the use of activation functions that avoid derivative saturation and generalizing the Lipschitz condition to induced mixed norms. The resulting approach, called Residual Flows, achieves state-of-the-art performance on density estimation amongst flow-based models, and outperforms networks that use coupling blocks at joint generative and discriminative modeling.


title: DeepMDP: Learning Continuous Latent Space Models for Representation Learning

abstract: Many reinforcement learning (RL) tasks provide the agent with high-dimensional observations that can be simplified into low-dimensional continuous states. To formalize this process, we introduce the concept of a DeepMDP, a parameterized latent space model that is trained via the minimization of two tractable losses: prediction of rewards and prediction of the distribution over next latent states. We show that the optimization of these objectives guarantees (1) the quality of the latent space as a representation of the state space and (2) the quality of the DeepMDP as a model of the environment. We connect these results to prior work in the bisimulation literature, and explore the use of a variety of metrics. Our theoretical findings are substantiated by the experimental result that a trained DeepMDP recovers the latent structure underlying high-dimensional observations on a synthetic environment. Finally, we show that learning a DeepMDP as an auxiliary task in the Atari 2600 domain leads to large performance improvements over model-free RL.


title: The Evolution and Origin of Ionized Gas Velocity Dispersion from $z\sim2.6$ to $z\sim0.6$ with KMOS$^{\rm 3D}$

abstract: We present the $0.6<z<2.6$ evolution of the ionized gas velocity dispersion in 175 star-forming disk galaxies based on data from the full KMOS$^{\rm 3D}$ integral field spectroscopic survey. In a forward-modelling Bayesian framework including instrumental effects and beam-smearing, we fit simultaneously the observed galaxy velocity and velocity dispersion along the kinematic major axis to derive the intrinsic velocity dispersion $\sigma_0$. We find a reduction of the average intrinsic velocity dispersion of disk galaxies as a function of cosmic time, from $\sigma_0\sim45$ km s$^{-1}$ at $z\sim2.3$ to $\sigma_0\sim30$ km s$^{-1}$ at $z\sim0.9$. There is substantial intrinsic scatter ($\sigma_{\sigma_0, {\rm int}}\approx10$ km s$^{-1}$) around the best-fit $\sigma_0-z$-relation beyond what can be accounted for from the typical measurement uncertainties ($\delta\sigma_0\approx12$ km s$^{-1}$), independent of other identifiable galaxy parameters. This potentially suggests a dynamic mechanism such as minor mergers or variation in accretion being responsible for the scatter. Putting our data into the broader literature context, we find that ionized and atomic+molecular velocity dispersions evolve similarly with redshift, with the ionized gas dispersion being $\sim10-15$ km s$^{-1}$ higher on average. We investigate the physical driver of the on average elevated velocity dispersions at higher redshift, and find that our galaxies are at most marginally Toomre-stable, suggesting that their turbulent velocities are powered by gravitational instabilities, while stellar feedback as a driver alone is insufficient. This picture is supported through comparison with a state-of-the-art analytical model of galaxy evolution.


title: Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading

abstract: Although neural conversation models are effective in learning how to produce fluent responses, their primary challenge lies in knowing what to say to make the conversation contentful and non-vacuous. We present a new end-to-end approach to contentful neural conversation that jointly models response generation and on-demand machine reading. The key idea is to provide the conversation model with relevant long-form text on the fly as a source of external knowledge. The model performs QA-style reading comprehension on this text in response to each conversational turn, thereby allowing for more focused integration of external knowledge than has been possible in prior approaches. To support further research on knowledge-grounded conversation, we introduce a new large-scale conversation dataset grounded in external web pages (2.8M turns, 7.4M sentences of grounding). Both human evaluation and automated metrics show that our approach results in more contentful responses compared to a variety of previous methods, improving both the informativeness and diversity of generated output.


title: Mesh R-CNN

abstract: Rapid advances in 2D perception have led to systems that accurately detect objects in real-world images. However, these systems make predictions in 2D, ignoring the 3D structure of the world. Concurrently, advances in 3D shape prediction have mostly focused on synthetic benchmarks and isolated objects. We unify advances in these two areas. We propose a system that detects objects in real-world images and produces a triangle mesh giving the full 3D shape of each detected object. Our system, called Mesh R-CNN, augments Mask R-CNN with a mesh prediction branch that outputs meshes with varying topological structure by first predicting coarse voxel representations which are converted to meshes and refined with a graph convolution network operating over the mesh's vertices and edges. We validate our mesh prediction branch on ShapeNet, where we outperform prior work on single-image shape prediction. We then deploy our full Mesh R-CNN system on Pix3D, where we jointly detect objects and predict their 3D shapes.


title: Longitudinal double-spin asymmetry for inclusive jet and dijet production in $pp$ collisions at $\sqrt{s} = 510$ GeV

abstract: We report the first measurement of the inclusive jet and the dijet longitudinal double-spin asymmetries, $A_{LL}$, at midrapidity in polarized $pp$ collisions at a center-of-mass energy $\sqrt{s} = 510$ GeV. The inclusive jet $A_{LL}$ measurement is sensitive to the gluon helicity distribution down to a gluon momentum fraction of $x\approx 0.015$, while the dijet measurements, separated into four jet-pair topologies, provide constraints on the $x$ dependence of the gluon polarization. Both results are consistent with previous measurements made at $\sqrt{s}= 200$ GeV in the overlapping kinematic region, $x > 0.05$, and show good agreement with predictions from recent next-to-leading order global analyses.


title: Higher order derivative operators as quantum corrections

abstract: In this paper we propose a non-minimal, and ghost free, coupling between the gauge field and the fermionic one from which we obtain, perturbatively, terms with higher order derivatives as quantum corrections to the photon effective action in the low energy regime. We calculate the one-loop effective action of the photon field and show that, in addition to the Euler-Heisenberg terms, the well known Lee-Wick term, $\sim F_{\mu\nu}\partial_{\alpha}\partial^{\alpha}F^{\mu\nu}$, arises in low energy regime as a quantum correction from the model. We also obtain the electron self energy in leading order.


title: On the road to percent accuracy II: calibration of the non-linear matter power spectrum for arbitrary cosmologies

abstract: We introduce an emulator approach to predict the non-linear matter power spectrum for broad classes of beyond-$\Lambda$CDM cosmologies, using only a suite of $\Lambda$CDM $N$-body simulations. By including a range of suitably modified initial conditions in the simulations, and rescaling the resulting emulator predictions with analytical `halo model reactions', accurate non-linear matter power spectra for general extensions to the standard $\Lambda$CDM model can be calculated. We optimise the emulator design by substituting the simulation suite with non-linear predictions from the standard {\sc halofit} tool. We review the performance of the emulator for artificially generated departures from the standard cosmology as well as for theoretically motivated models, such as $f (R)$ gravity and massive neutrinos. For the majority of cosmologies we have tested, the emulator can reproduce the matter power spectrum with errors $\lesssim 1\%$ deep into the highly non-linear regime. This work demonstrates that with a well-designed suite of $\Lambda$CDM simulations, extensions to the standard cosmological model can be tested in the non-linear regime without any reliance on expensive beyond-$\Lambda$CDM simulations.


title: The role of atom tunneling in gas-phase reactions in planet-forming disks

abstract: This paper investigates the impact of the increased reaction rate constant due to tunneling effects on planet-forming disks. Our aim is to quantify the astrophysical implications of atom tunneling for simple molecules that are frequently used to infer disk structure information or to define the initial conditions for planet (atmosphere) formation. We explain the tunneling effect on reaction rates by using a scholarly example in comparison to previous UMIST2012 rate constants. In a chemical network with 1299 reactions, we identify all reactions that could show atom tunneling. We devise a simple formulation of reaction rate constants that overestimates tunneling and screen a standard T Tauri disk model for changes in species abundances. For those reactions found to be relevant, we find values of the most recent literature for the rate constants including tunneling and compare the resulting disk chemistry to the standard disk models. The rate constants in the UMIST2012 database in many cases already capture tunneling effects implicitly. A rigorous screening procedure identified three neutral-neutral reactions where atom tunneling could change simple molecule abundances. However, by adopting recent values of the rate constants of these reactions and due to the layered structure of planet-forming disks, the effects are limited to a small region where cold neutral-neutral chemistry dominates. Abundances of water close to the midplane snowline can increase by a factor of two at most compared to previous results with UMIST2012 rates. Observables from the disk surface, such as high excitation (> 500 K) water line fluxes, decrease by 60% at most when tunneling effects are explicitly excluded. On the other hand, disk midplane quantities relevant for planet formation such as the C-to-O ratio and also the ice-to-rock ratio are clearly affected by these gas-phase tunneling effects.


title: On Stochastic Effects and Primordial Black-Hole Formation

abstract: The effect of large quantum fluctuations on primordial black-hole formation during an inflationary phase along a plateau is investigated. By using techniques of stochastic inflation in combination with replica field theory and the Feynman-Jensen variational method, it is non-perturbatively demonstrated that the abundance of primordial black holes is amplified by several orders of magnitude as compared to the classical computation.


title: Automated Classification of Seizures against Nonseizures: A Deep Learning Approach

abstract: In current clinical practice, electroencephalograms (EEG) are reviewed and analyzed by well-trained neurologists to provide supports for therapeutic decisions. The way of manual reviewing is labor-intensive and error prone. Automatic and accurate seizure/nonseizure classification methods are needed. One major problem is that the EEG signals for seizure state and nonseizure state exhibit considerable variations. In order to capture essential seizure features, this paper integrates an emerging deep learning model, the independently recurrent neural network (IndRNN), with a dense structure and an attention mechanism to exploit temporal and spatial discriminating features and overcome seizure variabilities. The dense structure is to ensure maximum information flow between layers. The attention mechanism is to capture spatial features. Evaluations are performed in cross-validation experiments over the noisy CHB-MIT data set. The obtained average sensitivity, specificity and precision of 88.80%, 88.60% and 88.69% are better than using the current state-of-the-art methods. In addition, we explore how the segment length affects the classification performance. Thirteen different segment lengths are assessed, showing that the classification performance varies over the segment lengths, and the maximal fluctuating margin is more than 4%. Thus, the segment length is an important factor influencing the classification performance.


title: Ranking and synchronization from pairwise measurements via SVD

abstract: Given a measurement graph $G= (V,E)$ and an unknown signal $r \in \mathbb{R}^n$, we investigate algorithms for recovering $r$ from pairwise measurements of the form $r_i - r_j$; $\{i,j\} \in E$. This problem arises in a variety of applications, such as ranking teams in sports data and time synchronization of distributed networks. Framed in the context of ranking, the task is to recover the ranking of $n$ teams (induced by $r$) given a small subset of noisy pairwise rank offsets. We propose a simple SVD-based algorithmic pipeline for both the problem of time synchronization and ranking. We provide a detailed theoretical analysis in terms of robustness against both sampling sparsity and noise perturbations with outliers, using results from matrix perturbation and random matrix theory. Our theoretical findings are complemented by a detailed set of numerical experiments on both synthetic and real data, showcasing the competitiveness of our proposed algorithms with other state-of-the-art methods.


title: The relationship between black hole mass and galaxy properties: Examining the black hole feedback model in IllustrisTNG

abstract: Supermassive black hole feedback is thought to be responsible for the lack of star formation, or quiescence, in a significant fraction of galaxies. We explore how observable correlations between the specific star formation rate (sSFR), stellar mass (M$_{\rm{star}}$), and black hole mass (M$_{\rm{BH}}$) are sensitive to the physics of black hole feedback in a galaxy formation model. We use the IllustrisTNG simulation suite, specifically the TNG100 simulation and ten model variations that alter the parameters of the black hole model. Focusing on central galaxies at $z = 0$ with M$_{\rm{star}} > 10^{10}$ M$_{\odot}$, we find that the sSFR of galaxies in IllustrisTNG decreases once the energy from black hole kinetic winds at low accretion rates becomes larger than the gravitational binding energy of gas within the galaxy stellar radius. This occurs at a particular M$_{\rm{BH}}$ threshold above which galaxies are found to sharply transition from being mostly star-forming to mostly quiescent. As a result of this behavior, the fraction of quiescent galaxies as a function of M$_{\rm{star}}$ is sensitive to both the normalization of the M$_{\rm{BH}}$-M$_{\rm{star}}$ relation and the M$_{\rm{BH}}$ threshold for quiescence in IllustrisTNG. Finally, we compare these model results to observations of 91 central galaxies with dynamical M$_{\rm{BH}}$ measurements with the caveat that this sample is not representative of the whole galaxy population. While IllustrisTNG reproduces the observed trend that quiescent galaxies host more massive black holes, the observations exhibit a broader scatter in M$_{\rm{BH}}$ at a given M$_{\rm{star}}$ and show a smoother decline in sSFR with M$_{\rm{BH}}$.


title: Multiple components of the Jhelum stellar stream

abstract: In simple models of the Milky Way, tidally disrupting satellites produce long and thin---nearly one-dimensional---stellar streams. Using astrometric data from the Gaia second data release and photometry from the Dark Energy Survey, we demonstrate that the Jhelum stream, a stellar stream in the inner halo, is a two-dimensional structure. The spatial distribution of highly probable Jhelum members reveals a dense thin component and an associated diffuse, spatially offset component. These two spatial components have indistinguishable proper motions (at $\sigma\sim1\,\rm mas\,yr^{-1}$ level) and a similar ratio of blue straggler to blue horizontal branch stars, which indicates a common origin for the two components. The best-fit orbit to the narrow component (pericenter $8\,\rm kpc$, apocenter $24\,\rm kpc$), however, does not explain the wide component of the Jhelum stream. On the other hand, an older orbital wrap of Jhelum's orbit traces the Indus stream, indicating a possible connection between these two structures and additional complexity in Jhelum's formation. Substructure in the Jhelum progenitor or precession of its tidal debris in the Milky Way potential may explain the observed structure of Jhelum. Future spectroscopic data will enable discrimination between these "nature" and "nurture" formation scenarios. Jhelum adds to the growing list of cold stellar streams that display complex morphologies and promise to reveal the dynamical history of the Milky Way.


title: Odd-Parity Superconductivity Driven by Octahedra Rotations in Iridium Oxides

abstract: Iridium oxides have provided a playground to study novel phases originating from spin-orbit coupling and electron-electron interactions. Among them, the d-wave singlet superconductor was proposed for electron-doped Sr$_2$IrO$_4$, containing two Ir atoms in a unit cell due to the staggered rotation of oxygen octahedra about the c-axis. It was also noted that such oxygen octahedra rotation affects electronic transports. Here we study the role of octahedra tilting away from the c-axis, in determining superconducting pairing symmetry. We show that the octahedra tilting changes the large Fermi surface to a Dirac point, which strongly suppresses the conventional d-wave pairing. Furthermore, it also promotes effective spin-triplet interactions in the strong Hubbard interaction limit, leading to a transition from the even-parity to odd-parity superconducting phase. Thus, tuning octahedra distortions can be used as a tool to engineer a spin triplet superconductor in strongly correlated systems with strong spin-orbit coupling.


title: Out-of-horizon correlations following a quench in a relativistic quantum field theory

abstract: One of the manifestations of relativistic invariance in non-equilibrium quantum field theory is the "horizon effect" a.k.a. light-cone spreading of correlations: starting from an initially short-range correlated state, measurements of two observers at distant space-time points are expected to remain independent until their past light-cones overlap. Surprisingly, we find that in the presence of topological excitations correlations can develop outside of horizon and indeed even between infinitely distant points. We demonstrate this effect for a wide class of global quantum quenches to the sine-Gordon model. We point out that besides the maximum velocity bound implied by relativistic invariance, clustering of initial correlations is required to establish the "horizon effect". We show that quenches in the sine-Gordon model have an interesting property: despite the fact that the initial states have exponentially decaying correlations and cluster in terms of the bosonic fields, they violate the clustering condition for the soliton fields, which is argued to be related to the non-trivial field topology. The nonlinear dynamics governed by the solitons makes the clustering violation manifest also in correlations of the local bosonic fields after the quench.

categories: cond-mat.stat-mech cond-mat.quant-gas cond-mat.str-el hep-th quant-ph


title: Higgs modes in proximized superconducting systems

abstract: The proximity effect in hybrid superconducting - normal metal structures is shown to affect strongly the coherent oscillations of the superconducting order parameter $\Delta$ known as the Higgs modes. The standard Higgs mode at the frequency $2\Delta$ is damped exponentially by the quasiparticle leakage from the primary superconductor. Two new Higgs modes with the frequencies depending on both the primary and induced gaps in the hybrid structure are shown to appear due to the coherent electron transfer between the superconductor and the normal metal. Altogether these three modes determine the long-time asymptotic behavior of the superconducting order parameter disturbed either by the electromagnetic pulse or the quench of the system parameters and, thus, are of crucial importance for the dynamical properties and restrictions on the operating frequencies for superconducting devices based on the proximity effect used, e.g., in quantum computing, in particular, with topological low-energy excitations.


title: Fractional disclination charge in two-dimensional $C_n-$symmetric topological crystalline insulators

abstract: Robust fractional charge localized at disclination defects has been recently found as a topological response in $C_{6}$ symmetric 2D topological crystalline insulators (TCIs). In this article, we thoroughly investigate the fractional charge on disclinations in $C_n$ symmetric TCIs, with or without time reversal symmetry, and including spinless and spin-$\frac{1}{2}$ cases. We compute the fractional disclination charges from the Wannier representations in real space and use band representation theory to construct topological indices of the fractional disclination charge for all $2D$ TCIs that admit a (generalized) Wannier representation. We find the disclination charge is fractionalized in units of $\frac{e}{n}$ for $C_n$ symmetric TCIs; and for spin-$\frac{1}{2}$ TCIs, with additional time reversal symmetry, the disclination charge is fractionalized in units of $\frac{2e}{n}$. We furthermore prove that with electron-electron interactions that preserve the $C_n$ symmetry and many-body bulk gap, though we can deform a TCI into another which is topologically distinct in the free fermion case, the fractional disclination charge determined by our topological indices will not change in this process. Moreover, we use an algebraic technique to generalize the indices for TCIs with non-zero Chern numbers, where a Wannier representation is not applicable. With the inclusion of the Chern number, our generalized fractional disclination indices apply for all $C_n$ symmetric TCIs. Finally, we briefly discuss the connection between the Chern number dependence of our generalized indices and the Wen-Zee term.


title: Spectral Weight Suppression and Fermi Arc-like Features with Strong Holographic Lattices

abstract: We investigate holographic fermions in uni-directional striped phases, where the breaking of translational invariance can be generated either spontaneously or explicitly. We solve the Dirac equation for a probe fermion in the associated background geometry. When the spatial modulation effect becomes sufficiently strong, we see a spectral weight suppression whenever the Fermi surface is larger than the first Brillouin zone. This leads to the gradual disappearance of the Fermi surface along the symmetry breaking direction, in all of the cases we have examined. This effect appears to be a generic consequence of strong inhomogeneities, independently of whether translational invariance is broken spontaneously or explicitly. The resulting Fermi surface is segmented and has features reminiscent of Fermi arcs.


title: Simplified Template Cross Sections - Stage 1.1

abstract: Simplified Template Cross Sections (STXS) have been adopted by the LHC experiments as a common framework for Higgs measurements. Their purpose is to reduce the theoretical uncertainties that are directly folded into the measurements as much as possible, while at the same time allowing for the combination of the measurements between different decay channels as well as between experiments. We report the complete, revised definition of the STXS kinematic bins (stage 1.1), which are to be used for the upcoming measurements by the ATLAS and CMS experiments using the full LHC Run 2 datasets. The main focus is on the three dominant Higgs production processes, namely gluon-fusion, vector-boson fusion, and in association with a vector boson. We also comment briefly on the treatment of other production modes.


title: Reheating in two-sector cosmology

abstract: We analyze reheating scenarios where a hidden sector is populated during reheating along with the sector containing the Standard Model. We numerically solve the Boltzmann equations describing perturbative reheating of the two sectors, including the full dependence on quantum statistics, and study how quantum statistical effects during reheating as well as the non-equilibrium inflaton-mediated energy transfer between the two sectors affects the temperature evolution of the two radiation baths. We obtain new power laws describing the temperature evolution of fermions and bosons when quantum statistics are important during reheating. We show that inflaton-mediated scattering is generically most important at radiation temperatures $T\sim M_\phi/4$, and build on this observation to obtain analytic estimates for the temperature asymmetry produced by asymmetric reheating. We find that for reheating temperatures $T_{\textrm{rh}} \ll M_{\phi}/4$, classical perturbative reheating provides an excellent approximation to the final temperature asymmetry, while for $T_{\textrm{rh}}\gg M_{\phi}/4$, inflaton-mediated scattering dominates the population of the colder sector and thus the final temperature asymmetry. We additionally present new techniques to calculate energy transfer rates between two relativistic species at different temperatures.


title: Planck Scale Origin of Non-zero $\theta_{13}$ and Super-WIMP Dark Matter

abstract: We study a discrete flavour symmetric scenario for neutrino mass and dark matter under the circumstances where such global discrete symmetries can be explicitly broken at Planck scale, possibly by gravitational effects. Such explicit breaking of discrete symmetries mimic as Planck suppressed operators in the model which can have non-trivial consequences for neutrino and dark matter sectors. In particular, we study a flavour symmetric model which, at renormalisable level, gives rise to tri-bimaximal type neutrino mixing with vanishing reactor mixing angle $\theta_{13}=0$, a stable inert scalar doublet behaving like a weakly interacting massive particle (WIMP) and a stable singlet inert fermion which does not interact with any other particles. The introduction of Planck suppressed operators which explicitly break the discrete symmetries, can give rise to the generation of non-zero $\theta_{13}$ in agreement with neutrino data and also open up decay channels of inert scalar doublet into singlet neutral inert fermion leading to the realisation of the super-WIMP dark matter scenario. We show that the correct neutrino phenomenology can be obtained in this model while discussing three distinct realisation of the super-WIMP dark matter scenario.


title: Telling neuronal apples from oranges: analytical performance modeling of neural tissue simulations

abstract: Computational modeling and simulation have become essential tools in the quest to better understand the brain's makeup and to decipher the causal interrelations of its components. The breadth of biochemical and biophysical processes and structures in the brain has led to the development of a large variety of model abstractions and specialized tools, often times requiring high performance computing resource for their timely execution. What has been missing so far was an in-depth analysis of the complexity of the computational kernels, hindering a systematic approach to identifying bottlenecks of algorithms and hardware, and their combinations. If whole brain models are to be achieved on emerging computer generations, models and simulation engines will have to be carefully co-designed for the intrinsic hardware tradeoffs. For the first time, we present a systematic exploration based on analytic performance modeling. We base our analysis on three in silico models, chosen as representative examples of the most widely employed modeling abstractions. We identify that the synaptic formalism, i.e. current or conductance based representations, and not the level of morphological detail, is the most significant factor in determining the properties of memory bandwidth saturation and shared-memory scaling of in silico models. Even though general purpose computing has, until now, largely been able to deliver high performance, we find that for all types of abstractions, network latency and memory bandwidth will become severe bottlenecks as the number of neurons to be simulated grows. By adapting and extending a performance modeling approach, we deliver a first characterization of the performance landscape of brain tissue simulations, allowing us to pinpoint current bottlenecks in state-of-the-art in silico models, and make projections for future hardware and software requirements.


title: Combining Parameter Identification and Trajectory Optimization: Real-time Planning for Information Gain

abstract: Robotic systems often operate with uncertainties in their dynamics, for example, unknown inertial properties. Broadly, there are two approaches for controlling uncertain systems: design robust controllers in spite of uncertainty, or characterize a system before attempting to control it. This paper proposes a middle-ground approach, making trajectory progress while also accounting for gaining information about the system. More specifically, it combines excitation trajectories which are usually intended to optimize information gain for an estimator, with goal-driven trajectory optimization metrics. For this purpose, a measure of information gain is incorporated (using the Fisher Information Matrix) in a real-time planning framework to produce trajectories favorable for estimation. At the same time, the planner receives stable parameter updates from the estimator, enhancing the system model. An implementation of this learn-as-you-go approach utilizing an Unscented Kalman Filter (UKF) and Nonlinear Model Predictive Controller (NMPC) is demonstrated in simulation. Results for cases with and without information gain and online parameter updates in the system model are presented.


title: Gauge-invariant bounce from loop quantum gravity

abstract: We present a gauge-invariant treatment of singularity resolution using loop quantum gravity techniques with respect to local SU(2) transformations. Our analysis reveals many novel features of quantum geometry which were till now hidden in models based on non-gauge-invariant discretizations. Quantum geometric effects resolve the big bang singularity replacing it with a non-singular bounce when spacetime curvature reaches Planckian value. The bounce is found to be generically asymmetric in the sense that pre-bounce and post-bounce branches are not mirrored to each other and effective constants, such as Newton's constant, are rescaled across the bounce. Furthermore, in the vicinity of the bounce, minimally coupled matter behaves as non-minimally coupled. These ramifications of quantum geometry open a rich avenue for potential phenomenological signatures.


title: Kardar-Parisi-Zhang Scaling for an Integrable Lattice Landau-Lifshitz Spin Chain

abstract: Recent studies report on anomalous spin transport for the integrable Heisenberg spin chain at its isotropic point. Anomalous scaling is also observed in the time-evolution of non-equilibrium initial conditions, the decay of current-current correlations, and non-equilibrium steady state averages. These studies indicate a space-time scaling with $x \sim t^{2/3}$ behavior at the isotropic point, in sharp contrast to the ballistic form $x \sim t$ generically expected for integrable systems. In our contribution we study the scaling behavior for the integrable lattice Landau-Lifshitz spin chain. We report on equilibrium spatio-temporal correlations and dynamics with step initial conditions. Remarkably, for the case with zero mean magnetization, we find strong evidence that the scaling function is identical to the one obtained from the stationary stochastic Burgers equation, alias Kardar-Parisi-Zhang equation. In addition, we present results for the easy-plane and easy-axis regimes for which, respectively, ballistic and diffusive spin transport is observed, whereas the energy remains ballistic over the entire parameter regime.


title: Tensor-Network Approach for Quantum Metrology in Many-Body Quantum Systems

abstract: Identification of the optimal quantum metrological protocols in realistic many particle quantum models is in general a challenge that cannot be efficiently addressed by the state-of-the-art numerical and analytical methods. Here we provide a comprehensive framework exploiting matrix product operators (MPO) type tensor networks for quantum metrological problems. Thanks to the fact that the MPO formalism allows for an efficient description of short-range spatial and temporal noise correlations, the maximal achievable estimation precision in such models, as well as the optimal probe states in previously inaccessible regimes can be identified. Moreover, the application of infinite MPO (iMPO) techniques allows for a direct and efficient determination of the asymptotic precision of optimal protocols in the limit of infinite particle numbers. We illustrate the potential of our framework in terms of an atomic clock stabilization (temporal noise correlation) example as well as for magnetic field sensing in the presence of locally correlated magnetic field fluctuations (spatial noise correlations). As a byproduct, the developed methods for calculating the quantum Fisher information via MPOs may be used to calculate the fidelity susceptibility - a parameter widely used in many-body physics to study phase transitions.


title: Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View

abstract: The Transformer architecture is widely used in natural language processing. Despite its success, the design principle of the Transformer remains elusive. In this paper, we provide a novel perspective towards understanding the architecture: we show that the Transformer can be mathematically interpreted as a numerical Ordinary Differential Equation (ODE) solver for a convection-diffusion equation in a multi-particle dynamic system. In particular, how words in a sentence are abstracted into contexts by passing through the layers of the Transformer can be interpreted as approximating multiple particles' movement in the space using the Lie-Trotter splitting scheme and the Euler's method. Given this ODE's perspective, the rich literature of numerical analysis can be brought to guide us in designing effective structures beyond the Transformer. As an example, we propose to replace the Lie-Trotter splitting scheme by the Strang-Marchuk splitting scheme, a scheme that is more commonly used and with much lower local truncation errors. The Strang-Marchuk splitting scheme suggests that the self-attention and position-wise feed-forward network (FFN) sub-layers should not be treated equally. Instead, in each layer, two position-wise FFN sub-layers should be used, and the self-attention sub-layer is placed in between. This leads to a brand new architecture. Such an FFN-attention-FFN layer is "Macaron-like", and thus we call the network with this new architecture the Macaron Net. Through extensive experiments, we show that the Macaron Net is superior to the Transformer on both supervised and unsupervised learning tasks. The reproducible codes and pretrained models can be found at https://github.com/zhuohan123/macaron-net


title: Strong Preferential Ion Heating is Limited to within the Solar Alfven Surface

abstract: The decay of the solar wind helium to hydrogen temperature ratio due to Coulomb thermalization can be used to measure how far from the Sun strong preferential ion heating occurs. Previous work has shown that a zone of preferential ion heating, resulting in mass-proportional temperatures, extends about $20-40 R_\odot$ from the Sun on average. Here we look at the motion of the outer boundary of this zone with time and compare it to other physically meaningful distances. We report that the boundary moves in lockstep with the Alfv\'en point over the solar cycle, contracting and expanding with solar activity with a correlation coefficient of better than 0.95 and with an RMS difference of $4.23 R_\odot$. Strong preferential ion heating apparently is predominatly active below the Alfv\'en point. To definitively identify the underlying preferential heating mechanisms, it will be necessary to make in situ measurements of the local plasma conditions below the Alfv\'en surface. We predict Parker Solar Probe (PSP) will be the first spacecraft to directly observe this heating in action, but only a couple of years after launch as activity increases, the zone expands, and PSP's perihelion drops.


title: Enhancement of the Axion Decay Constant in Inflation and the Weak Gravity Conjecture

abstract: Models of axion inflation based on a single cosine potential require the axion decay constant $f$ to be super-Planckian in size. However, $f > M_{Pl}$ is disfavored by the Weak Gravity Conjecture (WGC). It is then pertinent to ask if one can construct axion inflation models in conformity with WGC. In this work we assume that WGC holds for the microscopic Lagrangian so that $f < M_{Pl}$. However, inflation is controlled by an effective Lagrangian much below the Planck scale where the inflaton is an effective axionic field associated with an effective decay constant $f_e$ which could be very different from $f$. In this work we propose a Coherent Enhancement Mechanism (CEM) for slow roll inflation controlled by flat potentials which can produce $f_e \gg M_{Pl}$ while $f < M_{Pl}$. In the analysis we consider a landscape of chiral fields charged under a $U\left(1\right)$ global shift symmetry and consider breaking of the $U\left(1\right)$ symmetry by instanton type symmetry breaking terms. In the broken phase there is one light pseudo-Nambu-Goldstone-Boson (pNGB) which acts as the inflaton. We show that with an appropriate choice of symmetry breaking terms the inflaton potential is a superposition of many cosines and the condition that they produce a flat potential allows one to enhance $f_e$ so that $f_e / M_{Pl} \gg 1$. We discuss the utility of this mechanism for a variety of inflaton models originating in supersymmetry and supergravity. The Coherent Enhancement Mechanism allows one to reduce an inflation model with an arbitrary potential to an effective model of natural inflation, i.e. with a single cosine, by expanding the potential near a field point where horizon exit occurs, and matching the expansion coefficients to those of natural inflation.


title: Multiphase quasar-driven outflows in PG 1114+445. I. Entrained ultra-fast outflows

abstract: Substantial evidence in the last few decades suggests that outflows from supermassive black holes (SMBH) may play a significant role in the evolution of galaxies.Large-scale outflows known as warm absorbers (WA) and fast disk winds known as ultra-fast outflows (UFO) are commonly found in the spectra of many Seyfert galaxies and quasars, and a correlation has been suggested between them. Recent detections of low ionization and low column density outflows, but with a high velocity comparable to UFOs, challenge such initial possible correlations. Observations of UFOs in AGN indicate that their energetics may be enough to have an impact on the interstellar medium (ISM). However, observational evidence of the interaction between the inner high-ionization outflow and the ISM is still missing. We present here the spectral analysis of 12 XMM-Newton/EPIC archival observations of the quasar PG 1114+445, aimed at studying the complex outflowing nature of its absorbers. Our analysis revealed the presence of three absorbing structures. We find a WA with velocity $v\sim530$ km s$^{-1}$, ionization $\log\xi/\text{erg cm s}^{-1}\sim0.35,$ and column density $\log N_\text{H}/\text{cm}^{-2}\sim22$, and a UFO with $v_\text{out}\sim0.145c$, $\log\xi/\text{erg cm s}^{-1}\sim4$, and $\log N_\text{H}/\text{cm}^{-2}\sim23$. We also find an additional absorber in the soft X-rays ($E<2$ keV) with velocity comparable to that of the UFO ($v_\text{out}\sim0.120c$), but ionization ($\log\xi/\text{erg cm s}^{-1}\sim0.5$) and column density ($\log N_\text{H}/\text{cm}^{-2}\sim21.5$) comparable with those of the WA. The ionization, velocity, and variability of the three absorbers indicate an origin in a multiphase and multiscale outflow, consistent with entrainment of the clumpy ISM by an inner UFO moving at $\sim15\%$ the speed of light, producing an entrained ultra-fast outflow (E-UFO).


title: The correlation function of a queue with Levy and Markov additive input

abstract: Let $(Q_t)$ be a stationary workload process, and $r(t)$ the correlation coefficient of $Q_0$ and $Q_t$. In a series of previous papers (i) the transform of $r(\cdot)$ has been derived for the case that the driving process is spectrally-positive (sp) or spectrally-negative (sn) Levy, (ii) it has been shown that for sp-Levy and sn-Levy input $r(\cdot)$ is positive, decreasing, and convex, (iii) in case the driving Levy process is light-tailed (a condition that is automatically fulfilled in the sn case), the decay of the decay rate agrees with that of the tail of the busy period distribution. In the present paper we first prove the conjecture that property (ii) carries over to spectrally two-sided Levy processes; we do so for the case the Levy process is reflected at 0, and the case it is reflected at 0 and $K > 0$. Then we focus on queues fed by Markov additive processes (maps). We start by the establishing the counterpart of (i) for sp- and sn-maps. Then we refute property (ii) for maps: we construct examples in which the correlation coefficient can be (locally) negative, decreasing, and concave. Finally, in relation to (iii), we point out how to identify the decay rate of $r(\cdot)$ in the light-tailed map case, thus showing that the tail behavior of $r(\cdot)$ does not necessarily match that of the busy-period tail; singularities related to the transition rate matrix of the background Markov chain turn out to play a crucial role here.


title: Nonresonant bilinear forms for partially dissipative hyperbolic systems violating the Shizuta-Kawashima condition

abstract: In the context of hyperbolic systems of balance laws, the Shizuta-Kawashima coupling condition guarantees that all the variables of the system are dissipative even though the system is not totally dissipative. Hence it plays a crucial role in terms of sufficient conditions for the global in time existence of classical solutions. However, it is easy to find physically based models that do not satisfy this condition, especially in several space dimensions. In this paper, we consider two simple examples of partially dissipative hyperbolic systems violating the Shizuta-Kawashima condition ([SK]) in 3D, such that some eigendirections do not exhibit dissipation at all. We prove that, if the source term is non resonant (in a suitable sense) in the direction where dissipation does not play any role, then the formation of singularities is prevented, despite the lack of dissipation, and the smooth solutions exist globally in time. The main idea of the proof is to couple Green function estimates for weakly dissipative hyperbolic systems with the space-time resonance analysis for dispersive equations introduced by Germain, Masmoudi and Shatah. More precisely, the partially dissipative hyperbolic systems violating [SK] are endowed, in the non-dissipative directions, with a special structure of the nonlinearity, the so-called Nonresonant Bilinear Form for the wave equation (see Pusateri and Shatah, CPAM 2013).


title: Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP

abstract: The lottery ticket hypothesis proposes that over-parameterization of deep neural networks (DNNs) aids training by increasing the probability of a "lucky" sub-network initialization being present rather than by helping the optimization process (Frankle & Carbin, 2019). Intriguingly, this phenomenon suggests that initialization strategies for DNNs can be improved substantially, but the lottery ticket hypothesis has only previously been tested in the context of supervised learning for natural image tasks. Here, we evaluate whether "winning ticket" initializations exist in two different domains: natural language processing (NLP) and reinforcement learning (RL).For NLP, we examined both recurrent LSTM models and large-scale Transformer models (Vaswani et al., 2017). For RL, we analyzed a number of discrete-action space tasks, including both classic control and pixel control. Consistent with workin supervised image classification, we confirm that winning ticket initializations generally outperform parameter-matched random initializations, even at extreme pruning rates for both NLP and RL. Notably, we are able to find winning ticket initializations for Transformers which enable models one-third the size to achieve nearly equivalent performance. Together, these results suggest that the lottery ticket hypothesis is not restricted to supervised learning of natural images, but rather represents a broader phenomenon in DNNs.


title: Signature of Quantum Entanglement in NH4CuPO4.H2O

abstract: Entangled solid state systems have gained a great deal of attention due to their fruitful applications in modern quantum technologies. Herein, detection of entanglement content from experimental magnetic susceptibility and specific heat data is reported for NH4CuPO4.H2O in its solid state crystalline form. NH4CuPO4.H2O is a prototype of Heisenberg spin 1/2 dimer system. Temperature dependent magnetic susceptibility and specific data are fitted to an isolated dimer model and the exchange coupling constant is determined. Field dependent magnetization isotherms taken at different temperatures are plotted in a three dimensional plot. Subsequently, entanglement is detected both from susceptibility and specific heat through two different entanglement measures; entanglement witness and entanglement of formation. The temperature evolution of entanglement is studied and the critical temperature is determined up to which entanglement exists. Temperature dependent nature of entanglement extracted from susceptibility and specific heat shows good consistency with each other. Moreover, the field dependent entanglement is also investigated.


title: Inner For-Loop for Speeding Up Blockchain Mining

abstract: In this paper, the authors propose to increase the efficiency of blockchain mining by using a population-based approach. Blockchain relies on solving difficult mathematical problems as proof-of-work within a network before blocks are added to the chain. Brute force approach, advocated by some as the fastest algorithm for solving partial hash collisions and implemented in Bitcoin blockchain, implies exhaustive, sequential search. It involves incrementing the nonce (number) of the header by one, then taking a double SHA-256 hash at each instance and comparing it with a target value to ascertain if lower than that target. It excessively consumes both time and power. In this paper, the authors, therefore, suggest using an inner for-loop for the population-based approach. Comparison shows that it's a slightly faster approach than brute force, with an average speed advantage of about 1.67% or 3,420 iterations per second and 73% of the time performing better. Also, we observed that the more the total particles deployed, the better the performance until a pivotal point. Furthermore, a recommendation on taming the excessive use of power by networks, like Bitcoin's, by using penalty by consensus is suggested.


title: Improving Exploration in Soft-Actor-Critic with Normalizing Flows Policies

abstract: Deep Reinforcement Learning (DRL) algorithms for continuous action spaces are known to be brittle toward hyperparameters as well as \cut{being}sample inefficient. Soft Actor Critic (SAC) proposes an off-policy deep actor critic algorithm within the maximum entropy RL framework which offers greater stability and empirical gains. The choice of policy distribution, a factored Gaussian, is motivated by \cut{chosen due}its easy re-parametrization rather than its modeling power. We introduce Normalizing Flow policies within the SAC framework that learn more expressive classes of policies than simple factored Gaussians. \cut{We also present a series of stabilization tricks that enable effective training of these policies in the RL setting.}We show empirically on continuous grid world tasks that our approach increases stability and is better suited to difficult exploration in sparse reward settings.


title: Adaptive Subspace Sampling for Class Imbalance Processing-Some clarifications, algorithm, and further investigation including applications to Brain Computer Interface

abstract: Kohonen's Adaptive Subspace Self-Organizing Map (ASSOM) learns several subspaces of the data where each subspace represents some invariant characteristics of the data. To deal with the imbalance classification problem, earlier we have proposed a method for oversampling the minority class using Kohonen's ASSOM. This investigation extends that study, clarifies some issues related to our earlier work, provides the algorithm for generation of the oversamples, applies the method on several benchmark data sets, and makes application to three Brain Computer Interface (BCI) applications. First we compare the performance of our method using some benchmark data sets with several state-of-the-art methods. Finally, we apply the ASSOM-based technique to analyze the three BCI based applications using electroencephalogram (EEG) datasets. These tasks are classification of motor imagery , drivers' fatigue states, and phases of migraine. Our results demonstrate the effectiveness of the ASSOM-based meth od in dealing with imbalance classification problem.


title: One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers

abstract: The success of lottery ticket initializations (Frankle and Carbin, 2019) suggests that small, sparsified networks can be trained so long as the network is initialized appropriately. Unfortunately, finding these "winning ticket" initializations is computationally expensive. One potential solution is to reuse the same winning tickets across a variety of datasets and optimizers. However, the generality of winning ticket initializations remains unclear. Here, we attempt to answer this question by generating winning tickets for one training configuration (optimizer and dataset) and evaluating their performance on another configuration. Perhaps surprisingly, we found that, within the natural images domain, winning ticket initializations generalized across a variety of datasets, including Fashion MNIST, SVHN, CIFAR-10/100, ImageNet, and Places365, often achieving performance close to that of winning tickets generated on the same dataset. Moreover, winning tickets generated using larger datasets consistently transferred better than those generated using smaller datasets. We also found that winning ticket initializations generalize across optimizers with high performance. These results suggest that winning ticket initializations generated by sufficiently large datasets contain inductive biases generic to neural networks more broadly which improve training across many settings and provide hope for the development of better initialization methods.


title: Connected Subgraph Defense Games

abstract: We study a security game over a network played between a $defender$ and $k$ $attackers$. Every attacker chooses, probabilistically, a node of the network to damage. The defender chooses, probabilistically as well, a connected induced subgraph of the network of $\lambda$ nodes to scan and clean.Each attacker wishes to maximize the probability of escaping her cleaning by the defender. On the other hand, the goal of the defender is to maximize the expected number of attackers that she catches. This game is a generalization of the model from the seminal paper of Mavronicolas et al. "The price of defense" (MFCS'06). We are interested in Nash equilibria (NE) of this game, as well as in characterizing $defense$-$optimal$ networks which allow for the best $equilibrium$ $defense$ $ratio$, termed Price of Defense; this is the ratio of $k$ over the expected number of attackers that the defender catches in a NE. We provide characterizations of the NEs of this game and defense-optimal networks. This allows us to show that the NEs of the game coincide independently from the coordination or not of the attackers. In addition, we give an algorithm for computing NEs. Our algorithm requires exponential time in the worst case, but it is polynomial-time for $\lambda$ constantly close to 1 or $n$. For the special case of tree-networks, we refine our characterization which allows us to derive a polynomial-time algorithm for deciding whether a tree is defense-optimal and if this is the case it computes a defense-optimal NE. On the other hand, we prove that it is NP-hard to find a best-defense strategy if the tree is not defense-optimal. We complement this negative result with a polynomial-time constant-approximation algorithm that computes solutions that are close to optimal ones for general graphs. Finally, we provide asymptotically (almost) tight bounds for the Price of Defense for any $\lambda$.


title: Fair Division Without Disparate Impact

abstract: We consider the problem of dividing items between individuals in a way that is fair both in the sense of distributional fairness and in the sense of not having disparate impact across protected classes. An important existing mechanism for distributionally fair division is competitive equilibrium from equal incomes (CEEI). Unfortunately, CEEI will not, in general, respect disparate impact constraints. We consider two types of disparate impact measures: requiring that allocations be similar across protected classes and requiring that average utility levels be similar across protected classes. We modify the standard CEEI algorithm in two ways: equitable equilibrium from equal incomes, which removes disparate impact in allocations, and competitive equilibrium from equitable incomes which removes disparate impact in attained utility levels. We show analytically that removing disparate impact in outcomes breaks several of CEEI's desirable properties such as envy, regret, Pareto optimality, and incentive compatibility. By contrast, we can remove disparate impact in attained utility levels without affecting these properties. Finally, we experimentally evaluate the tradeoffs between efficiency, equity, and disparate impact in a recommender-system based market.


title: An Informatics Software Stack for Point Defect-Derived Opto-Electronic Properties: The Asphalt Project

abstract: Computational acceleration of performance-metric-based materials discovery via high-throughput screening and machine learning methods is becoming widespread. Nevertheless, development and optimization of the opto-electronic properties that depend on dilute concentrations of point defects in new materials have not significantly benefited from these advances. Here, we present an informatics and simulation suite to computationally accelerate these processes. This will enable faster and more fundamental materials research, and reduce the cost and time associated with the materials development cycle. Analogous to the new avenues enabled by current first-principles-based property databases, this type of framework will open entire new research frontiers as it proliferates.


title: Learning in Gated Neural Networks

abstract: Gating is a key feature in modern neural networks including LSTMs, GRUs and sparsely-gated deep neural networks. The backbone of such gated networks is a mixture-of-experts layer, where several experts make regression decisions and gating controls how to weigh the decisions in an input-dependent manner. Despite having such a prominent role in both modern and classical machine learning, very little is understood about parameter recovery of mixture-of-experts since gradient descent and EM algorithms are known to be stuck in local optima in such models. In this paper, we perform a careful analysis of the optimization landscape and show that with appropriately designed loss functions, gradient descent can indeed learn the parameters accurately. A key idea underpinning our results is the design of two {\em distinct} loss functions, one for recovering the expert parameters and another for recovering the gating parameters. We demonstrate the first sample complexity results for parameter recovery in this model for any algorithm and demonstrate significant performance gains over standard loss functions in numerical experiments.


title: Active Deep Decoding of Linear Codes

abstract: High quality data is essential in deep learning to train a robust model. While in other fields data is sparse and costly to collect, in error decoding it is free to query and label thus allowing potential data exploitation. Utilizing this fact and inspired by active learning, two novel methods are introduced to improve Weighted Belief Propagation (WBP) decoding. These methods incorporate machine-learning concepts with error decoding measures. For BCH(63,36), (63,45) and (127,64) codes, with cycle-reduced parity-check matrices, improvement of up to 0.4dB at the waterfall region, and of up to 1.5dB at the errorfloor region in FER, over the original WBP, is demonstrated by smartly sampling the data, without increasing inference (decoding) complexity. The proposed methods constitutes an example guidelines for model enhancement by incorporation of domain knowledge from error-correcting field into a deep learning model. These guidelines can be adapted to any other deep learning based communication block.


title: New stability estimates for an unfitted finite element method for two-phase Stokes problem

abstract: The paper addresses stability and finite element analysis of the stationary two-phase Stokes problem with a piecewise constant viscosity coefficient experiencing a jump across the interface between two fluid phases. We first prove a priori estimates for the individual terms of the Cauchy stress tensor with stability constants independent of the viscosity coefficient. Next, this stability result is extended to the approximation of the two-phase Stokes problem by a finite element method. In the method considered, the interface between the phases does not respect the underlying triangulation, which put the finite element method into the class of unfitted discretizations. The finite element error estimates are proved with constants independent of viscosity. Numerical experiments supporting the theoretical results are provided.


title: Syntactically Supervised Transformers for Faster Neural Machine Translation

abstract: Standard decoders for neural machine translation autoregressively generate a single target token per time step, which slows inference especially for long outputs. While architectural advances such as the Transformer fully parallelize the decoder computations at training time, inference still proceeds sequentially. Recent developments in non- and semi- autoregressive decoding produce multiple tokens per time step independently of the others, which improves inference speed but deteriorates translation quality. In this work, we propose the syntactically supervised Transformer (SynST), which first autoregressively predicts a chunked parse tree before generating all of the target tokens in one shot conditioned on the predicted parse. A series of controlled experiments demonstrates that SynST decodes sentences ~ 5x faster than the baseline autoregressive Transformer while achieving higher BLEU scores than most competing methods on En-De and En-Fr datasets.


title: Tutte Polynomial Activities

abstract: Unlike Whitney's definition of the corank-nullity generating function $T(G;x+1,y+1)$, Tutte's definition of his now eponymous polynomial $T(G;x,y)$ requires a total order on the edges of which the polynomial is a posteriori independent. Tutte presented his definition in terms of internal and external activities of maximal spanning forests. Although Tutte's original definition may appear somewhat ad hoc upon first inspection, subsequent work by various researchers has demonstrated that activity is a deep combinatorial concept. In this survey, we provide an introduction to activities for graphs and matroids. Our primary goal is to survey several notions of activity for graphs which admit expansions of the Tutte polynomial. Additionally, we describe some fundamental structural theorems, and outline connections to the topological notion of shellability as well as several topics in algebraic combinatorics.