title: A study of stellar orbit fractions: simulated IllustrisTNG galaxies compared to CALIFA observations

abstract: Motivated by the recently discovered kinematic "Hubble sequence" shown by the stellar orbit-circularity distribution of 260 CALIFA galaxies, we make use of a comparable galaxy sample at z = 0 with a stellar mass range from 5E9 to 5E11 solar masses, selected from the IllustrisTNG simulation and study their stellar orbit compositions in relation to a number of other fundamental galaxy properties.We find that the TNG100 simulation broadly reproduces the observed fractions of different orbital components and their stellar mass dependencies. In particular, the mean mass dependencies of the luminosity fractions for the kinematically warm and hot orbits are well reproduced within model uncertainties of the observed galaxies. The simulation also largely reproduces the observed peak and trough features at a stellar mass of 1-2E10 solar masses, in the mean distributions of the cold- and hot-orbit fractions, respectively, indicating fewer cooler orbits and more hotter orbits in both more- and less-massive galaxies beyond such a mass range. Several marginal disagreements are seen between the simulation and observations: the average cold-orbit (counter-rotating) fractions of the simulated galaxies below (above) a stellar mass of 6E10 solar masses, are systematically higher than the observational data by < 10% (absolute orbital fraction); the simulation also seems to produce more scatter for the cold-orbit fraction and less so for the non-cold orbits at any given galaxy mass. Possible causes that stem from the adopted heating mechanisms are discussed.


title: Peculiar Velocities of Galaxies Just Beyond the Local Group

abstract: The Milky Way lies in a thin plane, the Local Sheet, a part of a wall bounding the Local Void lying toward the north supergalactic pole. Galaxies with accurate distances both above and below this supergalactic equatorial plane have systematically negative peculiar velocities. The interpretation of this situation is that the Local Void is expanding, giving members of the Local Sheet deviant velocities toward the south supergalactic pole. The few galaxies within the void are evacuating the void. Galaxies in a filament in the supergalactic south are not feeling the expansion so their apparent motion toward us is mainly a reflex of our motion. The model of the local velocity field was uncertain because the apex of our motion away from the Local Void lies in obscurity near the Galactic plane. Here, results of Hubble Space Telescope infrared observations are reported that find tip of the red giant branch distances to four obscured galaxies. All the distances are $\sim7$ Mpc, revealing that these galaxies are part of a continuous filamentary structure passing between the north and south Galactic hemispheres and sharing the same kinematic signature of peculiar velocities toward us. A fifth galaxy nearby in projection, GALFA-DW4, has an ambiguous distance. If nearby at $\sim 3$ Mpc, this galaxy has an anomalous velocity away from us of +348 km/s. Alternatively, perhaps the resolved stars are on the asymptotic giant branch and the galaxy is beyond 6 Mpc whence the observed velocity would not be unusual.


title: The Molecular Gas Reservoirs of $z\sim 2$ Galaxies: A comparison of CO(1-0) and dust-based molecular gas masses

abstract: We test the use of long-wavelength dust continuum emission as a molecular gas tracer at high redshift, via a unique sample of 12, z~2 galaxies with observations of both the dust continuum and CO(1-0) line emission (obtained with the Atacama Large Millimeter Array and Karl G. Jansky Very Large Array, respectively). Our work is motivated by recent, high redshift studies that measure molecular gas masses (\ensuremath{\rm{M}_{\rm{mol}}}) via a calibration of the rest-frame $850\mu$m luminosity ($L_\mathrm{850\mu m,rest}$) against the CO(1-0)-derived \ensuremath{\rm{M}_{\rm{mol}}}\ of star-forming galaxies. We hereby test whether this method is valid for the types of high-redshift, star-forming galaxies to which it has been applied. We recover a clear correlation between the rest-frame $850\mu$m luminosity, inferred from the single-band, long-wavelength flux, and the CO(1-0) line luminosity, consistent with the samples used to perform the $850\mu$m calibration. The molecular gas masses, derived from $L_\mathrm{850\mu m,rest}$, agree to within a factor of two with those derived from CO(1-0). We show that this factor of two uncertainty can arise from the values of the dust emissivity index and temperature that need to be assumed in order to extrapolate from the observed frequency to the rest-frame at 850$\mathrm{\mu m}$. The extrapolation to 850$\mathrm{\mu m}$ therefore has a smaller effect on the accuracy of \Mmol\ derived via single-band dust-continuum observations than the assumed CO(1-0)-to-\ensuremath{\rm{M}_{\rm{mol}}}\ conversion factor. We therefore conclude that single-band observations of long-wavelength dust emission can be used to reliably constrain the molecular gas masses of massive, star-forming galaxies at $z\gtrsim2$.


title: Probing Blazar Emission Processes with Optical/Gamma-ray Flare Correlations

abstract: Even with several thousand {\it Fermi}-LAT blazar detections, the $\gamma$-ray emission mechanism is poorly understood. We explore correlated optical/$\gamma$-ray flux variations for 178 {\it Fermi}-LAT blazars regularly monitored by KAIT, SMARTS, and the Steward Observatory. Out of the 178 sources, 121 show a measurable ($>1\sigma$) discrete correlation function peak. Using the derived time-lags and Bayesian block light-curve decompositions, we measure the fraction of common and orphan flares between the two bands. After accounting for sampling and sensitivity limitations we quantify for the first time the true orphan flare rates of optical and $\gamma$-ray flares: 54.5\% of optical and 20\% of $\gamma$-ray flares are orphan events. Both the intraband temporal relation and the small orphan $\gamma$-ray flare fraction point toward leptonic processes as the likely mechanism for the high-energy emission. Motivated to discriminate between synchrotron self-Compton and external-Compton dominance in individual sources, we use the flux-flux variations to determine the slope $m$ of the ${\rm log}\,f_{\rm opt} - {\rm log}\,f_{\gamma}$ dependence. The slope distribution suggests a bimodal population with high and intermediate synchrotron-peak objects showing larger $m$ than low synchrotron-peak objects. We find that $m$ is naturally decreased through pollution from the orphan (typically optical) flares and develop a method to statistically recover, given the sources' measured orphan flare rate, the intrinsic $m$. While source classes show composite behavior, the majority of BL Lac objects favor $m=2$, indicating a synchrotron self-Compton origin for the $\gamma$-rays. No preference for either $m$ is found in flat spectrum radio quasars.


title: The Chaotic Nature of TRAPPIST-1 Planetary Spin States

abstract: The TRAPPIST-1 system has 7 known terrestrial planets arranged compactly in a mean motion resonant chain around an ultra-cool central star, some within the estimated habitable zone. Given their short orbital periods of just a few days, it is often presumed that the planets are tidally locked such that the spin rate is equal to that of the orbital mean motion. However, the compact, and resonant, nature of the system implies that there can be significant variations in the mean motion of these planets due to their mutual interactions. We show that such fluctuations can then have significant effects on the spin states of these planets. In this paper, we analyze, using detailed numerical simulations, the mean motion histories of the three planets that are thought to lie within or close to the habitable zone of the system: planets d, e, and f. We demonstrate that, depending on the strength of the mutual interactions within the system, these planets can be pushed into spin states which are effectively non-synchronous. We find that it can produce significant libration of the spin state, if not complete circulation in the frame co-rotating with the orbit. We also show that these spin states are likely to be unable to sustain long-term stability, with many of our simulations suggesting that the spin evolves, under the influence of tidal synchronization forces, into quasi-stable attractor states, which last on timescales of thousands of years.


title: Resolving continua of fractional excitations by spinon echo in THz 2D coherent spectroscopy

abstract: We show that the new technique of terahertz 2D coherent spectroscopy is capable of giving qualitatively new information about fractionalized spin systems. For the prototypical example of the transverse field Ising chain, we demonstrate theoretically that, despite the broad continuum of excitations in linear response, the 2D spectrum contains sharp features that are a coherent signature of a `spinon echo', which gives previously inaccessible information such as the lifetime of the two-spinon excited state. The effects of disorder and finite lifetime, which are practically indistinguishable in the linear optical or neutron response, manifest in dramatically different fashion in the 2D spectra. Our results may be directly applicable to model quasi-1D transverse field Ising chain systems such as CoNb$_2$O$_6$, but the concept can be applied to fractionalized spin systems in general.


title: `Unhinging' the surfaces of higher-order topological insulators and superconductors

abstract: We show that the chiral Dirac and Majorana hinge modes in three-dimensional higher-order topological insulators (HOTIs) and superconductors (HOTSCs) can be gapped while preserving the protecting $\mathsf{C}_{2n}\mathcal T$ symmetry upon the introduction of non-Abelian surface topological order. In both cases, the topological order on a single side surface breaks time reversal symmetry, but appears with its time-reversal conjugate on alternating sides in a $\mathsf{C}_{2n}\mathcal T$ preserving pattern. In the absence of the HOTI/HOTSC bulk, such a pattern necessarily involves gapless chiral modes on hinges between $\mathsf{C}_{2n}\mathcal T$-conjugate domains. However, using a combination of $K$-matrix and anyon condensation arguments, we show that on the boundary of a 3D HOTI/HOTSC these topological orders are fully gapped and hence `anomalous'. Our results suggest that new patterns of surface and hinge states can be engineered by selectively introducing topological order only on specific surfaces.


title: Coherent backaction between spins and an electronic bath: Non-Markovian dynamics and low-temperature quantum thermodynamic electron cooling

abstract: We provide a versatile analytical framework for calculating the dynamics of a spin system in contact with a fermionic bath beyond the Markov approximation. The approach is based on a second order expansion of the Nakajima-Zwanzig master equation but systematically includes all quantum coherent memory effects leading to non-Markovian dynamics. Our results describe, for the free induction decay, the full time range from the non-Markovian dynamics at short times, to the well-known exponential thermal decay at long times. We provide full analytic results for the entire time range using a bath of itinerant electrons as an archetype for universal quantum fluctuations. Furthermore, we propose a quantum thermodynamic scheme to employ the temperature insensitivity of the non-Markovian decay to transport heat out of the electron system and thus, by repeated reinitialization of a cluster of spins, to efficiently cool the electrons at very low temperatures.


title: A non-perturbative test of consistency relations and their violation

abstract: In this paper, we verify the large scale structure consistency relations using N-body simulations, including modes in the highly non-linear regime. These relations (pointed out by Kehagias & Riotto and Peloso & Pietroni) follow from the symmetry of the dynamics under a shift of the Newtonian potential by a constant and a linear gradient, and predict the absence of certain poles in the ratio between the (equal time) squeezed bispectrum and power spectrum. The consistency relations, as symmetry statements, are exact, but have not been previously checked beyond the perturbative regime. Our test using N-body simulations not only offers a non-perturbative check, but also serves as a warm-up exercise for applications to observational data. A number of subtleties arise when taking the squeezed limit of the bispectrum--we show how to circumvent or address them. An interesting by-product of our investigation is an explicit demonstration that the linear-gradient symmetry is unaffected by the periodic boundary condition of the simulations. Lastly, we verify using simulations that the consistency relations are violated when the initial conditions are non-gaussian (of the local fNL type). The methodology developed here paves the way for constraining primordial non-gaussianity using large scale structure data, including (numerous) highly non-linear modes that are otherwise hard to interpret and utilize.


title: Magnetohydrodynamics in graphene: shear and Hall viscosities

abstract: Viscous phenomena are the hallmark of the hydrodynamic flow exhibited by Dirac fermions in clean graphene at high enough temperatures. We report a quantitative calculation of the electronic shear and Hall viscosities in graphene based on the kinetic theory combined with the renormalization group providing a unified description at arbitrary doping levels and non-quantizing magnetic fields. At charge neutrality, the Hall viscosity vanishes, while the field-dependent shear viscosity decays from its zero-field value saturating to a nonzero value in classically strong fields. Away from charge neutrality, the field-dependent viscosity coefficients tend to agree with the semiclassical expectation.

categories: cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el physics.flu-dyn physics.plasm-ph


title: Finite-Sample Analysis of Nonlinear Stochastic Approximation with Applications in Reinforcement Learning

abstract: Motivated by applications in reinforcement learning (RL), we study a nonlinear stochastic approximation (SA) algorithm under Markovian noise, and establish its finite-sample convergence bounds under various stepsizes. Specifically, we show that when using constant stepsize (i.e., $\alpha_k\equiv \alpha$), the algorithm achieves exponential fast convergence to a neighborhood (with radius $O(\alpha\log(1/\alpha))$) around the desired limit point. When using diminishing stepsizes with appropriate decay rate, the algorithm converges with rate $O(\log(k)/k)$. Our proof is based on Lyapunov drift arguments, and to handle the Markovian noise, we exploit the fast mixing of the underlying Markov chain. To demonstrate the generality of our theoretical results on Markovian SA, we use it to derive the finite-sample bounds of the popular $Q$-learning with linear function approximation algorithm, under a condition on the behavior policy. Importantly, we do not need to make the assumption that the samples are i.i.d., and do not require an artificial projection step in the algorithm to maintain the boundedness of the iterates. Numerical simulations corroborate our theoretical results.


title: Heavy dark matter particle annihilation in dwarf spheroidal galaxies: radio signals at the SKA telescope

abstract: A weakly interacting dark matter candidate is difficult to detect at high-energy colliders like the LHC, if its mass is close to, or higher than a TeV. On the other hand, pair-annihilation of such particles may give rise to $e^+ e^-$ pairs in dwarf spheroidal galaxies (dSph), which in turn can lead to radio synchrotron signals that are detectable at the upcoming Square Kilometre Array (SKA) telescope within a moderate observation time. We investigate the circumstances under which this complementarity between collider and radio signals of dark matter can be useful in probing physics beyond the standard model of elementary particles. Both particle physics issues and the roles of diffusion and electromagnetic energy loss of the $e^\pm$ are taken into account. First, the criteria for detectability of trans-TeV dark matter are analysed independently of the particle physics model(s) involved. We thereafter use some benchmarks based on a popular scenario, namely, the minimal supersymmetric standard model. It is thus shown that the radio flux from a dSph like Draco should be observable in about 100 hours at the SKA, for dark matter masses upto 4-8 TeV. In addition, the regions in the space spanned by astrophysical parameters, for which such signals should be detectable at the SKA, are marked out.


title: Quantifying the generalization error in deep learning in terms of data distribution and neural network smoothness

abstract: The accuracy of deep learning, i.e., deep neural networks, can be characterized by dividing the total error into three main types: approximation error, optimization error, and generalization error. Whereas there are some satisfactory answers to the problems of approximation and optimization, much less is known about the theory of generalization. Most existing theoretical works for generalization fail to explain the performance of neural networks in practice. To derive a meaningful bound, we study the generalization error of neural networks for classification problems in terms of data distribution and neural network smoothness. We introduce the cover complexity (CC) to measure the difficulty of learning a data set and the inverse of the modulus of continuity to quantify neural network smoothness. A quantitative bound for expected accuracy/error is derived by considering both the CC and neural network smoothness. Although most of the analysis is general and not specific to neural networks, we validate our theoretical assumptions and results numerically for neural networks by several data sets of images. The numerical results confirm that the expected error of trained networks scaled with the square root of the number of classes has a linear relationship with respect to the CC. We also observe a clear consistency between test loss and neural network smoothness during the training process. In addition, we demonstrate empirically that the neural network smoothness decreases when the network size increases whereas the smoothness is insensitive to training dataset size.


title: Equivalent and Approximate Transformations of Deep Neural Networks

abstract: Two networks are equivalent if they produce the same output for any given input. In this paper, we study the possibility of transforming a deep neural network to another network with a different number of units or layers, which can be either equivalent, a local exact approximation, or a global linear approximation of the original network. On the practical side, we show that certain rectified linear units (ReLUs) can be safely removed from a network if they are always active or inactive for any valid input. If we only need an equivalent network for a smaller domain, then more units can be removed and some layers collapsed. On the theoretical side, we constructively show that for any feed-forward ReLU network, there exists a global linear approximation to a 2-hidden-layer shallow network with a fixed number of units. This result is a balance between the increasing number of units for arbitrary approximation with a single layer and the known upper bound of $\lceil log(n_0+1)\rceil +1$ layers for exact representation, where $n_0$ is the input dimension. While the transformed network may require an exponential number of units to capture the activation patterns of the original network, we show that it can be made substantially smaller by only accounting for the patterns that define linear regions. Based on experiments with ReLU networks on the MNIST dataset, we found that $l_1$-regularization and adversarial training reduces the number of linear regions significantly as the number of stable units increases due to weight sparsity. Therefore, we can also intentionally train ReLU networks to allow for effective loss-less compression and approximation.


title: Discovery of new stellar groups in the Orion complex

abstract: We test the ability of two unsupervised machine learning algorithms, \textit{EnLink} and Shared Nearest Neighbour (SNN), to identify stellar groupings in the Orion star-forming complex as an application to the 5-dimensional astrometric data from \textit{Gaia} DR2. The algorithms represent two distinct approaches to limiting user bias when selecting parameter values and evaluating the relative weights among astrometric parameters. \textit{EnLink} adopts a locally adaptive distance metric and eliminates the need of parameter tuning through automation. The original SNN relies only on human input for parameter tuning so we modified SNN to run in two stages. We first ran the original SNN 7,000 times, each with a randomly generated sample according to within-source co-variance matrices provided in \textit{Gaia} DR2 and random parameter values within reasonable ranges. During the second stage, we modified SNN to identify the most repeating stellar groups from 25,798 we obtained in the first stage. We reveal 21 spatially- and kinematically-coherent groups in the Orion complex, 12 of which previously unknown. The groups show a wide distribution of distances extending as far as about 150 pc in front of the star-forming Orion molecular clouds, to about 50 pc beyond them where we find, unexpectedly, several groups. Our results expose to view the wealth of sub-structure in the OB association, within and beyond the classical Blaauw Orion OBI sub-groups. A full characterization of the new groups is of the essence as it offers the potential to unveil how star formation proceeds globally in large complexes such as Orion. The data and code that generated the groups in this work as well as the final table can be found at \protect\url{ https://github.com/BoquanErwinChen/GaiaDR2_Orion_Dissection}.


title: Treelike interactions and fast scrambling with cold atoms

abstract: We propose an experimentally realizable quantum spin model that exhibits fast scrambling, based on non-local interactions which couple sites whose separation is a power of 2. By controlling the relative strengths of deterministic, non-random couplings, we can continuously tune from the linear geometry of a nearest-neighbor spin chain to an ultrametric geometry in which the effective distance between spins is governed by their positions on a tree graph. The transition in geometry can be observed in quench dynamics, and is furthermore manifest in calculations of the entanglement entropy. Between the linear and treelike regimes, we find a peak in entanglement and exponentially fast spreading of quantum information across the system. Our proposed implementation, harnessing photon-mediated interactions among cold atoms in an optical cavity, offers a test case for experimentally observing the emergent geometry of a quantum many-body system.


title: Semilinear integro-differential equations, II: one-dimensional and saddle-shaped solutions to the Allen-Cahn equation

abstract: This paper addresses saddle-shaped solutions to the semilinear equation $L_K u = f(u)$ in $\mathbb{R}^{2m}$, where $L_K$ is a linear elliptic integro-differential operator with a radially symmetric kernel $K$, and $f$ is of Allen-Cahn type. Saddle-shaped solutions are doubly radial, odd with respect to the Simons cone $\{(x', x'') \in \mathbb{R}^m \times \mathbb{R}^m \, : \, |x'| = |x''|\}$, and vanish only in this set. We establish the uniqueness and the asymptotic behavior of the saddle-shaped solution. For this, we prove a Liouville type result, the one-dimensional symmetry of positive solutions to semilinear problems in a half-space, and maximum principles in "narrow" sets. The existence of the solution was already proved in part I of this work.


title: On the field generated by the periods of a Drinfeld module

abstract: Generalizing the results of Maurischat in \cite{Maurischatxx}, we show that the field $K_{\infty}(\Lambda)$ of periods of a Drinfeld module $\phi$ of rank $r$ defined over $K_{\infty} = \mathds{F}_{q}((T^{-1}))$ may be arbitrarily large over $K_{\infty}$. We also show that, in contrast, the residue class degree $f( K_{\infty}(\Lambda) | K_{\infty})$ remains bounded by a constant that depends only on $r$.


title: The Rise of SMEFT On-shell Amplitudes

abstract: We present a map between the tree-level Standard Model Effective Theory (SMEFT) in the Warsaw basis and massive on-shell amplitudes. As a first step, we focus on the electroweak sector without fermions. We describe the Feynman rules for a particular choice of input scheme and compare them with the 3-point massive amplitudes in the broken phase. Thereby we fix an on-shell basis which allows us to study scattering amplitudes with recursion relations. We hope to open up new avenues of exploration to a complete formulation of massive EFTs in the on-shell language.


title: On the identification of individual principal stratum direct, natural direct and pleiotropic effects without cross world independence assumptions

abstract: The analysis of natural direct and principal stratum direct effects has a controversial history in statistics and causal inference as these effects are commonly identified with either untestable cross world independence or graphical assumptions. This paper demonstrates that the presence of individual level natural direct and principal stratum direct effects can be identified without cross world independence assumptions. We also define a new type of causal effect, called pleiotropy, that is of interest in genomics, and provide empirical conditions to detect such an effect as well. Our results are applicable for all types of distributions concerning the mediator and outcome.


title: Use DG-methods to build a matrix factorization

abstract: Let P be a commutative Noetherian ring, K be an ideal of P which is generated by a regular sequence of length four, f be a regular element of P, and Pbar be the hypersurface ring P/(f). Assume that K:f is a grade four Gorenstein ideal of P. We give a resolution N of Pbar/K Pbar by free Pbar-modules. The resolution N is built from a Differential Graded Algebra resolution of P/(K:f) by free P-modules, together with one homotopy map. In particular, we give an explicit form for the matrix factorization which is the infinite tail of the resolution N.


title: Kalman Filter, Sensor Fusion, and Constrained Regression: Equivalences and Insights

abstract: The Kalman filter (KF) is one of the most widely used tools for data assimilation and sequential estimation. In this work, we show that the state estimates from the KF in a standard linear dynamical system setting are equivalent to those given by the KF in a transformed system, with infinite process noise (i.e., a "flat prior") and an augmented measurement space. This reformulation -- which we refer to as augmented measurement sensor fusion (SF) -- is conceptually interesting, because the transformed system here is seemingly static (as there is effectively no process model), but we can still capture the state dynamics inherent to the KF by folding the process model into the measurement space. Further, this reformulation of the KF turns out to be useful in settings in which past states are observed eventually (at some lag). Here, when the measurement noise covariance is estimated by the empirical covariance, we show that the state predictions from SF are equivalent to those from a regression of past states on past measurements, subject to particular linear constraints (reflecting the relationships encoded in the measurement map). This allows us to port standard ideas (say, regularization methods) in regression over to dynamical systems. For example, we can posit multiple candidate process models, fold all of them into the measurement model, transform to the regression perspective, and apply $\ell_1$ penalization to perform process model selection. We give various empirical demonstrations, and focus on an application to nowcasting the weekly incidence of influenza in the US.


title: A Survey of Adaptive Resonance Theory Neural Network Models for Engineering Applications

abstract: This survey samples from the ever-growing family of adaptive resonance theory (ART) neural network models used to perform the three primary machine learning modalities, namely, unsupervised, supervised and reinforcement learning. It comprises a representative list from classic to modern ART models, thereby painting a general picture of the architectures developed by researchers over the past 30 years. The learning dynamics of these ART models are briefly described, and their distinctive characteristics such as code representation, long-term memory and corresponding geometric interpretation are discussed. Useful engineering properties of ART (speed, configurability, explainability, parallelization and hardware implementation) are examined along with current challenges. Finally, a compilation of online software libraries is provided. It is expected that this overview will be helpful to new and seasoned ART researchers.


title: Jamming and percolation of $k^2$-mers on simple cubic lattices

abstract: Jamming and percolation of square objects of size $k \times k$ ($k^2$-mers) isotropically deposited on simple cubic lattices have been studied by numerical simulations complemented with finite-size scaling theory. The $k^2$-mers were irreversibly deposited into the lattice. Jamming coverage $\theta_{j,k}$ was determined for a wide range of $k$ ($2 \leq k \leq 200$). $\theta_{j,k}$ exhibits a decreasing behavior with increasing $k$, being $\theta_{j,k\rightarrow\infty}=0.4285(6)$ the limit value for large $k^2$-mer sizes. On the other hand, the obtained results shows that percolation threshold, $\theta_{c,k}$, has a strong dependence on $k$. It is a decreasing function in the range $2 \leq k \leq 18$ with a minimum around $k=18$ and, for $k \geq 18$, it increases smoothly towards a saturation value. Finally, a complete analysis of critical exponents and universality has been done, showing that the percolation phase transition involved in the system has the same universality class as the 3D random percolation, regardless of the size $k$ considered.


title: Resolving the cosmic X-ray background with a next-generation high-energy X-ray observatory

abstract: The cosmic X-ray background (CXB), which peaks at an energy of ~30 keV, is produced primarily by emission from accreting supermassive black holes (SMBHs). The CXB therefore serves as a constraint on the integrated SMBH growth in the Universe and the accretion physics and obscuration in active galactic nuclei (AGNs). This paper gives an overview of recent progress in understanding the high-energy (>~10 keV) X-ray emission from AGNs and the synthesis of the CXB, with an emphasis on results from NASA's NuSTAR hard X-ray mission. We then discuss remaining challenges and open questions regarding the nature of AGN obscuration and AGN physics. Finally, we highlight the exciting opportunities for a next-generation, high-resolution hard X-ray mission to achieve the long-standing goal of resolving and characterizing the vast majority of the accreting SMBHs that produce the CXB.


title: Jamming and percolation of $k^3$-mers on simple cubic lattices

abstract: Jamming and percolation of three-dimensional (3D) $k \times k \times k $ cubic objects ($k^3$-mers) deposited on simple cubic lattices have been studied by numerical simulations complemented with finite-size scaling theory. The $k^3$-mers were irreversibly deposited into the lattice. Jamming coverage $\theta_{j,k}$ was determined for a wide range of $k$ ($2 \leq k \leq 40$). $\theta_{j,k}$ exhibits a decreasing behavior with increasing $k$, being $\theta_{j,k=\infty}=0.4204(9)$ the limit value for large $k^3$-mer sizes. In addition, a finite-size scaling analysis of the jamming transition was carried out, and the corresponding spatial correlation length critical exponent $\nu_j$ was measured, being $\nu_j \approx 3/2$. On the other hand, the obtained results for the percolation threshold $\theta_{p,k}$ showed that $\theta_{p,k}$ is an increasing function of $k$ in the range $2 \leq k \leq 16$. For $k \geq 17$, all jammed configurations are non-percolating states, and consequently, the percolation phase transition disappears. The interplay between the percolation and the jamming effects is responsible for the existence of a maximum value of $k$ (in this case, $k = 16$) from which the percolation phase transition no longer occurs. Finally, a complete analysis of critical exponents and universality has been done, showing that the percolation phase transition involved in the system has the same universality class as the 3D random percolation, regardless of the size $k$ considered.


title: Electronic structure of a graphene-like artificial crystal of $NdNiO_3$

abstract: Artificial complex-oxide heterostructures containing ultrathin buried layers grown along the pseudocubic [111] direction have been predicted to host a plethora of exotic quantum states arising from the graphene-like lattice geometry and the interplay between strong electronic correlations and band topology. To date, however, electronic-structural investigations of such atomic layers remain an immense challenge due to the shortcomings of conventional surface-sensitive probes, with typical information depths of a few Angstroms. Here, we use a combination of bulk-sensitive soft x-ray angle-resolved photoelectron spectroscopy (SX-ARPES), hard x-ray photoelectron spectroscopy (HAXPES) and state-of-the-art first-principles calculations to demonstrate a direct and robust method for extracting momentum-resolved and angle-integrated valence-band electronic structure of an ultrathin buckled graphene-like layer of $NdNiO_3$ confined between two 4-unit cell-thick layers of insulating $LaAlO_3$. The momentum-resolved dispersion of the buried Ni d states near the Fermi level obtained via SX-ARPES is in excellent agreement with the first-principles calculations and establishes the realization of an antiferro-orbital order in this artificial lattice. The HAXPES measurements reveal the presence of a valence-band (VB) bandgap of 265 meV. Our findings open a promising avenue for designing and investigating quantum states of matter with exotic order and topology in a few buried layers.


title: Meta Distribution of SIR in Dual-Hop Internet-of-Things (IoT) Networks

abstract: This paper characterizes the meta distribution of the downlink signal-to-interference ratio (SIR) attained at a typical Internet-of-Things (IoT) device in a dual-hop IoT network. The IoT device associates with either a serving macro base station (MBS) for direct transmissions or associates with a decode and forward (DF) relay for dual-hop transmissions, depending on the biased received signal power criterion. In contrast to the conventional success probability, the meta distribution is the distribution of the conditional success probability (CSP), which is conditioned on the locations of the wireless transmitters. The meta distribution is a fine-grained performance metric that captures important network performance metrics such as the coverage probability and the mean local delay as its special cases. Specifically, we derive the moments of the CSP in order to calculate analytic expressions for the meta distribution. Further, we derive mathematical expressions for special cases such as the mean local delay, variance of the CSP, and success probability of a typical IoT device and typical relay with different offloading biases. We take in consideration in our analysis the association probabilities of IoT devices. Finally, we investigate the impact of increasing the relay density on the mean local delay using numerical results.


title: Black hole shadow of a rotating polytropic black hole by the Newman--Janis algorithm without complexification

abstract: In this work, starting from a spherically symmetric polytropic black hole, a rotating solution is obtained by following the Newman--Janis algorithm without complexification. Besides studying the horizon, the static conditions and causality issues of the rotating solution, we obtain and discuss the shape of its shadow. Some other physical features as the Hawking temperature and emission rate of the rotating polytropic black hole solution are also discussed.


title: Manipulating Acoustic and Plasmonic Modes in Gold Nanostars

abstract: In this contribution experimental evidence of plasmonic edge modes and breathing acoustic modes in gold nanostars (AuNS) is reported. AuNS are synthesized in a surfactant-free, one-step wet-chemistry method. Optical extinction measurements of AuNS confirm the presence of localized surface plasmon resonances (LSPRs), while electron energy-loss spectroscopy (EELS) in the scanning transmission electron microscope (STEM) shows the spatial distribution of LSPRs and reveals the presence of acoustic breathing modes. Plasmonic hot-spots generated at the pinnacle of the sharp spikes, due to the optically active edge dipolar mode, allow significant intensity enhancement of local fields, hot-electron injection, and thus useful for size detection of small protein molecules. The breathing modes observed away from the apices of the nanostars are identified as stimulated dark modes - they have an acoustic nature - and likely originate from the confinement of the surface plasmon by the geometrical boundaries of a nanostructure. The presence of both types of modes is verified by numerical simulations. Both these modes offer the possibility to design nanoplasmonic antenna based on AuNS, which can provide information both on mass and polarizability of biomolecules using a two-step molecular detection process.


title: COSET: A Benchmark for Evaluating Neural Program Embeddings

abstract: Neural program embedding can be helpful in analyzing large software, a task that is challenging for traditional logic-based program analyses due to their limited scalability. A key focus of recent machine-learning advances in this area is on modeling program semantics instead of just syntax. Unfortunately evaluating such advances is not obvious, as program semantics does not lend itself to straightforward metrics. In this paper, we introduce a benchmarking framework called COSET for standardizing the evaluation of neural program embeddings. COSET consists of a diverse dataset of programs in source-code format, labeled by human experts according to a number of program properties of interest. A point of novelty is a suite of program transformations included in COSET. These transformations when applied to the base dataset can simulate natural changes to program code due to optimization and refactoring and can serve as a "debugging" tool for classification mistakes. We conducted a pilot study on four prominent models: TreeLSTM, gated graph neural network (GGNN), AST-Path neural network (APNN), and DYPRO. We found that COSET is useful in identifying the strengths and limitations of each model and in pinpointing specific syntactic and semantic characteristics of programs that pose challenges.


title: Fisher-KPP dynamics in diffusive Rosenzweig-MacArthur and Holling-Tanner models

abstract: We prove the existence of traveling fronts in diffusive Rosenzweig-MacArthur and Holling-Tanner population models and investigate their relation with fronts in a scalar Fisher-KPP equation. More precisely, we prove the existence of fronts in a Rosenzweig-MacArthur predator-prey model in two situations: when the prey diffuses at the rate much smaller than that of the predator and when both the predator and the prey diffuse very slowly. Both situations are captured as singular perturbations of the associated limiting systems. In the first situation we demonstrate clear relations of the fronts with the fronts in a scalar Fisher-KPP equation. Indeed, we show that the underlying dynamical system in a singular limit is reduced to a scalar Fisher-KPP equation and the fronts supported by the full system are small perturbations of the Fisher-KPP fronts. We obtain a similar result for a diffusive Holling-Tanner population model. In the second situation for the Rosenzweig-MacArthur model we prove the existence of the fronts but without observing a direct relation with Fisher-KPP equation. The analysis suggests that, in a variety of reaction-diffusion systems that rise in population modeling, parameter regimes may be found when the dynamics of the system is inherited from the scalar Fisher-KPP equation.


title: A Symmetric Encoder-Decoder with Residual Block for Infrared and Visible Image Fusion

abstract: In computer vision and image processing tasks, image fusion has evolved into an attractive research field. However, recent existing image fusion methods are mostly built on pixel-level operations, which may produce unacceptable artifacts and are time-consuming. In this paper, a symmetric encoder-decoder with a residual block (SEDR) for infrared and visible image fusion is proposed. For the training stage, the SEDR network is trained with a new dataset to obtain a fixed feature extractor. For the fusion stage, first, the trained model is utilized to extract the intermediate features and compensation features of two source images. Then, extracted intermediate features are used to generate two attention maps, which are multiplied to the input features for refinement. In addition, the compensation features generated by the first two convolutional layers are merged and passed to the corresponding deconvolutional layers. At last, the refined features are fused for decoding to reconstruct the final fused image. Experimental results demonstrate that the proposed fusion method (named as SEDRFuse) outperforms the state-of-the-art fusion methods in terms of both subjective and objective evaluations.


title: Probabilistic morphisms and Bayesian nonparametrics

abstract: In this paper we develop a functorial language of probabilistic morphisms and apply it to some basic problems in Bayesian nonparametrics. First we extend and unify the Kleisli category of probabilistic morphisms proposed by Lawvere and Giry with the category of statistical models proposed by Chentsov and Morse-Sacksteder. Then we introduce the notion of a Bayesian statistical model that formalizes the notion of a parameter space with a given prior distribution in Bayesian statistics. {We revisit the existence of a posterior distribution, using probabilistic morphisms}. In particular, we give an explicit formula for posterior distributions of the Bayesian statistical model, assuming that the underlying parameter space is a Souslin space and the sample space is a subset in a complete connected finite dimensional Riemannian manifold. Then we give a new proof of the existence of Dirichlet measures over any measurable space using a functorial property of the Dirichlet map constructed by Sethuraman.


title: VQVAE Unsupervised Unit Discovery and Multi-scale Code2Spec Inverter for Zerospeech Challenge 2019

abstract: We describe our submitted system for the ZeroSpeech Challenge 2019. The current challenge theme addresses the difficulty of constructing a speech synthesizer without any text or phonetic labels and requires a system that can (1) discover subword units in an unsupervised way, and (2) synthesize the speech with a target speaker's voice. Moreover, the system should also balance the discrimination score ABX, the bit-rate compression rate, and the naturalness and the intelligibility of the constructed voice. To tackle these problems and achieve the best trade-off, we utilize a vector quantized variational autoencoder (VQ-VAE) and a multi-scale codebook-to-spectrogram (Code2Spec) inverter trained by mean square error and adversarial loss. The VQ-VAE extracts the speech to a latent space, forces itself to map it into the nearest codebook and produces compressed representation. Next, the inverter generates a magnitude spectrogram to the target voice, given the codebook vectors from VQ-VAE. In our experiments, we also investigated several other clustering algorithms, including K-Means and GMM, and compared them with the VQ-VAE result on ABX scores and bit rates. Our proposed approach significantly improved the intelligibility (in CER), the MOS, and discrimination ABX scores compared to the official ZeroSpeech 2019 baseline or even the topline.


title: Physical Layer Security for Visible Light Communication Systems: A Survey

abstract: Due to the dramatic increase in high data rate services and in order to meet the demands of the fifth-generation (5G) networks, researchers from both academia and industry are exploring advanced transmission techniques, new network architectures and new frequency spectrum such as the visible light spectra. Visible light communication (VLC) particularly is an emerging technology that has been introduced as a promising solution for 5G and beyond. Although VLC systems are more immune against interference and less susceptible to security vulnerabilities since light does not penetrate through walls, security issues arise naturally in VLC channels due to their open and broadcasting nature, compared to fiber-optic systems. In addition, since VLC is considered to be an enabling technology for 5G, and security is one of the 5G fundamental requirements, security issues should be carefully addressed and resolved in the VLC context. On the other hand, due to the success of physical layer security (PLS) in improving the security of radio-frequency (RF) wireless networks, extending such PLS techniques to VLC systems has been of great interest. Only two survey papers on security in VLC have been published in the literature. However, a comparative and unified survey on PLS for VLC from information theoretic and signal processing point of views is still missing. This paper covers almost all aspects of PLS for VLC, including different channel models, input distributions, network configurations, precoding/signaling strategies, and secrecy capacity and information rates. Furthermore, we propose a number of timely and open research directions for PLS-VLC systems, including the application of measurement-based indoor and outdoor channel models, incorporating user mobility and device orientation into the channel model, and combining VLC and RF systems to realize the potential of such technologies.


title: Microtubule Motility Analysis based on Time-Lapse Fluorescence Microscopy

abstract: This paper describes an investigation into part of the mechanical mechanisms underlying the formation of mitotic spindle, the cellular machinery responsible for chromosomal separation during cell division. In normal eukaryotic cells, spindles are composed of microtubule filaments that radiate outward from two centrosomes. In many transformed cells, however, centrosome number is misregulated resulting in cells with more than two centrosomes. Addressing the question of how these cells accommodate these additional structures by coalescing supernumerary centrosomes to form normal spindles will provide a powerful insight toward understanding the proliferation of cancer cells and developing new therapeutics. The process of centrosome coalescence is thought to involve motor proteins that function to slide microtubules relative to one another. Here we use in vitro motility assays combined with fluorescence microscopy to visualize, characterize and quantify microtubule-microtubule interactions. After segmenting the microtubules, their speed and direction of movement are the extracted features to cluster their interaction type. In order to evaluate the potential of our processing algorithm, we created a simulated dataset similar to the time-lapse series. Once our procedure has been optimized using the simulated data, we will apply it to the real data. Results of our analyses will provide a quantitative description of interaction among microtubules. This is a potentially important step toward more thorough understanding of cancer.


title: Mixed Precision DNNs: All you need is a good parametrization

abstract: Efficient deep neural network (DNN) inference on mobile or embedded devices typically involves quantization of the network parameters and activations. In particular, mixed precision networks achieve better performance than networks with homogeneous bitwidth for the same size constraint. Since choosing the optimal bitwidths is not straight forward, training methods, which can learn them, are desirable. Differentiable quantization with straight-through gradients allows to learn the quantizer's parameters using gradient methods. We show that a suited parametrization of the quantizer is the key to achieve a stable training and a good final performance. Specifically, we propose to parametrize the quantizer with the step size and dynamic range. The bitwidth can then be inferred from them. Other parametrizations, which explicitly use the bitwidth, consistently perform worse. We confirm our findings with experiments on CIFAR-10 and ImageNet and we obtain mixed precision DNNs with learned quantization parameters, achieving state-of-the-art performance.


title: Dirac geometry and integration of Poisson homogeneous spaces

abstract: Using tools from Dirac geometry and through an explicit construction, we show that every Poisson homogeneous space of any Poisson Lie group admits an integration to a symplectic groupoid. Our theorem follows from a more general result which relates, for a principal bundle $M\to M/H$, integrations of a Dirac structure on $M/H$ to $H$-admissible integrations of its pullback Dirac structure on $M$ by pre-symplectic groupoids. Our construction gives a distinguished class of explicit real or holomorphic pre-symplectic and symplectic groupoids over semi-simple Lie groups and some of their homogeneous spaces, including their symmetric spaces, conjugacy classes, and flag varieties. In a more general framework, we also show integrability of all homogeneous spaces of ${\mathcal{LA}}^\vee$-Lie groups in the sense of E. Meinrenken.


title: Geometric structures and the Laplace spectrum

abstract: Inspired by the role geometric structures play in our understanding of surfaces and three-manifolds, and Berger's observation that a surface of constant sectional curvature is determined up to local isometry by its Laplace spectrum, we explore the extent to which compact locally homogeneous three-manifolds are characterized up to local isometry by their spectra. We observe that there are eight `metrically maximal' three-dimensional geometries on which all compact locally homogeneous three-manifolds are modeled and we demonstrate that for five of these geometries the associated compact locally homogeneous three-manifolds are determined up to local isometry by their spectra within the universe of locally homogeneous three-manifolds. Specifically, we show that among compact locally homogeneous three-manifolds, a Riemannian three-manifold is determined up to local isometry if its universal Riemannian cover is isometric to (1) a symmetric space, (2) $\mathbb{R}^2 \rtimes \mathbb{R}$ endowed with a left-invariant metric, (3) $\operatorname{Nil}$ endowed with a left-invariant metric, or (4) $S^3$ endowed with a left-invariant metric sufficiently close to a metric of constant sectional curvature. We then deduce that three-dimensional Riemannian nilmanifolds and locally symmetric spaces with universal Riemannian cover $\mathbb{S}^2 \times \mathbb{E}$ are uniquely characterized by their spectra among compact locally homogeneous three-manifolds. Finally, within the collection of closed manifolds covered by $\operatorname{Sol}$ equipped with a left-invariant metric, local geometry is `audible.'


title: Capsule Routing via Variational Bayes

abstract: Capsule networks are a recently proposed type of neural network shown to outperform alternatives in challenging shape recognition tasks. In capsule networks, scalar neurons are replaced with capsule vectors or matrices, whose entries represent different properties of objects. The relationships between objects and their parts are learned via trainable viewpoint-invariant transformation matrices, and the presence of a given object is decided by the level of agreement among votes from its parts. This interaction occurs between capsule layers and is a process called routing-by-agreement. In this paper, we propose a new capsule routing algorithm derived from Variational Bayes for fitting a mixture of transforming gaussians, and show it is possible transform our capsule network into a Capsule-VAE. Our Bayesian approach addresses some of the inherent weaknesses of MLE based models such as the variance-collapse by modelling uncertainty over capsule pose parameters. We outperform the state-of-the-art on smallNORB using 50% fewer capsules than previously reported, achieve competitive performances on CIFAR-10, Fashion-MNIST, SVHN, and demonstrate significant improvement in MNIST to affNIST generalisation over previous works.


title: Bianchi models with a free massless scalar field: invariant sets and higher symmetries

abstract: We scrutinize the overall structure of the space of cosmological models of Bianchi type I-VII$_h$ that contain a free massless scalar field, with a spatially homogeneous gradient $\nabla_\mu \varphi$ that generally breaks isotropy, in addition to a standard perfect fluid. Specifically, state space is written as a union of disjoint invariant sets, each corresponding to a particular cosmological model that is classified with respect to the Bianchi type and the matter content. Subsets corresponding to higher-symmetry models, including all locally rotationally symmetric models and FLRW models, and models with a shear-free normal congruence, are also derived and classified. For each model the dimension ($d$) of the space of initial data is given, after fixing the orientation of the orthonormal frame uniquely relative to matter anisotropies and geometrical anisotropies.


title: Characterizing K2 Candidate Planetary Systems Orbiting Low-Mass Stars IV: Updated Properties for 86 Cool Dwarfs Observed During Campaigns 1-17

abstract: We present revised stellar properties for 172 K2 target stars that were identified as possible hosts of transiting planets during Campaigns 1-17. Using medium-resolution near-infrared spectra acquired with the NASA Infrared Telescope Facility/SpeX and Palomar/TripleSpec, we found that 86 of our targets were bona fide cool dwarfs, 74 were hotter dwarfs, and 12 were giants. Combining our spectroscopic metallicities with Gaia parallaxes and archival photometry, we derived photometric stellar parameters and compared them to our spectroscopic estimates. Although our spectroscopic and photometric radius and temperature estimates are consistent, our photometric mass estimates are systematically 0.11 solar masses (34%) higher than our spectroscopic mass estimates for the least massive stars (photometric mass estimates < 0.4 solar masses). Adopting the photometric parameters and comparing our results to parameters reported in the Ecliptic Plane Input Catalog, our revised stellar radii are 0.15 solar radii (40%) larger and our revised stellar effective temperatures are roughly 65K cooler. Correctly determining the properties of K2 target stars is essential for characterizing any associated planet candidates, estimating the planet search sensitivity, and calculating planet occurrence rates. Even though Gaia parallaxes have increased the power of photometric surveys, spectroscopic characterization remains essential for determining stellar metallicities and investigating correlations between stellar metallicity and planetary properties.


title: Distinguishing noisy boson sampling from classical simulations

abstract: Giving a convincing experimental evidence of the quantum supremacy over classical simulations is a challenging goal. Noise is considered to be the main problem in such a demonstration, hence it is urgent to understand the effect of noise. Recently found classical algorithms can efficiently approximate, to any small error, the output of boson sampling with finite-amplitude noise. In this work it is shown analytically and confirmed by numerical simulations that one can efficiently distinguish the output distribution of such a noisy boson sampling from the approximations accounting for low-order quantum multiboson interferences, what includes the mentioned classical algorithms. The number of samples required to tell apart the quantum and classical output distributions is strongly affected by the previously unexplored parameter: density of bosons, i.e., the ratio of total number of interfering bosons to number of input ports of interferometer. Such critical dependence is strikingly reminiscent of the quantum-to-classical transition in systems of identical particles, which sets in when the system size scales up while density of particles vanishes.


title: Limiting entropy of determinantal processes

abstract: We extend Lyons's tree entropy theorem to general determinantal measures. As a byproduct we show that the sofic entropy of an invariant determinantal measure does not depend on the chosen sofic approximation.


title: Incidence Networks for Geometric Deep Learning

abstract: Sparse incidence tensors can represent a variety of structured data. For example, we may represent attributed graphs using their node-node, node-edge, or edge-edge incidence matrices. In higher dimensions, incidence tensors can represent simplicial complexes and polytopes. In this paper, we formalize incidence tensors, analyze their structure, and present the family of equivariant networks that operate on them. We show that any incidence tensor decomposes into invariant subsets. This decomposition, in turn, leads to a decomposition of the corresponding equivariant linear maps, for which we prove an efficient pooling-and-broadcasting implementation.


title: Design and Performance Analysis of an Index Time Frequency Modulation Scheme for Optical Communications

abstract: In this article, we propose an index modulation system suitable for optical communications, based on jointly driving the time and frequency of the signal: an index-time frequency hopping (I-TFH) system. We analyze its performance from the point of view of its efficiency in power and spectrum, and its behavior in terms of error probability for the non-turbulent free-space optical (FSO) channel. We compare I-TFH with already proposed index modulated systems of the same nature, but where the amplitude or the number of transmitters are driven instead of the signal frequency. We derive and compare approximations for the average symbol and bit error probabilities of all these systems. The simulation results show that said approximations are tight enough for a wide range of signal-to-noise ratios and system parameters. Moreover, I-TFH shows to be better performing in BER and/or power efficiency than the comparative alternatives, and may offer interesting properties in a variety of contexts.


title: Forecasting Stock Market with Support Vector Regression and Butterfly Optimization Algorithm

abstract: Support Vector Regression (SVR) has achieved high performance on forecasting future behavior of random systems. However, the performance of SVR models highly depends upon the appropriate choice of SVR parameters. In this study, a novel BOA-SVR model based on Butterfly Optimization Algorithm (BOA) is presented. The performance of the proposed model is compared with eleven other meta-heuristic algorithms on a number of stocks from NASDAQ. The results indicate that the presented model here is capable to optimize the SVR parameters very well and indeed is one of the best models judged by both prediction performance accuracy and time consumption.


title: Two-loop triangle integrals with 4 scales for the $HZV$ vertex

abstract: We calculate analytically the two-loop triangle integrals entering the $\mathcal{O}(\alpha\alpha_s)$ corrections to the $HZV$ vertex with $V=Z^*,\gamma^*$ using the method of differential equations. Our result provides a prototype to study the analytic properties of multi-loop multi-scale Feynman integrals, and also allows fast numeric evaluation for phenomenological studies. We apply our results to the leptonic decay of the Higgs boson and to $ZH$ production at electron-positron colliders. Besides the top quark loop, we include also the bottom quark loop contributions, whose evaluation takes a lot of time using purely numeric methods, but is very efficient with our analytic results.


title: Sequences of expected record values

abstract: We investigate conditions in order to decide whether a given sequence of real numbers represents expected record values arising from an independent, identically distributed, sequence of random variables. The main result provides a necessary and sufficient condition, relating any expected record sequence with the Stieltjes moment problem. The results are proved by means of a useful transformation on random variables. Some properties of this mapping, and its inverse, are discussed in detail, and, under mild conditions, an explicit inversion formula for the random variable that admits a given expected record sequence is obtained. Key words and phrases: characterizations; expected record values; Stieltjes moment problem; transformation of random variables; inversion formula. AMS subject classification: Primary 60E05, 62G30; Secondary 44A60.


title: ADDIS: an adaptive discarding algorithm for online FDR control with conservative nulls

abstract: Major internet companies routinely perform tens of thousands of A/B tests each year. Such large-scale sequential experimentation has resulted in a recent spurt of new algorithms that can provably control the false discovery rate (FDR) in a fully online fashion. However, current state-of-the-art adaptive algorithms can suffer from a significant loss in power if null p-values are conservative (stochastically larger than the uniform distribution), a situation that occurs frequently in practice. In this work, we introduce a new adaptive discarding method called ADDIS that provably controls the FDR and achieves the best of both worlds: it enjoys appreciable power increase over all existing methods if nulls are conservative (the practical case), and rarely loses power if nulls are exactly uniformly distributed (the ideal case). We provide several practical insights on robust choices of tuning parameters, and extend the idea to asynchronous and offline settings as well.


title: Ground states for generalized gauge actions on UHF algebras

abstract: We describe the structure of ground states and ceiling states for generalized gauge actions on an UHF algebra. It is shown that both sets are affinely homeomorphic to the state space of a unital AF algebra, and that any pair of unital AF algebras can occur in this way, independently of the field of KMS states. In addtion, we study the KMS-infinity states.


title: The Octagon as a Determinant

abstract: The computation of a certain class of four-point functions of heavily charged BPS operators boils down to the computation of a special form factor - the octagon. In this paper, which is an extended version of the short note [1], we derive a non-perturbative formula for the square of the octagon as the determinant of a semi-infinite skew-symmetric matrix. We show that perturbatively in the weak coupling limit the octagon is given by a determinant constructed from the polylogarithms evaluating ladder Feynman graphs. We also give a simple operator representation of the octagon in terms of a vacuum expectation value of massless free bosons or fermions living in the rapidity plane.


title: Scaleable input gradient regularization for adversarial robustness

abstract: In this work we revisit gradient regularization for adversarial robustness with some new ingredients. First, we derive new per-image theoretical robustness bounds based on local gradient information. These bounds strongly motivate input gradient regularization. Second, we implement a scaleable version of input gradient regularization which avoids double backpropagation: adversarially robust ImageNet models are trained in 33 hours on four consumer grade GPUs. Finally, we show experimentally and through theoretical certification that input gradient regularization is competitive with adversarial training. Moreover we demonstrate that gradient regularization does not lead to gradient obfuscation or gradient masking.


title: Comment on: On the irreducibility of the Severi variety of nodal curves in a smooth surface, by E. Ballico

abstract: In this short note, I point out that results of Ballico and Kool--Shende--Thomas together imply that on $K3$, Enriques, and Abelian surfaces, if $L$ is a very ample and $(2p_a(L)-2g-1)$-spanned line bundle, then the equigeneric Severi variety $V_{g}(L)$ of all curves in $|L|$ having genus $g$ is non-empty, irreducible, of the expected dimension, and its general member is a $(p_a(L)-g)$-nodal curve.


title: Local time stepping methods and discontinuous Galerkin methods applied to diffusion advection reaction equations

abstract: This paper is focussed on the numerical resolution of diffusion advection and reaction equations (DAREs) with special features (such as fractures, walls, corners, obstacles or point loads) which globally, as well as locally, have important effects on the solution. We introduce a multilevel and local time solver of DAREs based on the discontinuous Galerkin (DG) method for the spatial discreization and time stepping methods such as exponential time differencing (ETD), exponential Rosenbrock (EXPR) and implicit Euler (Impl) methods. The efficiency of our solvers is shown with several experiments on cyclic voltammetry models and fluid flows through domains with fractures.


title: XLDA: Cross-Lingual Data Augmentation for Natural Language Inference and Question Answering

abstract: While natural language processing systems often focus on a single language, multilingual transfer learning has the potential to improve performance, especially for low-resource languages. We introduce XLDA, cross-lingual data augmentation, a method that replaces a segment of the input text with its translation in another language. XLDA enhances performance of all 14 tested languages of the cross-lingual natural language inference (XNLI) benchmark. With improvements of up to $4.8\%$, training with XLDA achieves state-of-the-art performance for Greek, Turkish, and Urdu. XLDA is in contrast to, and performs markedly better than, a more naive approach that aggregates examples in various languages in a way that each example is solely in one language. On the SQuAD question answering task, we see that XLDA provides a $1.0\%$ performance increase on the English evaluation set. Comprehensive experiments suggest that most languages are effective as cross-lingual augmentors, that XLDA is robust to a wide range of translation quality, and that XLDA is even more effective for randomly initialized models than for pretrained models.


title: End-to-End Pore Extraction and Matching in Latent Fingerprints: Going Beyond Minutiae

abstract: Latent fingerprint recognition is not a new topic but it has attracted a lot of attention from researchers in both academia and industry over the past 50 years. With the rapid development of pattern recognition techniques, automated fingerprint identification systems (AFIS) have become more and more ubiquitous. However, most AFIS are utilized for live-scan or rolled/slap prints while only a few systems can work on latent fingerprints with reasonable accuracy. The question of whether taking higher resolution scans of latent fingerprints and their rolled/slap mate prints could help improve the identification accuracy still remains an open question in the forensic community. Because pores are one of the most reliable features besides minutiae to identify latent fingerprints, we propose an end-to-end automatic pore extraction and matching system to analyze the utility of pores in latent fingerprint identification. Hence, this paper answers two questions in the latent fingerprint domain: (i) does the incorporation of pores as level-3 features improve the system performance significantly? and (ii) does the 1,000 ppi image resolution improve the recognition results? We believe that our proposed end-to-end pore extraction and matching system will be a concrete baseline for future latent AFIS development.


title: Rationality and Fusion Rules of Exceptional W-Algebras

abstract: First, we prove the Kac-Wakimoto conjecture on modular invariance of characters of exceptional affine W-algebras. In fact more generally we prove modular invariance of characters of all lisse W-algebras obtained through Hamiltonian reduction of admissible affine vertex algebras. Second, we prove the rationality of a large subclass of these W-algebras, which includes all exceptional W-algebras of type A and lisse subregular W-algebras in simply laced types. Third, for the latter cases we compute S-matrices and fusion rules. Our results provide the first examples of rational W-algebras associated with non-principal distinguished nilpotent elements, and the corresponding fusion rules are rather mysterious.


title: Infusing domain knowledge in AI-based "black box" models for better explainability with application in bankruptcy prediction

abstract: Although "black box" models such as Artificial Neural Networks, Support Vector Machines, and Ensemble Approaches continue to show superior performance in many disciplines, their adoption in the sensitive disciplines (e.g., finance, healthcare) is questionable due to the lack of interpretability and explainability of the model. In fact, future adoption of "black box" models is difficult because of the recent rule of "right of explanation" by the European Union where a user can ask for an explanation behind an algorithmic decision, and the newly proposed bill by the US government, the "Algorithmic Accountability Act", which would require companies to assess their machine learning systems for bias and discrimination and take corrective measures. Top Bankruptcy Prediction Models are A.I.-based and are in need of better explainability -the extent to which the internal working mechanisms of an AI system can be explained in human terms. Although explainable artificial intelligence is an emerging field of research, infusing domain knowledge for better explainability might be a possible solution. In this work, we demonstrate a way to collect and infuse domain knowledge into a "black box" model for bankruptcy prediction. Our understanding from the experiments reveals that infused domain knowledge makes the output from the black box model more interpretable and explainable.


title: GAT: Generative Adversarial Training for Adversarial Example Detection and Robust Classification

abstract: The vulnerabilities of deep neural networks against adversarial examples have become a significant concern for deploying these models in sensitive domains. Devising a definitive defense against such attacks is proven to be challenging, and the methods relying on detecting adversarial samples are only valid when the attacker is oblivious to the detection mechanism. In this paper we propose a principled adversarial example detection method that can withstand norm-constrained white-box attacks. Inspired by one-versus-the-rest classification, in a K class classification problem, we train K binary classifiers where the i-th binary classifier is used to distinguish between clean data of class i and adversarially perturbed samples of other classes. At test time, we first use a trained classifier to get the predicted label (say k) of the input, and then use the k-th binary classifier to determine whether the input is a clean sample (of class k) or an adversarially perturbed example (of other classes). We further devise a generative approach to detecting/classifying adversarial examples by interpreting each binary classifier as an unnormalized density model of the class-conditional data. We provide comprehensive evaluation of the above adversarial example detection/classification methods, and demonstrate their competitive performances and compelling properties.


title: Channel Static Antennas for Mobile Devices

abstract: Channel static antennas are considered for mobile devices. The antenna keeps the wireless communication channel static by performing a counter-movement that is opposed to movements of the device that might be caused by a user. The feasibility of the concept is demonstrated for linear movement in an office environment. Channel measurements are performed with quarter wavelength monopole antennas in the 2.4GHz ISM frequency band. A channel model for the wireless communication channel of mobile devices with channel static antennas is proposed based on these measurement results.


title: Multi-sensor State Estimation over Lossy Channels using Coded Measurements

abstract: This paper focuses on a networked state estimation problem for a spatially large linear system with a distributed array of sensors, each of which offers partial state measurements, and the transmission is lossy. We propose a measurement coding scheme with two goals. Firstly, it permits adjusting the communication requirements by controlling the dimension of the vector transmitted by each sensor to the central estimator. Secondly, for a given communication requirement, the scheme is optimal, within the family of linear causal coders, in the sense that the weakest channel condition is required to guarantee the stability of the estimator. For this coding scheme, we derive the minimum mean-square error (MMSE) state estimator, and state a necessary and sufficient condition with a trivial gap, for its stability. We also derive a sufficient but easily verifiable stability condition, and quantify the advantage offered by the proposed coding scheme. Finally, simulations results are presented to confirm our claims.


title: Learning In Practice: Reasoning About Quantization

abstract: There is a mismatch between the standard theoretical analyses of statistical machine learning and how learning is used in practice. The foundational assumption supporting the theory is that we can represent features and models using real-valued parameters. In practice, however, we do not use real numbers at any point during training or deployment. Instead, we rely on discrete and finite quantizations of the reals, typically floating points. In this paper, we propose a framework for reasoning about learning under arbitrary quantizations. Using this formalization, we prove the convergence of quantization-aware versions of the Perceptron and Frank-Wolfe algorithms. Finally, we report the results of an extensive empirical study of the impact of quantization using a broad spectrum of datasets.


title: Quadrupole dominance in light Cd and Sn isotopes

abstract: Shell model calculations with the neutron effective charge as single free parameter describe well the \bet and \bef rates for $N\le 64$ in the Cd and Sn isotopes. The former exhibit weak permanent deformation corroborating the prediction of a pseudo SU3 symmetry, which remains of heuristic value in the latter, though the pairing force erodes the quadrupole dominance. Calculations in $10^7$ and $10^{10}$-dimensional spaces exhibit almost identical patterns: A vindication of the shell model. For $N\ge 64$ quadrupole dominance is accentuated in the Cd isotopes and gives way to seniority dominance for the Sn isotopes.


title: Cross-resonance interactions between superconducting qubits with variable detuning

abstract: Cross-resonance interactions are a promising way to implement all-microwave two-qubit gates with fixed-frequency qubits. In this work, we study the dependence of the cross-resonance interaction rate on qubit-qubit detuning and compare with a model that includes the higher levels of a transmon system. To carry out this study we employ two transmon qubits--one fixed frequency and the other flux tunable--to allow us to vary the detuning between qubits. We find that the interaction closely follows a three-level model of the transmon, thus confirming the presence of an optimal regime for cross-resonance gates.


title: AI Feynman: a Physics-Inspired Method for Symbolic Regression

abstract: A core challenge for both physics and artificial intellicence (AI) is symbolic regression: finding a symbolic expression that matches data from an unknown function. Although this problem is likely to be NP-hard in principle, functions of practical interest often exhibit symmetries, separability, compositionality and other simplifying properties. In this spirit, we develop a recursive multidimensional symbolic regression algorithm that combines neural network fitting with a suite of physics-inspired techniques. We apply it to 100 equations from the Feynman Lectures on Physics, and it discovers all of them, while previous publicly available software cracks only 71; for a more difficult test set, we improve the state of the art success rate from 15% to 90%.


title: An upper bound on the time required to implement unitary operations

abstract: We derive an upper bound for the time needed to implement a generic unitary transformation in a $d$ dimensional quantum system using $d$ control fields. We show that given the ability to control the diagonal elements of the Hamiltonian, which allows for implementing any unitary transformation under the premise of controllability, the time $T$ needed is upper bounded by $T\leq \frac{\pi d^{2}(d-1)}{2g_{\text{min}}}$ where $g_{\text{min}}$ is the smallest coupling constant present in the system. We study the tightness of the bound by numerically investigating randomly generated systems, with specific focus on a system consisting of $d$ energy levels that interact in a tight-binding like manner.


title: Scaling properties of firearm homicides in Brazilian cities

abstract: The recent quantitative approaches for studing several aspects of urban life and infrastructure have shown that scale properties allow to understand many features of urban infrastructure and of human activity in cities. In this work, an analysis based on the complexity of cities network is performed for data on Brazilian cities firearms homicides. Due to the diversity in Brazilian population and cities, this is an interesting test for theories recently proposed. The superlinear power-law behavior for number of homicides as a function of city population, with exponent $\beta=1.15$ is obtained. The hypothesis that fractal structures can be formed in cities as well as in larger networks is tested, indicating that indeed self-similarity may be found in networks connecting several cities.


title: Proof of Concept for Keeping Mobile Communication Channels Static With Partner Antenna With-Movements

abstract: This work presents a proof of concept, that mobile communication channels can be kept static by the partner antenna to which the channel is formed. The partner antenna simultaneously moves along the same trajectory with the first antenna (with-movement). Experimental results are presented for movement along a straight line over a distance of several wavelengths. Measurements were performed with 2.45GHz quarter-wavelength monopole antennas in an anechoic chamber. Statistical analysis and mathematical models of the results are presented.


title: Representation Learning for Dynamic Graphs: A Survey

abstract: Graphs arise naturally in many real-world applications including social networks, recommender systems, ontologies, biology, and computational finance. Traditionally, machine learning models for graphs have been mostly designed for static graphs. However, many applications involve evolving graphs. This introduces important challenges for learning and inference since nodes, attributes, and edges change over time. In this survey, we review the recent advances in representation learning for dynamic graphs, including dynamic knowledge graphs. We describe existing models from an encoder-decoder perspective, categorize these encoders and decoders based on the techniques they employ, and analyze the approaches in each category. We also review several prominent applications and widely used datasets and highlight directions for future research.


title: Autonomous Driving and Residential Location Preferences: Evidence from a Stated Choice Survey

abstract: The literature suggests that autonomous vehicles (AVs) may drastically change the user experience of private automobile travel by allowing users to engage in productive or relaxing activities while travelling. As a consequence, the generalised cost of car travel may decrease, and car users may become less sensitive to travel time. By facilitating private motorised mobility, AVs may eventually impact land use and households' residential location choices. This paper seeks to advance the understanding of the potential impacts of AVs on travel behaviour and land use by investigating stated preferences for combinations of residential locations and travel options for the commute in the context of autonomous automobile travel. Our analysis draws from a stated preference survey, which was completed by 512 commuters from the Sydney metropolitan area in Australia and provides insights into travel time valuations in a long-term decision-making context. For the analysis of the stated choice data, mixed logit models are estimated. Based on the empirical results, no changes in the valuation of travel time due to the advent of AVs should be expected. However, given the hypothetical nature of the stated preference survey, the results may be affected by methodological limitations.


title: Spin-glass-like ordering in a frustrated $J_1-J_2$ Ising antiferromagnet on a honeycomb lattice

abstract: We study the nature of a low-temperature phase in the frustrated honeycomb-lattice Ising model with first- and second-neighbor antiferromagnetic (AF) interactions, $J_1$ and $J_2$, respectively, for $R = J_2/J_1 > 1/4$. It is known that for $R < 1/4$ there is a phase transition at low temperatures to the AF phase. Nevertheless, little is known about the critical behavior of the model for $R > 1/4$, except for recent effective field results which detected no phase transition down to zero temperature. Our Monte Carlo results suggest that for $R > 1/4$ there is at least one peculiar phase transition accompanied by a spin-glass-like freezing to a highly degenerate state consisting of frozen domains with stripe-type AF ordering separated by zero-energy domain walls. In spite of the local ordering within the respective domains there is no ordering among them and thus, unlike in the corresponding square-lattice model with $R > 1/2$, there is no conventional magnetic long-range ordering spanning the entire system.


title: Generalization Bounds in the Predict-then-Optimize Framework

abstract: The predict-then-optimize framework is fundamental in many practical settings: predict the unknown parameters of an optimization problem, and then solve the problem using the predicted values of the parameters. A natural loss function in this environment is to consider the cost of the decisions induced by the predicted parameters, in contrast to the prediction error of the parameters. This loss function was recently introduced in Elmachtoub and Grigas (2022) and referred to as the Smart Predict-then-Optimize (SPO) loss. In this work, we seek to provide bounds on how well the performance of a prediction model fit on training data generalizes out-of-sample, in the context of the SPO loss. Since the SPO loss is non-convex and non-Lipschitz, standard results for deriving generalization bounds do not apply. We first derive bounds based on the Natarajan dimension that, in the case of a polyhedral feasible region, scale at most logarithmically in the number of extreme points, but, in the case of a general convex feasible region, have linear dependence on the decision dimension. By exploiting the structure of the SPO loss function and a key property of the feasible region, which we denote as the strength property, we can dramatically improve the dependence on the decision and feature dimensions. Our approach and analysis rely on placing a margin around problematic predictions that do not yield unique optimal solutions, and then providing generalization bounds in the context of a modified margin SPO loss function that is Lipschitz continuous. Finally, we characterize the strength property and show that the modified SPO loss can be computed efficiently for both strongly convex bodies and polytopes with an explicit extreme point representation.


title: Ranks and presentations of some normally ordered inverse semigroups

abstract: In this paper we compute the rank and exhibit a presentation for the monoids of all $P$-stable and $P$-order preserving partial permutations on a finite set $\Omega$, with $P$ an ordered uniform partition of $\Omega$. These (inverse) semigroups constitute a natural class of generators of the pseudovariety of inverse semigroups ${\sf NO}$ of all normally ordered (finite) inverse semigroups.


title: The low-rank eigenvalue problem

abstract: The nonzero eigenvalues of $AB$ are equal to those of $BA$: an identity that holds as long as the products are square, even when $A,B$ are rectangular. This fact naturally suggests an efficient algorithm for computing eigenvalues and eigenvectors of a low-rank matrix $X= AB$ with $A,B^T\in\mathbb{C}^{N\times r}, N\gg r$: form the small $r\times r$ matrix $BA$ and find its eigenvalues and eigenvectors. For nonzero eigenvalues, the eigenvectors are related by $ ABv = \lambda v \Leftrightarrow BAw = \lambda w $ with $w=Bv$, and the same holds for Jordan vectors. For zero eigenvalues, the Jordan blocks can change sizes between $AB$ and $BA$, and we characterize this behavior.


title: Non-radial solutions to a bi-harmonic equation with negative exponent

abstract: We prove the existence of non-radial entire solution to $$\Delta^2 u+u^{-q}=0\quad\text{in }\mathbb{R}^3,\quad u>0,$$ for $q>1$. This answers an open question raised by P. J. McKenna and W. Reichel (E. J. D. E. \textbf{37} (2003) 1-13).


title: Exposing the plural nature of molecular clouds : Extracting filaments and the CIB against the true scale-free interstellar medium

abstract: We present the Multiscale non-Gaussian Segmentation (MnGSeg) analysis technique. This wavelet based method combines the analysis of the probability distribution function (PDF) of map fluctuations as a function of spatial scales and the power spectrum analysis of a map. This technique allows us to extract the non-Gaussianities identified in the multiscaled PDFs usually associated with turbulence intermittency and to spatially reconstruct the Gaussian and the non-Gaussian component of the map. This new technique can be applied on any data set. Here, it is applied on a Herschel column density map of the Polaris flare cloud. The first component has by construction a self-similar fractal geometry as the one produced by fractional Brownian motion simulations. The second component is called the coherent component, by opposition to fractal, and includes a network of filamentary structures which demonstrates a spatial hierarchical scaling, i.e. filaments inside filaments. The power spectrum analysis of both components proves that the Fourier power spectrum of the initial map is dominated by the power of the coherent filamentary structures across almost all spatial scales. The coherent structures contribute progressively, more and more from large to smaller scales, without producing any break in the inertial range. We suggest that this behaviour is induced, at least partly, by inertial-range intermittency, a well known phenomenon for turbulent flows. We also demonstrate that the MnGSeg technique is a very sensitive signal analysis technique, which allows the extraction of the cosmic infrared background (CIB) signal present in the Polaris flare submillimeter observations and the detection of a characteristic scale for 0.1 < l < 0.3 pc whose origin could partly be the transition of regimes dominated by incompressible turbulence versus compressible modes and other physical processes, such as gravity.


title: H2-Induced Pressure Broadening and Pressure Shift in the P-Branch of the v3 Band of CH4 from 300 to 700 K

abstract: For accurate modelling of observations of exoplanet atmospheres, quantification of the pressure broadening of infrared absorption lines for and by a variety of gases at elevated temperatures is needed. High-resolution high-temperature H2-pressure-broadened spectra are recorded for the CH4 v3-band P-branch. Measured linewidths for 116 transitions between 2840 and 3000 cm^{-1} with temperature and pressures ranging between 300 and 700 K, and 10 and 933 Torr, respectively, were used to find rotation- and tetrahedral-symmetry-dependent coefficients for pressure and temperature broadening and pressure-induced lineshifts. The new pressure-broadening data will be useful in radiative-transfer models for retrieving the properties of observed expolanet atmospheres.


title: Magnetocaloric properties of an Ising antiferromagnet on a kagome lattice

abstract: Owing to a high degree of geometrical frustration an Ising antiferromagnet on a kagome lattice (IAKL) is known to exhibit no long-range ordering at any temperature, including the ground state. Nevertheless, at low temperatures it shows a strongly correlated, highly fluctuating regime known as a cooperative paramagnet or classical spin liquid. In the ground state it is characterized by a macroscopic degeneracy which translates to a relatively large value of the residual entropy. It has been shown that the presence of a macroscopic degeneracy associated with geometrical frustration below the saturation field can facilitate an enhanced magnetocaloric effect (MCE), which can exceed that of an ideal paramagnet with equivalent spin by more than an order of magnitude. In the present study we investigate magnetic and magnetocaloric properties of IAKL by Monte Carlo simulation. In particular, we calculate the entropy of the system using the thermodynamic integration method and evaluate quantities which characterize MCE, such as the isothermal entropy and adiabatic temperature changes in a varying magnetic field. It is found that IAKL shows the most interesting magnetocaloric properties at low temperatures and moderate magnetic fields, suggesting its potential to be used in technological applications for low-temperature magnetic refrigeration.


title: Integral $p$-adic \'etale cohomology of Drinfeld symmetric spaces

abstract: We compute the integral $p$-adic \'etale cohomology of Drinfeld symmetric spaces of any dimension. This refines the computation of the rational $p$-adic \'etale cohomology from Colmez-Dospinescu-Nizio{\l}. The main tools are: the computation of the integral de Rham cohomology from CDN and the integral $p$-adic comparison theorems of Bhatt-Morrow-Scholze and \v{C}esnavi\v{c}ius-Koshikawa which replace the quasi-integral comparison theorem of Tsuji used in CDN.


title: Tuning Free Rank-Sparse Bayesian Matrix and Tensor Completion with Global-Local Priors

abstract: Matrix and tensor completion are frameworks for a wide range of problems, including collaborative filtering, missing data, and image reconstruction. Missing entries are estimated by leveraging an assumption that the matrix or tensor is low-rank. Most existing Bayesian techniques encourage rank-sparsity by modelling factorized matrices and tensors with Normal-Gamma priors. However, the Horseshoe prior and other "global-local" formulations provide tuning-parameter-free solutions which may better achieve simultaneous rank-sparsity and missing-value recovery. We find these global-local priors outperform commonly used alternatives in simulations and in a collaborative filtering task predicting board game ratings.


title: Estimating Average Treatment Effects Utilizing Fractional Imputation when Confounders are Subject to Missingness

abstract: The problem of missingness in observational data is ubiquitous. When the confounders are missing at random, multiple imputation is commonly used; however, the method requires congeniality conditions for valid inferences, which may not be satisfied when estimating average causal treatment effects. Alternatively, fractional imputation, proposed by Kim 2011, has been implemented to handling missing values in regression context. In this article, we develop fractional imputation methods for estimating the average treatment effects with confounders missing at random. We show that the fractional imputation estimator of the average treatment effect is asymptotically normal, which permits a consistent variance estimate. Via simulation study, we compare fractional imputation's accuracy and precision with that of multiple imputation.


title: FAN: Focused Attention Networks

abstract: Attention networks show promise for both vision and language tasks, by emphasizing relationships between constituent elements through weighting functions. Such elements could be regions in an image output by a region proposal network, or words in a sentence, represented by word embedding. Thus far the learning of attention weights has been driven solely by the minimization of task specific loss functions. We introduce a method for learning attention weights to better emphasize informative pair-wise relations between entities. The key component is a novel center-mass cross entropy loss, which can be applied in conjunction with the task specific ones. We further introduce a focused attention backbone to learn these attention weights for general tasks. We demonstrate that the focused supervision leads to improved attention distribution across meaningful entities, and that it enhances the representation by aggregating features from them. Our focused attention module leads to state-of-the-art recovery of relations in a relationship proposal task and boosts performance for various vision and language tasks.


title: One-Shot Learning for Text-to-SQL Generation

abstract: Most deep learning approaches for text-to-SQL generation are limited to the WikiSQL dataset, which only supports very simple queries. Recently, template-based and sequence-to-sequence approaches were proposed to support complex queries, which contain join queries, nested queries, and other types. However, Finegan-Dollak et al. (2018) demonstrated that both the approaches lack the ability to generate SQL of unseen templates. In this paper, we propose a template-based one-shot learning model for the text-to-SQL generation so that the model can generate SQL of an untrained template based on a single example. First, we classify the SQL template using the Matching Network that is augmented by our novel architecture Candidate Search Network. Then, we fill the variable slots in the predicted template using the Pointer Network. We show that our model outperforms state-of-the-art approaches for various text-to-SQL datasets in two aspects: 1) the SQL generation accuracy for the trained templates, and 2) the adaptability to the unseen SQL templates based on a single example without any additional training.


title: Rotational excitations in near neutron-drip line nuclei: the birth and death of particle-bound rotational bands and the extension of nuclear landscape beyond spin zero neutron drip line

abstract: Two new mechanisms active in rotating nuclei located in the vicinity of neutron drip line have been discovered. Strong Coriolis interaction acting on high-$j$ orbitals transforms particle-unbound (resonance) nucleonic configurations into particle-bound ones with increasing angular momentum. The point of the transition manifests the birth of particle-bound rotational bands. Alternative possibility of the transition from particle-bound to resonance rotational band (the death of particle-bound rotational bands) with increasing spin also exists but it is less frequent in the calculations. The birth of particle-bound rotational bands provides a mechanism for the extension of nuclear landscape to neutron numbers which are larger than those of the neutron drip line in non-rotating nuclei.


title: Emergence of a Skyrmion Phase in a Frustrated Heisenberg Antiferromagnet with Dzyaloshinskii-Moriya Interaction

abstract: We study formation of a periodical structure of quasiparticle-like magnetic configurations with non-trivial topological charge, known as a magnetic skyrmion phase, on a frustrated triangular lattice antiferromagnetic Heisenberg model with Dzyaloshinskii-Moriya interaction (DMI) by means of Monte Carlo simulations. The existence of such a phase, formed on the three interpenetrating sublattices, has been demonstrated for a sufficiently large strength of DMI. The goal of the present investigation is to establish the minimum values of both the DM interaction strength as well as the magnetic field intensity at which such a skyrmion phase can exist at very low temperatures (close to zero). We find that the skyrmion phase emerges above the DMI parameter value of $D = 0.2$ and persists within the field intensity $2 \lesssim h < 4.5$.


title: Intervention in undirected Ising graphs and the partition function

abstract: Undirected graphical models have many applications in such areas as machine learning, image processing, and, recently, psychology. Psychopathology in particular has received a lot of attention, where symptoms of disorders are assumed to influence each other. One of the most relevant questions practically is on which symptom (node) to intervene to have the most impact. Interventions in undirected graphical models is equal to conditioning, and so we have available the machinery with the Ising model to determine the best strategy to intervene. In order to perform such calculations the partition function is required, which is computationally difficult. Here we use a Curie-Weiss approach to approximate the partition function in applications of interventions. We show that when the connection weights in the graph are equal within each clique then we obtain exactly the correct partition function. And if the weights vary according to a sub-Gaussian distribution, then the approximation is exponentially close to the correct one. We confirm these results with simulations.