title: Multiple eigenvectors around the homo-lumo gap as a cheap by-product in linear scaling electronic structure calculations

abstract: In this work we present and evaluate an implementation of the purify-shift-and-project method [J. Chem. Phys. 128, 176101 (2008)] for linear scaling computation of multiple eigenvectors around the homo-lumo gap of the Fock/Kohn-Sham matrix. Recursive polynomial expansions allow for linear scaling density matrix construction if matrices are sufficiently sparse. However, a drawback is that, compared to the traditional diagonalization approach, eigenvectors of the Fock/Kohn-Sham matrix are not readily available. The sharp polynomial filter, constructed in intermediate iterations of the recursive polynomial expansion, increases the relative separation of eigenvalues near the homo-lumo gap. The computed density matrix approximation is used to project away the uninteresting part of the spectrum, so that the eigenvalues of interest become the extreme eigenvalues, enabling fast convergence of a Lanczos eigensolver. We implement the purify-shift-and-project algorithm in the quantum chemistry program Ergo [SoftwareX 7, 107 (2018)]. We illustrate the performance of the method by computing 30 eigenvectors around the homo-lumo gap for large scale systems.


title: Explicitly disentangling image content from translation and rotation with spatial-VAE

abstract: Given an image dataset, we are often interested in finding data generative factors that encode semantic content independently from pose variables such as rotation and translation. However, current disentanglement approaches do not impose any specific structure on the learned latent representations. We propose a method for explicitly disentangling image rotation and translation from other unstructured latent factors in a variational autoencoder (VAE) framework. By formulating the generative model as a function of the spatial coordinate, we make the reconstruction error differentiable with respect to latent translation and rotation parameters. This formulation allows us to train a neural network to perform approximate inference on these latent variables while explicitly constraining them to only represent rotation and translation. We demonstrate that this framework, termed spatial-VAE, effectively learns latent representations that disentangle image rotation and translation from content and improves reconstruction over standard VAEs on several benchmark datasets, including applications to modeling continuous 2-D views of proteins from single particle electron microscopy and galaxies in astronomical images.


title: Developing Linear Dark-Field Control for Exoplanet Direct Imaging in the Laboratory and on Ground-based Telescopes

abstract: Imaging rocky planets in reflected light, a key focus of future NASA missions and ELTs, requires advanced wavefront control to maintain a deep, temporally correlated null of stellar halo at just several diffraction beam widths. We discuss development of Linear Dark Field Control (LDFC) to achieve this aim. We describe efforts to test spatial LDFC in a laboratory setting for the first time, using the Ames Coronagraph Experiment (ACE) testbed. Our preliminary results indicate that spatial LDFC is a promising method focal-plane wavefront control method capable of maintaining a static dark hole, at least at contrasts relevant for imaging mature planets with 30m-class telescopes.


title: The Large-Misalignment Mechanism for the Formation of Compact Axion Structures: Signatures from the QCD Axion to Fuzzy Dark Matter

abstract: Axions are some of the best motivated particles beyond the Standard Model. We show how the attractive self-interactions of dark matter (DM) axions over a broad range of masses, from $10^{-22}$ eV to $10^7$ GeV, can lead to nongravitational growth of density fluctuations and the formation of bound objects. This structure formation enhancement is driven by parametric resonance when the initial field misalignment is large, and it affects axion density perturbations on length scales of order the Hubble horizon when the axion field starts oscillating, deep inside the radiation-dominated era. This effect can turn an otherwise nearly scale-invariant spectrum of adiabatic perturbations into one that has a spike at the aforementioned scales, producing objects ranging from dense DM halos to scalar-field configurations such as solitons and oscillons. We call this class of cosmological scenarios for axion DM production "the large-misalignment mechanism." We explore observational consequences of this mechanism for axions with masses up to $10$ eV. For axions heavier than $10^{-5}$ eV, the compact axion halos are numerous enough to significantly impact Earth-bound direct detection experiments, yielding intermittent but coherent signals with repetition rates exceeding one per decade and crossing times less than a day. These episodic increases in the axion density and kinematic coherence suggest new approaches for axion DM searches, including for the QCD axion. Dense structures made up of axions from $10^{-22}$ eV to $10^{-5}$ eV are detectable through gravitational lensing searches, and their gravitational interactions can also perturb baryonic structures and alter star formation. At very high misalignment amplitudes, the axion field can undergo self-interaction-induced implosions long before matter-radiation equality, producing potentially-detectable low-frequency stochastic gravitational waves.


title: Twisted Circle Compactifications of 6d SCFTs

abstract: We study 6d superconformal field theories (SCFTs) compactified on a circle with arbitrary twists. The theories obtained after compactification, often referred to as 5d Kaluza-Klein (KK) theories, can be viewed as starting points for RG flows to 5d SCFTs. According to a conjecture, all 5d SCFTs can be obtained in this fashion. We compute the Coulomb branch prepotential for all 5d KK theories obtainable in this manner and associate to these theories a smooth local genus one fibered Calabi-Yau threefold in which is encoded information about all possible RG flows to 5d SCFTs. These Calabi-Yau threefolds provide hitherto unknown M-theory duals of F-theory configurations compactified on a circle with twists. For certain exceptional KK theories that do not admit a standard geometric description we propose an algebraic description that appears to retain the properties of the local Calabi-Yau threefolds necessary to determine RG flows to 5d SCFTs, along with other relevant physical data.


title: The Physical Origins of the Identified and Still Missing Components of the Warm-Hot Intergalactic Medium: Insights from Deep Surveys in the Field of Blazar 1ES1553+113

abstract: The relationship between galaxies and the state/chemical enrichment of the warm-hot intergalactic medium (WHIM) expected to dominate the baryon budget at low-z provides sensitive constraints on structure formation and galaxy evolution models. We present a deep redshift survey in the field of 1ES1553+113, a blazar with a unique combination of UV+X-ray spectra for surveys of the circum-/intergalactic medium (CGM/IGM). Nicastro et al. 2018 reported the detection of two O VII WHIM absorbers at $z=0.4339$ and $0.3551$ in its spectrum, suggesting that the WHIM is metal-rich and sufficient to close the missing baryons problem. Our survey indicates that the blazar is a member of a $z=0.433$ group and that the higher-$z$ O VII candidate arises from its intragroup medium. The resulting bias precludes its use in baryon censuses. The $z=0.3551$ candidate occurs in an isolated environment 630 kpc from the nearest galaxy (with stellar mass $\log M_*/M_\odot \approx 9.7$) which we show is unexpected for the WHIM. Finally, we characterize the galactic environments of broad H I Ly$\alpha$ absorbers (Doppler widths of $b=40-80$ \kms; $T\lesssim4\times10^5$ K) which provide metallicity independent WHIM probes. On average, broad Ly$\alpha$, absorbers are ${\approx}2\times$ closer to the nearest luminous ($L>0.25 L_*$) galaxy (700 kpc) than narrow ($b<30$ \kms; $T\lesssim4\times10^5$ K) ones (1300 kpc) but ${\approx}2\times$ further than O\,VI absorbers (350 kpc). These observations suggest that gravitational collapse heats portions of the IGM to form the WHIM but with feedback that does not enrich the IGM far beyond galaxy/group halos to levels currently observable in UV/X-ray metal lines.


title: Testing the electric Aharonov-Bohm effect with superconductors

abstract: The phase of the wave function of charged matter is sensitive to the value of the electric potential, even when the matter never enters any region with non-vanishing electromagnetic fields. Despite its fundamental character, this archetypal electric Aharonov-Bohm effect has evidently never been observed. We propose an experiment to detect the electric potential through its coupling to the superconducting order parameter. A potential difference between two superconductors will induce a relative phase shift that is observable via the DC Josephson effect even when no electromagnetic fields ever act on the superconductors, and even if the potential difference is later reduced to zero. This is a type of electromagnetic memory effect, and would directly demonstrate the physical significance of the electric potential.


title: AdS$_3$ solutions in massive IIA, defect CFTs and T-duality

abstract: We establish a map between AdS$_3 \times$S$^2$ and AdS$_7$ solutions to massive IIA supergravity that allows one to interpret the former as holographic duals to D2-D4 defects inside 6d (1,0) CFTs. This relation singles out in a particular manner the AdS$_3\times$S$^2$ solution constructed from AdS$_3\times$S$^3\times $CY$_2$ through non-Abelian T-duality, with respect to a freely acting SU(2). We find explicit global completions to this solution and provide well-defined (0,4) 2d dual CFTs associated to them. These completions consist of linear quivers with colour groups coming from D2 and D6 branes and flavour groups coming from D8 and D4 branes. Finally, we discuss the relation with flows interpolating between AdS$_3\times$S$^2\times$T$^4$ geometries and AdS$_7$ solutions found in the literature.


title: Probing the Higgs Portal at the Fermilab Short-Baseline Neutrino Experiments

abstract: The Fermilab Short-Baseline Neutrino (SBN) experiments, MicroBooNE, ICARUS, and SBND, are expected to have significant sensitivity to light weakly coupled hidden sector particles. Here we study the capability of the SBN experiments to probe dark scalars interacting through the Higgs portal. We investigate production of dark scalars using both the Fermilab Booster 8 GeV and NuMI 120 GeV proton beams, simulating kaons decaying to dark scalars and taking into account the beamline geometry. We also investigate strategies to mitigate backgrounds from beam-related neutrino scattering events. We find that SBND, with its comparatively short ${\cal O}(100\ {\rm m})$ baseline, will have the best sensitivity to scalars produced with Booster, while ICARUS, with its large detector volume, will provide the best limits on off-axis dark scalar production from NuMI. The SBN experiments can provide leading tests of dark scalars with masses in the 50 - 350 MeV range in the near term. Our results motivate dedicated experimental searches for dark scalars and other long-lived hidden sector states at these experiments.


abstract: Quantifying the value of data is a fundamental problem in machine learning. Data valuation has multiple important use cases: (1) building insights about the learning task, (2) domain adaptation, (3) corrupted sample discovery, and (4) robust learning. To adaptively learn data values jointly with the target task predictor model, we propose a meta learning framework which we name Data Valuation using Reinforcement Learning (DVRL). We employ a data value estimator (modeled by a deep neural network) to learn how likely each datum is used in training of the predictor model. We train the data value estimator using a reinforcement signal of the reward obtained on a small validation set that reflects performance on the target task. We demonstrate that DVRL yields superior data value estimates compared to alternative methods across different types of datasets and in a diverse set of application scenarios. The corrupted sample discovery performance of DVRL is close to optimal in many regimes (i.e. as if the noisy samples were known apriori), and for domain adaptation and robust learning DVRL significantly outperforms state-of-the-art by 14.6% and 10.8%, respectively.


title: The X-ray and radio activity of typical and luminous Lya emitters from z~2 to z~6: evidence for a diverse, evolving population

abstract: Despite recent progress in understanding Lyman-alpha (Lya) emitters (LAEs), relatively little is known regarding their typical black hole activity across cosmic time. Here, we study the X-ray and radio properties of ~4000 LAEs at 2.2<z<6 from the SC4K survey in the COSMOS field. We detect 254 (6.8+-0.4%) of the LAEs individually in the X-rays (S/N>3) and find an average luminosity of 10^{44.31+-0.01} erg/s and an average black hole accretion rate (BHAR) of 0.72+-0.01 Msun/yr, consistent with moderate to high accreting AGN. We detect 120 sources in deep radio data (radio AGN fraction of 3.2%+-0.3%). The global AGN fraction (8.6%+-0.4%) rises with Lya luminosity and declines with increasing redshift. For X-ray detected LAEs, Lya luminosities correlate with the BHARs, suggesting that Lya luminosity becomes an accretion rate indicator. Most LAEs (93.1+-0.6%) at 2<z<6 have no detectable X-ray emission (BHARs<0.017 Msun/yr). The median star formation rate (SFR) of star-forming LAEs from Lya and radio luminosities is 7.6^{+6.6}_{-2.8} Msun/yr. The black hole to galaxy growth ratio (BHAR/SFR) for LAEs is <0.0022, consistent with typical star forming galaxies and the local BHAR/SFR relation. We conclude that LAEs at 2<z<6 include two different populations: an AGN population, where Lya luminosity traces BHAR, making them bright in Lya, and another with low SFRs which remain undetected in even the deepest X-ray stacks but is detected in the radio stacks.


title: Mapping the Magnetic Interstellar Medium in Three Dimensions Over the Full Sky with Neutral Hydrogen

abstract: Recent analyses of 21-cm neutral hydrogen (HI) emission have demonstrated that HI gas is organized into linear filamentary structures that are preferentially aligned with the local magnetic field, and that the coherence of these structures in velocity space traces line-of-sight magnetic field tangling. On this basis, we introduce a paradigm for modeling the properties of magnetized, dusty regions of the interstellar medium, using the orientation of HI structure at different velocities to map "magnetically coherent" regions of space. We construct three-dimensional (position-position-velocity) Stokes parameter maps using HI4PI full-sky spectroscopic HI data. We compare these maps, integrated over the velocity dimension, to Planck maps of the polarized dust emission at 353 GHz. Without any free parameters governing the relation between HI intensity and dust emission, we find that our $Q$ and $U$ maps are highly correlated ($r > 0.75$) with the 353 GHz $Q$ and $U$ maps of polarized dust emission observed by Planck and reproduce many of its large-scale features. The $E/B$ ratio of the dust emission maps agrees well with the HI-derived maps at large angular scales ($\ell \lesssim 120$), supporting the interpretation that this asymmetry arises from the coupling of linear density structures to the Galactic magnetic field. We demonstrate that our 3D Stokes parameter maps constrain the 3D structure of the Galactic interstellar medium and the orientation of the interstellar magnetic field.


title: Van der Waals heterostructures with spin-orbit coupling

abstract: In this article we review recent work on van der Waals (vdW) systems in which at least one of the components has strong spin-orbit coupling. We focus on a selection of vdW heterostructures to exemplify the type of interesting electronic properties that can arise in these systems. We first present a general effective model to describe the low energy electronic degrees of freedom in these systems. We apply the model to study the case of (vdW) systems formed by a graphene sheet and a topological insulator. We discuss the electronic transport properties of such systems and show how they exhibit much stronger spin-dependent transport effects than isolated topological insulators. We then consider vdW systems in which the layer with strong spin-orbit coupling is a monolayer transition metal dichalcogenide (TMD) and briefly discuss graphene-TMD systems. In the second part of the article we discuss the case in which the vdW system includes a superconducting layer in addition to the layer with strong spin-orbit coupling. We show in detail how these systems can be designed to realize odd-frequency superconducting pair correlations. Finally, we discuss twisted graphene-NbSe2 bilayer systems as an example in which the strength of the proximity-induced superconducting pairing in the normal layer, and its Ising character, can be tuned via the relative twist angle between the two layers forming the heterostructure.


title: String Field Theory Solution for Any Open String Background. II

abstract: Generalizing previous work, we give a new analytic solution in Witten's open bosonic string field theory which can describe any open string background. The central idea is to use Riemann surface degenerations as a mechanism for taming OPE singularities. This requires leaving the familiar subalgebra of wedge states with insertions, but the payoff is that the solution makes no assumptions about the reference and target D-brane systems, and is therefore truly general. For example, unlike in previous work, the solution can describe time dependent backgrounds and multiple copies of the reference D-brane within the universal sector. The construction also resolves some subtle issues resulting from associativity anomalies, giving a more complete understanding of the relation between the degrees of freedom of different D-brane systems, and a nonperturbative proof of background independence in classical open bosonic string field theory.


title: Bounds on Triangle Anomalies in (3+1)d

abstract: How many charged degrees of freedom are necessary to accommodate a certain amount of 't Hooft anomaly? Using the conformal bootstrap for the four-point function of flavor current multiplets, we show that in all (3+1)d superconformal field theories the 't Hooft anomaly of a continuous flavor symmetry is bounded from above by the 3/2 power of the current two-point function coefficient, which can be thought of as a measure for the amount of charged degrees of freedom. We check our bounds against free fields and SQCD in the conformal window.


title: Benchmarking one-shot distillation in general quantum resource theories

abstract: We study the one-shot distillation of general quantum resources, providing a unified quantitative description of the maximal fidelity achievable in this task, and revealing similarities shared by broad classes of resources. We establish fundamental quantitative and qualitative limitations on resource distillation applicable to all convex resource theories. We show that every convex quantum resource theory admits a meaningful notion of a pure maximally resourceful state which maximizes several monotones of operational relevance and finds use in distillation. We endow the generalized robustness measure with an operational meaning as an exact quantifier of performance in distilling such maximal states in many classes of resources including bi- and multipartite entanglement, multi-level coherence, as well as the whole family of affine resource theories, which encompasses important examples such as asymmetry, coherence, and thermodynamics.


title: Lighting the Dark: The Evolution of the Post-Inflationary Universe

abstract: In simple inflationary cosmological scenarios the near-exponential growth can be followed by a long period in which the Universe is dominated by the oscillating inflaton condensate. The condensate is initially almost homogeneous, but perturbations grow gravitationally, eventually fragmenting the condensate if it is not disrupted more quickly by resonance or prompt reheating. We show that the gravitational fragmentation of the condensate is well-described by the Schr\"odinger-Poisson equations and use numerical solutions to show that large overdensities form quickly after the onset of nonlinearity. This is the first exploration of this phase of nonlinear dynamics in the very early universe, which can affect the detailed form of the inflationary power spectrum and the dark matter fraction when the dark sector is directly coupled to the inflaton.


title: A Dynamical Study of Extraplanar Diffuse Ionized Gas in NGC 5775

abstract: The structure and kinematics of gaseous, disk-halo interfaces are imprinted with the processes that transfer mass, metals, and energy between galactic disks and their environments. We study the extraplanar diffuse ionized gas (eDIG) layer in the interacting, star-forming galaxy NGC 5775 to better understand the consequences of star-formation feedback on the dynamical state of the thick-disk interstellar medium (ISM). Combining emission-line spectroscopy from the Robert Stobie Spectrograph on the Southern African Large Telescope with radio continuum observations from Continuum Halos in Nearby Galaxies - an EVLA Survey, we ask whether thermal, turbulent, magnetic field, and cosmic-ray pressure gradients can stably support the eDIG layer in dynamical equilibrium. This model fails to reproduce the observed exponential electron scale heights of the eDIG thick disk and halo on the northeast ($h_{z,e} = 0.6, 7.5$ kpc) and southwest ($h_{z,e} = 0.8, 3.6$ kpc) sides of the galaxy at $R < 11$ kpc. We report the first definitive detection of an increasing eDIG velocity dispersion as a function of height above the disk. Blueshifted gas along the minor axis at large distances from the midplane hints at a disk-halo circulation and/or ram pressure effects caused by the ongoing interaction with NGC 5774. This work motivates further integral field unit and/or Fabry-Perot spectroscopy of galaxies with a range of star-formation rates to develop a spatially-resolved understanding of the role of star-formation feedback in shaping the kinematics of the disk-halo interface.


title: Evolution of the Stellar Mass-Metallicity Relation. II. Constraints on Galactic Outflows from the Mg Abundances of Quiescent Galaxies

abstract: We present the stellar mass-[Fe/H] and mass-[Mg/H] relation of quiescent galaxies in two galaxy clusters at $z\sim0.39$ and $z\sim0.54$. We derive the age, [Fe/H], and [Mg/Fe] for each individual galaxy using a full-spectrum fitting technique. By comparing with the relations for $z\sim0$ SDSS galaxies, we confirm our previous finding that the mass-[Fe/H] relation evolves with redshift. The mass-[Fe/H] relation at higher redshift has lower normalization and possibly steeper slope. However, based on our sample, the mass-[Mg/H] relation does not evolve over the observed redshift range. We use a simple analytic chemical evolution model to constrain average outflow that these galaxies experience over their lifetime, via the calculation of mass-loading factor. We find that the average mass-loading factor $\eta$ is a power-law function of galaxy stellar mass, $\eta \propto M_*^{-0.21\pm0.09}$. The measured mass-loading factors are consistent with the results of other observational methods for outflow measurements and with the predictions where outflow is caused by star formation feedback in turbulent disks.


title: The low density and magnetization of a massive galaxy halo exposed by a fast radio burst

abstract: Present-day galaxies are surrounded by cool and enriched halo gas extending to hundreds of kiloparsecs. This halo gas is thought to be the dominant reservoir of material available to fuel future star formation, but direct constraints on its mass and physical properties have been difficult to obtain. We report the detection of a fast radio burst (FRB 181112) with arcsecond precision, which passes through the halo of a foreground galaxy. Analysis of the burst shows the halo gas has low net magnetization and turbulence. Our results imply predominantly diffuse gas in massive galactic halos, even those hosting active supermassive black holes, contrary to some previous results.


title: A Deep Targeted Search for Fast Radio Bursts from the Sites of Low-Redshift Short Gamma-Ray Bursts

abstract: Some short gamma-ray bursts (SGRBs) are thought to be caused by the mergers of binary neutron stars which may sometimes produce massive neutron star remnants capable of producing extragalactic fast radio bursts (FRBs). We conducted a deep search for FRBs from the sites of six low-redshift SGRBs. We collected high time- and frequency-resolution data from each of the sites for 10 hours using the 2 GHz receiver of the Green Bank Telescope. Two of the SGRB sites we targeted were visible with the Arecibo Radio Telescope with which we conducted an additional 10 hours of 1.4 GHz observations for each. We searched our data for FRBs using the GPU-optimized dedispersion algorithm $\texttt{heimdall}$ and the machine-learning-based package $\texttt{FETCH}$ (Fast Extragalactic Transient Candidate Hunter). We did not discover any FRBs, but would have detected any with peak flux densities in excess of 87 mJy at the Green Bank Telescope or 21 mJy at Arecibo with a signal-to-noise ratio of at least 10. The isotropic-equivalent energy of any FRBs emitted from these sites in our bands during our observations must not have exceeded a few times $10^{38}$ erg, comparable to some of the lowest energy bursts yet seen from the first known repeating FRB 121102.


title: Terrestrial and Martian Heat Flow Limits on Dark Matter

abstract: If dark matter is efficiently captured by a planet, energy released in its annihilation can exceed that planet's total heat output. Building on prior work, we treat Earth's composition and dark matter capture in detail and present improved limits on dark matter-nucleon scattering cross sections for dark matter masses ranging from 0.1 to $10^{10}$ GeV. We also extend Earth limits by applying the same treatment to Mars. The scope of dark matter models considered is expanded to include spin-dependent nuclear interactions including isospin-independent, proton only, and neutron only interactions. We find that Earth and Mars heating bounds are alleviated for dark matter s-wave self-annihilation cross sections $\lesssim 10^{-44}~{\rm cm^2}$.


title: Stochastic thermodynamics for self-propelled particles

abstract: We propose a generalization of stochastic thermodynamics to systems of active particles, which move under the combined influence of stochastic internal self-propulsions (activity) and a heat bath. The main idea is to consider joint trajectories of particles' positions and self-propulsions. It is then possible to exploit formal similarity of an active system and a system consisting of two subsystems interacting with different heat reservoirs and coupled by a non-symmetric interaction. The resulting thermodynamic description closely follows the standard stochastic thermodynamics. In particular, total entropy production, $\Delta s_\text{tot}$, can be decomposed into housekeeping, $\Delta s_\text{hk}$, and excess, $\Delta s_\text{ex}$, parts. Both $\Delta s_\text{tot}$ and $\Delta s_\text{hk}$ satisfy fluctuation theorems. The average rate of the steady-state housekeeping entropy production can be related to the violation of the fluctuation-dissipation theorem via a Harada-Sasa relation. The excess entropy production enters into a Hatano-Sasa-like relation, which leads to a generalized Clausius inequality involving the change of the system's entropy and the excess entropy production. Interestingly, although the evolution of particles' self-propulsions is free and uncoupled from that of their positions, non-trivial steady-state correlations between these variables lead to the non-zero excess dissipation in the reservoir coupled to the self-propulsions.


title: Axion scales and couplings with St\"uckelberg mixing

abstract: We study the axion field range and low energy couplings in models with St\"uckelberg mixing between axions and $U(1)$ gauge bosons. It is noted that the gauge-invariant axion combination $\xi$ in the model is periodic $modulo$ an appropriate shift of gauge-variant axions eaten by the massive $U(1)$ gauge bosons, which in some cases makes the connection between the field range and the low energy couplings less transparent. We derive the field range of $\xi$ for generic forms of the axion kinetic metric and $U(1)$ charges, and identify the field basis for which all non-derivative couplings of $\xi$ are quantized in a manner manifestly consistent with the periodicity of $\xi$. Generically St\"uckelberg mixing reduces the axion field range. In particular, the mixings between $N$ axions and $(N-1)$ $U(1)$ gauge bosons typically result in an exponentially reduced field range $M_\xi ={\cal O}\left({k^{-(N-1)} f}/{\sqrt{N!}}\right)$ for the residual gauge-invariant axion $\xi$ in the limit $N\gg 1$, where $f$ and $k$ denote the typical decay constant and the root mean square of the $U(1)$ gauge charges of the original $N$ axions. Using simple examples, we study also the reparameterization-invariant physical quantities such as the axion effective potential and 1PI couplings to gauge bosons, which are determined by the reparameterization-dependent axion couplings in the model.


title: Revisiting (s)neutrino dark matter in natural SUSY

abstract: We study natural supersymmetric scenarios with light right-handed neutrino superfields, and consider the possibility of having either a neutrino or a sneutrino as a dark matter candidate. For the former, we evaluate the possibility of having SUSY corrections on the $\nu_4\to\nu_\ell\gamma$ decay rate, such that the NuStar bounds are relaxed. We find that corrections are too small. For sneutrino dark matter, we consider thermal and non-thermal production, taking into account freeze-out, freeze-in and super-WIMP mechanisms. For the non-thermal case, we find that the $\tilde\nu_R$ can reproduce the observed relic density by adjusting the R-sneutrino mass and Yukawa couplings. For the thermal case, we find the need to extend the model in order to enhance sneutrino annihilations, which we exemplify in a model with an extended gauge symmetry.


title: Extremely Small BERT Models from Mixed-Vocabulary Training

abstract: Pretrained language models like BERT have achieved good results on NLP tasks, but are impractical on resource-limited devices due to memory footprint. A large fraction of this footprint comes from the input embeddings with large input vocabulary and embedding dimensions. Existing knowledge distillation methods used for model compression cannot be directly applied to train student models with reduced vocabulary sizes. To this end, we propose a distillation method to align the teacher and student embeddings via mixed-vocabulary training. Our method compresses BERT-LARGE to a task-agnostic model with smaller vocabulary and hidden dimensions, which is an order of magnitude smaller than other distilled BERT models and offers a better size-accuracy trade-off on language understanding benchmarks as well as a practical dialogue task.


title: Direct observation of hole carrier density profiles and their light induced manipulation at the surface of Ge

abstract: We demonstrate that, by using low-energy positive muon ($\mu^+$) spin spectroscopy as a local probe technique, the profiles of free charge carriers can be directly determined in the accumulation/depletion surface regions of p- or n-type Ge wafers. The detection of free holes is accomplished by measuring the effect of the interaction of the free carriers with the $\mu^+$ probe spin on the observable muon spin polarization. By tuning the energy of the low-energy $\mu^+$ between 1 keV and 20 keV the near-surface region between 10 nm and 160 nm is probed. We find hole carrier depletion and electron accumulation in all samples with doping concentrations up to the $10^{17}$ cm$^{-3}$ range, which is opposite to the properties of cleaved Ge surfaces. By illumination with light the hole carrier density in the depletion zone can be manipulated in a controlled way. Depending on the used light wavelength $\lambda$ this change can be persistent ($\lambda = 405, 457$ nm) or non-persistent ($\lambda = 635$ nm) at temperatures $< 270$ K. This difference is attributed to the different kinetic energies of the photo-electrons. Photo-electrons generated by red light do not have sufficient energy to overcome a potential barrier at the surface to be trapped in empty surface acceptor states. Compared to standard macroscopic transport measurements our contact-less local probe technique offers the possibility of measuring carrier depth profiles and manipulation directly. Our approach may provide important microscopic information on a nanometer scale in semiconductor device studies.


title: The Role of Specific Ion Effects in Ion Transport: The Case of Nitrate and Thiocyanate

abstract: The selective transport of trivalent rare earth metals from aqueous to organic environments with the help of amphiphilic "extractants" is an industrially important process. When the amphiphilic extractant is positively charged or neutral, the coextracted background anions are not only necessary for charge balance but also have a large impact on extraction efficiency and selectivity. In particular, the opposite selectivity trends observed throughout the lanthanide series in the presence of nitrate and thiocyanate ions have not been explained. To understand the role of background anions in the phase transfer of lanthanide cations, we use a positively charged long-chain aliphatic molecule, modeling a common extractant, and gain molecular level insight into interfacial headgroup-anion interactions. By combining surface sensitive sum frequency generation spectroscopy with X-ray reflectivity and grazing incidence X-ray diffraction, we observed qualitative differences in the orientational and overall interfacial structure of nitrate and thiocyanate solutions at a positively charged Langmuir monolayer. Though nitrate adsorbs without dramatic changes to the solvation structure at the interface or the monolayer ordering, thiocyanate significantly alters the water structure and reduces monolayer ordering. We suggest that these qualitatively different adsorption trends help explain a reversal in system selectivity toward lighter or heavier lanthanides in solvent extraction systems in the presence of nitrate or thiocyanate anions.


title: A local-global principle for surjective polynomial maps

abstract: Let $R$ be an affine domain of characteristic zero with finite quotients. We prove that a polynomial map over $R$ is surjective if and only if it is surjective over $\hat{R_{\mathfrak{m}}}$, the completion of $R$ with respect to $\mathfrak{m}$, for every maximal ideal $\mathfrak{m} \subseteq R$. In fact, the completions $\hat{R_{\mathfrak{m}}}$ may be replaced by arbitrary subrings containing $R$. We use this result to yield a characterization of surjective polynomial maps, and remark that there does not exist a similar principle for injective polynomial maps.


title: Gamma-Ray Burst Afterglows In The Multi-Messenger Era: Numerical Models and Closure Relations

abstract: Gamma-ray bursts (GRBs) associated with gravitational wave events are, and will likely continue to be, viewed at a larger inclination than GRBs without gravitational wave detections. As demonstrated by the afterglow of GW170817, this requires an extension of the common GRB afterglow models which typically assume emission from an on-axis top hat jet. We present a characterization of the afterglows arising from structured jets, providing a framework covering both successful and choked jets. We compute new closure relations for structured jets and compare with the established relations for energy injection and refreshed shock models. The temporal slope before the jet break is found to be a simple function of the ratio between the viewing angle and effective opening angle of the jet. A numerical model to calculate synthetic light curves and spectra is publicly available as the open source Python package afterglowpy.


title: Production of ultra-low radioactivity NaI(Tl) crystals for Dark Matter detectors

abstract: Scintillating NaI(Tl) crystals are widely used in a large variety of experimental applications. However, for the use as Dark Matter (DM) detectors, such crystals demand a high level of radio-purity, not achievable by means of standard industrial techniques. One of the main difficulties comes from the presence of potassium that always accompanies sodium in alkali halides. On the other hand, the arguable DM detection by DAMA experiment using NaI(Tl) scintillating crystals requires a reliable verification able to either confirm the existence of DM or rule out the DAMA claim. Ultra-low radioactivity NaI(Tl) crystals, particularly with very low potassium content, are therefore indispensable to overcome the current stalemate in Dark Matter searches. Nonetheless, apart from DAMA-LIBRA experiments, to date, no other experiment has succeeded in building a detector from NaI(Tl) crystals with potassium content of ppb level. This work describes recent results in the preparation of ultra-radio-pure NaI(Tl) crystals using a modified Bridgman method. A double-walled platinum crucible technique has been designed and reliability tests show that 5 ppb of potassium in the NaI(Tl) crystals of 2 and 3 inches in diameter can be achieved starting from NaI powder with potassium content of the order of 10 ppb. The potassium excess is segregated in the tail-side of the as grown ingot where measured potassium concentration is above 20 ppb. The purifying effect of Bridgman growth for larger NaI(Tl) crystals is currently being tested. The work also reports on scintillation parameters of our NaI(Tl) crystals measured in a dedicated setup conceived for naked, hygroscopic crystals. The reproducible and reliable production of ultra-low radioactivity NaI(Tl) crystals reported in this work will hopefully spur the construction of new DM search experiments and, anyway, clarify the controversial DAMA-LIBRA results.


title: On the Expressiveness of LARA: A Unified Language for Linear and Relational Algebra

abstract: We study the expressive power of the LARA language -- a recently proposed unified model for expressing relational and linear algebra operations -- both in terms of traditional database query languages and some analytic tasks often performed in machine learning pipelines. We start by showing LARA to be expressive complete with respect to first-order logic with aggregation. Since LARA is parameterized by a set of user-defined functions which allow to transform values in tables, the exact expressive power of the language depends on how these functions are defined. We distinguish two main cases depending on the level of genericity queries are enforced to satisfy. Under strong genericity assumptions the language cannot express matrix convolution, a very important operation in current machine learning operations. This language is also local, and thus cannot express operations such as matrix inverse that exhibit a recursive behavior. For expressing convolution, one can relax the genericity requirement by adding an underlying linear order on the domain. This, however, destroys locality and turns the expressive power of the language much more difficult to understand. In particular, although under complexity assumptions the resulting language can still not express matrix inverse, a proof of this fact without such assumptions seems challenging to obtain.


title: Ramanujan Graphs and the Spectral Gap of Supercomputing Topologies

abstract: Graph eigenvalues play a fundamental role in controlling structural properties, such as bisection bandwidth, diameter, and fault tolerance, which are critical considerations in the design of supercomputing interconnection networks. This motivates considering graphs with optimal spectral expansion, called Ramanujan graphs, as potential candidates for interconnection networks. In this work, we explore this possibility by comparing Ramanujan graph properties against those of a wide swath of current and proposed supercomputing topologies. We derive analytic expressions for the spectral gap, bisection bandwidth, and diameter of these topologies, some of which were previously unknown. We find the spectral gap of existing topologies are well-separated from the optimal achievable by Ramanujan topologies, suggesting the potential utility of adopting Ramanujan graphs as interconnection networks.


title: Non-adiabatic Dynamics in a Laser Field with Floquet Fewest Switches Surface Hopping: The Need for An Accurate Treatment of Coherence and Decoherence Remains

abstract: We investigate two well-known approaches for extending the fewest switches surface hopping (FSSH) algorithm to periodic time-dependent couplings. The first formalism acts as if the instantaneous adiabatic electronic states were standard adiabatic states, which just happen to evolve in time. The second formalism replaces the role of the usual adiabatic states by the time-independent adiabatic Floquet states. For a set of modified Tully model problems, the Floquet FSSH (F-FSSH) formalism gives a better estimate for both transmission and reflection probabilities than the instantaneous adiabatic FSSH (IA-FSSH) formalism. More importantly, only F-FSSH predicts the correct final scattering momentum. Finally, in order to use Floquet theory accurately, we find that it is crucial to account for the interference between Floquet states. Our results should be of interest to all those interested in laser induced molecular dynamics.


title: Cross-Validation, Risk Estimation, and Model Selection

abstract: Cross-validation is a popular non-parametric method for evaluating the accuracy of a predictive rule. The usefulness of cross-validation depends on the task we want to employ it for. In this note, I discuss a simple non-parametric setting, and find that cross-validation is asymptotically uninformative about the expected test error of any given predictive rule, but allows for asymptotically consistent model selection. The reason for this phenomenon is that the leading-order error term of cross-validation doesn't depend on the model being evaluated, and so cancels out when we compare two models.


title: Deployment characterization of a floatable tidal energy converter on a tidal channel, Ria Formosa, Portugal

abstract: This paper presents the results of a pilot experiment with an existing tidal energy converter (TEC), Evopod 1 kW floatable prototype, in a real test case scenario (Faro Channel, Ria Formosa, Portugal). A baseline marine geophysical, hydrodynamic and ecological study based on the experience collected on the test site is presented. The collected data was used to validate a hydro-morphodynamic model, allowing the selection of the installation area based on both operational and environmental constraints. Operational results related to the description of power generation capacity, energy capture area and proportion of energy flux are presented and discussed, including the failures occurring during the experimental setup. The data is now available to the scientific community and to TEC industry developers, enhancing the operational knowledge of TEC technology concerning efficiency, environmental effects, and interactions (i.e. device/environment). The results can be used by developers on the licensing process, on overcoming the commercial deployment barriers, on offering extra assurance and confidence to investors, who traditionally have seen environmental concerns as a barrier, and on providing the foundations whereupon similar deployment areas can be considered around the world for marine tidal energy extraction.


title: Simulations of sawtooth-wave adiabatic passage with losses

abstract: The results of simulations of cooling based on Sawtooth-Wave Adiabatic Passage (SWAP) are presented including the possibility of population leaking to states outside of the cycling transition. The amount of population leaking can be substantially suppressed compared to Doppler cooling, which could be useful for systems that are difficult to repump back to the cycling transition. The suppression of the leaked population was more effective when simulating the slowing of a beam than in cooling a thermal distribution. As expected, calculations of the leaked population versus branching ratio of spontaneous emission show that the suppression is more effective for narrow linewidth transitions. In this limit, using SWAP to slow a beam may be worth pursuing even when the branching ratio out of the cycling transition is greater than 10%.


title: Speech Recognition with Augmented Synthesized Speech

abstract: Recent success of the Tacotron speech synthesis architecture and its variants in producing natural sounding multi-speaker synthesized speech has raised the exciting possibility of replacing expensive, manually transcribed, domain-specific, human speech that is used to train speech recognizers. The multi-speaker speech synthesis architecture can learn latent embedding spaces of prosody, speaker and style variations derived from input acoustic representations thereby allowing for manipulation of the synthesized speech. In this paper, we evaluate the feasibility of enhancing speech recognition performance using speech synthesis using two corpora from different domains. We explore algorithms to provide the necessary acoustic and lexical diversity needed for robust speech recognition. Finally, we demonstrate the feasibility of this approach as a data augmentation strategy for domain-transfer. We find that improvements to speech recognition performance is achievable by augmenting training data with synthesized material. However, there remains a substantial gap in performance between recognizers trained on human speech those trained on synthesized speech.


title: A generic framework for task selection driven by synthetic emotions

abstract: Given a certain complexity level, humanized agents may select from a wide range of possible tasks, with each activity corresponding to a transient goal. In general there will be no overarching credit assignment scheme allowing to compare available options with respect to expected utilities. For this situation we propose a task selection framework that is based on time allocation via emotional stationarity (TAES). Emotions are argued to correspond to abstract criteria, such as satisfaction, challenge and boredom, along which activities that have been carried out can be evaluated. The resulting timeline of experienced emotions is then compared with the `character' of the agent, which is defined in terms of a preferred distribution of emotional states. The long-term goal of the agent, to align experience with character, is achieved by optimizing the frequency for selecting the individual tasks. Upon optimization, the statistics of emotion experience becomes stationary.


title: Generation and Distribution of Quantum Oblivious Keys for Secure Multiparty Computation

abstract: The oblivious transfer primitive is sufficient to implement secure multiparty computation. However, secure multiparty computation based only on classical cryptography is severely limited by the security and efficiency of the oblivious transfer implementation. We present a method to efficiently and securely generate and distribute oblivious keys by exchanging qubits and by performing commitments using classical hash functions. With the presented hybrid approach, quantum and classical, we obtain a practical and high-speed oblivious transfer protocol, secure even against quantum computer attacks. The oblivious distributed keys allow implementing a fast and secure oblivious transfer protocol, which can pave the way for the widespread of applications based on secure multiparty computation.


title: Stochastic Prototype Embeddings

abstract: Supervised deep-embedding methods project inputs of a domain to a representational space in which same-class instances lie near one another and different-class instances lie far apart. We propose a probabilistic method that treats embeddings as random variables. Extending a state-of-the-art deterministic method, Prototypical Networks (Snell et al., 2017), our approach supposes the existence of a class prototype around which class instances are Gaussian distributed. The prototype posterior is a product distribution over labeled instances, and query instances are classified by marginalizing relative prototype proximity over embedding uncertainty. We describe an efficient sampler for approximate inference that allows us to train the model at roughly the same space and time cost as its deterministic sibling. Incorporating uncertainty improves performance on few-shot learning and gracefully handles label noise and out-of-distribution inputs. Compared to the state-of-the-art stochastic method, Hedged Instance Embeddings (Oh et al., 2019), we achieve superior large- and open-set classification accuracy. Our method also aligns class-discriminating features with the axes of the embedding space, yielding an interpretable, disentangled representation.


title: Gravitational Corner Conditions in Holography

abstract: Contrary to popular belief, asymptotically anti-de Sitter solutions of gravitational theories cannot be obtained by taking initial data (satisfying the constraints) on a spacelike surface, and choosing an arbitrary conformal metric on the timelike boundary at infinity. There are an infinite number of corner conditions that also must be satisfied where the initial data surface hits the boundary. These are well known to mathematical relativists, but to make them more widely known we give a simple explanation of why these conditions exist and discuss some of their consequences. An example is given which illustrates their power. Some implications for holography are also mentioned.


title: MPCDF HPC Performance Monitoring System: Enabling Insight via Job-Specific Analysis

abstract: This paper reports on the design and implementation of the HPC performance monitoring system deployed to continuously monitor performance metrics of all jobs on the HPC systems at the Max Planck Computing and Data Facility (MPCDF). Thereby it reveals important information to various stakeholders, in particular to users, application support, system administrators, and management. On each compute node, hardware and software performance monitoring data is collected by our newly developed lightweight open-source hpcmd middleware which builds upon standard Linux tools. The data is transported via rsyslog, and aggregated and processed by a Splunk system, enabling detailed per-cluster and per-job interactive analysis in a web browser. Additionally, performance reports are provided to the users as PDF files. Finally, we report on practical experience and benefits from large-scale deployments on MPCDF HPC systems, demonstrating how our solution can be useful to any HPC center.


title: Relations between the 2x2 minors of a generic matrix

abstract: We prove the case t = 2 of a conjecture of Bruns-Conca-Varbaro, describing the minimal relations between the t x t minors of a generic matrix. Interpreting these relations as polynomial functors, and applying transpose duality as in the work of Sam-Snowden, this problem is equivalent to understanding the relations satisfied by t x t generalized permanents. Our proof follows by combining Koszul homology calculations on the minors side, with a study of subspace varieties on the permanents side, and with the Kempf-Weyman technique (on both sides).


title: The Power of Communities: A Text Classification Model with Automated Labeling Process Using Network Community Detection

abstract: Text classification is one of the most critical areas in machine learning and artificial intelligence research. It has been actively adopted in many business applications such as conversational intelligence systems, news articles categorizations, sentiment analysis, emotion detection systems, and many other recommendation systems in our daily life. One of the problems in supervised text classification models is that the models' performance depends heavily on the quality of data labeling that is typically done by humans. In this study, we propose a new network community detection-based approach to automatically label and classify text data into multiclass value spaces. Specifically, we build networks with sentences as the network nodes and pairwise cosine similarities between the Term Frequency-Inversed Document Frequency (TFIDF) vector representations of the sentences as the network link weights. We use the Louvain method to detect the communities in the sentence networks. We train and test the Support Vector Machine and the Random Forest models on both the human-labeled data and network community detection labeled data. Results showed that models with the data labeled by the network community detection outperformed the models with the human-labeled data by 2.68-3.75% of classification accuracy. Our method may help developments of more accurate conversational intelligence and other text classification systems.


title: Implementation of three LWC Schemes in the WiFi 4-Way Handshake with Software Defined Radio

abstract: With the rapid deployment of Internet of Things (IoT) devices in applications such as smarthomes, healthcare and industrial automation, security and privacy has become a major concern. Recently, National Institute of Standards and Technology (NIST) has initiated a lightweight cryptography (LWC) competition to standardize new cryptographic algorithm(s) for providing security in resource-constrained environments. In this context, measuring the suitability of new algorithms with existing communication and authentication protocols is an important problem. This paper investigates the performance of three NIST lightweight authenticated ciphers in round 2 namely ACE, SPIX and WAGE in the WiFi and CoAP handshaking authentication protocols. We implement the WiFi and CoAP handshake protocols and the IEEE802.11a physical layer communication protocol in software defined radio (SDR) and embed these two handshaking protocols into the IEEE802.11a OFDM communication protocol to measure the performance of three ciphers. We present the construction of KDF and MIC used in the handshaking authentication protocols and provide optimized implementations of ACE, SPIX and WAGE including KDF and MIC on three different (low-power) microcontrollers. The performance results of these three ciphers when adopted in WiFi and CoAP protocols are presented. Our experimental results show that the cryptographic functionalities are the bottleneck in the handshaking and data protection protocols.


title: Three-body closed chain of interactive (an)harmonic oscillators and the algebra $sl(4)$

abstract: In this work we study 2- and 3-body oscillators with quadratic and sextic pairwise potentials which depend on relative distances, $|{\bf r}_i - {\bf r}_j |$, between particles. The two-body harmonic oscillator is two-parametric and can be reduced to a one-dimensional radial Jacobi oscillator, while in the 3-body case such a reduction is not possible in general. Our study is restricted to solutions in the space of relative motion which are functions of mutual (relative) distances only ($S$-states). We pay special attention to the cases where the masses of the particles and spring constants are unequal as well as to the atomic, where one mass is infinite, and molecular, where two masses are infinite, limits. In general, three-body harmonic oscillator is 7-parametric depending on 3 masses and 3 spring constants, and frequency. In particular, the first and second order integrals of the 3-body oscillator for unequal masses are searched: it is shown that for certain relations involving masses and spring constants the system becomes maximally (minimally) superintegrable in the case of two (one) relations.

categories: math-ph math.MP physics.chem-ph physics.class-ph quant-ph


title: Singularities of a characteristic Cauchy problem for a PDE with singular coefficients

abstract: In this paper we give an explicit representation of the solutions of a characteristic Cauchy problem for a class of PDEs with singular coefficients. We give the explicit solutions in terms of the Gauss hypergeometric functions, which enable us to study the singularities and the analytic continuation. Our results are illustrated through some examples.


title: Robust stimulated Raman exact passage using shaped pulses

abstract: We developed single-shot shaped pulses for ultra high fidelity (UH-fidelity) population transfer on a 3-level quantum system in lambda configuration. To ensure high fidelity, we use the Lewis-Riesenfeld (L-R) method to derive a family of solutions leading to an exact transfer, where the solutions follow a single dynamical mode of the L-R invariant. Among this family, we identify a tracking solution with a single parameter to control simultaneously the fidelity of the transfer, the population of the excited state, and robustness. We define a measure of the robustness of an UH-fidelity transfer as the minimum percentile deviation on the pulse areas at which the infidelity rises above $10^{-4}$. The robustness of our shaped pulses is found superior to that of Gaussian and adiabatically-optimized pulses for moderate pulse areas.


title: Probabilistic duck curve in high PV penetration power system: Concept, modeling, and empirical analysis in China

abstract: The high penetration of photovoltaic (PV) is reshaping the electricity net-load curve and has a significant impact on power system operation and planning. The concept of duck curve is widely used to describe the timing imbalance between peak demand and PV generation. The traditional duck curve is deterministic and only shows a single extreme or typical scenario during a day. Thus, it cannot capture both the probability of that scenario and the uncertainty of PV generation and loads. These weaknesses limit the application of the duck curve on power system planning under high PV penetration. To address this issue, the novel concepts of probabilistic duck curve (PDC) and probabilistic ramp curve (PRC) are proposed to accurately model the uncertainty and variability of electricity net load and ramp under high PV penetration. An efficient method is presented for modeling PDC and PRC using kernel density estimation, copula function, and dependent discrete convolution. Several indices are designed to quantify the characteristics of the PDC and PRC. For the application, we demonstrate how the PDC and PRC will benefit flexible resource planning. Finally, an empirical study on the Qinghai provincial power system of China validates the effectiveness of the presented method. The results of PDC and PRC intuitively illustrate that the ramp demand and the valley of net load face considerable uncertainty under high PV penetration. The results of flexible resource planning indicate that retrofitting coal-fired units has remarkable performance on enhancing the power system flexibility in Qinghai. In average, reducing the minimal output of coal-fired units by 1 MW will increase PV accommodation by over 4 MWh each day.


title: Tate module tensor decompositions and the Sato-Tate conjecture for certain abelian varieties potentially of $\mathrm{GL}_2$-type

abstract: We introduce a tensor decomposition of the $\ell$-adic Tate module of an abelian variety $A_0$ defined over a number field which is geometrically isotypic. If $A_0$ is potentially of $\GL_2$-type and defined over a totally real number field, we use this decomposition to describe its Sato--Tate group and to prove the Sato--Tate conjecture in certain cases.


title: Strategic reciprocity improves academic performance in public elementary school children

abstract: Social networks are pivotal for learning. Yet, we still lack a full understanding of the mechanisms connecting networks with learning outcomes. Here, we present the results of a large scale study (946 elementary school children from 45 different classrooms) designed to understand the social strategies used by elementary school children. We mapped the social networks of students using both, a non-anonymous version of a prisoner's dilemma and a survey of nominated friendships, and compared the strategies played by students with their GPAs. We found that higher GPA students invest more strategically in their relationships, cooperating more generously with friends and less generously with non-friends than lower GPA students. Our findings suggest that the higher selectivity of social capital investments by high performing students may be one of the mechanisms helping them reap the learning benefits of their social networks.

categories: physics.soc-ph cs.SI physics.app-ph physics.data-an


title: Realizing the potential of astrostatistics and astroinformatics

abstract: This Astro2020 State of the Profession Consideration White Paper highlights the growth of astrostatistics and astroinformatics in astronomy, identifies key issues hampering the maturation of these new subfields, and makes recommendations for structural improvements at different levels that, if acted upon, will make significant positive impacts across astronomy.


title: GraphMix: Improved Training of GNNs for Semi-Supervised Learning

abstract: We present GraphMix, a regularization method for Graph Neural Network based semi-supervised object classification, whereby we propose to train a fully-connected network jointly with the graph neural network via parameter sharing and interpolation-based regularization. Further, we provide a theoretical analysis of how GraphMix improves the generalization bounds of the underlying graph neural network, without making any assumptions about the "aggregation" layer or the depth of the graph neural networks. We experimentally validate this analysis by applying GraphMix to various architectures such as Graph Convolutional Networks, Graph Attention Networks and Graph-U-Net. Despite its simplicity, we demonstrate that GraphMix can consistently improve or closely match state-of-the-art performance using even simpler architectures such as Graph Convolutional Networks, across three established graph benchmarks: Cora, Citeseer and Pubmed citation network datasets, as well as three newly proposed datasets: Cora-Full, Co-author-CS and Co-author-Physics.


title: Optimal Transport to a Variety

abstract: We study the problem of minimizing the Wasserstein distance between a probability distribution and an algebraic variety. We consider the setting of finite state spaces and describe the solution depending on the choice of the ground metric and the given distribution. The Wasserstein distance between the distribution and the variety is the minimum of a linear functional over a union of transportation polytopes. We obtain a description in terms of the solutions of a finite number of systems of polynomial equations. The case analysis is based on the ground metric. A detailed analysis is given for the two bit independence model.


title: Iterative Multilevel density estimation for McKean-Vlasov SDEs via projections

abstract: In this paper, we present a generic methodology for the efficient numerical approximation of the density function of the McKean-Vlasov SDEs. The weak error analysis for the projected process motivates us to combine the iterative Multilevel Monte Carlo method for McKean-Vlasov SDEs \cite{szpruch2019} with non-interacting kernels and projection estimation of particle densities \cite{belomestny2018projected}. By exploiting smoothness of the coefficients for McKean-Vlasov SDEs, in the best case scenario (i.e $C^{\infty}$ for the coefficients), we obtain the complexity of order $O(\epsilon^{-2}|\log\epsilon|^4)$ for the approximation of expectations and $O(\epsilon^{-2}|\log\epsilon|^5)$ for density estimation.


title: Quantitative Rates of Convergence to Non-Equilibrium Steady State for a Weakly Anharmonic Chain of Oscillators

abstract: We study a $1$-dimensional chain of $N$ weakly anharmonic classical oscillators coupled at its ends to heat baths at different temperatures. Each oscillator is subject to pinning potential and it also interacts with its nearest neighbors. In our set up both potentials are homogeneous and bounded (with $N$ dependent bounds) perturbations of the harmonic ones. We show how a generalized version of Bakry-Emery theory can be adapted to this case of a hypoelliptic generator which is inspired by F. Baudoin (2017). By that we prove exponential convergence to non-equilibrium steady state (NESS) in Wasserstein-Kantorovich distance and in relative entropy with quantitative rates. We estimate the constants in the rate by solving a Lyapunov-type matrix equation and we obtain that the exponential rate, for the homogeneous chain, has order bigger than $N^{-3}$. For the purely harmonic chain the order of the rate is in $ [N^{-3},N^{-1}]$. This shows that, in this set up, the spectral gap decays at most polynomially with $N$.


title: Understanding Quantum Control Processor Capabilities and Limitations through Circuit Characterization

abstract: Continuing the scaling of quantum computers hinges on building classical control hardware pipelines that are scalable, extensible, and provide real time response. The instruction set architecture (ISA) of the control processor provides functional abstractions that map high-level semantics of quantum programming languages to low-level pulse generation by hardware. In this paper, we provide a methodology to quantitatively assess the effectiveness of the ISA to encode quantum circuits for intermediate-scale quantum devices with O($10^2$) qubits. The characterization model that we define reflects performance, the ability to meet timing constraint implications, scalability for future quantum chips, and other important considerations making them useful guides for future designs. Using our methodology, we propose scalar (QUASAR) and vector (qV) quantum ISAs as extensions and compare them with other ISAs in metrics such as circuit encoding efficiency, the ability to meet real-time gate cycle requirements of quantum chips, and the ability to scale to more qubits.


title: Benefit of Interpolation in Nearest Neighbor Algorithms

abstract: The over-parameterized models attract much attention in the era of data science and deep learning. It is empirically observed that although these models, e.g. deep neural networks, over-fit the training data, they can still achieve small testing error, and sometimes even {\em outperform} traditional algorithms which are designed to avoid over-fitting. The major goal of this work is to sharply quantify the benefit of data interpolation in the context of nearest neighbors (NN) algorithm. Specifically, we consider a class of interpolated weighting schemes and then carefully characterize their asymptotic performances. Our analysis reveals a U-shaped performance curve with respect to the level of data interpolation, and proves that a mild degree of data interpolation {\em strictly} improves the prediction accuracy and statistical stability over those of the (un-interpolated) optimal $k$NN algorithm. This theoretically justifies (predicts) the existence of the second U-shaped curve in the recently discovered double descent phenomenon. Note that our goal in this study is not to promote the use of interpolated-NN method, but to obtain theoretical insights on data interpolation inspired by the aforementioned phenomenon.


title: Deep-learning-based Breast CT for Radiation Dose Reduction

abstract: Cone-beam breast computed tomography (CT) provides true 3D breast images with isotropic resolution and high-contrast information, detecting calcifications as small as a few hundred microns and revealing subtle tissue differences. However, breast is highly sensitive to x-ray radiation. It is critically important for healthcare to reduce radiation dose. Few-view cone-beam CT only uses a fraction of x-ray projection data acquired by standard cone-beam breast CT, enabling significant reduction of the radiation dose. However, insufficient sampling data would cause severe streak artifacts in CT images reconstructed using conventional methods. In this study, we propose a deep-learning-based method to establish a residual neural network model for the image reconstruction, which is applied for few-view breast CT to produce high quality breast CT images. We respectively evaluate the deep-learning-based image reconstruction using one third and one quarter of x-ray projection views of the standard cone-beam breast CT. Based on clinical breast imaging dataset, we perform a supervised learning to train the neural network from few-view CT images to corresponding full-view CT images. Experimental results show that the deep learning-based image reconstruction method allows few-view breast CT to achieve a radiation dose <6 mGy per cone-beam CT scan, which is a threshold set by FDA for mammographic screening.


title: A Theoretical Analysis of the Number of Shots in Few-Shot Learning

abstract: Few-shot classification is the task of predicting the category of an example from a set of few labeled examples. The number of labeled examples per category is called the number of shots (or shot number). Recent works tackle this task through meta-learning, where a meta-learner extracts information from observed tasks during meta-training to quickly adapt to new tasks during meta-testing. In this formulation, the number of shots exploited during meta-training has an impact on the recognition performance at meta-test time. Generally, the shot number used in meta-training should match the one used in meta-testing to obtain the best performance. We introduce a theoretical analysis of the impact of the shot number on Prototypical Networks, a state-of-the-art few-shot classification method. From our analysis, we propose a simple method that is robust to the choice of shot number used during meta-training, which is a crucial hyperparameter. The performance of our model trained for an arbitrary meta-training shot number shows great performance for different values of meta-testing shot numbers. We experimentally demonstrate our approach on different few-shot classification benchmarks.


title: Revisiting Knowledge Distillation via Label Smoothing Regularization

abstract: Knowledge Distillation (KD) aims to distill the knowledge of a cumbersome teacher model into a lightweight student model. Its success is generally attributed to the privileged information on similarities among categories provided by the teacher model, and in this sense, only strong teacher models are deployed to teach weaker students in practice. In this work, we challenge this common belief by following experimental observations: 1) beyond the acknowledgment that the teacher can improve the student, the student can also enhance the teacher significantly by reversing the KD procedure; 2) a poorly-trained teacher with much lower accuracy than the student can still improve the latter significantly. To explain these observations, we provide a theoretical analysis of the relationships between KD and label smoothing regularization. We prove that 1) KD is a type of learned label smoothing regularization and 2) label smoothing regularization provides a virtual teacher model for KD. From these results, we argue that the success of KD is not fully due to the similarity information between categories from teachers, but also to the regularization of soft targets, which is equally or even more important. Based on these analyses, we further propose a novel Teacher-free Knowledge Distillation (Tf-KD) framework, where a student model learns from itself or manuallydesigned regularization distribution. The Tf-KD achieves comparable performance with normal KD from a superior teacher, which is well applied when a stronger teacher model is unavailable. Meanwhile, Tf-KD is generic and can be directly deployed for training deep neural networks. Without any extra computation cost, Tf-KD achieves up to 0.65\% improvement on ImageNet over well-established baseline models, which is superior to label smoothing regularization.


title: Koszul Duality in Higher Topoi

abstract: We show that there is an equivalence in any $n$-topos $\mathcal{X}$ between the pointed and $k$-connective objects of $\mathcal{X}$ and the $\mathbb{E}_k$-group objects of the $(n-k-1)$-truncation of $\mathcal{X}$. This recovers, up to equivalence of $\infty$-categories, some classical results regarding algebraic models for $k$-connective, $(n-1)$-coconnective homotopy types. Further, it extends those results to the case of sheaves of such homotopy types. We also show that for any pointed and $k$-connective object $X$ of $\mathcal{X}$ there is an equivalence between the $\infty$-category of modules in $\mathcal{X}$ over the associative algebra $\Omega^k X$, and the $\infty$-category of comodules in $\mathcal{X}$ for the cocommutative coalgebra $\Omega^{k-1}X$. All of these equivalences are given by truncations of Lurie's $\infty$-categorical bar and cobar constructions, hence the terminology "Koszul duality".


title: Interacting Faults in California and Hindu Kush

abstract: We study seismic fluctuations in California and Hindu Kush using Diffusion Entropy Analysis (DEA), a technique designed to detect the action of crucial events in time series generated by complex dynamical systems. The time distance between two consecutive crucial events is described by an inverse power law distribution density with a power index $\mu$ close to the value $\mu = 2$, corresponding to an ideal $1/f$ noise. DEA was used in the recent past to study neurophysiological processes that in the healthy condition are found to generate $1/f$ noise and $\mu$ close to $2$. In this paper we find that the seismic fluctuations in both California and Hindu-Kush of extended areas implying the action of many faults, $\mu \approx 2.1$, while in regions involving the action of only one fault, or of a very small number of faults, $\mu \approx 2.4$. This observation led us the conjectures that the seismic criticality is due to the interaction of many faults. To support this conjecture we adopted a dynamical model for fault dynamics proposed by Brown and Tosatti and we have extended it to describe the interaction between many faults. The DEA applied to surrogate sequences generated by this dynamical model, yields $\mu = 2.1$ for a single fault and $\mu = 2,4$ for many interacting faults, in a good agreement with the observation of real seismic fluctuations. This result supports our conjecture and suggests interesting applications to neurophysiological and sociological processes.


title: A variant of Schur's product theorem and its applications

abstract: We show the following version of the Schur's product theorem. If $M=(M_{j,k})_{j,k=1}^n\in{\mathbb R}^{n\times n}$ is a positive semidefinite matrix with all entries on the diagonal equal to one, then the matrix $N=(N_{j,k})_{j,k=1}^n$ with the entries $N_{j,k}=M_{j,k}^2-\frac{1}{n}$ is positive semidefinite. As a corollary of this result, we prove the conjecture of E. Novak on intractability of numerical integration on a space of trigonometric polynomials of degree at most one in each variable. Finally, we discuss also some consequences for Bochner's theorem, covariance matrices of $\chi^2$-variables, and mean absolute values of trigonometric polynomials. -- Please, have a look into page 6 of the preprint "Lower Bounds for the Error of Quadrature Formulas for Hilbert Spaces" for a discussion of the relation of Theorem 1 and Corollary 2 to Gegenbauer polynomials (pointed out by Dmitriy Bilyk (University of Minnesota)). --


title: Disentangling Speech and Non-Speech Components for Building Robust Acoustic Models from Found Data

abstract: In order to build language technologies for majority of the languages, it is important to leverage the resources available in public domain on the internet - commonly referred to as `Found Data'. However, such data is characterized by the presence of non-standard, non-trivial variations. For instance, speech resources found on the internet have non-speech content, such as music. Therefore, speech recognition and speech synthesis models need to be robust to such variations. In this work, we present an analysis to show that it is important to disentangle the latent causal factors of variation in the original data to accomplish these tasks. Based on this, we present approaches to disentangle such variations from the data using Latent Stochastic Models. Specifically, we present a method to split the latent prior space into continuous representations of dominant speech modes present in the magnitude spectra of audio signals. We propose a completely unsupervised approach using multinode latent space variational autoencoders (VAE). We show that the constraints on the latent space of a VAE can be in-fact used to separate speech and music, independent of the language of the speech. This paper also analytically presents the requirement on the number of latent variables for the task based on distribution of the speech data.


title: Cosmogenic Neutron Production at the Sudbury Neutrino Observatory

abstract: Neutrons produced in nuclear interactions initiated by cosmic-ray muons present an irreducible background to many rare-event searches, even in detectors located deep underground. Models for the production of these neutrons have been tested against previous experimental data, but the extrapolation to deeper sites is not well understood. Here we report results from an analysis of cosmogenically produced neutrons at the Sudbury Neutrino Observatory. A specific set of observables are presented, which can be used to benchmark the validity of GEANT4 physics models. In addition, the cosmogenic neutron yield, in units of $10^{-4}\;\text{cm}^{2}/\left(\text{g}\cdot\mu\right)$, is measured to be $7.28 \pm 0.09\;\text{stat.} ^{+1.59}_{-1.12}\;\text{syst.}$ in pure heavy water and $7.30 \pm 0.07\;\text{stat.} ^{+1.40}_{-1.02}\;\text{syst.}$ in NaCl-loaded heavy water. These results provide unique insights into this potential background source for experiments at SNOLAB.


title: Tilings of $(2\times2\times n)$-board with colored cubes and bricks

abstract: Several articles deal with tilings with squares and dominoes on 2-dimensional boards, but only a few on boards in 3-dimensional space. We examine a tiling problem with colored cubes and bricks of $(2\times2\times n)$-board in three dimensions. After a short introduction and the definition of breakability we show a way to get the number of the tilings of an $n$-long board considering the $(n-1)$-long board. It describes recursively the number of possible breakable and unbreakable tilings. Finally, we give some identities for the recursions using breakability. The method of determining the recursions in space can be useful in mathematical education as well.


title: "Good Robot!": Efficient Reinforcement Learning for Multi-Step Visual Tasks with Sim to Real Transfer

abstract: Current Reinforcement Learning (RL) algorithms struggle with long-horizon tasks where time can be wasted exploring dead ends and task progress may be easily reversed. We develop the SPOT framework, which explores within action safety zones, learns about unsafe regions without exploring them, and prioritizes experiences that reverse earlier progress to learn with remarkable efficiency. The SPOT framework successfully completes simulated trials of a variety of tasks, improving a baseline trial success rate from 13% to 100% when stacking 4 cubes, from 13% to 99% when creating rows of 4 cubes, and from 84% to 95% when clearing toys arranged in adversarial patterns. Efficiency with respect to actions per trial typically improves by 30% or more, while training takes just 1-20k actions, depending on the task. Furthermore, we demonstrate direct sim to real transfer. We are able to create real stacks in 100% of trials with 61% efficiency and real rows in 100% of trials with 59% efficiency by directly loading the simulation-trained model on the real robot with no additional real-world fine-tuning. To our knowledge, this is the first instance of reinforcement learning with successful sim to real transfer applied to long term multi-step tasks such as block-stacking and row-making with consideration of progress reversal. Code is available at https://github.com/jhu-lcsr/good_robot .


title: Globular Cluster Intrinsic Iron Abundance Spreads: I. Catalog

abstract: We present an up-to-date catalog of intrinsic iron abundance spreads in the 55 Milky Way globular clusters for which sufficiently precise spectroscopic measurements are available. Our method combines multiple datasets when possible to improve the statistics, taking into account the fact that different methods and instruments can lead to systematically offset metallicities. Only high spectral resolution (R>14,000) studies that measure the equivalent widths of individual iron lines are found to have uncertainties on the metallicities of the individual stars that can be calibrated sufficiently well for the intrinsic dispersion to be separated cleanly from random measurement error. The median intrinsic iron spread is found to be 0.045 dex, which is small but unambiguously measured to be non-zero in most cases. There is large variation between clusters, but more luminous globular clusters, above 10^5 L_sun, have increasingly large iron spreads on average; no trend between iron spread and metallicity is found.


title: Mitigating Internal Instrument Coupling for 21 cm Cosmology I: Temporal and Spectral Modeling in Simulations

abstract: We study the behavior of internal signal chain reflections and antenna cross coupling as systematics for 21 cm cosmological surveys. We outline the mathematics for how these systematics appear in interferometric visibilities and describe their phenomenology. We then describe techniques for modeling and removing these systematics without attenuating the 21 cm signal in the data. This has critical implications for low-frequency radio surveys aiming to characterize the 21cm signal from the Epoch of Reionization and Cosmic Dawn, as systematics can cause bright foreground emission to contaminate the EoR window and prohibit a robust detection. We also quantify the signal loss properties of the systematic modeling algorithms, and show that our techniques demonstrate resistance against EoR signal loss. In a companion paper, we demonstrate these methods on data from the Hydrogen Epoch of Reionization Array as a proof-of-concept.


title: Mitigating Internal Instrument Coupling II: A Method Demonstration with the Hydrogen Epoch of Reionization Array

abstract: We present a study of internal reflection and cross coupling systematics in Phase I of the Hydrogen Epoch of Reionization Array (HERA). In a companion paper, we outlined the mathematical formalism for such systematics and presented algorithms for modeling and removing them from the data. In this work, we apply these techniques to data from HERA's first observing season as a method demonstration. The data show evidence for systematics that, without removal, would hinder a detection of the 21 cm power spectrum for the targeted EoR line-of-sight modes in the range 0.2 < k_parallel < 0.5\ h^-1 Mpc. After systematic removal, we find we can recover these modes in the power spectrum down to the integrated noise-floor of a nightly observation, achieving a dynamic range in the EoR window of 10^-6 in power (mK^2 units) with respect to the bright galactic foreground signal. In the absence of other systematics and assuming the systematic suppression demonstrated here continues to lower noise levels, our results suggest that fully-integrated HERA Phase I may have the capacity to set competitive upper limits on the 21 cm power spectrum. For future observing seasons, HERA will have upgraded analog and digital hardware to better control these systematics in the field.


title: On the spectral property of kernel-based sensor fusion algorithms of high dimensional data

abstract: We apply local laws of random matrices and free probability theory to study the spectral properties of two kernel-based sensor fusion algorithms, nonparametric canonical correlation analysis (NCCA) and alternating diffusion (AD), for two simultaneously recorded high dimensional datasets under the null hypothesis. The matrix of interest is the product of the kernel matrices associated with the databsets, which may not be diagonalizable in general. We prove that in the regime where dimensions of both random vectors are comparable to the sample size, if NCCA and AD are conducted using a smooth kernel function, then the first few nontrivial eigenvalues will converge to real deterministic values provided the datasets are independent Gaussian random vectors. Toward the claimed result, we also provide a convergence rate of eigenvalues of a kernel affinity matrix.


title: Learning Pixel Representations for Generic Segmentation

abstract: Deep learning approaches to generic (non-semantic) segmentation have so far been indirect and relied on edge detection. This is in contrast to semantic segmentation, where DNNs are applied directly. We propose an alternative approach called Deep Generic Segmentation (DGS) and try to follow the path used for semantic segmentation. Our main contribution is a new method for learning a pixel-wise representation that reflects segment relatedness. This representation is combined with a CRF to yield the segmentation algorithm. We show that we are able to learn meaningful representations that improve segmentation quality and that the representations themselves achieve state-of-the-art segment similarity scores. The segmentation results are competitive and promising.


title: Readdressing the UV solar variability with SATIRE-S: non-LTE effects

abstract: Context. Solar spectral irradiance (SSI) variability is one of the key inputs to models of the Earth's climate. Understanding solar irradiance fluctuations also helps to place the Sun among other stars in terms of their brightness variability patterns and to set detectability limits for terrestrial exo-planets. Aims. One of the most successful and widely used models of solar irradiance variability is SATIRE-S. It uses spectra of the magnetic features and surrounding quiet Sun computed with the ATLAS9 spectral synthesis code under the assumption of Local Thermodynamic Equilibrium (LTE). SATIRE-S has been at the forefront of solar variability modelling, but due to the limitations of the LTE approximation its output SSI has to be empirically corrected below 300 nm, which reduces the physical consistency of its results. This shortcoming is addressed in the present paper. Methods. We replace the ATLAS9 spectra of all atmospheric components in SATIRE-S with the spectra calculated using the non-LTE Spectral Synthesis Code (NESSY). We also use Fontenla et al. (1999) temperature and density stratification models of the solar atmosphere to compute the spectrum of the quiet Sun and faculae. Results. We compute non-LTE contrasts of spots and faculae and combine them with the SDO/HMI filling factors of the active regions to calculate the total and spectral solar irradiance variability during solar cycle 24. Conclusions. The non-LTE contrasts result in total and spectral solar irradiance in good agreement with the empirically corrected output of the LTE version. This suggests that empirical correction introduced into SATIRE-S output is well judged and that the corrected total and spectral solar irradiance obtained from the SATIRE-S model in LTE is fully consistent with the results of non-LTE computations.


title: Beyond Beaconing: Emerging Applications and Challenges of BLE

abstract: As an emerging technology with exceptional low energy consumption and low-latency data transmissions, Bluetooth Low Energy (BLE) has gained significant momentum in various application domains, such as Indoor Positioning, Home Automation, and Wireless Personal Area Network (WPAN) communications. With various novel protocol stack features, BLE is finding use on resource-constrained sensor nodes as well as more powerful gateway devices. Particularly proximity detection using BLE beacons has been a popular usage scenario ever since the release of Bluetooth 4.0, primarily due to the beacons' energy efficiency and ease of deployment. However, with the rapid rise of the Internet of Things (IoT), BLE is likely to be a significant component in many other applications with widely varying performance and Quality-of-Service (QoS) requirements and there is a need for a consolidated view of the role that BLE will play in applications beyond beaconing. This paper comprehensively surveys state-of-the-art applications built with BLE, obstacles to adoption of BLE in new application areas, and current solutions from academia and industry that further expand the capabilities of BLE.


title: Observation and Spectral Assignment of a Family of Hexagonal Boron Nitride Lattice Defects

abstract: Atomic vacancy defects in single unit cell thick hexagonal boron nitride are of significant interest because of their photophysical properties, including single-photon emission, and promising applications in quantum communication and computation. The spectroscopic assignment of emission energies to specific atomic vacancies within the triangular lattice is confounded by the exponential scaling of defect candidates with the number of removed atoms. Herein, we collect more than 1000 spectra consisting of single, isolated zero-phonon lines between 1.69 and 2.25 eV, observing 6 quantized zero-phonon lines arising from hexagonal boron nitride vacancies. A newly developed computational framework for isomer cataloguing significantly narrows the number of candidate vacancies. Direct lattice imaging of hexagonal boron nitride, electronic structure calculations, and subsequent boric acid etching are used to definitively assign the 6 features. Systematic chemical etching supports the assignment by demonstrating the sequence of growth of successively larger vacancy centres from smaller ones, with the defects including a single B vacancy and a 16-atom triangular defect. These features exhibit a range of emission lifetimes from 1 to 6 ns, and phonon sidebands offset by the dominant lattice phonon in hexagonal boron nitride near 1370 cm-1. This assignment should significantly advance the solid-state chemistry and photophysics of such vacancy emitters.


title: Categorifying the algebra of indexing systems

abstract: The homotopy category of $N_\infty$ operads is equivalent to a finite lattice, and as the ambient group varies, there are various image constructions between these lattices. In this paper, we explain how to lift this algebraic structure back to the operad level. We show that lattice joins and meets correspond to derived operadic coproducts and products, and we show that the image constructions correspond to derived operadic induction, restriction, and coinduction, at least when taken along an injective homomorphism. We also prove that a derived variant of the Boardman-Vogt tensor product lifts the join. Our result does not resolve Blumberg and Hill's conjecture on the usual tensor product, but it does imply that every $N_\infty$ ring spectrum can be replaced with an equivalent spectrum, which is equipped with a self-interchanging operad action.


title: UNITER: UNiversal Image-TExt Representation Learning

abstract: Joint image-text embedding is the bedrock for most Vision-and-Language (V+L) tasks, where multimodality inputs are simultaneously processed for joint visual and textual understanding. In this paper, we introduce UNITER, a UNiversal Image-TExt Representation, learned through large-scale pre-training over four image-text datasets (COCO, Visual Genome, Conceptual Captions, and SBU Captions), which can power heterogeneous downstream V+L tasks with joint multimodal embeddings. We design four pre-training tasks: Masked Language Modeling (MLM), Masked Region Modeling (MRM, with three variants), Image-Text Matching (ITM), and Word-Region Alignment (WRA). Different from previous work that applies joint random masking to both modalities, we use conditional masking on pre-training tasks (i.e., masked language/region modeling is conditioned on full observation of image/text). In addition to ITM for global image-text alignment, we also propose WRA via the use of Optimal Transport (OT) to explicitly encourage fine-grained alignment between words and image regions during pre-training. Comprehensive analysis shows that both conditional masking and OT-based WRA contribute to better pre-training. We also conduct a thorough ablation study to find an optimal combination of pre-training tasks. Extensive experiments show that UNITER achieves new state of the art across six V+L tasks (over nine datasets), including Visual Question Answering, Image-Text Retrieval, Referring Expression Comprehension, Visual Commonsense Reasoning, Visual Entailment, and NLVR$^2$. Code is available at https://github.com/ChenRocks/UNITER.


title: One-loop electromagnetic correlators of SQED in power-law inflation

abstract: We examine scalar quantum electrodynamics in power-law inflation space-time, and compute the one-loop correction to electric and magnetic field correlators at superhorizon separations. The effect at one-loop descends from the coupling of the vector to the charged scalar current which is greatly enhanced due to gravitational particle production. We conclude that non-perturbative effects must exist due to (i) secular growth, (ii) spatial running, and (iii) infrared sensitivity of the one-loop correction to the correlators. Electric and magnetic correlators exhibit a hierarchy that is due to Faraday's law and accelerated expansion, and must hold non-perturbatively.


title: Active galactic nuclei winds as the origin of the H$_2$ emission excess in nearby galaxies

abstract: In most galaxies, the fluxes of rotational H2 lines strongly correlate with star formation diagnostics (such as polycyclic aromatic hydrocarbons, PAH), suggesting that H2 emission from warm molecular gas is a minor byproduct of star formation. We analyse the optical properties of a sample of 309 nearby galaxies derived from a parent sample of 2,015 objects observed with the Spitzer Space Telescope. We find a correlation between the [OI]6300 emission-line flux and kinematics and the H2 S(3)9.665um/PAH11.3um. The [OI]6300 kinematics in Active Galactic Nuclei (AGN) can not be explained only by gas motions due to the gravitational potential of their host galaxies, suggesting that AGN driven outflows are important to the observed kinematics. While H2 excess also correlates with the fluxes and kinematics of ionized gas (probed by [OIII]), the correlation with [OI] is much stronger, suggesting that H2 and [OI] emission probe the same phase or tightly coupled phases of the wind. We conclude that the excess of H2 emission seen in AGN is produced by shocks due to AGN driven outflows and in the same clouds that produce the [OI] emission. Our results provide an indirect detection of neutral and molecular winds and suggest a new way to select galaxies that likely host molecular outflows. Further ground- and space-based spatially resolved observations of different phases of the molecular gas (cold, warm and hot) are necessary to test our new selection method.


title: On asymptotic charges in 3D gravity

abstract: A variant of the ADT method for the determination of gravitational charges as integrals at infinity is applied to "Chern-Simons-like" theories of 3D gravity, and the result is used to find the mass and angular momentum of the BTZ black hole considered as a solution of a variety of massive 3D gravity field equations. The results agree with many obtained previously by other methods, including our own results for "Minimal Massive Gravity", but they disagree with others, including recently reported results for "Exotic Massive Gravity". We also find the central charges of the asymptotic conformal symmetry algebra for the generic 3D gravity model with AdS vacuum and discuss implications for black hole thermodynamics.


title: Streaming PTAS for Binary $\ell_0$-Low Rank Approximation

abstract: We give a 3-pass, polylog-space streaming PTAS for the constrained binary $k$-means problem and a 4-pass, polylog-space streaming PTAS for the binary $\ell_0$-low rank approximation problem. The connection between the above two problems has recently been studied. We design a streaming PTAS for the former and use this connection to obtain streaming PTAS for the latter. This is the first constant pass, polylog-space streaming algorithm for either of the two problems.


title: Non-Newtonian effects on the slip and mobility of a self-propelling active particle

abstract: Janus particles propel themselves by generating concentration gradients along their active surface. This induces a flow near the surface, known as the diffusio-osmotic slip, which propels the particle even in the absence of externally applied concentration gradients. In this work, we study the influence of viscoelasticity and shear-thinning (described by the second-order-fluid and Carreau model, respectively) on the diffusio-osmotic slip on an active surface. Using matched asymptotic expansions, we provide an analytical expression for the modification of slip induced by the non-Newtonian behavior. The results reveal that the modification in slip velocity arising from polymer elasticity is proportional to the second tangential derivative of the concentration field. Using the reciprocal theorem, we estimate the influence of this modification on the mobility of a Janus sphere. The current study also has direct implications on the understanding of the transport of complex fluids in diffusio-osmotic pumps.


title: Relaxation oscillations in substrate-depletion oscillators close to the nonsmooth limit

abstract: In this paper, we describe a novel type of relaxation oscillations occurring in a model of substrate-depletion oscillators. Using geometric singular perturbation theory, with blow-up as a key technical tool, we show that the oscillations in this planar model are produced by a complicated interplay between two stable nodes and a discontinuity set in the singular limit $\varepsilon\rightarrow 0$. This interplay produces a new mechanism for producing relaxation-type oscillations, which we also describe in a more general setting.