title: Mean-Shifted Contrastive Loss for Anomaly Detection

abstract: Deep anomaly detection methods learn representations that separate between normal and anomalous images. Although self-supervised representation learning is commonly used, small dataset sizes limit its effectiveness. It was previously shown that utilizing external, generic datasets (e.g. ImageNet classification) can significantly improve anomaly detection performance. One approach is outlier exposure, which fails when the external datasets do not resemble the anomalies. We take the approach of transferring representations pre-trained on external datasets for anomaly detection. Anomaly detection performance can be significantly improved by fine-tuning the pre-trained representations on the normal training images. In this paper, we first demonstrate and analyze that contrastive learning, the most popular self-supervised learning paradigm cannot be naively applied to pre-trained features. The reason is that pre-trained feature initialization causes poor conditioning for standard contrastive objectives, resulting in bad optimization dynamics. Based on our analysis, we provide a modified contrastive objective, the Mean-Shifted Contrastive Loss. Our method is highly effective and achieves a new state-of-the-art anomaly detection performance including $98.6\%$ ROC-AUC on the CIFAR-10 dataset.


title: A Matrix Trickle-Down Theorem on Simplicial Complexes and Applications to Sampling Colorings

abstract: We show that the natural Glauber dynamics mixes rapidly and generates a random proper edge-coloring of a graph with maximum degree $\Delta$ whenever the number of colors is at least $q\geq (\frac{10}{3} + \epsilon)\Delta$, where $\epsilon>0$ is arbitrary and the maximum degree satisfies $\Delta \geq C$ for a constant $C = C(\epsilon)$ depending only on $\epsilon$. For edge-colorings, this improves upon prior work \cite{Vig99, CDMPP19} which show rapid mixing when $q\geq (\frac{11}{3}-\epsilon_0 ) \Delta$, where $\epsilon_0 \approx 10^{-5}$ is a small fixed constant. At the heart of our proof, we establish a matrix trickle-down theorem, generalizing Oppenheim's influential result, as a new technique to prove that a high dimensional simplical complex is a local spectral expander.


title: COSMOPOWER: emulating cosmological power spectra for accelerated Bayesian inference from next-generation surveys

abstract: We present $\it{CosmoPower}$, a suite of neural cosmological power spectrum emulators providing orders-of-magnitude acceleration for parameter estimation from two-point statistics analyses of Large-Scale Structure (LSS) and Cosmic Microwave Background (CMB) surveys. The emulators replace the computation of matter and CMB power spectra from Boltzmann codes; thus, they do not need to be re-trained for different choices of astrophysical nuisance parameters or redshift distributions. The matter power spectrum emulation error is less than $0.4\%$ in the wavenumber range $k \in [10^{-5}, 10] \, \mathrm{Mpc}^{-1}$, for redshift $z \in [0, 5]$. $\it{CosmoPower}$ emulates CMB temperature, polarisation and lensing potential power spectra in the $5\sigma$ region of parameter space around the $\it{Planck}$ best fit values with an error $\lesssim 10\%$ of the expected shot noise for the forthcoming Simons Observatory. $\it{CosmoPower}$ is showcased on a joint cosmic shear and galaxy clustering analysis from the Kilo-Degree Survey, as well as on a Stage IV $\it{Euclid}$-like simulated cosmic shear analysis. For the CMB case, $\it{CosmoPower}$ is tested on a $\it{Planck}$ 2018 CMB temperature and polarisation analysis. The emulators always recover the fiducial cosmological constraints with differences in the posteriors smaller than sampling noise, while providing a speed-up factor up to $O(10^4)$ to the complete inference pipeline. This acceleration allows posterior distributions to be recovered in just a few seconds, as we demonstrate in the $\it{Planck}$ likelihood case. $\it{CosmoPower}$ is written entirely in Python, can be interfaced with all commonly used cosmological samplers and is publicly available at https://github.com/alessiospuriomancini/cosmopower .


title: GAN Cocktail: mixing GANs without dataset access

abstract: Today's generative models are capable of synthesizing high-fidelity images, but each model specializes on a specific target domain. This raises the need for model merging: combining two or more pretrained generative models into a single unified one. In this work we tackle the problem of model merging, given two constraints that often come up in the real world: (1) no access to the original training data, and (2) without increasing the size of the neural network. To the best of our knowledge, model merging under these constraints has not been studied thus far. We propose a novel, two-stage solution. In the first stage, we transform the weights of all the models to the same parameter space by a technique we term model rooting. In the second stage, we merge the rooted models by averaging their weights and fine-tuning them for each specific domain, using only data generated by the original trained models. We demonstrate that our approach is superior to baseline methods and to existing transfer learning techniques, and investigate several applications.


title: How planets grow by pebble accretion IV: Envelope opacity trends from sedimenting dust and pebbles

abstract: The amount of nebular gas that a planet can bind is limited by its cooling rate, which is set by the opacity of its envelope. Accreting dust and pebbles contribute to the envelope opacity and, thus, influence the outcome of planet formation. Our aim is to model the size evolution and opacity contribution of solids inside planetary envelopes. We then use the resultant opacity relations to study emergent trends in planet formation. We design a model for the opacity of solids in planetary envelopes that accounts for the growth, fragmentation and erosion of pebbles during their sedimentation. We formulate analytical expressions for the opacity of pebbles and dust and map out their trends as a function of depth, planet mass, distance and accretion rate. We find that the accretion of pebbles rather than planetesimals can produce fully convective envelopes, but only in lower-mass planets that reside in the outer disk or in those that are accreting pebbles at a high rate. In these conditions, pebble sizes are limited by fragmentation and erosion, allowing them to pile up in the envelope. At higher planetary masses or reduced accretion rates, a different regime applies where the sizes of sedimenting pebbles are only limited by their rate of growth. The opacity in this growth-limited regime is much lower, steeply declines with depth and planet mass but is invariant with the pebble mass flux. Our results imply that the opacity of a forming planetary envelope can not be approximated by a value that is constant with either depth or planet mass. When applied to the Solar System, we argue that Uranus and Neptune could not have maintained a sufficiently high opacity to avoid runaway gas accretion unless they both experienced sufficiently rapid accretion of solids and formed late.


title: SIMONe: View-Invariant, Temporally-Abstracted Object Representations via Unsupervised Video Decomposition

abstract: To help agents reason about scenes in terms of their building blocks, we wish to extract the compositional structure of any given scene (in particular, the configuration and characteristics of objects comprising the scene). This problem is especially difficult when scene structure needs to be inferred while also estimating the agent's location/viewpoint, as the two variables jointly give rise to the agent's observations. We present an unsupervised variational approach to this problem. Leveraging the shared structure that exists across different scenes, our model learns to infer two sets of latent representations from RGB video input alone: a set of "object" latents, corresponding to the time-invariant, object-level contents of the scene, as well as a set of "frame" latents, corresponding to global time-varying elements such as viewpoint. This factorization of latents allows our model, SIMONe, to represent object attributes in an allocentric manner which does not depend on viewpoint. Moreover, it allows us to disentangle object dynamics and summarize their trajectories as time-abstracted, view-invariant, per-object properties. We demonstrate these capabilities, as well as the model's performance in terms of view synthesis and instance segmentation, across three procedurally generated video datasets.


title: Multi-Task Hierarchical Learning Based Network Traffic Analytics

abstract: Classifying network traffic is the basis for important network applications. Prior research in this area has faced challenges on the availability of representative datasets, and many of the results cannot be readily reproduced. Such a problem is exacerbated by emerging data-driven machine learning based approaches. To address this issue, we present(N et)2databasewith three open datasets containing nearly 1.3M labeled flows in total, with a comprehensive list of flow features, for there search community1. We focus on broad aspects in network traffic analysis, including both malware detection and application classification. As we continue to grow them, we expect the datasets to serve as a common ground for AI driven, reproducible research on network flow analytics. We release the datasets publicly and also introduce a Multi-Task Hierarchical Learning (MTHL)model to perform all tasks in a single model. Our results show that MTHL is capable of accurately performing multiple tasks with hierarchical labeling with a dramatic reduction in training time.


title: Impact of data-splits on generalization: Identifying COVID-19 from cough and context

abstract: Rapidly scaling screening, testing and quarantine has shown to be an effective strategy to combat the COVID-19 pandemic. We consider the application of deep learning techniques to distinguish individuals with COVID from non-COVID by using data acquirable from a phone. Using cough and context (symptoms and meta-data) represent such a promising approach. Several independent works in this direction have shown promising results. However, none of them report performance across clinically relevant data splits. Specifically, the performance where the development and test sets are split in time (retrospective validation) and across sites (broad validation). Although there is meaningful generalization across these splits the performance significantly varies (up to 0.1 AUC score). In addition, we study the performance of symptomatic and asymptomatic individuals across these three splits. Finally, we show that our model focuses on meaningful features of the input, cough bouts for cough and relevant symptoms for context. The code and checkpoints are available at https://github.com/WadhwaniAI/cough-against-covid


title: Generalized Circular One-Way Jumping Finite Automata

abstract: A discontinuous model of computation called one-way jumping finite automata was defined by H. Chigahara et. al. This model was a restricted version of the model jumping finite automata. One-way jumping finite automata change their states after deleting a letter of an input and jump only in one direction. Allowing a state to delete a subword instead of a letter, we define a new model generalized circular one-way jumping finite automata. These automata work on an input in a circular manner. Similar to one-way jumping finite automata, generalized circular one-way jumping finite automata also jump only in one direction. We show that this newly defined model is powerful than one-way jumping finite automata. We define new variants(right and left) of the model generalized circular one-way jumping finite automata and compare them. We also compare the newly defined model with Chomsky hierarchy. Finally, we explore closure properties of the model.


title: DisTop: Discovering a Topological representation to learn diverse and rewarding skills

abstract: The optimal way for a deep reinforcement learning (DRL) agent to explore is to learn a set of skills that achieves a uniform distribution of states. Following this,we introduce DisTop, a new model that simultaneously learns diverse skills and focuses on improving rewarding skills. DisTop progressively builds a discrete topology of the environment using an unsupervised contrastive loss, a growing network and a goal-conditioned policy. Using this topology, a state-independent hierarchical policy can select where the agent has to keep discovering skills in the state space. In turn, the newly visited states allows an improved learnt representation and the learning loop continues. Our experiments emphasize that DisTop is agnostic to the ground state representation and that the agent can discover the topology of its environment whether the states are high-dimensional binary data, images, or proprioceptive inputs. We demonstrate that this paradigm is competitiveon MuJoCo benchmarks with state-of-the-art algorithms on both single-task dense rewards and diverse skill discovery. By combining these two aspects, we showthat DisTop achieves state-of-the-art performance in comparison with hierarchical reinforcement learning (HRL) when rewards are sparse. We believe DisTop opens new perspectives by showing that bottom-up skill discovery combined with representation learning can unlock the exploration challenge in DRL.


title: Locally accurate matrix product approximation to thermal states

abstract: In one-dimensional quantum systems with short-range interactions, a set of leading numerical methods is based on matrix product states, whose bond dimension determines the amount of computational resources required by these methods. We prove that a thermal state at constant inverse temperature $\beta$ has a matrix product representation with bond dimension $e^{\tilde O(\sqrt{\beta\log(1/\epsilon)})}$ such that all local properties are approximated to accuracy $\epsilon$. This justifies the common practice of using a constant bond dimension in the numerical simulation of thermal properties.

categories: quant-ph cond-mat.stat-mech cond-mat.str-el math-ph math.MP


title: q-Calculus Revisited

abstract: In this study, a new representation is obtained for \emph{q}-calculus, as proposed by Borges [Phyica A 340 (2004) 95], and a new dual \emph{q}-integral is suggested.


title: High Order Impedance Boundary Condition for the Three-dimensional Scattering Problem in Electromagnetism

abstract: In this paper, we propose a variational formulation with the use of high order impedance boundary condition (HOIBC) to solve the scattering problem. We study the existence and uniqueness of the solution. Then, a discretization of this formulation is done with Rao-Wilton-Glisson (RWG). We give validations of the HOIBC obtained with a 3D MoM code that show the improvement in accuracy over the standard impedance boundary condition (SIBC) computations.


title: Simulating relic gravitational waves from inflationary magnetogenesis

abstract: We present three-dimensional direct numerical simulations of the production of magnetic fields and gravitational waves (GWs) in the early Universe during a low energy scale matter-dominated post-inflationary reheating era, and during the early subsequent radiative era, which is strongly turbulent. The parameters of the model are determined such that it avoids a number of known physical problems and produces magnetic energy densities between 0.2% and 2% of the critical energy density at the end of reheating. During the subsequent development of a turbulent magnetohydrodynamic cascade, magnetic fields and GWs develop a spectrum that extends to higher frequencies in the millihertz (nanohertz) range for models with reheating temperatures of around 100 GeV (150 MeV) at the beginning of the radiation-dominated era. However, even though the turbulent cascade is fully developed, the GW spectrum shows a sharp drop for frequencies above the peak value. This suggests that the turbulence is less efficient in driving GWs than previously thought. The peaks of the resulting GW spectra may well be in the range accessible to space interferometers, pulsar timing arrays, and other facilities.


title: Discovery and origins of giant optical nebulae surrounding quasar PKS 0454-22

abstract: We report optical integral-field spectroscopy in the field of one of the most luminous quasars in the $z < 1$ Universe, PKS0454-22, with the Multi-Unit Spectroscopic Explorer. These data enable the discovery of three large ionized nebulae emitting in [O II], H$\beta$, and [O III] with projected areas of $1720, \ 1520,$ and $130 \ \mathrm{pkpc}^2$, which we refer to as N1, N2, and N3, respectively. N1 spatially and kinematically surrounds the quasar host and five nearby galaxies. The morphology and kinematics of N1 are most consistent with stripped interstellar medium resulting from ongoing interactions. Its ionization properties can be explained by quasar photoionization. N2 spatially and kinematically surrounds two galaxies which are at projected distances of $d \approx 90 \ \mathrm{pkpc}$ and line-of-sight velocities of $\Delta v \approx +1410\ \mathrm{km\ s^{-1}}$ from the quasar. The morphology and kinematics of N2 are also consistent with stripped interstellar medium. However, its ionization state requires additional ionization sources beyond the quasar, likely from fast shocks as it moves through the hot halo associated with a galaxy over-density around the quasar. N3 is not coincident with any galaxies with secure redshifts, and may arise from a cool gas structure in the intragroup medium or a dwarf galaxy. These large ionized nebulae demonstrate that interactions can produce cool gas structures on halo scales, while also possibly facilitating quasar fueling. The growing availability of wide-area integral field spectroscopic data will continue to reveal the morphologies, kinematics, and conditions of the gas flows, which may fuel galaxy and black hole growth.


title: Single-spin qubit magnetic spectroscopy of two dimensional superconductivity

abstract: A single-spin qubit placed near the surface of a conductor acquires an additional contribution to its $1/T_1$ relaxation rate due to magnetic noise created by electric current fluctuations in the material. We analyze this technique as a wireless probe of superconductivity in atomically thin two dimensional materials. At temperatures $T \lesssim T_c$, the dominant contribution to the qubit relaxation rate is due to transverse electric current fluctuations arising from quasiparticle excitations. We demonstrate that this method enables detection of metal-to-superconductor transitions, as well as investigation of the symmetry of the superconducting gap function, through the noise scaling with temperature. We show that scaling of the noise with sample-probe distance provides a window into the non-local quasi-static conductivity of superconductors, both clean and disordered. At low temperatures the quasiparticle fluctuations get suppressed, yet the noise can be substantial due to resonant contributions from collective longitudinal modes, such as plasmons in monolayers and Josephson plasmons in bilayers. Potential experimental implications are discussed.


title: The propagation of relativistic jets in expanding media

abstract: We present a comprehensive analytic model of relativistic jet propagation in expanding homologous media (ejecta). This model covers the entire jet evolution as well as a range of configurations that are relevant to binary neutron star mergers. These include low and high luminosity jets, unmagnetized and mildly magnetized jets, time-dependent luminosity jets, and Newtonian and relativistic head velocities. We also extend the existing solution of jets in a static medium to power-law density media with index $\alpha<5$. Our model provides simple analytic formulae (calibrated by 3D simulations) for the jet head propagation and breakout times. We find that the system evolution has two main regimes: strong and weak jets. Strong jets start their propagation immediately within the ejecta. Weak jets are unable to penetrate the ejecta at first, and breach it only after the ejecta expands significantly, thus their evolution is independent of the delay between the onset of the ejecta and the jet launching. After enough time, both strong and weak jets approach a common asymptotic phase. We find that a necessary, but insufficient, criterion for the breakout of unmagnetized [weakly magnetized] jets is $E_{j,{\rm iso,tot}} \gtrsim 3[0.4]E_{ej,{\rm tot}}\left({\theta_j}/{0.1{\rm~rad}}\right)^2$, where $E_{j,{\rm iso,tot}}$ is the jet total isotropic equivalent energy, $\theta_j$ is its opening angle, and $E_{ej,{\rm tot}}$ is the ejecta energy. Applying our model to short GRBs, we find that there is most likely a large diversity of ejecta mass, where mass $ \lesssim 10^{-3}~{\rm M}_{\odot} $ (at least along the poles) is common.


title: The effects of LMC-mass environments on their dwarf satellite galaxies in the FIRE simulations

abstract: Characterizing the predicted environments of dwarf galaxies like the Large Magellanic Cloud (LMC) is becoming increasingly important as next generation surveys push sensitivity limits into this low-mass regime at cosmological distances. We study the environmental effects of LMC-mass halos ($M_{200m} \sim 10^{11}$ M$_\odot$) on their populations of satellites ($M_\star \geq 10^4$ M$_\odot$) using a suite of zoom-in simulations from the Feedback In Realistic Environments (FIRE) project. Our simulations predict significant hot coronas with $T\sim10^5$ K and $M_\text{gas}\sim10^{9.5}$ M$_\odot$. We identify signatures of environmental quenching in dwarf satellite galaxies, particularly for satellites with intermediate mass ($M_\star = 10^{6-7}$ M$_\odot$). The gas content of such objects indicates ram-pressure as the likely quenching mechanism, sometimes aided by star formation feedback. Satellites of LMC-mass hosts replicate the stellar mass dependence of the quiescent fraction found in satellites of MW mass hosts (i.e. that the quiescent fraction increases as stellar mass decreases). Satellites of LMC-mass hosts have a wider variety of quenching times when compared to the strongly bi-modal distribution of quenching times of nearby centrals. Finally, we identify significant tidal stellar structures around four of our six LMC-analogs, suggesting that stellar streams may be common. These tidal features originated from satellites on close orbits, extend to $\sim$80 kpc from the central galaxy, and contain $\sim10^{6-7}$ M$_\odot$~of stars.


title: How squeezed states both maximize and minimize the same notion of quantumness

abstract: Beam splitters are routinely used for generating entanglement between modes in the optical and microwave domains, requiring input states that are not convex combinations of coherent states. This leads to the ability to generate entanglement at a beam splitter as a notion of quantumness. A similar, yet distinct, notion of quantumness is the amount of entanglement generated by two-mode squeezers (i.e., four-wave mixers). We show that squeezed-vacuum states, paradoxically, both minimize and maximize these notions of quantumness, with the crucial resolution of the paradox hinging upon the relative phases between the input states and the devices. Our notion of quantumness is intrinsically related to eigenvalue equations involving creation and annihilation operators, governed by a set of inequalities that leads to generalized cat and squeezed-vacuum states.


title: Re-evaluation of Lunar X-ray observations by Apollo 15 & 16

abstract: The Apollo 15 & 16 missions were the first to explore the Lunar surface chemistry by investigating about 10% of the Lunar surface using a remote sensing X-ray fluorescence spectrometer experiment. The data obtained have been extensively used to study Lunar formation history and geological evolution. In this work, a re-evaluation of the Apollo 15 & 16 X-ray fluorescence experiment is conducted with the aim of obtaining up-to-date empirical values for aluminum (Al) and magnesium (Mg) concentrations relative to silicon (Si) of the upper Lunar surface. An updated instrument response, a newly reconstructed Lunar trajectory orbit, and improved intensity ratio calculations were used to obtain new intensity ratio maps. The resulting Lunar Al/Si and Mg/Al X-ray maps show a clear distinction in Lunar mare and highland regions. The mean Al/Si and Mg/Al intensity ratios for the mare regions obtained from the newly obtained maps are 0.54$\pm$0.07 and 0.54$\pm$0.17, respectively; for the highland regions, the values are 0.76$\pm$0.07 and 1.07$\pm$0.13, respectively. For the Mg/Si intensity ratio, no clear distinction between Lunar features is obtained and we derived a mean value of 0.47$\pm$0.13. Our determined intensity ratios are lower than previously published. These values can be used to infer concentration ratios when accounting for Solar activity, inter-orbit variability, and measurements from different instruments. We employed a correction to infer concentration ratios by comparing our intensity ratios directly to Lunar rock concentrations obtained from various Lunar missions.


title: Emergent fractal phase in energy stratified random models

abstract: We study the effects of partial correlations in kinetic hopping terms of long-range disordered random matrix models on their localization properties. We consider a set of models interpolating between fully-localized Richardson's model and the celebrated Rosenzweig-Porter model (with implemented translation-invariant symmetry). In order to do this, we propose the energy-stratified spectral structure of the hopping term allowing one to decrease the range of correlations gradually. We show both analytically and numerically that any deviation from the completely correlated case leads to the emergent non-ergodic delocalization in the system unlike the predictions of localization of cooperative shielding. In order to describe the models with correlated kinetic terms, we develop the generalization of the Dyson Brownian motion and cavity approaches basing on stochastic matrix process with independent rank-one matrix increments and examine its applicability to the above set of models.


title: Partonic collinear structure by quantum computing

abstract: We present a systematic quantum algorithm, which integrates both the hadronic state preparation and the evaluation of real-time light-front correlators, to study parton distribution functions (PDFs). As a proof of concept, we demonstrate the first direct simulation of the PDFs in the 1+1 dimensional Nambu-Jona-Lasinio model. We show the results obtained by exact diagonalization and by quantum computation using classical hardware. The agreement between these two distinct methods and the qualitative consistency with QCD PDFs validate the proposed quantum algorithm. Our work suggests the encouraging prospects of calculating QCD PDFs on current and near-term quantum devices. The presented quantum algorithm is expected to have many applications in high energy particle and nuclear physics.


title: Gravity Driven Magnetic Field at ~1000 au Scales in High-mass Star Formation

abstract: A full understanding of high-mass star formation requires the study of one of the most elusive components of the energy balance in the interstellar medium: magnetic fields. We report ALMA 1.2 mm, high-resolution (700 au) dust polarization and molecular line observations of the rotating hot molecular core embedded in the high-mass star-forming region IRAS 18089-1732. The dust continuum emission and magnetic field morphology present spiral-like features resembling a whirlpool. The velocity field traced by the H13CO+ (J=3-2) transition line reveals a complex structure with spiral filaments that are likely infalling and rotating, dragging the field with them. We have modeled the magnetic field and find that the best model corresponds to a weakly magnetized core with a mass-to-magnetic-flux ratio (lambda) of 8.38. The modeled magnetic field is dominated by a poloidal component, but with an important contribution from the toroidal component that has a magnitude of 30% of the poloidal component. Using the Davis-Chandrasekhar-Fermi method, we estimate a magnetic field strength of 3.5 mG. At the spatial scales accessible to ALMA, an analysis of the energy balance of the system indicates that gravity overwhelms turbulence, rotation, and the magnetic field. We show that high-mass star formation can occur in weakly magnetized environments, with gravity taking the dominant role.


title: Quantum spatial search in two-dimensional waveguide arrays

abstract: Continuous-time quantum walks (CTQW) have shown the capability to perform efficiently the spatial search of a marked site on many kinds of graphs. However, most of such graphs are hard to realize in an experimental setting. Here we study CTQW spatial search on a planar triangular lattice by means of both numerical simulations and experiments. The experiments are performed using three-dimensional waveguide arrays fabricated by femtosecond laser pulses, illuminated by coherent light. We show that the retrieval of the marked site by the quantum walker is accomplished with higher probability than the classical counterpart, in a convenient time window placed early in the evolution.


title: The slope of the low energy spectrum of Gamma-Ray Burst prompt emission

abstract: Gamma-ray Bursts (GRBs) prompt emission spectra are often fitted with the empirical ''Band" function, namely two power laws smoothly connected. The typical slope of the low energy (sub-MeV) power law is $\alpha_{B}\simeq -1$. In a small fraction of long GRBs this power law splits into two components such that the spectrum presents, in addition to the typical $\sim$ MeV $\nu F_{\nu}$ peak, a break at the order of a few keV or hundreds keV. The typical power law slopes below and above the break are -0.6 and -1.5 respectively. If the break is a common feature, the value of $\alpha_{B}$ could be an ''average'' of the spectral slopes below and above the break in GRBs fitted with Band function. We analyze the spectra of 27 (9) bright long (short) GRBs detected by the Fermi satellite finding a low energy break between 80 keV and 280 keV in 12 long GRBs, but in none of the short events. Through spectral simulations we show that if the break is moved closer (farther) to the peak energy a relatively harder (softer) $\alpha_{B}$ is found by fitting the simulated spectra with the Band function. The hard average slope $\alpha_{B}\simeq-0.38$ found in short GRBs suggests that the break is close to the peak energy. We show that for 15 long GRBs best fitted by the Band function only, the break could be present, but it is not identifiable in the Fermi/GBM spectrum, because either at low energies, close to the detector limit for relatively soft $\alpha_{B}\lesssim-1$, or in the proximity of the energy peak for relatively hard $\alpha_{B}\gtrsim-1$. A spectrum with two breaks could be typical of GRB prompt emission, though hard to identify with current detectors. Instrumental design such that conceived for the THESEUS space mission, extending from 0.3 keV to several MeV and featuring a larger effective area with respect to Fermi/GBM, can reveal a larger fraction of GRBs with a spectral energy break.


title: Axisymmetric magneto-plastic evolution of neutron-star crusts

abstract: Magnetic field evolution in neutron-star crusts is driven by the Hall effect and Ohmic dissipation, for as long as the crust is sufficiently strong to absorb Maxwell stresses exerted by the field and thus make the momentum equation redundant. For the strongest neutron-star fields, however, stresses build to the point of crustal failure, at which point the standard evolution equations are no longer valid. Here, we study the evolution of the magnetic field of the crust up to and beyond crustal failure, whence the crust begins to flow plastically. We perform global axisymmetric evolutions, exploring different types of failure affecting a limited region of the crust. We find that a plastic flow does not simply suppress the Hall effect even in the regime of a low plastic viscosity, but it rather leads to non-trivial evolution -- in some cases even overreacting and enhancing the impact of the Hall effect. Its impact is more pronouced in the toroidal field, with the differences on the poloidal field being less substantial. We argue that both the nature of magnetar bursts and their spindown evolution will be affected by plastic flow, so that observations of these phenomena may help to constrain the way the crust fails.


title: Fermi-Pasta-Ulam phenomena and persistent breathers in the harmonic trap

abstract: We consider the long-term weakly nonlinear evolution governed by the two-dimensional nonlinear Schr\"{o}dinger (NLS) equation with an isotropic harmonic oscillator potential. The dynamics in this regime is dominated by resonant interactions between quartets of linear normal modes, accurately captured by the corresponding resonant Hamiltonian system. In the framework of this system, we identify Fermi-Pasta-Ulam-like recurrence phenomena, whereby the normal-mode spectrum passes in close proximity of the initial configuration, and two-mode states with time-independent mode amplitude spectra that translate into long-lived breathers of the original NLS equation. We comment on possible implications of these findings for nonlinear optics and matter-wave dynamics in Bose-Einstein condensates.

categories: nlin.PS cond-mat.quant-gas math-ph math.MP


title: Quantum Interference of Identical Photons from Remote GaAs Quantum Dots

abstract: Photonic quantum technology provides a viable route to quantum communication, quantum simulation, and quantum information processing. Recent progress has seen the realisation of boson sampling using 20 single-photons and quantum key distribution over hundreds of kilometres. Scaling the complexity requires architectures containing multiple photon-sources, photon-counters, and a large number of indistinguishable single photons. Semiconductor quantum dots are bright and fast sources of coherent single-photons. For applications, a significant roadblock is the poor quantum coherence upon interfering single photons created by independent quantum dots. Here, we demonstrate two-photon interference with near-unity visibility ($93.0\pm0.8$)\% using photons from two completely separate GaAs quantum dots. The experiment retains all the emission into the zero-phonon-line -- only the weak phonon-sideband is rejected -- and temporal post-selection is not employed. Exploiting the quantum interference, we demonstrate a photonic controlled-not circuit and an entanglement with fidelity ($85.0\pm 1.0$)\% between photons of different origins. The two-photon interference visibility is high enough that the entanglement fidelity is well above the classical threshold. The high mutual-coherence of the photons stems from high-quality materials, a diode-structure, and the relatively large quantum dot size. Our results establish a platform, GaAs QDs, for creating coherent single photons in a scalable way.


title: INQ, a modern GPU-accelerated computational framework for (time-dependent) density functional theory

abstract: We present INQ, a new implementation of density functional theory (DFT) and time-dependent DFT (TDDFT) written from scratch to work on graphical processing units (GPUs). Besides GPU support, INQ makes use of modern code design features and takes advantage of newly available hardware. By designing the code around algorithms, rather than against specific implementations and numerical libraries, we aim to provide a concise and modular code. The result is a fairly complete DFT/TDDFT implementation in roughly 12,000 lines of open-source C++ code representing a modular platform for community-driven application development on emerging high-performance computing architectures for the simulation of materials.


title: Measuring Conversational Uptake: A Case Study on Student-Teacher Interactions

abstract: In conversation, uptake happens when a speaker builds on the contribution of their interlocutor by, for example, acknowledging, repeating or reformulating what they have said. In education, teachers' uptake of student contributions has been linked to higher student achievement. Yet measuring and improving teachers' uptake at scale is challenging, as existing methods require expensive annotation by experts. We propose a framework for computationally measuring uptake, by (1) releasing a dataset of student-teacher exchanges extracted from US math classroom transcripts annotated for uptake by experts; (2) formalizing uptake as pointwise Jensen-Shannon Divergence (pJSD), estimated via next utterance classification; (3) conducting a linguistically-motivated comparison of different unsupervised measures and (4) correlating these measures with educational outcomes. We find that although repetition captures a significant part of uptake, pJSD outperforms repetition-based baselines, as it is capable of identifying a wider range of uptake phenomena like question answering and reformulation. We apply our uptake measure to three different educational datasets with outcome indicators. Unlike baseline measures, pJSD correlates significantly with instruction quality in all three, providing evidence for its generalizability and for its potential to serve as an automated professional development tool for teachers.


title: Anti-particle detector models in QFT

abstract: We analyze families of particle detector models that linearly couple to different kinds of fermionic and bosonic fields. We also study the response of these detectors to particle and anti-particle excitations of the field. We propose a simple linear complex scalar particle detector model that captures the fundamental features of fermionic field detectors similarly to how the Unruh-DeWitt model captures the features of the light matter interaction. We also discuss why we do not need to limit ourselves to quadratic models commonly employed in past literature. Namely, we provide a physically motivated mechanism that restores U(1) symmetry in these linear complex models.


title: Bayesian-Wilson coefficients in lattice QCD computations of valence PDFs and GPDs

abstract: We propose an analysis method for the leading-twist operator product expansion based lattice QCD determinations of the valence parton distribution function (PDF). In the first step, we determine the confidence-intervals of the leading-twist $\overline{\mathrm{MS}}$ Wilson coefficients, $C_n(\mu^2 z^2)$, of the equal-time bilocal quark bilinear, given the lattice QCD matrix element of Ioffe-time distribution for a particular hadron $H$ as well as the prior knowledge of the valence PDF, $f(x,\mu)$ of the hadron $H$ determined via global fit from the experimental data. In the next step, we apply the numerically estimated $C_n$ in the lattice QCD determinations of the valence PDFs of other hadrons, and for the zero-skewness generalized parton distribution (GPD) of the same hadron $H$ at non-zero momentum transfers. Our proposal still assumes the dominance of leading-twist terms, but it offers a pragmatic alternative to the usage of perturbative Wilson coefficients and their associated higher-loop uncertainties such as the effect of all-order logarithms at larger sub-Fermi quark-antiquark separations $z$.


title: Twin Pati-Salam theory of flavour with a TeV scale vector leptoquark

abstract: We propose a twin Pati-Salam (PS) theory of flavour broken to the $G_{4321}$ gauge group at high energies, then to the Standard Model at low energies, yielding a TeV scale vector leptoquark $U^{\mu}_1(3,1,2/3)$ which has been suggested to address the lepton universality anomalies $R_{K^{(*)}}$ and $R_{D^{(*)}}$ in $B$ decays. Quark and lepton masses are mediated by vector-like fermions, with personal Higgs doublets for the second and third families, which may be replaced by a two Higgs doublet model (2HDM). The twin PS theory of flavour successfully accounts for all quark and lepton (including neutrino) masses and mixings, and predicts a dominant coupling of $U^{\mu}_1(3,1,2/3)$ to the third family left-handed doublets. However the predicted mass matrices, assuming natural values of the parameters, are not consistent with the single vector leptoquark solution to the $R_{D^{(*)}}$ anomaly, given its current value.


title: Viewing angle observations and effects of evolution with redshift, black hole mass, and Eddington ratio in quasar based cosmology

abstract: This study is focused on the observational measurement of the viewing angle of individual quasars by modeling the broadband quasar spectrum ranging from the infra-red (IR) to the soft X-ray band. Sources are selected from various published catalogs, and their broadband quasi-simultaneous spectral data points were collected and used to model. We started with a COSMOS sample of type-1 sources which have broadband photometric points. Then, to include more data points, we cross-matched the COSMOS with the SDSS DR14 quasar catalog, and eventually, we find 90 sources that have broadband data ranging from IR to soft X-ray. The broadband spectral energy distribution (SED) modeling is done in Xspec by using the optxagnf and the SKIRTOR models for the X-ray, UV, Optical, and IR regimes for each source. The whole sample is divided into four bins with respect to redshift, black hole (BH) mass, and Eddington ratio with an equal number of sources in each bin. The viewing angle is estimated in each bin, and its evolution with respect to redshift, BH mass, and Eddington ratio is examined. As a result, we did not find any significant evolution of viewing angle with those parameters within the 95$\%$ confidence interval. We conclude that the use of quasars in cosmology to determine the expansion rate of the universe is therefore justified, and biases are not expected.


title: Maruyoshi-Song Flows and Defect Groups of $D_p^b(G)$ Theories

abstract: We study the defect groups of $D_p^b(G)$ theories using geometric engineering and BPS quivers. In the simple case when $b=h^\vee (G)$, we use the BPS quivers of the theory to see that the defect group is compatible with a known Maruyoshi-Song flow. To extend to the case where $b\neq h^\vee (G)$, we use a similar Maruyoshi-Song flow to conjecture that the defect groups of $D_p^b(G)$ theories are given by those of $G^{(b)}[k]$ theories. In the cases of $G=A_n, \;E_6, \;E_8$ we cross check our result by calculating the BPS quivers of the $G^{(b)}[k]$ theories and looking at the cokernel of their intersection matrix.


title: Gamma-Ray Flashes from Dark Photons in Neutron Star Mergers

abstract: In this letter we begin the study of visible dark sector signals coming from binary neutron star mergers. We focus on dark photons emitted in the 10 ms - 1 s after the merger, and show how they can lead to bright transient gamma-ray signals. The signal will be approximately isotropic, and for much of the interesting parameter space will be close to thermal, with an apparent temperature of about $100$ keV. These features can be used to distinguish the dark photon signal from the expected short gamma-ray bursts produced in neutron star mergers, which are beamed in a small angle and non-thermal. We calculate the expected signal strength and show that for dark photon masses in the $1-100$ MeV range it can easily lead to total luminosities larger than $10^{46}$ ergs for much of the unconstrained parameter space. This signal can be used to probe a large fraction of the unconstrained parameter space motivated by freeze-in dark matter scenarios with interactions mediated by a dark photon in that mass range. We also comment on future improvements when proposed telescopes and mid-band gravitational detectors become operational.


title: Encoding-dependent generalization bounds for parametrized quantum circuits

abstract: A large body of recent work has begun to explore the potential of parametrized quantum circuits (PQCs) as machine learning models, within the framework of hybrid quantum-classical optimization. In particular, theoretical guarantees on the out-of-sample performance of such models, in terms of generalization bounds, have emerged. However, none of these generalization bounds depend explicitly on how the classical input data is encoded into the PQC. We derive generalization bounds for PQC-based models that depend explicitly on the strategy used for data-encoding. These imply bounds on the performance of trained PQC-based models on unseen data. Moreover, our results facilitate the selection of optimal data-encoding strategies via structural risk minimization, a mathematically rigorous framework for model selection. We obtain our generalization bounds by bounding the complexity of PQC-based models as measured by the Rademacher complexity and the metric entropy, two complexity measures from statistical learning theory. To achieve this, we rely on a representation of PQC-based models via trigonometric functions. Our generalization bounds emphasize the importance of well-considered data-encoding strategies for PQC-based models.


title: Efficiency limits of Perovskite Solar Cells with Transition Metal Oxides as Hole Transport Layers

abstract: Transition metal oxides (TMOs) like MoOx are increasingly explored as hole transport layers for perovskite-based solar cells. Due to their large work function, the hole collection mechanism of such solar cells are fundamentally different from other materials like PEDOT: PSS, and the associated device optimizations are not well elucidated. In addition, the prospects of such architectures against the challenges posed by ion migration are yet to be explored - which we critically examine in this contribution through detailed numerical simulations. Curiously, we find that, for similar ion densities and interface recombination velocities, ion migration is more detrimental for Perovskite solar cells with TMO contact layers with much lower achievable efficiency limits (21%). The insights shared by this work should be of broad interest to the community in terms of long-term stability, efficiency degradation and hence could help critically evaluate the promises and prospects of TMOs as hole contact layers for perovskite solar cells.


title: Exploiting the Gaia EDR3 photometry to derive stellar temperatures

abstract: We present new colour -- effective temperature (Teff) transformations based on the photometry of the early third data release (EDR3) of the Gaia/ESA mission. These relations are calibrated on a sample of about 600 dwarf and giant stars for which Teff have been previously determined with the InfraRed Flux Method from dereddened colours. The 1$\sigma$ dispersion of the transformations is of 60-80 K for the pure Gaia colours BP-RP, BP-G , G-RP, improving to 40-60 K for colours including the 2MASS K-band, namely BP-K, RP-K and G-K, We validate these relations in the most challenging case of dense stellar fields, where the Gaia EDR3 photometry could be less reliable, providing guidance for a safe use of Gaia colours in crowded environments . We compare the Teff from the Gaia EDR3 colours with those obtained from standard V-K colours for stars in three Galactic globular clusters of different metallicity, namely NGC 104, NGC 6752 and NGC 7099. The agreement between the two estimates of Teff is excellent, with mean differences between -50 and +50 K, depending on the colour, and with 1$\sigma$ dispersions around the mean Teff differences of 25-50 K for most of the colours and below 10 K for BP-K and G-K . This demonstrates that these colours are analogue to V-K , as Teff indicators.


title: Cooling and state preparation in an optical lattice via Markovian feedback control

abstract: We propose and investigate a scheme based on Markovian feedback control that allows for the preparation of single targeted eigenstates of a system of bosonic atoms in a one-dimensional optical lattice with high fidelity. It can be used for in-situ cooling the interacting system without particle loss, both for weak and strong interactions, and for experimentally preparing and probing individual excited eigenstates. For that purpose the system is assumed to be probed weakly via homodyne detection of photons that are scattered off-resonantly by the atoms from a structured probe beam into a cavity mode. By applying an inertial force to the system that is proportional to the measured signal, the system is then guided into a pure target state. The scheme is found to be robust against reduced measurement efficiencies.


title: A note on knot Floer homology and fixed points of monodromy

abstract: Using an argument of Baldwin--Hu--Sivek, we prove that if $K$ is a hyperbolic fibered knot with fiber $F$ in a closed, oriented $3$--manifold $Y$, and $\widehat{HFK}(Y,K,[F], g(F)-1)$ has rank $1$, then the monodromy of $K$ is freely isotopic to a pseudo-Anosov map with no fixed points. In particular, this shows that the monodromy of a hyperbolic L-space knot is freely isotopic to a map with no fixed points.


title: Differentiable Multiple Shooting Layers

abstract: We detail a novel class of implicit neural models. Leveraging time-parallel methods for differential equations, Multiple Shooting Layers (MSLs) seek solutions of initial value problems via parallelizable root-finding algorithms. MSLs broadly serve as drop-in replacements for neural ordinary differential equations (Neural ODEs) with improved efficiency in number of function evaluations (NFEs) and wall-clock inference time. We develop the algorithmic framework of MSLs, analyzing the different choices of solution methods from a theoretical and computational perspective. MSLs are showcased in long horizon optimal control of ODEs and PDEs and as latent models for sequence generation. Finally, we investigate the speedups obtained through application of MSL inference in neural controlled differential equations (Neural CDEs) for time series classification of medical data.


title: Non-Perturbative Heterotic Duals of M-Theory on $G_{2}$ Orbifolds

abstract: By fibering the duality between the $E_{8}\times E_{8}$ heterotic string on $T^{3}$ and M-theory on K3, we study heterotic duals of M-theory compactified on $G_{2}$ orbifolds of the form $T^{7}/\mathbb{Z}_{2}^{3}$. While the heterotic compactification space is straightforward, the description of the gauge bundle is subtle, involving the physics of point-like instantons on orbifold singularities. By comparing the gauge groups of the dual theories, we deduce behavior of a "half-$G_{2}$" limit, which is the M-theory analog of the stable degeneration limit of F-theory. The heterotic backgrounds exhibit point-like instantons that are localized on pairs of orbifold loci, similar to the "gauge-locking" phenomenon seen in Ho\v{r}ava-Witten compactifications. In this way, the geometry of the $G_{2}$ orbifold is translated to bundle data in the heterotic background. While the instanton configuration looks surprising from the perspective of the $E_{8}\times E_{8}$ heterotic string, it may be understood as T-dual $\text{Spin}(32)/\mathbb{Z}_{2}$ instantons along with winding shifts originating in a dual Type I compactification.


title: A Catalog of Formulations for the Network Pricing Problem

abstract: We study the network pricing problem where the leader maximizes their revenue by determining the optimal amounts of tolls to charge on a set of arcs, under the assumption that the followers will react rationally and choose the shortest paths to travel. Many distinct single-level reformulations to this bilevel optimization program have been proposed, however, their relationship has not been established. In this paper, we aim to build a connection between those reformulations and explore the combination of the path representation with various modeling options, allowing us to generate 12 different reformulations of the problem. Moreover, we propose a new path enumeration scheme, path-based preprocessing, and hybrid framework to further improve performance and robustness when solving the final model. We provide numerical results, comparing all the derived reformulations and confirming the efficiency of the novel dimensionality reduction procedures.


title: Investigating New Physics Models with Signature of Same-Sign Diboson + ${E\!\!/}_{T}$

abstract: We investigate the prospect of searching for new physics via the novel signature of same-sign diboson + ${E\!\!/}_{T}$ at current and future LHC. We study three new physics models: (i) natural SUSY models, (ii) type-III seesaw model and (iii) type-II seesaw/Georgi-Machacek model. In the first two class of models, this signature arises due to the presence of a singly-charged particle which has lifetime long enough to escape detection, while in the third model this signature originates resonantly from a doubly-charged particle produced along with two forward jets that, most likely, would escape detection. We analyze in great detail the discovery prospects of the signal in these three classes of models in the current as well as the upcoming runs of the LHC (such as HL-LHC, HE-LHC and FCC-hh) by showing a distinction among these scenarios.


title: Higher spin wormholes from modular bootstrap

abstract: We investigate the connection between spacetime wormholes and ensemble averaging in the context of higher spin AdS$_3$/CFT$_2$. Using techniques from modular bootstrap combined with some holographic inputs, we evaluate the partition function of a Euclidean wormhole in AdS$_3$ higher spin gravity. The fixed spin sectors of the dual CFT$_2$ exhibit features that starkly go beyond conventional random matrix ensembles: power-law ramps in the spectral form factor and potentials with a double-well/crest underlying the level statistics.


title: Extreme Matter meets Extreme Gravity: Ultra-heavy neutron stars with crossovers and first-order phase transitions

abstract: The speed of sound of the matter within neutron stars may contain non-smooth structure related to first-order phase transitions or or crossovers. Here we investigate what are the observable consequences of structure, such as bumps, spikes, step functions, plateaus, and kinks. One of the main consequences is the possibility of ultra-heavy neutron stars, i.e.~stars with masses significantly heavier than two solar masses. These stars pass all observational and theoretical constraints, including those imposed by recent LIGO/Virgo gravitational-wave observations and NICER X-ray observations. We thoroughly investigate other consequences of this structure in the speed of sound to develop an understanding of how non-smooth features affect astrophysical observables, such as stellar radii, tidal deformability, moment of inertia, and Love number. Our results have important implications to future gravitational wave and X-ray observations of neutron stars and their impact in nuclear astrophysics.


title: Noisy intermediate-scale quantum algorithm for semidefinite programming

abstract: Semidefinite programs (SDPs) are convex optimization programs with vast applications in control theory, quantum information, combinatorial optimization and operational research. Noisy intermediate-scale quantum (NISQ) algorithms aim to make an efficient use of the current generation of quantum hardware. However, optimizing variational quantum algorithms is a challenge as it is an NP-hard problem that in general requires an exponential time to solve and can contain many far from optimal local minima. Here, we present a current term NISQ algorithm for solving SDPs. The classical optimization program of our NISQ solver is another SDP over a lower dimensional ansatz space. We harness the SDP based formulation of the Hamiltonian ground state problem to design a NISQ eigensolver. Unlike variational quantum eigensolvers, the classical optimization program of our eigensolver is convex, can be solved in polynomial time with the number of ansatz parameters and every local minimum is a global minimum. We find numeric evidence that NISQ SDP can improve the estimation of ground state energies in a scalable manner. Further, we efficiently solve constrained problems to calculate the excited states of Hamiltonians, find the lowest energy of symmetry constrained Hamiltonians and determine the optimal measurements for quantum state discrimination. We demonstrate the potential of our approach by finding the largest eigenvalue of up to $2^{1000}$ dimensional matrices and solving graph problems related to quantum contextuality. We also discuss NISQ algorithms for rank-constrained SDPs. Our work extends the application of NISQ computers onto one of the most successful algorithmic frameworks of the past few decades.


title: Ten dimensional symmetry of N=4 SYM correlators

abstract: We consider four-point correlation functions of protected single-trace scalar operators in planar N = 4 supersymmetric Yang-Mills (SYM). We conjecture that all loop corrections derive from an integrand which enjoys a ten-dimensional symmetry. This symmetry combines spacetime and R-charge transformations. By considering a 10D light-like limit, we extend the correlator/amplitude duality by equating large R-charge octagons with Coulomb branch scattering amplitudes. Using results from integrability, this predicts new finite amplitudes as well as some Feynman integrals.


title: Rethinking Graph Transformers with Spectral Attention

abstract: In recent years, the Transformer architecture has proven to be very successful in sequence processing, but its application to other data structures, such as graphs, has remained limited due to the difficulty of properly defining positions. Here, we present the $\textit{Spectral Attention Network}$ (SAN), which uses a learned positional encoding (LPE) that can take advantage of the full Laplacian spectrum to learn the position of each node in a given graph. This LPE is then added to the node features of the graph and passed to a fully-connected Transformer. By leveraging the full spectrum of the Laplacian, our model is theoretically powerful in distinguishing graphs, and can better detect similar sub-structures from their resonance. Further, by fully connecting the graph, the Transformer does not suffer from over-squashing, an information bottleneck of most GNNs, and enables better modeling of physical phenomenons such as heat transfer and electric interaction. When tested empirically on a set of 4 standard datasets, our model performs on par or better than state-of-the-art GNNs, and outperforms any attention-based model by a wide margin, becoming the first fully-connected architecture to perform well on graph benchmarks.


title: Differentiable Quality Diversity

abstract: Quality diversity (QD) is a growing branch of stochastic optimization research that studies the problem of generating an archive of solutions that maximize a given objective function but are also diverse with respect to a set of specified measure functions. However, even when these functions are differentiable, QD algorithms treat them as "black boxes", ignoring gradient information. We present the differentiable quality diversity (DQD) problem, a special case of QD, where both the objective and measure functions are first order differentiable. We then present MAP-Elites via a Gradient Arborescence (MEGA), a DQD algorithm that leverages gradient information to efficiently explore the joint range of the objective and measure functions. Results in two QD benchmark domains and in searching the latent space of a StyleGAN show that MEGA significantly outperforms state-of-the-art QD algorithms, highlighting DQD's promise for efficient quality diversity optimization when gradient information is available. Source code is available at https://github.com/icaros-usc/dqd.


title: SIGTYP 2021 Shared Task: Robust Spoken Language Identification

abstract: While language identification is a fundamental speech and language processing task, for many languages and language families it remains a challenging task. For many low-resource and endangered languages this is in part due to resource availability: where larger datasets exist, they may be single-speaker or have different domains than desired application scenarios, demanding a need for domain and speaker-invariant language identification systems. This year's shared task on robust spoken language identification sought to investigate just this scenario: systems were to be trained on largely single-speaker speech from one domain, but evaluated on data in other domains recorded from speakers under different recording circumstances, mimicking realistic low-resource scenarios. We see that domain and speaker mismatch proves very challenging for current methods which can perform above 95% accuracy in-domain, which domain adaptation can address to some degree, but that these conditions merit further investigation to make spoken language identification accessible in many scenarios.


title: Orbital Angular Momentum Distribution of Gluons at Small-$x$ : Analytic interpolation between Ji and Jaffe-Manohar

abstract: In this work, we first introduced a generalized Wilson line gauge link that reproduces both staple and near straight links along the light cone in different parameter limits. We then studied the gauge-invariant bi-local orbital angular momentum operator with such a general gauge link, in the framework of Chen et. al. decomposition of gauge fields. At the appropriate combination of limits, the operator reproduces both Jaffe-Manohar and Ji's operator structure and offers a continuous analytical interpolation between the two.


title: TRAO Survey of the nearby filamentary molecular clouds, the universal nursery of stars (TRAO FUNS). II. Filaments and Dense cores in IC 5146

abstract: We present the results on the physical properties of filaments and dense cores in IC 5146, as a part of the TRAO FUNS project. We carried out On-The-Fly mapping observations using the Taeduk Radio Astronomy Observatory (TRAO) 14m telescope covering about 1 square degree of the area of IC 5146 using various molecular lines. We identified 14 filaments (24 in total, including sub-filaments) from the C$^{18}$O (1-0) data cube and 22 dense cores from the $\rm N_{2}H^{+}$ (1-0) data. We examined the filaments' gravitational criticality, turbulence properties, accretion rate from filaments to dense cores, and relative evolutionary stages of cores. Most filaments in IC 5146 are gravitationally supercritical within the uncertainty, and most dense cores are formed in them. We found that dense cores in the hubs show a systemic velocity shift of ~0.3 km/s between the $\rm N_{2}H^{+}$ and C$^{18}$O gas. Besides, these cores are subsonic or transonic, while the surrounding filament gas is transonic or supersonic, indicating that the cores in the hubs are likely formed by the turbulence dissipation in the colliding turbulent filaments and the merging is still ongoing. We estimated the mass accretion rate of $15 - 35~M_{\odot}~\rm Myr^{-1}$ from the filaments to the dense cores, and the required time scales to collect the current core mass are consistent with the lifetime of the dense cores. The structures of filaments and dense cores in the hub can form by a collision of turbulent converging flows, and mass flow along the filaments to the dense cores may play an important role in forming dense cores.


title: SPANet: Generalized Permutationless Set Assignment for Particle Physics using Symmetry Preserving Attention

abstract: The creation of unstable heavy particles at the Large Hadron Collider is the most direct way to address some of the deepest open questions in physics. Collisions typically produce variable-size sets of observed particles which have inherent ambiguities complicating the assignment of observed particles to the decay products of the heavy particles. Current strategies for tackling these challenges in the physics community ignore the physical symmetries of the decay products and consider all possible assignment permutations and do not scale to complex configurations. Attention based deep learning methods for sequence modelling have achieved state-of-the-art performance in natural language processing, but they lack built-in mechanisms to deal with the unique symmetries found in physical set-assignment problems. We introduce a novel method for constructing symmetry-preserving attention networks which reflect the problem's natural invariances to efficiently find assignments without evaluating all permutations. This general approach is applicable to arbitrarily complex configurations and significantly outperforms current methods, improving reconstruction efficiency between 19\% - 35\% on typical benchmark problems while decreasing inference time by two to five orders of magnitude on the most complex events, making many important and previously intractable cases tractable. A full code repository containing a general library, the specific configuration used, and a complete dataset release, are avaiable at https://github.com/Alexanders101/SPANet


title: Shifting Transformation Learning for Out-of-Distribution Detection

abstract: Detecting out-of-distribution (OOD) samples plays a key role in open-world and safety-critical applications such as autonomous systems and healthcare. Recently, self-supervised representation learning techniques (via contrastive learning and pretext learning) have shown effective in improving OOD detection. However, one major issue with such approaches is the choice of shifting transformations and pretext tasks which depends on the in-domain distribution. In this paper, we propose a simple framework that leverages a shifting transformation learning setting for learning multiple shifted representations of the training set for improved OOD detection. To address the problem of selecting optimal shifting transformation and pretext tasks, we propose a simple mechanism for automatically selecting the transformations and modulating their effect on representation learning without requiring any OOD training samples. In extensive experiments, we show that our simple framework outperforms state-of-the-art OOD detection models on several image datasets. We also characterize the criteria for a desirable OOD detector for real-world applications and demonstrate the efficacy of our proposed technique against state-of-the-art OOD detection techniques.


title: Toric ideals which are determinantal

abstract: Given any equigenerated monomial ideal $I$ with the property that the defining ideal $J$ of the fiber cone $ F(I)$ of $I$ is generated by quadratic binomials, we introduce a matrix such that the set of its binomial $2$-minors is a generating set of $J$. In this way, we characterize the fiber cone of sortable and Freiman ideals.


title: Subleading Corrections in N=3 Gaiotto-Tomasiello Theory

abstract: We study subleading corrections to the genus-zero free energy of the $\mathcal{N}=3$ Gaiotto-Tomasiello theory. In general, we obtain the endpoints and free energy as a set of parametric equations via contour integrals of the planar resolvent, up to exponentially suppressed corrections. In the particular case that the two gauge groups in the quiver are of equal rank, we find an explicit (perturbative) expansion for the free energy. If, additionally, both groups have equal levels, then we find the full expression for the genus-zero free energy, modulo exponentially suppressed corrections. We also verify our results numerically.


title: Impact of the activation rate of the hyperpolarization-activated current $I_{\rm h}$ on the neuronal membrane time constant and synaptic potential duration

abstract: The temporal dynamics of membrane voltage changes in neurons is controlled by ionic currents. These currents are characterized by two main properties: conductance and kinetics. The hyperpolarization-activated current ($I_{\rm h}$) strongly modulates subthreshold potential changes by shortening the excitatory postsynaptic potentials and decreasing their temporal summation. Whereas the shortening of the synaptic potentials caused by the $I_{\rm h}$ conductance is well understood, the role of the $I_{\rm h}$ kinetics remains unclear. Here, we use a model of the $I_{\rm h}$ current model with either fast or slow kinetics to determine its influence on the membrane time constant ($\tau_m$) of a CA1 pyramidal cell model. Our simulation results show that the $I_{\rm h}$ with fast kinetics decreases $\tau_m$ and attenuates and shortens the excitatory postsynaptic potentials more than the slow $I_{\rm h}$. We conclude that the $I_{\rm h}$ activation kinetics is able to modulate $\tau_m$ and the temporal properties of excitatory postsynaptic potentials (EPSPs) in CA1 pyramidal cells. In order to elucidate the mechanisms by which $I_{\rm h}$ kinetics controls $\tau_m$, we propose a new concept called "time scaling factor". Our main finding is that the $I_{\rm h}$ kinetics influences $\tau_m$ by modulating the contribution of the $I_{\rm h}$ derivative conductance to $\tau_m$.


title: PILOT: Introducing Transformers for Probabilistic Sound Event Localization

abstract: Sound event localization aims at estimating the positions of sound sources in the environment with respect to an acoustic receiver (e.g. a microphone array). Recent advances in this domain most prominently focused on utilizing deep recurrent neural networks. Inspired by the success of transformer architectures as a suitable alternative to classical recurrent neural networks, this paper introduces a novel transformer-based sound event localization framework, where temporal dependencies in the received multi-channel audio signals are captured via self-attention mechanisms. Additionally, the estimated sound event positions are represented as multivariate Gaussian variables, yielding an additional notion of uncertainty, which many previously proposed deep learning-based systems designed for this application do not provide. The framework is evaluated on three publicly available multi-source sound event localization datasets and compared against state-of-the-art methods in terms of localization error and event detection accuracy. It outperforms all competing systems on all datasets with statistical significant differences in performance.


title: When in Doubt: Neural Non-Parametric Uncertainty Quantification for Epidemic Forecasting

abstract: Accurate and trustworthy epidemic forecasting is an important problem that has impact on public health planning and disease mitigation. Most existing epidemic forecasting models disregard uncertainty quantification, resulting in mis-calibrated predictions. Recent works in deep neural models for uncertainty-aware time-series forecasting also have several limitations; e.g. it is difficult to specify meaningful priors in Bayesian NNs, while methods like deep ensembling are computationally expensive in practice. In this paper, we fill this important gap. We model the forecasting task as a probabilistic generative process and propose a functional neural process model called EPIFNP, which directly models the probability density of the forecast value. EPIFNP leverages a dynamic stochastic correlation graph to model the correlations between sequences in a non-parametric way, and designs different stochastic latent variables to capture functional uncertainty from different perspectives. Our extensive experiments in a real-time flu forecasting setting show that EPIFNP significantly outperforms previous state-of-the-art models in both accuracy and calibration metrics, up to 2.5x in accuracy and 2.4x in calibration. Additionally, due to properties of its generative process,EPIFNP learns the relations between the current season and similar patterns of historical seasons,enabling interpretable forecasts. Beyond epidemic forecasting, the EPIFNP can be of independent interest for advancing principled uncertainty quantification in deep sequential models for predictive analytics


title: AutoPtosis

abstract: Blepharoptosis, or ptosis as it is more commonly referred to, is a condition of the eyelid where the upper eyelid droops. The current diagnosis for ptosis involves cumbersome manual measurements that are time-consuming and prone to human error. In this paper, we present AutoPtosis, an artificial intelligence based system with interpretable results for rapid diagnosis of ptosis. We utilize a diverse dataset collected from the Illinois Ophthalmic Database Atlas (I-ODA) to develop a robust deep learning model for prediction and also develop a clinically inspired model that calculates the marginal reflex distance and iris ratio. AutoPtosis achieved 95.5% accuracy on physician verified data that had an equal class balance. The proposed algorithm can help in the rapid and timely diagnosis of ptosis, significantly reduce the burden on the healthcare system, and save the patients and clinics valuable resources.


title: Learning to Guide a Saturation-Based Theorem Prover

abstract: Traditional automated theorem provers have relied on manually tuned heuristics to guide how they perform proof search. Recently, however, there has been a surge of interest in the design of learning mechanisms that can be integrated into theorem provers to improve their performance automatically. In this work, we introduce TRAIL, a deep learning-based approach to theorem proving that characterizes core elements of saturation-based theorem proving within a neural framework. TRAIL leverages (a) an effective graph neural network for representing logical formulas, (b) a novel neural representation of the state of a saturation-based theorem prover in terms of processed clauses and available actions, and (c) a novel representation of the inference selection process as an attention-based action policy. We show through a systematic analysis that these components allow TRAIL to significantly outperform previous reinforcement learning-based theorem provers on two standard benchmark datasets (up to 36% more theorems proved). In addition, to the best of our knowledge, TRAIL is the first reinforcement learning-based approach to exceed the performance of a state-of-the-art traditional theorem prover on a standard theorem proving benchmark (solving up to 17% more problems).


title: Deep Proxy Causal Learning and its Application to Confounded Bandit Policy Evaluation

abstract: Proxy causal learning (PCL) is a method for estimating the causal effect of treatments on outcomes in the presence of unobserved confounding, using proxies (structured side information) for the confounder. This is achieved via two-stage regression: in the first stage, we model relations among the treatment and proxies; in the second stage, we use this model to learn the effect of treatment on the outcome, given the context provided by the proxies. PCL guarantees recovery of the true causal effect, subject to identifiability conditions. We propose a novel method for PCL, the deep feature proxy variable method (DFPV), to address the case where the proxies, treatments, and outcomes are high-dimensional and have nonlinear complex relationships, as represented by deep neural network features. We show that DFPV outperforms recent state-of-the-art PCL methods on challenging synthetic benchmarks, including settings involving high dimensional image data. Furthermore, we show that PCL can be applied to off-policy evaluation for the confounded bandit problem, in which DFPV also exhibits competitive performance.


title: Scanning probe-induced thermoelectrics in a quantum point contact

abstract: We study three-terminal thermoelectric transport in a two-dimensional Quantum Point Contact (QPC) connected to left and right electronic reservoirs, as well as a third one represented by a scanning probe tip. The latter acts as a voltage probe exchanging heat with the system but no charges on average. The thermoelectric coefficients are calculated numerically within the Landauer-B\"uttiker formalism in the low-temperature and linear response regimes. We find tip-induced oscillations of the local and non-local thermopowers and study their dependence on the QPC opening. If the latter is tuned on a conductance plateau, the system behaves as a perfect thermoelectric diode: for some tip positions the charge current through the QPC, driven by a local Seebeck effect, can flow in one direction only.


title: Solutions to the non-cutoff Boltzmann equation uniformly near a Maxwellian

abstract: The purpose of this paper is to show how the combination of the well-known results for convergence to equilibrium and conditional regularity, in addition to a short-time existence result, lead to a quick proof of the existence of global smooth solutions for the non cutoff Boltzmann equation when the initial data is close to equilibrium. We include a short-time existence result for polynomially-weighted $L^\infty$ initial data. From this, we deduce that if the initial data is sufficiently close to a Maxwellian in this norm, then a smooth solution exists globally in time.


title: On log differentials of local fields

abstract: We prove a logarithmic version of Fontaine's classic result on differentials of $\mathcal{O}_{\bar K}$ over $\mathcal{O}_K$.


title: XIRL: Cross-embodiment Inverse Reinforcement Learning

abstract: We investigate the visual cross-embodiment imitation setting, in which agents learn policies from videos of other agents (such as humans) demonstrating the same task, but with stark differences in their embodiments -- shape, actions, end-effector dynamics, etc. In this work, we demonstrate that it is possible to automatically discover and learn vision-based reward functions from cross-embodiment demonstration videos that are robust to these differences. Specifically, we present a self-supervised method for Cross-embodiment Inverse Reinforcement Learning (XIRL) that leverages temporal cycle-consistency constraints to learn deep visual embeddings that capture task progression from offline videos of demonstrations across multiple expert agents, each performing the same task differently due to embodiment differences. Prior to our work, producing rewards from self-supervised embeddings typically required alignment with a reference trajectory, which may be difficult to acquire under stark embodiment differences. We show empirically that if the embeddings are aware of task progress, simply taking the negative distance between the current state and goal state in the learned embedding space is useful as a reward for training policies with reinforcement learning. We find our learned reward function not only works for embodiments seen during training, but also generalizes to entirely new embodiments. Additionally, when transferring real-world human demonstrations to a simulated robot, we find that XIRL is more sample efficient than current best methods. Qualitative results, code, and datasets are available at https://x-irl.github.io


title: CNO dredge-up in a sample of APOGEE/Kepler red giants: Tests of stellar models and Galactic evolutionary trends of N/O and C/N

abstract: Surface abundances of C, N, and O in red giants are affected by processed material mixed into the stars' convective envelopes. Using a sample of $\sim 5100$ stars with elemental abundances from APOGEE and asteroseismic masses from {\it Kepler}, we test theoretical stellar models that predict this mixing, then apply these models to derive birth C, N, and O abundances for these stars. Our models with standard mixing can reproduce the observed trends to within plausible uncertainties in the birth abundances. Some models with ''extra'' mixing processes fail, predicting trends with surface gravity or evolutionary state that are not observed. Applying mixing corrections to the APOGEE abundances removes the observed age-dependence of log(N/O) and log(C/N), but it leaves trends of log(N/O) and log(C/N) with metallicity, as expected based on nucleosynthesis models. The stellar N/O trend agrees well with Dopita et al.'s calibration of gas phase log(N/O) with metallicity, and with gas phase trends in the MaNGA integral field survey of nearby galaxies. We also find a substantial separation in birth [N/Mg] ratios between high-[$\alpha$/Fe] (''thick disc'') stars and low-[$\alpha$/Fe] (''thin disc'') stars. We find a smaller but still clear separation for [C/Mg]. The trends of birth C and N abundances with [Fe/H] and [$\alpha$/Fe] could affect spectroscopic age estimates for red giants that rely on the observed C/N ratio as a diagnostic of stellar mass.


title: Stability estimates for the complex Monge-Amp\`ere and Hessian equations

abstract: A new proof for stability estimates for the complex Monge-Amp\`ere and Hessian equations is given, which does not require pluripotential theory. A major advantage is that the resulting stability estimates are then uniform under general degenerations of the background metric in the case of the Monge-Amp\`ere equation, and under degenerations to a big class in the case of Hessian equations.


title: Conformalons and Trans-Planckian problem

abstract: In any conformally invariant gravitational theory, the space of exact solutions is greatly enlarged. The Weyl's conformal invariance can then be spontaneously broken to spherically symmetric vacuum solutions that exclude the spacetime region inside the black hole's event horizon from our Universe. We baptize these solutions ''conformalons''. It turns out that for all such spacetimes nothing can reach the Schwarzschild event horizon in a finite amount of proper time for conformally coupled ``massive'' particles, or finite values of the affine parameter for massless particles. Therefore, for such vacuum solutions the event horizon is an asymptotic region of the Universe. As a general feature, all conformalons show a gravitational blueshift instead of a gravitational redshift at the unattainable event horizon, hence avoiding the Trans-Planckian problem in the Hawking evaporation process. The latter happens as usual near the event horizon, but now the annihilation process between the matter and Hawking's negative energy particles takes place outside of the event horizon. Indeed, in these solutions the gravitational collapse consists of matter that falls down forever towards the horizon without ever reaching it. According to a previous work that has been faithfully adapted to the conformalons' scenario, the information is not lost in the whole process of singularity-free collapse and evaporation, as evident from the Penrose diagram.


title: A Graphical Representation of Membrane Filtration

abstract: We analyze the performance of membrane filters represented by pore networks using two criteria: 1) total volumetric throughput of filtrate over the filter lifetime and 2) accumulated foulant concentration in the filtrate. We first formulate the governing equations of fluid flow on a general network, and we model transport and adsorption of particles (foulants) within the network by imposing an advection equation with a sink term on each pore (edge) as well as conservation of fluid and foulant volumetric flow rates at each pore junction (network vertex). Such a setup yields a system of partial differential equations on the network. We study the influence of three geometric network parameters on filter performance: 1) average number of neighbors of each vertex; 2) initial total void volume of the pore network; and 3) tortuosity of the network. We find that total volumetric throughput depends more strongly on the initial void volume than on average number of neighbors. Tortuosity, however, turns out to be a universal parameter, leading to almost perfect collapse of all results for a variety of different network architectures. In particular, the accumulated foulant concentration in the filtrate shows an exponential decay as tortuosity increases.


title: Lambda Numbers of Finite $p$-Groups

abstract: An $L(2,1)$-labelling of a finite graph $\Gamma$ is a function that assigns integer values to the vertices $V(\Gamma)$ of $\Gamma$ (colouring of $V(\Gamma)$ by ${\mathbb{Z}}$) so that the absolute difference of two such values is at least $2$ for adjacent vertices and is at least $1$ for vertices which are precisely distance $2$ apart. The lambda number $\lambda(\Gamma)$ of $\Gamma$ measures the least number of integers needed for such a labelling (colouring). A power graph $\Gamma_G$ of a finite group $G$ is a graph with vertex set as the elements of $G$ and two vertices are joined by an edge if and only if one of them is a positive integer power of the other. It is known that $\lambda(\Gamma_G) \geq |G|$ for any finite group. In this paper we show that if $G$ is a finite group of a prime power order, then $\lambda(\Gamma_G) = |G|$ if and only if $G$ is neither cyclic nor a generalized quaternion $2$-group. This settles a partial classification of finite groups achieving the lower bound of lambda number.


title: Mixture Outlier Exposure: Towards Out-of-Distribution Detection in Fine-grained Environments

abstract: Many real-world scenarios in which DNN-based recognition systems are deployed have inherently fine-grained attributes (e.g., bird-species recognition, medical image classification). In addition to achieving reliable accuracy, a critical subtask for these models is to detect Out-of-distribution (OOD) inputs. Given the nature of the deployment environment, one may expect such OOD inputs to also be fine-grained w.r.t. the known classes (e.g., a novel bird species), which are thus extremely difficult to identify. Unfortunately, OOD detection in fine-grained scenarios remains largely underexplored. In this work, we aim to fill this gap by first carefully constructing four large-scale fine-grained test environments, in which existing methods are shown to have difficulties. Particularly, we find that even explicitly incorporating a diverse set of auxiliary outlier data during training does not provide sufficient coverage over the broad region where fine-grained OOD samples locate. We then propose Mixture Outlier Exposure (MixOE), which mixes ID data and training outliers to expand the coverage of different OOD granularities, and trains the model such that the prediction confidence linearly decays as the input transitions from ID to OOD. Extensive experiments and analyses demonstrate the effectiveness of MixOE for building up OOD detector in fine-grained environments. The code is available at https://github.com/zjysteven/MixOE.


title: Foundation of one-particle reduced density matrix functional theory for excited states

abstract: In [Phys. Rev. Lett. 127, 023001 (2021)] a reduced density matrix functional theory (RDMFT) has been proposed for calculating energies of selected eigenstates of interacting many-fermion systems. Here, we develop a solid foundation for this so-called $\boldsymbol{w}$-RDMFT and present the details of various derivations. First, we explain how a generalization of the Ritz variational principle to ensemble states with fixed weights $\boldsymbol{w}$ in combination with the constrained search would lead to a universal functional of the one-particle reduced density matrix. To turn this into a viable functional theory, however, we also need to implement an exact convex relaxation. This general procedure includes Valone's pioneering work on ground state RDMFT as the special case $\boldsymbol{w}=(1,0,\ldots)$. Then, we work out in a comprehensive manner a methodology for deriving a compact description of the functional's domain. This leads to a hierarchy of generalized exclusion principle constraints which we illustrate in great detail. By anticipating their future pivotal role in functional theories and to keep our work self-contained, several required concepts from convex analysis are introduced and discussed.

categories: quant-ph cond-mat.str-el math-ph math.MP


title: Learning to Detect Multi-Modal Grasps for Dexterous Grasping in Dense Clutter

abstract: We propose an approach to multi-modal grasp detection that jointly predicts the probabilities that several types of grasps succeed at a given grasp pose. Given a partial point cloud of a scene, the algorithm proposes a set of feasible grasp candidates, then estimates the probabilities that a grasp of each type would succeed at each candidate pose. Predicting grasp success probabilities directly from point clouds makes our approach agnostic to the number and placement of depth sensors at execution time. We evaluate our system both in simulation and on a real robot with a Robotiq 3-Finger Adaptive Gripper and compare our network against several baselines that perform fewer types of grasps. Our experiments show that a system that explicitly models grasp type achieves an object retrieval rate 8.5% higher in a complex cluttered environment than our highest-performing baseline.


title: Existence and nonexistence results of polyharmonic boundary value problems with supercritical growth

abstract: We establish some existence results of polyharmonic boundary value problems with supercritical growth. Our approach is based on truncation argument as well as $L^{\infty}$-bounds. Also, by virtue of Pucci-serrin's variational identity \cite{PS}, we provide some nonexistence results.


title: Measuring and Improving BERT's Mathematical Abilities by Predicting the Order of Reasoning

abstract: Imagine you are in a supermarket. You have two bananas in your basket and want to buy four apples. How many fruits do you have in total? This seemingly straightforward question can be challenging for data-driven language models, even if trained at scale. However, we would expect such generic language models to possess some mathematical abilities in addition to typical linguistic competence. Towards this goal, we investigate if a commonly used language model, BERT, possesses such mathematical abilities and, if so, to what degree. For that, we fine-tune BERT on a popular dataset for word math problems, AQuA-RAT, and conduct several tests to understand learned representations better. Since we teach models trained on natural language to do formal mathematics, we hypothesize that such models would benefit from training on semi-formal steps that explain how math results are derived. To better accommodate such training, we also propose new pretext tasks for learning mathematical rules. We call them (Neighbor) Reasoning Order Prediction (ROP or NROP). With this new model, we achieve significantly better outcomes than data-driven baselines and even on-par with more tailored models. We also show how to reduce positional bias in such models.


title: Interactive Label Cleaning with Example-based Explanations

abstract: We tackle sequential learning under label noise in applications where a human supervisor can be queried to relabel suspicious examples. Existing approaches are flawed, in that they only relabel incoming examples that look "suspicious" to the model. As a consequence, those mislabeled examples that elude (or don't undergo) this cleaning step end up tainting the training data and the model with no further chance of being cleaned. We propose Cincer, a novel approach that cleans both new and past data by identifying pairs of mutually incompatible examples. Whenever it detects a suspicious example, Cincer identifies a counter-example in the training set that -- according to the model -- is maximally incompatible with the suspicious example, and asks the annotator to relabel either or both examples, resolving this possible inconsistency. The counter-examples are chosen to be maximally incompatible, so to serve as explanations of the model's suspicion, and highly influential, so to convey as much information as possible if relabeled. Cincer achieves this by leveraging an efficient and robust approximation of influence functions based on the Fisher information matrix (FIM). Our extensive empirical evaluation shows that clarifying the reasons behind the model's suspicions by cleaning the counter-examples helps in acquiring substantially better data and models, especially when paired with our FIM approximation.


title: Acoustic Power Management by Swarms of Microscopic Robots

abstract: Microscopic robots in the body could harvest energy from ultrasound to provide on-board control of autonomous behaviors such as measuring and communicating diagnostic information and precisely delivering drugs. This paper evaluates the acoustic power available to micron-size robots that collect energy using pistons. Acoustic attenuation and viscous drag on the pistons are the major limitations on the available power. Frequencies around 100kHz can deliver hundreds of picowatts to a robot in low-attenuation tissue within about 10cm of transducers on the skin, but much less in high-attenuation tissue such as a lung. However, applications of microscopic robots could involve such large numbers that the robots significantly increase attenuation, thereby reducing power for robots deep in the body. This paper describes how robots can collectively manage where and when they harvest energy to mitigate this attenuation so that a swarm of a few hundred billion robots can provide tens of picowatts to each robot, on average.


title: News consumption and social media regulations policy

abstract: Users online tend to consume information adhering to their system of beliefs and to ignore dissenting information. During the COVID-19 pandemic, users get exposed to a massive amount of information about a new topic having a high level of uncertainty. In this paper, we analyze two social media that enforced opposite moderation methods, Twitter and Gab, to assess the interplay between news consumption and content regulation concerning COVID-19. We compare the two platforms on about three million pieces of content analyzing user interaction with respect to news articles. We first describe users' consumption patterns on the two platforms focusing on the political leaning of news outlets. Finally, we characterize the echo chamber effect by modeling the dynamics of users' interaction networks. Our results show that the presence of moderation pursued by Twitter produces a significant reduction of questionable content, with a consequent affiliation towards reliable sources in terms of engagement and comments. Conversely, the lack of clear regulation on Gab results in the tendency of the user to engage with both types of content, showing a slight preference for the questionable ones which may account for a dissing/endorsement behavior. Twitter users show segregation towards reliable content with a uniform narrative. Gab, instead, offers a more heterogeneous structure where users, independently of their leaning, follow people who are slightly polarized towards questionable news.


title: Circuit topology for bottom-up engineering of molecular knots

abstract: The art of tying knots is exploited in nature and occurs in multiple applications ranging from being an essential part of scouting programs to engineering molecular knots. Biomolecular knots, such as knotted proteins, bear various cellular functions and their entanglement is believed to provide them with thermal and kinetic stability. Yet, little is known about the design principles of naturally evolved molecular knots. Intra-chain contacts and chain entanglement contribute to folding of knotted proteins. Circuit topology, a theory that describes intra-chain contacts, was recently generalized to account for chain entanglement. This generalization is unique to circuit topology and not motivated by other theories. In this paper, we systematically analyze the circuit topology approach to a description of linear chain entanglement. We utilize a bottom-up approach, i.e., we express entanglement by a set of 4 fundamental structural units subjected to 3 (or 5) binary topological operations. All knots found in proteins form a well-defined, distinct group which naturally appears if expressed in terms of these basic structural units. Prime knots, which are viewed by knot theory as undecomposable, are also made of these structural units connected in some specific way. In turn, this kind of connection shows the fundamental reason why prime knots cannot be decomposed in the rigorous sense of knot theory. We believe that such a detailed, bottom-up understanding of the structure of molecular knots should be beneficial for molecular engineering.

categories: physics.bio-ph cond-mat.mtrl-sci math-ph math.MP physics.chem-ph


title: Reconciling Rewards with Predictive State Representations

abstract: Predictive state representations (PSRs) are models of controlled non-Markov observation sequences which exhibit the same generative process governing POMDP observations without relying on an underlying latent state. In that respect, a PSR is indistinguishable from the corresponding POMDP. However, PSRs notoriously ignore the notion of rewards, which undermines the general utility of PSR models for control, planning, or reinforcement learning. Therefore, we describe a sufficient and necessary accuracy condition which determines whether a PSR is able to accurately model POMDP rewards, we show that rewards can be approximated even when the accuracy condition is not satisfied, and we find that a non-trivial number of POMDPs taken from a well-known third-party repository do not satisfy the accuracy condition. We propose reward-predictive state representations (R-PSRs), a generalization of PSRs which accurately models both observations and rewards, and develop value iteration for R-PSRs. We show that there is a mismatch between optimal POMDP policies and the optimal PSR policies derived from approximate rewards. On the other hand, optimal R-PSR policies perfectly match optimal POMDP policies, reconfirming R-PSRs as accurate state-less generative models of observations and rewards.


title: Improving Social Welfare While Preserving Autonomy via a Pareto Mediator

abstract: Machine learning algorithms often make decisions on behalf of agents with varied and sometimes conflicting interests. In domains where agents can choose to take their own action or delegate their action to a central mediator, an open question is how mediators should take actions on behalf of delegating agents. The main existing approach uses delegating agents to punish non-delegating agents in an attempt to get all agents to delegate, which tends to be costly for all. We introduce a Pareto Mediator which aims to improve outcomes for delegating agents without making any of them worse off. Our experiments in random normal form games, a restaurant recommendation game, and a reinforcement learning sequential social dilemma show that the Pareto Mediator greatly increases social welfare. Also, even when the Pareto Mediator is based on an incorrect model of agent utility, performance gracefully degrades to the pre-intervention level, due to the individual autonomy preserved by the voluntary mediator.