title: Black Hole Hair Removal For N=4 CHL Models

abstract: Although BMPV black holes in flat space and in Taub-NUT space have identical near-horizon geometries, they have different indices from the microscopic analysis. For K3 compactification of type IIB theory, Sen et al in a series of papers identified that the key to resolving this puzzle is the black hole hair modes: smooth, normalisable, bosonic and fermionic degrees of freedom living outside the horizon. In this paper, we extend their study to N = 4 CHL orbifold models. For these models, the puzzle is more challenging due to the presence of the twisted sectors. We identify hair modes in the untwisted as well as twisted sectors. We show that after removing the contributions of the hair modes from the microscopic partition functions, the 4d and 5d horizon partition functions agree. Special care is taken to present details on the smoothness analysis of hair modes for rotating black holes, thereby filling an essential gap in the literature.


title: Gravitational Constrained Instantons

abstract: We find constrained instantons in Einstein gravity with and without a cosmological constant. These configurations are not saddle points of the Einstein-Hilbert action, yet they contribute to non-perturbative processes in quantum gravity. In some cases we expect that they give the dominant contribution from spacetimes with certain fixed topologies. With negative cosmological constant, these metrics describe wormholes connecting two asymptotic regions. We find many examples of such wormhole metrics and for certain symmetric configurations establish their perturbative stability. We expect that the Euclidean versions of these wormholes encode the energy level statistics of AdS black hole microstates. In the de Sitter and flat space settings we find new homogeneous and isotropic bounce and big bang/crunch cosmologies.


title: Formation of GW190521 from stellar evolution: the impact of the hydrogen-rich envelope, dredge-up and $^{12}$C($\alpha$, $\gamma$)$^{16}$O rate on the pair-instability black hole mass gap

abstract: Pair-instability (PI) is expected to open a gap in the mass spectrum of black holes (BHs) between $\approx{}40-65$ M$_\odot$ and $\approx{}120$ M$_\odot$. The existence of the mass gap is currently being challenged by the detection of GW190521, with a primary component mass of $85^{+21}_{-14}$ M$_{\odot}$. Here, we investigate the main uncertainties on the PI mass gap: the $^{12}$C($\alpha$, $\gamma$)$^{16}$O reaction rate and the H-rich envelope collapse. With the standard $^{12}$C($\alpha$, $\gamma$)$^{16}$O rate, the lower edge of the mass gap can be 70 M$_\odot$ if we allow for the collapse of the residual H-rich envelope at metallicity $Z\leq{}0.0003$. Adopting the uncertainties given by the STARLIB database, for models computed with the $^{12}$C($\alpha$, $\gamma$)$^{16}$O rate $-1\, \sigma$, we find that the PI mass gap ranges between $\approx{}80$ M$_\odot$ and $\approx{}150$ M$_\odot$. Stars with $M_{\rm ZAMS}>110$ M$_\odot$ may experience a deep dredge-up episode during the core helium-burning phase, that extracts matter from the core enriching the envelope. As a consequence of the He-core mass reduction, a star with $M_{\rm ZAMS} =160$ M$_\odot$ may avoid the PI and produce a BH of 150 M$_\odot$. In the $-2\,{}\sigma{}$ case, the PI mass gap ranges from 92 M$_\odot$ to 110 M$_\odot$. Finally, in models computed with $^{12}$C($\alpha$, $\gamma$)$^{16}$O $-3\,{}\sigma{}$, the mass gap is completely removed by the dredge-up effect. The onset of this dredge-up is particularly sensitive to the assumed model for convection and mixing. The combined effect of H-rich envelope collapse and low $^{12}$C($\alpha$, $\gamma$)$^{16}$O rate can lead to the formation of BHs with masses consistent with the primary component of GW190521.


title: Optimal noise estimation from syndrome statistics of quantum codes

abstract: Quantum error correction allows to actively correct errors occurring in a quantum computation when the noise is weak enough. To make this error correction competitive information about the specific noise is required. Traditionally, this information is obtained by benchmarking the device before operation. We address the question of what can be learned from only the measurements done during decoding. Such estimation of noise models was proposed for surface codes, exploiting their special structure, and in the limit of low error rates also for other codes. However, so far it has been unclear under what general conditions noise models can be estimated from the syndrome measurements. In this work, we derive a general condition for identifiability of the error rates. For general stabilizer codes, we prove identifiability under the assumption that the rates are small enough. Without this assumption we prove a result for perfect codes. Finally, we propose a practical estimation method with linear runtime for concatenated codes. We demonstrate that it outperforms other recently proposed methods and that the estimation is optimal in the sense that it reaches the Cram\'{e}r-Rao Bound. Our method paves the way for practical calibration of error corrected quantum devices during operation.


title: Conditional Generative Adversarial Networks to Model Urban Outdoor Air Pollution

abstract: This is a relevant problem because the design of most cities prioritizes the use of motorized vehicles, which has degraded air quality in recent years, having a negative effect on urban health. Modeling, predicting, and forecasting ambient air pollution is an important way to deal with this issue because it would be helpful for decision-makers and urban city planners to understand the phenomena and to take solutions. In general, data-driven methods for modeling, predicting, and forecasting outdoor pollution requires an important amount of data, which may limit their accuracy. In order to deal with such a lack of data, we propose to train models able to generate synthetic nitrogen dioxide daily time series according to a given classification that will allow an unlimited generation of realistic data. The main experimental results indicate that the proposed approach is able to generate accurate and diverse pollution daily time series, while requiring reduced computational time.


title: Creating a galaxy lacking dark matter in a dark matter dominated universe

abstract: We use hydrodynamical cosmological simulations to show that it is possible to create, via tidal interactions, galaxies lacking dark matter in a dark matter dominated universe. We select dwarf galaxies from the NIHAO project, obtained in the standard Cold Dark Matter model and use them as initial conditions for simulations of satellite-central interactions. After just one pericentric passage on an orbit with a strong radial component, NIHAO dwarf galaxies can lose up to 80 per~cent of their dark matter content, but, most interestingly, their central ($\approx 8$~kpc) dark matter to stellar ratio changes from a value of ${\sim}25$, as expected from numerical simulations and abundance matching techniques, to roughly unity as reported for NGC1052-DF2 and NGC1054-DF4. The stellar velocity dispersion drops from ${\sim}30$ ${\rm km\,s^{-1}}$ before infall to values as low as $6\pm 2$~ ${\rm km\,s^{-1}}$. These, and the half light radius around 3 kpc, are in good agreement with observations from van Dokkum and collaborators. Our study shows that it is possible to create a galaxy "without" dark matter starting from typical dwarf galaxies formed in a dark matter dominated universe, provided they live in a dense environment.


title: MedFilter: Improving Extraction of Task-relevant Utterances from Doctor-Patient Conversations through Integration of Discourse Structure and Ontological Knowledge

abstract: Information extraction from conversational data is particularly challenging because the task-centric nature of conversation allows for effective communication of implicit information by humans, but is challenging for machines. The challenges may differ between utterances depending on the role of the speaker within the conversation, especially when relevant expertise is distributed asymmetrically across roles. Further, the challenges may also increase over the conversation as more shared context is built up through information communicated implicitly earlier in the dialogue. In this paper, we propose the novel modeling approach MedFilter, which addresses these insights in order to increase performance at identifying and categorizing task-relevant utterances, and in so doing, positively impacts performance at a downstream information extraction task. We evaluate this approach on a corpus of nearly 7,000 doctor-patient conversations where MedFilter is used to identify medically relevant contributions to the discussion (achieving a 10% improvement over SOTA baselines in terms of area under the PR curve). Identifying task-relevant utterances benefits downstream medical processing, achieving improvements of 15%, 105%, and 23% respectively for the extraction of symptoms, medications, and complaints.


title: A Framework for Causal Discovery in non-intervenable systems

abstract: Many frameworks exist to infer cause and effect relations in complex nonlinear systems but a complete theory is lacking. A new framework is presented that is fully nonlinear, provides a complete information theoretic disentanglement of causal processes, allows for nonlinear interactions between causes, identifies the causal strength of missing or unknown processes, and can analyze systems that cannot be represented on Directed Acyclic Graphs. The basic building blocks are information theoretic measures such as (conditional) mutual information and a new concept called certainty that monotonically increases with the information available about the target process. The framework is presented in detail and compared with other existing frameworks, and the treatment of confounders is discussed. While there are systems with structures that the framework cannot disentangle, it is argued that any causal framework that is based on integrated quantities will miss out potentially important information of the underlying probability density functions. The framework is tested on several highly simplified stochastic processes to demonstrate how blocking and gateways are handled, and on the chaotic Lorentz 1963 system. We show that the framework provides information on the local dynamics, but also reveals information on the larger scale structure of the underlying attractor. Furthermore, by applying it to real observations related to the El-Nino-Southern-Oscillation system we demonstrate its power and advantage over other methodologies.


title: The first ALMA survey of protoplanetary discs at 3 mm: demographics of grain growth in the Lupus region

abstract: We present the first ALMA survey of protoplanetary discs at 3 mm, targeting 36 young stellar objects in the Lupus star-forming region with deep observations (sensitivity 20-50 microJy/beam) at ~0.35" resolution (~50 au). Building on previous ALMA surveys at 0.89 and 1.3 mm that observed the complete sample of Class II discs in Lupus at a comparable resolution, we aim to assess the level of grain growth in the relatively young Lupus region. We measure 3 mm integrated fluxes, from which we derive disc-averaged 1-3 mm spectral indices. We find that the mean spectral index of the observed Lupus discs is $\alpha_\mathrm{1-3 mm}=2.23\pm0.06$, in all cases $\alpha_\mathrm{1-3 mm}<3.0$, with a tendency for larger spectral indices in the brightest discs and in transition discs. Furthermore, we find that the distribution of spectral indices in Lupus discs is statistically indistinguishable from that of the Taurus and Ophiuchus star-forming regions. Assuming the emission is optically thin, the low values $\alpha_\mathrm{1-3 mm}\leq 2.5$ measured for most discs can be interpreted with the presence of grains larger than 1 mm. The observations of the faint discs in the sample can be explained without invoking the presence of large grains, namely through a mixture of optically thin and optically thick emission from small grains. However, the bright (and typically large) discs do inescapably require the presence of millimeter-sized grains in order to have realistic masses. Based on a disc mass argument, our results challenge previous claims that the presence of optically thick sub-structures may be a universal explanation for the empirical millimeter size-luminosity correlation observed at 0.89 mm.


title: Multi-wavelength continuum sizes of protoplanetary discs: scaling relations and implications for grain growth and radial drift

abstract: We analyse spatially resolved ALMA observations at 0.9, 1.3, and 3.1 mm for the 26 brightest protoplanetary discs in the Lupus star-forming region. We characterise the discs multi-wavelength brightness profiles by fitting the interferometric visibilities in a homogeneous way, obtaining effective disc sizes at the three wavelengths, spectral index profiles and optical depth estimates. We report three fundamental discoveries: first, the millimeter continuum size - luminosity relation already observed at 0.9 mm is also present at 1.3 mm with an identical slope, and at 3.1 mm with a steeper slope, confirming that emission at longer wavelengths becomes increasingly optically thin. Second, when observed at 3.1 mm the discs appear to be only 9% smaller than when observed at 0.9 mm, in tension with models of dust evolution which predict a starker difference. Third, by forward modelling the sample of measurements with a simple parametric disc model, we find that the presence of large grains ($a_\mathrm{max}>1 $mm) throughout the discs is the most favoured explanation for all discs as it reproduces simultaneously their spectral indices, optical depth, luminosity, and radial extent in the 0.9-1.3 mm wavelength range. We also find that the observations can be alternatively interpreted with the discs being dominated by optically thick, unresolved, substructures made of mm-sized grains with a high scattering albedo.


title: An ALMA survey of the S2CLS UDS field: Optically invisible submillimetre galaxies

abstract: We analyse a robust sample of 30 near-infrared-faint (K>25.3, 5 sigma) submillimetre galaxies selected across a 0.96 deg^2 field, to investigate their properties and the cause of their lack of detectable optical/near-infrared emission. Our analysis exploits precise identifications based on ALMA 870um continuum imaging, combined with the very deep near-infrared imaging from the UKIDSS-UDS survey. We estimate that K>25.3 submillimetre galaxies represent 15+/-2 per cent of the total population brighter than S870=3.6mJy, with an expected surface density of ~450/deg^2 above S870>1mJy. As such they pose a source of contamination in surveys for both high-redshift "quiescent" galaxies and very-high-redshift Lyman-break galaxies. We show that these K-faint submillimetre galaxies are simply the tail of the broader submillimetre population, with comparable dust and stellar masses to K<25.3 mag submillimetre galaxies, but lying at significantly higher redshifts (z=3.44+/-0.06 versus z=2.36+/-0.11) and having higher dust attenuation (Av=5.2+/-0.3 versus Av=2.9+/-0.1). We investigate the origin of the strong dust attenuation and find indications that these K-faint galaxies have smaller dust continuum sizes than the K<25.3 galaxies, as measured by ALMA, which suggests their high attenuation is related to their compact sizes. We find a correlation of dust attenuation with star-formation rate surface density (Sigma_SFR), with the K-faint submillimetre galaxies representing the higher-Sigma_SFR and highest-Av galaxies. The concentrated, intense star-formation activity in these systems is likely to be associated with the formation of spheroids in compact galaxies at high redshifts, but as a result of their high obscuration these are completely missed in UV, optical and even near-infrared surveys.


title: A note on Fourier restriction and nested Polynomial Wolff axioms

abstract: This note records an asymptotic improvement on the known $L^p$ range for the Fourier restriction conjecture in high dimensions. This is obtained by combining Guth's polynomial partitioning method with recent geometric results regarding intersections of tubes with nested families of varieties.


title: Forecasting COVID-19 daily cases using phone call data

abstract: The need to forecast COVID-19 related variables continues to be pressing as the epidemic unfolds. Different efforts have been made, with compartmental models in epidemiology and statistical models such as AutoRegressive Integrated Moving Average (ARIMA), Exponential Smoothing (ETS) or computing intelligence models. These efforts have proved useful in some instances by allowing decision makers to distinguish different scenarios during the emergency, but their accuracy has been disappointing, forecasts ignore uncertainties and less attention is given to local areas. In this study, we propose a simple Multiple Linear Regression model, optimised to use call data to forecast the number of daily confirmed cases. Moreover, we produce a probabilistic forecast that allows decision makers to better deal with risk. Our proposed approach outperforms ARIMA, ETS and a regression model without call data, evaluated by three point forecast error metrics, one prediction interval and two probabilistic forecast accuracy measures. The simplicity, interpretability and reliability of the model, obtained in a careful forecasting exercise, is a meaningful contribution to decision makers at local level who acutely need to organise resources in already strained health services. We hope that this model would serve as a building block of other forecasting efforts that on the one hand would help front-line personal and decision makers at local level, and on the other would facilitate the communication with other modelling efforts being made at the national level to improve the way we tackle this pandemic and other similar future challenges.


title: Classification of interacting Floquet phases with $U(1)$ symmetry in two dimensions

abstract: We derive a complete classification of Floquet phases of interacting bosons and fermions with $U(1)$ symmetry in two spatial dimensions. According to our classification, there is a one-to-one correspondence between these Floquet phases and rational functions $\pi(z) = a(z)/b(z)$ where $a(z)$ and $b(z)$ are polynomials obeying certain conditions and $z$ is a formal parameter. The physical meaning of $\pi(z)$ involves the stroboscopic edge dynamics of the corresponding Floquet system: in the case of bosonic systems, $\pi(z) = \frac{p}{q} \cdot \tilde{\pi}(z)$ where $\frac{p}{q}$ is a rational number which characterizes the flow of quantum information at the edge during each driving period, and $\tilde{\pi}(z)$ is a rational function which characterizes the flow of $U(1)$ charge at the edge. A similar decomposition exists in the fermionic case. We also show that $\tilde{\pi}(z)$ is directly related to the time-averaged $U(1)$ current that flows in a particular geometry. This $U(1)$ current is a generalization of the quantized current and quantized magnetization density found in previous studies of non-interacting fermionic Floquet phases.


title: Fracton phases via exotic higher-form symmetry-breaking

abstract: We study p-string condensation mechanisms for fracton phases from the viewpoint of higher-form symmetry, focusing on the examples of the X-cube model and the rank-two symmetric-tensor U(1) scalar charge theory. This work is motivated by questions of the relationship between fracton phases and continuum quantum field theories, and also provides general principles to describe p-string condensation independent of specific lattice model constructions. We give a perspective on higher-form symmetry in lattice models in terms of cellular homology. Applying this perspective to the coupled-layer construction of the X-cube model, we identify a foliated 1-form symmetry that is broken in the X-cube phase, but preserved in the phase of decoupled toric code layers. Similar considerations for the scalar charge theory lead to a framed 1-form symmetry. These symmetries are distinct from standard 1-form symmetries that arise, for instance, in relativistic quantum field theory. We also give a general discussion on interpreting p-string condensation, and related constructions involving gauging of symmetry, in terms of higher-form symmetry.


title: Temporal Difference Uncertainties as a Signal for Exploration

abstract: An effective approach to exploration in reinforcement learning is to rely on an agent's uncertainty over the optimal policy, which can yield near-optimal exploration strategies in tabular settings. However, in non-tabular settings that involve function approximators, obtaining accurate uncertainty estimates is almost as challenging a problem. In this paper, we highlight that value estimates are easily biased and temporally inconsistent. In light of this, we propose a novel method for estimating uncertainty over the value function that relies on inducing a distribution over temporal difference errors. This exploration signal controls for state-action transitions so as to isolate uncertainty in value that is due to uncertainty over the agent's parameters. Because our measure of uncertainty conditions on state-action transitions, we cannot act on this measure directly. Instead, we incorporate it as an intrinsic reward and treat exploration as a separate learning problem, induced by the agent's temporal difference uncertainties. We introduce a distinct exploration policy that learns to collect data with high estimated uncertainty, which gives rise to a curriculum that smoothly changes throughout learning and vanishes in the limit of perfect value estimates. We evaluate our method on hard exploration tasks, including Deep Sea and Atari 2600 environments and find that our proposed form of exploration facilitates both diverse and deep exploration.


title: An Ensemble Approach for Automatic Structuring of Radiology Reports

abstract: Automatic structuring of electronic medical records is of high demand for clinical workflow solutions to facilitate extraction, storage, and querying of patient care information. However, developing a scalable solution is extremely challenging, specifically for radiology reports, as most healthcare institutes use either no template or department/institute specific templates. Moreover, radiologists' reporting style varies from one to another as sentences are telegraphic and do not follow general English grammar rules. We present an ensemble method that consolidates the predictions of three models, capturing various attributes of textual information for automatic labeling of sentences with section labels. These three models are: 1) Focus Sentence model, capturing context of the target sentence; 2) Surrounding Context model, capturing the neighboring context of the target sentence; and finally, 3) Formatting/Layout model, aimed at learning report formatting cues. We utilize Bi-directional LSTMs, followed by sentence encoders, to acquire the context. Furthermore, we define several features that incorporate the structure of reports. We compare our proposed approach against multiple baselines and state-of-the-art approaches on a proprietary dataset as well as 100 manually annotated radiology notes from the MIMIC-III dataset, which we are making publicly available. Our proposed approach significantly outperforms other approaches by achieving 97.1% accuracy.


title: Forced Imbibition in Stratified Porous Media

abstract: Imbibition plays a central role in diverse energy, environmental, and industrial processes. In many cases, the medium has multiple parallel strata of different permeabilities; however, how this stratification impacts imbibition is poorly understood. We address this gap in knowledge by directly visualizing forced imbibition in three-dimensional (3D) porous media with two parallel strata. We find that imbibition is spatially heterogeneous: for small capillary number Ca, the wetting fluid preferentially invades the fine stratum, while for Ca above a threshold value, the fluid instead preferentially invades the coarse stratum. This threshold value depends on the medium geometry, the fluid properties, and the presence of residual wetting films in the pore space. These findings are well described by a linear stability analysis that incorporates crossflow between the strata. Thus, our work provides quantitative guidelines for predicting and controlling flow in stratified porous media.

categories: physics.flu-dyn cond-mat.dis-nn cond-mat.soft physics.geo-ph


title: Extending the view of ArH+ chemistry in diffuse clouds

abstract: One of the surprises of the Herschel mission was the detection of ArH+ towards the Crab Nebula in emission and in absorption towards strong Galactic background sources. Although these detections were limited to the first quadrant of the Galaxy, the existing data suggest that ArH+ ubiquitously and exclusively probes the diffuse atomic regions of the ISM. In this study, we extend the coverage of ArH+ to other parts of the Galaxy with new observations of its J = 1-0 transition along seven Galactic sight lines towards bright sub-mm continuum sources. We aim to benchmark its efficiency as a tracer of purely atomic gas by evaluating its correlation (or lack there of) with other well-known atomic and molecular gas tracers. The observations of ArH+ near 617.5 GHz were made feasible with the new, sensitive SEPIA660 receiver on the APEX 12 m telescope. The two sidebands of this receiver allowed us to observe p-H2O+ transitions of at 607.227 GHz simultaneously with the ArH+ line. By analysing the steady state chemistry of OH+ and o-H2O+, we derive on average a cosmic-ray ionisation rate (CRIR), of 2.3e-16 s^-1 towards the sight lines studied in this work. Using the derived values of the CRIR and the observed ArH+ abundances we constrain the molecular fraction of the gas traced by ArH+ to lie below 2e-2 with a median value of 8.8e-4. Combined, our observations of ArH+, OH+, H2O+, and CH probe different regimes of the ISM, from diffuse atomic to diffuse and translucent molecular clouds. Over Galactic scales, we see that the distribution of N(ArH+) is associated with that of N(H), particularly in the inner Galaxy with potentially even contributions from the warm neutral medium phase of atomic gas at larger galactocentric distances. We derive an average o/p-ratio for H2O+ of 2.1, which corresponds to a nuclear spin temperature of 41 K, consistent with the typical gas temperatures of diffuse clouds.


title: Is there enough star formation in simulated protoclusters?

abstract: As progenitors of the most massive objects, protoclusters are key to tracing the evolution and star-formation history of the Universe, and are responsible for ${\gtrsim}\,20$ per cent of the cosmic star formation at $z\,{>}\,2$. Using a combination of state-of-the-art hydrodynamical simulations and empirical models, we show that current galaxy-formation models do not produce enough star formation in protoclusters to match observations. We find that the star-formation rates (SFRs) predicted from the models are an order of magnitude lower than what is seen in observations, despite the relatively good agreement found for their mass-accretion histories, specifically that they lie on an evolutionary path to become Coma-like clusters at $z\,{\simeq}\, 0$. Using a well-studied protocluster core at $z\,{=}\,4.3$ as a test case, we find that star-formation efficiency of protocluster galaxies is higher than predicted by the models. We show that a large part of the discrepancy can be attributed to a dependence of SFR on the numerical resolution of the simulations, with a roughly factor of 3 drop in SFR when the spatial resolution decreases by a factor of 4. We also present predictions up to $z\,{\simeq}\,7$. Compared to lower redshifts, we find that centrals (the most massive member galaxies) are more distinct from the other galaxies, while protocluster galaxies are less distinct from field galaxies. All these results suggest that, as a rare and extreme population at high-$z$, protoclusters can help constrain galaxy formation models tuned to match the average population at $z\,{\simeq}\,0$.


title: Effects of Naturalistic Variation in Goal-Oriented Dialog

abstract: Existing benchmarks used to evaluate the performance of end-to-end neural dialog systems lack a key component: natural variation present in human conversations. Most datasets are constructed through crowdsourcing, where the crowd workers follow a fixed template of instructions while enacting the role of a user/agent. This results in straight-forward, somewhat routine, and mostly trouble-free conversations, as crowd workers do not think to represent the full range of actions that occur naturally with real users. In this work, we investigate the impact of naturalistic variation on two goal-oriented datasets: bAbI dialog task and Stanford Multi-Domain Dataset (SMD). We also propose new and more effective testbeds for both datasets, by introducing naturalistic variation by the user. We observe that there is a significant drop in performance (more than 60% in Ent. F1 on SMD and 85% in per-dialog accuracy on bAbI task) of recent state-of-the-art end-to-end neural methods such as BossNet and GLMP on both datasets.


title: Impact of neutrino pair-production rates in Core-Collapse Supernovae

abstract: In this paper, we present a careful study on the impact of neutrino pair-production on core-collapse supernovae via spherically-symmetric, general-relativistic simulations of two different massive star progenitors with energy-dependent neutrino transport. We explore the impact and consequences of both the underlying microphysics and the implementation in the radiation transport algorithms on the supernova evolution, neutrino signal properties, and the explosion dynamics. We consider the two dominant neutrino pair-production processes found in supernovae, electron-positron annihilation as well as nucleon-nucleon bremsstrahlung in combination with both a simplified and a complete treatment of the processes in the radiation transport algorithms. We find that the use of the simplified prescription quantitatively impacts the neutrino signal at the 10\% level and potentially the supernova dynamics, as we show for the case of a 9.6M$_\odot$ progenitor. We also show that the choice of nucleon-nucleon bremsstrahlung interaction can also have a quantitative impact on the neutrino signal. A self-consistent treatment with state-of-the-art microphysics is suggested for precision simulations of core collapse, however the simplified treatment explored here is both computationally less demanding and results in a qualitatively similar evolution.


title: Wind-Induced Changes to Surface Gravity Wave Shape in Shallow Water

abstract: Wave shape (e.g. wave skewness and asymmetry) impacts sediment transport, remote sensing and ship safety. Previous work showed that wind affects wave shape in intermediate and deep water. Here, we investigate the effect of wind on wave shape in shallow water through a wind-induced surface pressure for different wind speeds and directions to provide the first theoretical description of wind-induced shape changes. A multiple-scale analysis of long waves propagating over a shallow, flat bottom and forced by a Jeffreys-type surface pressure yields a forward or backward Korteweg-de Vries (KdV)-Burgers equation for the wave profile, depending on the wind direction. The evolution of a symmetric, solitary-wave initial condition is calculated numerically. The resulting wave grows (decays) for onshore (offshore) wind and becomes asymmetric, with the rear face showing the largest shape changes. The wave profile's deviation from a reference solitary wave is primarily a bound wave and trailing, dispersive, decaying tail. The onshore wind increases the wave's energy and skewness with time while decreasing the wave's asymmetry, with the opposite holding for offshore wind. The corresponding wind speeds are shown to be physically realistic, and the shape changes are explained as slow growth followed by rapid evolution according to the unforced KdV equation.


title: Projection Mapping Implementation: Enabling Direct Externalization of Perception Results and Action Intent to Improve Robot Explainability

abstract: Existing research on non-verbal cues, e.g., eye gaze or arm movement, may not accurately present a robot's internal states such as perception results and action intent. Projecting the states directly onto a robot's operating environment has the advantages of being direct, accurate, and more salient, eliminating mental inference about the robot's intention. However, there is a lack of tools for projection mapping in robotics, compared to established motion planning libraries (e.g., MoveIt). In this paper, we detail the implementation of projection mapping to enable researchers and practitioners to push the boundaries for better interaction between robots and humans. We also provide practical documentation and code for a sample manipulation projection mapping on GitHub: https://github.com/uml-robotics/projection_mapping.


title: Subspace Embeddings Under Nonlinear Transformations

abstract: We consider low-distortion embeddings for subspaces under \emph{entrywise nonlinear transformations}. In particular we seek embeddings that preserve the norm of all vectors in a space $S = \{y: y = f(x)\text{ for }x \in Z\}$, where $Z$ is a $k$-dimensional subspace of $\mathbb{R}^n$ and $f(x)$ is a nonlinear activation function applied entrywise to $x$. When $f$ is the identity, and so $S$ is just a $k$-dimensional subspace, it is known that, with high probability, a random embedding into $O(k/\epsilon^2)$ dimensions preserves the norm of all $y \in S$ up to $(1\pm \epsilon)$ relative error. Such embeddings are known as \emph{subspace embeddings}, and have found widespread use in compressed sensing and approximation algorithms. We give the first low-distortion embeddings for a wide class of nonlinear functions $f$. In particular, we give additive $\epsilon$ error embeddings into $O(\frac{k\log (n/\epsilon)}{\epsilon^2})$ dimensions for a class of nonlinearities that includes the popular Sigmoid SoftPlus, and Gaussian functions. We strengthen this result to give relative error embeddings under some further restrictions, which are satisfied e.g., by the Tanh, SoftSign, Exponential Linear Unit, and many other `soft' step functions and rectifying units. Understanding embeddings for subspaces under nonlinear transformations is a key step towards extending random sketching and compressing sensing techniques for linear problems to nonlinear ones. We discuss example applications of our results to improved bounds for compressed sensing via generative neural networks.


title: Coulomb blockade and quantum confinement in field electron emission from heterostructured nanotips

abstract: A new field electron emission (FE) mechanism, which includes Coulomb blockade and quantum confinement effects, is revealed for heterostructured emitters composed of quantum dots and nanowires self-assembled at diamond nanotips. The total energy distributions of the emitted electrons show multiple peaks attributed to the discrete electronic states of the quantum-confined emitter with the corresponding energy levels oscillating as a function of the applied voltage due to the Coulomb blockade. The FE current-voltage characteristics exhibit a modified Coulomb staircase with additional steps becoming more pronounced with increasing voltage. The experimentally observed behavior is consistent with numerical simulations based on the model of Coulomb blockade in quantum dots in combination with the theory of FE from sharp tips.


title: COSTA: the COld STream finder Algorithm. Searching for kinematical substructures in the phase space of discrete tracers

abstract: Context: We present COSTA (COld STream finder Algorithm), a novel algorithm to search for cold kinematical substructures in the phase space of planetary nebulae (PNe) and globular clusters (GCs) in the halo of massive galaxies and intracluster regions. Aims: COSTA aims at detecting small sized, low velocity dispersion streams, as the ones produced in recent interactions of dwarf galaxies with the halo of more massive galaxies, including the ones sitting in the central region of rich galaxy clusters. Methods: COSTA is based on a deep friend-of-friend procedure that isolates groups of N particles with small velocity dispersion (between 10 kms and $\sim$ 100 kms), using an iterative (n) sigma-clipping over a defined number of (k) neighbor particles. The algorithm has three parameters (k-n-N), plus a velocity dispersion cut-off, which defines the "coldness" of the stream, that are set using Montecarlo realizations of the sample under exam. Results: In this paper, we show the ability of COSTA to recover simulated streams on mock data-sets of discrete kinematical tracers with different sizes and measurement errors, from publicly available hydrodynamical simulations. We also show the best algorithm set-up for a realistic case of stream finding in the core of the Fornax cluster, for future applications of COSTA to real populations of PNe and GCs. Conclusions: COSTA can be generalized to all problems of finding small substructures in the phase space of a limited sample of discrete tracers, provided that the algorithm is trained on realistic mock observations reproducing the specific dataset under exam.


title: Comments on chiral algebras and $\Omega$-deformations

abstract: Every six-dimensional $\mathcal{N}=(2,0)$ SCFT on $\mathbf{R}^6$ contains a set of protected operators whose correlation functions are controlled by a two-dimensional chiral algebra. We provide an alternative construction of this chiral algebra by performing an $\Omega$-deformation~of a topological-holomorphic twist of the $\mathcal{N}=(2,0)$ theory on $\mathbf{R}^6$ and restricting to the cohomology of a specific supercharge. In addition, we show that the central charge of the chiral algebra can be obtained by performing equivariant integration of the anomaly polynomial of the six-dimensional theory. Furthermore, we generalize this construction to include orbifolds of the $\mathbf{R}^4$ transverse to the chiral algebra plane.


title: Zeta functions of $\mathbb{F}_p$-Lie algebras and finite $p$-groups

abstract: We study zeta functions enumerating subalgebras or ideals of Lie algebras over finite field of prime order $\mathbb{F}_p$. We first develop a general blueprint method for computing zeta functions of $\mathbb{F}_p$-Lie algebras, and demonstrate its practical applications in detail to obtain explicit formulas for various interesting new examples that are not covered in any known literature yet. For nilpotent cases this also provides zeta functions counting subgroups and normal subgroups of finite $p$-groups of exponent $p$ for almost all primes via the Lazard correspondence. We investigate their connections to the study of finite $p$-groups, and discuss what can be deduced from these finite Dirichlet polynomials.


title: The AARTFAAC Cosmic Explorer: observations of the 21-cm power spectrum in the EDGES absorption trough

abstract: The 21-cm absorption feature reported by the EDGES collaboration is several times stronger than that predicted by traditional astrophysical models. If genuine, a deeper absorption may lead to stronger fluctuations on the 21-cm signal on degree scales (up to 1~Kelvin in rms), allowing these fluctuations to be detectable in nearly 50~times shorter integration times compared to previous predictions. We commenced the "AARTFAAC Cosmic Explorer" (ACE) program, that employs the AARTFAAC wide-field imager, to measure or set limits on the power spectrum of the 21-cm fluctuations in the redshift range $z = 17.9-18.6$ ($\Delta\nu = 72.36-75.09$~MHz) corresponding to the deep part of the EDGES absorption feature. Here, we present first results from two LST bins: 23.5-23.75h and 23.5-23.75h, each with 2~h of data, recorded in `semi drift-scan' mode. We demonstrate the application of the new ACE data-processing pipeline (adapted from the LOFAR-EoR pipeline) on the AARTFAAC data. We observe that noise estimates from the channel and time-differenced Stokes~$V$ visibilities agree with each other. After 2~h of integration and subtraction of bright foregrounds, we obtain $2\sigma$ upper limits on the 21-cm power spectrum of $\Delta_{21}^2 < (8139~\textrm{mK})^2$ and $\Delta_{21}^2 < (8549~\textrm{mK})^2$ at $k = 0.144~h\,\textrm{cMpc}^{-1}$ for the two LST bins. Incoherently averaging the noise bias-corrected power spectra for the two LST bins yields an upper limit of $\Delta_{21}^2 < (7388~\textrm{mK})^2$ at $k = 0.144~h\,\textrm{cMpc}^{-1}$. These are the deepest upper limits thus far at these redshifts.


title: Smoother Network Tuning and Interpolation for Continuous-level Image Processing

abstract: In Convolutional Neural Network (CNN) based image processing, most studies propose networks that are optimized to single-level (or single-objective); thus, they underperform on other levels and must be retrained for delivery of optimal performance. Using multiple models to cover multiple levels involves very high computational costs. To solve these problems, recent approaches train networks on two different levels and propose their own interpolation methods to enable arbitrary intermediate levels. However, many of them fail to generalize or have certain side effects in practical usage. In this paper, we define these frameworks as network tuning and interpolation and propose a novel module for continuous-level learning, called Filter Transition Network (FTN). This module is a structurally smoother module than existing ones. Therefore, the frameworks with FTN generalize well across various tasks and networks and cause fewer undesirable side effects. For stable learning of FTN, we additionally propose a method to initialize non-linear neural network layers with identity mappings. Extensive results for various image processing tasks indicate that the performance of FTN is comparable in multiple continuous levels, and is significantly smoother and lighter than that of other frameworks.


title: Bounds for the Lonely Runner Problem via Linear Programming

abstract: In this note we develop a linear programming framework to produce upper and lower bounds for the lonely runner problem.


title: When Do Stalled Stars Resume Spinning Down? Advancing Gyrochronology with Ruprecht 147

abstract: Recent measurements of rotation periods ($P_\text{rot}$) in the benchmark open clusters Praesepe (670 Myr), NGC 6811 (1 Gyr), and NGC 752 (1.4 Gyr) demonstrate that, after converging onto a tight sequence of slowly rotating stars in mass$-$period space, stars temporarily stop spinning down. These data also show that the duration of this epoch of stalled spin-down increases toward lower masses. To determine when stalled stars resume spinning down, we use data from the $K2$ mission and the Palomar Transient Factory to measure $P_\text{rot}$ for 58 dwarf members of the 2.7-Gyr-old cluster Ruprecht 147, 39 of which satisfy our criteria designed to remove short-period or near-equal-mass binaries. Combined with the $Kepler$ $P_\text{rot}$ data for the approximately coeval cluster NGC 6819 (30 stars with $M_\star > 0.85$ M$_\odot$), our new measurements more than double the number of $\approx$2.5 Gyr benchmark rotators and extend this sample down to $\approx$0.55 M$_\odot$. The slowly rotating sequence for this joint sample appears relatively flat (22 $\pm$ 2 days) compared to sequences for younger clusters. This sequence also intersects the $Kepler$ intermediate period gap, demonstrating that this gap was not created by a lull in star formation. We calculate the time at which stars resume spinning down, and find that 0.55 M$_\odot$ stars remain stalled for at least 1.3 Gyr. To accurately age-date low-mass stars in the field, gyrochronology formulae must be modified to account for this stalling timescale. Empirically tuning a core$-$envelope coupling model with open cluster data can account for most of the apparent stalling effect. However, alternative explanations, e.g., a temporary reduction in the magnetic braking torque, cannot yet be ruled out.


title: Single-Pixel Pattern Recognition with Coherent Nonlinear Optics

abstract: We propose and experimentally demonstrate a nonlinear-optics approach to pattern recognition with single-pixel imaging and deep neural network. It employs mode selective image up-conversion to project a raw image onto a set of coherent spatial modes, whereby its signature features are extracted nonlinear-optically. With 40 projection modes, the classification accuracy reaches a high value of 99.49% for the MNIST handwritten digit images, and up to 95.32% even when they are mixed with strong noise. Our experiment harnesses rich coherent processes in nonlinear optics for efficient machine learning, with potential applications in online classification of large size images, fast lidar data analyses, complex pattern recognition, and so on.


title: A Functional Ito-Formula for Dawson-Watanabe Superprocesses

abstract: We derive an Ito-formula for the Dawson-Watanabe superprocess, a well-known class of measure-valued processes, extending the classical Ito-formula with respect to two aspects. Firstly, we extend the state-space of the underlying process $(X(t))_{t\in [0,T]}$ to an infinite-dimensional one - the space of finite measure. Secondly, we extend the formula to functions $F(t,X_t)$ depending on the entire paths $X_t=(X(s\wedge t))_{s \in [0,T]}$ up to times $t$. This later extension is usually called functional Ito-formula. Finally we remark on the application to predictable representation for martingales associated with superprocesses.


title: Short-term prediction of photovoltaic power generation using Gaussian process regression

abstract: Photovoltaic (PV) power is affected by weather conditions, making the power generated from the PV systems uncertain. Solving this problem would help improve the reliability and cost effectiveness of the grid, and could help reduce reliance on fossil fuel plants. The present paper focuses on evaluating predictions of the energy generated by PV systems in the United Kingdom Gaussian process regression (GPR). Gaussian process regression is a Bayesian non-parametric model that can provide predictions along with the uncertainty in the predicted value, which can be very useful in applications with a high degree of uncertainty. The model is evaluated for short-term forecasts of 48 hours against three main factors -- training period, sky area coverage and kernel model selection -- and for very short-term forecasts of four hours against sky area. We also compare very short-term forecasts in terms of cloud coverage within the prediction period and only initial cloud coverage as a predictor.


title: Minimal and Disjoint Negation Sets in Signed Graphs

abstract: A signed graph is a graph with a function that assigns a label of positive or negative to each edge. The sign of a circle is the product of the signs of its edges; a graph is balanced if all of its circles are positive. A set of edges whose negation yields a balanced graph is a negation set. Results: tests to determine whether a negation set is minimal, minimum, or the unique minimum; any two disjoint negation sets must be bipartite; two classes of graphs are shown to have bipartite negation sets (in general, existence is an unsolved problem); I give an algorithm which finds a maximum family of disjoint negation sets that includes a given negation set.


title: Loewner equations and reductions of dispersionless hierarchies

abstract: The equations of Loewner type can be derived in two very different contexts: one of them is complex analysis and the theory of parametric conformal maps and the other one is the theory of integrable systems. In this paper we compare the both approaches. After recalling the derivation of L\"owner equations based on complex analysis we review one- and multi-variable reductions of dispersionless integrable hierarhies (dKP, dBKP, dToda, and dDKP). The one-vaiable reductions are described by solutions of different versions of Loewner equation: chordal (rational) for dKP, quadrant for dBKP, radial (trigonometric) for dToda and elliptic for DKP. We also discuss multi-variable reductions which are given by a system of Loewner equations supplemented by a system of partial differential equations of hydrodynamic type. The solvability of the hydrodynamic type system can be proved by means of the generalized hodograph method.


title: Reasons People Want Explanations After Unrecoverable Pre-Handover Failures

abstract: Most research on human-robot handovers focuses on the development of comfortable and efficient HRI; few have studied handover failures. If a failure occurs in the beginning of the interaction, it prevents the whole handover process and destroys trust. Here we analyze the underlying reasons why people want explanations in a handover scenario where a robot cannot possess the object. Results suggest that participants set expectations on their request and that a robot should provide explanations rather than non-verbal cues after failing. Participants also expect that their handover request can be done by a robot, and, if not, would like to be able to fix the robot or change the request based on the provided explanations.


title: Classification theorem and properties of singular solutions to the Tolman-Oppenheimer-Volkoff equation

abstract: The Tolman-Oppenheimer-Volkoff (TOV) equation admits singular solutions in addition to regular ones. Here, we prove the following theorem. For any equation of state that (i) is obtained from an entropy function, (ii) has positive pressure and (iii) satisfies the dominant energy condition, the TOV equation can be integrated from a boundary inwards to the center. Hence, thermodynamic consistency of the EoS precludes pathological solutions, in which the integration terminates at finite radius (because of horizons, or divergences / zeroes of energy density). At the center, the mass function either vanishes (regular solutions) or it is negative (singular solutions). For singular solutions, the metric at the center is locally isomorphic to negative-mass Schwarzschild spacetime. This means that matter is stabilized because the singularity is strongly repulsive. We show that singular solutions are causally well behaved: they are bounded-acceleration complete, and they are conformal to a globally hyperbolic spacetime with boundary. Finally, we show how to modify unphysical equations of state in order to obtain non-pathological solutions, and we undertake a preliminary investigation of dynamical stability for singular solutions.


title: Solving strongly convex-concave composite saddle point problems with a small dimension of one of the variables

abstract: The article is devoted to the development of algorithmic methods ensuring efficient complexity bounds for strongly convex-concave saddle point problems in the case when one of the groups of variables is high-dimensional, and the other is relatively low-dimensional (up to a hundred). The proposed technique is based on reducing problems of this type to a problem of minimizing a convex (maximizing a concave) functional in one of the variables, for which it is possible to find an approximate gradient at an arbitrary point with the required accuracy using an auxiliary optimization subproblem with another variable. In this case, the ellipsoid method is used for low-dimensional problems (if necessary, with an inexact $\delta$-subgradient), and accelerated gradient methods are used for high-dimensional problems. For the case of a very small dimension of one of the groups of variables (up to 5), an approach based on a new version of the multidimensional analog of the Yu. E. Nesterov's method on the square (multidimensional dichotomy) is proposed with the possibility of using inexact values of the gradient of the objective functional.


title: Early Detection of Myocardial Infarction in Low-Quality Echocardiography

abstract: Myocardial infarction (MI), or commonly known as heart attack, is a life-threatening health problem worldwide from which 32.4 million people suffer each year. Early diagnosis and treatment of MI are crucial to prevent further heart tissue damages or death. The earliest and most reliable sign of ischemia is regional wall motion abnormality (RWMA) of the affected part of the ventricular muscle. Echocardiography can easily, inexpensively, and non-invasively exhibit the RWMA. In this article, we introduce a three-phase approach for early MI detection in low-quality echocardiography: 1) segmentation of the entire left ventricle (LV) wall using a state-of-the-art deep learning model, 2) analysis of the segmented LV wall by feature engineering, and 3) early MI detection. The main contributions of this study are highly accurate segmentation of the LV wall from low-quality echocardiography, pseudo labeling approach for ground-truth formation of the unannotated LV wall, and the first public echocardiographic dataset (HMC-QU)* for MI detection. Furthermore, the outputs of the proposed approach can significantly help cardiologists for a better assessment of the LV wall characteristics. The proposed approach has achieved 95.72% sensitivity and 99.58% specificity for the LV wall segmentation, and 85.97% sensitivity, 74.03% specificity, and 86.85% precision for MI detection on the HMC-QU dataset. *The benchmark HMC-QU dataset is publicly shared at the repository https://www.kaggle.com/aysendegerli/hmcqu-dataset


title: First-order methods for problems with O(1) functional constraints can have almost the same convergence rate as for unconstrained problems

abstract: First-order methods (FOMs) have recently been applied and analyzed for solving problems with complicated functional constraints. Existing works show that FOMs for functional constrained problems have lower-order convergence rates than those for unconstrained problems. In particular, an FOM for a smooth strongly-convex problem can have linear convergence, while it can only converge sublinearly for a constrained problem if the projection onto the constraint set is prohibited. In this paper, we point out that the slower convergence is caused by the large number of functional constraints but not the constraints themselves. When there are only $m=O(1)$ functional constraints, we show that an FOM can have almost the same convergence rate as that for solving an unconstrained problem, even without the projection onto the feasible set. In addition, given an $\varepsilon>0$, we show that a complexity result that is better than a lower bound can be obtained, if there are only $m=o(\varepsilon^{-\frac{1}{2}})$ functional constraints. Our result is surprising but does not contradict to the existing lower complexity bound, because we focus on a specific subclass of problems. Experimental results on quadratically-constrained quadratic programs demonstrate our theory.


title: Ultra-high quality two-dimensional electron systems

abstract: Two-dimensional electrons confined to GaAs quantum wells are hallmark platforms for probing electron-electron interaction. Many key observations have been made in these systems as sample quality improved over the years. Here, we present a breakthrough in sample quality via source-material purification and innovation in GaAs molecular beam epitaxy vacuum chamber design. Our samples display an ultra-high mobility of $44\times10^6$ cm$^2$/Vs at an electron density of $2.0\times10^{11}$ /cm$^2$. These results imply only 1 residual impurity for every $10^{10}$ Ga/As atoms. The impact of such low impurity concentration is manifold. Robust stripe/bubble phases are observed, and several new fractional quantum Hall states emerge. Furthermore, the activation gap of the $\nu=5/2$ state, which is widely believed to be non-Abelian and of potential use for topological quantum computing, reaches $\Delta\simeq820$ mK. We expect that our results will stimulate further research on interaction-driven physics in a two-dimensional setting and significantly advance the field.


title: Spectrum, Scattering Amplitudes, and String Field Theory of 4 Dimensional Twistor String

abstract: The recently introduced anomaly-free twistor string in 4 dimensions is further explored. The spectrum based on the physical states and its Minkowski interpretation are examined. Scattering amplitudes with vertex operators involving gravitons and fermions are computed and are compared with Einstein-Yang-Mills amplitudes. Tree and one-loop scattering amplitudes are shown to have proper unitary factorization properties. Finally a string field theory is proposed.


title: Model-Free Control of Dynamical Systems with Deep Reservoir Computing

abstract: We propose and demonstrate a nonlinear control method that can be applied to unknown, complex systems where the controller is based on a type of artificial neural network known as a reservoir computer. In contrast to many modern neural-network-based control techniques, which are robust to system uncertainties but require a model nonetheless, our technique requires no prior knowledge of the system and is thus model-free. Further, our approach does not require an initial system identification step, resulting in a relatively simple and efficient learning process. Reservoir computers are well-suited to the control problem because they require small training data sets and remarkably low training times. By iteratively training and adding layers of reservoir computers to the controller, a precise and efficient control law is identified quickly. With examples on both numerical and high-speed experimental systems, we demonstrate that our approach is capable of controlling highly complex dynamical systems that display deterministic chaos to nontrivial target trajectories.


title: Genome Compression Against a Reference

abstract: Being able to store and transmit human genome sequences is an important part in genomic research and industrial applications. The complete human genome has 3.1 billion base pairs (haploid), and storing the entire genome naively takes about 3 GB, which is infeasible for large scale usage. However, human genomes are highly redundant. Any given individual's genome would differ from another individual's genome by less than 1%. There are tools like DNAZip, which express a given genome sequence by only noting down the differences between the given sequence and a reference genome sequence. This allows losslessly compressing the given genome to ~ 4 MB in size. In this work, we demonstrate additional improvements on top of the DNAZip library, where we show an additional ~ 11% compression on top of DNAZip's already impressive results. This would allow further savings in disk space and network costs for transmitting human genome sequences.


title: Searching for QCD Instantons at Hadron Colliders

abstract: QCD instantons are arguably the best motivated yet unobserved nonperturbative effects predicted by the Standard Model. A discovery and detailed study of instanton-generated processes at colliders would provide a new window into the phenomenological exploration of QCD and a vastly improved fundamental understanding of its non-perturbative dynamics. Building on the optical theorem, we numerically calculate the total instanton cross-section from the elastic scattering amplitude, also including quantum effects arising from resummed perturbative exchanges between hard gluons in the initial state, thereby improving in accuracy on previous results. Although QCD instanton processes are predicted to be produced with a large scattering cross-section at small centre-of-mass partonic energies, discovering them at hadron colliders is a challenging task that requires dedicated search strategies. We evaluate the sensitivity of high-luminosity LHC runs, as well as low-luminosity LHC and Tevatron runs. We find that LHC low-luminosity runs in particular, which do not suffer from large pileup and trigger thresholds, show a very good sensitivity for discovering QCD instanton-generated processes.


title: Detecting approximate replicate components of a high-dimensional random vector with latent structure

abstract: High-dimensional feature vectors are likely to contain sets of measurements that are approximate replicates of one another. In complex applications, or automated data collection, these feature sets are not known a priori, and need to be determined. This work proposes a class of latent factor models on the observed high-dimensional random vector $X \in \mathbb{R}^p$, for defining, identifying and estimating the index set of its approximately replicate components. The model class is parametrized by a $p \times K$ loading matrix $A$ that contains a hidden sub-matrix whose rows can be partitioned into groups of parallel vectors. Under this model class, a set of approximate replicate components of $X$ corresponds to a set of parallel rows in $A$: these entries of $X$ are, up to scale and additive error, the same linear combination of the $K$ latent factors; the value of $K$ is itself unknown. The problem of finding approximate replicates in $X$ reduces to identifying, and estimating, the location of the hidden sub-matrix within $A$, and of the partition of its row index set $H$. Both $H$ and its partiton can be fully characterized in terms of a new family of criteria based on the correlation matrix of $X$, and their identifiability, as well as that of the unknown latent dimension $K$, are obtained as consequences. The constructive nature of the identifiability arguments enables computationally efficient procedures, with consistency guarantees. When $A$ has the errors-in-variable parametrization, the difficulty of the problem is elevated. The task becomes that of separating out groups of parallel rows that are proportional to canonical basis vectors from other dense parallel rows in $A$. This is met under a scale assumption, via a principled way of selecting the target row indices, guided by the succesive maximization of Schur complements of appropriate covariance matrices.


title: Terrestrial Orbit-Spin Coupling Torque Episodes in Late 2020

abstract: Orbit-spin coupling torques on the Earth in November 2020 are larger than at any other time between 2000 and 2050. This affords an opportunity to observe the terrestrial atmospheric response to the putative torque in near real time.


title: Chiral Lattice Fermions From Staggered Fields

abstract: We describe a proposal for constructing a lattice theory that we argue may be capable of yielding free Weyl fermions in the continuum limit. The model employs reduced staggered fermions and uses site parity dependent Yukawa interactions of Fidkowski-Kitaev type to gap a subset of the lattice fermions without breaking symmetries. The possibility for such symmetric mass generation is tied to the cancellation of certain discrete anomalies arising in the continuum limit. The latter place strong constraints on the number of lattice fermions -- constraints that are satisfied by this model. We present numerical results for the model in two dimensions which support this sc


title: Rigid Body Dynamic Simulation with Line and Surface Contact

abstract: In this paper, we develop a principled method to model line and surface contact with point contact (we call this point, equivalent contact point) that is consistent with physics-based models of surface (line) contact. Assuming that the set of contact points form a convex set, we solve the contact detection and dynamic simulation step simultaneously by formulating the problem as a mixed nonlinear complementarity problem. This allows us to simultaneously compute the equivalent contact point as well as the wrenches (forces and moments) at the equivalent contact point (consistent with the friction model) along with the configuration and velocities of the rigid objects. Furthermore, we prove that the contact constraints of no inter-penetration between the objects is also satisfied. We present a geometrically implicit time-stepping scheme for dynamic simulation for contacts between two bodies with convex contact area, which includes line contact and surface contact. We prove that for surface and line contact, for any value of the velocity of center of mass of the object, there is a unique solution for contact point and contact wrench that satisfies the discrete-time equations of motion. Simulation examples are shown to demonstrate the validity of our approach and show that with our approach we can seamlessly transition between point, line, and surface contact.


title: Universal norms and the Fargues-Fontaine curve

abstract: We study the module of universal norms associated with a de Rham $p$-adic Galois representation in a perfectoid field extension. In particular, we compute precisely this module when the Hodge-Tate weights of a representation are greater than or equal to $0$. This generalises a result by Coates and Greenberg for Abelian varieties, and partially answers a question of theirs. Our method relies on the classification of vector bundles over the Fargues-Fontaine curve.


title: Using Soft Actor-Critic for Low-Level UAV Control

abstract: Unmanned Aerial Vehicles (UAVs), or drones, have recently been used in several civil application domains from organ delivery to remote locations to wireless network coverage. These platforms, however, are naturally unstable systems for which many different control approaches have been proposed. Generally based on classic and modern control, these algorithms require knowledge of the robot's dynamics. However, recently, model-free reinforcement learning has been successfully used for controlling drones without any prior knowledge of the robot model. In this work, we present a framework to train the Soft Actor-Critic (SAC) algorithm to low-level control of a quadrotor in a go-to-target task. All experiments were conducted under simulation. With the experiments, we show that SAC can not only learn a robust policy, but it can also cope with unseen scenarios. Videos from the simulations are available in https://www.youtube.com/watch?v=9z8vGs0Ri5g and the code in https://github.com/larocs/SAC_uav.


title: Weak antilocalization beyond the fully diffusive regime in Pb1-xSnxSe topological quantum wells

abstract: We report the measurements and analysis of weak antilocalization (WAL) in Pb1-xSnxSe topological quantum wells in a new regime where the elastic scattering length is larger than the magnetic length. We achieve this regime through the development of high-quality epitaxy and doping of topological crystalline insulator (TCI) quantum wells. We obtain elastic scattering lengths that exceeds 100nm and become comparable to the magnetic length. In this transport regime, the Hikami-Larkin-Nagaoka model is no longer valid. We employ the model of Wittmann and Schmid to extract the coherence time from the magnetoresistance. We find that despite our improved transport characteristics, the coherence time may be limited by scattering channels that are not strongly carrier dependent, such as electron-phonon or defect scattering.


title: SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding

abstract: Spoken language understanding (SLU) requires a model to analyze input acoustic signal to understand its linguistic content and make predictions. To boost the models' performance, various pre-training methods have been proposed to learn rich representations from large-scale unannotated speech and text. However, the inherent disparities between the two modalities necessitate a mutual analysis. In this paper, we propose a novel semi-supervised learning framework, SPLAT, to jointly pre-train the speech and language modules. Besides conducting a self-supervised masked language modeling task on the two individual modules using unpaired speech and text, SPLAT aligns representations from the two modules in a shared latent space using a small amount of paired speech and text. Thus, during fine-tuning, the speech module alone can produce representations carrying both acoustic information and contextual semantic knowledge of an input acoustic signal. Experimental results verify the effectiveness of our approach on various SLU tasks. For example, SPLAT improves the previous state-of-the-art performance on the Spoken SQuAD dataset by more than 10%.


title: Deformations of semi-smooth varieties

abstract: For a singular variety X, an essential step to determine its smoothability and study its deformations is the understanding of the tangent sheaf and of the sheaf T^1_X:=ext^1(Omega_X,O_X). A variety is semi-smooth if its singularities are \'etale locally the product of a double crossing point (uv=0) or a pinch point (u^2-v^2w=0) with affine space; equivalently, if it can be obtained by gluing a smooth variety along a smooth divisor via an involution with smooth quotient. Our main result is the explicit computation of the tangent sheaf and the sheaf T^1_X for a semi-smooth variety X in terms of the gluing data.


title: Testing homogeneity in dynamic discrete games in finite samples

abstract: The literature on dynamic discrete games often assumes that the conditional choice probabilities and the state transition probabilities are homogeneous across markets and over time. We refer to this as the "homogeneity assumption" in dynamic discrete games. This assumption enables empirical studies to estimate the game's structural parameters by pooling data from multiple markets and from many time periods. In this paper, we propose a hypothesis test to evaluate whether the homogeneity assumption holds in the data. Our hypothesis test is the result of an approximate randomization test, implemented via a Markov chain Monte Carlo (MCMC) algorithm. We show that our hypothesis test becomes valid as the (user-defined) number of MCMC draws diverges, for any fixed number of markets, time periods, and players. We apply our test to the empirical study of the U.S.\ Portland cement industry in Ryan (2012).


title: Rotation periods for cool stars in the open cluster Ruprecht 147 (NGC 6774): Implications for gyrochronology

abstract: Gyrochronology allows the derivation of ages for cool main sequence stars based on their observed rotation periods and masses, or a suitable proxy thereof. It is increasingly well-explored for FGK stars, but requires further measurements for older ages and K-M-type stars. We study the nearby, 3 Gyr-old open cluster Ruprecht 147 to compare it with the previously-studied, but far more distant, NGC 6819 cluster, and especially to measure cooler stars than was previously possible there. We constructed an inclusive list of 102 cluster members from prior work, including Gaia DR2, and for which light curves were also obtained during Campaign 7 of the Kepler/K2 space mission. [...] Periodic signals are found for 32 stars, 21 of which are considered to be both highly reliable and to represent single, or effectively single, Ru147 stars. These stars cover the spectral types from late-F to mid-M stars, and they have periods ranging from 6d-32d, allowing for a comparison of Ruprecht 147 to both of the other open clusters and to models of rotational spindown. The derived rotation periods connect reasonably to, overlap with, and extend to lower masses the known rotation period distribution of the 2.5 Gyr-old cluster NGC 6819. The data confirm that cool stars lie on a single surface in rotation period-mass-age space, and they simultaneously challenge its commonly assumed shape. The shape at the low mass region of the color-period diagram at the age of Ru147 favors a recently-proposed model, which requires a third mass-dependent timescale in addition to the two timescales required by a former model, suggesting that a third physical process is required to model rotating stars effectively.


title: $|\Delta \mathcal{B}| =2$: A State of the Field, and Looking Forward--A brief status report of theoretical and experimental physics opportunities

abstract: The origin of the matter-antimatter asymmetry apparently obligates the laws of physics to include some mechanism of baryon number ($\mathcal{B}$) violation. Searches for interactions violating $\mathcal{B}$ and baryon-minus-lepton number $\mathcal{(B-L)}$ represent a rich and underutilized opportunity. These are complementary to the existing, broad program of searches for $\mathcal{L}$-violating modes such as neutrinoless double $\beta$-decay which could provide deeper understandings of the plausibility of leptogenesis, or $\mathcal{B}$-violating, $\mathcal{(B-L)}$-conserving processes such as proton decay. In particular, a low-scale, post-sphaleron violation mechanism of $\mathcal{(B-L)}$ could provide a \textit{testable} form of baryogenesis. Though theoretically compelling, searches for such $\mathcal{(B-L)}$-violating processes like $\Delta\mathcal{B}=2$ dinucleon decay and $n\rightarrow\bar{n}$ remain relatively underexplored experimentally compared to other rare processes. By taking advantage of upcoming facilities such as the Deep Underground Neutrino Experiment and the European Spallation Source, this gap can be addressed with new intranuclear and free searches for neutron transformations with very high sensitivity, perhaps greater than three orders of magnitude higher than previous experimental searches. This proceedings reports on recent theoretical and experimental advances and sensitivities of next-generation searches for neutron transformations were detailed as part of the Amherst Center for Fundamental Interactions Workshop, "Theoretical Innovations for Future Experiments Regarding Baryon Number Violation," directly coordinated with the Rare Processes and Precision Measurements Frontier.


title: Spectrum of extensive multiclusters in the Kuramoto model with higher-order interactions

abstract: Globally coupled ensembles of phase oscillators serve as useful tools for modeling synchronization and collective behavior in a variety of applications. As interest in the effects of simplicial interactions (i.e., non-additive, higher-order interactions between three or more units) continues to grow we study an extension of the Kuramoto model where oscillators are coupled via three-way interactions that exhibits novel dynamical properties including clustering, multistability, and abrupt desynchronization transitions. Here we provide a rigorous description of the stability of various multicluster states by studying their spectral properties in the thermodynamic limit. Not unlike the classical Kuramoto model, a natural frequency distribution with infinite support yields a population of drifting oscillators, which in turn guarantees that a portion of the spectrum is located on the imaginary axes, resulting in neutrally stable or unstable solutions. On the other hand, a natural frequency distribution with finite support allows for a fully phase-locked state, whose spectrum is real and may be linearly stable or unstable.


title: PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation

abstract: Pre-trained Transformers have enabled impressive breakthroughs in generating long and fluent text, yet their outputs are often "rambling" without coherently arranged content. In this work, we present a novel content-controlled text generation framework, PAIR, with planning and iterative refinement, which is built upon a large model, BART. We first adapt the BERT model to automatically construct the content plans, consisting of keyphrase assignments and their corresponding sentence-level positions. The BART model is employed for generation without modifying its structure. We then propose a refinement algorithm to gradually enhance the generation quality within the sequence-to-sequence framework. Evaluation with automatic metrics shows that adding planning consistently improves the generation quality on three distinct domains, with an average of 20 BLEU points and 12 METEOR points improvements. In addition, human judges rate our system outputs to be more relevant and coherent than comparisons without planning.


title: Latent World Models For Intrinsically Motivated Exploration

abstract: In this work we consider partially observable environments with sparse rewards. We present a self-supervised representation learning method for image-based observations, which arranges embeddings respecting temporal distance of observations. This representation is empirically robust to stochasticity and suitable for novelty detection from the error of a predictive forward model. We consider episodic and life-long uncertainties to guide the exploration. We propose to estimate the missing information about the environment with the world model, which operates in the learned latent space. As a motivation of the method, we analyse the exploration problem in a tabular Partially Observable Labyrinth. We demonstrate the method on image-based hard exploration environments from the Atari benchmark and report significant improvement with respect to prior work. The source code of the method and all the experiments is available at https://github.com/htdt/lwm.


title: Generalized parafermions of orthogonal type

abstract: There is an embedding of affine vertex algebras $V^k(\mathfrak{gl}_n) \hookrightarrow V^k(\mathfrak{sl}_{n+1})$, and the coset $\mathcal{C}^k(n) = \text{Com}(V^k(\mathfrak{gl}_n), V^k(\mathfrak{sl}_{n+1}))$ is a natural generalization of the parafermion algebra of $\mathfrak{sl}_2$. It was called the algebra of generalized parafermions by the third author and was shown to arise as a one-parameter quotient of the universal two-parameter $\mathcal{W}_{\infty}$-algebra of type $\mathcal{W}(2,3,\dots)$. In this paper, we consider an analogous structure of orthogonal type, namely $\mathcal{D}^k(n) = \text{Com}(V^k(\mathfrak{so}_{2n}), V^k(\mathfrak{so}_{2n+1}))^{\mathbb{Z}_2}$. We realize this algebra as a one-parameter quotient of the two-parameter even spin $\mathcal{W}_{\infty}$-algebra of type $\mathcal{W}(2,4,\dots)$, and we classify all coincidences between its simple quotient $\mathcal{D}_k(n)$ and the algebras $\mathcal{W}_{\ell}(\mathfrak{so}_{2m+1})$ and $\mathcal{W}_{\ell}(\mathfrak{so}_{2m})^{\mathbb{Z}_2}$. As a corollary, we show that for the admissible levels $k = -(2n-2) + \frac{1}{2} (2 n + 2 m -1)$ for $\widehat{\mathfrak{so}}_{2n}$ the simple affine algebra $L_k(\mathfrak{so}_{2n})$ embeds in $L_k(\mathfrak{so}_{2n+1})$, and the coset is strongly rational. As a consequence, the category of ordinary modules of $L_k(\mathfrak{so}_{2n+1})$ at such a level is a braided fusion category.


title: A Power Analysis of the Conditional Randomization Test and Knockoffs

abstract: In many scientific problems, researchers try to relate a response variable $Y$ to a set of potential explanatory variables $X = (X_1,\dots,X_p)$, and start by trying to identify variables that contribute to this relationship. In statistical terms, this goal can be posed as trying to identify $X_j$'s upon which $Y$ is conditionally dependent. Sometimes it is of value to simultaneously test for each $j$, which is more commonly known as variable selection. The conditional randomization test (CRT) and model-X knockoffs are two recently proposed methods that respectively perform conditional independence testing and variable selection by, for each $X_j$, computing any test statistic on the data and assessing that test statistic's significance by comparing it to test statistics computed on synthetic variables generated using knowledge of $X$'s distribution. Our main contribution is to analyze their power in a high-dimensional linear model where the ratio of the dimension $p$ and the sample size $n$ converge to a positive constant. We give explicit expressions of the asymptotic power of the CRT, variable selection with CRT $p$-values, and model-X knockoffs, each with a test statistic based on either the marginal covariance, the least squares coefficient, or the lasso. One useful application of our analysis is the direct theoretical comparison of the asymptotic powers of variable selection with CRT $p$-values and model-X knockoffs; in the instances with independent covariates that we consider, the CRT provably dominates knockoffs. We also analyze the power gain from using unlabeled data in the CRT when limited knowledge of $X$'s distribution is available, and the power of the CRT when samples are collected retrospectively.


title: Conversational Document Prediction to Assist Customer Care Agents

abstract: A frequent pattern in customer care conversations is the agents responding with appropriate webpage URLs that address users' needs. We study the task of predicting the documents that customer care agents can use to facilitate users' needs. We also introduce a new public dataset which supports the aforementioned problem. Using this dataset and two others, we investigate state-of-the art deep learning (DL) and information retrieval (IR) models for the task. Additionally, we analyze the practicality of such systems in terms of inference time complexity. Our show that an hybrid IR+DL approach provides the best of both worlds.


title: On generalized divergence and Laplace operators as a matter of division of distributions

abstract: Starting from the approach to the Laplacian with respect to coupling measures and undirected weighted graphs, we provide a setting for a general point of view for a Kirchhoff type divergence and a Laplace operators built on the trivial gradient of order zero $f(y)-f(x)$. We consider some particular classical and new instances of this approach.


title: KGPT: Knowledge-Grounded Pre-Training for Data-to-Text Generation

abstract: Data-to-text generation has recently attracted substantial interests due to its wide applications. Existing methods have shown impressive performance on an array of tasks. However, they rely on a significant amount of labeled data for each task, which is costly to acquire and thus limits their application to new tasks and domains. In this paper, we propose to leverage pre-training and transfer learning to address this issue. We propose a knowledge-grounded pre-training (KGPT), which consists of two parts, 1) a general knowledge-grounded generation model to generate knowledge-enriched text. 2) a pre-training paradigm on a massive knowledge-grounded text corpus crawled from the web. The pre-trained model can be fine-tuned on various data-to-text generation tasks to generate task-specific text. We adopt three settings, namely fully-supervised, zero-shot, few-shot to evaluate its effectiveness. Under the fully-supervised setting, our model can achieve remarkable gains over the known baselines. Under zero-shot setting, our model without seeing any examples achieves over 30 ROUGE-L on WebNLG while all other baselines fail. Under the few-shot setting, our model only needs about one-fifteenth as many labeled examples to achieve the same level of performance as baseline models. These experiments consistently prove the strong generalization ability of our proposed framework https://github.com/wenhuchen/KGPT.


title: On the Generation of Electronic Ring Currents under Vibronic Coupling Effects

abstract: We study the generation of electronic ring currents in the presence of nonadiabatic coupling using circularly polarized light. For this, we introduce a solvable model consisting of an electron and a nucleus rotating around a common center and subject to their mutual Coulomb interaction. The simplicity of the model brings to the forefront the non-trivial properties of electronic ring currents in the presence of coupling to the nuclear coordinates and enables the characterization of various limiting situations transparently. Employing this model, we show that vibronic coupling effects play a crucial role even when a single $E$ degenerate eigenstate of the system supports the current. The maximum current of a degenerate eigenstate depends on the strength of the nonadiabatic interactions. In the limit of large nuclear to electronic masses, in which the Born-Oppenheimer approximation becomes exact, constant ring currents and time-averaged oscillatory currents necessarily vanish.


title: Layer shift factor in layered hybrid perovskites -- univocal quantitative descriptor of composition-structure-property relationships

abstract: Asceding interest of the scientific community in layered hybrid halide perovskites (LHHPs) as materials for innovative photovoltaic and optoelectronic applications led to unprecedented expansion of this family of compounds, reaching now several hundred refined structures. Despite the unique structural diversity of LHHPs, traditional approaches of describing their structures, such as dividing into Dion-Jacobson (DJ) or Ruddlesden-Popper (RP) phases for mostt structures are ambiguous and unquantifiable. Here, we introduced a quantitative layer shift factor (LSF) for a univocal classification and quantitative comparison of the structures. We also developed an algorithm for automatic calculation of the LSF for such structures. We demonstrate the application of the proposed approach for an analysis of correlations between LSF and band gap to reveal "structure-property" relationships. Our study gives a simple and useful approach to classify of either the layered perovskite-like structures or other layered compounds composed of layers of vertex-connected octahedra as a structural unit.


title: Deep Anomaly Detection by Residual Adaptation

abstract: Deep anomaly detection is a difficult task since, in high dimensions, it is hard to completely characterize a notion of "differentness" when given only examples of normality. In this paper we propose a novel approach to deep anomaly detection based on augmenting large pretrained networks with residual corrections that adjusts them to the task of anomaly detection. Our method gives rise to a highly parameter-efficient learning mechanism, enhances disentanglement of representations in the pretrained model, and outperforms all existing anomaly detection methods including other baselines utilizing pretrained networks. On the CIFAR-10 one-versus-rest benchmark, for example, our technique raises the state of the art from 96.1 to 99.0 mean AUC.


title: Goal-directed Generation of Discrete Structures with Conditional Generative Models

abstract: Despite recent advances, goal-directed generation of structured discrete data remains challenging. For problems such as program synthesis (generating source code) and materials design (generating molecules), finding examples which satisfy desired constraints or exhibit desired properties is difficult. In practice, expensive heuristic search or reinforcement learning algorithms are often employed. In this paper we investigate the use of conditional generative models which directly attack this inverse problem, by modeling the distribution of discrete structures given properties of interest. Unfortunately, maximum likelihood training of such models often fails with the samples from the generative model inadequately respecting the input properties. To address this, we introduce a novel approach to directly optimize a reinforcement learning objective, maximizing an expected reward. We avoid high-variance score-function estimators that would otherwise be required by sampling from an approximation to the normalized rewards, allowing simple Monte Carlo estimation of model gradients. We test our methodology on two tasks: generating molecules with user-defined properties and identifying short python expressions which evaluate to a given target value. In both cases, we find improvements over maximum likelihood estimation and other baselines.


title: Probing the Warm-Hot Circumgalactic Medium with broad OVI and X-rays

abstract: Most of the baryonic mass in the circumgalactic medium (CGM) of a spiral galaxy is believed to be warm-hot, with temperature around $10^6$K. The narrow OVI absorption lines probe a somewhat cooler component at $\log \rm T(K)= 5.5$, but broad OVI absorbers have the potential to probe the hotter CGM. Here we present 376 ks Chandra LETG observations of a carefully selected galaxy in which the presence of broad OVI together with the non-detection of Lya was indicative of warm-hot gas. The strongest line expected to be present at $\approx 10^6$K is OVII $\lambda 21.602$. There is a hint of an absorption line at the redshifted wavelength, but the line is not detected with better than $2\sigma$ significance. A physical model, taking into account strengths of several other lines, provides better constraints. Our best-fit absorber model has $\log \rm T(K) =6.3\pm 0.2$ and $\log \rm N_{H} (cm^{-2})=20.7^{+0.3}_{-0.5}$. These parameters are consistent with the warm-hot plasma model based on UV observations; other OVI models of cooler gas phases are ruled out at better than $99$% confidence. Thus we have suggestive, but not conclusive evidence for the broad OVI absorber probing the warm-hot gas from the shallow observations of this pilot program. About 800ks of XMM-Newton observations will detect the expected absorption lines of OVII and OVIII unequivocally. Future missions like XRISM, Arcus and Athena will revolutionize the CGM science.


title: Multi-Objective Approach for Optimal Size and Location of DGs in Distribution Systems

abstract: In the recent years, due to the economic and environmental requirements, the use of distributed generations (DGs) has increased. If DGs have the optimal size and are located at the optimal locations, they are capable of enhancing the voltage profile and reducing the power loss. This paper proposes a new approach to obtain the optimal location and size of DGs. To this end, exchange market algorithm (EMA) is offered to find the optimal size and location of DGs subject to minimizing loss, increasing voltage profile, and improving voltage stability in the distribution systems. The effectiveness of the proposed approach is verified on both 33- and 69-bus IEEE standard systems.


title: Axion-Polaritons in the Magnetic Dual Chiral Density Wave Phase of Dense QCD

abstract: We investigate the propagation of electromagnetic radiation in the magnetic dual chiral density wave (MDCDW) phase of dense quark matter. Considering the theory of low-energy fluctuations in this phase, we show how linearly polarized photons reaching the MDCDW medium couple to the fluctuation field to produce two hybridized modes of propagation that we call in analogy with similar phenomenon in condensed matter physics axion polaritons, one of them being gapless and the other gapped. The gapped mode's gap is proportional to the background magnetic field and inversely proportional to the amplitude of the inhomogeneous condensate. The generation of axion polaritons can be traced back to the presence of the chiral anomaly in the low-energy theory of the fluctuations. Considering the Primakoff effect in the MDCDW medium, we argued that axion polaritons can be generated inside quark stars bombarded by energetic photons coming from gamma-ray bursts and point out that this mechanism could serve to explain the missing pulsar paradox in the galaxy center.


title: SMILE: Semantically-guided Multi-attribute Image and Layout Editing

abstract: Attribute image manipulation has been a very active topic since the introduction of Generative Adversarial Networks (GANs). Exploring the disentangled attribute space within a transformation is a very challenging task due to the multiple and mutually-inclusive nature of the facial images, where different labels (eyeglasses, hats, hair, identity, etc.) can co-exist at the same time. Several works address this issue either by exploiting the modality of each domain/attribute using a conditional random vector noise, or extracting the modality from an exemplary image. However, existing methods cannot handle both random and reference transformations for multiple attributes, which limits the generality of the solutions. In this paper, we successfully exploit a multimodal representation that handles all attributes, be it guided by random noise or exemplar images, while only using the underlying domain information of the target domain. We present extensive qualitative and quantitative results for facial datasets and several different attributes that show the superiority of our method. Additionally, our method is capable of adding, removing or changing either fine-grained or coarse attributes by using an image as a reference or by exploring the style distribution space, and it can be easily extended to head-swapping and face-reenactment applications without being trained on videos.


title: Sentiment Analysis for Reinforcement Learning

abstract: While reinforcement learning (RL) has been successful in natural language processing (NLP) domains such as dialogue generation and text-based games, it typically faces the problem of sparse rewards that leads to slow or no convergence. Traditional methods that use text descriptions to extract only a state representation ignore the feedback inherently present in them. In text-based games, for example, descriptions like "Good Job! You ate the food}" indicate progress, and descriptions like "You entered a new room" indicate exploration. Positive and negative cues like these can be converted to rewards through sentiment analysis. This technique converts the sparse reward problem into a dense one, which is easier to solve. Furthermore, this can enable reinforcement learning without rewards, in which the agent learns entirely from these intrinsic sentiment rewards. This framework is similar to intrinsic motivation, where the environment does not necessarily provide the rewards, but the agent analyzes and realizes them by itself. We find that providing dense rewards in text-based games using sentiment analysis improves performance under some conditions.


title: Meta-Learning of Structured Task Distributions in Humans and Machines

abstract: In recent years, meta-learning, in which a model is trained on a family of tasks (i.e. a task distribution), has emerged as an approach to training neural networks to perform tasks that were previously assumed to require structured representations, making strides toward closing the gap between humans and machines. However, we argue that evaluating meta-learning remains a challenge, and can miss whether meta-learning actually uses the structure embedded within the tasks. These meta-learners might therefore still be significantly different from humans learners. To demonstrate this difference, we first define a new meta-reinforcement learning task in which a structured task distribution is generated using a compositional grammar. We then introduce a novel approach to constructing a "null task distribution" with the same statistical complexity as this structured task distribution but without the explicit rule-based structure used to generate the structured task. We train a standard meta-learning agent, a recurrent network trained with model-free reinforcement learning, and compare it with human performance across the two task distributions. We find a double dissociation in which humans do better in the structured task distribution whereas agents do better in the null task distribution -- despite comparable statistical complexity. This work highlights that multiple strategies can achieve reasonable meta-test performance, and that careful construction of control task distributions is a valuable way to understand which strategies meta-learners acquire, and how they might differ from humans.


title: MIMOSA: Multi-constraint Molecule Sampling for Molecule Optimization

abstract: Molecule optimization is a fundamental task for accelerating drug discovery, with the goal of generating new valid molecules that maximize multiple drug properties while maintaining similarity to the input molecule. Existing generative models and reinforcement learning approaches made initial success, but still face difficulties in simultaneously optimizing multiple drug properties. To address such challenges, we propose the MultI-constraint MOlecule SAmpling (MIMOSA) approach, a sampling framework to use input molecule as an initial guess and sample molecules from the target distribution. MIMOSA first pretrains two property agnostic graph neural networks (GNNs) for molecule topology and substructure-type prediction, where a substructure can be either atom or single ring. For each iteration, MIMOSA uses the GNNs' prediction and employs three basic substructure operations (add, replace, delete) to generate new molecules and associated weights. The weights can encode multiple constraints including similarity and drug property constraints, upon which we select promising molecules for next iteration. MIMOSA enables flexible encoding of multiple property- and similarity-constraints and can efficiently generate new molecules that satisfy various property constraints and achieved up to 49.6% relative improvement over the best baseline in terms of success rate. The code repository (including readme file, data preprocessing and model construction, evaluation) is available https://github.com/futianfan/MIMOSA.


title: Tensor Fields for Data Extraction from Chart Images: Bar Charts and Scatter Plots

abstract: Charts are an essential part of both graphicacy (graphical literacy), and statistical literacy. As chart understanding has become increasingly relevant in data science, automating chart analysis by processing raster images of the charts has become a significant problem. Automated chart reading involves data extraction and contextual understanding of the data from chart images. In this paper, we perform the first step of determining the computational model of chart images for data extraction for selected chart types, namely, bar charts, and scatter plots. We demonstrate the use of positive semidefinite second-order tensor fields as an effective model. We identify an appropriate tensor field as the model and propose a methodology for the use of its degenerate point extraction for data extraction from chart images. Our results show that tensor voting is effective for data extraction from bar charts and scatter plots, and histograms, as a special case of bar charts.


title: A Category of Banach Space Functors

abstract: We introduce a sheaf theoretic viewpoint on functional analysis designed for infinite dimensional Lie group actions. We develop functional calculus for Banach valued functors and, in particular, prove the existence of an exponential map for a certain class of operators that generalise first order partial differential operators. This algebraic framework can be used in dynamical systems and KAM theory to provide normal forms and versal deformations. it is used in our papers on the subject such as the Herman conjecture paper, the versal deformation theorem for vector fields etc.