title: Bayesian autotuning of Hubbard model quantum simulators

abstract: Spins in gated semiconductor quantum dots (QDs) are a promising platform for Hubbard model simulation inaccessible to computation. Precise control of the tunnel couplings by tuning voltages on metallic gates is vital for a successful QD-based simulator. However, the number of tunable voltages and the complexity of the relationships between gate voltages and the parameters of the resulting Hubbard models quickly increase with the number of quantum dots. As a consequence, it is not known if and how a particular gate geometry yields a target Hubbard model. To solve this problem, we propose a hybrid machine-learning approach using a combination of support vector machines (SVMs) and Bayesian optimization (BO) to identify combinations of voltages that realize a desired Hubbard model. SVM constrains the space of voltages by rejecting voltage combinations producing potentials unsuitable for tight-binding (TB) approximation. The target voltage combinations are then identified by BO in the constrained subdomain. For large QD arrays, we propose a scalable efficient iterative procedure using our SVM-BO approach, which optimises voltage subsets and utilises a two-QD SVM model for large systems. Our results use experimental gate lithography images and accurate integrals calculated with linear combinations of harmonic orbitals to train the machine learning algorithms.


title: Rainier: Reinforced Knowledge Introspector for Commonsense Question Answering

abstract: Knowledge underpins reasoning. Recent research demonstrates that when relevant knowledge is provided as additional context to commonsense question answering (QA), it can substantially enhance the performance even on top of state-of-the-art. The fundamental challenge is where and how to find such knowledge that is high quality and on point with respect to the question; knowledge retrieved from knowledge bases are incomplete and knowledge generated from language models are inconsistent. We present Rainier, or Reinforced Knowledge Introspector, that learns to generate contextually relevant knowledge in response to given questions. Our approach starts by imitating knowledge generated by GPT-3, then learns to generate its own knowledge via reinforcement learning where rewards are shaped based on the increased performance on the resulting question answering. Rainier demonstrates substantial and consistent performance gains when tested over 9 different commonsense benchmarks: including 5 datasets that are seen during model training, as well as 4 datasets that are kept unseen. Our work is the first to report that knowledge generated by models that are orders of magnitude smaller than GPT-3, even without direct supervision on the knowledge itself, can exceed the quality of commonsense knowledge elicited from GPT-3.


title: Eddy-freshwater Interaction using Regional Ocean Modeling System in the Bay of Bengal

abstract: Eddy-freshwater interaction is studied in the north Bay of Bengal (BoB) with a high-resolution simulation using the Regional Ocean Modeling System. Following observations, the model simulates the trapping and homogenization of river water by a cyclonic mesoscale eddy on a sub-monthly time scale from October-November of 2015. As fresh river water is trapped in the eddy, it is characterized by strong vertical and lateral gradients in salinity. Within a few weeks, these gradients relax along with the progressive homogenization of freshwater within the eddy. A mixed layer salinity budget shows the importance of ageostrophic vertical advection in addition to lateral advection during the evolution of salinity within the eddy. An analysis of the eddy kinetic energy (EKE) budget in the upper ocean indicates the development of barotropic and baroclinic instabilities. The vertical profiles of EKE conversion terms reveal that the surface freshwater was involved in the evolution of baroclinic instability within the mixed layer. In addition, an eddy available potential energy (EPE) budget shows that the entrainment of the river water raises the EPE, which is due to an increase in lateral salinity gradients across the eddy during the trapping event. Subsequently, the salinity homogenization leads to a decrease in the EPE, and its rate of decay is modulated by a correlation between surface buoyancy fluxes and density anomalies. Finally, reanalysis data show similar trapping and homogenization events across multiple years, highlighting the importance of this mechanism of subseasonal freshwater evolution in the BoB.


title: Explainable Verbal Deception Detection using Transformers

abstract: People are regularly confronted with potentially deceptive statements (e.g., fake news, misleading product reviews, or lies about activities). Only few works on automated text-based deception detection have exploited the potential of deep learning approaches. A critique of deep-learning methods is their lack of interpretability, preventing us from understanding the underlying (linguistic) mechanisms involved in deception. However, recent advancements have made it possible to explain some aspects of such models. This paper proposes and evaluates six deep-learning models, including combinations of BERT (and RoBERTa), MultiHead Attention, co-attentions, and transformers. To understand how the models reach their decisions, we then examine the model's predictions with LIME. We then zoom in on vocabulary uniqueness and the correlation of LIWC categories with the outcome class (truthful vs deceptive). The findings suggest that our transformer-based models can enhance automated deception detection performances (+2.11% in accuracy) and show significant differences pertinent to the usage of LIWC features in truthful and deceptive statements.


title: Shadows of rotating Einstein-Maxwell-dilaton black holes surrounded by a plasma

abstract: We consider rotating charged black holes with a scalar dilaton field and surrounded by plasma, with the purpose of studying their shadows. The corresponding metric has been previously obtained in the literature from the static solution by using the Newman-Janis algorithm. Assuming a well known form for the pressureless and nonmagnetized plasma distribution, which is suitable for the separation of the Hamilton-Jacobi equation for light, we derive an expression that determines the shape of the shadow. We present some examples of contours and we analyze their observable properties as functions of the charge and the dilaton coupling. We find that the presence of plasma introduces a dependency on the frequency, with the shadow becoming smaller as the frequency decreases.


title: Search for a heavy composite Majorana neutrino in events with dilepton signatures from proton-proton collisions at $\sqrt{s}$ = 13 TeV

abstract: Results are presented of a search for a heavy Majorana neutrino N$_\ell$ decaying into two same-flavor leptons $\ell$ (electrons or muons) and a quark-pair jet. A model is considered in which the N$_\ell$ is an excited neutrino in a compositeness scenario. The analysis is performed using a sample of proton-proton collisions at $\sqrt{s}$ = 13 TeV recorded by the CMS experiment at the CERN LHC, corresponding to an integrated luminosity of 138 fb$^{-1}$. The data are found to be in agreement with the standard model prediction. For the process in which the N$_\ell$ is produced in association with a lepton, followed by the decay of the N$_\ell$ to a same-flavor lepton and a quark pair, an upper limit at 95% confidence level on the product of the cross section and branching fraction is obtained as a function of the N$_\ell$ mass $m_{\text{N}_\ell}$ and the compositeness scale $\Lambda$. For this model the data exclude the existence of N$_\text{e}$ (N$_\mu$) for $m_{\text{N}_\ell}$ below 6.0 (6.1) TeV, at the limit where $m_{\text{N}_\ell}$ is equal to $\Lambda$. For $m_{\text{N}_\ell}$ $\approx$ 1 TeV, values of $\Lambda$ less than 20 (23) TeV are excluded. These results represent a considerable improvement in sensitivity, covering a larger parameter space than previous searches in pp collisions at 13 TeV.


title: Measurement-induced phase transition in teleportation and wormholes

abstract: We demonstrate that some quantum teleportation protocols exhibit measurement induced phase transitions in Sachdev-Ye-Kitaev model. Namely, Kitaev-Yoshida and Gao-Jafferis-Wall protocols have a phase transition if we apply them at a large projection rate or at a large coupling rate respectively. It is well-known that at small rates they allow teleportation to happen only within a small time-window. We show that at large rates, the system goes into a new steady state, where the teleportation can be performed at any moment. In dual Jackiw-Teitelboim gravity these phase transitions correspond to the formation of an eternal traversable wormhole. In the Kitaev-Yoshida case this novel type of wormhole is supported by continuous projections.

categories: hep-th cond-mat.stat-mech cond-mat.str-el quant-ph


title: Quantum time dilation in the near-horizon region of a black hole

abstract: In this work, we obtain a relation for average quantum time dilation between two clocks A and B in the near-horizon region of a black hole supported by the Rindler metric and conformal tortoise coordinate. It is indicated that this relation is identified with time dilation in classical and flat background limits.


title: Small fractional parts of polynomials and mean values of exponential sums

abstract: Let $k_i\ (i=1,2,\ldots,t)$ be natural numbers with $k_1>k_2>\cdots>k_t>0$, $k_1\geq 2$ and $t<k_1.$ Given real numbers $\alpha_{ji}\ (1\leq j\leq t,\ 1\leq i\leq s)$, we consider polynomials of the shape $$\varphi_i(x)=\alpha_{1i}x^{k_1}+\alpha_{2i}x^{k_2}+\cdots+\alpha_{ti}x^{k_t},$$ and derive upper bounds for fractional parts of polynomials in the shape $$\varphi_1(x_1)+\varphi_2(x_2)+\cdots+\varphi_s(x_s),$$ by applying novel mean value estimates related to Vinogradov's mean value theorem. Our results improve on earlier Theorems of Baker (2017).


title: Multiplicity results for ground state solutions of a semilinear equation via abrupt changes in magnitude of the nonlinearity

abstract: Given $k\in\mathbb N$, we define a class of continuous piecewise functions $f$ having abrupt but controlled magnitude changes so that the problem $$\Delta u +f(u)=0,\quad x\in \mathbb R^N, N> 2, $$ has at least $k$ radially symmetric ground state solutions.


abstract: We present Iterative Vision-and-Language Navigation (IVLN), a paradigm for evaluating language-guided agents navigating in a persistent environment over time. Existing Vision-and-Language Navigation (VLN) benchmarks erase the agent's memory at the beginning of every episode, testing the ability to perform cold-start navigation with no prior information. However, deployed robots occupy the same environment for long periods of time. The IVLN paradigm addresses this disparity by training and evaluating VLN agents that maintain memory across tours of scenes that consist of up to 100 ordered instruction-following Room-to-Room (R2R) episodes, each defined by an individual language instruction and a target path. We present discrete and continuous Iterative Room-to-Room (IR2R) benchmarks comprising about 400 tours each in 80 indoor scenes. We find that extending the implicit memory of high-performing transformer VLN agents is not sufficient for IVLN, but agents that build maps can benefit from environment persistence, motivating a renewed focus on map-building agents in VLN.


title: High-energy neutrinos from choked-jet supernovae: Searches and implications

abstract: The origin of the high-energy astrophysical neutrinos discovered by IceCube remains largely unknown. Multimessenger studies have indicated that the majority of these neutrinos come from gamma-ray-dark sources. Choked-jet supernovae (cjSNe), which are supernovae powered by relativistic jets stalled in stellar materials, may lead to neutrino emission via photohadronic interactions while the coproduced gamma rays are absorbed. In this paper, we perform an unbinned maximum-likelihood analysis to search for correlations between IceCube's ten-year muon-track events and our SN Ib/c sample, collected from publicly available catalogs. In addition to the conventional power-law models, we also consider the impacts of more realistic neutrino emission models for the first time, and we study the effects of the jet beaming factor in the analyses. Our results show no significant correlation. Even so, the conservative upper limits we set to the contribution of cjSNe to the diffuse astrophysical neutrino flux still allow SNe Ib/c to be the dominant source of astrophysical neutrinos observed by IceCube. We discuss implications to the cjSNe scenario from our results and the power of future neutrino and supernova observations.


title: Quantum computation of dynamical quantum phase transitions and entanglement tomography in a lattice gauge theory

abstract: Strongly-coupled gauge theories far from equilibrium may exhibit unique features that could illuminate the physics of the early universe and of hadron and ion colliders. Studying real-time phenomena has proven challenging with classical-simulation methods, but is a natural application of quantum simulation. To demonstrate this prospect, we quantum compute non-equal time correlation functions and perform entanglement tomography of non-equilibrium states of a simple lattice gauge theory, the Schwinger model, using a trapped-ion quantum computer by IonQ Inc. As an ideal target for near-term devices, a recently-predicted [Zache et al., Phys. Rev. Lett. 122, 050403 (2019)] dynamical quantum phase transition in this model is studied by preparing, quenching, and tracking the subsequent non-equilibrium dynamics in three ways: i) overlap echos signaling dynamical transitions, ii) non-equal time correlation functions with an underlying topological nature, and iii) the entanglement structure of non-equilibrium states, including entanglement Hamiltonians. These results constitute the first observation of a dynamical quantum phase transition in a lattice gauge theory on a quantum computer, and are a first step toward investigating topological phenomena in nuclear and high-energy physics using quantum technologies.


title: Dynamical masses of the primary Be star and the secondary sdB star in the single-lined binary kappa Dra (B6 IIIe)

abstract: Because many classical Be stars may owe their nature to mass and angular-momentum transfer in a close binary, the present masses, temperatures, and radii of their components are of high interest for comparison to stellar evolution models. Kappa Dra is a 61.5-day single-lined binary with a B6 IIIe primary. With the CHARA Array instruments MIRC/MIRC-X and MYSTIC, we detected the secondary at (approximately photospheric) flux ratios of 1.49 +- 0.10% and 1.63 +- 0.09% in the H and K band, respectively. From a large and diverse optical spectroscopic database only the radial velocity curve of the Be star could be extracted. However, employing the parallaxes from Hipparcos and Gaia, which agree within their nominal 1-sigma errors, we could derive the total mass and found component masses of 3.65 +- 0.48 Msun and 0.426 +- 0.043 Msun for the Be star and the companion, respectively. Previous cross-correlation of the observed far-UV spectrum with sdO spectral model templates had not detected a companion belonging to the hot O-type subdwarf (sdO) population known from ~20 earlier-type Be stars. Guided by our full 3D orbital solution, we found a strong cross-correlation signal for a stripped subdwarf B-type companion (far-UV flux ratio of 2.3 +- 0.5%), enabling the first firm characterization of such a star, and making kappa Dra the first mid- to late-type Be star with a directly-observed subdwarf companion.


title: Keller and Lieb-Thirring estimates of the eigenvalues in the gap of Dirac operators

abstract: We estimate the lowest eigenvalue in the gap of the essential spectrum of a Dirac operator with mass in terms of a Lebesgue norm of the potential. Such a bound is the counterpart for Dirac operators of the Keller estimates for the Schr\"odinger operator, which are equivalent to Gagliardo-Nirenberg-Sobolev interpolation inequalities. Domain, self-adjointness, optimality and critical values of the norms are addressed, while the optimal potential is given by a Dirac equation with a Kerr nonlinearity. A new critical bound appears, which is the smallest value of the norm of the potential for which eigenvalues may reach the bottom of the gap in the essential spectrum. The Keller estimate is then extended to a Lieb-Thirring inequality for the eigenvalues in the gap. Most of our result are established in the Birman-Schwinger reformulation.


title: Adaptive Ranking-based Sample Selection for Weakly Supervised Class-imbalanced Text Classification

abstract: To obtain a large amount of training labels inexpensively, researchers have recently adopted the weak supervision (WS) paradigm, which leverages labeling rules to synthesize training labels rather than using individual annotations to achieve competitive results for natural language processing (NLP) tasks. However, data imbalance is often overlooked in applying the WS paradigm, despite being a common issue in a variety of NLP tasks. To address this challenge, we propose Adaptive Ranking-based Sample Selection (ARS2), a model-agnostic framework to alleviate the data imbalance issue in the WS paradigm. Specifically, it calculates a probabilistic margin score based on the output of the current model to measure and rank the cleanliness of each data point. Then, the ranked data are sampled based on both class-wise and rule-aware ranking. In particular, the two sample strategies corresponds to our motivations: (1) to train the model with balanced data batches to reduce the data imbalance issue and (2) to exploit the expertise of each labeling rule for collecting clean samples. Experiments on four text classification datasets with four different imbalance ratios show that ARS2 outperformed the state-of-the-art imbalanced learning and WS methods, leading to a 2%-57.8% improvement on their F1-score.


title: Edge-Varying Fourier Graph Networks for Multivariate Time Series Forecasting

abstract: The key problem in multivariate time series (MTS) analysis and forecasting aims to disclose the underlying couplings between variables that drive the co-movements. Considerable recent successful MTS methods are built with graph neural networks (GNNs) due to their essential capacity for relational modeling. However, previous work often used a static graph structure of time-series variables for modeling MTS failing to capture their ever-changing correlations over time. To this end, a fully-connected supra-graph connecting any two variables at any two timestamps is adaptively learned to capture the high-resolution variable dependencies via an efficient graph convolutional network. Specifically, we construct the Edge-Varying Fourier Graph Networks (EV-FGN) equipped with Fourier Graph Shift Operator (FGSO) which efficiently performs graph convolution in the frequency domain. As a result, a high-efficiency scale-free parameter learning scheme is derived for MTS analysis and forecasting according to the convolution theorem. Extensive experiments show that EV-FGN outperforms state-of-the-art methods on seven real-world MTS datasets.


title: VIMA: General Robot Manipulation with Multimodal Prompts

abstract: Prompt-based learning has emerged as a successful paradigm in natural language processing, where a single general-purpose language model can be instructed to perform any task specified by input prompts. Yet task specification in robotics comes in various forms, such as imitating one-shot demonstrations, following language instructions, and reaching visual goals. They are often considered different tasks and tackled by specialized models. We show that a wide spectrum of robot manipulation tasks can be expressed with multimodal prompts, interleaving textual and visual tokens. Accordingly, we develop a new simulation benchmark that consists of thousands of procedurally-generated tabletop tasks with multimodal prompts, 600K+ expert trajectories for imitation learning, and a four-level evaluation protocol for systematic generalization. We design a transformer-based robot agent, VIMA, that processes these prompts and outputs motor actions autoregressively. VIMA features a recipe that achieves strong model scalability and data efficiency. It outperforms alternative designs in the hardest zero-shot generalization setting by up to $2.9\times$ task success rate given the same training data. With $10\times$ less training data, VIMA still performs $2.7\times$ better than the best competing variant. Code and video demos are available at https://vimalabs.github.io/


title: Birational geometry of Beauville-Mukai systems III: asymptotic behavior

abstract: Suppose that a Hilbert scheme of points on a K3 surface S of Picard rank one admits a rational Lagrangian fibration. We show that if the degree of the surface is sufficiently large compared to the number of points, then the Hilbert scheme is the unique hyperk\"ahler manifold in its birational class. In particular, the Hilbert scheme is a Lagrangian fibration itself, which we realize as coming from a (twisted) Beauville-Mukai system on a Fourier-Mukai partner of S. We also show that when the degree of the surface is small our method can be used to find all birational models of the Hilbert scheme.


title: Accelerated Single-Call Methods for Constrained Min-Max Optimization

abstract: We study first-order methods for constrained min-max optimization. Existing methods either require two gradient calls or two projections in each iteration, which may be costly in some applications. In this paper, we first show that a variant of the Optimistic Gradient (OG) method, a single-call single-projection algorithm, has $O(\frac{1}{\sqrt{T}})$ best-iterate convergence rate for inclusion problems with operators that satisfy the weak Minty variation inequality (MVI). Our second result is the first single-call single-projection algorithm -- the Accelerated Reflected Gradient (ARG) method that achieves the optimal $O(\frac{1}{T})$ last-iterate convergence rate for inclusion problems that satisfy negative comonotonicity. Both the weak MVI and negative comonotonicity are well-studied assumptions and capture a rich set of non-convex non-concave min-max optimization problems. Finally, we show that the Reflected Gradient (RG) method, another single-call single-projection algorithm, has $O(\frac{1}{\sqrt{T}})$ last-iterate convergence rate for constrained convex-concave min-max optimization, answering an open problem of [Heish et al, 2019]. Our convergence rates hold for standard measures such as the tangent residual and the natural residual.


title: Mixed higher-order topology: boundary non-Hermitian skin effect induced by a Floquet bulk

abstract: We show that anomalous Floquet topological insulators generate intrinsic, non-Hermitian topology on their boundary. As a consequence, removing a boundary hopping from the time-evolution operator stops the propagation of chiral edge modes, leading to a non-Hermitian skin effect. This does not occur in Floquet Chern insulators, however, in which boundary modes continue propagating. The non-Hermitian skin effect on the boundary is a consequence of the nontrivial topology of the bulk Floquet operator, which we show by designing a real-space topological invariant. Our work introduces a form of `mixed' higher-order topology, providing a bridge between research on periodically-driven systems and the study of non-Hermiticity. It suggests that periodic driving, which has already been demonstrated in a wide range of experiments, may be used to generate non-Hermitian skin effects.


title: Simulating reflected light coronagraphy of Earth-like exoplanets with a large IR/O/UV space telescope: impact and calibration of smooth exozodiacal dust

abstract: Observing Earth-like exoplanets orbiting within the habitable zone of Sun-like stars and studying their atmospheres in reflected starlight requires contrasts of $\sim1\mathrm{e}{-10}$ in the visible. At such high contrast, starlight reflected by exozodiacal dust is expected to be a significant source of contamination. Here, we present high-fidelity simulations of coronagraphic observations of a synthetic Solar System located at a distance of 10 pc and observed with a 12 m and an 8 m circumscribed aperture diameter space telescope operating at 500 nm wavelength. We explore different techniques to subtract the exozodi and stellar speckles from the simulated images in the face-on, the 30 deg inclined, and the 60 deg inclined case and quantify the remaining systematic noise as a function of the exozodiacal dust level of the system. We find that in the face-on case, the exozodi can be subtracted down to the photon noise limit for exozodi levels up to $\sim1000$ zodi using a simple toy model for the exozodiacal disk, whereas in the 60 deg inclined case this only works up to $\sim50$ zodi. We also investigate the impact of larger wavefront errors and larger system distance, finding that while the former have no significant impact, the latter has a strong (negative) impact. Ultimately, we derive a penalty factor as a function of the exozodi level and system inclination that should be considered in exoplanet yield studies as a realistic estimate for the excess systematic noise from the exozodi.


title: Non-recursive perturbative gadgets without subspace restrictions and applications to variational quantum algorithms

abstract: Perturbative gadgets are a tool to encode part of a Hamiltonian, usually the low-energy subspace, into a different Hamiltonian with favorable properties, for instance, reduced locality. Many constructions of perturbative gadgets have been proposed over the years. Still, all of them are restricted in some ways: Either they apply to some specific classes of Hamiltonians, they involve recursion to reduce locality, or they are limited to studying time evolution under the gadget Hamiltonian, e.g., in the context of adiabatic quantum computing, and thus involve subspace restrictions. In this work, we fill the gap by introducing a versatile universal, non-recursive, non-adiabatic perturbative gadget construction, without subspace restrictions, that encodes an arbitrary many-body Hamiltonian into the low-energy subspace of a three-body Hamiltonian. Our construction requires $rk$ additional qubits for a $k$-body Hamiltonian comprising $r$ terms. Besides a specific gadget construction, we also provide a recipe for constructing similar gadgets, which can be tailored to different properties, which we discuss.


title: Scalable photonic integrated circuits for programmable control of atomic systems

abstract: Advances in laser technology have driven discoveries in atomic, molecular, and optical (AMO) physics and emerging applications, from quantum computers with cold atoms or ions, to quantum networks with solid-state color centers. This progress is motivating the development of a new generation of "programmable optical control" systems, characterized by criteria (C1) visible (VIS) and near-infrared (IR) wavelength operation, (C2) large channel counts extensible beyond 1000s of individually addressable atoms, (C3) high intensity modulation extinction and (C4) repeatability compatible with low gate errors, and (C5) fast switching times. Here, we address these challenges by introducing an atom control architecture based on VIS-IR photonic integrated circuit (PIC) technology. Based on a complementary metal-oxide-semiconductor (CMOS) fabrication process, this Atom-control PIC (APIC) technology meets the system requirements (C1)-(C5). As a proof of concept, we demonstrate a 16-channel silicon nitride based APIC with (5.8$\pm$0.4) ns response times and -30 dB extinction ratio at a wavelength of 780 nm. This work demonstrates the suitability of PIC technology for quantum control, opening a path towards scalable quantum information processing based on optically-programmable atomic systems.


title: Kazhdan-Laumon Category O, Braverman-Kazhdan Schwartz space, and the semi-infinite flag variety

abstract: We define and study an analogue of Category O in the context of Kazhdan and Laumon's gluing construction for perverse sheaves on the basic affine space. We explicitly describe the simple objects in this category, and we show its linearized Grothendieck group is isomorphic to a natural submodule of Lusztig's periodic Hecke module. We then provide a categorification of these results by showing that the Kazhdan-Laumon Category O is equivalent to a full subcategory of a suitably-defined category of perverse sheaves on the semi-infinite flag variety.


title: Ambiguous Images With Human Judgments for Robust Visual Event Classification

abstract: Contemporary vision benchmarks predominantly consider tasks on which humans can achieve near-perfect performance. However, humans are frequently presented with visual data that they cannot classify with 100% certainty, and models trained on standard vision benchmarks achieve low performance when evaluated on this data. To address this issue, we introduce a procedure for creating datasets of ambiguous images and use it to produce SQUID-E ("Squidy"), a collection of noisy images extracted from videos. All images are annotated with ground truth values and a test set is annotated with human uncertainty judgments. We use this dataset to characterize human uncertainty in vision tasks and evaluate existing visual event classification models. Experimental results suggest that existing vision models are not sufficiently equipped to provide meaningful outputs for ambiguous images and that datasets of this nature can be used to assess and improve such models through model training and direct evaluation of model calibration. These findings motivate large-scale ambiguous dataset creation and further research focusing on noisy visual data.


title: Env-Aware Anomaly Detection: Ignore Style Changes, Stay True to Content!

abstract: We introduce a formalization and benchmark for the unsupervised anomaly detection task in the distribution-shift scenario. Our work builds upon the iWildCam dataset, and, to the best of our knowledge, we are the first to propose such an approach for visual data. We empirically validate that environment-aware methods perform better in such cases when compared with the basic Empirical Risk Minimization (ERM). We next propose an extension for generating positive samples for contrastive methods that considers the environment labels when training, improving the ERM baseline score by 8.7%.


title: Distributionally Adaptive Meta Reinforcement Learning

abstract: Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task distribution on which they were trained and struggle in the presence of distribution shift of test-time rewards or transition dynamics. In this work, we develop a framework for meta-RL algorithms that are able to behave appropriately under test-time distribution shifts in the space of tasks. Our framework centers on an adaptive approach to distributional robustness that trains a population of meta-policies to be robust to varying levels of distribution shift. When evaluated on a potentially shifted test-time distribution of tasks, this allows us to choose the meta-policy with the most appropriate level of robustness, and use it to perform fast adaptation. We formally show how our framework allows for improved regret under distribution shift, and empirically show its efficacy on simulated robotics problems under a wide range of distribution shifts.


title: Mask3D: Mask Transformer for 3D Semantic Instance Segmentation

abstract: Modern 3D semantic instance segmentation approaches predominantly rely on specialized voting mechanisms followed by carefully designed geometric clustering techniques. Building on the successes of recent Transformer-based methods for object detection and image segmentation, we propose the first Transformer-based approach for 3D semantic instance segmentation. We show that we can leverage generic Transformer building blocks to directly predict instance masks from 3D point clouds. In our model called Mask3D each object instance is represented as an instance query. Using Transformer decoders, the instance queries are learned by iteratively attending to point cloud features at multiple scales. Combined with point features, the instance queries directly yield all instance masks in parallel. Mask3D has several advantages over current state-of-the-art approaches, since it neither relies on (1) voting schemes which require hand-selected geometric properties (such as centers) nor (2) geometric grouping mechanisms requiring manually-tuned hyper-parameters (e.g. radii) and (3) enables a loss that directly optimizes instance masks. Mask3D sets a new state-of-the-art on ScanNet test (+6.2 mAP), S3DIS 6-fold (+10.1 mAP), STPLS3D (+11.2 mAP) and ScanNet200 test (+12.4 mAP).


title: Galaxy kinematics and mass estimates at z~1 from ionised gas and stars

abstract: We compare ionised gas and stellar kinematics of 16 star-forming galaxies ($\log(M_\star/M_\odot)=9.7-11.2$, SFR=6-86 $M_\odot/yr$) at $z\sim1$ using near-infrared integral field spectroscopy (IFS) of H$\alpha$ emission from the KMOS$^{\rm 3D}$ survey and optical slit spectroscopy of stellar absorption and gas emission from the LEGA-C survey. H$\alpha$ is dynamically colder than stars, with higher disc rotation velocities (by ~45 per cent) and lower disc velocity dispersions (by a factor ~2). This is similar to trends observed in the local Universe. We find higher rotational support for H$\alpha$ relative to [OII], potentially explaining systematic offsets in kinematic scaling relations found in the literature. Regarding dynamical mass measurements, for six galaxies with cumulative mass profiles from Jeans Anisotropic Multi-Gaussian Expansion (JAM) models the H$\alpha$ dynamical mass models agree remarkably well out to ~10 kpc for all but one galaxy (average $\Delta M_{\rm dyn}(R_{e,\rm F814W})<0.1$ dex). Simpler dynamical mass estimates based on integrated stellar velocity dispersion are less accurate (standard deviation 0.24 dex). Differences in dynamical mass estimates are larger, for example, for galaxies with stronger misalignments of the H$\alpha$ kinematic major axis and the photometric position angle, highlighting the added value of IFS observations for dynamics studies. The good agreement between the JAM models and the dynamical models based on H$\alpha$ kinematics at $z\sim1$ corroborates the validity of dynamical mass measurements from H$\alpha$ IFS observations also for higher redshift rotating disc galaxies.


title: AdS/BCFT from Conformal Bootstrap: Construction of Gravity with Branes and Particles

abstract: We initiate a conformal bootstrap program to study AdS3/BCFT2 with heavy excitations. We start by solving the bootstrap equations associated with two-point functions of scalar/non-scalar primaries under the assumption that one-point functions vanish. These correspond to gravity with a brane and a non-spinning/spinning particle where the brane and the particle do not intersect with each other. From the bootstrap equations, we obtain the energy spectrum and the modified black hole threshold. We then carefully analyze the gravity duals and find the results perfectly match the BCFT analysis. In particular, brane self-intersections, which are usually considered to be problematic, are nicely avoided by the black hole formation. Despite the assumption to solve the bootstrap equations, one-point functions of scalar primaries can be non-zero in general. We construct the holographic dual for a non-vanishing one-point function, in which the heavy particle can end on the brane, by holographically computing the Renyi entropy in AdS/BCFT. As a bonus, we find a refined formula for the holographic Renyi entropy, which appears to be crucial to correctly reproduce the boundary entropy term. On the other hand, we explain why one-point functions of non-scalar primaries always vanish from the gravity dual. The independence of the bootstrap equations to the boundary entropy helps us to construct gravity duals with negative tension branes. We also find a holographic dual of boundary primaries.


title: Jump Starting the Dark Sector with a Phase Transition

abstract: We study the possibility to populate the dark sector through a phase transition. We will consider secluded dark sectors made of gauge theories, Randall-Sundrum scenarios and conformally coupled elementary particles. These sectors have in common the fact that the action is approximately Weyl invariant, implying that particle production due to time dependent background is strongly suppressed. In particular no significant production takes place during inflation allowing to avoid strong isocurvature constraints from CMB. As we will show, if the scale of inflation is large compared to the dynamical mass scale, these sectors automatically undergo a phase transition that in the simplest cases is controlled by the Hubble parameter. If the phase transition takes place during reheating or radiation the abundance obtained can be larger than particle production and production from the SM plasma. For phase transitions completing during radiation domination, the DM mass is predicted in the range $10^8$ GeV while larger values are required for phase transitions occurring during reheating.


title: Real-World Robot Learning with Masked Visual Pre-training

abstract: In this work, we explore self-supervised visual pre-training on images from diverse, in-the-wild videos for real-world robotic tasks. Like prior work, our visual representations are pre-trained via a masked autoencoder (MAE), frozen, and then passed into a learnable control module. Unlike prior work, we show that the pre-trained representations are effective across a range of real-world robotic tasks and embodiments. We find that our encoder consistently outperforms CLIP (up to 75%), supervised ImageNet pre-training (up to 81%), and training from scratch (up to 81%). Finally, we train a 307M parameter vision transformer on a massive collection of 4.5M images from the Internet and egocentric videos, and demonstrate clearly the benefits of scaling visual pre-training for robot learning.


title: KiDS-1000: Combined halo-model cosmology constraints from galaxy abundance, galaxy clustering and galaxy-galaxy lensing

abstract: We present constraints on the flat $\Lambda$CDM cosmological model through a joint analysis of galaxy abundance, galaxy clustering and galaxy-galaxy lensing observables with the Kilo-Degree Survey. Our theoretical model combines a flexible conditional stellar mass function, to describe the galaxy-halo connection, with a cosmological N-body simulation-calibrated halo model to describe the non-linear matter field. Our magnitude-limited bright galaxy sample combines 9-band optical-to-near-infrared photometry with an extensive and complete spectroscopic training sample to provide accurate redshift and stellar mass estimates. Our faint galaxy sample provides a background of accurately calibrated lensing measurements. We constrain the structure growth parameter $S_8=\sigma_8\sqrt{\Omega_{\mathrm{m}}/0.3}=0.773^{+0.028}_{-0.030}$, and the matter density parameter $\Omega_{\mathrm{m}}=0.290^{+0.021}_{-0.017}$. The galaxy-halo connection model adopted in the work is shown to be in agreement with previous studies. Our constraints on cosmological parameters are comparable to, and consistent with, joint $3\times2{\mathrm{pt}}$ clustering-lensing analyses that additionally include a cosmic shear observable. This analysis therefore brings attention to the significant constraining power in the often-excluded non-linear scales for galaxy clustering and galaxy-galaxy lensing observables. By adopting a theoretical model that accounts for non-linear halo bias, halo exclusion, scale-dependent galaxy bias and the impact of baryon feedback, this work demonstrates the potential and a way forward to include non-linear scales in cosmological analyses. Varying the width of the satellite galaxy distribution with an additional parameter yields a strong preference for sub-Poissonian variance, improving the goodness of fit by 0.18 in reduced $\chi^{2}$ value compared to a fixed Poisson distribution.


title: Commutativity equations and their trigonometric solutions

abstract: We consider commutativity equations $F_i F_j =F_j F_i$ for a function $F(x^1, \dots, x^N),$ where $F_i$ is a matrix of the third order derivatives $F_{ikl}$. We show that under certain non-degeneracy conditions a solution $F$ satisfies the WDVV equations. Equivalently, the corresponding family of Frobenius algebras has the identity field $e$. We also study trigonometric solutions $F$ determined by a finite collection of vectors with multiplicities, and we give an explicit formula for $e$ for all the known such solutions. The corresponding collections of vectors are given by non-simply laced root systems or are related to their projections to the intersection of mirrors.


title: A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learning

abstract: Recent studies in Vision-and-Language Navigation (VLN) train RL agents to execute natural-language navigation instructions in photorealistic environments, as a step towards robots that can follow human instructions. However, given the scarcity of human instruction data and limited diversity in the training environments, these agents still struggle with complex language grounding and spatial language understanding. Pretraining on large text and image-text datasets from the web has been extensively explored but the improvements are limited. We investigate large-scale augmentation with synthetic instructions. We take 500+ indoor environments captured in densely-sampled 360 degree panoramas, construct navigation trajectories through these panoramas, and generate a visually-grounded instruction for each trajectory using Marky, a high-quality multilingual navigation instruction generator. We also synthesize image observations from novel viewpoints using an image-to-image GAN. The resulting dataset of 4.2M instruction-trajectory pairs is two orders of magnitude larger than existing human-annotated datasets, and contains a wider variety of environments and viewpoints. To efficiently leverage data at this scale, we train a simple transformer agent with imitation learning. On the challenging RxR dataset, our approach outperforms all existing RL agents, improving the state-of-the-art NDTW from 71.1 to 79.1 in seen environments, and from 64.6 to 66.8 in unseen test environments. Our work points to a new path to improving instruction-following agents, emphasizing large-scale imitation learning and the development of synthetic instruction generation capabilities.


title: IR-MCL: Implicit Representation-Based Online Global Localization

abstract: Determining the state of a mobile robot is an essential building block of robot navigation systems. In this paper, we address the problem of estimating the robots pose in an indoor environment using 2D LiDAR data and investigate how modern environment models can improve gold standard Monte-Carlo localization (MCL) systems. We propose a neural occupancy field to implicitly represent the scene using a neural network. With the pretrained network, we can synthesize 2D LiDAR scans for an arbitrary robot pose through volume rendering. Based on the implicit representation, we can obtain the similarity between a synthesized and actual scan as an observation model and integrate it into an MCL system to perform accurate localization. We evaluate our approach on self-recorded datasets and three publicly available ones. We show that we can accurately and efficiently localize a robot using our approach surpassing the localization performance of state-of-the-art methods. The experiments suggest that the presented implicit representation is able to predict more accurate 2D LiDAR scans leading to an improved observation model for our particle filter-based localization. The code of our approach will be available at: https://github.com/PRBonn/ir-mcl.


title: CLIP model is an Efficient Continual Learner

abstract: The continual learning setting aims to learn new tasks over time without forgetting the previous ones. The literature reports several significant efforts to tackle this problem with limited or no access to previous task data. Among such efforts, typical solutions offer sophisticated techniques involving memory replay, knowledge distillation, model regularization, and dynamic network expansion. The resulting methods have a retraining cost at each learning task, dedicated memory requirements, and setting-specific design choices. In this work, we show that a frozen CLIP (Contrastive Language-Image Pretraining) model offers astounding continual learning performance without any fine-tuning (zero-shot evaluation). We evaluate CLIP under a variety of settings including class-incremental, domain-incremental and task-agnostic incremental learning on five popular benchmarks (ImageNet-100 & 1K, CORe50, CIFAR-100, and TinyImageNet). Without any bells and whistles, the CLIP model outperforms the state-of-the-art continual learning approaches in the majority of the settings. We show the effect on the CLIP model's performance by varying text inputs with simple prompt templates. To the best of our knowledge, this is the first work to report the CLIP zero-shot performance in a continual setting. We advocate the use of this strong yet embarrassingly simple baseline for future comparisons in the continual learning tasks.


title: SimPer: Simple Self-Supervised Learning of Periodic Targets

abstract: From human physiology to environmental evolution, important processes in nature often exhibit meaningful and strong periodic or quasi-periodic changes. Due to their inherent label scarcity, learning useful representations for periodic tasks with limited or no supervision is of great benefit. Yet, existing self-supervised learning (SSL) methods overlook the intrinsic periodicity in data, and fail to learn representations that capture periodic or frequency attributes. In this paper, we present SimPer, a simple contrastive SSL regime for learning periodic information in data. To exploit the periodic inductive bias, SimPer introduces customized augmentations, feature similarity measures, and a generalized contrastive loss for learning efficient and robust periodic representations. Extensive experiments on common real-world tasks in human behavior analysis, environmental sensing, and healthcare domains verify the superior performance of SimPer compared to state-of-the-art SSL methods, highlighting its intriguing properties including better data efficiency, robustness to spurious correlations, and generalization to distribution shifts. Code and data are available at: https://github.com/YyzHarry/SimPer.


title: Content-Based Search for Deep Generative Models

abstract: The growing proliferation of customized and pretrained generative models has made it infeasible for a user to be fully cognizant of every model in existence. To address this need, we introduce the task of content-based model search: given a query and a large set of generative models, finding the models that best match the query. As each generative model produces a distribution of images, we formulate the search task as an optimization problem to select the model with the highest probability of generating similar content as the query. We introduce a formulation to approximate this probability given the query from different modalities, e.g., image, sketch, and text. Furthermore, we propose a contrastive learning framework for model retrieval, which learns to adapt features for various query modalities. We demonstrate that our method outperforms several baselines on Generative Model Zoo, a new benchmark we create for the model retrieval task.


title: MaPLe: Multi-modal Prompt Learning

abstract: Pre-trained vision-language (V-L) models such as CLIP have shown excellent generalization ability to downstream tasks. However, they are sensitive to the choice of input text prompts and require careful selection of prompt templates to perform well. Inspired by the Natural Language Processing (NLP) literature, recent CLIP adaptation approaches learn prompts as the textual inputs to fine-tune CLIP for downstream tasks. We note that using prompting to adapt representations in a single branch of CLIP (language or vision) is sub-optimal since it does not allow the flexibility to dynamically adjust both representation spaces on a downstream task. In this work, we propose Multi-modal Prompt Learning (MaPLe) for both vision and language branches to improve alignment between the vision and language representations. Our design promotes strong coupling between the vision-language prompts to ensure mutual synergy and discourages learning independent uni-modal solutions. Further, we learn separate prompts across different early stages to progressively model the stage-wise feature relationships to allow rich context learning. We evaluate the effectiveness of our approach on three representative tasks of generalization to novel classes, new target datasets and unseen domain shifts. Compared with the state-of-the-art method Co-CoOp, MaPLe exhibits favorable performance and achieves an absolute gain of 3.45% on novel classes and 2.72% on overall harmonic-mean, averaged over 11 diverse image recognition datasets. Our code and pre-trained models are available at https://github.com/muzairkhattak/multimodal-prompt-learning.


title: Unsupervised confidence for LiDAR depth maps and applications

abstract: Depth perception is pivotal in many fields, such as robotics and autonomous driving, to name a few. Consequently, depth sensors such as LiDARs rapidly spread in many applications. The 3D point clouds generated by these sensors must often be coupled with an RGB camera to understand the framed scene semantically. Usually, the former is projected over the camera image plane, leading to a sparse depth map. Unfortunately, this process, coupled with the intrinsic issues affecting all the depth sensors, yields noise and gross outliers in the final output. Purposely, in this paper, we propose an effective unsupervised framework aimed at explicitly addressing this issue by learning to estimate the confidence of the LiDAR sparse depth map and thus allowing for filtering out the outliers. Experimental results on the KITTI dataset highlight that our framework excels for this purpose. Moreover, we demonstrate how this achievement can improve a wide range of tasks.


title: Evaluating k-NN in the Classification of Data Streams with Concept Drift

abstract: Data streams are often defined as large amounts of data flowing continuously at high speed. Moreover, these data are likely subject to changes in data distribution, known as concept drift. Given all the reasons mentioned above, learning from streams is often online and under restrictions of memory consumption and run-time. Although many classification algorithms exist, most of the works published in the area use Naive Bayes (NB) and Hoeffding Trees (HT) as base learners in their experiments. This article proposes an in-depth evaluation of k-Nearest Neighbors (k-NN) as a candidate for classifying data streams subjected to concept drift. It also analyses the complexity in time and the two main parameters of k-NN, i.e., the number of nearest neighbors used for predictions (k), and window size (w). We compare different parameter values for k-NN and contrast it to NB and HT both with and without a drift detector (RDDM) in many datasets. We formulated and answered 10 research questions which led to the conclusion that k-NN is a worthy candidate for data stream classification, especially when the run-time constraint is not too restrictive.


title: GBSVM: Granular-ball Support Vector Machine

abstract: GBSVM (Granular-ball Support Vector Machine) is a significant attempt to construct a classifier using the coarse-to-fine granularity of a granular-ball as input, rather than a single data point. It is the first classifier whose input contains no points. However, the existing model has some errors, and its dual model has not been derived. As a result, the current algorithm cannot be implemented or applied. To address these problems, this paper has fixed the errors of the original model of the existing GBSVM, and derived its dual model. Furthermore, a particle swarm optimization algorithm is designed to solve the dual model. The sequential minimal optimization algorithm is also carefully designed to solve the dual model. The solution is faster and more stable than the particle swarm optimization based version. The experimental results on the UCI benchmark datasets demonstrate that GBSVM has good robustness and efficiency. All codes have been released in the open source library at http://www.cquptshuyinxia.com/GBSVM.html or https://github.com/syxiaa/GBSVM.


title: On the complex zeros of the Riemann Zeta-function

abstract: The purpose of this paper is to prove that the so-called Quasi-Riemann Hypothesis for the Zeta-function implies the Riemann Hypothesis


title: Temporal Spatial Decomposition and Fusion Network for Time Series Forecasting

abstract: Feature engineering is required to obtain better results for time series forecasting, and decomposition is a crucial one. One decomposition approach often cannot be used for numerous forecasting tasks since the standard time series decomposition lacks flexibility and robustness. Traditional feature selection relies heavily on preexisting domain knowledge, has no generic methodology, and requires a lot of labor. However, most time series prediction models based on deep learning typically suffer from interpretability issue, so the "black box" results lead to a lack of confidence. To deal with the above issues forms the motivation of the thesis. In the paper we propose TSDFNet as a neural network with self-decomposition mechanism and an attentive feature fusion mechanism, It abandons feature engineering as a preprocessing convention and creatively integrates it as an internal module with the deep model. The self-decomposition mechanism empowers TSDFNet with extensible and adaptive decomposition capabilities for any time series, users can choose their own basis functions to decompose the sequence into temporal and generalized spatial dimensions. Attentive feature fusion mechanism has the ability to capture the importance of external variables and the causality with target variables. It can automatically suppress the unimportant features while enhancing the effective ones, so that users do not have to struggle with feature selection. Moreover, TSDFNet is easy to look into the "black box" of the deep neural network by feature visualization and analyze the prediction results. We demonstrate performance improvements over existing widely accepted models on more than a dozen datasets, and three experiments showcase the interpretability of TSDFNet.


title: On the Effectiveness of Hybrid Pooling in Mixup-Based Graph Learning for Language Processing

abstract: Graph neural network (GNN)-based graph learning has been popular in natural language and programming language processing, particularly in text and source code classification. Typically, GNNs are constructed by incorporating alternating layers which learn transformations of graph node features, along with graph pooling layers that use graph pooling operators (e.g., Max-pooling) to effectively reduce the number of nodes while preserving the semantic information of the graph. Recently, to enhance GNNs in graph learning tasks, Manifold-Mixup, a data augmentation technique that produces synthetic graph data by linearly mixing a pair of graph data and their labels, has been widely adopted. However, the performance of Manifold-Mixup can be highly affected by graph pooling operators, and there have not been many studies that are dedicated to uncovering such affection. To bridge this gap, we take an early step to explore how graph pooling operators affect the performance of Mixup-based graph learning. To that end, we conduct a comprehensive empirical study by applying Manifold-Mixup to a formal characterization of graph pooling based on 11 graph pooling operations (9 hybrid pooling operators, 2 non-hybrid pooling operators). The experimental results on both natural language datasets (Gossipcop, Politifact) and programming language datasets (JAVA250, Python800) demonstrate that hybrid pooling operators are more effective for Manifold-Mixup than the standard Max-pooling and the state-of-the-art graph multiset transformer (GMT) pooling, in terms of producing more accurate and robust GNN models.


title: Learning Transfer Operators by Kernel Density Estimation

abstract: Inference of transfer operators from data is often formulated as a classical problem that hinges on the Ulam method. The conventional description, known as the Ulam-Galerkin method, involves projecting onto basis functions represented as characteristic functions supported over a fine grid of rectangles. From this perspective, the Ulam-Galerkin approach can be interpreted as density estimation using the histogram method. In this study, we recast the problem within the framework of statistical density estimation. This alternative perspective allows for an explicit and rigorous analysis of bias and variance, thereby facilitating a discussion on the mean square error. Through comprehensive examples utilizing the logistic map and a Markov map, we demonstrate the validity and effectiveness of this approach in estimating the eigenvectors of the Frobenius-Perron operator. We compare the performance of Histogram Density Estimation(HDE) and Kernel Density Estimation(KDE) methods and find that KDE generally outperforms HDE in terms of accuracy. However, it is important to note that KDE exhibits limitations around boundary points and jumps. Based on our research findings, we suggest the possibility of incorporating other density estimation methods into this field and propose future investigations into the application of KDE-based estimation for high-dimensional maps. These findings provide valuable insights for researchers and practitioners working on estimating the Frobenius-Perron operator and highlight the potential of density estimation techniques in this area of study. Keywords: Transfer Operators; Frobenius-Perron operator; probability density estimation; Ulam-Galerkin method; Kernel Density Estimation; Histogram Density Estimation.

categories: cs.LG cs.IT math.DS math.IT math.ST stat.CO stat.TH


title: Tunable superconductivity and M\"obius Fermi surfaces in an inversion-symmetric twisted van der Waals heterostructure

abstract: We study theoretically a moir\'e superlattice geometry consisting of mirror-symmetric twisted trilayer graphene surrounded by identical transition metal dichalcogenide layers. We show that this setup allows to switch on/off and control the spin-orbit splitting of the Fermi surfaces via application of a perpendicular displacement field $D_0$, and explore two manifestations of this control: first, we compute the evolution of superconducting pairing with $D_0$; this features a complex admixture of singlet and triplet pairing and, depending on the pairing state in the parent trilayer system, phase transitions between competing superconducting phases. Second, we reveal that, with application of $D_0$, the spin-orbit-induced spin textures exhibit vortices which lead to "M\"obius fermi surfaces'' in the interior of the Brillouin zone: diabatic electron trajectories, which are predicted to dominate quantum oscillation experiments, require encircling the $\Gamma$ point twice, making their M\"obius nature directly observable. We further show that the superconducting order parameter inherits the unconventional, M\"obius spin textures. Our findings suggest that this system provides a promising experimental avenue for studying systematically the impact of spin-orbit coupling on the multitude of topological and correlated phases in near-magic-angle twisted trilayer graphene.


title: Boosting Asymmetric Charged DM via Thermalization

abstract: We consider a dark sector scenario with two dark matter species with opposite dark $U(1)$ charges and an asymmetric population comprising some fraction of the dark matter abundance. A new mechanism for boosting dark matter is introduced, arising from the large mass hierarchy between the two particles. In the galaxy, the two species thermalize efficiently through dark Rutherford scattering greatly boosting the lighter dark matter particle, far above the virial and escape velocities in the galaxy, while the dark charge prevents it from escaping. We study the consequences of this scenario for direct-detection experiments, assuming a kinetic mixing between the dark photon and the photon. If the charged dark sector makes up 5% of the total DM mass in our galaxy and the mass ratio is between $10^3-10^4$, we find that current and future experiments may probe the boosted light dark matter for masses down to 100 keV, in a hitherto unexplored parameter range.


title: Lifshitz gauge duality

abstract: Motivated by a variety of realizations of the compact Lifshitz model I derive its fractonic gauge dual. The resulting U(1) vector gauge theory efficiently and robustly encodes the restricted mobility of its dipole conserving charged matter and the corresponding topological vortex defects. The gauge theory provides a transparent formulation of the three phases of the Lifshitz model and gives a field theoretic formulation of the associated two-stage Higgs transitions.


title: Snowmass Topical Summary: Formal QFT

abstract: We attempt to give a broad conceptual overview of modern quantum field theory, highlighting important recent developments. This report serves as the TF03 topical group summary for Snowmass 2021.

categories: hep-th cond-mat.stat-mech hep-lat hep-ph math-ph math.MP


title: Detecting Accelerating Eccentric Binaries in the LISA Band

abstract: Many gravitational wave (GW) sources in the LISA band are expected to have non-negligible eccentricity. Furthermore, many of them can undergo acceleration because they reside in the presence of a tertiary. Here we develop analytical and numerical methods to quantify how the compact binary's eccentricity enhances the detection of its peculiar acceleration. We show that the general relativistic precession pattern can disentangle the binary's acceleration-induced frequency shift from the chirp-mass-induced frequency shift in GW template fitting, thus relaxing the signal-to-noise ratio requirement for distinguishing the acceleration by a factor of $10\sim100$. Moreover, by adopting the GW templates of the accelerating eccentric compact binaries, we can enhance the acceleration measurement accuracy by a factor of $\sim100$, compared to the zero-eccentricity case, and detect the source's acceleration even if it does not change during the observational time. For example, a stellar-mass binary black hole (BBH) with moderate eccentricity in the LISA band yields an error of the acceleration measurement $\sim10^{-7}m\cdot s^{-2}$ for $\rm{SNR}=20$ and observational time of $4$ yrs. In this example, we can measure the BBHs' peculiar acceleration even when it is $\sim1\rm pc$ away from a $4\times 10^{6}\rm M_{\odot}$ SMBH. Our results highlight the importance of eccentricity to the LISA-band sources and show the necessity of developing GW templates for accelerating eccentric compact binaries.


title: Mapping Variations of Redshift Distributions with Probability Integral Transforms

abstract: We present a method for mapping variations between probability distribution functions and apply this method within the context of measuring galaxy redshift distributions from imaging survey data. This method, which we name PITPZ for the probability integral transformations it relies on, uses a difference in curves between distribution functions in an ensemble as a transformation to apply to another distribution function, thus transferring the variation in the ensemble to the latter distribution function. This procedure is broadly applicable to the problem of uncertainty propagation. In the context of redshift distributions, for example, the uncertainty contribution due to certain effects can be studied effectively only in simulations, thus necessitating a transfer of variation measured in simulations to the redshift distributions measured from data. We illustrate the use of PITPZ by using the method to propagate photometric calibration uncertainty to redshift distributions of the Dark Energy Survey Year 3 weak lensing source galaxies. For this test case, we find that PITPZ yields a lensing amplitude uncertainty estimate due to photometric calibration error within 1 per cent of the truth, compared to as much as a 30 per cent underestimate when using traditional methods.


title: Metal-insulator transition in a 2D system of chiral unitary class

abstract: We perform a numerical investigation of Anderson metal-insulator transition (MIT) in a twodimensional system of chiral symmetry class AIII by combining finite-size scaling, transport, density of states, and multifractality studies. The results are in agreement with the sigma-model renormalization-group theory, where MIT is driven by proliferation of vortices. We determine the phase diagram and find an apparent non-universality of several parameters on the critical line of MIT, which is consistent with the analytically predicted slow renormalization towards the ultimate fixed point of the MIT. The localization-length exponent $\nu$ is estimated as $\nu = 1.55 \pm 0.10$.


title: Measuring properties of primordial black hole mergers at cosmological distances: effect of higher order modes in gravitational waves

abstract: Primordial black holes (PBHs) may form from the collapse of matter overdensities shortly after the Big Bang. One may identify their existence by observing gravitational wave (GW) emissions from merging PBH binaries at high redshifts $z\gtrsim 30$, where astrophysical binary black holes (BBHs) are unlikely to merge. The next-generation ground-based GW detectors, Cosmic Explorer and Einstein Telescope, will be able to observe BBHs with total masses of $\mathcal{O}(10-100)~M_{\odot}$ at such redshifts. This paper serves as a companion paper of arXiv:2108.07276, focusing on the effect of higher-order modes (HoMs) in the waveform modeling, which may be detectable for these high redshift BBHs, on the estimation of source parameters. We perform Bayesian parameter estimation to obtain the measurement uncertainties with and without HoM modeling in the waveform for sources with different total masses, mass ratios, orbital inclinations and redshifts observed by a network of next-generation GW detectors. We show that including HoMs in the waveform model reduces the uncertainties of redshifts and masses by up to a factor of two, depending on the exact source parameters. We then discuss the implications for identifying PBHs with the improved single-event measurements, and expand the investigation of the model dependence of the relative abundance between the BBH mergers originating from the first stars and the primordial BBH mergers as shown in arXiv:2108.07276.


title: Abundance and temperature of the outer hot circum-Galactic medium: The SRG/eROSITA view of the soft X-ray background in the eFEDS field

abstract: Despite their vital importance to understand galaxy evolution and our own Galactic ecosystem, our knowledge of the physical properties of the hot phase of the Milky Way is still inadequate. However, sensitive SRG/eROSITA large area surveys are now providing us with the long sought-after data needed to mend this state of affairs. We present the properties of the soft X-ray emission as observed by eROSITA in the eFEDS field. We measure the temperature and metal abundance of the hot circum-Galactic medium (CGM) to be within $kT_{CGM}=0.153-0.178$ keV and $Z_{CGM}=0.052-0.072$ $Z_\odot$, depending on the contribution of solar wind charge exchange (SWCX). Slightly larger CGM abundances $Z_{CGM}=0.05-0.10$ $Z_\odot$ are possible, considering the uncertain extrapolation of the extragalactic Cosmic X-ray background (CXB) emission below $\sim1$ keV. To recover CGM abundances as large as $Z_{CGM}=0.3$ $Z_\odot$, it must be postulated the presence of an additional component, likely associated with the warm-hot intergalactic medium, providing $\sim15-20$% of the flux in the soft X-ray band. The emission in the soft band is dominated by the CGM, with contributions from the CXB and the local hot bubble. Moreover, the eROSITA data require the presence of an additional component associated with the elusive Galactic corona plus a possible contribution from unresolved M dwarf stars. This component has a temperature of $kT\sim0.4-0.7$ keV and it might be out of thermal equilibrium. It contributes $\sim9$% to the total emission in the 0.6--2 keV band, therefore it is a likely candidate to produce part of the unresolved CXB flux observed in X-ray ultra-deep fields. We also observe a significant contribution to the soft X-ray flux due to SWCX, during periods characterised by stronger solar wind activity, and causing the largest uncertainty on the determination of the CGM temperature.


title: Entanglement Entropy of Free Fermions in Timelike Slices

abstract: We define the entanglement entropy of free fermion quantum states in an arbitrary spacetime slice of a discrete set of points, and particularly investigate timelike (causal) slices. For 1D lattice free fermions with an energy bandwidth $E_0$, we calculate the time-direction entanglement entropy $S_A$ in a time-direction slice of a set of times $t_n=n\tau$ ($1\le n\le K$) spanning a time length $t$ on the same site. For zero temperature ground states, we find that $S_A$ shows volume law when $\tau\gg\tau_0=2\pi/E_0$; in contrast, $S_A\sim \frac{1}{3}\ln t$ when $\tau=\tau_0$, and $S_A\sim\frac{1}{6}\ln t$ when $\tau<\tau_0$, resembling the Calabrese-Cardy formula for one flavor of nonchiral and chiral fermion, respectively. For finite temperature thermal states, the mutual information also saturates when $\tau<\tau_0$. For non-eigenstates, volume law in $t$ and signatures of the Lieb-Robinson bound velocity can be observed in $S_A$. For generic spacetime slices with one point per site, the zero temperature entanglement entropy shows a clear transition from area law to volume law when the slice varies from spacelike to timelike.


title: The hidden side of cosmic star formation at z > 3: Bridging optically-dark and Lyman break galaxies with GOODS-ALMA

abstract: Our current understanding of the cosmic star formation history at z>3 is primarily based on UV-selected galaxies (i.e., LBGs). Recent studies of H-dropouts have revealed that we may be missing a large proportion of star formation that is taking place in massive galaxies at z>3. In this work, we extend the H-dropout criterion to lower masses to select optically dark/faint galaxies (OFGs), in order to complete the census between LBGs and H-dropouts. Our criterion (H> 26.5 mag & [4.5] < 25 mag) combined with a de-blending technique is designed to select not only extremely dust-obscured massive galaxies but also normal star-forming galaxies. In total, we identified 27 OFGs at z_phot > 3 (z_med=4.1) in the GOODS-ALMA field, covering a wide distribution of stellar masses with log($M_{\star}$/$M_{\odot}$) = 9.4-11.1. We find that up to 75% of the OFGs with log($M_{\star}$/$M_{\odot}$) = 9.5-10.5 were neglected by previous LBGs and H-dropout selection techniques. After performing stacking analyses, the OFGs exhibit shorter gas depletion timescales, slightly lower gas fractions, and lower dust temperatures than typical star-forming galaxies. Their SFR_tot (SFR_ IR+SFR_UV) is much larger than SFR_UVcorr (corrected for dust extinction), with SFR_tot/SFR_UVcorr = $8\pm1$, suggesting the presence of hidden dust regions in the OFGs that absorb all UV photons. The average dust size measured by a circular Gaussian model fit is R_e(1.13 mm)=1.01$\pm$0.05 kpc. We find that the cosmic SFRD at z>3 contributed by massive OFGs is at least two orders of magnitude higher than the one contributed by equivalently massive LBGs. Finally, we calculate the combined contribution of OFGs and LBGs to the cosmic SFRD at z=4-5 to be 4 $\times$ 10$^{-2}$ $M_{\odot}$ yr$^{-1}$Mpc$^{-3}$, which is about 0.15 dex (43%) higher than the SFRD derived from UV-selected samples alone at the same redshift.


title: Variational Quantum Continuous Optimization: a Cornerstone of Quantum Mathematical Analysis

abstract: Here we show how universal quantum computers based on the quantum circuit model can handle mathematical analysis calculations for functions with continuous domains, without any digitalization, and with remarkably few qubits. The basic building block of our approach is a variational quantum circuit where each qubit encodes up to three continuous variables (two angles and one radious in the Bloch sphere). By combining this encoding with quantum state tomography, a variational quantum circuit of $n$ qubits can optimize functions of up to $3n$ continuous variables in an analog way. We then explain how this quantum algorithm for continuous optimization is at the basis of a whole toolbox for mathematical analysis on quantum computers. For instance, we show how to use it to compute arbitrary series expansions such as, e.g., Fourier (harmonic) decompositions. In turn, Fourier analysis allows us to implement essentially any task related to function calculus, including the evaluation of multidimensional definite integrals, solving (systems of) differential equations, and more. To prove the validity of our approach, we provide benchmarking calculations for many of these use-cases implemented on a quantum computer simulator. The advantages with respect to classical algorithms for mathematical analysis, as well as perspectives and possible extensions, are also discussed.


title: Deep Inventory Management

abstract: This work provides a Deep Reinforcement Learning approach to solving a periodic review inventory control system with stochastic vendor lead times, lost sales, correlated demand, and price matching. While this dynamic program has historically been considered intractable, our results show that several policy learning approaches are competitive with or outperform classical methods. In order to train these algorithms, we develop novel techniques to convert historical data into a simulator. On the theoretical side, we present learnability results on a subclass of inventory control problems, where we provide a provable reduction of the reinforcement learning problem to that of supervised learning. On the algorithmic side, we present a model-based reinforcement learning procedure (Direct Backprop) to solve the periodic review inventory control problem by constructing a differentiable simulator. Under a variety of metrics Direct Backprop outperforms model-free RL and newsvendor baselines, in both simulations and real-world deployments.


title: Partition function approach to non-Gaussian likelihoods: Formalism and expansions for weakly non-Gaussian cosmological inference

abstract: Non-Gaussian likelihoods, ubiquitous throughout cosmology, are a direct consequence of nonlinearities in the physical model. Their treatment requires Monte-Carlo Markov-chain or more advanced sampling methods for the determination of confidence contours. As an alternative, we construct canonical partition functions as Laplace-transforms of the Bayesian evidence, from which MCMC-methods would sample microstates. Cumulants of order $n$ of the posterior distribution follow by direct $n$-fold differentiation of the logarithmic partition function, recovering the classic Fisher-matrix formalism at second order. We connect this approach for weakly non-Gaussianities to the DALI- and Gram-Charlier expansions and demonstrate the validity with a supernova-likelihood on the cosmological parameters $\Omega_m$ and $w$. We comment on extensions of the canonical partition function to include kinetic energies in order to bridge to Hamilton Monte-Carlo sampling, and on ensemble Markov-chain methods, as they would result from transitioning to macrocanonical partition functions depending on a chemical potential. Lastly we demonstrate the relationship of the partition function approach to the Cram\'er-Rao boundary and to information entropies.


title: Stochastic normalizing flows for lattice field theory

abstract: Stochastic normalizing flows are a class of deep generative models that combine normalizing flows with Monte Carlo updates and can be used in lattice field theory to sample from Boltzmann distributions. In this proceeding, we outline the construction of these hybrid algorithms, pointing out that the theoretical background can be related to Jarzynski's equality, a non-equilibrium statistical mechanics theorem that has been successfully used to compute free energy in lattice field theory. We conclude with examples of applications to the two-dimensional $\phi^4$ field theory.


title: Toward the ultimate reach of current imaging atmospheric Cherenkov telescopes and their sensitivity to TeV dark matter

abstract: Indirect detection opens a unique window for probing thermal dark matter (DM): the same annihilation process that determined the relic abundance in the early Universe drives the present day astrophysical signal. While TeV-scale particles weakly coupled to the Standard Model face undoubted challenges from decades of null searches, the scenario remains compelling, and simple realizations such as Higgsino DM remain largely unexplored. The fate of such scenarios could be determined by gamma-ray observations of the centre of the Milky Way with Imaging Atmospheric Cherenkov Telescopes (IACTs). We consider the ultimate sensitivity of current IACTs to a broad range of TeV-scale DM candidates - including specific ones such as the Wino, Higgsino, and Quintuplet. To do so, we use realistic mock H.E.S.S.-like observations of the inner Milky Way halo, and provide a careful assessment of the impact of recent Milky Way mass modeling, instrumental and astrophysical background uncertainties in the Galactic Center region, and the theoretical uncertainty on the predicted signal. We find that the dominant systematic for IACT searches in the inner Galaxy is the unknown distribution of DM in that region, however, beyond this the searches are currently statistically dominated indicating a continued benefit from more observations. For two-body final states at $1~{\rm TeV}$, we find a H.E.S.S.-like observatory is sensitive to $\langle \sigma v \rangle \sim 3 \times 10^{-26}-4 \times 10^{-25}~{\rm cm}^3{\rm s}^{-1}$, except for neutrino final states, although we find results competitive with ANTARES. In addition, the thermal masses for the Wino and Quintuplet can be probed; the Higgsino continues to be out of reach by at least a factor of a few. Our conclusions are also directly relevant to the next generation Cherenkov Telescope Array, which remains well positioned to be the discovery instrument for thermal DM.


title: Dissipative stabilization of dark quantum dimers via squeezed vacuum

abstract: Understanding the mechanism through which an open quantum system exchanges information with an environment is central to the creation and stabilization of quantum states. This theme has been explored recently, with attention mostly focused on system control or environment engineering. Here, we bring these ideas together to describe the many-body dynamics of an extended atomic array coupled to a squeezed vacuum. We show that fluctuations can drive the array into a pure dark state decoupled from the environment. The dark state is obtained for an even number of atoms and consists of maximally entangled atomic pairs, or dimers, that mimic the behavior of the squeezed field. Each pair displays reduced fluctuations in one polarization quadrature and amplified in another. This dissipation-induced stabilization relies on an efficient transfer of correlations between pairs of photons and atoms. It uncovers the mechanism through which squeezed light causes an atomic array to self-organize and illustrates the increasing importance of spatial correlations in modern quantum technologies where many-body effects play a central role.


title: On Distillation of Guided Diffusion Models

abstract: Classifier-free guided diffusion models have recently been shown to be highly effective at high-resolution image generation, and they have been widely used in large-scale diffusion frameworks including DALLE-2, Stable Diffusion and Imagen. However, a downside of classifier-free guided diffusion models is that they are computationally expensive at inference time since they require evaluating two diffusion models, a class-conditional model and an unconditional model, tens to hundreds of times. To deal with this limitation, we propose an approach to distilling classifier-free guided diffusion models into models that are fast to sample from: Given a pre-trained classifier-free guided model, we first learn a single model to match the output of the combined conditional and unconditional models, and then we progressively distill that model to a diffusion model that requires much fewer sampling steps. For standard diffusion models trained on the pixel-space, our approach is able to generate images visually comparable to that of the original model using as few as 4 sampling steps on ImageNet 64x64 and CIFAR-10, achieving FID/IS scores comparable to that of the original model while being up to 256 times faster to sample from. For diffusion models trained on the latent-space (e.g., Stable Diffusion), our approach is able to generate high-fidelity images using as few as 1 to 4 denoising steps, accelerating inference by at least 10-fold compared to existing methods on ImageNet 256x256 and LAION datasets. We further demonstrate the effectiveness of our approach on text-guided image editing and inpainting, where our distilled model is able to generate high-quality results using as few as 2-4 denoising steps.


title: Imaging Scatterometer for Observing In-Situ Changes to Optical Coatings During Air Annealing

abstract: Annealing of amorphous optical coatings has been shown to generally reduce optical absorption, optical scattering, and mechanical loss, with higher temperature annealing giving better results. The achievable maximum temperatures are limited to the levels at which coating damage, such as crystallization, cracking, or bubbling will occur. Coating damage caused by heating is typically only observed statically, after annealing. An experimental method to dynamically observe how and over what temperature range such damage occurs during annealing is desirable as its results could inform manufacturing and annealing processes to ultimately achieve better coating performance. We developed a new instrument that features an industrial annealing oven with holes cut into its sides for viewports to illuminate optical samples and observe their coating scatter and eventual damage mechanisms in-situ and in real-time during annealing. We present results that demonstrate in-situ observation of changes to titania-doped tantala coatings on fused silica substrates. We obtain a spatial image (mapping) of the evolution of these changes during annealing, an advantage over x-ray diffraction, electron beam, or Raman methods. We infer, based on other experiments in the literature, these changes to be due to crystallization. We further discuss the utility of this apparatus for observing other forms of coating damage such as cracking and blisters.


title: Wafer-scale detachable monocrystalline Germanium nanomembranes for the growth of III-V materials and substrate reuse

abstract: Germanium (Ge) is increasingly used as a substrate for high-performance optoelectronic, photovoltaic, and electronic devices. These devices are usually grown on thick and rigid Ge substrates manufactured by classical wafering techniques. Nanomembranes (NMs) provide an alternative to this approach while offering wafer-scale lateral dimensions, weight reduction, limitation of waste, and cost effectiveness. Herein, we introduce the Porous germanium Efficient Epitaxial LayEr Release (PEELER) process, which consists of the fabrication of wafer-scale detachable monocrystalline Ge NMs on porous Ge (PGe) and substrate reuse. We demonstrate monocrystalline Ge NMs with surface roughness below 1 nm on top of nanoengineered void layer enabling layer detachment. Furthermore, these Ge NMs exhibit compatibility with the growth of III-V materials. High-resolution transmission electron microscopy (HRTEM) characterization shows Ge NMs crystallinity and high-resolution X-ray diffraction (HRXRD) reciprocal space mapping endorses high-quality GaAs layers. Finally, we demonstrate the chemical reconditioning process of the Ge substrate, allowing its reuse, to produce multiple free-standing NMs from a single parent wafer. The PEELER process significantly reduces the consumption of Ge during the fabrication process which paves the way for a new generation of low-cost flexible optoelectronics devices.


title: Snowmass 2021 Topical Report on Synergies in Research at Underground Facilities

abstract: This is a Snowmass 2021 Topical Report for the Underground Facilities and Infrastructure Frontier on Synergies in Research at Underground Facilities: A broad range of scientific and engineering research is possible in underground laboratories, beyond the physics-focused activities described in the other Underground Facilities and Infrastructure Topical Reports. These areas of research include nuclear astrophysics, geology, geoengineering, gravitational wave detection, biology, and perhaps soon quantum information science. This UF Topical Report will survey those other scientific and engineering research activities that share interest in research-orientated Underground Facilities and Infrastructure. In most cases the breadth and depth of research aims is too large to cover in completeness and references to surveys or key documents for those fields are provided after introductory summaries. Additional attention is then given to shared, similar, and unique needs of each research area with respect to the broader underground research community's Underground Facilities and Infrastructure needs. Where potential conflicts of usage type, site, or duration might arise, these are identified.


title: Snowmass TF04 Report: Scattering Amplitudes and their Applications

abstract: The field of scattering amplitudes plays a central role in elementary-particle physics. This includes various problems of broader interest for collider physics, gravitational physics, and fundamental principles underlying quantum field theory. We describe various applications and theoretical advances pointing towards novel descriptions of quantum field theories. Comments on future prospects are included.


title: APLC-Optimization: an apodized pupil Lyot coronagraph design survey toolkit

abstract: We present a publicly available software package developed for exploring apodized pupil Lyot coronagraph (APLC) solutions for various telescope architectures. In particular, the package optimizes the apodizer component of the APLC for a given focal-plane mask and Lyot stop geometry to meet a set of constraints (contrast, bandwidth etc.) on the coronagraph intensity in a given focal-plane region (i.e. dark zone). The package combines a high-contrast imaging simulation package HCIPy with a third-party mathematical optimizer (Gurobi) to compute the linearly optimized binary mask that maximizes transmission. We provide examples of the application of this toolkit to several different telescope geometries, including the Gemini Planet Imager (GPI) and the High-contrast imager for Complex Aperture Telescopes (HiCAT) testbed. Finally, we summarize the results of a preliminary design survey for the case of a 6~m aperture off-axis space telescope, as recommended by the 2020 NASA Decadal Survey, exploring APLC solutions for different segment sizes. We then use the Pair-based Analytical model for Segmented Telescope Imaging from Space (PASTIS) to perform a segmented wavefront error tolerancing analysis on these solutions.


title: On the deck groups of iterates of bicritical rational maps

abstract: Given a rational map $f:\widehat{\mathbb C}\to\widehat{\mathbb C}$ on the Riemann sphere, we define $\mathrm{Deck}(f)$ to be the group of M\"obius transformations $\mu$ satisfying $f \circ \mu = f$. In this note, we consider the groups $\mathrm{Deck}(f^k)$, where $f$ is a \emph{bicritical} rational map (that is, a rational map with exactly two critical points) and $f^k$ denotes the $k$th iterate of $f$. In particular, we give a complete description of which groups (up to isomorphism) arise as the groups $\mathrm{Deck}(f^k)$ for bicritical rational maps $f$.


title: Towards anisotropic cosmology in group field theory

abstract: In cosmological group field theory (GFT) models for quantum gravity coupled to a massless scalar field the total volume, seen as a function of the scalar field, follows the classical Friedmann dynamics of a flat Friedmann-Lema\^itre-Robertson-Walker (FLRW) Universe at low energies while resolving the Big Bang singularity at high energies. An open question is how to generalise these results to other homogeneous cosmologies. Here we take the first steps towards studying anisotropic Bianchi models in GFT, based on the introduction of a new anisotropy observable analogous to the $\beta$ variables in Misner's parametrisation. In a classical Bianchi I spacetime, $\beta$ behaves as a massless scalar field and can be used as a (gravitational) relational clock. We construct a GFT model for which in an expanding Universe $\beta$ initially behaves like its classical analogue before "decaying" showing a previously studied isotropisation. We support numerical results in GFT by analytical approximations in a toy model. One possible outcome of our work is a definition of relational dynamics in GFT that does not require matter.


title: Towards Out-of-Distribution Adversarial Robustness

abstract: Adversarial robustness continues to be a major challenge for deep learning. A core issue is that robustness to one type of attack often fails to transfer to other attacks. While prior work establishes a theoretical trade-off in robustness against different $L_p$ norms, we show that there is potential for improvement against many commonly used attacks by adopting a domain generalisation approach. Concretely, we treat each type of attack as a domain, and apply the Risk Extrapolation method (REx), which promotes similar levels of robustness against all training attacks. Compared to existing methods, we obtain similar or superior worst-case adversarial robustness on attacks seen during training. Moreover, we achieve superior performance on families or tunings of attacks only encountered at test time. On ensembles of attacks, our approach improves the accuracy from 3.4% with the best existing baseline to 25.9% on MNIST, and from 16.9% to 23.5% on CIFAR10.


title: Integrative Imaging Informatics for Cancer Research: Workflow Automation for Neuro-oncology (I3CR-WANO)

abstract: Efforts to utilize growing volumes of clinical imaging data to generate tumor evaluations continue to require significant manual data wrangling owing to the data heterogeneity. Here, we propose an artificial intelligence-based solution for the aggregation and processing of multisequence neuro-oncology MRI data to extract quantitative tumor measurements. Our end-to-end framework i) classifies MRI sequences using an ensemble classifier, ii) preprocesses the data in a reproducible manner, iii) delineates tumor tissue subtypes using convolutional neural networks, and iv) extracts diverse radiomic features. Moreover, it is robust to missing sequences and adopts an expert-in-the-loop approach, where the segmentation results may be manually refined by radiologists. Following the implementation of the framework in Docker containers, it was applied to two retrospective glioma datasets collected from the Washington University School of Medicine (WUSM; n = 384) and the M.D. Anderson Cancer Center (MDA; n = 30) comprising preoperative MRI scans from patients with pathologically confirmed gliomas. The scan-type classifier yielded an accuracy of over 99%, correctly identifying sequences from 380/384 and 30/30 sessions from the WUSM and MDA datasets, respectively. Segmentation performance was quantified using the Dice Similarity Coefficient between the predicted and expert-refined tumor masks. Mean Dice scores were 0.882 ($\pm$0.244) and 0.977 ($\pm$0.04) for whole tumor segmentation for WUSM and MDA, respectively. This streamlined framework automatically curated, processed, and segmented raw MRI data of patients with varying grades of gliomas, enabling the curation of large-scale neuro-oncology datasets and demonstrating a high potential for integration as an assistive tool in clinical practice.


title: Intersections of orbits of self-maps with subgroups in semiabelian varieties

abstract: Let $G$ be a semiabelian variety defined over an algebraically closed field $K$, endowed with a rational self-map $\Phi$. Let $\alpha\in G(K)$ and let $\Gamma\subseteq G(K)$ be a finitely generated subgroup. We show that the set $\{n\in\mathbb{N}\colon \Phi^n(\alpha)\in \Gamma\}$ is a union of finitely many arithmetic progressions along with a set of Banach density equal to $0$. In addition, assuming $\Phi$ is regular, we prove that the set $S$ must be finite.


title: Reviving product states in the disordered Heisenberg chain

abstract: When a generic quantum system is prepared in a simple initial condition, it typically equilibrates toward a state that can be described by a thermal ensemble. A known exception are localized systems which are non-ergodic and do not thermalize, however local observables are still believed to become stationary. Here we demonstrate that this general picture is incomplete by constructing product states which feature periodic high-fidelity revivals of the full wavefunction and local observables that oscillate indefinitely. The system neither equilibrates nor thermalizes. This is analogous to the phenomenon of weak ergodicity breaking due to many-body scars and challenges aspects of the current MBL phenomenology, such as the logarithmic growth of the entanglement entropy. To support our claim, we combine analytic arguments with large-scale tensor network numerics for the disordered Heisenberg chain. Our results hold for arbitrarily long times in chains of 160 sites up to machine precision.


title: Comparison of Missing Data Imputation Methods using the Framingham Heart study dataset

abstract: Cardiovascular disease (CVD) is a class of diseases that involve the heart or blood vessels and according to World Health Organization is the leading cause of death worldwide. EHR data regarding this case, as well as medical cases in general, contain missing values very frequently. The percentage of missingness may vary and is linked with instrument errors, manual data entry procedures, etc. Even though the missing rate is usually significant, in many cases the missing value imputation part is handled poorly either with case-deletion or with simple statistical approaches such as mode and median imputation. These methods are known to introduce significant bias, since they do not account for the relationships between the dataset's variables. Within the medical framework, many datasets consist of lab tests or patient medical tests, where these relationships are present and strong. To address these limitations, in this paper we test and modify state-of-the-art missing value imputation methods based on Generative Adversarial Networks (GANs) and Autoencoders. The evaluation is accomplished for both the tasks of data imputation and post-imputation prediction. Regarding the imputation task, we achieve improvements of 0.20, 7.00% in normalised Root Mean Squared Error (RMSE) and Area Under the Receiver Operating Characteristic Curve (AUROC) respectively. In terms of the post-imputation prediction task, our models outperform the standard approaches by 2.50% in F1-score.


title: Understanding Neural Coding on Latent Manifolds by Sharing Features and Dividing Ensembles

abstract: Systems neuroscience relies on two complementary views of neural data, characterized by single neuron tuning curves and analysis of population activity. These two perspectives combine elegantly in neural latent variable models that constrain the relationship between latent variables and neural activity, modeled by simple tuning curve functions. This has recently been demonstrated using Gaussian processes, with applications to realistic and topologically relevant latent manifolds. Those and previous models, however, missed crucial shared coding properties of neural populations. We propose feature sharing across neural tuning curves which significantly improves performance and helps optimization. We also propose a solution to the ensemble detection problem, where different groups of neurons, i.e., ensembles, can be modulated by different latent manifolds. Achieved through a soft clustering of neurons during training, this allows for the separation of mixed neural populations in an unsupervised manner. These innovations lead to more interpretable models of neural population activity that train well and perform better even on mixtures of complex latent manifolds. Finally, we apply our method on a recently published grid cell dataset, and recover distinct ensembles, infer toroidal latents and predict neural tuning curves in a single integrated modeling framework.


title: Ordered Bose Glass of Vortices in Superconducting YBa$_{2}$Cu$_{3}$O$_{7-\delta}$ Thin Films with a Periodic Pin Lattice Created by Focused Helium Ion Irradiation

abstract: The defect-rich morphology of YBa$_{2}$Cu$_{3}$O$_{7-\delta}$ (YBCO) thin films leads to a glass-like arrangement of Abrikosov vortices which causes the resistance to disappear in vanishing current densities. This vortex glass consists of entangled vortex lines and is identified by a characteristic scaling of the voltage-current isotherms. Randomly distributed columnar defects stratify the vortex lines and lead to a Bose glass. Here, we report on the observation of an ordered Bose glass in a YBCO thin film with a hexagonal array of columnar defects with 30 nm spacings. The periodic pinning landscape was engineered by a focused beam of 30 keV He$^+$ ions in a helium-ion microscope.