title: Emergent self-adaptation in an integrated photonic neural network for backpropagation-free learning

abstract: Plastic self-adaptation, nonlinear recurrent dynamics and multi-scale memory are desired features in hardware implementations of neural networks, because they enable them to learn, adapt and process information similarly to the way biological brains do. In this work, we experimentally demonstrate these properties occurring in arrays of photonic neurons. Importantly, this is realised autonomously in an emergent fashion, without the need for an external controller setting weights and without explicit feedback of a global reward signal. Using a hierarchy of such arrays coupled to a backpropagation-free training algorithm based on simple logistic regression, we are able to achieve a performance of 98.2% on the MNIST task, a popular benchmark task looking at classification of written digits. The plastic nodes consist of silicon photonics microring resonators covered by a patch of phase-change material that implements nonvolatile memory. The system is compact, robust, and straightforward to scale up through the use of multiple wavelengths. Moreover, it constitutes a unique platform to test and efficiently implement biologically plausible learning schemes at a high processing speed.


title: Excitation of multipolar transitions in nuclei by twisted photons

abstract: The explicit expression for the probability of absorption of a twisted photon by an atomic nucleus has been obtained. It is shown that photoabsorption obeys the selection rule $j\geqslant|m_\gamma|$, where $j$ is the multipolarity of the nuclear transition, when the nuclei lie near the axis along which a twisted photon with a projection of the total angular momentum $m_\gamma$ propagates. In the long-wave limit, the main contribution to the probability of absorption of a twisted photon comes from the multipole transition with $j=|m_\gamma|$. The absorption coefficient for twisted photons in a target consisting of many nuclei has been found.


title: How Low Can You Go? Surfacing Prototypical In-Distribution Samples for Unsupervised Anomaly Detection

abstract: Unsupervised anomaly detection (UAD) alleviates large labeling efforts by training exclusively on unlabeled in-distribution data and detecting outliers as anomalies. Generally, the assumption prevails that large training datasets allow the training of higher-performing UAD models. However, in this work, we show that using only very few training samples can already match - and in some cases even improve - anomaly detection compared to training with the whole training dataset. We propose three methods to identify prototypical samples from a large dataset of in-distribution samples. We demonstrate that by training with a subset of just ten such samples, we achieve an area under the receiver operating characteristics curve (AUROC) of $96.37 \%$ on CIFAR10, $92.59 \%$ on CIFAR100, $95.37 \%$ on MNIST, $95.38 \%$ on Fashion-MNIST, $96.37 \%$ on MVTec-AD, $98.81 \%$ on BraTS, and $81.95 \%$ on RSNA pneumonia detection, even exceeding the performance of full training in $25/67$ classes we tested. Additionally, we show that the prototypical in-distribution samples identified by our proposed methods translate well to different models and other datasets and that using their characteristics as guidance allows for successful manual selection of small subsets of high-performing samples. Our code is available at https://anonymous.4open.science/r/uad_prototypical_samples/


title: SYNC-CLIP: Synthetic Data Make CLIP Generalize Better in Data-Limited Scenarios

abstract: Prompt learning is a powerful technique for transferring Vision-Language Models (VLMs) such as CLIP to downstream tasks. However, the prompt-based methods that are fine-tuned solely with base classes may struggle to generalize to novel classes in open-vocabulary scenarios, especially when data are limited. To address this issue, we propose an innovative approach called SYNC-CLIP that leverages SYNthetiC data for enhancing the generalization capability of CLIP. Based on the observation of the distribution shift between the real and synthetic samples, we treat real and synthetic samples as distinct domains and propose to optimize separate domain prompts to capture domain-specific information, along with the shared visual prompts to preserve the semantic consistency between two domains. By aligning the cross-domain features, the synthetic data from novel classes can provide implicit guidance to rebalance the decision boundaries. Experimental results on three model generalization tasks demonstrate that our method performs very competitively across various benchmarks. Notably, SYNC-CLIP outperforms the state-of-the-art competitor PromptSRC by an average improvement of 3.0% on novel classes across 11 datasets in open-vocabulary scenarios.


title: XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchies

abstract: We present XCube (abbreviated as $\mathcal{X}^3$), a novel generative model for high-resolution sparse 3D voxel grids with arbitrary attributes. Our model can generate millions of voxels with a finest effective resolution of up to $1024^3$ in a feed-forward fashion without time-consuming test-time optimization. To achieve this, we employ a hierarchical voxel latent diffusion model which generates progressively higher resolution grids in a coarse-to-fine manner using a custom framework built on the highly efficient VDB data structure. Apart from generating high-resolution objects, we demonstrate the effectiveness of XCube on large outdoor scenes at scales of 100m$\times$100m with a voxel size as small as 10cm. We observe clear qualitative and quantitative improvements over past approaches. In addition to unconditional generation, we show that our model can be used to solve a variety of tasks such as user-guided editing, scene completion from a single scan, and text-to-3D. The source code and more results can be found at https://research.nvidia.com/labs/toronto-ai/xcube/.


title: Achieving ${O}(\epsilon^{-1.5})$ Complexity in Hessian/Jacobian-free Stochastic Bilevel Optimization

abstract: In this paper, we revisit the bilevel optimization problem, in which the upper-level objective function is generally nonconvex and the lower-level objective function is strongly convex. Although this type of problem has been studied extensively, it still remains an open question how to achieve an ${O}(\epsilon^{-1.5})$ sample complexity in Hessian/Jacobian-free stochastic bilevel optimization without any second-order derivative computation. To fill this gap, we propose a novel Hessian/Jacobian-free bilevel optimizer named FdeHBO, which features a simple fully single-loop structure, a projection-aided finite-difference Hessian/Jacobian-vector approximation, and momentum-based updates. Theoretically, we show that FdeHBO requires ${O}(\epsilon^{-1.5})$ iterations (each using ${O}(1)$ samples and only first-order gradient information) to find an $\epsilon$-accurate stationary point. As far as we know, this is the first Hessian/Jacobian-free method with an ${O}(\epsilon^{-1.5})$ sample complexity for nonconvex-strongly-convex stochastic bilevel optimization.


title: SurfaceAug: Closing the Gap in Multimodal Ground Truth Sampling

abstract: Despite recent advances in both model architectures and data augmentation, multimodal object detectors still barely outperform their LiDAR-only counterparts. This shortcoming has been attributed to a lack of sufficiently powerful multimodal data augmentation. To address this, we present SurfaceAug, a novel ground truth sampling algorithm. SurfaceAug pastes objects by resampling both images and point clouds, enabling object-level transformations in both modalities. We evaluate our algorithm by training a multimodal detector on KITTI and compare its performance to previous works. We show experimentally that SurfaceAug outperforms existing methods on car detection tasks and establishes a new state of the art for multimodal ground truth sampling.


title: Nonequilibrium diagrammatic many-body simulations with quantics tensor trains

abstract: The nonequilibrium Green's function formalism provides a versatile and powerful framework for numerical studies of nonequilibrium phenomena in correlated many-body systems. For calculations starting from an equilibrium initial state, a standard approach consists of discretizing the Kadanoff-Baym contour and implementing a causal time-stepping scheme in which the self-energy of the system plays the role of a memory kernel. This approach becomes computationally expensive at long times, because of the convolution integrals and the large amount of computer memory needed to store the Green's functions. A recent idea for the compression of nonequilibrium Green's functions is the quantics tensor train representation. Here, we explore this approach by implementing equilibrium and nonequilibrium simulations of the two-dimensional Hubbard model with a second-order weak-coupling approximation to the self-energy. We show that calculations with compressed two-time functions are possible without any loss of accuracy, and that the quantics tensor train implementation shows a much improved scaling of the computational effort and memory demand with the length of the time contour.


title: Observational constraints on the second-order primordial power spectrum: Exploring a Continuous Spontaneous Localization inspired inflationary model

abstract: Inflation, a period of exponential expansion in the early Universe, is considered an important part of the standard $\Lambda$CDM cosmological model, and plays a crucial role in explaining a wide range of current observations. The standard inflationary model predicts a primordial spectrum of fluctuations that is nearly scale-independent, fitting remarkably well the latest observational data. Nevertheless, there is an ongoing discussion surrounding the transition from an initial homogeneous and isotropic quantum state, characterizing the matter fields during inflation, to a classical inhomogeneous/anisotropic one, which gives rise to large-scale structure in the Universe. To tackle this issue, in the present work we explore an inflationary scenario where quantum ``collapse'' (or reduction) occurs naturally during the evolution of the system; this model is inspired in the so called Continuous Spontaneous Localization (CSL) model. Our present work builds upon previous results by considering the primordial power spectrum up to the second order in the Hubble Flow Functions, where we perform an estimation of the model free parameters. By validating the predictions of the model against observational data, we investigate whether this second-order calculation can explain the slight departure from the power law observed in the scalar spectral running index. We hope this research contributes to the understanding of the quantum-to-classical transition and its implications for cosmology.


title: Quantum reference frames, revisited

abstract: The topic of quantum reference frames (QRFs) has attracted a great deal of attention in the recent literature. Potentially, the correct description of such frames is important for both the technological applications of quantum mechanics and for its foundations, including the search for a future theory of quantum gravity. In this letter, we point out potential inconsistencies in the mainstream approach to this subject and propose an alternative definition that avoids these problems. Crucially, we reject the notion that transformations between QRFs can be represented by unitary operators and explain the clear physical reasons for this. An experimental protocol, capable of empirically distinguishing between competing definitions of the term, is also proposed. The implications of the new model, for uncertainty relations, spacetime symmetries, gauge symmetries, the quantisation of gravity, and other foundational issues are discussed, and possible directions for future work in this field are considered.


title: Seeing the random forest through the decision trees. Supporting learning health systems from histopathology with machine learning models: Challenges and opportunities

abstract: This paper discusses some overlooked challenges faced when working with machine learning models for histopathology and presents a novel opportunity to support "Learning Health Systems" with them. Initially, the authors elaborate on these challenges after separating them according to their mitigation strategies: those that need innovative approaches, time, or future technological capabilities and those that require a conceptual reappraisal from a critical perspective. Then, a novel opportunity to support "Learning Health Systems" by integrating hidden information extracted by ML models from digitalized histopathology slides with other healthcare big data is presented.


title: Improving Activation Steering in Language Models with Mean-Centring

abstract: Recent work in activation steering has demonstrated the potential to better control the outputs of Large Language Models (LLMs), but it involves finding steering vectors. This is difficult because engineers do not typically know how features are represented in these models. We seek to address this issue by applying the idea of mean-centring to steering vectors. We find that taking the average of activations associated with a target dataset, and then subtracting the mean of all training activations, results in effective steering vectors. We test this method on a variety of models on natural language tasks by steering away from generating toxic text, and steering the completion of a story towards a target genre. We also apply mean-centring to extract function vectors, more effectively triggering the execution of a range of natural language tasks by a significant margin (compared to previous baselines). This suggests that mean-centring can be used to easily improve the effectiveness of activation steering in a wide range of contexts.


title: Pearl: A Production-ready Reinforcement Learning Agent

abstract: Reinforcement Learning (RL) offers a versatile framework for achieving long-term goals. Its generality allows us to formalize a wide range of problems that real-world intelligent systems encounter, such as dealing with delayed rewards, handling partial observability, addressing the exploration and exploitation dilemma, utilizing offline data to improve online performance, and ensuring safety constraints are met. Despite considerable progress made by the RL research community in addressing these issues, existing open-source RL libraries tend to focus on a narrow portion of the RL solution pipeline, leaving other aspects largely unattended. This paper introduces Pearl, a Production-ready RL agent software package explicitly designed to embrace these challenges in a modular fashion. In addition to presenting preliminary benchmark results, this paper highlights Pearl's industry adoptions to demonstrate its readiness for production usage. Pearl is open sourced on Github at github.com/facebookresearch/pearl and its official website is located at pearlagent.github.io.


title: LLM as OS, Agents as Apps: Envisioning AIOS, Agents and the AIOS-Agent Ecosystem

abstract: This paper envisions a revolutionary AIOS-Agent ecosystem, where Large Language Model (LLM) serves as the (Artificial) Intelligent Operating System (IOS, or AIOS)--an operating system "with soul". Upon this foundation, a diverse range of LLM-based AI Agent Applications (Agents, or AAPs) are developed, enriching the AIOS-Agent ecosystem and signaling a paradigm shift from the traditional OS-APP ecosystem. We envision that LLM's impact will not be limited to the AI application level, instead, it will in turn revolutionize the design and implementation of computer system, architecture, software, and programming language, featured by several main concepts: LLM as OS (system-level), Agents as Applications (application-level), Natural Language as Programming Interface (user-level), and Tools as Devices/Libraries (hardware/middleware-level). We begin by introducing the architecture of traditional OS. Then we formalize a conceptual framework for AIOS through "LLM as OS (LLMOS)", drawing analogies between AIOS and traditional OS: LLM is likened to OS kernel, context window to memory, external storage to file system, hardware tools to peripheral devices, software tools to programming libraries, and user prompts to user commands. Subsequently, we introduce the new AIOS-Agent Ecosystem, where users can easily program Agent Applications (AAPs) using natural language, democratizing the development of software, which is different from the traditional OS-APP ecosystem. Following this, we explore the diverse scope of Agent Applications. We delve into both single-agent and multi-agent systems, as well as human-agent interaction. Lastly, drawing on the insights from traditional OS-APP ecosystem, we propose a roadmap for the evolution of the AIOS-Agent ecosystem. This roadmap is designed to guide the future research and development, suggesting systematic progresses of AIOS and its Agent applications.


title: AVID: Any-Length Video Inpainting with Diffusion Model

abstract: Recent advances in diffusion models have successfully enabled text-guided image inpainting. While it seems straightforward to extend such editing capability into the video domain, there have been fewer works regarding text-guided video inpainting. Given a video, a masked region at its initial frame, and an editing prompt, it requires a model to do infilling at each frame following the editing guidance while keeping the out-of-mask region intact. There are three main challenges in text-guided video inpainting: ($i$) temporal consistency of the edited video, ($ii$) supporting different inpainting types at different structural fidelity levels, and ($iii$) dealing with variable video length. To address these challenges, we introduce Any-Length Video Inpainting with Diffusion Model, dubbed as AVID. At its core, our model is equipped with effective motion modules and adjustable structure guidance, for fixed-length video inpainting. Building on top of that, we propose a novel Temporal MultiDiffusion sampling pipeline with a middle-frame attention guidance mechanism, facilitating the generation of videos with any desired duration. Our comprehensive experiments show our model can robustly deal with various inpainting types at different video duration ranges, with high quality. More visualization results are made publicly available at https://zhang-zx.github.io/AVID/ .


title: Diffusion Illusions: Hiding Images in Plain Sight

abstract: We explore the problem of computationally generating special `prime' images that produce optical illusions when physically arranged and viewed in a certain way. First, we propose a formal definition for this problem. Next, we introduce Diffusion Illusions, the first comprehensive pipeline designed to automatically generate a wide range of these illusions. Specifically, we both adapt the existing `score distillation loss' and propose a new `dream target loss' to optimize a group of differentially parametrized prime images, using a frozen text-to-image diffusion model. We study three types of illusions, each where the prime images are arranged in different ways and optimized using the aforementioned losses such that images derived from them align with user-chosen text prompts or images. We conduct comprehensive experiments on these illusions and verify the effectiveness of our proposed method qualitatively and quantitatively. Additionally, we showcase the successful physical fabrication of our illusions -- as they are all designed to work in the real world. Our code and examples are publicly available at our interactive project website: https://diffusionillusions.com


title: Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

abstract: Contrastive Language-Image Pre-training (CLIP) plays an essential role in extracting valuable content information from images across diverse tasks. It aligns textual and visual modalities to comprehend the entire image, including all the details, even those irrelevant to specific tasks. However, for a finer understanding and controlled editing of images, it becomes crucial to focus on specific regions of interest, which can be indicated as points, masks, or boxes by humans or perception models. To fulfill the requirements, we introduce Alpha-CLIP, an enhanced version of CLIP with an auxiliary alpha channel to suggest attentive regions and fine-tuned with constructed millions of RGBA region-text pairs. Alpha-CLIP not only preserves the visual recognition ability of CLIP but also enables precise control over the emphasis of image contents. It demonstrates effectiveness in various tasks, including but not limited to open-world recognition, multimodal large language models, and conditional 2D / 3D generation. It has a strong potential to serve as a versatile tool for image-related tasks.


title: A theory for the low-energy optical sum-rule in moir\'e graphene

abstract: Few layers of graphene at small twist-angles have emerged as a fascinating platform for studying the problem of strong interactions in regimes with a nearly quenched single-particle kinetic energy and non-trivial band topology. Starting from the strong-coupling limit of twisted bilayer graphene with a vanishing single-electron bandwidth and interlayer-tunneling between the same sublattice sites, we present an ${\it exact}$ analytical theory of the Coulomb interaction-induced low-energy optical spectral weight at all ${\it integer}$ fillings. In this limit, while the interaction-induced single-particle dispersion is finite, the optical spectral weight vanishes identically at integer fillings. We study corrections to the optical spectral weight by systematically including the effects of experimentally relevant strain-induced renormalization of the single-electron bandwidth and interlayer tunnelings between the same sublattice sites. Given the relationship between the optical spectral weight and the diamagnetic response that controls superconducting $T_c$, our results highlight the relative importance of specific parent insulating phases in enhancing the tendency towards superconductivity when doped away from integer fillings.


title: The Ambient Space Formalism

abstract: We present a new formalism to solve the kinematical constraints due to Weyl invariance for CFTs in curved backgrounds and/or non-trivial states, and we apply it to thermal CFTs and to CFTs on squashed spheres. The ambient space formalism is based on constructing a class of geometric objects that are Weyl covariant and identifying them as natural building blocks of correlation functions. We construct (scalar) $n$-point functions and we illustrate the formalism with a detailed computation of 2-point functions. We compare our results for thermal 2-point functions with results that follow from thermal OPEs and holographic computations, finding exact agreement. In our holographic computation we also obtain the OPE coefficient of the leading double-twist contribution, and we discuss how the double-twist coefficients may be computed from the multi-energy-momentum contributions, given knowledge of the analytic structure of the correlator. The 2-point function for the CFT on squashed spheres is a new result. We also discuss the relation of our work to flat holography.


title: Primary Observables for Electroweak Gauge Boson Collider Signals

abstract: In this paper, we determine a basis for the on-shell 4-point amplitudes $VVVV$ for Standard Model gauge bosons $V=W^\pm, Z, \gamma, g$. Following previous work, this completes the analysis of 3- and 4-point amplitudes for the Standard Model and could be used for model independent searches for beyond the Standard Model physics at colliders. Our results include a Lagrangian parametrization for the "primary" amplitudes, where including additional derivatives leads to the Mandelstam "descendant" amplitudes, and upper bounds on the coupling constants from imposing unitarity. We also perform an estimate for the sensitivity for new $Z$ decays at the HL-LHC, finding that $Z\to \gamma \bar{\ell}\ell$ could be searched for, but that other decay modes, like $Z\to (\gamma\gamma\gamma, \gamma gg)$, are too small to be discovered after imposing unitarity constraints.


title: Existence and regularity of ultradifferentiable periodic solutions to certain vector fields

abstract: We consider a class of first-order partial differential operators, acting on the space of ultradifferentiable periodic functions, and we describe their range by using the following conditions on the coefficients of the operators: the connectedness of certain sublevel sets, the dimension of the subspace generated by the imaginary part of the coefficients, and Diophantine conditions. In addition, we show that these properties are also linked to the regularity of the solutions. The results extend previous ones in Gevrey classes.


title: High Pileup Particle Tracking with Object Condensation

abstract: Recent work has demonstrated that graph neural networks (GNNs) can match the performance of traditional algorithms for charged particle tracking while improving scalability to meet the computing challenges posed by the HL-LHC. Most GNN tracking algorithms are based on edge classification and identify tracks as connected components from an initial graph containing spurious connections. In this talk, we consider an alternative based on object condensation (OC), a multi-objective learning framework designed to cluster points (hits) belonging to an arbitrary number of objects (tracks) and regress the properties of each object. Building on our previous results, we present a streamlined model and show progress toward a one-shot OC tracking algorithm in a high-pileup environment.


title: nbi: the Astronomer's Package for Neural Posterior Estimation

abstract: Despite the promise of Neural Posterior Estimation (NPE) methods in astronomy, the adaptation of NPE into the routine inference workflow has been slow. We identify three critical issues: the need for custom featurizer networks tailored to the observed data, the inference inexactness, and the under-specification of physical forward models. To address the first two issues, we introduce a new framework and open-source software nbi (Neural Bayesian Inference), which supports both amortized and sequential NPE. First, nbi provides built-in "featurizer" networks with demonstrated efficacy on sequential data, such as light curve and spectra, thus obviating the need for this customization on the user end. Second, we introduce a modified algorithm SNPE-IS, which facilities asymptotically exact inference by using the surrogate posterior under NPE only as a proposal distribution for importance sampling. These features allow nbi to be applied off-the-shelf to astronomical inference problems involving light curves and spectra. We discuss how nbi may serve as an effective alternative to existing methods such as Nested Sampling. Our package is at https://github.com/kmzzhang/nbi.


title: Competing Higher Order Topological Superconducting Phases in Triangular Lattice Magnet-Superconductor Hybrid Systems

abstract: We demonstrate that a plethora of higher order topological phases emerge in magnet-superconductor hybrid (MSH) systems through the interplay of a stacked magnetic structure and an underlying triangular surface lattice; the latter being of great current experimental interest. Such lattices offer the ability to create three main types of edge terminations -- called x-, y- and y'-edges -- of MSH islands that, in turn, give rise to a complex phase diagrams exhibiting various regions of HOTSC phases. We identify the single adatom chain, as well as a pair of adjacent adatom chains (called a double-chain), as the basic building blocks for the emergence of HOTSC phases. Of particular interest are those HOTSC phase which arise from a competition between the topology of single and double-chain blocks, which are absent for square latices.


title: A Duet of Freeze-in and Freeze-out: Lepton-Flavored Dark Matter and Muon Colliders

abstract: We study a Lepton-Flavored Dark Matter model and its signatures at a future Muon Collider. We focus on the less-explored regime of feeble dark matter interactions, which suppresses the dangerous lepton-flavor violating processes, gives rise to dark matter freeze-in production, and leads to long-lived particle signatures at colliders. We find that the interplay of dark matter freeze-in and its mediator freeze-out gives rise to an upper bound of around TeV scales on the dark matter mass. The signatures of this model depend on the lifetime of the mediator, and can range from generic prompt decays to more exotic long-lived particle signals. In the prompt region, we calculate the signal yield, study useful kinematics cuts, and report tolerable systematics that would allow for a $5\sigma$ discovery. In the long-lived region, we calculate the number of charged tracks and displaced lepton signals of our model in different parts of the detector, and uncover kinematic features that can be used for background rejection. We show that, unlike in hadron colliders, multiple production channels contribute significantly which leads to sharply distinct kinematics for electroweakly-charged long-lived particle signals. Ultimately, the collider signatures of this lepton-flavored dark matter model are common amongst models of electroweak-charged new physics, rendering this model a useful and broadly applicable benchmark model for future Muon Collider studies that can help inform work on detector design and studies of systematics.


title: Dynamics of spin-momentum entanglement from superradiant phase transitions

abstract: Exploring operational regimes of many-body cavity QED with multi-level atoms remains an exciting research frontier for their enhanced storage capabilities of intra-level quantum correlations. In this work, we consider an experimentally feasible many-body cavity QED model describing a four-level system, where each of those levels is formed from a combination of different spin and momentum states of ultra-cold atoms in a cavity. The resulting model comprises a pair of Dicke Hamiltonians constructed from pseudo-spin operators, effectively capturing two intertwined superradiant phase transitions. The phase diagram reveals regions featuring weak and strong entangled states of spin and momentum atomic degrees of freedom. These states exhibit different dynamical responses, ranging from slow to fast relaxation, with the added option of persistent entanglement temporal oscillations. We discuss the role of cavity losses in steering the system's dynamics into such entangled states and propose a readout scheme that leverages different light polarizations within the cavity. Our work paves the way to connect the rich variety of non-equilibrium phase transitions that occur in many-body cavity QED to the buildup of quantum correlations in systems with multi-level atom descriptions.


title: Quantum Melting of Generalized Wigner Crystals in Transition Metal Dichalcogenide Moir\'e Systems

abstract: Generalized Wigner Crystal (GWC) is a novel quantum phase of matter driven by further-range interaction at fractional fillings of a lattice. The role of further range interaction as the driver for the incompressible state is akin to Wigner crystal. On the other hand, the significant role of commensurate filling is akin to the Mott insulator. Recent progress in simulator platforms presents unprecedented opportunities to investigate quantum melting in the strongly interacting regime through synergy between theory and experiments. However, the earlier theory literature presents diverging predictions. We study the quantum freezing of GWC through large-scale density matrix renormalization group simulations of a triangular lattice extended Hubbard model. We find a single first-order phase transition between the Fermi liquid and the $\sqrt{3}\times\sqrt{3}$ GWC state. The GWC state shows long-range antiferromagnetic $120^\circ$ N{\'e}el order. Our results present the simplest answers to the question of the quantum phase transition into the GWC phase and the properties of the GWC phase.


title: Magnon interactions in the quantum paramagnetic phase of CoNb$_2$O$_6$

abstract: In this work, we study effects of magnon interactions in the excitation spectrum of CoNb$_2$O$_6$ in the quantum paramagnetic phase in transverse field, where the $1/S$ spin-wave theory exhibits unphysical divergences at the critical field. We propose a self-consistent Hartree-Fock approach that eliminates such unphysical singularities while preserving the integrity of the singular threshold phenomena of magnon decay and spectrum renormalization that are present in both theory and experiment. With the microscopic parameters adopted from previous studies, this method yields a close quantitative agreement with the available experimental data for CoNb$_2$O$_6$ in the relevant regime. Insights into the general structure of the spin-anisotropic model of CoNb$_2$O$_6$ and related zigzag chain materials are also provided and a discussion of the effects of additional longitudinal field on the spectrum is given.


title: QSlack: A slack-variable approach for variational quantum semi-definite programming

abstract: Solving optimization problems is a key task for which quantum computers could possibly provide a speedup over the best known classical algorithms. Particular classes of optimization problems including semi-definite programming (SDP) and linear programming (LP) have wide applicability in many domains of computer science, engineering, mathematics, and physics. Here we focus on semi-definite and linear programs for which the dimensions of the variables involved are exponentially large, so that standard classical SDP and LP solvers are not helpful for such large-scale problems. We propose the QSlack and CSlack methods for estimating their optimal values, respectively, which work by 1) introducing slack variables to transform inequality constraints to equality constraints, 2) transforming a constrained optimization to an unconstrained one via the penalty method, and 3) replacing the optimizations over all possible non-negative variables by optimizations over parameterized quantum states and parameterized probability distributions. Under the assumption that the SDP and LP inputs are efficiently measurable observables, it follows that all terms in the resulting objective functions are efficiently estimable by either a quantum computer in the SDP case or a quantum or probabilistic computer in the LP case. Furthermore, by making use of SDP and LP duality theory, we prove that these methods provide a theoretical guarantee that, if one could find global optima of the objective functions, then the resulting values sandwich the true optimal values from both above and below. Finally, we showcase the QSlack and CSlack methods on a variety of example optimization problems and discuss details of our implementation, as well as the resulting performance. We find that our implementations of both the primal and dual for these problems approach the ground truth, typically achieving errors of order $10^{-2}$.


title: Robustness of the derivative expansion in Asymptotic Safety

abstract: We analyse the renormalisation group flow of quantum gravity at sixth order in the derivative expansion within the background field approximation. Non-linear field redefinitions are used to ensure that only essential couplings flow. Working within the universality class of General Relativity, with a vanishing cosmological constant, redundant couplings are fixed to their values at the Gaussian fixed point. This reduces the theory space to two dynamical essential couplings given by Newton's and the Goroff-Sagnotti coupling. Furthermore, it implements the condition that no extra degrees of freedom are present beyond those of General Relativity, in contrast to higher derivative theories and derivative expansions in a conventional renormalisation scheme. We find a unique ultraviolet fixed point with a single relevant direction and analyse the phase diagram of the theory. Our results suggest resilience of the gravitational Reuter fixed point under the inclusion of higher order curvature invariants and show several signs of near-perturbativity. The regulator dependence of our results is investigated in detail and shows that qualitative and quantitative features are robust to a large extent.


title: Axion Electrodyanmics in the Presence of Current Sources

abstract: Axions are among the most sought-after candidates for dark matter. In the ultralight regime, they could help alleviate puzzles in small scale cosmology. Searches for a halo of axion dark matter rely on the electromagnetic response to a magnetic field. In this work, we resolve a number of issues in the determination of this response by carefully solving Maxwell's equations in the presence of an axion background. We find that the electric field induced by a magnetic field in an axion background is significant and unsuppressed by the size of the experiment.


title: Integrability, multifractality, and two-photon dynamics in disordered Tavis-Cummings models

abstract: The Tavis-Cummings model is a paradigmatic central-mode model where a set of two-level quantum emitters (spins) are coupled to a collective cavity mode. Here we study the eigenstate spectrum, its localization properties and the effect on dynamics, focusing on the two-excitation sector relevant for nonlinear photonics. These models admit two sources of disorder: in the coupling between the spins and the cavity and in the energy shifts of the individual spins. While this model was known to be exactly solvable in the limit of a homogeneous coupling and inhomogeneous energy shifts, we here establish the solvability in the opposite limit of a homogeneous energy shift and inhomogeneous coupling, presenting the exact solution and corresponding conserved quantities. We identify three different classes of eigenstates, exhibiting different degrees of multifractality and semilocalization closely tied to the integrable points, and study their stability to perturbations away from these solvable points. The dynamics of the cavity occupation number away from equilibrium, exhibiting boson bunching and a two-photon blockade, is explicitly related to the localization properties of the eigenstates and illustrates how these models support a collective spin description despite the presence of disorder.

categories: cond-mat.dis-nn nlin.SI physics.optics quant-ph


title: Boundaries of Universal Theories

abstract: Universal theories are a broad class of well-motivated microscopic dynamics of the electroweak sector that go beyond the Standard Model description. The long distance physics is described by electroweak parameters which correspond to local operators in the Effective Field Theory. We show how unitarity and analyticity constrain the space of parameters. In particular, the $W$ and $Y$ parameters are constrained to be positive and are necessarily the leading terms in the low energy expansion. We assess the impact of unitarity on the interpretation of Drell-Yan data. In passing, we uncover an unexpected Wilson coefficient transcendental cancellation at the $\mathcal{O}(<10^{-3})$ level.


title: Constraining the gas mass of Herbig disks using CO isotopologues

abstract: The total disk mass sets the formation potential for exoplanets. Carbon-monoxide (CO) has been used as a gas mass tracer in T Tauri disks, but was found to be less abundant than expected due to freeze-out and chemical conversion of CO on the surfaces of cold dust grains. The disks around more massive intermediate mass pre-main sequence stars called Herbig disks are likely to be warmer, allowing for the possibility of using CO as a more effective total gas mass tracer. Using ALMA archival data and new NOEMA data of 12CO, 13CO, and C18O transitions of 35 Herbig disks within 450 pc, the masses are determined using the thermo-chemical code Dust And LInes (DALI). The majority of Herbig disks for which 13CO and C18O are detected are optically thick in both. Computing the gas mass using a simple optically thin relation between line flux and column density results in an underestimate of the gas mass of at least an order of magnitude compared to the masses obtained with DALI. The inferred gas masses with DALI are consistent with a gas-to-dust ratio of at least 100. These gas-to-dust ratios are two orders of magnitude higher compared to those found for T Tauri disks using similar techniques, even over multiple orders of magnitude in dust mass, illustrating the importance of chemical conversion of CO in colder T Tauri disks. Similar high gas-to-dust ratios are found for Herbig group I and II disks. Since group II disks have dust masses comparable to T Tauri disks, their higher CO gas masses illustrate the determining role of temperature. Compared to debris disks, Herbig disks have four orders of magnitude higher gas masses. At least one Herbig disk, HD 163296, has a detected molecular disk wind, but our investigation has not turned up other detections of the CO disk wind in spite of similar sensitivities.


title: Four-dimensional $\mathcal N=2$ superconformal long circular quivers

abstract: We study four-dimensional $\mathcal N=2$ superconformal circular, cyclic symmetric quiver theories which are planar equivalent to $\mathcal N=4$ super Yang-Mills. We use localization to compute nonplanar corrections to the free energy and the circular half-BPS Wilson loop in these theories for an arbitrary number of nodes, and examine their behaviour in the limit of long quivers. Exploiting the relationship between the localization quiver matrix integrals and an integrable Bessel operator, we find a closed-form expression for the leading nonplanar correction to both observables in the limit when the number of nodes and 't Hooft coupling become large. We demonstrate that it has different asymptotic behaviour depending on how the two parameters are compared, and interpret this behaviour in terms of properties of a lattice model defined on the quiver diagram.


title: Sub-GeV millicharge dark matter from the $U(1)_X$ hidden sector

abstract: We conduct a comprehensive study on the sub-GeV millicharge dark matter produced through the freeze-in mechanism. We discuss in general the mixing mechanism, encompassing both kinetic mixing and mass mixing, between the $U(1)_X$ hidden sector and the standard model, which can generate millicharge carried by the dark fermions from the hidden sector. We discuss in depth how such millicharge is generated, and clarify several misunderstandings regarding this subject in the literature. Without employing an effective field theory approach, where the photon field directly mixed with the additional $U(1)$, we analyze a general renormalizable model and investigate the complete evolution of the hidden sector particles. Due to the substantial self-interactions among hidden sector particles, the evolution of the hidden sector temperature plays a crucial role, which is addressed concurrently with the number densities of hidden sector particles by solving a set of coupled Boltzmann equations. We thoroughly examine eight benchmark models from six distinct cases. Some of our key findings from the analysis of these benchmark models may be generalizable and applicable to broader freeze-in scenarios. We also explore the possibility that the $\mathcal{O}$(keV) $U(1)_X$ dark photon is a viable dark matter candidate, even though it can contribute at most $\sim 5\%$ to the total observed dark matter relic density.


title: Hayden-Preskill recovery in chaotic and integrable unitary circuit dynamics

abstract: The Hayden-Preskill protocol probes the capability of information recovery from local subsystems after unitary dynamics. As such it resolves the capability of quantum many-body systems to dynamically implement a quantum error-correcting code. The transition to coding behavior has been mostly discussed using effective approaches, such as entanglement membrane theory. Here, we present exact results on the use of Hayden-Preskill recovery as a dynamical probe of scrambling in local quantum many-body systems. We investigate certain classes of unitary circuit models, both structured Floquet (dual-unitary) and Haar-random circuits. We discuss different dynamical signatures corresponding to information transport or scrambling, respectively, that go beyond effective approaches. Surprisingly, certain chaotic circuits transport information with perfect fidelity. In integrable dual-unitary circuits, we relate the information transmission to the propagation and scattering of quasiparticles. Using numerical and analytical insights, we argue that the qualitative features of information recovery extend away from these solvable points. Our results suggest that information recovery protocols can serve to distinguish chaotic and integrable behavior, and that they are sensitive to characteristic dynamical features, such as long-lived quasiparticles or dual-unitarity.

categories: quant-ph cond-mat.stat-mech cond-mat.str-el nlin.CD


title: Perturbing Fast Neutrino Flavor Conversion

abstract: The flavor evolution of neutrinos in dense astrophysical sources, such as core-collapse supernovae or compact binary mergers, is non-linear due to the coherent forward scattering of neutrinos among themselves. Recent work in this context has been addressed to figure out whether flavor equipartition could be a generic flavor outcome of fast flavor conversion. We investigate the flavor conversion physics injecting random perturbations in the neutrino field in two simulation setups: 1. a spherically symmetric simulation shell without periodic boundaries, with angular distributions evolving dynamically thanks to non-forward scatterings of neutrinos with the background medium, and neutrino advection; 2. a periodic simulation shell, with angular distributions of neutrinos defined a priori and neutrino advection. We find that, independent of the exact initial flavor configuration and type of perturbations, flavor equipartition is generally achieved in the system with periodic boundaries; in this case, perturbations aid the diffusion of flavor structures to smaller and smaller scales. However, flavor equipartition is not a general outcome in the simulation shell without periodic boundaries, where the inhomogeneities induced perturbing the neutrino field affect the flavor evolution, but do not facilitate the diffusion of flavor waves. This work highlights the importance of the choice of the simulation boundary conditions in the exploration of fast flavor conversion physics.


title: Transient localization from the interaction with quantum bosons

abstract: We carefully revisit the electron-boson scattering problem, going beyond popular semi-classical treatments. By providing numerically exact results valid at finite temperatures, we demonstrate the existence of a regime of electron-boson scattering where quantum localization processes become relevant despite the absence of extrinsic disorder. Localization in the Anderson sense is caused by the emergent randomness resulting from a large thermal boson population, being effective at transient times before diffusion can set in. Compelling evidence of this transient localization phenomenon is provided by the observation of a distinctive displaced Drude peak (DDP) in the optical absorption and the ensuing suppression of conductivity. Our findings identify a general route for anomalous metallic behavior that can broadly apply in interacting quantum matter.


title: Phonon screening and dissociation of excitons at finite temperatures from first principles

abstract: The properties of excitons, or correlated electron-hole pairs, are of paramount importance to optoelectronic applications of materials. A central component of exciton physics is the electron-hole interaction, which is commonly treated as screened solely by electrons within a material. However, nuclear motion can screen this Coulomb interaction as well, with several recent studies developing model approaches for approximating the phonon screening to the properties of excitons. While these model approaches tend to improve agreement with experiment for exciton properties, they rely on several approximations that restrict their applicability to a wide range of materials, and thus far they have neglected the effect of finite temperatures. Here, we develop a fully first-principles, parameter-free approach to compute the temperature-dependent effects of phonon screening within the ab initio GW-Bethe Salpeter equation framework. We recover previously proposed models of phonon screening as well-defined limits of our general framework, and discuss their validity by comparing them against our first-principles results. We develop an efficient computational workflow and apply it to a diverse set of semiconductors, specifically AlN, CdS, GaN, MgO and SrTiO3. We demonstrate under different physical scenarios how excitons may be screened by multiple polar optical or acoustic phonons, how their binding energies can exhibit strong temperature dependence, and the ultrafast timescales on which they dissociate into free electron-hole pairs.


title: Light-Curve Structure and Halpha Line Formation in the Tidal Disruption Event AT 2019azh

abstract: AT 2019azh is a H+He tidal disruption event (TDE) with one of the most extensive ultraviolet and optical datasets available to date. We present our photometric and spectroscopic observations of this event starting several weeks before and out to approximately two years after g-band peak brightness and combine them with public photometric data. This extensive dataset robustly reveals a change in the light-curve slope and a bump in the rising light curve of a TDE for the first time, which may indicate more than one dominant emission mechanism contributing to the pre-peak light curve. We further confirm the relation seen in previous TDEs whereby the redder emission peaks later than the bluer emission. The post-peak bolometric light curve of AT 2019azh is better described by an exponential decline than by the canonical t^{-5/3} (and in fact any) power-law decline. We find a possible mid-infrared excess around peak optical luminosity, but cannot determine its origin. In addition, we provide the earliest measurements of the Halpha emission-line evolution and find no significant time delay between the peak of the V-band light curve and that of the Halpha luminosity. These results can be used to constrain future models of TDE line formation and emission mechanisms in general. More pre-peak 1-2 day cadence observations of TDEs are required to determine whether the characteristics observed here are common among TDEs. More importantly, detailed emission models are needed to fully exploit such observations for understanding the emission physics of TDEs.


title: Exposing Disparities in Flood Adaptation for Equitable Future Interventions

abstract: As governments race to implement new climate adaptation policies that prepare for more frequent flooding, they must seek policies that are effective for all communities and uphold climate justice. This requires evaluating policies not only on their overall effectiveness but also on whether their benefits are felt across all communities. We illustrate the importance of considering such disparities for flood adaptation using the FEMA National Flood Insurance Program Community Rating System and its dataset of $\sim$2.5 million flood insurance claims. We use ${\rm C{\scriptsize AUSAL}F{\scriptsize LOW}}$, a causal inference method based on deep generative models, to estimate the treatment effect of flood adaptation interventions based on a community's income, diversity, population, flood risk, educational attainment, and precipitation. We find that the program saves communities \$5,000--15,000 per household. However, these savings are not evenly spread across communities. For example, for low-income communities savings sharply decline as flood-risk increases in contrast to their high-income counterparts with all else equal. Even among low-income communities, there is a gap in savings between predominantly white and non-white communities: savings of predominantly white communities can be higher by more than \$6000 per household. As communities worldwide ramp up efforts to reduce losses inflicted by floods, simply prescribing a series flood adaptation measures is not enough. Programs must provide communities with the necessary technical and economic support to compensate for historical patterns of disenfranchisement, racism, and inequality. Future flood adaptation efforts should go beyond reducing losses overall and aim to close existing gaps to equitably support communities in the race for climate adaptation.


title: "Quantum bipolaron" superconductivity from quadratic electron-phonon coupling

abstract: When the electron-phonon coupling is quadratic in the phonon coordinates, electrons can pair to form bipolarons due to phonon zero-point fluctuations, a purely quantum effect. We study superconductivity originating from this pairing mechanism in a minimal model and reveal that, in the strong coupling regime, the critical temperature ($T_c$) is only mildly suppressed by the coupling strength, in stark contrast to the exponential suppression in linearly coupled systems, thus implying higher optimal $T_c$ values. We demonstrate that large coupling constants of this flavor are achieved in known materials such as perovskites, and discuss strategies to realize such superconductivity using superlattices.


title: A Nearby Polluted White Dwarf with a 6.2 h Spin Period

abstract: This letter reports the first detection of a periodic light curve whose modulation is unambiguously due to rotation in a polluted white dwarf. TESS observations of WD 2138-332, at a distance of 16.1 pc, reveal a 0.39 per cent amplitude modulation with a 6.19 h period. While this rotation is relatively rapid for isolated white dwarfs, it falls within the range of spin periods common to those with detectable magnetic fields, where WD 2138-332 is notably both metal-rich and weakly magnetic. Within the local 20 pc volume of white dwarfs, multi-sector TESS data find no significant periodicities among the remaining 16 polluted objects (five of which are also magnetic), whereas six of 23 magnetic and metal-free targets have light curves consistent with rotation periods between 0.7 and 35 h (three of which are new discoveries). This indicates the variable light curve of WD 2138-332 is primarily a result of magnetism, as opposed to an inhomogeneous distribution of metals. From 13 magnetic and metallic degenerates with acceptable TESS data, a single detection of periodicity suggests that polluted white dwarfs are not rotating as rapidly as their magnetic counterparts, and planet ingestion is thus unlikely to be a significant channel for rapid rotation.


title: A New Constraint on the Relative Disorder of Magnetic Fields between Neutral ISM Phases

abstract: Utilizing Planck polarized dust emission maps at 353 GHz and new large-area maps of the neutral hydrogen (HI) cold neutral medium (CNM) fraction ($f_\mathrm{CNM}$), we investigate the relationship between dust polarization fraction ($p_{353}$) and $f_\mathrm{CNM}$ in the diffuse high latitude ($|b|>30^{\circ}$) sky. We find that the correlation between $p_{353}$ and $f_\mathrm{CNM}$ is qualitatively distinct from the $p_{353}$-HI column density ($N_\mathrm{H\,I}$) relationship. At low column densities ($N_\mathrm{H\,I}<4\times10^{20}~\mathrm{cm^{-2}}$) where $p_{353}$ and $N_\mathrm{H\,I}$ are uncorrelated, there is a strong positive $p_{353}$-$f_\mathrm{CNM}$ correlation. We fit the $p_{353}$-$f_{\rm CNM}$ correlation with data-driven models to constrain the degree of magnetic field disorder between phases along the line-of-sight. We argue that an increased magnetic field disorder in the warm neutral medium (WNM) relative to the CNM best explains the positive $p_{353}$-$f_\mathrm{CNM}$ correlation in diffuse regions. Modeling the CNM-associated dust column as being maximally polarized, with a polarization fraction $p_{\rm CNM} \sim$ 0.2, we find that the best-fit mean polarization fraction in the WNM-associated dust column is 0.22$p_{\rm CNM}$. The model further suggests that a significant $f_{\rm CNM}$-correlated fraction of the non-CNM column (an additional ~18.4% of the HI mass on average) is also more magnetically ordered, and we speculate that the additional column is associated with the unstable medium (UNM). Our results constitute a new large-area constraint on the average relative disorder of magnetic fields between the neutral phases of the ISM, and are consistent with the physical picture of a more magnetically aligned CNM column forming out of a disordered WNM.


title: The Pristine Inner Galaxy Survey (PIGS) VIII: Characterising the orbital properties of the ancient, very metal-poor inner Milky Way

abstract: The oldest stars in the Milky Way (born in the first few billion years) are expected to have a high density in the inner few kpc, spatially overlapping with the Galactic bulge. We use spectroscopic data from the Pristine Inner Galaxy Survey (PIGS) to study the dynamical properties of ancient, metal-poor inner Galaxy stars. We compute distances using StarHorse, and orbital properties in a barred Galactic potential. With this paper, we release the spectroscopic AAT/PIGS catalogue (13 235 stars). We find that most PIGS stars have orbits typical for a pressure-supported population. The fraction of stars confined to the inner Galaxy decreases with decreasing metallicity, but many very metal-poor stars (VMP, [Fe/H] < -2.0) stay confined (~ 60% stay within 5 kpc). The azimuthal velocity v$_\phi$ also decreases between [Fe/H] = -1.0 and -2.0, but is constant for VMP stars (at ~ 40 km/s). The carbon-enhanced metal-poor (CEMP) stars in PIGS appear to have similar orbital properties compared to normal VMP stars. Our results suggest a possible transition between two spheroidal components - a more metal-rich, more concentrated, faster rotating component, and a more metal-poor, more extended and slower/non-rotating component. We propose that the former may be connected to pre-disc in-situ stars (or those born in large building blocks), whereas the latter may be dominated by contributions from smaller galaxies. This is an exciting era where large metal-poor samples, such as in this work (as well as upcoming surveys, e.g., 4MOST), shed light on the earliest evolution of our Galaxy.


title: Quantum chaos, integrability, and late times in the Krylov basis

abstract: Quantum chaotic systems are conjectured to display a spectrum whose fine-grained features (gaps and correlations) are well described by Random Matrix Theory (RMT). We propose and develop a complementary version of this conjecture: quantum chaotic systems display a Lanczos spectrum whose local means and covariances are well described by RMT. To support this proposal, we first demonstrate its validity in examples of chaotic and integrable systems. We then show that for Haar-random initial states in RMTs the mean and covariance of the Lanczos spectrum suffices to produce the full long time behavior of general survival probabilities including the spectral form factor, as well as the spread complexity. In addition, for initial states with continuous overlap with energy eigenstates, we analytically find the long time averages of the probabilities of Krylov basis elements in terms of the mean Lanczos spectrum. This analysis suggests a notion of eigenstate complexity, the statistics of which differentiate integrable systems and classes of quantum chaos. Finally, we clarify the relation between spread complexity and the universality classes of RMT by exploring various values of the Dyson index and Poisson distributed spectra.

categories: hep-th cond-mat.stat-mech nlin.CD quant-ph


title: LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuning

abstract: Generating instructional images of human daily actions from an egocentric viewpoint serves as a key step towards efficient skill transfer. In this paper, we introduce a novel problem -- egocentric action frame generation. The goal is to synthesize an image depicting an action in the user's context (i.e., action frame) by conditioning on a user prompt and an input egocentric image. Notably, existing egocentric action datasets lack the detailed annotations that describe the execution of actions. Additionally, existing diffusion-based image manipulation models are sub-optimal in controlling the state transition of an action in egocentric image pixel space because of the domain gap. To this end, we propose to Learn EGOcentric (LEGO) action frame generation via visual instruction tuning. First, we introduce a prompt enhancement scheme to generate enriched action descriptions from a visual large language model (VLLM) by visual instruction tuning. Then we propose a novel method to leverage image and text embeddings from the VLLM as additional conditioning to improve the performance of a diffusion model. We validate our model on two egocentric datasets -- Ego4D and Epic-Kitchens. Our experiments show substantial improvement over prior image manipulation models in both quantitative and qualitative evaluation. We also conduct detailed ablation studies and analysis to provide insights in our method. More details of the dataset and code are available on the website (https://bolinlai.github.io/Lego_EgoActGen/).


title: Learning the Dynamics of Future Marine Microgrids Using Temporal Convolutional Neural Network

abstract: Medium-voltage direct-current (MVDC) ship-board microgrids (SMGs) are the state-of-the-art architecture for onboard power distribution in navy. These systems are considered to be highly dynamic due to high penetration of power electronic converters and volatile load patterns such as pulsed-power load (PPL) and propulsion motors demand variation. Obtaining the dynamic model of an MVDC SMG is a challenging task due to the confidentiality of system components models and uncertainty in the dynamic models through time. In this paper, a dynamic identification framework based on a temporal convolutional neural network (TCN) is developed to learn the system dynamics from measurement data. Different kinds of testing scenarios are implemented, and the testing results show that this approach achieves an exceptional performance and high generalization ability, thus holding substantial promise for development of advanced data-driven control strategies and stability prediction of the system.


title: Vector-Like Fermions and Inert Scalar Solutions to the Muon g-2 Anomaly and collider probes at the HL-LHC and FCC-hh

abstract: We examine simple models with an inert scalar and vector-like leptons that can explain the recent $g_{\mu}-2$ measurement reported at FNAL. Prompted by this exciting result, we explore the viability of a simple interpretation and determine the required parameters. We also embed these models within a 3-3-1 gauge extension of the Standard Model (SM), showing that the $g_{\mu}-2$ anomaly can be accommodated in agreement with current data. We also show how our theory can be tested at high-energy colliders such as HL-LHC and FCC-hh.


title: The JWST Early Release Science Program for Direct Observations of Exoplanetary Systems V: Do Self-Consistent Atmospheric Models Represent JWST Spectra? A Showcase With VHS 1256 b

abstract: The unprecedented medium-resolution (R~1500-3500) near- and mid-infrared (1-18um) spectrum provided by JWST for the young (140+/-20Myr) low-mass (12-20MJup) L-T transition (L7) companion VHS1256b gives access to a catalogue of molecular absorptions. In this study, we present a comprehensive analysis of this dataset utilizing a forward modelling approach, applying our Bayesian framework, ForMoSA. We explore five distinct atmospheric models to assess their performance in estimating key atmospheric parameters: Teff, log(g), [M/H], C/O, gamma, fsed, and R. Our findings reveal that each parameter's estimate is significantly influenced by factors such as the wavelength range considered and the model chosen for the fit. This is attributed to systematic errors in the models and their challenges in accurately replicating the complex atmospheric structure of VHS1256b, notably the complexity of its clouds and dust distribution. To propagate the impact of these systematic uncertainties on our atmospheric property estimates, we introduce innovative fitting methodologies based on independent fits performed on different spectral windows. We finally derived a Teff consistent with the spectral type of the target, considering its young age, which is confirmed by our estimate of log(g). Despite the exceptional data quality, attaining robust estimates for chemical abundances [M/H] and C/O, often employed as indicators of formation history, remains challenging. Nevertheless, the pioneering case of JWST's data for VHS1256b has paved the way for future acquisitions of substellar spectra that will be systematically analyzed to directly compare the properties of these objects and correct the systematics in the models.


title: Dr. Jekyll and Mr. Hyde: Two Faces of LLMs

abstract: Recently, we have witnessed a rise in the use of Large Language Models (LLMs), especially in applications like chatbot assistants. Safety mechanisms and specialized training procedures are implemented to prevent improper responses from these assistants. In this work, we bypass these measures for ChatGPT and Bard (and, to some extent, Bing chat) by making them impersonate complex personas with personality characteristics that are not aligned with a truthful assistant. We start by creating elaborate biographies of these personas, which we then use in a new session with the same chatbots. Our conversations then followed a role-play style to elicit prohibited responses. By making use of personas, we show that such responses are actually provided, making it possible to obtain unauthorized, illegal, or harmful information. This work shows that by using adversarial personas, one can overcome safety mechanisms set out by ChatGPT and Bard. We also introduce several ways of activating such adversarial personas, which show that both chatbots are vulnerable to this kind of attack. With the same principle, we introduce two defenses that push the model to interpret trustworthy personalities and make it more robust against such attacks.


title: Gaia DR3 data consistent with a short bar connected to a spiral arm

abstract: We use numerical simulations to model Gaia DR3 data with the aim of constraining the Milky Way bar and spiral structure parameters. We show that both the morphology and the velocity field in Milky Way-like galactic disc models are strong functions of time, changing dramatically over a few tens of Myr. This suggests that by finding a good match to the observed radial velocity field, v_R(x,y), we can constrain the bar-spiral orientation. Incorporating uncertainties into our models is necessary to match the data; most importantly, a heliocentric distance uncertainty above 10-15% distorts the bar's shape and v_R quadrupole pattern morphology, and decreases its apparent angle with respect to the Sun-Galactocentric line. An excellent match to the Gaia DR3 v_R(x,y) field is found for a simulation with a bar length R_b\approx3.6 kpc. We argue that the data are consistent with a MW bar as short as ~3 kpc, for moderate strength inner disc spiral structure (A_2/A_0\approx0.25) or, alternatively, with a bar length up to ~5.2 kpc, provided that spiral arms are quite weak (A_2/A_0\approx0.1), and is most likely in the process of disconnecting from a spiral arm. We demonstrate that the bar angle and distance uncertainty can similarly affect the match between our models and the data - a smaller bar angle (20 deg instead of 30 deg) requires smaller distance uncertainty (20% instead of 30%) to explain the observations. Fourier components of the face-on density distribution of our models suggest that the MW does not have strong m=1 and/or m=3 spirals near the solar radius.


title: Confining Strings and Glueballs in $\mathbb{Z}_N$ Gauge Theories

abstract: Effective string theory has shown its universal power in the prediction of the spectrum of low-lying excited states of confining strings. Here we study confining flux tubes in $\mathbb{Z}_N$ gauge theories. For the $N=2$ theory, which corresponds to the 3d Ising gauge model, we compute the spectrum of low-lying excitations of confining strings and show that it agrees with the universal Nambu--Goto predictions except for an additional massive scalar resonance. This resonance, however, turns out to be a bulk glueball mixing with the flux tube excitations rather than a genuine string worldsheet state. In general $\mathbb{Z}_N$ gauge theories (dual to clock spin models), we observe a continuous phase transition for $N \geq 4$, while for $N > 5$ it is governed by the $O(2)$ universality class. The critical behavior of the string tension and mass gap is verified to be described by a dangerously irrelevant operator. At large $N$ the glueball spectrum is expected to approach the spectrum of U(1) gauge theory, which is confirmed by our lattice data.


title: On a problem of Brown, Erd\H{o}s and S\'{o}s

abstract: Let $f^{(r)}(n;s,k)$ be the maximum number of edges in an $n$-vertex $r$-uniform hypergraph not containing a subhypergraph with $k$ edges on at most $s$ vertices. Recently, Delcourt and Postle, building on work of Glock, Joos, Kim, K\"{u}hn, Lichev and Pikhurko, proved that the limit $\lim_{n \to \infty} n^{-2} f^{(3)}(n;k+2,k)$ exists for all $k \ge 2$, solving an old problem of Brown, Erd\H{o}s and S\'{o}s (1973). Meanwhile, Shangguan and Tamo asked the more general question of determining if the limit $\lim_{n \to \infty} n^{-t} f^{(r)}(n;k(r-t)+t,k)$ exists for all $r>t\ge 2$ and $k \ge 2$. Here we make progress on their question. For every even $k$, we determine the value of the limit when $r$ is sufficiently large with respect to $k$ and $t$. Moreover, we show that the limit exists for $k \in \{5,7\}$ and all $r > t \ge 2$.


title: Population Monte Carlo with Normalizing Flow

abstract: Adaptive importance sampling (AIS) methods provide a useful alternative to Markov Chain Monte Carlo (MCMC) algorithms for performing inference of intractable distributions. Population Monte Carlo (PMC) algorithms constitute a family of AIS approaches which adapt the proposal distributions iteratively to improve the approximation of the target distribution. Recent work in this area primarily focuses on ameliorating the proposal adaptation procedure for high-dimensional applications. However, most of the AIS algorithms use simple proposal distributions for sampling, which might be inadequate in exploring target distributions with intricate geometries. In this work, we construct expressive proposal distributions in the AIS framework using normalizing flow, an appealing approach for modeling complex distributions. We use an iterative parameter update rule to enhance the approximation of the target distribution. Numerical experiments show that in high-dimensional settings, the proposed algorithm offers significantly improved performance compared to the existing techniques.


title: Stop Hiding The Sharp Knives: The WebAssembly Linux Interface

abstract: WebAssembly is gaining popularity as a portable binary format targetable from many programming languages. With a well-specified low-level virtual instruction set, minimal memory footprint and many high-performance implementations, it has been successfully adopted for lightweight in-process memory sandboxing in many contexts. Despite these advantages, WebAssembly lacks many standard system interfaces, making it difficult to reuse existing applications. This paper proposes WALI: The WebAssembly Linux Interface, a thin layer over Linux's userspace system calls, creating a new class of virtualization where WebAssembly seamlessly interacts with native processes and the underlying operating system. By virtualizing the lowest level of userspace, WALI offers application portability with little effort and reuses existing compiler backends. With WebAssembly's control flow integrity guarantees, these modules gain an additional level of protection against remote code injection attacks. Furthermore, capability-based APIs can themselves be virtualized and implemented in terms of WALI, improving reuse and robustness through better layering. We present an implementation of WALI in a modern WebAssembly engine and evaluate its performance on a number of applications which we can now compile with mostly trivial effort.


title: Towards Tight Bounds for the Graph Homomorphism Problem Parameterized by Cutwidth via Asymptotic Rank Parameters

abstract: A homomorphism from a graph $G$ to a graph $H$ is an edge-preserving mapping from $V(G)$ to $V(H)$. In the graph homomorphism problem, denoted by $Hom(H)$, the graph $H$ is fixed and we need to determine if there exists a homomorphism from an instance graph $G$ to $H$. We study the complexity of the problem parameterized by the cutwidth of $G$. We aim, for each $H$, for algorithms for $Hom(H)$ running in time $c_H^k n^{\mathcal{O}(1)}$ and matching lower bounds that exclude $c_H^{k \cdot o(1)}n^{\mathcal{O}(1)}$ or $c_H^{k(1-\Omega(1))}n^{\mathcal{O}(1)}$ time algorithms under the (Strong) Exponential Time Hypothesis. In the paper we introduce a new parameter that we call $\mathrm{mimsup}(H)$. Our main contribution is strong evidence of a close connection between $c_H$ and $\mathrm{mimsup}(H)$: * an information-theoretic argument that the number of states needed in a natural dynamic programming algorithm is at most $\mathrm{mimsup}(H)^k$, * lower bounds that show that for almost all graphs $H$ indeed we have $c_H \geq \mathrm{mimsup}(H)$, assuming the (Strong) Exponential-Time Hypothesis, and * an algorithm with running time $\exp ( {\mathcal{O}( \mathrm{mimsup}(H) \cdot k \log k)}) n^{\mathcal{O}(1)}$. The parameter $\mathrm{mimsup}(H)$ can be thought of as the $p$-th root of the maximum induced matching number in the graph obtained by multiplying $p$ copies of $H$ via certain graph product, where $p$ tends to infinity. It can also be defined as an asymptotic rank parameter of the adjacency matrix of $H$. Our results tightly link the parameterized complexity of a problem to such an asymptotic rank parameter for the first time.


title: Revisiting the cosmic string origin of GW190521

abstract: For the first time we analyse gravitational-wave strain data using waveforms constructed from strong gravity simulations of cosmic string loops collapsing to Schwarzschild black holes; a previously unconsidered source. Since the expected signal is dominated by a black-hole ringdown, it can mimic the observed gravitational waves from high-mass binary black hole mergers. To illustrate this, we consider GW190521, a short duration gravitational-wave event observed in the third LIGO--Virgo--KAGRA observing run. We show that describing this event as a collapsing cosmic string loop is favoured over previous cosmic string analyses by an approximate log Bayes factor of $22$. The binary black hole hypothesis is still preferred, mostly because the cosmic string remnant is non-spinning. It remains an open question whether a spinning remnant could form from loops with angular momentum, but if possible, it would likely bring into contention the binary black hole preference. Finally, we suggest that searches for ringdown-only waveforms would be a viable approach for identifying collapsing cosmic string events and estimating their event rate. This work opens up an important new direction for the cosmic-string and gravitational-wave communities.


title: Data-driven analysis of annual rain distributions

abstract: Rainfall is an important component of the climate system and its statistical properties are vital for prediction purposes. In this study, we have developed a statistical method for constructing the distribution of annual precipitation. The method is based on the convolution of the measured monthly rainfall distributions and does not depend on any presumed annual rainfall distribution. Using a simple statistical model, we demonstrate that our approach allows for a better prediction of extremely dry or wet years with a recurrence time several times longer than the original time series. The method that has been proposed can be utilized for other climate variables as well.


title: An inductive bias from quantum mechanics: learning order effects with non-commuting measurements

abstract: There are two major approaches to building good machine learning algorithms: feeding lots of data into large models, or picking a model class with an ''inductive bias'' that suits the structure of the data. When taking the second approach as a starting point to design quantum algorithms for machine learning, it is important to understand how mathematical structures in quantum mechanics can lead to useful inductive biases in quantum models. In this work, we bring a collection of theoretical evidence from the Quantum Cognition literature to the field of Quantum Machine Learning to investigate how non-commutativity of quantum observables can help to learn data with ''order effects'', such as the changes in human answering patterns when swapping the order of questions in a survey. We design a multi-task learning setting in which a generative quantum model consisting of sequential learnable measurements can be adapted to a given task -- or question order -- by changing the order of observables, and we provide artificial datasets inspired by human psychology to carry out our investigation. Our first experimental simulations show that in some cases the quantum model learns more non-commutativity as the amount of order effect present in the data is increased, and that the quantum model can learn to generate better samples for unseen question orders when trained on others - both signs that the model architecture suits the task.


title: Efficient Large Language Models: A Survey

abstract: Large Language Models (LLMs) have demonstrated remarkable capabilities in important tasks such as natural language understanding and language generation, and thus have the potential to make a substantial impact on our society. Such capabilities, however, come with the considerable resources they demand, highlighting the strong need to develop effective techniques for addressing their efficiency challenges. In this survey, we provide a systematic and comprehensive review of efficient LLMs research. We organize the literature in a taxonomy consisting of three main categories, covering distinct yet interconnected efficient LLMs topics from model-centric, data-centric, and framework-centric perspective, respectively. We have also created a GitHub repository where we organize the papers featured in this survey at https://github.com/AIoT-MLSys-Lab/Efficient-LLMs-Survey. We will actively maintain the repository and incorporate new research as it emerges. We hope our survey can serve as a valuable resource to help researchers and practitioners gain a systematic understanding of efficient LLMs research and inspire them to contribute to this important and exciting field.


title: Geometry Matching for Multi-Embodiment Grasping

abstract: Many existing learning-based grasping approaches concentrate on a single embodiment, provide limited generalization to higher DoF end-effectors and cannot capture a diverse set of grasp modes. We tackle the problem of grasping using multiple embodiments by learning rich geometric representations for both objects and end-effectors using Graph Neural Networks. Our novel method - GeoMatch - applies supervised learning on grasping data from multiple embodiments, learning end-to-end contact point likelihood maps as well as conditional autoregressive predictions of grasps keypoint-by-keypoint. We compare our method against baselines that support multiple embodiments. Our approach performs better across three end-effectors, while also producing diverse grasps. Examples, including real robot demos, can be found at geo-match.github.io.


title: Learning Genomic Sequence Representations using Graph Neural Networks over De Bruijn Graphs

abstract: The rapid expansion of genomic sequence data calls for new methods to achieve robust sequence representations. Existing techniques often neglect intricate structural details, emphasizing mainly contextual information. To address this, we developed k-mer embeddings that merge contextual and structural string information by enhancing De Bruijn graphs with structural similarity connections. Subsequently, we crafted a self-supervised method based on Contrastive Learning that employs a heterogeneous Graph Convolutional Network encoder and constructs positive pairs based on node similarities. Our embeddings consistently outperform prior techniques for Edit Distance Approximation and Closest String Retrieval tasks.


title: Dynamically Reprogrammable Stiffness in Gecko-Inspired Laminated Structures

abstract: Adaptive structures are of interest for their ability to dynamically modify mechanical properties post fabrication, enabling structural performance that is responsive to environmental uncertainty and changing loading conditions. Dynamic control of stiffness is of particular importance as a fundamental structural property, impacting both static and dynamic structural performance. However, existing technologies necessitate continuous power to maintain multiple stiffness states or couple stiffness modulation to a large geometric reconfiguration. In this work, reversible lamination of stiff materials using Gecko-inspired dry adhesives is leveraged for bending stiffness control. All stiffness states are passively maintained, with electrostatic or magnetic actuation applied for ~1s to reprogram stiffness. We demonstrate hinges with up to four passively maintained reprogrammable states decoupled from any shape reconfiguration. Design guidelines are developed for maximizing stiffness modulation. Experimentally, the proposed method achieved a stiffness modulation ratio of up to 14.4, with simulations showing stiffness modulation ratios of at least 73.0. It is anticipated that the stiffness reprogramming method developed in this work will reduce energy requirements and design complexity for adaptation in aerospace and robotics applications.


title: Multi-Group Fairness Evaluation via Conditional Value-at-Risk Testing

abstract: Machine learning (ML) models used in prediction and classification tasks may display performance disparities across population groups determined by sensitive attributes (e.g., race, sex, age). We consider the problem of evaluating the performance of a fixed ML model across population groups defined by multiple sensitive attributes (e.g., race and sex and age). Here, the sample complexity for estimating the worst-case performance gap across groups (e.g., the largest difference in error rates) increases exponentially with the number of group-denoting sensitive attributes. To address this issue, we propose an approach to test for performance disparities based on Conditional Value-at-Risk (CVaR). By allowing a small probabilistic slack on the groups over which a model has approximately equal performance, we show that the sample complexity required for discovering performance violations is reduced exponentially to be at most upper bounded by the square root of the number of groups. As a byproduct of our analysis, when the groups are weighted by a specific prior distribution, we show that R\'enyi entropy of order 2/3 of the prior distribution captures the sample complexity of the proposed CVaR test algorithm. Finally, we also show that there exists a non-i.i.d. data collection strategy that results in a sample complexity independent of the number of groups.


title: Uncertainty-Informed Renewable Energy Scheduling: A Scalable Bilevel Framework

abstract: This work proposes an uncertainty-informed bid adjustment framework for integrating variable renewable energy sources (VRES) into electricity markets. This framework adopts a bilevel model to compute the optimal VRES day-ahead bids. It aims to minimize the expected system cost across day-ahead and real-time stages and approximate the cost efficiency of the stochastic market design. However, solving the bilevel optimization problem is computationally challenging for large-scale systems. To overcome this challenge, we introduce a novel technique based on strong duality and McCormick envelopes, which relaxes the problem to a linear program, enabling large-scale applications. The proposed bilevel framework is applied to the 1576-bus NYISO system and benchmarked against a myopic strategy, where the VRES bid is the mean value of the probabilistic power forecast. Results demonstrate that, under high VRES penetration levels (e.g., 40%), our framework can significantly reduce system costs and market-price volatility, by optimizing VRES quantities efficiently in the day-ahead market. Furthermore, we find that when transmission capacity increases, the proposed bilevel model will still reduce the system cost, whereas the myopic strategy may incur a much higher cost due to over-scheduling of VRES in the day-ahead market and the lack of flexible conventional generators in real time.


title: Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusion

abstract: This paper presents a novel approach to inpainting 3D regions of a scene, given masked multi-view images, by distilling a 2D diffusion model into a learned 3D scene representation (e.g. a NeRF). Unlike 3D generative methods that explicitly condition the diffusion model on camera pose or multi-view information, our diffusion model is conditioned only on a single masked 2D image. Nevertheless, we show that this 2D diffusion model can still serve as a generative prior in a 3D multi-view reconstruction problem where we optimize a NeRF using a combination of score distillation sampling and NeRF reconstruction losses. Predicted depth is used as additional supervision to encourage accurate geometry. We compare our approach to 3D inpainting methods that focus on object removal. Because our method can generate content to fill any 3D masked region, we additionally demonstrate 3D object completion, 3D object replacement, and 3D scene completion.


title: A M|M|m|m Queue System Transient Behavior Study

abstract: It is a very hard task to compute an exact solution for the differential equations, with differences, system that allows the determination of the M|M|m|m system transient probabilities. The respective complexity grows with m. The computations are extremely fastidious and the length and the fact that the expressions obtained are often approximate, and not exact, will not allow the transient probabilities behavior as time functions characterization. To overcome these problems, in this work it is analyzed how that system can supply approximate values to the M|M|m|m queue system. It is also presented an asymptotic method to solve the system that becomes possible in many cases to obtain simple approximated expressions for those probabilities using the M|M|Inf transient probabilities, very well-known and very much easier to study.


title: Hidden yet quantifiable: A lower bound for confounding strength using randomized trials

abstract: In the era of fast-paced precision medicine, observational studies play a major role in properly evaluating new treatments in clinical practice. Yet, unobserved confounding can significantly compromise causal conclusions drawn from non-randomized data. We propose a novel strategy that leverages randomized trials to quantify unobserved confounding. First, we design a statistical test to detect unobserved confounding with strength above a given threshold. Then, we use the test to estimate an asymptotically valid lower bound on the unobserved confounding strength. We evaluate the power and validity of our statistical test on several synthetic and semi-synthetic datasets. Further, we show how our lower bound can correctly identify the absence and presence of unobserved confounding in a real-world setting.


title: The BigCode Project Governance Card

abstract: This document serves as an overview of the different mechanisms and areas of governance in the BigCode project. It aims to support transparency by providing relevant information about choices that were made during the project to the broader public, and to serve as an example of intentional governance of an open research project that future endeavors can leverage to shape their own approach. The first section, Project Structure, covers the project organization, its stated goals and values, its internal decision processes, and its funding and resources. The second section, Data and Model Governance, covers decisions relating to the questions of data subject consent, privacy, and model release.


title: Optimizing $CO_{2}$ Capture in Pressure Swing Adsorption Units: A Deep Neural Network Approach with Optimality Evaluation and Operating Maps for Decision-Making

abstract: This study presents a methodology for surrogate optimization of cyclic adsorption processes, focusing on enhancing Pressure Swing Adsorption units for carbon dioxide ($CO_{2}$) capture. We developed and implemented a multiple-input, single-output (MISO) framework comprising two deep neural network (DNN) models, predicting key process performance indicators. These models were then integrated into an optimization framework, leveraging particle swarm optimization (PSO) and statistical analysis to generate a comprehensive Pareto front representation. This approach delineated feasible operational regions (FORs) and highlighted the spectrum of optimal decision-making scenarios. A key aspect of our methodology was the evaluation of optimization effectiveness. This was accomplished by testing decision variables derived from the Pareto front against a phenomenological model, affirming the surrogate models reliability. Subsequently, the study delved into analyzing the feasible operational domains of these decision variables. A detailed correlation map was constructed to elucidate the interplay between these variables, thereby uncovering the most impactful factors influencing process behavior. The study offers a practical, insightful operational map that aids operators in pinpointing the optimal process location and prioritizing specific operational goals.


title: Single cavitation bubble dynamics in a stagnation flow

abstract: Jetting of collapsing bubbles is a key aspect in cavitation-driven fluid-solid interactions as it shapes the bubble dynamics and additionally due to its direct interaction with the wall. We study experimentally and numerically the near-wall collapse and jetting of a single bubble seeded into the stagnation flow of a wall jet, i.e. a jet that impinges perpendicular onto a solid wall. High-speed imaging shows rich and rather distinct bubble dynamics for different wall jet flow velocities and bubble-to-wall stand-off distances. The simulations use a Volume-of-Fluid method and allow to numerically determine the microscopic and transient pressures and shear stresses on the wall. It is shown that a wall jet at moderate flow velocities of a few metres per second already shapes the bubble ellipsoidally inducing a planar and convergent jet flow. The distinct bubble dynamics allow to tailor the wall interaction. In particular, the shear stresses can be increased by orders of magnitude without increasing impact pressures the same way. Interestingly, at small seeding stand-offs, the bubble during the final collapse stage can lift off the wall and migrate against the flow direction of the wall jet such that the violent collapse occurs away from the wall.


title: Data-driven state-space and Koopman operator models of coherent state dynamics on invariant manifolds

abstract: The accurate simulation of complex dynamics in fluid flows demands a substantial number of degrees of freedom, i.e. a high-dimensional state space. Nevertheless, the swift attenuation of small-scale perturbations due to viscous diffusion permits in principle the representation of these flows using a significantly reduced dimensionality. Over time, the dynamics of such flows evolve towards a finite-dimensional invariant manifold. Using only data from direct numerical simulations, in the present work we identify the manifold and determine evolution equations for the dynamics on it. We use an advanced autoencoder framework to automatically estimate the intrinsic dimension of the manifold and provide an orthogonal coordinate system. Then, we learn the dynamics by determining an equation on the manifold by using both a function space approach (approximating the Koopman operator) and a state space approach (approximating the vector field on the manifold). We apply this method to exact coherent states for Kolmogorov flow and minimal flow unit pipe flow. Fully resolved simulations for these cases require O(103) and O(105) degrees of freedom respectively, and we build models with two or three degrees of freedom that faithfully capture the dynamics of these flows. For these examples, both the state space and function space time evaluations provide highly accurate predictions of the long-time dynamics in manifold coordinates.


title: Scaling transformer neural networks for skillful and reliable medium-range weather forecasting

abstract: Weather forecasting is a fundamental problem for anticipating and mitigating the impacts of climate change. Recently, data-driven approaches for weather forecasting based on deep learning have shown great promise, achieving accuracies that are competitive with operational systems. However, those methods often employ complex, customized architectures without sufficient ablation analysis, making it difficult to understand what truly contributes to their success. Here we introduce Stormer, a simple transformer model that achieves state-of-the-art performance on weather forecasting with minimal changes to the standard transformer backbone. We identify the key components of Stormer through careful empirical analyses, including weather-specific embedding, randomized dynamics forecast, and pressure-weighted loss. At the core of Stormer is a randomized forecasting objective that trains the model to forecast the weather dynamics over varying time intervals. During inference, this allows us to produce multiple forecasts for a target lead time and combine them to obtain better forecast accuracy. On WeatherBench 2, Stormer performs competitively at short to medium-range forecasts and outperforms current methods beyond 7 days, while requiring orders-of-magnitude less training data and compute. Additionally, we demonstrate Stormer's favorable scaling properties, showing consistent improvements in forecast accuracy with increases in model size and training tokens. Code and checkpoints will be made publicly available.


title: Exploring correlations between HEFT Higgs couplings $\kappa_V$ and $\kappa_{2V}$ via HH production at $e^+e^-$ colliders

abstract: In this work we explore the phenomenological implications at future $e^+e^-$ colliders of assuming anomalous couplings of the Higgs boson to gauge bosons $HVV$ and $HHVV$ ($V=W,Z$) given by the $\kappa$-modifiers with respect to the Standard Model couplings, $\kappa_V$ and $\kappa_{2V}$, respectively. For this study we use the Higgs Effective Field Theory (HEFT) where these two $\kappa$ parameters are identified with the two most relevant effective couplings at leading order, concretely $a=\kappa_V$ and $b=\kappa_{2V}$. Our focus is put on these two couplings and their potential correlations which we believe carry interesting information on the underlying ultraviolet theory. The particular studied process is $e^+e^- \to HH \nu \bar \nu$, where the vector boson scattering subprocess $WW \to HH$ plays a central role, specially at the largest planned energy colliders. Our detailed study of this process as a function of the energy and the angular variables indicates that the produced Higgs bosons in the BSM scenarios will have in general a high transversality as compared to the SM case if $\kappa_V^2 \neq \kappa_{2V}$. In order to enhance the sensitivity to these HEFT parameters $\kappa_V$ and $\kappa_{2V}$ and their potential correlations we propose here some selected differential cross sections for the $e^+e^- \to HH \nu \bar\nu$ process where different kinematic properties of the BSM case with respect to the SM are manifested. Finally, we will focus on the dominant Higgs decays to $b \bar b$ pairs leading to final events with 4 $b$-jets and missing transverse energy from the undetected neutrinos and will provide the expected accessibility to the $(\kappa_V,\kappa_{2V})$ effective couplings and their potential correlations. In our study we will consider the three projected energies for $e^+e^-$ colliders of 500 GeV, 1000 GeV and 3000 GeV.


title: Domain constraints improve risk prediction when outcome data is missing

abstract: Machine learning models are often trained to predict the outcome resulting from a human decision. For example, if a doctor decides to test a patient for disease, will the patient test positive? A challenge is that historical decision-making determines whether the outcome is observed: we only observe test outcomes for patients doctors historically tested. Untested patients, for whom outcomes are unobserved, may differ from tested patients along observed and unobserved dimensions. We propose a Bayesian model class which captures this setting. The purpose of the model is to accurately estimate risk for both tested and untested patients. Estimating this model is challenging due to the wide range of possibilities for untested patients. To address this, we propose two domain constraints which are plausible in health settings: a prevalence constraint, where the overall disease prevalence is known, and an expertise constraint, where the human decision-maker deviates from purely risk-based decision-making only along a constrained feature set. We show theoretically and on synthetic data that domain constraints improve parameter inference. We apply our model to a case study of cancer risk prediction, showing that the model's inferred risk predicts cancer diagnoses, its inferred testing policy captures known public health policies, and it can identify suboptimalities in test allocation. Though our case study is in healthcare, our analysis reveals a general class of domain constraints which can improve model estimation in many settings.