title: Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agents

abstract: Scene simulation in autonomous driving has gained significant attention because of its huge potential for generating customized data. However, existing editable scene simulation approaches face limitations in terms of user interaction efficiency, multi-camera photo-realistic rendering and external digital assets integration. To address these challenges, this paper introduces ChatSim, the first system that enables editable photo-realistic 3D driving scene simulations via natural language commands with external digital assets. To enable editing with high command flexibility,~ChatSim leverages a large language model (LLM) agent collaboration framework. To generate photo-realistic outcomes, ChatSim employs a novel multi-camera neural radiance field method. Furthermore, to unleash the potential of extensive high-quality digital assets, ChatSim employs a novel multi-camera lighting estimation method to achieve scene-consistent assets' rendering. Our experiments on Waymo Open Dataset demonstrate that ChatSim can handle complex language commands and generate corresponding photo-realistic scene videos.


title: Jacquard V2: Refining Datasets using the Human In the Loop Data Correction Method

abstract: In the context of rapid advancements in industrial automation, vision-based robotic grasping plays an increasingly crucial role. In order to enhance visual recognition accuracy, the utilization of large-scale datasets is imperative for training models to acquire implicit knowledge related to the handling of various objects. Creating datasets from scratch is a time and labor-intensive process. Moreover, existing datasets often contain errors due to automated annotations aimed at expediency, making the improvement of these datasets a substantial research challenge. Consequently, several issues have been identified in the annotation of grasp bounding boxes within the popular Jacquard Grasp. We propose utilizing a Human-In-The-Loop(HIL) method to enhance dataset quality. This approach relies on backbone deep learning networks to predict object positions and orientations for robotic grasping. Predictions with Intersection over Union (IOU) values below 0.2 undergo an assessment by human operators. After their evaluation, the data is categorized into False Negatives(FN) and True Negatives(TN). FN are then subcategorized into either missing annotations or catastrophic labeling errors. Images lacking labels are augmented with valid grasp bounding box information, whereas images afflicted by catastrophic labeling errors are completely removed. The open-source tool Labelbee was employed for 53,026 iterations of HIL dataset enhancement, leading to the removal of 2,884 images and the incorporation of ground truth information for 30,292 images. The enhanced dataset, named the Jacquard V2 Grasping Dataset, served as the training data for a range of neural networks.


title: Mixed Integer Linear Programming Solver Using Benders Decomposition Assisted by Neutral Atom Quantum Processor

abstract: This paper presents a new hybrid classical-quantum approach to solve Mixed Integer Linear Programming (MILP) using neutral atom quantum computations. We apply Benders decomposition (BD) to segment MILPs into a master problem (MP) and a subproblem (SP), where the MP is addressed using a neutral-atom device, after being transformed into a Quadratic Unconstrained Binary Optimization (QUBO) model, with an automatized procedure. Our MILP to QUBO conversion tightens the upper bounds of the involved continuous variables, positively impacting the required qubit count, and the convergence of the algorithm. To solve the QUBO, we develop a heuristic for atom register embedding and apply a variational algorithm for pulse shaping. In addition, we implement a Proof of Concept (PoC) that outperforms existing solutions. We also conduct preliminary numerical results: in a series of small MILP instances our algorithm identifies over 95 percent of feasible solutions of high quality, outperforming classical BD approaches where the MP is solved using simulated annealing. To the best of our knowledge, this work is the first to utilize a neutral atom quantum processor in developing an automated, problem-agnostic framework for solving MILPs through BD.


title: Generalized Preference Optimization: A Unified Approach to Offline Alignment

abstract: Offline preference optimization allows fine-tuning large models directly from offline data, and has proved effective in recent alignment practices. We propose generalized preference optimization (GPO), a family of offline losses parameterized by a general class of convex functions. GPO enables a unified view over preference optimization, encompassing existing algorithms such as DPO, IPO and SLiC as special cases, while naturally introducing new variants. The GPO framework also sheds light on how offline algorithms enforce regularization, through the design of the convex function that defines the loss. Our analysis and experiments reveal the connections and subtle differences between the offline regularization and the KL divergence regularization intended by the canonical RLHF formulation. In a controlled setting akin to Gao et al 2023, we also show that different GPO variants achieve similar trade-offs between regularization and performance, though the optimal values of hyper-parameter might differ as predicted by theory. In all, our results present new algorithmic toolkits and empirical insights to alignment practitioners.


title: Surrogate Modeling and Control of Medical Digital Twins

abstract: The vision of personalized medicine is to identify interventions that maintain or restore a person's health based on their individual biology. Medical digital twins, computational models that integrate a wide range of health-related data about a person and can be dynamically updated, are a key technology that can help guide medical decisions. Such medical digital twin models can be high-dimensional, multi-scale, and stochastic. To be practical for healthcare applications, they often need to be simplified into low-dimensional surrogate models that can be used for the optimal design of interventions. This paper introduces surrogate modeling algorithms for the purpose of optimal control applications. As a use case, we focus on agent-based models (ABMs), a common model type in biomedicine for which there are no readily available optimal control algorithms. By deriving surrogate models that are based on systems of ordinary differential equations, we show how optimal control methods can be employed to compute effective interventions, which can then be lifted back to a given ABM. The relevance of the methods introduced here extends beyond medical digital twins to other complex dynamical systems.


title: Limit theorems for a strongly irreducible product of independent random matrices with optimal moment conditions

abstract: Let $ \nu $ be a probability distribution over the linear semi-group $ \mathrm{End}(E) $ for $ E $ a finite dimensional vector space over a locally compact field. We assume that $ \nu $ is proximal, strongly irreducible and that $ \nu^{*n}\{0\}=0 $ for all integers $ n\in\mathbb{N} $. We consider the random sequence $ \overline\gamma_n := \gamma_0 \cdots \gamma_{n-1} $ for $ (\gamma_k)_{k \ge 0} $ independents of distribution law $ \nu $. We define the logarithmic singular gap as $ \mathrm{sqz} = \log\left( \frac{\mu_1}{\mu_2} \right) $ , where $ \mu_1 $ and $ \mu_2 $ are the two largest singular values. We show that $ (\mathrm{sqz}(\overline{\gamma}_n))_{n\in\mathbb{N}} $ escapes to infinity linearly and satisfies exponential large deviations estimates below its escape rate. Using this escape speed, we also show that the image of a generic line by $ \overline{\gamma}_n $ as well as its eigenspace of maximal eigenvalue both converge to the same random line $ l_\infty $ at an exponential speed. If we moreover assume that the push-forward distribution $ N(\nu) $ is $ \mathrm{L}^p $ for $ N:g\mapsto\log\left(\|g\|\|g^{-1}\|\right) $ and for some $ p\ge 1 $ , then we show that $ \log|w(l_\infty)| $ is $ \mathrm{L}^p $ for all unitary linear form $ w $ and the logarithm of each coefficient of $ \overline{\gamma}_n $ is almost surely equivalent to the logarithm of the norm. To prove these results, we do not rely on any classical results for random products of invertible matrices with $ \mathrm{L}^1 $ moment assumption. Instead we describe an effective way to group the i.i.d factors into i.i.d random words that are aligned in the Cartan projection. We moreover have an explicit control over the moments.


title: Constraining the EdGB Theory with Extreme Mass-Ratio Inspirals

abstract: The Einstein-dilaton-Gauss-Bonnet (EdGB) theory is a modified theory which include a scalar field to couple with the higher order curvature terms. It has already been constrained with various observations include the gravitational wave (GW) with LIGO, Virgo and KAGRA (LVK) Collaboration. In this work, we study the problem of using the GW of Extreme Mass-Ratio Inspiral (EMRI) to constrain the EdGB theory. We use the "numerical kludge (NK)" method to construct the waveform of EMRI in the EdGB theory, focusing on the case when the central black hole is spinless. We then study how a future space-borne gravitational wave detector, TianQin, for example, can place constraints on the EdGB theory through the detection of EMRIs. With the analysis using mismatch and Fisher Information Matrix (FM), we find that the EdGB parameter $\sqrt{\alpha}$ is expected to be constrained to the level of $\sim\mathcal{O}(0.1)$ km.


title: Cops and Robber on Hyperbolic Manifolds

abstract: The Cops and Robber game on geodesic spaces is a pursuit-evasion game with discrete steps which captures the behavior of the game played on graphs, as well as that of continuous pursuit-evasion games. One of the outstanding open problems about the game on graphs is to determine which graphs embeddable in a surface of genus $g$ have largest cop number. It is known that the cop number of genus $g$ graphs is $O(g)$ and that there are examples whose cop number is $\tilde\Omega(\sqrt{g}\,)$. The same phenomenon occurs when the game is played on geodesic surfaces. In this paper we obtain a surprising result about the game on a surface with constant curvature. It is shown that two cops have a strategy to come arbitrarily close to the robber, independently of the genus. We also discuss upper bounds on the number of cops needed to catch the robber. Our results generalize to higher-dimensional hyperbolic manifolds.


title: Switching equivalence of strongly regular polar graphs

abstract: We prove the switching equivalence of the strongly regular polar graphs $NO^\pm(4m,2)$, $NO^\mp(2m+1,4)$, and $\Gamma(O^\mp(4m,2))$ plus an isolated vertex by giving an analytic description for them and their associated two-graphs.


title: SpiRit-LM: Interleaved Spoken and Written Language Model

abstract: We introduce SPIRIT-LM, a foundation multimodal language model that freely mixes text and speech. Our model is based on a pretrained text language model that we extend to the speech modality by continuously training it on text and speech units. Speech and text sequences are concatenated as a single set of tokens, and trained with a word-level interleaving method using a small automatically-curated speech-text parallel corpus. SPIRIT-LM comes in two versions: a BASE version that uses speech semantic units and an EXPRESSIVE version that models expressivity using pitch and style units in addition to the semantic units. For both versions, the text is encoded with subword BPE tokens. The resulting model displays both the semantic abilities of text models and the expressive abilities of speech models. Additionally, we demonstrate that SPIRIT-LM is able to learn new tasks in a few-shot fashion across modalities (i.e. ASR, TTS, Speech Classification).


title: Non-Markovian Quantum Mpemba effect

abstract: Since it's rediscovery in the twentieth century, the Mpemba effect, where a far-from-equilibrium state may relax faster than a state closer to equilibrium, has been extensively studied in classical systems and has recently received significant attention in quantum systems. Many theories explaining this counter-intuitive behavior in classical systems rely on memory effects. However, in quantum systems, the relation between the Mpemba effect and memory has remained unexplored. In this work, we consider a general non-Markovian open quantum setting and reveal new classes of quantum Mpemba effects, with no analog in Markovian quantum dynamics. Generically, open quantum dynamics possess a finite memory time and a unique steady state. Due to non-Markovian dynamics, even if the system is initialized in the steady state it can take a long time to relax back. We find other initial states that reach the steady state much faster. Most notably, we demonstrate that there can be an initial state in which the system reaches the steady state within the finite memory time itself, therefore giving the fastest possible relaxation to stationarity. We verify the effect for quantum dot systems coupled to electronic reservoirs in equilibrium and non-equilibrium setups at weak, intermediate and strong coupling, and both with and without interactions. Our work provides new insights into the rich physics underlying accelerated relaxation in quantum systems.


title: When is Mean-Field Reinforcement Learning Tractable and Relevant?

abstract: Mean-field reinforcement learning has become a popular theoretical framework for efficiently approximating large-scale multi-agent reinforcement learning (MARL) problems exhibiting symmetry. However, questions remain regarding the applicability of mean-field approximations: in particular, their approximation accuracy of real-world systems and conditions under which they become computationally tractable. We establish explicit finite-agent bounds for how well the MFG solution approximates the true $N$-player game for two popular mean-field solution concepts. Furthermore, for the first time, we establish explicit lower bounds indicating that MFGs are poor or uninformative at approximating $N$-player games assuming only Lipschitz dynamics and rewards. Finally, we analyze the computational complexity of solving MFGs with only Lipschitz properties and prove that they are in the class of \textsc{PPAD}-complete problems conjectured to be intractable, similar to general sum $N$ player games. Our theoretical results underscore the limitations of MFGs and complement and justify existing work by proving difficulty in the absence of common theoretical assumptions.


title: Latent variable model for high-dimensional point process with structured missingness

abstract: Longitudinal data are important in numerous fields, such as healthcare, sociology and seismology, but real-world datasets present notable challenges for practitioners because they can be high-dimensional, contain structured missingness patterns, and measurement time points can be governed by an unknown stochastic process. While various solutions have been suggested, the majority of them have been designed to account for only one of these challenges. In this work, we propose a flexible and efficient latent-variable model that is capable of addressing all these limitations. Our approach utilizes Gaussian processes to capture temporal correlations between samples and their associated missingness masks as well as to model the underlying point process. We construct our model as a variational autoencoder together with deep neural network parameterised encoder and decoder models, and develop a scalable amortised variational inference approach for efficient model training. We demonstrate competitive performance using both simulated and real datasets.


title: The non-collinear phase of the antiferromagnetic sawtooth chain

abstract: The antiferromagnetic sawtooth chain is a prototypical example of a frustrated spin system with vertex-sharing triangles, giving rise to complex quantum states. Depending on the interaction parameters, this system has three phases, of which the gapless non-collinear phase (for strongly coupled basal spins and loosely attached apical spins) has received little theoretical attention so far. In this work, we comprehensively investigate the properties of the non-collinear phase using large-scale tensor network computations which exploit the full SU(2) symmetry of the underlying Heisenberg model. We study the ground state both for finite systems using the density-matrix renormalization group (DMRG) as well as for infinite chains via the variational uniform matrix-product state (VUMPS) formalism. Finite temperatures and correlation functions are tackled via imaginary- or real time evolutions, which we implement using the time-dependent variational principle (TDVP). We find that the non-collinear phase is characterized by a double-Q structure for the apex-apex correlations. Deep into the phase, two peaks merge into a single one indicating a 90-degree spiral. The apical spins are soft and highly susceptible to external perturbations; they form a large number of gapless magnetic states that are polarized by weak fields and cause a long low-temperature tail in the specific heat. The dynamic spin-structure factor exhibits additive contributions from a two-spinon continuum (excitations of the basal chain) and a gapless peak at $k=\pi/2$ (excitations of the apical spins). Small temperatures excite the gapless states and smear the spectral weight of the $k=\pi/2$ peak out into a homogeneous flat-band structure. Our results are relevant, e.g., for the material atacamite Cu$_2$Cl(OH)$_3$ in high magnetic fields.


title: On the growth and evolution of low-mass planets in pressure bumps

abstract: Observations of protoplanetary discs have revealed dust rings which are likely due to the presence of pressure bumps in the disc. Because these structures tend to trap drifting pebbles, it has been proposed that pressure bumps may play an important role in the planet formation process. In this paper, we investigate the orbital evolution of a $0.1$ $M_\oplus$ protoplanet embedded in a pressure bump using 2-dimensional hydrodynamical simulations of protoplanetary discs consisting of gas and pebbles. We examine the role of thermal forces generated by the pebble accretion-induced heat release, taking into account the feedback between luminosity and eccentricity. We also study the effect of the pebble-scattered flow on the planet's orbital evolution. Due to accumulation of pebbles at the pressure bump, the planet's accretion luminosity is high enough to induce significant eccentricity growth through thermal forces. Accretion luminosity is also responsible for vortex formation at the planet position through baroclinic effects, which cause the planet escape from the dust ring if dust feedback onto the gas is neglected. Including the effect of the dust back-reaction leads to weaker vortices, which enable the planet to remain close to the pressure maximum on an eccentric orbit. Simulations in which the planet mass is allowed to increase as a consequence of pebble accretion resulted in the formation of giant planet cores with mass in the range $5-20$ $M_\oplus$ over $\sim 2\times 10^4$ yrs. This occurs for moderate values of the Stokes number $St \approx 0.01$ such that the pebble drift velocity is not too high and the dust ring mass not too small. Our results suggest that pressure bumps mays be preferred locations for the formation of giant planets, but this requires a moderate level of grain growth within the disc.


title: Growth history and quasar bias evolution at z < 3 from Quaia

abstract: We make use of the Gaia-Unwise quasar catalogue, Quaia, to constrain the growth history out to high redshifts from the clustering of quasars and their cross-correlation with maps of the Cosmic Microwave Background (CMB) lensing convergence. Considering three tomographic bins, centered at redshifts $\bar{z}_i = [0.69, 1.59, 2.72]$, we reconstruct the evolution of the amplitude of matter fluctuations $\sigma_8(z)$ over the last $\sim12$ billion years of cosmic history. In particular, we make one of the highest-redshift measurements of $\sigma_8$ ($\sigma_8(z=2.72)=0.22\pm 0.06$), finding it to be in good agreement (at the $\sim1\sigma$ level) with the value predicted by $\Lambda$CDM using CMB data from Planck. We also used the data to study the evolution of the linear quasar bias for this sample, finding values similar to those of other quasar samples, although with a less steep evolution at high redshifts. Finally, we study the potential impact of foreground contamination in the CMB lensing maps and, although we find evidence of contamination in cross-correlations at $z\sim1.7$ we are not able to clearly pinpoint its origin as being Galactic or extragalactic. Nevertheless, we determine that the impact of this contamination on our results is negligible.


title: OGLE GD-CEP-0516: the most metal-poor lithium-rich Galactic Cepheid

abstract: Classical Cepheids (DCEPs) are important astrophysical objects not only as standard candles for the determination of the cosmic distance ladder but also as a test-bed for the stellar evolution theory, thanks to the connection between their pulsation (periods, amplitudes) and stellar (luminosity, mass, effective temperature, metallicity) parameters. We aim to unveil the nature of the Galactic DCEP OGLE-GD-CEP-0516 and other DCEPs showing an enhanced abundance of lithium in their atmospheres. We have collected a high-resolution spectrum for OGLE-GD-CEP-0516 with UVES@VLT. Accurate stellar parameters: effective temperature, gravity, micro- and macro-turbulence, radial velocity, and metal abundances were measured for this star, using spectral synthesis techniques based on LTE plane-parallel atmospheric model. We measured a chemical pattern with most elements under-abundant compared with the Sun, i.e. [Fe/H]\,=\,$-$0.54\,$\pm$\,0.16~dex, [C/H]\,=\,$-$0.45\,$\pm$\,0.05~dex, or [Mg/H]\,=\,$-$0.40\,$\pm$\,0.16~dex among others. In particular, we measured a lithium abundance A(Li)\,=\,3.06\,$\pm$\,0.10~dex for OGLE-GD-CEP-0516, which makes this object the sixth Li-rich object among the Milky Way DCEPs. Our results favour the scenario in which the six Galactic Li-rich DCEPs are first-crossing the instability strip having had slowly-rotating progenitors during their main sequence phase. This study explored the link between lithium abundance and the pulsation period in classical Cepheids. It found that brighter Cepheids, indicative of higher mass, show enhanced lithium abundance, contrary to predictions from evolutionary models considering rotation. Additionally, an analysis of lithium abundance versus [Fe/H] revealed a lack of significant correlation, contradicting expectations from galactic chemical evolution (GCE) models.


title: The McKay correspondence in type $D_4$ via VGIT

abstract: We present an explicit GIT construction which produces both the minimal resolution of the type $D_4$ surface singularity, and also the orbifold resolution. Our construction is based on a Tannakian approach which is in principle applicable to arbitrary quotient singularities.


title: Datastringer: easy dataset monitoring for journalists

abstract: We created a software enabling journalists to define a set of criteria they would like to see applied regularly to a constantly-updated dataset, sending them an alert when these criteria are met, thus signaling them that there may be a story to write. The main challenges were to keep the product scalable and powerful, while making sure that it could be used by journalists who would not possess all the technical knowledge to exploit it fully. In order to do so, we had to choose Javascript as our main language, as well as designing the code in such a way that it would allow re-usability and further improvements. This project is a proof of concept being tested in a real-life environment, and will be developed towards more and more accessibility.


title: Analysis of practical fractional vortex beams at far field

abstract: The subject of calculating the topological charge (TC) or vortex strength of optical vortices has generated divided opinions among scientists. This is due to the fact that proper analytical results are hard to support from the experimental point of view, leading to different results and conclusions. In this work we will present numerical data that shows the limits of TC measurements for practical fractional vortices and the possible challenges that high order measurements may pose. By analyzing the far field phase and the behavior of the transitions we have shown that they follow specific curves that depend not only on the TC but also on the beam waist. This leads us to present a new "strength staircase" for practical vortices. Our aim is to give some insight in practical scenarios that have not been taken into account in previous results.


title: Off-policy Distributional Q($\lambda$): Distributional RL without Importance Sampling

abstract: We introduce off-policy distributional Q($\lambda$), a new addition to the family of off-policy distributional evaluation algorithms. Off-policy distributional Q($\lambda$) does not apply importance sampling for off-policy learning, which introduces intriguing interactions with signed measures. Such unique properties distributional Q($\lambda$) from other existing alternatives such as distributional Retrace. We characterize the algorithmic properties of distributional Q($\lambda$) and validate theoretical insights with tabular experiments. We show how distributional Q($\lambda$)-C51, a combination of Q($\lambda$) with the C51 agent, exhibits promising results on deep RL benchmarks.


title: Covariance matrix completion via auxiliary information

abstract: Covariance matrix estimation is an important task in the analysis of multivariate data in disparate scientific fields, including neuroscience, genomics, and astronomy. However, modern scientific data are often incomplete due to factors beyond the control of researchers, and data missingness may prohibit the use of traditional covariance estimation methods. Some existing methods address this problem by completing the data matrix, or by filling the missing entries of an incomplete sample covariance matrix by assuming a low-rank structure. We propose a novel approach that exploits auxiliary variables to complete covariance matrix estimates. An example of auxiliary variable is the distance between neurons, which is usually inversely related to the strength of neuronal correlation. Our method extracts auxiliary information via regression, and involves a single tuning parameter that can be selected empirically. We compare our method with other matrix completion approaches via simulations, and apply it to the analysis of large-scale neuroscience data.


title: A non-damped stabilization algorithm for multibody dynamics

abstract: The stability of integrators dealing with high order Differential Algebraic Equations (DAEs) is a major issue. The usual procedures give rise to instabilities that are not predicted by the usual linear analysis, rendering the common checks (developed for ODEs) unusable. The appearance of these difficult-toexplain and unexpected problems leads to methods that arise heavy numerical damping for avoiding them. This has the undesired consequences of lack of convergence of the methods, along with a need of smaller stepsizes. In this paper a new approach is presented. The algorithm presented here allows us to avoid the interference of the constraints in the integration, thus allowing the linear criteria to be applied. In order to do so, the integrator is applied to a set of instantaneous minimal coordinates that are obtained through the application of the null space. The new approach can be utilized along with any integration method. Some experiments using the Newmark method have been carried out, which validate the methodology and also show that the method behaves in a predictable way if one considers linear stability criteria.


title: A characterisation of Euclidean normed planes via bisectors

abstract: Our main result states that whenever we have a non-Euclidean norm $\|\cdot\|$ on a two-dimensional vector space $X$, there exists some $x\neq 0$ such that for every $\lambda\neq 1, \lambda>0$, there exist $y, z\in X$ verifying that $\|y\|=\lambda\|x\|$, $z\neq 0$, and $z$ belongs to the bisectors $B(-x,x)$ and $B(-y,y)$. Throughout this paper we also state and prove some other simple but maybe useful results about the geometry of the unit sphere of strictly convex planes.


title: Spectral asymmetry induces a re-entrant quantum Hall effect in a topological insulator

abstract: The band inversion of topological materials in three spatial dimensions is intimately connected to the parity anomaly of two-dimensional massless Dirac fermions. At finite magnetic fields, the parity anomaly reveals itself as a non-zero spectral asymmetry, i.e., a non-zero difference between the number of conduction and valence band Landau levels, due to the unpaired zero Landau level. Here, we realize this two-dimensional Dirac physics at a single surface of the three-dimensional topological insulator (Hg,Mn)Te. We observe an unconventional re-entrant quantum Hall effect that can be directly related to the occurrence of spectral asymmetry in a single topological surface state. The effect should be observable in any topological insulator where the transport is dominated by a single Dirac surface state.


title: Cyclic sieving on noncrossing (1,2)-configurations

abstract: Verifying a suspicion of Propp and Reiner concerning the cyclic sieving phenomenon (CSP), M. Thiel introduced a Catalan object called noncrossing $(1,2)$-configurations (denoted by $X_n$), which is a class of set partitions of $[n-1]$. More precisely, Thiel proved that, with a natural action of the cyclic group $C_{n-1}$ on $X_n$, the triple $\left(X_n,C_{n-1},\text{Cat}_n(q)\right)$ exhibits the CSP, where $\text{Cat}_n(q):=\frac{1}{[n+1]_q}\begin{bmatrix} 2n\\ n \end{bmatrix}_q$ is MacMahon's $q$-Catalan number. Recently, in a study of the fermionic diagonal coinvariant ring $FDR_n$, J. Kim found a combinatorial basis for $FDR_n$ indexed by $X_n$. In this paper, we continue to study $X_n$ and obtain the following results: (1) We define a statistic $cwt$ on $X_n$ whose generating function is $\text{Cat}_n(q)$, which answers a problem of Thiel. (2) We show that $\text{Cat}_n(q)$ is equivalent to $$\sum_{\substack{k,x,y\\2k+x+y=n-1}}\begin{bmatrix} n-1 2k,x,y \end{bmatrix}_q\text{Cat}_k (q)q^{k+\binom{x}{2}+\binom{y}{2}+\binom{n}{2}}$$ modulo $q^{n-1}-1$, which answers a problem of Kim. As mentioned by Kim, this result leads to a representation theoretic proof of the above cyclic sieving result of Thiel. (3) We consider the dihedral sieving, a generalization of the CSP, which was recently introduced by Rao and Suk. Under a natural action of the dihedral group $I_2(n-1)$ (for even $n$), we prove a dihedral sieving result on $X_n$.


title: The class of grim reapers in $\mathbb{H}^2\times\mathbb{R}$

abstract: We study translators of the mean curvature flow in the product space $\h^2\times\r$. In $\h^2\times\r$ there are three types of translations: vertical translations due to the factor $\r$ and parabolic and hyperbolic translations from $\h^2$. A grim reaper in $\h^2\times\r$ is a translator invariant by a one-parameter group of translations. The variety of translators and translations in $\h^2\times\r$ makes that the family of grim reapers particularly rich. In this paper we give a full classification of the grim reapers of $\h^2\times\r$ with a description of their geometric properties. In some cases, we obtain explicit parametrizations of the surfaces.


title: UAV-Rain1k: A Benchmark for Raindrop Removal from UAV Aerial Imagery

abstract: Raindrops adhering to the lens of UAVs can obstruct visibility of the background scene and degrade image quality. Despite recent progress in image deraining methods and datasets, there is a lack of focus on raindrop removal from UAV aerial imagery due to the unique challenges posed by varying angles and rapid movement during drone flight. To fill the gap in this research, we first construct a new benchmark dataset for removing raindrops from UAV images, called UAV-Rain1k. In this letter, we provide a dataset generation pipeline, which includes modeling raindrop shapes using Blender, collecting background images from various UAV angles, random sampling of rain masks and etc. Based on the proposed benchmark, we further present a comprehensive evaluation of existing representative image deraining algorithms, and reveal future research opportunities worth exploring. The proposed dataset is publicly available at https://github.com/cschenxiang/UAV-Rain1k.


title: Stable Autonomous Flow Matching

abstract: In contexts where data samples represent a physically stable state, it is often assumed that the data points represent the local minima of an energy landscape. In control theory, it is well-known that energy can serve as an effective Lyapunov function. Despite this, connections between control theory and generative models in the literature are sparse, even though there are several machine learning applications with physically stable data points. In this paper, we focus on such data and a recent class of deep generative models called flow matching. We apply tools of stochastic stability for time-independent systems to flow matching models. In doing so, we characterize the space of flow matching models that are amenable to this treatment, as well as draw connections to other control theory principles. We demonstrate our theoretical results on two examples.


title: Relations between closed string amplitudes and mixed string amplitudes at tree-level

abstract: This paper investigates the relationships between closed and mixed string amplitudes at the tree level in string theory. Through the analytic continuation of complex variables, we establish a factorization of closed string amplitudes into those involving ($n-2$) open strings and a single closed string. Expressions for four-, five-, and six-point amplitudes are provided, along with systematic formulations for $n$ strings. The paper addresses possible correction terms arising from integration along infinite tubes during the Wick rotation process. In the field theory limit, the correction terms become negligible due to being of subleading order.


title: On string theory on deformed BTZ and $T\bar T$

abstract: Aspects of superstring theory on deformed BTZ black holes, formed near $k$~NS5 branes by $p$~fundamental strings, and single-trace $T\bar T$ holography, are presented. The excitation energy of a singly wound long string plus its contribution to the energy of the black hole, $1/p$ fraction of the black-hole energy, is the same as that in $T\bar T$ deformed $CFT_2$ with $c=6k$. This supports the claim that the black hole can be thought of as a state in a symmetric product of $p$~$CFT_2$'s of central charge~$6k$, where the black-hole energy is split equally among all $p$ factors. A comment on superstring theory on deformed global $AdS_3$ is also presented.


title: Groups of permutations preserving orientation (parity) of subsets of a fixed size

abstract: We study permutations on $n$ elements preserving orientation (parity) of every subset of size $k$. We describe all groups of these permutations. Unexpectedly, these groups (except some special cases) are either trivial or cyclic or dihedral. We produce these results while defining semigroups generalizing semigroups of order-preserving mappings and semigroups of orientation-preserving mappings.


title: The $\phi^n$ trajectory bootstrap

abstract: The Green's functions $G_n=\langle\phi^n\rangle$ and their self-consistent equations admit analytic continuations to complex $n$. The indeterminacy of bootstrap problems can be resolved by the principle of minimal singularity. We use the harmonic oscillator to illustrate various aspects of the bootstrap analysis, such as the large $n$ expansion, matching conditions, exact quantization condition, and high energy asymptotic behavior. For the Hermitian quartic and non-Hermitian cubic oscillators, we revisit the $\phi^n$ trajectories at non-integer $n$ by the standard wave function formulation. The results are in agreement with the minimally singular solutions. Using the matching procedure, we obtain accurate solutions for anharmonic oscillators with higher powers. In particular, the existence of $G_n$ with non-integer $n$ allows us to bootstrap the $\mathcal{PT}$ invariant oscillators with non-integer powers.

categories: hep-th cond-mat.stat-mech hep-lat nucl-th quant-ph


title: Examining Gender and Racial Bias in Large Vision-Language Models Using a Novel Dataset of Parallel Images

abstract: Following on recent advances in large language models (LLMs) and subsequent chat models, a new wave of large vision-language models (LVLMs) has emerged. Such models can incorporate images as input in addition to text, and perform tasks such as visual question answering, image captioning, story generation, etc. Here, we examine potential gender and racial biases in such systems, based on the perceived characteristics of the people in the input images. To accomplish this, we present a new dataset PAIRS (PArallel Images for eveRyday Scenarios). The PAIRS dataset contains sets of AI-generated images of people, such that the images are highly similar in terms of background and visual content, but differ along the dimensions of gender (man, woman) and race (Black, white). By querying the LVLMs with such images, we observe significant differences in the responses according to the perceived gender or race of the person depicted.


title: Magic Class and the Convolution Group

abstract: The classification of many-body quantum states plays a fundamental role in the study of quantum phases of matter. In this work, we propose an approach to classify quantum states by introducing the concept of magic class. In addition, we introduce an efficient coarse-graining procedure to extract the magic feature of states, which we call the ``convolution group (CG).'' We classify quantum states into different magic classes using the fixed points of the CG and circuit equivalence. We also show that magic classes can be characterized by symmetries and the quantum entropy of the CG fixed points. Finally, we discuss the connection between the CG and the renormalization group. These results may provide new insight into the study of the state classification and quantum phases of matter.

categories: quant-ph cond-mat.stat-mech hep-th math-ph math.MP


title: Temporal Variation of Solar Equatorial Rossby Modes with Azimuthal Orders $6\leq m \leq 10$

abstract: We use nearly two decades of helioseismic data obtained from the GONG (2002-2020) and HMI (2010-2020) ring-diagram pipelines to examine the temporal variations of the properties of individual equatorial Rossby modes with azimuthal orders in the range $6 \le m \le 10$. We find that the mode parameters obtained from GONG and HMI are consistent during the data overlapping period of 2010-2020. The power and the frequency of each mode exhibit significant temporal variations over the full observing period. Using the GONG data during solar cycles 23 and 24, we find that the mode power averaged over $6 \le m \le 10$ shows a positive correlation with the sunspot number ($0.42$), while the averaged frequency shift is anti-correlated ($-0.91$). The anti-correlation between the average mode power and frequency shift is $-0.44$.


title: Analysing the Sample Complexity of Opponent Shaping

abstract: Learning in general-sum games often yields collectively sub-optimal results. Addressing this, opponent shaping (OS) methods actively guide the learning processes of other agents, empirically leading to improved individual and group performances in many settings. Early OS methods use higher-order derivatives to shape the learning of co-players, making them unsuitable for shaping multiple learning steps. Follow-up work, Model-free Opponent Shaping (M-FOS), addresses these by reframing the OS problem as a meta-game. In contrast to early OS methods, there is little theoretical understanding of the M-FOS framework. Providing theoretical guarantees for M-FOS is hard because A) there is little literature on theoretical sample complexity bounds for meta-reinforcement learning B) M-FOS operates in continuous state and action spaces, so theoretical analysis is challenging. In this work, we present R-FOS, a tabular version of M-FOS that is more suitable for theoretical analysis. R-FOS discretises the continuous meta-game MDP into a tabular MDP. Within this discretised MDP, we adapt the $R_{max}$ algorithm, most prominently used to derive PAC-bounds for MDPs, as the meta-learner in the R-FOS algorithm. We derive a sample complexity bound that is exponential in the cardinality of the inner state and action space and the number of agents. Our bound guarantees that, with high probability, the final policy learned by an R-FOS agent is close to the optimal policy, apart from a constant factor. Finally, we investigate how R-FOS's sample complexity scales in the size of state-action space. Our theoretical results on scaling are supported empirically in the Matching Pennies environment.


title: Text-to-Code Generation with Modality-relative Pre-training

abstract: Large pre-trained language models have recently been expanded and applied to programming language tasks with great success, often through further pre-training of a strictly-natural language model--where training sequences typically contain both natural and (linearised) programming language. Such approaches effectively map both modalities of the sequence into the same embedding space. However, programming language keywords (e.g. "while") often have very strictly defined semantics. As such, transfer learning from their natural language usage may not necessarily be beneficial to their code application and vise versa. Assuming an already pre-trained language model, in this work we investigate how sequence tokens can be adapted and represented differently, depending on which modality they belong to, and to the ultimate benefit of the downstream task. We experiment with separating embedding spaces between modalities during further model pre-training with modality-relative training objectives. We focus on text-to-code generation and observe consistent improvements across two backbone models and two test sets, measuring pass@$k$ and a novel incremental variation.


title: Tsallis holographic dark energy with power law ansatz approach

abstract: Holographic principles have proven to be a very interesting approach towards dealing with the issues of the late-time acceleration of the universe, which has resulted in a great amount of work on holographic dark energy models. We consider one such very interesting holographic scenario, namely the Tsallis Holographic dark energy model and consider an ansatz based approach to such models. We consider three cosmological scenarios in such models, namely those with viscous , non-viscous and Chaplygin gas scenarios, discussing various crucial aspects related to these models. We discuss various crucial properties of the Tsallis model in such scenarios and see how the phantom divide is crossed in each case, but it's only the Chaplygin gas models which give a better view on stability issues.


title: Limits of Transformer Language Models on Learning to Compose Algorithms

abstract: We analyze the capabilities of Transformer language models in learning compositional discrete tasks. To this end, we evaluate training LLaMA models and prompting GPT-4 and Gemini on four tasks demanding to learn a composition of several discrete sub-tasks. On both training LLaMA models from scratch and prompting on GPT-4 and Gemini, we measure how well these models can reuse primitives observable in the sub-tasks to learn the composition task. Our results indicate that compositional learning in state-of-the-art Transformer language models is highly sample inefficient: LLaMA requires more data samples than relearning all sub-tasks from scratch to learn the compositional task; in-context prompting with few samples is unreliable and fails at executing the sub-tasks or correcting the errors in multi-round code generation. Further, by leveraging complexity theory, we support these findings with a theoretical analysis focused on the sample inefficiency of gradient descent in memorizing feedforward models.


title: Prompting Fairness: Artificial Intelligence as Game Players

abstract: Utilitarian games such as dictator games to measure fairness have been studied in the social sciences for decades. These games have given us insight into not only how humans view fairness but also in what conditions the frequency of fairness, altruism and greed increase or decrease. While these games have traditionally been focused on humans, the rise of AI gives us the ability to study how these models play these games. AI is becoming a constant in human interaction and examining how these models portray fairness in game play can give us some insight into how AI makes decisions. Over 101 rounds of the dictator game, I conclude that AI has a strong sense of fairness that is dependant of it it deems the person it is playing with as trustworthy, framing has a strong effect on how much AI gives a recipient when designated the trustee, and there may be evidence that AI experiences inequality aversion just as humans.


title: How do Transformers perform In-Context Autoregressive Learning?

abstract: Transformers have achieved state-of-the-art performance in language modeling tasks. However, the reasons behind their tremendous success are still unclear. In this paper, towards a better understanding, we train a Transformer model on a simple next token prediction task, where sequences are generated as a first-order autoregressive process $s_{t+1} = W s_t$. We show how a trained Transformer predicts the next token by first learning $W$ in-context, then applying a prediction mapping. We call the resulting procedure in-context autoregressive learning. More precisely, focusing on commuting orthogonal matrices $W$, we first show that a trained one-layer linear Transformer implements one step of gradient descent for the minimization of an inner objective function, when considering augmented tokens. When the tokens are not augmented, we characterize the global minima of a one-layer diagonal linear multi-head Transformer. Importantly, we exhibit orthogonality between heads and show that positional encoding captures trigonometric relations in the data. On the experimental side, we consider the general case of non-commuting orthogonal matrices and generalize our theoretical findings.


title: The roles of environment and interactions on the evolution of red and blue galaxies in the EAGLE simulation

abstract: We study the evolution of the red and blue galaxies from $z=3$ to $z=0$ using the EAGLE simulation. The galaxies in the blue cloud and the red sequence are separated at each redshift using a scheme based on Otsu's method. Our analysis shows that the two populations have small differences in the local density and the clustering strength until $z=2$, after which the red galaxies preferentially occupy the denser regions and exhibit a significantly stronger clustering than the blue galaxies. The large differences in the cold gas mass and the star formation rate (SFR) of the two populations before $z=2$ indicate that the dichotomy between the two populations may not arise due to the environment alone. The galaxy pairs at each redshift show a significantly higher SFR than the isolated control galaxies within pair separations $<200$ kpc. The SFR of the paired galaxies at a given separation declines with the decreasing redshift, indicating a gradual depletion of their cold gas reservoir. At smaller pair separations, an anomalous increase of the SFR in paired galaxies around $z \sim 2$, suggests that the environmental effects start to dominate at this redshift, increasing the rate of galaxy interactions and the occurrence of starburst galaxies. We observe a substantial decrease in the blue fraction in paired galaxies starting from $z=1$ to the present. The decrease in the blue fraction is mild for the paired galaxies with their second nearest neighbour at a distance $>500$ kpc.


title: High Dimensional Factor Analysis with Weak Factors

abstract: This paper studies the principal components (PC) estimator for high dimensional approximate factor models with weak factors in that the factor loading ($\boldsymbol{\Lambda}^0$) scales sublinearly in the number $N$ of cross-section units, i.e., $\boldsymbol{\Lambda}^{0\top} \boldsymbol{\Lambda}^0 / N^\alpha$ is positive definite in the limit for some $\alpha \in (0,1)$. While the consistency and asymptotic normality of these estimates are by now well known when the factors are strong, i.e., $\alpha=1$, the statistical properties for weak factors remain less explored. Here, we show that the PC estimator maintains consistency and asymptotical normality for any $\alpha\in(0,1)$, provided suitable conditions regarding the dependence structure in the noise are met. This complements earlier result by Onatski (2012) that the PC estimator is inconsistent when $\alpha=0$, and the more recent work by Bai and Ng (2023) who established the asymptotic normality of the PC estimator when $\alpha \in (1/2,1)$. Our proof strategy integrates the traditional eigendecomposition-based approach for factor models with leave-one-out analysis similar in spirit to those used in matrix completion and other settings. This combination allows us to deal with factors weaker than the former and at the same time relax the incoherence and independence assumptions often associated with the later.


title: Underwater MEMS Gyrocompassing: A Virtual Testing Ground

abstract: In underwater navigation, accurate heading information is crucial for accurately and continuously tracking trajectories, especially during extended missions beneath the waves. In order to determine the initial heading, a gyrocompassing procedure must be employed. As unmanned underwater vehicles (UUV) are susceptible to ocean currents and other disturbances, the model-based gyrocompassing procedure may experience degraded performance. To cope with such situations, this paper introduces a dedicated learning framework aimed at mitigating environmental effects and offering precise underwater gyrocompassing. Through the analysis of the dynamic UUV signature obtained from inertial measurements, our proposed framework learns to refine disturbed signals, enabling a focused examination of the earth's rotation rate vector. Leveraging recent machine learning advancements, empirical simulations assess the framework's adaptability to challenging underwater conditions. Ultimately, its contribution lies in providing a resilient gyrocompassing solution for UUVs.


title: Determining the significance and relative importance of parameters of a simulated quenching algorithm using statistical tools

abstract: When search methods are being designed it is very important to know which parameters have the greatest influence on the behaviour and performance of the algorithm. To this end, algorithm parameters are commonly calibrated by means of either theoretic analysis or intensive experimentation. When undertaking a detailed statistical analysis of the influence of each parameter, the designer should pay attention mostly to the parameters that are statistically significant. In this paper the ANOVA (ANalysis Of the VAriance) method is used to carry out an exhaustive analysis of a simulated annealing based method and the different parameters it requires. Following this idea, the significance and relative importance of the parameters regarding the obtained results, as well as suitable values for each of these, were obtained using ANOVA and post-hoc Tukey HSD test, on four well known function optimization problems and the likelihood function that is used to estimate the parameters involved in the lognormal diffusion process. Through this statistical study we have verified the adequacy of parameter values available in the bibliography using parametric hypothesis tests.


title: Spatially-Periodic Solutions for Evolution Anisotropic Variable-Coefficient Navier-Stokes Equations: I. Existence

abstract: We consider evolution (non-stationary) space-periodic solutions to the $n$-dimensional non-linear Navier-Stokes equations of anisotropic fluids with the viscosity coefficient tensor variable in space and time and satisfying the relaxed ellipticity condition. Employing the Galerkin algorithm with the basis constituted by the eigenfunctions of the periodic Bessel-potential operator, we prove the existence of a global weak solution.


title: Exact quantum sensing limits for bosonic dephasing channels

abstract: Dephasing is a prominent noise mechanism that afflicts quantum information carriers, and it is one of the main challenges towards realizing useful quantum computation, communication, and sensing. Here we consider discrimination and estimation of bosonic dephasing channels, when using the most general adaptive strategies allowed by quantum mechanics. We reduce these difficult quantum problems to simple classical ones based on the probability densities defining the bosonic dephasing channels. By doing so, we rigorously establish the optimal performance of various distinguishability and estimation tasks and construct explicit strategies to achieve this performance. To the best of our knowledge, this is the first example of a non-Gaussian bosonic channel for which there are exact solutions for these tasks.


title: Phonetically rich corpus construction for a low-resourced language

abstract: Speech technologies rely on capturing a speaker's voice variability while obtaining comprehensive language information. Textual prompts and sentence selection methods have been proposed in the literature to comprise such adequate phonetic data, referred to as a phonetically rich \textit{corpus}. However, they are still insufficient for acoustic modeling, especially critical for languages with limited resources. Hence, this paper proposes a novel approach and outlines the methodological aspects required to create a \textit{corpus} with broad phonetic coverage for a low-resourced language, Brazilian Portuguese. Our methodology includes text dataset collection up to a sentence selection algorithm based on triphone distribution. Furthermore, we propose a new phonemic classification according to acoustic-articulatory speech features since the absolute number of distinct triphones, or low-probability triphones, does not guarantee an adequate representation of every possible combination. Using our algorithm, we achieve a 55.8\% higher percentage of distinct triphones -- for samples of similar size -- while the currently available phonetic-rich corpus, CETUC and TTS-Portuguese, 12.6\% and 12.3\% in comparison to a non-phonetically rich dataset.


title: The Unruh-DeWitt model and its joint interacting Hilbert space

abstract: In this work we make the connection between the Unruh-DeWitt particle detector model applied to quantum field theory in curved spacetimes and the rigorous construction of the spin-boson model. With some modifications, we show that existing results about the existence of a spin-boson ground state can be adapted to the Unruh-DeWitt model. In the most relevant scenario involving massless scalar fields in (3+1)-dimensional globally hyperbolic spacetimes, where the Unruh-DeWitt model describes a simplified model of light-matter interaction, we argue that common choices of the spacetime smearing functions regulate the ultraviolet behaviour of the model but can still exhibit infrared divergences. In particular, this implies the well-known expectation that the joint interacting Hilbert space of the model cannot be described by the tensor product of a two-dimensional complex Hilbert space and the Fock space of the vacuum representation. We discuss the conditions under which this problem does not arise and the relevance of the operator-algebraic approach for better understanding of particle detector models and their applications.


title: Cloud Formation by Supernova Implosion

abstract: The deposition of energy and momentum by supernova explosions has been subject to numerous studies in the past few decades. However, while there has been some work that focused on the transition from the adiabatic to the radiative stage of a supernova remnant (SNR), the late radiative stage and merging with the interstellar medium (ISM) have received little attention. Here, we use three-dimensional, hydrodynamic simulations, focusing on the evolution of SNRs during the radiative phase, considering a wide range of physical explosion parameters ($n_{\text{H, ISM}} \in \left[0.1, 100\right] \text{cm}^{-3}$ and $E_{\text{SN}} \in \left[1, 14\right]\times 10^{51} \text{erg}$). We find that the radiative phase can be subdivided in four stages: A pressure driven snowplow phase during which the hot overpressurized bubble gas is evacuated and pushed into the cold shell, a momentum conserving snowplow phase which is accompanied by a broadening of the shell, an implosion phase where cold material from the back of the shell is flooding the central vacuum and a final cloud phase, during which the imploding gas is settling as a central, compact overdensity. The launching timescale for the implosion ranges from a few 100 kyr to a few Myr, while the cloud formation timescale ranges from a few to about 10 Myr. The highly chemically enriched clouds can become massive ($M_{\text{cl}} \sim 10^3 - 10^4 \, \text{M}_{\odot}$) and self-gravitating within a few Myr after their formation, providing an attractive, novel pathway for supernova induced star and planet formation in the ISM.


title: TaE: Task-aware Expandable Representation for Long Tail Class Incremental Learning

abstract: Class-incremental learning (CIL) aims to train classifiers that learn new classes without forgetting old ones. Most CIL methods focus on balanced data distribution for each task, overlooking real-world long-tailed distributions. Therefore, Long-Tailed Class-Incremental Learning (LT-CIL) has been introduced, which trains on data where head classes have more samples than tail classes. Existing methods mainly focus on preserving representative samples from previous classes to combat catastrophic forgetting. Recently, dynamic network algorithms frozen old network structures and expanded new ones, achieving significant performance. However, with the introduction of the long-tail problem, merely extending task-specific parameters can lead to miscalibrated predictions, while expanding the entire model results in an explosion of memory size. To address these issues, we introduce a novel Task-aware Expandable (TaE) framework, dynamically allocating and updating task-specific trainable parameters to learn diverse representations from each incremental task, while resisting forgetting through the majority of frozen model parameters. To further encourage the class-specific feature representation, we develop a Centroid-Enhanced (CEd) method to guide the update of these task-aware parameters. This approach is designed to adaptively minimize the distances between intra-class features while simultaneously maximizing the distances between inter-class features across all seen classes. The utility of this centroid-enhanced method extends to all "training from scratch" CIL algorithms. Extensive experiments were conducted on CIFAR-100 and ImageNet100 under different settings, which demonstrates that TaE achieves state-of-the-art performance.


title: Visual Harmony: Text-Visual Interplay in Circular Infographics

abstract: Infographics are visual representations designed for efficient and effective communication of data and knowledge. One crucial aspect of infographic design is the interplay between text and visual elements, particularly in circular visualizations where the textual descriptions can either be embedded within the graphics or placed adjacent to the visual representation. While several studies have examined text layout design in visualizations in general, the text-visual interplay in infographics and its subsequent perceptual effects remain underexplored. To address this, our study investigates how varying text placement and descriptiveness impact pleasantness, comprehension and overall memorability in the infographics viewing experience. We recruited 30 participants and presented them with a collection of 15 infographics across a diverse set of topics, including media and public events, health and nutrition, science and research, and sustainability. The text placement (embed, side-to-side) and descriptiveness (simplistic, normal, descriptive) were systematically manipulated, resulting in a total of six experimental conditions. Our key findings indicate that text placement can significantly influence the memorability of infographics, whereas descriptiveness can significantly impact the pleasantness of the viewing experience. Embedding text placement and simplistic text can potentially contribute to more effective infographic designs. These results offer valuable insights for infographic designers, contributing to the creation of more effective and memorable visual representations.


title: Recent Breakthrough in AI-Driven Materials Science: Tech Giants Introduce Groundbreaking Models

abstract: A close look of Google's GNoME inorganic materials dataset [Nature 624, 80 (2023)], and 11 things you would like to know.


title: Random choice spanning trees

abstract: In this paper we introduce a new model of random spanning trees that we call choice spanning trees, constructed from so-called choice random walks. These are random walks for which each step is chosen from a subset of random options, according to some pre-defined rule. The choice spanning trees are constructed by running a choice modified version of Wilson's algorithm or the Aldous-Broder algorithm on the complete graph. We show that the scaling limits of these choice spanning trees are slight variants of random aggregation trees previously considered by Curien and Haas (2017). Moreover, we show that the loop-erasure of a choice random walk run on the complete graph converges after rescaling to a generalized Rayleigh process, extending a result of Evans, Pitman and Winter (2006). These are all natural extensions of similar results for uniform spanning trees.


title: Predicting the photodynamics of cyclobutanone triggered by a laser pulse at 200 nm and its MeV-UED signals -- a trajectory surface hopping and XMS-CASPT2 perspective

abstract: This work is part of a prediction challenge that invited theoretical/computational chemists to predict the photochemistry of cyclobutanone in the gas phase, excited at 200 nm by a laser pulse, and the expected signal that will be recorded during a time-resolved megaelectronvolt ultrafast electron diffraction (MeV-UED). We present here our theoretical predictions based on a combination of trajectory surface hopping with XMS-CASPT2 (for the nonadiabatic molecular dynamics) and Born-Oppenheimer molecular dynamics (BOMD) with MP2 (for the athermal ground-state dynamics following internal conversion), coined (NA+BO)MD. The initial conditions were sampled from BOMD coupled to a quantum thermostat. Our simulations indicate that the main photoproducts after 2 ps of dynamics are CO + cyclopropane (50%), CO + propene (10%), and ethene and ketene (34%). The photoexcited cyclobutanone in its second excited electronic state S$_2$ can follow two pathways for its nonradiative decay: (i) a ring-opening in S$_2$ and a subsequent rapid decay to the ground electronic state, where the photoproducts are formed, or (ii) a transfer through a closed-ring conical intersection to S$_1$, where cyclobutanone ring opens and then funnels to the ground state. Lifetimes for the photoproduct and electronic populations were determined. We calculated a stationary MeV-UED signal [difference pair distribution function - $\Delta$PDF$(r)$] for each (interpolated) pathway as well as a time-resolved signal [$\Delta$PDF$(r,t)$ and $\Delta I/I(s,t)$] for the full swarm of (NA+BO)MD trajectories. Furthermore, our analysis provides time-independent basis functions that can be used to fit the time-dependent experimental UED signals and potentially recover the population of photoproducts. We also offer a detailed analysis of the limitations of our model and their potential impact on the predicted experimental signals.


title: Unsupervised Discovery of Clinical Disease Signatures Using Probabilistic Independence

abstract: Insufficiently precise diagnosis of clinical disease is likely responsible for many treatment failures, even for common conditions and treatments. With a large enough dataset, it may be possible to use unsupervised machine learning to define clinical disease patterns more precisely. We present an approach to learning these patterns by using probabilistic independence to disentangle the imprint on the medical record of causal latent sources of disease. We inferred a broad set of 2000 clinical signatures of latent sources from 9195 variables in 269,099 Electronic Health Records. The learned signatures produced better discrimination than the original variables in a lung cancer prediction task unknown to the inference algorithm, predicting 3-year malignancy in patients with no history of cancer before a solitary lung nodule was discovered. More importantly, the signatures' greater explanatory power identified pre-nodule signatures of apparently undiagnosed cancer in many of those patients.


title: AvatarMMC: 3D Head Avatar Generation and Editing with Multi-Modal Conditioning

abstract: We introduce an approach for 3D head avatar generation and editing with multi-modal conditioning based on a 3D Generative Adversarial Network (GAN) and a Latent Diffusion Model (LDM). 3D GANs can generate high-quality head avatars given a single or no condition. However, it is challenging to generate samples that adhere to multiple conditions of different modalities. On the other hand, LDMs excel at learning complex conditional distributions. To this end, we propose to exploit the conditioning capabilities of LDMs to enable multi-modal control over the latent space of a pre-trained 3D GAN. Our method can generate and edit 3D head avatars given a mixture of control signals such as RGB input, segmentation masks, and global attributes. This provides better control over the generation and editing of synthetic avatars both globally and locally. Experiments show that our proposed approach outperforms a solely GAN-based approach both qualitatively and quantitatively on generation and editing tasks. To the best of our knowledge, our approach is the first to introduce multi-modal conditioning to 3D avatar generation and editing. \\href{avatarmmc-sig24.github.io}{Project Page}


title: InkSight: Offline-to-Online Handwriting Conversion by Learning to Read and Write

abstract: Digital note-taking is gaining popularity, offering a durable, editable, and easily indexable way of storing notes in the vectorized form, known as digital ink. However, a substantial gap remains between this way of note-taking and traditional pen-and-paper note-taking, a practice still favored by a vast majority. Our work, InkSight, aims to bridge the gap by empowering physical note-takers to effortlessly convert their work (offline handwriting) to digital ink (online handwriting), a process we refer to as Derendering. Prior research on the topic has focused on the geometric properties of images, resulting in limited generalization beyond their training domains. Our approach combines reading and writing priors, allowing training a model in the absence of large amounts of paired samples, which are difficult to obtain. To our knowledge, this is the first work that effectively derenders handwritten text in arbitrary photos with diverse visual characteristics and backgrounds. Furthermore, it generalizes beyond its training domain into simple sketches. Our human evaluation reveals that 87% of the samples produced by our model on the challenging HierText dataset are considered as a valid tracing of the input image and 67% look like a pen trajectory traced by a human. Interactive visualizations of 100 word-level model outputs for each of the three public datasets are available in our Hugging Face space: https://huggingface.co/spaces/Derendering/Model-Output-Playground. Model release is in progress.


title: Revealing fingerprints of valence excitons in x-ray absorption spectra with the Bethe-Salpeter equation

abstract: The Bethe-Salpeter equation (BSE) is a powerful theoretical approach that is capable to accurately treat electron-hole interactions in materials in an excited state. We developed an ab initio framework based on the BSE to describe a pump-probe experiment, in which an x-ray pulse probes solid-state valence excitons by means of x-ray absorption spectroscopy. Our theoretical framework is of relevance for an accurate modeling of pump-probe experiments of photo-excited materials that utilize novel capabilities offered by x-ray science.


title: On Calibration and Conformal Prediction of Deep Classifiers

abstract: In many classification applications, the prediction of a deep neural network (DNN) based classifier needs to be accompanied with some confidence indication. Two popular post-processing approaches for that aim are: 1) calibration: modifying the classifier's softmax values such that their maximum (associated with the prediction) better estimates the correctness probability; and 2) conformal prediction (CP): devising a score (based on the softmax values) from which a set of predictions with theoretically guaranteed marginal coverage of the correct class is produced. While in practice both types of indications can be desired, so far the interplay between them has not been investigated. Toward filling this gap, in this paper we study the effect of temperature scaling, arguably the most common calibration technique, on prominent CP methods. We start with an extensive empirical study that among other insights shows that, surprisingly, calibration has a detrimental effect on popular adaptive CP methods: it frequently leads to larger prediction sets. Then, we turn to theoretically analyze this behavior. We reveal several mathematical properties of the procedure, according to which we provide a reasoning for the phenomenon. Our study suggests that it may be worthwhile to utilize adaptive CP methods, chosen for their enhanced conditional coverage, based on softmax values prior to (or after canceling) temperature scaling calibration.


title: Rigid currents in birational geometry

abstract: A rigid current on a compact complex manifold is a closed positive current whose cohomology class contains only one closed positive current. Rigid currents occur in complex dynamics, algebraic and differential geometry. The goals of the present paper are: (a) to give a systematic treatment of rigid currents, (b) to demonstrate how they appear within the Minimal Model Program, and (c) to give many new examples of rigid currents.


title: Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning

abstract: In this paper, we propose R$^3$: Learning Reasoning through Reverse Curriculum Reinforcement Learning (RL), a novel method that employs only outcome supervision to achieve the benefits of process supervision for large language models. The core challenge in applying RL to complex reasoning is to identify a sequence of actions that result in positive rewards and provide appropriate supervision for optimization. Outcome supervision provides sparse rewards for final results without identifying error locations, whereas process supervision offers step-wise rewards but requires extensive manual annotation. R$^3$ overcomes these limitations by learning from correct demonstrations. Specifically, R$^3$ progressively slides the start state of reasoning from a demonstration's end to its beginning, facilitating easier model exploration at all stages. Thus, R$^3$ establishes a step-wise curriculum, allowing outcome supervision to offer step-level signals and precisely pinpoint errors. Using Llama2-7B, our method surpasses RL baseline on eight reasoning tasks by $4.1$ points on average. Notebaly, in program-based reasoning on GSM8K, it exceeds the baseline by $4.2$ points across three backbone models, and without any extra data, Codellama-7B + R$^3$ performs comparable to larger models or closed-source models.


title: You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement

abstract: Low-Light Image Enhancement (LLIE) task tends to restore the details and visual information from corrupted low-light images. Most existing methods learn the mapping function between low/normal-light images by Deep Neural Networks (DNNs) on sRGB and HSV color space. Nevertheless, enhancement involves amplifying image signals, and applying these color spaces to low-light images with a low signal-to-noise ratio can introduce sensitivity and instability into the enhancement process. Consequently, this results in the presence of color artifacts and brightness artifacts in the enhanced images. To alleviate this problem, we propose a novel trainable color space, named Horizontal/Vertical-Intensity (HVI). It not only decouples brightness and color from RGB channels to mitigate the instability during enhancement but also adapts to low-light images in different illumination ranges due to the trainable parameters. Further, we design a novel Color and Intensity Decoupling Network (CIDNet) with two branches dedicated to processing the decoupled image brightness and color in the HVI space. Within CIDNet, we introduce the Lightweight Cross-Attention (LCA) module to facilitate interaction between image structure and content information in both branches, while also suppressing noise in low-light images. Finally, we conducted 22 quantitative and qualitative experiments to show that the proposed CIDNet outperforms the state-of-the-art methods on 11 datasets. The code is available at https://github.com/Fediory/HVI-CIDNet.


title: Natural Language User Profiles for Transparent and Scrutable Recommendations

abstract: Current state-of-the-art recommender systems predominantly rely on either implicit or explicit feedback from users to suggest new items. While effective in recommending novel options, these conventional systems often use uninterpretable embeddings. This lack of transparency not only limits user understanding of why certain items are suggested but also reduces the user's ability to easily scrutinize and edit their preferences. For example, if a user has a change in interests, they would need to make significant changes to their interaction history to adjust the model's recommendations. To address these limitations, we introduce a novel method that utilizes user reviews to craft personalized, natural language profiles describing users' preferences. Through these descriptive profiles, our system provides transparent recommendations in natural language. Our evaluations show that this novel approach maintains a performance level on par with established recommender systems, but with the added benefits of transparency and user control. By enabling users to scrutinize why certain items are recommended, they can more easily verify, adjust, and have greater autonomy over their recommendations.


title: High-Q Cavity Interface for Color Centers in Thin Film Diamond

abstract: Quantum information technology offers the potential to realize unprecedented computational resources via secure channels capable of distributing entanglement between quantum computers. Diamond, as a host to atom-like defects with optically-accessible spin qubits, is a leading platform to realize quantum memory nodes needed to extend the reach of quantum links. Photonic crystal (PhC) cavities enhance light-matter interaction and are essential ingredients of an efficient interface between spins and photons that are used to store and communicate quantum information respectively. Despite great effort, however, the realization of visible PhC cavities with high quality factor (Q) and design flexibility is challenging in diamond. Here, we demonstrate one- and two-dimensional PhC cavities fabricated in recently developed thin-film diamonds, featuring Q-factors of 1.8x10$^5$ and 1.6x10$^5$, respectively, the highest Qs for visible PhC cavities realized in any material. Importantly, our fabrication process is simple and high-yield, based on conventional planar fabrication techniques, in contrast to previous approaches that rely on complex undercut methods. We also demonstrate fiber-coupled 1D PhC cavities with high photon extraction efficiency, and optical coupling between a single SiV center and such a cavity at 4K achieving a Purcell factor of 13. The demonstrated diamond thin-film photonic platform will improve the performance and scalability of quantum nodes and expand the range of quantum technologies.


title: FAQ-Gen: An automated system to generate domain-specific FAQs to aid content comprehension

abstract: Frequently Asked Questions (FAQs) refer to the most common inquiries about specific content. They serve as content comprehension aids by simplifying topics and enhancing understanding through succinct presentation of information. In this paper, we address FAQ generation as a well-defined Natural Language Processing task through the development of an end-to-end system leveraging text-to-text transformation models. We present a literature review covering traditional question-answering systems, highlighting their limitations when applied directly to the FAQ generation task. We propose a system capable of building FAQs from textual content tailored to specific domains, enhancing their accuracy and relevance. We utilise self-curated algorithms to obtain an optimal representation of information to be provided as input and also to rank the question-answer pairs to maximise human comprehension. Qualitative human evaluation showcases the generated FAQs as well-constructed and readable while also utilising domain-specific constructs to highlight domain-based nuances and jargon in the original content.


title: Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models

abstract: The aim of this study is to investigate Machine Unlearning (MU), a burgeoning field focused on addressing concerns related to neural models inadvertently retaining personal or sensitive data. Here, a novel approach is introduced to achieve precise and selective forgetting within language models. Unlike previous methodologies that adopt completely opposing training objectives, this approach aims to mitigate adverse effects on language model performance, particularly in generation tasks. Furthermore, two innovative evaluation metrics are proposed: Sensitive Information Extraction Likelihood (S-EL) and Sensitive Information Memory Accuracy (S-MA), designed to gauge the effectiveness of sensitive information elimination. To reinforce the forgetting framework, an effective method for annotating sensitive scopes is presented, involving both online and offline strategies. The online selection mechanism leverages language probability scores to ensure computational efficiency, while the offline annotation entails a robust two-stage process based on Large Language Models (LLMs).


title: Connectedness of level sets for non-degenerate integrable systems that extend complexity one torus actions

abstract: In this paper we study the connectedness of the level sets of integrable systems that have only non-degenerate singular points and extend complexity one $T$-spaces with proper moment maps. Our main result states that if there are no singular points with a hyperbolic block and connected $T$-stabilizer, then each level set is connected. Moreover, we prove that the above condition is necessary if either some reduced space is simply connected or the moment map for the integrable system is generic in a natural sense.


title: Effects of kappa-opioid agonist U-50488 and p38 MAPK inhibitor SB203580 on the spike activity of pyramidal neurons in the basolateral amygdala

abstract: Introduction: Kappa-opioid receptor (KOR) signaling in the basolateral amygdala (BLA) underlies KOR agonist-induced aversion. In this study, we aimed to understand the individual and combined effects of KOR agonist U-50488 and p38 MAPK inhibitor SB203580 on the spiking activity of pyramidal neurons in the BLA to shed light on the complex interplay between KORs, the p38 MAPK, and neuronal excitability. Materials and Methods: Electrophysiological experiments were performed using the patch-clamp technique in the whole-cell configuration. Rat brain slices containing the amygdala were prepared, and pyramidal neurons within the BLA were visually patched and recorded in the current clamp mode. The neurons were identified by their accommodation properties and neural activity signals were amplified and analyzed. Using local perfusion, we obtained three dose-response curves for: a) U-50488 (0.001-10 {\mu}M); b) U-50488 (0.001-10 {\mu}M) in the presence of SB203580 (1 {\mu}M); and c) U-50488 (0.01-10 {\mu}M) in the presence of SB203580 (5 {\mu}M). Results: After the application of U-50488, pyramidal neurons had a higher action potential firing rate in response to a current injection than control neurons (p<0.001). The dose-dependent curves we obtained indicate that the combination of U-50488 and SB203580 results in non-competitive antagonism. This conclusion is supported by the observed change in the curve`s slope with reduction in the maximum effect of U-50488. Thus, it can be assumed that the increase in spike activity of pyramidal neurons of the amygdala is mediated through the beta-arrestin pathway. When this pathway is blocked, the spike activity reverts to its baseline level. Conclusion: Our study found that the KOR agonist-induced spiking activity of the BLA pyramidal neurons is mediated by the beta-arrestin pathway and can be suppressed by the application of the p38 MAPK inhibitor SB203580.


title: Dynamical large deviations for boundary driven gradient symmetric exclusion processes in mild contact with reservoirs

abstract: We consider a one-dimensional gradient symmetric exclusion process in mild contact with boundary reservoirs. The hydrodynamic limit of the empirical measure is given by a non-linear second-order parabolic equation with non-linear Robin boundary conditions. We prove the dynamical large deviations principle.


title: Using YOLO v7 to Detect Kidney in Magnetic Resonance Imaging

abstract: Introduction This study explores the use of the latest You Only Look Once (YOLO V7) object detection method to enhance kidney detection in medical imaging by training and testing a modified YOLO V7 on medical image formats. Methods Study includes 878 patients with various subtypes of renal cell carcinoma (RCC) and 206 patients with normal kidneys. A total of 5657 MRI scans for 1084 patients were retrieved. 326 patients with 1034 tumors recruited from a retrospective maintained database, and bounding boxes were drawn around their tumors. A primary model was trained on 80% of annotated cases, with 20% saved for testing (primary test set). The best primary model was then used to identify tumors in the remaining 861 patients and bounding box coordinates were generated on their scans using the model. Ten benchmark training sets were created with generated coordinates on not-segmented patients. The final model used to predict the kidney in the primary test set. We reported the positive predictive value (PPV), sensitivity, and mean average precision (mAP). Results The primary training set showed an average PPV of 0.94 +/- 0.01, sensitivity of 0.87 +/- 0.04, and mAP of 0.91 +/- 0.02. The best primary model yielded a PPV of 0.97, sensitivity of 0.92, and mAP of 0.95. The final model demonstrated an average PPV of 0.95 +/- 0.03, sensitivity of 0.98 +/- 0.004, and mAP of 0.95 +/- 0.01. Conclusion Using a semi-supervised approach with a medical image library, we developed a high-performing model for kidney detection. Further external validation is required to assess the model's generalizability.


title: $L$-systems and the Lov\'asz number

abstract: Given integers $n > k > 0$, and a set of integers $L \subset [0, k-1]$, an \emph{$L$-system} is a family of sets $\mathcal{F} \subset \binom{[n]}{k}$ such that $|F \cap F'| \in L$ for distinct $F, F'\in \mathcal{F}$. $L$-systems correspond to independent sets in a certain generalized Johnson graph $G(n, k, L)$, so that the maximum size of an $L$-system is equivalent to finding the independence number of the graph $G(n, k, L)$. The \emph{Lov\'asz number} $\vartheta(G)$ is a semidefinite programming approximation of the independence number $\alpha$ of a graph $G$. In this paper, we determine the leading order term of $\vartheta(G(n, k, L))$ of any generalized Johnson graph with $k$ and $L$ fixed and $n\rightarrow \infty$. As an application of this theorem, we give an explicit construction of a graph $G$ on $n$ vertices with a large gap between the Lov\'asz number and the Shannon capacity $c(G)$. Specifically, we prove that for any $\epsilon > 0$, for sufficiently large $n$ there is a generalized Johnson graph $G$ on $n$ vertices which has ratio $\vartheta(G)/c(G) = \Omega(n^{1-\epsilon})$, which improves on all known constructions. The graph $G$ \textit{a fortiori} also has ratio $\vartheta(G)/\alpha(G) = \Omega(n^{1-\epsilon})$, which greatly improves on the best known explicit construction.


title: Integrating Self-supervised Speech Model with Pseudo Word-level Targets from Visually-grounded Speech Model

abstract: Recent advances in self-supervised speech models have shown significant improvement in many downstream tasks. However, these models predominantly centered on frame-level training objectives, which can fall short in spoken language understanding tasks that require semantic comprehension. Existing works often rely on additional speech-text data as intermediate targets, which is costly in the real-world setting. To address this challenge, we propose Pseudo-Word HuBERT (PW-HuBERT), a framework that integrates pseudo word-level targets into the training process, where the targets are derived from a visually-ground speech model, notably eliminating the need for speech-text paired data. Our experimental results on four spoken language understanding (SLU) benchmarks suggest the superiority of our model in capturing semantic information.


title: XLR (piXel Loss Rate): a Lightweight Indicator to Measure Video QoE in IP Networks

abstract: A novel Key Quality Indicator for video delivery applications, XLR (piXel Loss Rate), is defined, characterized, and evaluated. The proposed indicator is an objective measure that captures the effects of transmission errors in the received video, has a good correlation with subjective Mean Opinion Scores, and provides comparable results with state-of-the-art Full-Reference metrics. Moreover, XLR can be estimated using only a lightweight analysis on the compressed bitstream, thus allowing a No-Reference operational method. Therefore, XLR can be used for measuring the quality of experience without latency at any network location. Thus, it is a relevant tool for network planning, specially in new high-demanding scenarios. The experiments carried out show the outstanding performance of its linear-dimension score and the reliability of the bitstream-based estimation.


title: Guided Evolution with Binary Discriminators for ML Program Search

abstract: How to automatically design better machine learning programs is an open problem within AutoML. While evolution has been a popular tool to search for better ML programs, using learning itself to guide the search has been less successful and less understood on harder problems but has the promise to dramatically increase the speed and final performance of the optimization process. We propose guiding evolution with a binary discriminator, trained online to distinguish which program is better given a pair of programs. The discriminator selects better programs without having to perform a costly evaluation and thus speed up the convergence of evolution. Our method can encode a wide variety of ML components including symbolic optimizers, neural architectures, RL loss functions, and symbolic regression equations with the same directed acyclic graph representation. By combining this representation with modern GNNs and an adaptive mutation strategy, we demonstrate our method can speed up evolution across a set of diverse problems including a 3.7x speedup on the symbolic search for ML optimizers and a 4x speedup for RL loss functions.


title: Bounds for the Hilbert-Kunz Multiplicity of Singular Rings

abstract: In this paper we prove that the Watanabe-Yoshida conjecture holds up to dimension $7$. Our primary new tool is a function, $\varphi_J\left(R; z^t\right),$ that interpolates between the Hilbert-Kunz multiplicities of a base ring, $R$, and various radical extensions, $R_n$. We prove that this function is concave and show that it's rate of growth is related to the size of $e_{HK}\left(R\right)$. We combine several known techniques to get effective lower bounds for $\varphi,$ which translate to improved bounds on the size of Hilbert-Kunz multiplicities of singular rings. The improved inequalities are powerful enough to show that the conjecture of Watanabe and Yoshida holds in dimension $7$.


title: FusionSF: Fuse Heterogeneous Modalities in a Vector Quantized Framework for Robust Solar Power Forecasting

abstract: Accurate solar power forecasting is crucial to integrate photovoltaic plants into the electric grid, schedule and secure the power grid safety. This problem becomes more demanding for those newly installed solar plants which lack sufficient data. Current research predominantly relies on historical solar power data or numerical weather prediction in a single-modality format, ignoring the complementary information provided in different modalities. In this paper, we propose a multi-modality fusion framework to integrate historical power data, numerical weather prediction, and satellite images, significantly improving forecast performance. We introduce a vector quantized framework that aligns modalities with varying information densities, striking a balance between integrating sufficient information and averting model overfitting. Our framework demonstrates strong zero-shot forecasting capability, which is especially useful for those newly installed plants. Moreover, we collect and release a multi-modal solar power (MMSP) dataset from real-world plants to further promote the research of multi-modal solar forecasting algorithms. Our extensive experiments show that our model not only operates with robustness but also boosts accuracy in both zero-shot forecasting and scenarios rich with training data, surpassing leading models. We have incorporated it into our eForecaster platform and deployed it for more than 300 solar plants with a capacity of over 15GW.


title: Loss induced collective mode in one-dimensional Bose gases

abstract: We show that two-body losses induce a collective excitation in a harmonically trapped one-dimensional Bose gas, even in the absence of a quench in the trap or any other external perturbation. Focusing on the dissipatively fermionized regime, we perform an exact mode expansion of the rapidity distribution function and characterize the emergence of the collective motion. We find clear coherent oscillations in both the potential and kinetic energies as well as in the phase space quadrupole mode of the gas. We also discuss how this loss induced collective mode differs from the well known breathing mode studied in the absence of dissipation.


title: Predicting concentration changes via discrete sampling

abstract: To successfully navigate chemical gradients, microorganisms need to predict how the ligand concentration changes in space. Due to their limited size, they do not take a spatial derivative over their body length but rather a temporal derivative, comparing the current signal with that in the recent past, over the so-called adaptation time. This strategy is pervasive in biology, but it remains unclear what determines the accuracy of such measurements. Using a generalized version of the previously established sampling framework, we investigate how resource limitations and the statistics of the input signal set the optimal design of a well-characterized network that measures temporal concentration changes: the Escherichia coli chemotaxis network. Our results show how an optimal adaptation time arises from the trade-off between the sampling error, caused by the stochastic nature of the network, and the dynamical error, caused by uninformative fluctuations in the input. A larger resource availability reduces the sampling error, which allows for a smaller adaptation time, thereby simultaneously decreasing the dynamical error. Similarly, we find that the optimal adaptation time scales inversely with the gradient steepness, because steeper gradients lift the signal above the noise and reduce the sampling error. These findings shed light on the principles that govern the optimal design of the E. coli chemotaxis network specifically, and any system measuring temporal changes more broadly.


title: Microscopic models for the large-scale spread of SARS-CoV-2 virus: A Statistical Mechanics approach

abstract: In this work, we derive a system of Boltzmann-type equations to describe the spread of SARS-CoV-2 virus at the microscopic scale, that is by modeling the human-to-human mechanisms of transmission. To this end, we consider two populations, characterized by specific distribution functions, made up of individuals without symptoms (population $1$) and infected people with symptoms (population $2$). The Boltzmann operators model the interactions between individuals within the same population and among different populations with a probability of transition from one to the other due to contagion or, vice versa, to recovery. In addition, the influence of innate and adaptive immune systems is taken into account. Then, starting from the Boltzmann microscopic description we derive a set of evolution equations for the size and mean state of each population considered. Mathematical properties of such macroscopic equations, as equilibria and their stability, are investigated and some numerical simulations are performed in order to analyze the ability of our model to reproduce the characteristic features of Covid-19.


title: Is it Possible to Edit Large Language Models Robustly?

abstract: Large language models (LLMs) have played a pivotal role in building communicative AI to imitate human behaviors but face the challenge of efficient customization. To tackle this challenge, recent studies have delved into the realm of model editing, which manipulates specific memories of language models and changes the related language generation. However, the robustness of model editing remains an open question. This work seeks to understand the strengths and limitations of editing methods, thus facilitating robust, realistic applications of communicative AI. Concretely, we conduct extensive analysis to address the three key research questions. Q1: Can edited LLMs behave consistently resembling communicative AI in realistic situations? Q2: To what extent does the rephrasing of prompts lead LLMs to deviate from the edited knowledge memory? Q3: Which knowledge features are correlated with the performance and robustness of editing? Our experimental results uncover a substantial disparity between existing editing methods and the practical application of LLMs. On rephrased prompts that are complex and flexible but common in realistic applications, the performance of editing experiences a significant decline. Further analysis shows that more popular knowledge is memorized better, easier to recall, and more challenging to edit effectively.


title: Discovering Temporally-Aware Reinforcement Learning Algorithms

abstract: Recent advancements in meta-learning have enabled the automatic discovery of novel reinforcement learning algorithms parameterized by surrogate objective functions. To improve upon manually designed algorithms, the parameterization of this learned objective function must be expressive enough to represent novel principles of learning (instead of merely recovering already established ones) while still generalizing to a wide range of settings outside of its meta-training distribution. However, existing methods focus on discovering objective functions that, like many widely used objective functions in reinforcement learning, do not take into account the total number of steps allowed for training, or "training horizon". In contrast, humans use a plethora of different learning objectives across the course of acquiring a new ability. For instance, students may alter their studying techniques based on the proximity to exam deadlines and their self-assessed capabilities. This paper contends that ignoring the optimization time horizon significantly restricts the expressive potential of discovered learning algorithms. We propose a simple augmentation to two existing objective discovery approaches that allows the discovered algorithm to dynamically update its objective function throughout the agent's training procedure, resulting in expressive schedules and increased generalization across different training horizons. In the process, we find that commonly used meta-gradient approaches fail to discover such adaptive objective functions while evolution strategies discover highly dynamic learning rules. We demonstrate the effectiveness of our approach on a wide range of tasks and analyze the resulting learned algorithms, which we find effectively balance exploration and exploitation by modifying the structure of their learning rules throughout the agent's lifetime.