title: Calibrating Long-form Generations from Large Language Models

abstract: To enhance Large Language Models' (LLMs) reliability, calibration is essential -- the model's assessed confidence scores should align with the actual likelihood of its responses being correct. However, current confidence elicitation methods and calibration metrics typically rely on a binary true/false assessment of response correctness. This approach does not apply to long-form generation, where an answer can be partially correct. Addressing this gap, we introduce a unified calibration framework, in which both the correctness of the LLMs' responses and their associated confidence levels are treated as distributions across a range of scores. Within this framework, we develop three metrics to precisely evaluate LLM calibration and further propose two confidence elicitation methods based on self-consistency and self-evaluation. Our experiments, which include long-form QA and summarization tasks, demonstrate that larger models don't necessarily guarantee better calibration, that calibration performance is found to be metric-dependent, and that self-consistency methods excel in factoid datasets. We also find that calibration can be enhanced through techniques such as fine-tuning, integrating relevant source documents, scaling the temperature, and combining self-consistency with self-evaluation. Lastly, we showcase a practical application of our system: selecting and cascading open-source models and ChatGPT to optimize correctness given a limited API budget. This research not only challenges existing notions of LLM calibration but also offers practical methodologies for improving trustworthiness in long-form generation.


title: Evaluating the impact of items and cooperation in inventory models with exemptable ordering costs

abstract: In this paper we introduce and analyse, from a game theoretical perspective, several multi-agent or multi-item continuous review inventory models in which the buyers are exempted from ordering costs if the price of their orders is greater than or equal to a certain amount. For all models we obtain the optimal ordering policy. We first analyse a simple model with one firm and one item. Then, we study a model with one firm and several items, for which we design a procedure based on cooperative game theory to evaluate the impact of each item on the total cost. Then, we deal with a model with several firms and one item for each firm, for which we characterise a rule to allocate the total cost among the firms in a coalitionally stable way. Finally, we discuss a model with several firms and several items, for which we characterise a rule to allocate the total cost among the firms in a coalitionally stable way and to evaluate the impact of each item on the cost that would be payable to each firm when using the allocation rule. All the concepts and results of this article are illustrated using data from a case study.


title: Flip graphs of coloured triangulations of convex polygons

abstract: A triangulation of a polygon is a subdivision of it into triangles, using diagonals between its vertices. Two different triangulations of a polygon can be related by a sequence of flips: a flip replaces a diagonal by the unique other diagonal in the quadrilateral it defines. In this paper, we study coloured triangulations and coloured flips. In this more general situation, it is no longer true that any two triangulations can be linked by a sequence of (coloured) flips. In this paper, we study the connected components of the coloured flip graphs of triangulations. The motivation for this is a result of Gravier and Payan proving that the Four-Colour Theorem is equivalent to the connectedness of the flip graph of 2-coloured triangulations.


title: Axion Star Explosions and the Reionization History of the Universe

abstract: Cosmological structure formation simulations of ultralight axion-like dark matter have shown that an axion star forms at the center of every dark matter halo in the Universe. These axion stars would then form in large numbers during the dark ages, $z \lesssim 70$. Axion stars would represent the densest axion environments in the Universe, and as such they can trigger collective processes that cannot otherwise occur for axions in vacuum. In particular, even though the lifetime of individual sub-eV axions decaying into a pair of photons is much larger than the age of the Universe, axion stars can decay into photons on very short time scales due to parametric resonance. In this talk, based on arXiv:2302.10206 and arXiv:2301.09769, I will discuss the cosmological implications of such decays. We show that massive enough axion stars will decay into a large number of radio photons which will in turn lead to heating and ionization during the dark ages which is strongly constrained by Planck. As a result, we find that couplings $10^{-14}\,{\rm GeV}^{-1} \lesssim g_{a\gamma\gamma} \lesssim 10^{-10}\,{\rm GeV}^{-1}$ are excluded by Planck for $10^{-14}\,{\rm eV}\lesssim m_a\lesssim 10^{-8}\,{\rm eV}$ within our benchmark model of axion star abundance. We also highlight that future measurements of the 21 cm line can have sensitivity to couplings at least one order of magnitude smaller.


title: Coexistence of asynchronous and clustered dynamics in noisy inhibitory neural networks

abstract: A regime of coexistence of asynchronous and clustered dynamics is analyzed for globally coupled homogeneous and heterogeneous inhibitory networks of quadratic integrate-and-fire (QIF) neurons subject to Gaussian noise. The analysis is based on accurate extensive simulations and complemented by a mean-field description in terms of low-dimensional next generation neural mass models for heterogeneously distributed synaptic couplings. The asynchronous regime is observable at low noise and becomes unstable via a sub-critical Hopf bifurcation at sufficiently large noise. This gives rise to a coexistence region between the asynchronous and the clustered regime. The clustered phase is characterized by population bursts in the {\gamma}-range (30-120 Hz), where neurons are split in two equally populated clusters firing in alternation. This clustering behaviour is quite peculiar: despite the global activity being essentially periodic, single neurons display switching between the two clusters due to heterogeneity and/or noise.


title: Bryndza at ClimateActivism 2024: Stance, Target and Hate Event Detection via Retrieval-Augmented GPT-4 and LLaMA

abstract: This study details our approach for the CASE 2024 Shared Task on Climate Activism Stance and Hate Event Detection, focusing on Hate Speech Detection, Hate Speech Target Identification, and Stance Detection as classification challenges. We explored the capability of Large Language Models (LLMs), particularly GPT-4, in zero- or few-shot settings enhanced by retrieval augmentation and re-ranking for Tweet classification. Our goal was to determine if LLMs could match or surpass traditional methods in this context. We conducted an ablation study with LLaMA for comparison, and our results indicate that our models significantly outperformed the baselines, securing second place in the Target Detection task. The code for our submission is available at https://github.com/NaiveNeuron/bryndza-case-2024


title: Self-Supervised Learning for Improved Calibrationless Radial MRI with NLINV-Net

abstract: Purpose: To develop a neural network architecture for improved calibrationless reconstruction of radial data when no ground truth is available for training. Methods: NLINV-Net is a model-based neural network architecture that directly estimates images and coil sensitivities from (radial) k-space data via non-linear inversion (NLINV). Combined with a training strategy using self-supervision via data undersampling (SSDU), it can be used for imaging problems where no ground truth reconstructions are available. We validated the method for (1) real-time cardiac imaging and (2) single-shot subspace-based quantitative T1 mapping. Furthermore, region-optimized virtual (ROVir) coils were used to suppress artifacts stemming from outside the FoV and to focus the k-space based SSDU loss on the region of interest. NLINV-Net based reconstructions were compared with conventional NLINV and PI-CS (parallel imaging + compressed sensing) reconstruction and the effect of the region-optimized virtual coils and the type of training loss was evaluated qualitatively. Results: NLINV-Net based reconstructions contain significantly less noise than the NLINV-based counterpart. ROVir coils effectively suppress streakings which are not suppressed by the neural networks while the ROVir-based focussed loss leads to visually sharper time series for the movement of the myocardial wall in cardiac real-time imaging. For quantitative imaging, T1-maps reconstructed using NLINV-Net show similar quality as PI-CS reconstructions, but NLINV-Net does not require slice-specific tuning of the regularization parameter. Conclusion: NLINV-Net is a versatile tool for calibrationless imaging which can be used in challenging imaging scenarios where a ground truth is not available.


title: The existence of arbitrary large number of non-$\mathbb R$-covered Anosov flows on hyperbolic $3$-manifolds

abstract: The purpose of this paper is to prove that, for every $n\in \mathbb N$, there exists a closed hyperbolic $3$-manifold $M$ which carries at least $n$ non-$\mathbb R$-covered Anosov flows, that are pariwise non-orbitally equivalent. Due to a recent result by Fenley, such Anosov flows are quasi-geodesic. Hence, we get the existence of hyperbolic $3$-manifolds carrying many pairwise non-orbitally equivalent quasi-geodesic Anosov flows. In order to prove that the flows we construct are not orbitally equivalent, we prove that some patterns of the bi-foliation of the orbit space are not destroyed by Dehn-Fried surgeries, and yield to new dynamical invariants. We believe that those dynamical invariants could be used in a much wider context.


title: Deceptive Path Planning via Reinforcement Learning with Graph Neural Networks

abstract: Deceptive path planning (DPP) is the problem of designing a path that hides its true goal from an outside observer. Existing methods for DPP rely on unrealistic assumptions, such as global state observability and perfect model knowledge, and are typically problem-specific, meaning that even minor changes to a previously solved problem can force expensive computation of an entirely new solution. Given these drawbacks, such methods do not generalize to unseen problem instances, lack scalability to realistic problem sizes, and preclude both on-the-fly tunability of deception levels and real-time adaptivity to changing environments. In this paper, we propose a reinforcement learning (RL)-based scheme for training policies to perform DPP over arbitrary weighted graphs that overcomes these issues. The core of our approach is the introduction of a local perception model for the agent, a new state space representation distilling the key components of the DPP problem, the use of graph neural network-based policies to facilitate generalization and scaling, and the introduction of new deception bonuses that translate the deception objectives of classical methods to the RL setting. Through extensive experimentation we show that, without additional fine-tuning, at test time the resulting policies successfully generalize, scale, enjoy tunable levels of deception, and adapt in real-time to changes in the environment.


title: On the influence of annealing on the compositional and crystallographic properties of sputtered Li-Al-O thin films

abstract: A Li-Al-O thin film materials library, deposited by inert magnetron sputtering and post-deposition annealing in O2 atmosphere, was used to study the effects of different annealing temperatures (300 to 850{\deg}C) and durations (1 min to 7 h) on crystallinity and composition of the films. XPS depth profiling revealed inhomogeneous compositional depth profiles with Li contents increased toward the film surface and Al contents toward the film-substrate interface. These depth profiles were confirmed by a combination of RBS and D-NRA. At annealing temperatures of 550{\deg}C and higher, Li reacted with the Si substrate. At the same time, temperatures of 550{\deg}C and higher enabled the formation of crystalline LiAlO2, whereas at lower temperatures, no crystalline Li-Al-O phases were detected with XRD. In contrast to conventional annealing in a tube furnace (3 to 7 h durations), rapid thermal annealing with fast heating/cooling rates of 10{\deg}C/min and durations of 1 to 10 min resulted in homogeneous depth profiles, while also leading to crystalline LiAlO2.


title: The Oberbeck--Boussinesq approximation and Rayleigh--Benard convection revisited

abstract: We consider the Oberbeck--Boussinesq approximation driven by an inhomogeneous temperature distribution on the boundary of a bounded fluid domain. The relevant boundary conditions are perturbed by a non--local term arising in the incompressible limit of the Navier--Stokes--Fourier system. The long time behaviour of the resulting initial/boundary value problem is investigated.


title: Cosmology and the classical limit of the S-matrix

abstract: We investigate the relationships between classical observables in cosmology and the classical limit of quantum scattering amplitudes. We first look at the relation between Bogoliubov transformations and the notion of classical limit. Then, we compute the cosmological redshift for a particle in a cosmological background and the emitted gravitational waveform from a quantum field theory basis and its classical limit. We observe that there is no interpretation for the geodesic redshift purely in terms of on-shell amplitudes in flat space, given that the classical limit of a scalar 2-point vanishes when considering an FRW background with two asymptotically flat in and out regions. We resolve this apparent conundrum and recover the correct observable by showing that the action of Hermitian operators differ between the in and out regions, unlike standard approaches in flat spacetime. We then show that radiation reaction corrections to the redshift enter already at order $G$. Furthermore, we demonstrate that the emitted waveform can be represented solely in terms of an on-shell 3-point amplitude in flat space without energy conservation, providing a closed formula for the waveform in an impulsive FRW.


title: Parameter estimation for quantum jump unraveling

abstract: We consider the estimation of parameters encoded in the measurement record of a continuously monitored quantum system in the jump unraveling. This unraveling picture corresponds to a single-shot scenario, where information is continuously gathered. Here, it is generally difficult to assess the precision of the estimation procedure via the Fisher Information due to intricate temporal correlations and memory effects. In this paper we provide a full set of solutions to this problem. First, for multi-channel renewal processes we relate the Fisher Information to an underlying Markov chain and derive a easily computable expression for it. For non-renewal processes, we introduce a new algorithm that combines two methods: the monitoring operator method for metrology and the Gillespie algorithm which allows for efficient sampling of a stochastic form of the Fisher Information along individual quantum trajectories. We show that this stochastic Fisher Information satisfies useful properties related to estimation in the single-shot scenario. Finally, we consider the case where some information is lost in data compression/post-selection, and provide tools for computing the Fisher Information in this case. All scenarios are illustrated with instructive examples from quantum optics and condensed matter.


title: The Quantified Boolean Bayesian Network: Theory and Experiments with a Logical Graphical Model

abstract: This paper introduces the Quantified Boolean Bayesian Network (QBBN), which provides a unified view of logical and probabilistic reasoning. The QBBN is meant to address a central problem with the Large Language Model (LLM), which has become extremely popular in Information Retrieval, which is that the LLM hallucinates. A Bayesian Network, by construction, cannot hallucinate, because it can only return answers that it can explain. We show how a Bayesian Network over an unbounded number of boolean variables can be configured to represent the logical reasoning underlying human language. We do this by creating a key-value version of the First-Order Calculus, for which we can prove consistency and completeness. We show that the model is trivially trained over fully observed data, but that inference is non-trivial. Exact inference in a Bayesian Network is intractable (i.e. $\Omega(2^N)$ for $N$ variables). For inference, we investigate the use of Loopy Belief Propagation (LBP), which is not guaranteed to converge, but which has been shown to often converge in practice. Our experiments show that LBP indeed does converge very reliably, and our analysis shows that a round of LBP takes time $O(N2^n)$, where $N$ bounds the number of variables considered, and $n$ bounds the number of incoming connections to any factor, and further improvements may be possible. Our network is specifically designed to alternate between AND and OR gates in a Boolean Algebra, which connects more closely to logical reasoning, allowing a completeness proof for an expanded version of our network, and also allows inference to follow specific but adequate pathways, that turn out to be fast.


title: The Asymptotic Structure of Cosmological Integrals

abstract: We provide a general analysis of the asymptotic behaviour of perturbative contributions to observables in arbitrary power-law FRW cosmologies, indistinctly the Bunch-Davies wavefunction and cosmological correlators. We consider a large class of scalar toy models, including conformally-coupled and massless scalars in arbitrary dimensions, that admits a first principle definition in terms of (generalised/weighted) cosmological polytopes. The perturbative contributions to an observable can be expressed as an integral of the canonical function associated to such polytopes and to weighted graphs. We show how the asymptotic behaviour of these integrals is governed by a special class of nestohedra living in the graph-weight space, both at tree and loop level. As the singularities of a cosmological process described by a graph can be associated to its subgraphs, we provide a realisation of the nestohedra as a sequential truncation of a top-dimensional simplex based on the underlying graph. This allows us to determine all the possible directions -- both in the infrared and in the ultraviolet --, where the integral can diverge as well as their divergence degree. Both of them are associated to the facets of the nestohedra, which are identified by overlapping tubings of the graph: the specific tubing determines the divergent directions while the number of overlapping tubings its degree of divergence. This combinatorial formulation makes straightforward the application of sector decomposition for extracting both leading and subleading divergences from the integral, as the sectors in which the integration domain can be tiled are identified by the collection of compatible facets of the nestohedra, with the latter that can be determined via the graph tubings. Finally, the leading divergence can be interpreted as a restriction of the canonical function of the relevant polytope onto a special hyperplane.


title: Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following

abstract: Diffusion models excel at modeling complex and multimodal trajectory distributions for decision-making and control. Reward-gradient guided denoising has been recently proposed to generate trajectories that maximize both a differentiable reward function and the likelihood under the data distribution captured by a diffusion model. Reward-gradient guided denoising requires a differentiable reward function fitted to both clean and noised samples, limiting its applicability as a general trajectory optimizer. In this paper, we propose DiffusionES, a method that combines gradient-free optimization with trajectory denoising to optimize black-box non-differentiable objectives while staying in the data manifold. Diffusion-ES samples trajectories during evolutionary search from a diffusion model and scores them using a black-box reward function. It mutates high-scoring trajectories using a truncated diffusion process that applies a small number of noising and denoising steps, allowing for much more efficient exploration of the solution space. We show that DiffusionES achieves state-of-the-art performance on nuPlan, an established closed-loop planning benchmark for autonomous driving. Diffusion-ES outperforms existing sampling-based planners, reactive deterministic or diffusion-based policies, and reward-gradient guidance. Additionally, we show that unlike prior guidance methods, our method can optimize non-differentiable language-shaped reward functions generated by few-shot LLM prompting. When guided by a human teacher that issues instructions to follow, our method can generate novel, highly complex behaviors, such as aggressive lane weaving, which are not present in the training data. This allows us to solve the hardest nuPlan scenarios which are beyond the capabilities of existing trajectory optimization methods and driving policies.


title: Video Annotator: A framework for efficiently building video classifiers using vision-language models and active learning

abstract: High-quality and consistent annotations are fundamental to the successful development of robust machine learning models. Traditional data annotation methods are resource-intensive and inefficient, often leading to a reliance on third-party annotators who are not the domain experts. Hard samples, which are usually the most informative for model training, tend to be difficult to label accurately and consistently without business context. These can arise unpredictably during the annotation process, requiring a variable number of iterations and rounds of feedback, leading to unforeseen expenses and time commitments to guarantee quality. We posit that more direct involvement of domain experts, using a human-in-the-loop system, can resolve many of these practical challenges. We propose a novel framework we call Video Annotator (VA) for annotating, managing, and iterating on video classification datasets. Our approach offers a new paradigm for an end-user-centered model development process, enhancing the efficiency, usability, and effectiveness of video classifiers. Uniquely, VA allows for a continuous annotation process, seamlessly integrating data collection and model training. We leverage the zero-shot capabilities of vision-language foundation models combined with active learning techniques, and demonstrate that VA enables the efficient creation of high-quality models. VA achieves a median 6.8 point improvement in Average Precision relative to the most competitive baseline across a wide-ranging assortment of tasks. We release a dataset with 153k labels across 56 video understanding tasks annotated by three professional video editors using VA, and also release code to replicate our experiments at: http://github.com/netflix/videoannotator.


title: Mitigating topological freezing using out-of-equilibrium simulations

abstract: Motivated by the recently-established connection between Jarzynski's equality and the theoretical framework of Stochastic Normalizing Flows, we investigate a protocol relying on out-of-equilibrium lattice Monte Carlo simulations to mitigate the infamous computational problem of topological freezing. We test our proposal on $2d$ $\mathrm{CP}^{N-1}$ models and compare our results with those obtained adopting the Parallel Tempering on Boundary Conditions proposed by M. Hasenbusch, obtaining comparable performances. Our work thus sets the stage for future applications combining our Monte Carlo setup with machine learning techniques.


title: Safe Guaranteed Exploration for Non-linear Systems

abstract: Safely exploring environments with a-priori unknown constraints is a fundamental challenge that restricts the autonomy of robots. While safety is paramount, guarantees on sufficient exploration are also crucial for ensuring autonomous task completion. To address these challenges, we propose a novel safe guaranteed exploration framework using optimal control, which achieves first-of-its-kind results: guaranteed exploration for non-linear systems with finite time sample complexity bounds, while being provably safe with arbitrarily high probability. The framework is general and applicable to many real-world scenarios with complex non-linear dynamics and unknown domains. Based on this framework we propose an efficient algorithm, SageMPC, SAfe Guaranteed Exploration using Model Predictive Control. SageMPC improves efficiency by incorporating three techniques: i) exploiting a Lipschitz bound, ii) goal-directed exploration, and iii) receding horizon style re-planning, all while maintaining the desired sample complexity, safety and exploration guarantees of the framework. Lastly, we demonstrate safe efficient exploration in challenging unknown environments using SageMPC with a car model.


title: What is Hiding in Medicine's Dark Matter? Learning with Missing Data in Medical Practices

abstract: Electronic patient records (EPRs) produce a wealth of data but contain significant missing information. Understanding and handling this missing data is an important part of clinical data analysis and if left unaddressed could result in bias in analysis and distortion in critical conclusions. Missing data may be linked to health care professional practice patterns and imputation of missing data can increase the validity of clinical decisions. This study focuses on statistical approaches for understanding and interpreting the missing data and machine learning based clinical data imputation using a single centre's paediatric emergency data and the data from UK's largest clinical audit for traumatic injury database (TARN). In the study of 56,961 data points related to initial vital signs and observations taken on children presenting to an Emergency Department, we have shown that missing data are likely to be non-random and how these are linked to health care professional practice patterns. We have then examined 79 TARN fields with missing values for 5,791 trauma cases. Singular Value Decomposition (SVD) and k-Nearest Neighbour (kNN) based missing data imputation methods are used and imputation results against the original dataset are compared and statistically tested. We have concluded that the 1NN imputer is the best imputation which indicates a usual pattern of clinical decision making: find the most similar patients and take their attributes as imputation.


title: A Review on the Analysis and Optimal Control of Chemotaxis-Consumption Models

abstract: In the present review we focus on the chemotaxis-consumption model $\partial_t u - \Delta u = - \nabla \cdot (u \nabla v)$ and $\partial_t v - \Delta v = - u^s v$ in $(0,T) \times \Omega$, for any fixed $s \geq 1$, endowed with isolated boundary conditions and nonnegative initial conditions, where $(u,v)$ model cell density and chemical signal concentration. Our objective is to present an overview of the related literature and latest results on the aforementioned model concerning the following three distinct research lines we have obtained in [12,24-26]: the mathematical analysis, the numerical analysis and the related optimal control theory with a bilinear control acting on the chemical equation.


title: PocketWATCH: Design and operation of a multi-use test bed for water Cherenkov detector components in pure and gadolinium loaded water

abstract: The PocketWATCH facility is a unique multi-purpose test bed designed to replicate the conditions of large water Cherenkov detectors. Housed at the University of Sheffield, the facility consists of a light-tight 2000L ultrapure water tank with purification and temperature control systems. Water temperature, resistivity, and UV attenuation in the tank are monitored and shown to be stable over time. The system is also shown to be compatible with a solution of 0.2% gadolinium sulfate, allowing further utility in testing equipment bound for the next generation neutrino and nucleon decay water Cherenkov particle detectors. The relevant water quality parameters are shown to be stable whilst running in Gd-mode, thereby providing a suitable test bed for hardware development in a realistic, ex situ environment.


title: About the Cohen-Macaulay defect and almost Cohen-Macaulay rings

abstract: We notice the connection between almost Cohen-Macaulay rings and the Cohen-Macaulay defect. We introduce a Serre-type condition for modules, that is connected to the Cohen-Macaulay defect in the same way that the condition $(S_n)$ is connected to Cohen-Macaulay modules.


title: On primitive integer solutions of the Diophantine equation $x^3\pm y^3=a^k\pm b^k$

abstract: In this note we consider the title Diophantine equation from both theoretical as well as experimental point of view. In particular, we prove that for $k=4, 6$ and each choice of the signs our equation has infinitely many co-prime positive integer solutions. For $k=5, 7$ and all choices of the signs we computed all co-prime positive integer solutions $(x, y, a, b)$ satisfying the condition $\op{max}\{a, b\}\leq 50000$.


title: Constrained multi-objective optimization for multi-UAV planning

abstract: Over the last decade, developments in unmanned aerial vehicles (UAVs) has greatly increased, and they are being used in many fields including surveillance, crisis management or automated mission planning. This last field implies the search of plans for missions with multiple tasks, UAVs and ground control stations; and the optimization of several objectives, including makespan, fuel consumption or cost, among others. In this work, this problem has been solved using a multi-objective evolutionary algorithm combined with a constraint satisfaction problem model, which is used in the fitness function of the algorithm. The algorithm has been tested on several missions of increasing complexity, and the computational complexity of the different element considered in the missions has been studied.


title: Time resolved spectroscopy of a GRS 1915+105 flare during its unusual low state using AstroSat

abstract: Since its discovery in 1992, GRS 1915+105 has been among the brightest sources in the X-ray sky. However, in early 2018, it dimmed significantly and has stayed in this faint state ever since. We report on AstroSat and NuSTAR observation of GRS 1915+105 in its unusual low/hard state during 2019 May. We performed time-resolved spectroscopy of the X-ray flares observed in this state and found that the spectra can be fitted well using highly ionised absorption models. We further show that the spectra can also be fitted using a highly relativistic reflection dominated model, where for the lamp post geometry, the X-ray emitting source is always very close to the central black hole. For both interpretations, the flare can be attributed to a change in the intrinsic flux, rather than dramatic variation in the absorption or geometry. These reflection dominated spectra are very similar to the reflection dominated spectra reported for Active Galactic Nuclei in their low flux states.


title: Distilling Morphology-Conditioned Hypernetworks for Efficient Universal Morphology Control

abstract: Learning a universal policy across different robot morphologies can significantly improve learning efficiency and enable zero-shot generalization to unseen morphologies. However, learning a highly performant universal policy requires sophisticated architectures like transformers (TF) that have larger memory and computational cost than simpler multi-layer perceptrons (MLP). To achieve both good performance like TF and high efficiency like MLP at inference time, we propose HyperDistill, which consists of: (1) A morphology-conditioned hypernetwork (HN) that generates robot-wise MLP policies, and (2) A policy distillation approach that is essential for successful training. We show that on UNIMAL, a benchmark with hundreds of diverse morphologies, HyperDistill performs as well as a universal TF teacher policy on both training and unseen test robots, but reduces model size by 6-14 times, and computational cost by 67-160 times in different environments. Our analysis attributes the efficiency advantage of HyperDistill at inference time to knowledge decoupling, i.e., the ability to decouple inter-task and intra-task knowledge, a general principle that could also be applied to improve inference efficiency in other domains.


title: Weighted cumulative residual Entropy Generating Function and its properties

abstract: The study on the generating function approach to entropy become popular as it generates several well-known entropy measures discussed in the literature. In this work, we define the weighted cumulative residual entropy generating function (WCREGF) and study its properties. We then introduce the dynamic weighted cumulative residual entropy generating function (DWCREGF). It is shown that the DWCREGF determines the distribution uniquely. We study some characterization results using the relationship between the DWCREGF and the hazard rate and/or the mean residual life function. Using a characterization based on DWCREGF, we develop a new goodness fit test for Rayleigh distribution. A Monte Carlo simulation study is conducted to evaluate the proposed test. Finally, the test is illustrated using two real data sets.


title: Formal Siegel modular forms for arithmetic subgroups

abstract: The notion of formal Siegel modular forms for an arithmetic subgroup $\Gamma$ of the symplectic group of genus $n$ is a generalization of symmetric formal Fourier-Jacobi series. Assuming an upper bound on the affine covering number of the Siegel modular variety associated with $\Gamma$, we prove that all formal Siegel modular forms are given by Fourier-Jacobi expansions of classical holomorphic Siegel modular forms. We also show that the required upper bound is always met if $2\leq n \leq 4$. As an application we consider the case of the paramodular group of squarefree level and genus $2$.


title: Exploring quantum criticality in a 4D quantum disordered system

abstract: Phase transitions are prevalent throughout physics, spanning thermal phenomena like water boiling to magnetic transitions in solids. They encompass cosmological phase transitions in the early universe and the transition into a quark-gluon plasma in high-energy collisions. Quantum phase transitions, particularly intriguing, occur at temperatures near absolute zero and are driven by quantum fluctuations rather than thermal ones. The strength of the fluctuations is very sensitive to the dimensionality of the physical systems, which determines the existence and nature of phase transitions. Low-dimensional systems often exhibit suppression of phase transitions, while high-dimensional systems tend to exhibit mean-field-like behavior. The localization-delocalization Anderson transition stands out among quantum phase transitions, as it is thought to retain its non-mean-field character across all dimensions. This work marks the first observation and characterization of the Anderson transition in four dimensions using ultracold atoms as a quantum simulator with synthetic dimensions. We characterize the universal dynamics in the vicinity of the phase transition. We measure the critical exponents describing the scale-invariant properties of the critical dynamics, which are shown to obey Wegner's scaling law. Our work is the first experimental demonstration that the Anderson transition is not mean-field in dimension four.


title: Prediction of air pollutants PM10 by ARBX(1) processes

abstract: This work adopts a Banach-valued time series framework for component-wise estimation and prediction, from temporal correlated functional data, in presence of exogenous variables. The strong-consistency of the proposed functional estimator and associated plug-in predictor is formulated. The simulation study undertaken illustrates their large-sample size properties. Air pollutants PM10 curve forecasting, in the Haute-Normandie region (France), is addressed by implementation of the functional time series approach presented


title: Modeling Microstrip Antenna

abstract: In this work, a rectangular microstrip antenna with inset is designed, simulated and optimized. In the optimization process the patch is deformed, it new antenna present a amorphous patch. The optimization process was conducted with Genetic Algorithm (GA), S11 parameters was obtained with full wave Finite-Differences Time-Domain (FDTD-3D), and the initial configuration (design) was obtained with line transmission and cavite method.


title: Value-based Resource Matching with Fairness Criteria: Application to Agricultural Water Trading

abstract: Optimal allocation of agricultural water in the event of droughts is an important global problem. In addressing this problem, many aspects, including the welfare of farmers, the economy, and the environment, must be considered. Under this backdrop, our work focuses on several resource-matching problems accounting for agents with multi-crop portfolios, geographic constraints, and fairness. First, we address a matching problem where the goal is to maximize a welfare function in two-sided markets where buyers' requirements and sellers' supplies are represented by value functions that assign prices (or costs) to specified volumes of water. For the setting where the value functions satisfy certain monotonicity properties, we present an efficient algorithm that maximizes a social welfare function. When there are minimum water requirement constraints, we present a randomized algorithm which ensures that the constraints are satisfied in expectation. For a single seller--multiple buyers setting with fairness constraints, we design an efficient algorithm that maximizes the minimum level of satisfaction of any buyer. We also present computational complexity results that highlight the limits on the generalizability of our results. We evaluate the algorithms developed in our work with experiments on both real-world and synthetic data sets with respect to drought severity, value functions, and seniority of agents.


title: Determinant and Derivative-Free Quantum Monte Carlo Within the Stochastic Representation of Wavefunctions

abstract: Describing the ground states of continuous, real-space quantum many-body systems, like atoms and molecules, is a significant computational challenge with applications throughout the physical sciences. Recent progress was made by variational methods based on machine learning (ML) ansatzes. However, since these approaches are based on energy minimization, ansatzes must be twice differentiable. This (a) precludes the use of many powerful classes of ML models; and (b) makes the enforcement of bosonic, fermionic, and other symmetries costly. Furthermore, (c) the optimization procedure is often unstable unless it is done by imaginary time propagation, which is often impractically expensive in modern ML models with many parameters. The stochastic representation of wavefunctions (SRW), introduced in Nat Commun 14, 3601 (2023), is a recent approach to overcoming (c). SRW enables imaginary time propagation at scale, and makes some headway towards the solution of problem (b), but remains limited by problem (a). Here, we argue that combining SRW with path integral techniques leads to a new formulation that overcomes all three problems simultaneously. As a demonstration, we apply the approach to generalized ``Hooke's atoms'': interacting particles in harmonic wells. We benchmark our results against state-of-the-art data where possible, and use it to investigate the crossover between the Fermi liquid and the Wigner molecule within closed-shell systems. Our results shed new light on the competition between interaction-driven symmetry breaking and kinetic-energy-driven delocalization.


title: On the Universality of Coupling-based Normalizing Flows

abstract: We present a novel theoretical framework for understanding the expressive power of normalizing flows. Despite their prevalence in scientific applications, a comprehensive understanding of flows remains elusive due to their restricted architectures. Existing theorems fall short as they require the use of arbitrarily ill-conditioned neural networks, limiting practical applicability. We propose a distributional universality theorem for well-conditioned coupling-based normalizing flows such as RealNVP. In addition, we show that volume-preserving normalizing flows are not universal, what distribution they learn instead, and how to fix their expressivity. Our results support the general wisdom that affine and related couplings are expressive and in general outperform volume-preserving flows, bridging a gap between empirical results and theoretical understanding.


title: Some remarks about deformation theory and formality conjecture

abstract: Using the algebraic criterion proved by Bandiera, Manetti and Meazzini, we show the formality conjecture for universally gluable objects with linearly reductive automorphism groups in the bounded derived category of a K3 surface. As an application, we prove the formality conjecture for polystable objects in the Kuznetsov components of Gushel--Mukai threefolds and quartic double solids.


title: SAE: Single Architecture Ensemble Neural Networks

abstract: Ensembles of separate neural networks (NNs) have shown superior accuracy and confidence calibration over single NN across tasks. Recent methods compress ensembles within a single network via early exits or multi-input multi-output frameworks. However, the landscape of these methods is fragmented thus far, making it difficult to choose the right approach for a given task. Furthermore, the algorithmic performance of these methods is behind the ensemble of separate NNs and requires extensive architecture tuning. We propose a novel methodology unifying these approaches into a Single Architecture Ensemble (SAE). Our method learns the optimal number and depth of exits per ensemble input in a single NN. This enables the SAE framework to flexibly tailor its configuration for a given architecture or application. We evaluate SAEs on image classification and regression across various network architecture types and sizes. We demonstrate competitive accuracy or confidence calibration to baselines while reducing the compute operations or parameter count by up to $1.5{\sim}3.7\times$.


title: More than the Sum of Its Parts: Ensembling Backbone Networks for Few-Shot Segmentation

abstract: Semantic segmentation is a key prerequisite to robust image understanding for applications in \acrlong{ai} and Robotics. \acrlong{fss}, in particular, concerns the extension and optimization of traditional segmentation methods in challenging conditions where limited training examples are available. A predominant approach in \acrlong{fss} is to rely on a single backbone for visual feature extraction. Choosing which backbone to leverage is a deciding factor contributing to the overall performance. In this work, we interrogate on whether fusing features from different backbones can improve the ability of \acrlong{fss} models to capture richer visual features. To tackle this question, we propose and compare two ensembling techniques-Independent Voting and Feature Fusion. Among the available \acrlong{fss} methods, we implement the proposed ensembling techniques on PANet. The module dedicated to predicting segmentation masks from the backbone embeddings in PANet avoids trainable parameters, creating a controlled `in vitro' setting for isolating the impact of different ensembling strategies. Leveraging the complementary strengths of different backbones, our approach outperforms the original single-backbone PANet across standard benchmarks even in challenging one-shot learning scenarios. Specifically, it achieved a performance improvement of +7.37\% on PASCAL-5\textsuperscript{i} and of +10.68\% on COCO-20\textsuperscript{i} in the top-performing scenario where three backbones are combined. These results, together with the qualitative inspection of the predicted subject masks, suggest that relying on multiple backbones in PANet leads to a more comprehensive feature representation, thus expediting the successful application of \acrlong{fss} methods in challenging, data-scarce environments.


title: Fundamental limits of metrology at thermal equilibrium

abstract: We consider the estimation of an unknown parameter $\theta$ through a quantum probe at thermal equilibrium. The probe is assumed to be in a Gibbs state according to its Hamiltonian $H_\theta$, which is divided in a parameter-encoding term $H^P_\theta$ and an additional, parameter-independent, control $H^C$. Given a fixed encoding, we find the maximal Quantum Fisher Information attainable via arbitrary $H^C$, which provides a fundamental bound on the measurement precision. Our bounds show that: (i) assuming full control of $H^C$, quantum non-commutativity does not offer any fundamental advantage in the estimation of $\theta$; (ii) an exponential quantum advantage arises at low temperatures if $H^C$ is constrained to have a spectral gap; (iii) in the case of locally-encoded parameters, the optimal sensitivity presents a Heisenberg-like $N^2$-scaling in terms of the number of particles of the probe, which can be reached with local measurements. We apply our results to paradigmatic spin chain models, showing that these fundamental limits can be approached using local two-body interactions. Our results set the fundamental limits and optimal control for metrology with thermal and ground state probes, including probes at the verge of criticality.


title: Crossover From Individual to Collective Magnetism in Dense Nanoparticle Systems: Local Anisotropy Versus Dipolar Interactions

abstract: Dense systems of magnetic nanoparticles may exhibit dipolar collective behavior. However, two fundamental questions remain unsolved: i) whether the transition temperature may be affected by the particle anisotropy or it is essentially determined by the intensity of the interparticle dipolar interactions, and ii) what is the minimum ratio of dipole-dipole interaction ($E_\text{dd}$) to nanoparticle anisotropy ($K_{\text{ef}}V$, anisotropy $\times$ volume) energies necessary to crossover from individual to collective behavior. A series of particle assemblies with similarly intense dipolar interactions but widely varying anisotropy is studied. The $K_\text{ef}$ is tuned through different degrees of cobalt-doping in maghemite nanoparticles, resulting in a variation of nearly an order of magnitude. All the bare particle compacts display collective behavior, except the one made with the highest anisotropy particles, which presents ``marginal'' features. Thus, a threshold of $K_{\text{ef}} V/E_{\text{dd}} \approx 130$ to suppress collective behavior is derived, in good agreement with Monte Carlo simulations. This translates into a crossover value of $\approx 1.7$ for the easily accessible parameter $T_\text{MAX}$(interacting)$/T_\text{MAX}$(non-interacting) (ratio of the peak temperatures of the zero-field-cooled magnetization curves of interacting and dilute particle systems), which is successfully tested against the literature to predict the individual-like$/$collective behavior of any given interacting particle assembly comprising relatively uniform particles.


title: G-SciEdBERT: A Contextualized LLM for Science Assessment Tasks in German

abstract: The advancement of natural language processing has paved the way for automated scoring systems in various languages, such as German (e.g., German BERT [G-BERT]). Automatically scoring written responses to science questions in German is a complex task and challenging for standard G-BERT as they lack contextual knowledge in the science domain and may be unaligned with student writing styles. This paper developed a contextualized German Science Education BERT (G-SciEdBERT), an innovative large language model tailored for scoring German-written responses to science tasks. Using G-BERT, we pre-trained G-SciEdBERT on a corpus of 50K German written science responses with 5M tokens to the Programme for International Student Assessment (PISA) 2015. We fine-tuned G-SciEdBERT on 59 assessment items and examined the scoring accuracy. We then compared its performance with G-BERT. Our findings reveal a substantial improvement in scoring accuracy with G-SciEdBERT, demonstrating a 10% increase of quadratic weighted kappa compared to G-BERT (mean accuracy difference = 0.096, SD = 0.024). These insights underline the significance of specialized language models like G-SciEdBERT, which is trained to enhance the accuracy of automated scoring, offering a substantial contribution to the field of AI in education.


title: Irreversible Monte Carlo algorithms for hard disk glasses: from event-chain to collective swaps

abstract: Equilibrium sampling of the configuration space in disordered systems requires algorithms that bypass the glassy slowing down of the physical dynamics. Irreversible Monte Carlo algorithms breaking detailed balance successfully accelerate sampling in some systems. We first implement an irreversible event-chain Monte Carlo algorithm in a model of polydisperse hard disks. The effect of collective translational moves marginally affects the dynamics and results in a modest speedup that decreases with density. We then propose an irreversible algorithm performing collective particle swaps which outperforms all known Monte Carlo algorithms. We show that these collective swaps can also be used to prepare very dense jammed packings of disks.


title: Analytical model for the relation between signal bandwidth and spatial resolution in Steered-Response Power Phase Transform (SRP-PHAT) maps

abstract: An analysis of the relationship between the bandwidth of acoustic signals and the required resolution of steered-response power phase transform (SRP-PHAT) maps used for sound source localization is presented. This relationship does not rely on the far-field assumption, nor does it depend on any specific array topology. The proposed analysis considers the computation of a SRP map as a process of sampling a set of generalized cross-correlation (GCC) functions, each one corresponding to a different microphone pair. From this approach, we derive a rule that relates GCC bandwidth with inter-microphone distance, resolution of the SRP map, and the potential position of the sound source relative to the array position. This rule is a sufficient condition for an aliasing-free calculation of the specified SRP-PHAT map. Simulation results show that limiting the bandwidth of the GCC according to such rule leads to significant reductions in sound source localization errors when sources are not in the immediate vicinity of the microphone array. These error reductions are more relevant for coarser resolutions of the SRP map, and they happen in both anechoic and reverberant environments.


title: Generating Higher Order Modes from Binary Black Hole mergers with Machine Learning

abstract: We introduce a machine learning model designed to rapidly and accurately predict the time domain gravitational wave emission of non-precessing binary black hole coalescences, incorporating the effects of higher order modes of the multipole expansion of the waveform. Expanding on our prior work, we decompose each mode by amplitude and phase and reduce dimensionality using principal component analysis. An ensemble of artificial neural networks is trained to learn the relationship between orbital parameters and the low-dimensional representation of each mode. Our model is trained with $\sim 10^5$ signals with mass ratio $q \in [1,10]$ and dimensionless spins $\chi_i \in [-0.9, 0.9]$, generated with the state-of-the-art approximant SEOBNRv4HM, and it is able to generate waveforms up to $\sim 4\times 10^5 M$ long. We find that it achieves a median faithfulness of $10^{-4}$ averaged across the parameter space. We show that our model generates a single waveform two orders of magnitude faster than the training model, with the speed up increasing when waveforms are generated in batches. This framework is entirely general and can be applied to any other time domain approximant capable of generating waveforms from aligned spin circular binaries, possibly incorporating higher order modes.


title: Precision Air Flow Control via EHD Actuator: A Co-simulation and Control Design Case Study

abstract: A Dielectric Barrier Discharge (DBD) plasma actuator for controlling airflow is proposed. It consists of diverging and converging nozzles, two concentric cylinders and an actuator mounted in-between the two cylinders. The actuator employs electrohydrodynamic (EHD) body force to induce an air jet within the air gap between the two cylinders, effectively creating a suction area while passing through the diverging nozzle, due to the Coanda effect. While merging with the air stream inside the inner cylinder, the Coanda jet effectively enhances amplification of the airflow. The outflow rate is measured by a velocity sensor at the outlet and controlled by the plasma actuator. The control strategy is based on the Active Disturbance Rejection Control (ADRC) and compared to the baseline PID controller. The actuator was modelled by seamlessly linking two modeling platforms for a co-simulation study. The CFD simulation of the plasma and airflow was carried out in the COMSOL multi-physics commercial software, and the control was implemented in the Simulink. The DBD plasma model was based on the two-species model of discharge, and the electric body force, calculated from the plasma simulation, was used in the Navier-Stokes equation for the turbulent flow simulation. The plasma-air flow system was analyzed using the input (the actuator voltage) and output (the outlet flow rate) data for the control design. Finally, the performance of the system of air flow control device was tested and discussed in the co-simulation process.

categories: physics.flu-dyn cs.SY eess.SY physics.plasm-ph


title: Modular Redesign of Mechatronic Systems: Formulation of Module Specifications Guaranteeing System Dynamics Specifications

abstract: Complex mechatronic systems are typically composed of interconnected modules, often developed by independent teams. This development process challenges the verification of system specifications before all modules are integrated. To address this challenge, a modular redesign framework is proposed in this paper. Herein, first, allowed changes in the dynamics (represented by frequency response functions (FRFs)) of the redesigned system are defined with respect to the original system model, which already satisfies system specifications. Second, these allowed changes in the overall system dynamics (or system redesign specifications) are automatically translated to dynamics (FRF) specifications on module level that, when satisfied, guarantee overall system dynamics (FRF) specifications. This modularity in specification management supports local analysis and verification of module design changes, enabling design teams to work in parallel without the need to iteratively rebuild the system model to check fulfilment of system FRF specifications. A modular redesign process results that shortens time-to-market and decreases redesign costs. The framework's effectiveness is demonstrated through three examples of increasing complexity, highlighting its potential to enable modular mechatronic system (re)design.


title: Predictive representations: building blocks of intelligence

abstract: Adaptive behavior often requires predicting future events. The theory of reinforcement learning prescribes what kinds of predictive representations are useful and how to compute them. This paper integrates these theoretical ideas with work on cognition and neuroscience. We pay special attention to the successor representation (SR) and its generalizations, which have been widely applied both as engineering tools and models of brain function. This convergence suggests that particular kinds of predictive representations may function as versatile building blocks of intelligence.


title: Random DFA With One Added Transition

abstract: Every language recognized by a non-deterministic finite automaton can be recognized by a deterministic automaton, at the cost of a potential increase of the number of states, which in the worst case can go from $n$ states to $2^n$ states. In this article, we investigate this classical result in a probabilistic setting where we take a deterministic automaton with $n$ states uniformly at random and add just one random transition. These automata are almost deterministic in the sense that only one state has a non-deterministic choice when reading an input letter. In our model, each state has a fixed probability to be final. We prove that for any $d\geq 1$, with non-negligible probability the minimal (deterministic) automaton of the language recognized by such an automaton has more than $n^d$ states; as a byproduct, the expected size of its minimal automaton grows faster than any polynomial. Our result also holds when each state is final with some probability that depends on $n$, as long as it is not too close to $0$ and $1$, at distance at least $\Omega(\frac1{\sqrt{n}})$ to be precise, therefore allowing models with a sublinear number of final states in expectation.


title: Self-consistent context aware conformer transducer for speech recognition

abstract: We propose a novel neural network architecture based on conformer transducer that adds contextual information flow to the ASR systems. Our method improves the accuracy of recognizing uncommon words while not harming the word error rate of regular words. We explore the uncommon words accuracy improvement when we use the new model and/or shallow fusion with context language model. We found that combination of both provides cumulative gain in uncommon words recognition accuracy.


title: Linear and Non-Linear Response of Quadratic Lindbladians

abstract: Quadratic Lindbladians encompass a rich class of dissipative electronic and bosonic quantum systems, which have been predicted to host new and exotic physics. In this study, we develop a Lindblad-Keldysh spectroscopic response formalism for open quantum systems that elucidates their steady-state response properties and dissipative phase transitions via finite-frequency linear and non-linear probes. As illustrative examples, we utilize this formalism to calculate the (1) density and dynamic spin susceptibilities of a boundary driven XY model at and near criticality, (2) linear and non-linear optical responses in Bernal bilayer graphene coupled to dissipative leads, and (3) steady state susceptibilities in a bosonic optical lattice. We find that the XY model spin density wavelength diverges with critical exponent 1/2, and there are gapless dispersive modes in the dynamic spin response that originate from the underlying spin density wave order; additionally the dispersing modes of the weak and ultra-strong dissipation limits exhibit a striking correspondence since the boundary dissipators couple only weakly to the bulk in both cases. In the optical response of the Bernal bilayer, we find that the diamagnetic response can decrease with increasing occupation, as opposed to in closed systems where the response increases monotonically with occupation; we study the effect of second harmonic generation and shift current and find that these responses, forbidden in centrosymmetric closed systems, can manifest in these open systems as a result of dissipation. We compare this formalism to its equilibrium counterpart and draw analogies between these non-interacting open systems and strongly interacting closed systems.


title: They were robbed! Scoring by the middlemost to attenuate biased judging in boxing

abstract: Boxing has a long-standing problem with biased judging, impacting both professional and Olympic bouts. "Robberies", where boxers are widely seen as being denied rightful victories, threaten to drive fans and athletes away from the sport. To tackle this problem, we propose a minimalist adjustment in how boxing is scored: the winner would be decided by the majority of round-by-round victories according to the judges, rather than relying on the judges' overall bout scores. This approach, rooted in social choice theory and utilising majority rule and middlemost aggregation functions, creates a coordination problem for partisan judges and attenuates their influence. Our model analysis and simulations demonstrate the potential to significantly decrease the likelihood of a partisan judge swaying the result of a bout.


title: Damping of density oscillations from bulk viscosity in quark matter

abstract: We study the damping of density oscillations in the quark matter phase that might occur in compact stars. To this end we compute the bulk viscosity and the associated damping time in three-flavor quark matter, considering both nonleptonic and semileptonic electroweak processes. We use two different equations of state of quark matter, more precisely, the MIT bag model and perturbative QCD, including the leading-order corrections in the strong coupling constant. We analyze the dependence of our results on the density, temperature and value of strange quark mass in each case. We then find that the maximum of the bulk viscosity is in the range of temperature from 0.01 to 0.1 MeV for frequencies around 1 kHz, while the associated minimal damping times of the density oscillations at those temperatures might be in the range of few to hundreds milliseconds. Our results suggest that bulk viscous damping might be relevant in the postmerger phase after the collision of two neutron stars if deconfined matter is achieved in the process.


title: Understanding the Weakness of Large Language Model Agents within a Complex Android Environment

abstract: Large language models (LLMs) have empowered intelligent agents to execute intricate tasks within domain-specific software such as browsers and games. However, when applied to general-purpose software systems like operating systems, LLM agents face three primary challenges. Firstly, the action space is vast and dynamic, posing difficulties for LLM agents to maintain an up-to-date understanding and deliver accurate responses. Secondly, real-world tasks often require inter-application cooperation}, demanding farsighted planning from LLM agents. Thirdly, agents need to identify optimal solutions aligning with user constraints, such as security concerns and preferences. These challenges motivate AndroidArena, an environment and benchmark designed to evaluate LLM agents on a modern operating system. To address high-cost of manpower, we design a scalable and semi-automated method to construct the benchmark. In the task evaluation, AndroidArena incorporates accurate and adaptive metrics to address the issue of non-unique solutions. Our findings reveal that even state-of-the-art LLM agents struggle in cross-APP scenarios and adhering to specific constraints. Additionally, we identify a lack of four key capabilities, i.e., understanding, reasoning, exploration, and reflection, as primary reasons for the failure of LLM agents. Furthermore, we provide empirical analysis on the failure of reflection, and improve the success rate by 27% with our proposed exploration strategy. This work is the first to present valuable insights in understanding fine-grained weakness of LLM agents, and offers a path forward for future research in this area. Environment, benchmark, and evaluation code for AndroidArena are released at https://github.com/AndroidArenaAgent/AndroidArena.


title: The impact of different unravelings in a monitored system of free fermions

abstract: We consider a free-fermion chain undergoing dephasing, described by two different random-measurement protocols (unravelings): a quantum-state-diffusion and a quantum-jump one. Both protocols keep the state in a Slater-determinant form, allowing to address quite large system sizes. We find a bifurcation in the distribution of the measurement operators along the quantum trajectories, that's to say, there is a point where the shape of this distribution changes from unimodal to bimodal. The value of the measurement strength where this phenomenon occurs is similar for the two unravelings, but the distributions and the transition have different properties reflecting the symmetries of the two measurement protocols. We also consider the scaling with the system size of the inverse participation ratio of the Slater-determinant components and find a power-law scaling that marks a multifractal behaviour, in both unravelings and for any nonvanishing measurement strength.


title: CigaR: Cost-efficient Program Repair with LLMs

abstract: Large language models (LLM) have proven to be effective at automated program repair (APR). However, using LLMs can be costly, with companies invoicing users by the number of tokens. In this paper, we propose CigaR, the first LLM-based APR tool that focuses on minimizing the repair cost. CigaR works in two major steps: generating a first plausible patch and multiplying plausible patches. CigaR optimizes the prompts and the prompt setting to maximize the information given to LLMs using the smallest possible number of tokens. Our experiments on 429 bugs from the widely used Defects4J and HumanEval-Java datasets shows that CigaR reduces the token cost by 73%. On average, CigaR spends 127k tokens per bug while the baseline uses 467k tokens per bug. On the subset of bugs that are fixed by both, CigaR spends 20k per bug while the baseline uses 608k tokens, a cost saving of 96%. Our extensive experiments show that CigaR is a cost-effective LLM-based program repair tool that uses a low number of tokens to automatically generate patches.


title: On the Out-Of-Distribution Generalization of Multimodal Large Language Models

abstract: We investigate the generalization boundaries of current Multimodal Large Language Models (MLLMs) via comprehensive evaluation under out-of-distribution scenarios and domain-specific tasks. We evaluate their zero-shot generalization across synthetic images, real-world distributional shifts, and specialized datasets like medical and molecular imagery. Empirical results indicate that MLLMs struggle with generalization beyond common training domains, limiting their direct application without adaptation. To understand the cause of unreliable performance, we analyze three hypotheses: semantic misinterpretation, visual feature extraction insufficiency, and mapping deficiency. Results identify mapping deficiency as the primary hurdle. To address this problem, we show that in-context learning (ICL) can significantly enhance MLLMs' generalization, opening new avenues for overcoming generalization barriers. We further explore the robustness of ICL under distribution shifts and show its vulnerability to domain shifts, label shifts, and spurious correlation shifts between in-context examples and test data.


title: First-Order Fischer Servi Logic

abstract: We prove the completeness of a first-order analogue of the Fischer Servi logic $\mathsf{FS}$ with respect to its expected birelational semantics. To this end we introduce the notion of the $\textit{trace model}$ and, much like in a canonical model argument, prove a truth lemma. We conclude by examining a number of other first-order Fischer Servi logics, including the first-order analogue of $\mathsf{FSS4}$, whose completeness can be similarly proved.


title: On the numerical controllability of the two-dimensional heat, Stokes and Navier-Stokes equations

abstract: The aim of this work is to present some strategies to solve numerically controllability problems for the two-dimensional heat equation, the Stokes equations and the Navier-Stokes equations with Dirichlet boundary conditions. The main idea is to adapt the Fursikov-Imanuvilov formulation, see~[A.V. Fursikov, O.Yu. Imanuvilov: {\it Controllability of Evolutions Equations,} Lectures Notes Series, Vol.~34, Seoul National University, 1996]; this approach has been followed recently for the one-dimensional heat equation by the first two authors. More precisely, we minimize over the class of admissible null controls a functional that involves weighted integrals of the state and the control, with weights that blow up near the final time. The associated optimality conditions can be viewed as a differential system in the three variables $x_1$, $x_2$ and $t$ that is second--order in time and fourth--order in space, completed with appropriate boundary conditions. We present several mixed formulations of the problems and, then, associated mixed finite element Lagrangian approximations that are relatively easy to handle. Finally, we exhibit some numerical experiments.


title: Recent progress in the electroweak structure of light nuclei using quantum Monte Carlo methods

abstract: Nuclei will play a prominent role in searches for physics beyond the Standard Model as the active material in experiments. In order to reliably interpret new physics signals, one needs an accurate model of the underlying nuclear dynamics. In this review, we discuss recent progress made with quantum Monte Carlo approaches for calculating the electroweak structure of light nuclei. We place particular emphasis on recent $\beta$-decay, muon capture, $0\nu\beta\beta$-decay, and electron scattering results.


title: Hamiltonicity of expanders: optimal bounds and applications

abstract: An $n$-vertex graph $G$ is a $C$-expander if $|N(X)|\geq C|X|$ for every $X\subseteq V(G)$ with $|X|< n/2C$ and there is an edge between every two disjoint sets of at least $n/2C$ vertices. We show that there is some constant $C>0$ for which every $C$-expander is Hamiltonian. In particular, this implies the well known conjecture of Krivelevich and Sudakov from 2003 on Hamilton cycles in $(n,d,\lambda)$-graphs. This completes a long line of research on the Hamiltonicity of sparse graphs, and has many applications, including to the Hamiltonicity of random Cayley graphs.


title: Gravitational Waveform: A Tale of Two Formalisms

abstract: We revisit the quantum-amplitude-based derivation of the gravitational waveform emitted by the scattering of two spinless massive bodies at the third order in Newton's constant, $h \sim G+G^2+G^3$ (one-loop level), and correspondingly update its comparison with its classically-derived multipolar-post-Minkowskian counterpart. A spurious-pole-free reorganization of the one-loop five-point amplitude substantially simplifies the post-Newtonian expansion. We find complete agreement between the two results up to the fifth order in the small velocity expansion after taking into account three subtle aspects of the amplitude derivation: (1) in agreement with [arXiv:2312.07452 [hep-th]], the term quadratic in the amplitude in the observable-based formalism [JHEP 02, 137 (2019)] generates a frame rotation by half the classical scattering angle; (2) the dimensional regularization of the infrared divergences of the amplitude introduces an additional $(d-4)/(d-4)$ finite term; and (3) zero-frequency gravitons are found to contribute additional terms both at order $h \sim G^1$ and at order $h \sim G^3$ when including disconnected diagrams in the observable-based formalism.


title: Simulation of ion temperature gradient driven modes with 6D kinetic Vlasov code

abstract: With the increase in computational capabilities over the last years it becomes possible to simulate more and more complex and accurate physical models. Gyrokinetic theory has been introduced in the 1960s and 1970s in the need of describing a plasma with more accurate models than fluid equations, but eliminating the complexity of the fast gyration about the magnetic field lines. Although results from current gyrokinetic computer simulations are in fair agreement with experimental results in core physics, crucial assumptions made in the derivation make it unreliable in regimes of higher fluctuations and stronger gradient, such as the tokamak edge. With our novel optimized and scalable semi-Lagrangian solver we are able to simulate ion-temperature gradient modes with the 6D kinetic model including the turbulent saturation. After thoroughly testing our simulation code against analytical computations and gyrokinetic simulations (with the gyrokinetic code GYRO), it has been possible to show first plasma properties that go beyond standard gyrokinetic simulations. This includes the explicit description of the complete perpendicular energy fluxes and the excitation of high frequency waves (around the Larmor frequency) in the nonlinear saturation phase.


title: RQP-SGD: Differential Private Machine Learning through Noisy SGD and Randomized Quantization

abstract: The rise of IoT devices has prompted the demand for deploying machine learning at-the-edge with real-time, efficient, and secure data processing. In this context, implementing machine learning (ML) models with real-valued weight parameters can prove to be impractical particularly for large models, and there is a need to train models with quantized discrete weights. At the same time, these low-dimensional models also need to preserve privacy of the underlying dataset. In this work, we present RQP-SGD, a new approach for privacy-preserving quantization to train machine learning models for low-memory ML-at-the-edge. This approach combines differentially private stochastic gradient descent (DP-SGD) with randomized quantization, providing a measurable privacy guarantee in machine learning. In particular, we study the utility convergence of implementing RQP-SGD on ML tasks with convex objectives and quantization constraints and demonstrate its efficacy over deterministic quantization. Through experiments conducted on two datasets, we show the practical effectiveness of RQP-SGD.


title: Real-time Dynamics of the Schwinger Model as an Open Quantum System with Neural Density Operators

abstract: Ab-initio simulations of multiple heavy quarks propagating in a Quark-Gluon Plasma are computationally difficult to perform due to the large dimension of the space of density matrices. This work develops machine learning algorithms to overcome this difficulty by approximating exact quantum states with neural network parametrisations, specifically Neural Density Operators. As a proof of principle demonstration in a QCD-like theory, the approach is applied to solve the Lindblad master equation in the 1+1d lattice Schwinger Model as an open quantum system. Neural Density Operators enable the study of in-medium dynamics on large lattice volumes, where multiple-string interactions and their effects on string-breaking and recombination phenomena can be studied. Thermal properties of the system at equilibrium can also be probed with these methods by variationally constructing the steady state of the Lindblad master equation. Scaling of this approach with system size is studied, and numerical demonstrations on up to 32 spatial lattice sites and with up to 3 interacting strings are performed.

categories: hep-ph hep-lat nucl-th physics.comp-ph quant-ph


title: TIC: Translate-Infer-Compile for accurate 'text to plan' using LLMs and logical intermediate representations

abstract: We study the problem of generating plans for given natural language planning task requests. On one hand, LLMs excel at natural language processing but do not perform well on planning. On the other hand, classical planning tools excel at planning tasks but require input in a structured language such as the Planning Domain Definition Language (PDDL). We leverage the strengths of both the techniques by using an LLM for generating the PDDL representation (task PDDL) of planning task requests followed by using a classical planner for computing a plan. Unlike previous approaches that use LLMs for generating task PDDLs directly, our approach comprises of (a) translate: using an LLM only for generating a logically interpretable intermediate representation of natural language task descriptions, (b) infer: deriving additional logically dependent information from the intermediate representation using a logic reasoner (currently, Answer Set Programming solver), and (c) compile: generating the target task PDDL from the base and inferred information. We observe that using an LLM to only output the intermediate representation significantly reduces LLM errors. Consequently, TIC approach achieves, for at least one LLM, high accuracy on task PDDL generation for all seven domains of our evaluation dataset.


title: You Still See Me: How Data Protection Supports the Architecture of ML Surveillance

abstract: Human data forms the backbone of machine learning. Data protection laws thus have strong bearing on how ML systems are governed. Given that most requirements in data protection laws accompany the processing of personal data, organizations have an incentive to keep their data out of legal scope. This makes the development and application of certain privacy-preserving techniques--data protection techniques--an important strategy for ML compliance. In this paper, we examine the impact of a rhetoric that deems data wrapped in these techniques as data that is "good-to-go". We show how their application in the development of ML systems--from private set intersection as part of dataset curation to homomorphic encryption and federated learning as part of model computation--can further support individual monitoring and data consolidation. With data accumulation at the core of how the ML pipeline is configured, we argue that data protection techniques are often instrumentalized in ways that support infrastructures of surveillance, rather than in ways that protect individuals associated with data. Finally, we propose technology and policy strategies to evaluate data protection techniques in light of the protections they actually confer. We conclude by highlighting the role that technologists might play in devising policies that combat surveillance ML technologies.


title: Equi-affine minimal-degree moving frames for polynomial curves

abstract: We develop a theory and an algorithm for constructing minimal-degree polynomial moving frames for polynomial curves in an affine space. The algorithm is equivariant under volume-preserving affine transformations of the ambient space and the parameter shifts. We show that any matrix-completion algorithm can be turned into an equivariant moving frame algorithm via an equivariantization procedure that we develop. We prove that if a matrix-completion algorithm is of minimal degree then so is the resulting equivariant moving frame algorithm. We propose a novel minimal-degree matrix-completion algorithm, complementing the existing body of literature on this topic.


title: Image-based Deep Learning for the time-dependent prediction of fresh concrete properties

abstract: Increasing the degree of digitisation and automation in the concrete production process can play a crucial role in reducing the CO$_2$ emissions that are associated with the production of concrete. In this paper, a method is presented that makes it possible to predict the properties of fresh concrete during the mixing process based on stereoscopic image sequences of the concretes flow behaviour. A Convolutional Neural Network (CNN) is used for the prediction, which receives the images supported by information on the mix design as input. In addition, the network receives temporal information in the form of the time difference between the time at which the images are taken and the time at which the reference values of the concretes are carried out. With this temporal information, the network implicitly learns the time-dependent behaviour of the concretes properties. The network predicts the slump flow diameter, the yield stress and the plastic viscosity. The time-dependent prediction potentially opens up the pathway to determine the temporal development of the fresh concrete properties already during mixing. This provides a huge advantage for the concrete industry. As a result, countermeasures can be taken in a timely manner. It is shown that an approach based on depth and optical flow images, supported by information of the mix design, achieves the best results.


title: Noncommutative point spaces of symbolic dynamical systems

abstract: We study point modules of monomial algebras associated with symbolic dynamical systems, parametrized by proalgebraic varieties which 'linearize' the underlying dynamical systems. Faithful point modules correspond to transitive sub-systems, equivalently, to monomial algebras associated with infinite words. In particular, we prove that the space of point modules of every prime monomial algebra with Hilbert series $1/(1-t)^2$ -- which is thus thought of as a 'monomial $\mathbb{P}^1$' -- is isomorphic to a union of a classical projective line with a Cantor set. While there is a continuum of monomial $\mathbb{P}^1$'s with non-equivalent graded module categories, they all share isomorphic parametrizing spaces of point modules. In contrast, free algebras are geometrically rigid, and are characterized up to isomorphism from their spaces of point modules. Furthermore, we derive enumerative and ring-theoretic consequences from our analysis. In particular, we show that the formal power series counting the irreducible components of the moduli schemes of truncated point modules of finitely presented monomial algebras are rational functions, and classify isomorphisms and automorphisms of projectively simple monomial algebras.


title: Primordial Black Holes and Scalar-induced Gravitational Waves in Radiative Hybrid Inflation

abstract: We study the possibility that primordial black holes (PBHs) can be formed from large curvature perturbations generated during the waterfall phase transition due to the effects of one-loop radiative corrections of Yukawa couplings between the inflaton and a dark fermion in a non-supersymmetric hybrid inflationary model. We obtain a spectral index, $n_s$ and a tensor-to-scalar ratio, $r$ consistent with the current Planck data. Our findings show that the abundance of PBHs are correlated to the dark fermion mass $m_N$ and peak in the GW spectrum. We identify parameter space where PBHs can be the entire dark matter (DM) candidate of the universe or a fraction of it. Our predictions are consistent with any existing constraints of PBH from microlensing, BBN, and CMB, etc. Moreover, the scenario is also testable via induced gravitational waves (GWs) from first-order scalar perturbations detectable in future observatories such as LISA and ET. For instance, with inflaton mass $m \sim 2\times 10^{12}$ GeV, $m_N \sim 5.4\times 10^{15}$ GeV, we obtain PBHs of around $10^{-13}\, M_\odot$ mass that can explain the entire abundance of DM and predict GWs with amplitude $\Omega_{\rm GW}h^2$ $\sim 10^{-9}$ with peak frequency $f$ $\sim$ $0.1$ Hz in LISA. By explicitly estimating fine-tuning we show the model has very mild tuning. We discuss successful reheating at the end of the inflationary phase via the conversion of the waterfall field into standard model (SM) particles. We also briefly speculate a scenario where the dark fermion can be the possible heavy right-handed neutrino (RHN) which is responsible for generating the SM neutrino masses via the seesaw mechanism. The RHN can be produced due to waterfall field decay and its subsequent decay may also explain the observed baryon asymmetry in the universe via leptogenesis.


title: The Complexity of Sequential Prediction in Dynamical Systems

abstract: We study the problem of learning to predict the next state of a dynamical system when the underlying evolution function is unknown. Unlike previous work, we place no parametric assumptions on the dynamical system, and study the problem from a learning theory perspective. We define new combinatorial measures and dimensions and show that they quantify the optimal mistake and regret bounds in the realizable and agnostic setting respectively.


title: Unified picture of measurement-induced ionization in the transmon

abstract: Despite the high measurement fidelity that can now be reached, the dispersive qubit readout of circuit quantum electrodynamics is plagued by a loss of its quantum nondemolition character and a decrease in fidelity with increased measurement strength. In this work we elucidate the nature of this dynamical process, which we refer to as transmon ionization. We develop a comprehensive framework which provides a unified physical picture of the origin of transmon ionization. This framework consists of three complementary levels of descriptions: a fully quantized transmon-resonator model, a semiclassical model where the resonator is treated as a classical drive on the transmon, and a fully classical model. Crucially, all three approaches preserve the full cosine potential of the transmon, and lead to similar predictions. This framework identifies the multiphoton resonances responsible for transmon ionization. It also allows us to efficiently compute numerical estimates of the photon number threshold for ionization, which are in remarkable agreement with recent experimental results. The set of tools developed within this work are both conceptually and computationally simple, and we expect them to become an integral part of the theoretical support of all circuit QED experiments.


title: Bakry-\'Emery-Ricci curvature: An alternative network geometry measure in the expanding toolbox of graph Ricci curvatures

abstract: The characterization of complex networks with tools originating in geometry, for instance through the statistics of so-called Ricci curvatures, is a well established tool of network science. There exist various types of such Ricci curvatures, capturing different aspects of network geometry. In the present work, we investigate Bakry-\'Emery-Ricci curvature, a notion of discrete Ricci curvature that has been studied much in geometry, but so far has not been applied to networks. We explore on standard classes of artificial networks as well as on selected empirical ones to what the statistics of that curvature are similar to or different from that of other curvatures, how it is correlated to other important network measures, and what it tells us about the underlying network. We observe that most vertices typically have negative curvature. Random and small-world networks exhibit a narrow curvature distribution whereas other classes and most of the real-world networks possess a wide curvature distribution. When we compare Bakry-\'Emery-Ricci curvature with two other discrete notions of Ricci-curvature, Forman-Ricci and Ollivier-Ricci curvature for both model and real-world networks, we observe a high positive correlation between Bakry-\'Emery-Ricci and both Forman-Ricci and Ollivier-Ricci curvature, and in particular with the augmented version of Forman-Ricci curvature. Bakry-\'Emery-Ricci curvature also exhibits a high negative correlation with the vertex centrality measure and degree for most of the model and real-world networks. However, it does not correlate with the clustering coefficient. Also, we investigate the importance of vertices with highly negative curvature values to maintain communication in the network. The computational time for Bakry-\'Emery-Ricci curvature is shorter than that required for Ollivier-Ricci curvature but higher than for Augmented Forman-Ricci curvature.


title: FaBERT: Pre-training BERT on Persian Blogs

abstract: We introduce FaBERT, a Persian BERT-base model pre-trained on the HmBlogs corpus, encompassing both informal and formal Persian texts. FaBERT is designed to excel in traditional Natural Language Understanding (NLU) tasks, addressing the intricacies of diverse sentence structures and linguistic styles prevalent in the Persian language. In our comprehensive evaluation of FaBERT on 12 datasets in various downstream tasks, encompassing Sentiment Analysis (SA), Named Entity Recognition (NER), Natural Language Inference (NLI), Question Answering (QA), and Question Paraphrasing (QP), it consistently demonstrated improved performance, all achieved within a compact model size. The findings highlight the importance of utilizing diverse and cleaned corpora, such as HmBlogs, to enhance the performance of language models like BERT in Persian Natural Language Processing (NLP) applications. FaBERT is openly accessible at https://huggingface.co/sbunlp/fabert


title: Polynomial parametrisation of the canonical iterates to the solution of $-\gamma g'= g^{-1}$

abstract: The iterates $h_0,h_1,h_2,\dotsc$ constructed in [8,5] and converging to the only solution $g=h\colon[0,1]\to[0,1]$ of the iterative differential equation $-\gamma g'= g^{-1}$, $\gamma>0$, are parametrised by polynomials over $\Bbb Q$, and the corresponding constant $\gamma=\kappa\approx0.278877$ is estimated by rational numbers.


title: Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning

abstract: Datasets are foundational to many breakthroughs in modern artificial intelligence. Many recent achievements in the space of natural language processing (NLP) can be attributed to the finetuning of pre-trained models on a diverse set of tasks that enables a large language model (LLM) to respond to instructions. Instruction fine-tuning (IFT) requires specifically constructed and annotated datasets. However, existing datasets are almost all in the English language. In this work, our primary goal is to bridge the language gap by building a human-curated instruction-following dataset spanning 65 languages. We worked with fluent speakers of languages from around the world to collect natural instances of instructions and completions. Furthermore, we create the most extensive multilingual collection to date, comprising 513 million instances through templating and translating existing datasets across 114 languages. In total, we contribute four key resources: we develop and open-source the Aya Annotation Platform, the Aya Dataset, the Aya Collection, and the Aya Evaluation Suite. The Aya initiative also serves as a valuable case study in participatory research, involving collaborators from 119 countries. We see this as a valuable framework for future research collaborations that aim to bridge gaps in resources.


title: The Brauer groups of moduli of genus three curves and plane curves

abstract: We compute the $\ell$-primary torsion of the Brauer group of the moduli stack of smooth curves of genus three over any field of characteristic different from two. We achieve this result by computing the cohomological invariants of this stack. Along the way, we also compute the cohomological invariants and the Brauer group of the moduli stacks of smooth plane curves of degree $d$ over any algebraically closed field of characteristic different from two and coprime to $d$.


title: Tidal resonances for fuzzballs

abstract: We study the gravitational tidal response of D1D5, Top Star and (1,0,n) strata horizonless geometries. We find that the tidal interactions in fuzzball geometries, unlike in the case of black holes, exhibits a sequence of resonant peaks associated to the existence of metastable bound states. The spectrum of resonant frequencies is computed by semi-analytical and numerical methods.


title: A two-stage algorithm in evolutionary product unit neural networks for classification

abstract: This paper presents a procedure to add broader diversity at the beginning of the evolutionary process. It consists of creating two initial populations with different parameter settings, evolving them for a small number of generations, selecting the best individuals from each population in the same proportion and combining them to constitute a new initial population. At this point the main loop of an evolutionary algorithm is applied to the new population. The results show that our proposal considerably improves both the efficiency of previous methodologies and also, significantly, their efficacy in most of the data sets. We have carried out our experimentation on twelve data sets from the UCI repository and two complex real-world problems which differ in their number of instances, features and classes.


title: Taut smoothings of arcs and curves

abstract: We study the geometric and combinatorial effect of smoothing an intersection point on a collection of curves or arcs on a surface, make progress towards answering the question of whether every taut curve has a taut smoothing, and answer the analogous question in full for taut arcs with fixed endpoints and for taut multi-curves and multi-arcs with at least two non-disjoint components. We deduce that for every Riemannian metric on a surface, the shortest properly immersed arcs with at least $k$ self-intersections have exactly $k$ self-intersections, and prove a partial monotonicity result for the marked length spectrum of curves on orientable surfaces.


title: Right or Wrong -- Understanding How Novice Users Write Software Models

abstract: Writing declarative models has numerous benefits, ranging from automated reasoning and correction of design-level properties before systems are built, to automated testing and debugging of their implementations after they are built. Alloy is a declarative modeling language that is well-suited for verifying system designs. A key strength of Alloy is its scenario-finding toolset, the Analyzer, which allows users to explore all valid scenarios that adhere to the model's constraints up to a user-provided scope. However, even with visualized scenarios, it is difficult to write correct Alloy models. To address this, a growing body of work explores different techniques for debugging Alloy models. In order to develop and evaluate these techniques in an effective manor, this paper presents an empirical study of over 97,000 models written by novice users trying to learn Alloy. We investigate how users write both correct and incorrect models in order to produce a comprehensive benchmark for future use as well as a series of observations to guide debugging and educational efforts for Alloy model development.


title: Understanding the Effects of Iterative Prompting on Truthfulness

abstract: The development of Large Language Models (LLMs) has notably transformed numerous sectors, offering impressive text generation capabilities. Yet, the reliability and truthfulness of these models remain pressing concerns. To this end, we investigate iterative prompting, a strategy hypothesized to refine LLM responses, assessing its impact on LLM truthfulness, an area which has not been thoroughly explored. Our extensive experiments delve into the intricacies of iterative prompting variants, examining their influence on the accuracy and calibration of model responses. Our findings reveal that naive prompting methods significantly undermine truthfulness, leading to exacerbated calibration errors. In response to these challenges, we introduce several prompting variants designed to address the identified issues. These variants demonstrate marked improvements over existing baselines, signaling a promising direction for future research. Our work provides a nuanced understanding of iterative prompting and introduces novel approaches to enhance the truthfulness of LLMs, thereby contributing to the development of more accurate and trustworthy AI systems.


title: Computing Optimal Commitments to Strategies and Outcome-Conditional Utility Transfers

abstract: Prior work has studied the computational complexity of computing optimal strategies to commit to in Stackelberg or leadership games, where a leader commits to a strategy which is observed by one or more followers. We extend this setting to one where the leader can additionally commit to outcome-conditional utility transfers. We characterize the computational complexity of finding optimal strategies in normal-form and Bayesian games, giving a mix of efficient algorithms and NP-hardness results. Finally, we allow the leader to also commit to a signaling scheme which induces a correlated equilibrium. In this setting, optimal commitments can be found in polynomial time for arbitrarily many players.


title: Feedback Loops With Language Models Drive In-Context Reward Hacking

abstract: Language models influence the external world: they query APIs that read and write to web pages, generate content that shapes human behavior, and run system commands as autonomous agents. These interactions form feedback loops: LLM outputs affect the world, which in turn affect subsequent LLM outputs. In this work, we show that feedback loops can cause in-context reward hacking (ICRH), where the LLM at test-time optimizes a (potentially implicit) objective but creates negative side effects in the process. For example, consider an LLM agent deployed to increase Twitter engagement; the LLM may retrieve its previous tweets into the context window and make them more controversial, increasing engagement but also toxicity. We identify and study two processes that lead to ICRH: output-refinement and policy-refinement. For these processes, evaluations on static datasets are insufficient -- they miss the feedback effects and thus cannot capture the most harmful behavior. In response, we provide three recommendations for evaluation to capture more instances of ICRH. As AI development accelerates, the effects of feedback loops will proliferate, increasing the need to understand their role in shaping LLM behavior.