title: Pointwise convergence of the Klein-Gordon flow

abstract: We consider the PDEs version of the Carleson problem in the context of the cubic nonlinear Klein-Gordon equation. This means that we aim to establish the lowest regularity class for which one has almost everywhere pointwise convergence of the solutions to the initial data, as $t \to 0$. We prove sharp results for initial data in Sobolev spaces and for their randomized counterparts.


title: Hearing Exotic Smooth Structures: Basic Spectra of Equivariant Manifolds

abstract: This paper explores the existence and properties of \emph{basic} eigenvalues and eigenfunctions associated with the Riemannian Laplacian on closed, connected Riemannian manifolds featuring an effective isometric action by a compact Lie group. We introduce the concept of equivariant isospectrality, asserting that two Riemannian manifolds with isometric actions by the same Lie group are equivariantly isospectral if their basic spectra coincide. Our primary focus is investigating the potential existence of homeomorphic yet not diffeomorphic smooth manifolds that can accommodate invariant, equivariantly isospectral metrics. We establish the occurrence of such scenarios for specific homotopy spheres and connected sums. Moreover, the developed theory demonstrates that the ring of invariant admissible scalar curvature functions on certain fixed smooth manifolds fails to distinguish between smooth structures. This implies the existence of homotopy spheres with identical rings of invariant scalar curvature functions, irrespective of the underlying smooth structure.


title: Quantized Embedding Vectors for Controllable Diffusion Language Models

abstract: Improving the controllability, portability, and inference speed of diffusion language models (DLMs) is a key challenge in natural language generation. While recent research has shown significant success in complex text generation with language models, the memory and computational power are still very demanding and fall short of expectations, which naturally results in low portability and instability for the models. To mitigate these issues, numerous well-established methods were proposed for neural network quantization. To further enhance their portability of independent deployment as well as improve their stability evaluated by language perplexity, we propose a novel approach called the Quantized Embedding Controllable Diffusion Language Model (QE-CDLM). QE-CDLM builds upon the recent successful controllable DLMs by remodeling the task-specific embedding space via quantization. This leads to a gradient-based controller for the generation tasks, and more stable intermediate latent variables are obtained, which naturally brings in an accelerated convergence as well as better controllability. Additionally, the adaption fine-tuning method is employed to reduce tunable weights. Experimental results on five challenging fine-grained control tasks demonstrate that QE-CDLM compares favorably to existing methods in terms of quality and feasibility, achieving better perplexity and lightweight fine-tuning.


title: Limitations to the energy resolution of single-photon sensitive Microwave Kinetic Inductance Detectors

abstract: This paper describes the energy resolution of Microwave Kinetic Inductance Detectors (MKIDs), and models some limiting factors to it. Energy resolution is a measure of the smallest possible difference in energy of the impinging photons, Delta E, that the detector can identify and is of critical importance for many applications. Limits to the energy resolution cause by the Fano effect, amplifier noise, current inhomogeneities, and readout sampling frequency are taken into consideration for this model. This paper describes an approach to combine all of these limitations and predict a wavelength dependency of the upper limit to the resolving power.


title: Towards Reducing Diagnostic Errors with Interpretable Risk Prediction

abstract: Many diagnostic errors occur because clinicians cannot easily access relevant information in patient Electronic Health Records (EHRs). In this work we propose a method to use LLMs to identify pieces of evidence in patient EHR data that indicate increased or decreased risk of specific diagnoses; our ultimate aim is to increase access to evidence and reduce diagnostic errors. In particular, we propose a Neural Additive Model to make predictions backed by evidence with individualized risk estimates at time-points where clinicians are still uncertain, aiming to specifically mitigate delays in diagnosis and errors stemming from an incomplete differential. To train such a model, it is necessary to infer temporally fine-grained retrospective labels of eventual "true" diagnoses. We do so with LLMs, to ensure that the input text is from before a confident diagnosis can be made. We use an LLM to retrieve an initial pool of evidence, but then refine this set of evidence according to correlations learned by the model. We conduct an in-depth evaluation of the usefulness of our approach by simulating how it might be used by a clinician to decide between a pre-defined list of differential diagnoses.


title: Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning

abstract: Instruction tuning is critical to large language models (LLMs) for achieving better instruction following and task adaptation capabilities but its success heavily relies on the training data quality. Many recent methods focus on improving the data quality but often overlook the compatibility of the data with the student model being finetuned. This paper introduces Selective Reflection-Tuning, a novel paradigm that synergizes a teacher LLM's reflection and introspection for improving existing data quality with the data selection capability of the student LLM, to automatically refine existing instruction-tuning data. This teacher-student collaboration produces high-quality and student-compatible instruction-response pairs, resulting in sample-efficient instruction tuning and LLMs of superior performance. Selective Reflection-Tuning is a data augmentation and synthesis that generally improves LLM finetuning and self-improvement without collecting brand-new data. We apply our method to Alpaca and WizardLM data and achieve much stronger and top-tier 7B and 13B LLMs.


title: A free boundary Monge-Amp\`ere equation and applications to complete Calabi-Yau metrics

abstract: Let $P$ be a convex body containing the origin in its interior. We study a real Monge-Amp\`ere equation with singularities along $\del P$ which is Legendre dual to a certain free boundary Monge-Amp\`ere equation. This is motivated by the existence problem for complete Calabi-Yau metrics on log Calabi-Yau pairs $(X, D)$ with $D$ an ample, simple normal crossings divisor. We prove the existence of solutions in $C^{\infty}(P)\cap C^{1,\alpha}(\overline{P})$, and establish the strict convexity of the free boundary. When $P$ is a polytope, we obtain an asymptotic expansion for the solution near the interior of the codimension $1$ faces of $\del P$.


title: Amenable group actions on $L_p$ lattices

abstract: A result by Ornstein and Weiss states that a free and measure-preserving action of an amenable group on a probability space yields a decomposition of the space in disjoint images, up to a small error, analogous to the one given by the Rokhlin lemma in the case of a single transformation. We generalise this result to non-singular actions, and use it to prove that the theory of an action by automorphisms of an amenable group on a Banach $L_p$ lattice admits a model companion, which is stable and has quantifier elimination.


title: An optically pumped magnetic gradiometer for the detection of human biomagnetism

abstract: We realise an intrinsic optically pumped magnetic gradiometer based on non-linear magneto-optical rotation. We show that our sensor can reach a gradiometric sensitivity of 18 $\text{fT}/\text{cm}/\sqrt{\text{Hz}}$ and can reject common mode homogeneous magnetic field noise with up to 30 dB attenuation. We demonstrate that our magnetic field gradiometer is sufficiently sensitive and resilient to be employed in biomagnetic applications. In particular, we are able to record the auditory evoked response of the human brain, and to perform real-time magnetocardiography in the presence of external magnetic field disturbances. Our gradiometer provides complementary capabilities in human biomagnetic sensing to optically pumped magnetometers, and opens new avenues in the detection of human biomagnetism.

categories: physics.app-ph physics.atom-ph physics.med-ph physics.optics quant-ph


title: Electromagnetic Scattering at an Arbitrarily Accelerated Interface

abstract: We present a general analytical solution to the problem of electromagnetic scattering at a one-dimensional arbitrarily accelerated space-time engineered-modulation (ASTEM) interface in the subluminal regime. We show that such an interface fundamentally produces chirping, whose profile can be designed according to specifications. This work represents an important step in the development of ASTEM crystals and holds significant potential for applications in microwave and optical devices reliant on chirp-based functionalities.


title: Generating Visual Stimuli from EEG Recordings using Transformer-encoder based EEG encoder and GAN

abstract: In this study, we tackle a modern research challenge within the field of perceptual brain decoding, which revolves around synthesizing images from EEG signals using an adversarial deep learning framework. The specific objective is to recreate images belonging to various object categories by leveraging EEG recordings obtained while subjects view those images. To achieve this, we employ a Transformer-encoder based EEG encoder to produce EEG encodings, which serve as inputs to the generator component of the GAN network. Alongside the adversarial loss, we also incorporate perceptual loss to enhance the quality of the generated images.


title: A geometric approach to conjugation-invariant random permutations

abstract: We propose a new approach to conjugation-invariant random permutations. Namely, we explain how to construct uniform permutations in given conjugacy classes from certain point processes in the plane. This enables the use of geometric tools to study various statistics of such permutations. For their longest decreasing subsequences, we prove universality of the $2\sqrt n$ asymptotic. For Robinson--Schensted shapes, we prove universality of the Vershik--Kerov--Logan--Shepp limit curve, thus solving a conjecture of Kammoun. For the number of records, we establish a phase transition phenomenon as the number of fixed points grows. For pattern counts, we obtain an asymptotic normality result, partially answering a conjecture of Hamaker and Rhoades.


title: Collision efficiency of droplets across diffusive, electrostatic and inertial regimes

abstract: Rain drops form in clouds by collision of submillimetric droplets falling under gravity: larger drops fall faster than smaller ones and collect them on their path. The puzzling stability of fogs and non-precipitating warm clouds with respect to this avalanching mechanism has been a longstanding problem. How to explain that droplets of diameter around $10~{\rm \mu m}$ have a low probability of collision, inhibiting the cascade towards larger and larger drops? Here we review the dynamical mechanisms that have been proposed in the literature and quantitatively investigate the frequency of drop collisions induced by Brownian diffusion, electrostatics and gravity, using an open-source Monte-Carlo code that takes all of them into account. Inertia dominates over aerodynamic forces for large drops, when the Stokes number is larger than $1$. Thermal diffusion dominates over aerodynamic forces for small drops, when the P\'eclet number is smaller than $1$. We show that there exists a range of size (typically $1-10~{\rm \mu m}$ for water drops in air) for which neither inertia nor Brownian diffusion are significant, leading to a gap in the collision rate. The effect is particularly important, due to the lubrication film forming between the drops immediately before collision, and secondarily to the long-range aerodynamic interaction. Two different mechanisms regularise the divergence of the lubrication force at vanishing gap: the transition to a noncontinuum regime in the lubrication film, when the gap is comparable to the mean free path of air, and the induction of a flow inside the drops due to shear at their surfaces. In the gap between inertia-dominated and diffusion-dominated regimes, dipole-dipole electrostatic interactions becomes the major effect controlling the efficiency of drop collisions.


title: Reusing Softmax Hardware Unit for GELU Computation in Transformers

abstract: Transformers have improved drastically the performance of natural language processing (NLP) and computer vision applications. The computation of transformers involves matrix multiplications and non-linear activation functions such as softmax and GELU (Gaussion Error Linear Unit) that are accelerated directly in hardware. Currently, function evaluation is done separately for each function and rarely allows for hardware reuse. To mitigate this problem, in this work, we map the computation of GELU to a softmax operator. In this way, the efficient hardware units designed already for softmax can be reused for computing GELU as well. Computation of GELU can enjoy the inherent vectorized nature of softmax and produce in parallel multiple GELU outcomes. Experimental results show that computing GELU via a pre-existing and incrementally modified softmax hardware unit (a) does not reduce the accuracy of representative NLP applications and (b) allows the reduction of the overall hardware area and power by 6.1% and 11.9%, respectively, on average.


title: Physics-Informed Neural Network Policy Iteration: Algorithms, Convergence, and Verification

abstract: Solving nonlinear optimal control problems is a challenging task, particularly for high-dimensional problems. We propose algorithms for model-based policy iterations to solve nonlinear optimal control problems with convergence guarantees. The main component of our approach is an iterative procedure that utilizes neural approximations to solve linear partial differential equations (PDEs), ensuring convergence. We present two variants of the algorithms. The first variant formulates the optimization problem as a linear least square problem, drawing inspiration from extreme learning machine (ELM) for solving PDEs. This variant efficiently handles low-dimensional problems with high accuracy. The second variant is based on a physics-informed neural network (PINN) for solving PDEs and has the potential to address high-dimensional problems. We demonstrate that both algorithms outperform traditional approaches, such as Galerkin methods, by a significant margin. We provide a theoretical analysis of both algorithms in terms of convergence of neural approximations towards the true optimal solutions in a general setting. Furthermore, we employ formal verification techniques to demonstrate the verifiable stability of the resulting controllers.


title: Dopant concentration effects on Si$_{1-x}$Ge$_{x}$ crystals for emerging light-source technologies: A molecular dynamics study

abstract: In this study, we conduct atomistic-level molecular dynamics simulations on fixed-sized silicon-germanium (Si$_{1-x}$Ge$_{x}$) crystals to elucidate the effects of dopant concentration and temperature on the crystalline inter-planar distances. Our calculations consider a range of Ge dopant concentrations between pure Si (0%) and 15%, and for both the optimised system state and a temperature of 300 K. We observe a linear relationship between Ge concentration and inter-planar distance and lattice constant, in line with the approximation of Vegard's Law, and other experimental and computational results. These findings will be employed in conjunction with future studies to establish precise tolerances for use in crystal growth, crucial for the manufacture of crystals intended for emerging gamma-ray crystal-based light source technologies.


title: A correction to a result of Chinburg and Henriksen on powers of integer polynomials

abstract: For a positive integer $k$, let $m(k)$ be the minimum positive integer $m$ such that $mx$ can be written as an integer linear combination of $k$th powers of integer polynomials. We correct an error in a 1976 formula of Chinburg and Henriksen for $m(k)$.


title: Mitigating subjectivity and bias in AI development indices: A robust approach to redefining country rankings

abstract: Countries worldwide have been implementing different actions national strategies for Artificial Intelligence (AI) to shape policy priorities and guide their development concerning AI. Several AI indices have emerged to assess countries' progress in AI development, aiding decision-making on investments and policy choices. Typically, these indices combine multiple indicators using linear additive methods such as weighted sums, although they are limited in their ability to account for interactions among indicators. Another limitation concerns the use of deterministic weights, which can be perceived as subjective and vulnerable to debate and scrutiny, especially by nations that feel disadvantaged. Aiming at mitigating these problems, we conduct a methodological analysis to derive AI indices based on multiple criteria decision analysis. Initially, we assess correlations between different AI dimensions and employ the Choquet integral to model them. Thus, we apply the Stochastic Multicriteria Acceptability Analysis (SMAA) to conduct a sensitivity analysis using both weighted sum and Choquet integral in order to evaluate the stability of the indices with regard the weights. Finally, we introduce a novel ranking methodology based on SMAA, which considers several sets of weights to derive the ranking of countries. As a result, instead of using predefined weights, in the proposed approach, the ranking is achieved based on the probabilities of countries in occupying a specific position. In the computational analysis, we utilize the data employed in The Global AI Index proposed by Tortoise. Results reveal correlations in the data, and our approach effectively mitigates bias. In the sensitivity analysis, we scrutinize changes in the ranking resulting from weight adjustments. We demonstrate that our proposal rankings closely align with those derived from weight variations, proving to be more robust.


title: Role of Fock-space correlations in many-body localization

abstract: Models of many-body localization (MBL) can be represented as tight-binding models in the many-body Hilbert space (Fock space). We explore the role of correlations between matrix elements of the effective Fock-space Hamiltonians in the scaling of MBL critical disorder $W_c(n)$ with the size $n$ of the system. For this purpose, we consider five models, which all have the same distributions of diagonal (energy) and off-diagonal ("hopping") Fock-space matrix elements but different Fock-space correlations. These include quantum-dot (QD) and one-dimensional (1D) MBL models, their modifications (uQD and u1D models) with removed correlations of off-diagonal matrix elements, as well a quantum random energy model (QREM) with no correlations at all. Our numerical results are in full consistency with analytical arguments predicting $n^{3/4} (\ln n)^{-1/4} \lesssim W_c \lesssim n \ln n$ for the scaling of $W_c(n)$ in the QD model (we find $W_c \sim n$ numerically), $W_c(n) \sim \text{const.}$ for the 1D model, $W_c \sim n \ln n$ for the uQD and u1D models without off-diagonal correlations, and $W_c \sim n^{1/2} \ln n$ for QREM. The key difference between the QD and 1D models is in the structure of correlations of many-body energies. Removing off-diagonal Fock-space correlations makes both these models "maximally chaotic". Our findings demonstrate that the scaling of $W_c(n)$ for MBL transitions is governed by a combined effect of Fock-space correlations of diagonal and off-diagonal matrix elements.


title: A Blob Method for Mean Field Control With Terminal Constraints

abstract: In the present work, we develop a novel particle method for a general class of mean field control problems, with source and terminal constraints. Specific examples of the problems we consider include the dynamic formulation of the p-Wasserstein metric, optimal transport around an obstacle, and measure transport subject to acceleration controls. Unlike existing numerical approaches, our particle method is meshfree and does not require global knowledge of an underlying cost function or of the terminal constraint. A key feature of our approach is a novel way of enforcing the terminal constraint via a soft, nonlocal approximation, inspired by recent work on blob methods for diffusion equations. We prove convergence of our particle approximation to solutions of the continuum mean-field control problem in the sense of Gamma-convergence. A byproduct of our result is an extension of existing discrete-to-continuum convergence results for mean field control problems to more general state and measure costs, as arise when modeling transport around obstacles, and more general constraint sets, including controllable linear time invariant systems. Finally, we conclude by implementing our method numerically and using it to compute solutions the example problems discussed above. We conduct a detailed numerical investigation of the convergence properties of our method, as well as its behavior in sampling applications and for approximation of optimal transport maps.

categories: math.OC cs.NA cs.SY eess.SY math.AP math.NA


title: Energy Flux Decomposition in Magnetohydrodynamic Turbulence

abstract: In hydrodynamic (HD) turbulence an exact decomposition of the energy flux across scales has been derived that identifies the contributions associated with vortex stretching and strain self-amplification (P. Johnson, Phys. Rev. Lett., 124, 104501 (2020), J. Fluid Mech. 922, A3 (2021)) to the energy flux across scales. Here we extend this methodology to general coupled advection-diffusion equations, in particular to homogeneous magnetohydrodynamic (MHD) turbulence, and we show that several subfluxes are related to each other by kinematic constraints akin to the Betchov relation in HD. Applied to data from direct numerical simulations, this decomposition allows for an identification of physical processes and for the quantification of their respective contributions to the energy cascade, as well as a quantitative assessment of their multi-scale nature through a further decomposition into single- and multi-scale terms. We find that vortex stretching is strongly depleted in MHD compared to HD, and the kinetic energy is transferred from large to small scales almost exclusively by the generation of regions of small-scale intense strain induced by the Lorentz force. In regions of large strain, current sheets are stretched by large-scale straining motion into regions of magnetic shear. This magnetic shear in turn drives extensional flows at smaller scales. Magnetic energy is transferred from large to small scales, albeit with considerable backscatter, predominantly by the aforementioned current-sheet thinning in region of high strain while the contribution from current-filament stretching - the analogue to vortex stretching - is negligible. Consequences of these results to subgrid-scale turbulence modelling are discussed.


title: Exchangeability, prediction and predictive modeling in Bayesian statistics

abstract: Prediction is a central problem in Statistics, and there is currently a renewed interest for the so-called predictive approach in Bayesian statistics. What is the latter about? One has to return on foundational concepts, which we do in this paper, moving from the role of exchangeability and reviewing forms of partial exchangeability for more structured data, with the aim of discussing their use and implications in Bayesian statistics. There we show the underlying concept that, in Bayesian statistics, a predictive rule is meant as a learning rule - how one conveys past information to information on future events. This concept has implications on the use of exchangeability and generally invests all statistical problems, also in inference. It applies to classic contexts and to less explored situations, such as the use of predictive algorithms that can be read as Bayesian learning rules. The paper offers a historical overview, but also includes a few new results, presents some recent developments and poses some open questions.


title: Nonlinear spiked covariance matrices and signal propagation in deep neural networks

abstract: Many recent works have studied the eigenvalue spectrum of the Conjugate Kernel (CK) defined by the nonlinear feature map of a feedforward neural network. However, existing results only establish weak convergence of the empirical eigenvalue distribution, and fall short of providing precise quantitative characterizations of the ''spike'' eigenvalues and eigenvectors that often capture the low-dimensional signal structure of the learning problem. In this work, we characterize these signal eigenvalues and eigenvectors for a nonlinear version of the spiked covariance model, including the CK as a special case. Using this general result, we give a quantitative description of how spiked eigenstructure in the input data propagates through the hidden layers of a neural network with random weights. As a second application, we study a simple regime of representation learning where the weight matrix develops a rank-one signal component over training and characterize the alignment of the target function with the spike eigenvector of the CK on test data.


title: GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering

abstract: Advancements in 3D Gaussian Splatting have significantly accelerated 3D reconstruction and generation. However, it may require a large number of Gaussians, which creates a substantial memory footprint. This paper introduces GES (Generalized Exponential Splatting), a novel representation that employs Generalized Exponential Function (GEF) to model 3D scenes, requiring far fewer particles to represent a scene and thus significantly outperforming Gaussian Splatting methods in efficiency with a plug-and-play replacement ability for Gaussian-based utilities. GES is validated theoretically and empirically in both principled 1D setup and realistic 3D scenes. It is shown to represent signals with sharp edges more accurately, which are typically challenging for Gaussians due to their inherent low-pass characteristics. Our empirical analysis demonstrates that GEF outperforms Gaussians in fitting natural-occurring signals (e.g. squares, triangles, and parabolic signals), thereby reducing the need for extensive splitting operations that increase the memory footprint of Gaussian Splatting. With the aid of a frequency-modulated loss, GES achieves competitive performance in novel-view synthesis benchmarks while requiring less than half the memory storage of Gaussian Splatting and increasing the rendering speed by up to 39%. The code is available on the project website https://abdullahamdi.com/ges .


title: Holographic covering and the fortuity of black holes

abstract: We propose a classification of BPS states in holographic CFTs into monotone and fortuitous, based on their behaviors in the large $N$ limit. Intuitively, monotone BPS states form infinite sequences with increasing rank $N$, while fortuitous ones exist within finite ranges of consecutive ranks. A precise definition is formulated using supercharge cohomology. We conjecture that under the AdS/CFT correspondence, monotone BPS states are dual to smooth horizonless geometries, and fortuitous ones are responsible for typical black hole microstates and give dominant contributions to the entropy. We present supporting evidence for our conjectures in the ${\cal N}=4$ SYM and symmetric product orbifolds.


title: Is Continual Learning Ready for Real-world Challenges?

abstract: Despite continual learning's long and well-established academic history, its application in real-world scenarios remains rather limited. This paper contends that this gap is attributable to a misalignment between the actual challenges of continual learning and the evaluation protocols in use, rendering proposed solutions ineffective for addressing the complexities of real-world setups. We validate our hypothesis and assess progress to date, using a new 3D semantic segmentation benchmark, OCL-3DSS. We investigate various continual learning schemes from the literature by utilizing more realistic protocols that necessitate online and continual learning for dynamic, real-world scenarios (eg., in robotics and 3D vision applications). The outcomes are sobering: all considered methods perform poorly, significantly deviating from the upper bound of joint offline training. This raises questions about the applicability of existing methods in realistic settings. Our paper aims to initiate a paradigm shift, advocating for the adoption of continual learning methods through new experimental protocols that better emulate real-world conditions to facilitate breakthroughs in the field.


title: A Study of monogenity of Binomial Composition

abstract: Let $\theta$ be a root of a monic polynomial $h(x) \in \Z[x]$ of degree $n \geq 2$. We say $h(x)$ is monogenic if it is irreducible over $\Q$ and $\{ 1, \theta, \theta^2, \ldots, \theta^{n-1} \}$ is a basis for the ring $\Z_K$ of integers of $K = \Q(\theta)$. In this article, we study about the monogenity of number fields generated by a root of composition of two binomials. We characterise all the primes dividing the index of the subgroup $\Z[\theta]$ in $\Z_K$ where $K = \Q(\theta)$ with $\theta$ having minimal polynomial $F(x) = (x^m-b)^n - a \in \Z[x]$, $m\geq 1$ and $n \geq 2$. As an application, we provide a class of pairs of binomials $f(x)=x^n-a$ and $g(x)=x^m-b$ having the property that both $f(x)$ and $f(g(x))$ are monogenic.


title: Quantum option pricing via the Karhunen-Lo\`{e}ve expansion

abstract: We consider the problem of pricing discretely monitored Asian options over $T$ monitoring points where the underlying asset is modeled by a geometric Brownian motion. We provide two quantum algorithms with complexity poly-logarithmic in $T$ and polynomial in $1/\epsilon$, where $\epsilon$ is the additive approximation error. Our algorithms are obtained respectively by using an $O(\log T)$-qubit semi-digital quantum encoding of the Brownian motion that allows for exponentiation of the stochastic process and by analyzing classical Monte Carlo algorithms inspired by the semi-digital encodings. The best quantum algorithm obtained using this approach has complexity $\widetilde{O}(1/\epsilon^{3})$ where the $\widetilde{O}$ suppresses factors poly-logarithmic in $T$ and $1/\epsilon$. The methods proposed in this work generalize to pricing options where the underlying asset price is modeled by a smooth function of a sub-Gaussian process and the payoff is dependent on the weighted time-average of the underlying asset price.


title: Zero-Shot Reasoning: Personalized Content Generation Without the Cold Start Problem

abstract: Procedural content generation uses algorithmic techniques to create large amounts of new content for games at much lower production costs. In newer approaches, procedural content generation utilizes machine learning. However, these methods usually require expensive collection of large amounts of data, as well as the development and training of fairly complex learning models, which can be both extremely time-consuming and expensive. The core of our research is to explore whether we can lower the barrier to the use of personalized procedural content generation through a more practical and generalizable approach with large language models. Matching game content with player preferences benefits both players, who enjoy the game more, and developers, who increasingly depend on players enjoying the game before being able to monetize it. Therefore, this paper presents a novel approach to achieving personalization by using large language models to propose levels based on the gameplay data continuously collected from individual players. We compared the levels generated using our approach with levels generated with more traditional procedural generation techniques. Our easily reproducible method has proven viable in a production setting and outperformed levels generated by traditional methods in the probability that a player will not quit the game mid-level.


title: Drag coefficient for irregularly shaped grains: rotational dependence at high Reynolds numbers

abstract: The nature and behaviour of the drag coefficient of irregularly shaped grains within a wide range of Reynolds numbers is discussed. Using computational fluid dynamics (CFD) tools, the behaviour of the boundary layer at high Re has been determined by applying the Reynolds Averaged Navier-Stokes turbulence model (RANS). The dependence of the mesh size and the grid resolution in the modelling are validated with the previous experimental results applied in flow around isolated smooth spheres. The drag coefficient for irregularly shaped grains is shown to be higher than that for spherical shapes, also showing a strong drop in its value at high Re (drag crisis) but lower than that of the sphere. The influence of the angle of incidence of the flow with respect to the particle is analysed, where our findings show an interesting oscillatory behaviour of the drag coefficient as a function of the angle of incidence, fitting the results to a sine-squared interpolation, predicted for particles within the Stokes' laminar regime and for bodies with an ellipsoidal shape (elongated and flattened spheroids) up to Re=2000. The statistical analysis shows a Weibullian behaviour of the drag coefficient when random polar and azimuthal rotation angles are considered.


title: Benchmarking federated strategies in Peer-to-Peer Federated learning for biomedical data

abstract: The increasing requirements for data protection and privacy has attracted a huge research interest on distributed artificial intelligence and specifically on federated learning, an emerging machine learning approach that allows the construction of a model between several participants who hold their own private data. In the initial proposal of federated learning the architecture was centralised and the aggregation was done with federated averaging, meaning that a central server will orchestrate the federation using the most straightforward averaging strategy. This research is focused on testing different federated strategies in a peer-to-peer environment. The authors propose various aggregation strategies for federated learning, including weighted averaging aggregation, using different factors and strategies based on participant contribution. The strategies are tested with varying data sizes to identify the most robust ones. This research tests the strategies with several biomedical datasets and the results of the experiments show that the accuracy-based weighted average outperforms the classical federated averaging method.


title: Birational complexity and dual complexes

abstract: We introduce the notion of birational complexity of a log Calabi-Yau pair. This invariant measures how far the log Calabi-Yau pair is to being birational to a toric pair. We study fundamental properties of the new invariant, with a particular focus on the geometry of dual complexes.


title: TOAD: Task-Oriented Automatic Dialogs with Diverse Response Styles

abstract: In light of recent advances in large language models (LLMs), the expectations for the next generation of virtual assistants include enhanced naturalness and adaptability across diverse usage scenarios. However, the creation of high-quality annotated data for Task-Oriented Dialog (TOD) is recognized to be slow and costly. To address these challenges, we introduce Task-Oriented Automatic Dialogs (TOAD), a novel and scalable TOD dataset along with its automatic generation pipeline. The TOAD dataset simulates realistic app context interaction and provide a variety of system response style options. Two aspects of system response styles are considered, verbosity level and users' expression mirroring. We benchmark TOAD on two response generation tasks, and the results show that modeling more verbose responses or responses without user expression mirroring is more challenging.


title: Transaction Capacity, Security and Latency in Blockchains

abstract: We analyze how secure a block is after the block becomes k-deep, i.e., security-latency, for Nakamoto consensus under an exponential network delay model. We give parameter regimes for which transactions are safe when sufficiently deep in the chain. We compare our results for Nakamoto consensus under bounded network delay models and obtain analogous bounds for safety violation threshold. Next, modeling the blockchain system as a batch service queue with exponential network delay, we connect the security-latency analysis to sustainable transaction rate of the queue system. As our model assumes exponential network delay, batch service queue models give a meaningful trade-off between transaction capacity, security and latency. As adversary can attack the queue service to hamper the service process, we consider two different attacks for adversary. In an extreme scenario, we modify the selfish-mining attack for this purpose and consider its effect on the sustainable transaction rate of the queue.


title: Fast interpolation and multiplication of unbalanced polynomials

abstract: We consider the classical problems of interpolating a polynomial given a black box for evaluation, and of multiplying two polynomials, in the setting where the bit-lengths of the coefficients may vary widely, so-called unbalanced polynomials. Writing s for the total bit-length and D for the degree, our new algorithms have expected running time $\tilde{O}(s \log D)$, whereas previous methods for (resp.) dense or sparse arithmetic have at least $\tilde{O}(sD)$ or $\tilde{O}(s^2)$ bit complexity.


title: A Case for a Binary Black Hole System Revealed via Quasi-Periodic Outflows

abstract: Binaries containing a compact object orbiting a supermassive black hole are thought to be precursors of gravitational wave events, but their identification has been extremely challenging. Here, we report quasi-periodic variability in X-ray absorption which we interpret as quasi-periodic outflows (QPOuts) from a previously low-luminosity active galactic nucleus after an outburst, likely caused by a stellar tidal disruption. We rule out several models based on observed properties and instead show using general relativistic magnetohydrodynamic simulations that QPOuts, separated by roughly 8.3 days, can be explained with an intermediate-mass black hole secondary on a mildly eccentric orbit at a mean distance of about 100 gravitational radii from the primary. Our work suggests that QPOuts could be a new way to identify intermediate/extreme-mass ratio binary candidates.


title: Linking Through Time: Memory-Enhanced Community Discovery in Temporal Networks

abstract: Temporal Networks, and more specifically, Markovian Temporal Networks, present a unique challenge regarding the community discovery task. The inherent dynamism of these systems requires an intricate understanding of memory effects and structural heterogeneity, which are often key drivers of network evolution. In this study, we address these aspects by introducing an innovative approach to community detection, centered around a novel modularity function. We focus on demonstrating the improvements our new approach brings to a fundamental aspect of community detection: the detectability threshold problem. We show that by associating memory directly with nodes' memberships and considering it in the expression of the modularity, the detectability threshold can be lowered with respect to cases where memory is not considered, thereby enhancing the quality of the communities discovered. To validate our approach, we carry out extensive numerical simulations, assessing the effectiveness of our method in a controlled setting. Furthermore, we apply our method to real-world data to underscore its practicality and robustness. This application not only demonstrates the method's effectiveness but also reveals its capacity to indirectly tackle additional challenges, such as determining the optimal time window for aggregating data in dynamic graphs. This illustrates the method's versatility in addressing complex aspects of temporal network analysis.


title: Tracking Changing Probabilities via Dynamic Learners

abstract: Consider a predictor, a learner, whose input is a stream of discrete items. The predictor's task, at every time point, is probabilistic multiclass prediction, i.e., to predict which item may occur next by outputting zero or more candidate items, each with a probability, after which the actual item is revealed and the predictor learns from this observation. To output probabilities, the predictor keeps track of the proportions of the items it has seen. The stream is unbounded and the predictor has finite limited space and we seek efficient prediction and update techniques: the set of items is unknown to the predictor and their totality can also grow unbounded. Moreover, there is non-stationarity: the underlying frequencies of items may change, substantially, from time to time. For instance, new items may start appearing and a few recently frequent items may cease to occur again. The predictor, being space-bounded, need only provide probabilities for those items with (currently) sufficiently high frequency, i.e., the salient items. This problem is motivated in the setting of prediction games, a self-supervised learning regime where concepts serve as both the predictors and the predictands, and the set of concepts grows over time, resulting in non-stationarities as new concepts are generated and used. We develop sparse multiclass moving average techniques designed to respond to such non-stationarities in a timely manner. One technique is based on the exponentiated moving average (EMA) and another is based on queuing a few count snapshots. We show that the combination, and in particular supporting dynamic predictand-specific learning rates, offers advantages in terms of faster change detection and convergence.


title: Emergent topological quasiparticle kinetics in constricted nanomagnets

abstract: The ubiquitous domain wall kinetics under magnetic field or current application describes the dynamic properties in nanostructured magnets. However, when the geometrical size of a nanomagnetic system is constricted to the limiting domain wall length scale, the competing energetics between anisotropy, exchange and dipolar interactions can cause emergent kinetics due to quasiparticle relaxation, similar to bulk magnets of atomic origin. Here, we present a joint experimental and theoretical study to support this argument -- constricted nanomagnets, made of antiferromagnetic and paramagnetic neodymium thin film with honeycomb motif, reveal fast kinetic events at ps time scales due to the relaxation of chiral vortex loop-shaped topological quasiparticles that persist to low temperature in the absence of any external stimuli. Such phenomena are typically found in macroscopic magnetic materials. Our discovery is especially important considering the fact that paramagnets or antiferromagnets have no net magnetization. Yet, the kinetics in neodymium nanostructures is quantitatively similar to that found in ferromagnetic counterparts and only varies with the thickness of the specimen. This suggests that a universal, topological quasiparticle mediated dynamical behavior can be prevalent in nanoscopic magnets, irrespective of the nature of underlying magnetic material.


title: A unified quantification of synchrony in globally coupled populations with the Wiener order parameter

abstract: We tackle the quantification of synchrony in globally coupled populations. Furthermore, we treat the problem of incomplete observations when the population mean field is unavailable, but only a small subset of units is observed. We introduce a new order parameter and demonstrate its efficiency for quantifying synchrony via monitoring general observables, regardless of whether the oscillations can be characterized in terms of the phases. Under condition of a significant irregularity in the dynamics of the coupled units, this order parameter provides a unified description of synchrony in populations of units of various complexity. The main examples include noise-induced oscillations, coupled strongly chaotic systems, and noisy periodic oscillations. Furthermore, we explore how this parameter works for the standard Kuramoto model of coupled regular phase oscillators. The most significant advantage of our approach is its ability to infer and quantify synchrony from the observation of a small percentage of the units and even from a single unit, provided the observations are sufficiently long.


title: A chaotic maps-based privacy-preserving distributed deep learning for incomplete and Non-IID datasets

abstract: Federated Learning is a machine learning approach that enables the training of a deep learning model among several participants with sensitive data that wish to share their own knowledge without compromising the privacy of their data. In this research, the authors employ a secured Federated Learning method with an additional layer of privacy and proposes a method for addressing the non-IID challenge. Moreover, differential privacy is compared with chaotic-based encryption as layer of privacy. The experimental approach assesses the performance of the federated deep learning model with differential privacy using both IID and non-IID data. In each experiment, the Federated Learning process improves the average performance metrics of the deep neural network, even in the case of non-IID data.


title: Optimizing Temporal Waveform Analysis: A Novel Pipeline for Efficient Characterization of Left Coronary Artery Velocity Profiles

abstract: Continuously measured arterial blood velocity can provide insight into physiological parameters and potential disease states. The efficient and effective description of the temporal profiles of arterial velocity is crucial for both clinical practice and research. We propose a pipeline to identify the minimum number of points of interest to adequately describe a velocity profile of the left coronary artery. This pipeline employs a novel operation that "stretches" a baseline waveform to quantify the utility of a point in fitting other waveforms. Our study introduces a comprehensive pipeline specifically designed to identify the minimal yet crucial number of points needed to accurately represent the velocity profile of the left coronary artery. Additionally, the only location-dependent portion of this pipeline is the first step, choosing all of the possible points of interest. Hence, this work is broadly applicable to other waveforms. This versatility paves the way for a novel non-frequency domain method that can enhance the analysis of physiological waveforms. Such advancements have potential implications in both research and clinical treatment of various diseases, underscoring the broader applicability and impact.


title: Thermodynamically Stable Knots in Semiflexible Polymers

abstract: Semiflexible polymers are widely used as a paradigm for understanding structural phases in biomolecules including folding of proteins. Here, we compare bead-spring and bead-stick variants of coarse-grained semiflexible polymer models that cover the whole range from flexible to stiff by conducting extensive replica-exchange Monte Carlo computer simulations. In the data analysis we focus on knotted conformations whose stability is shown to depend on the ratio $r_b/r_{\rm min}$ with $r_b$ denoting the equilibrium bond length and $r_{\rm min}$ the distance of the strongest nonbonded interactions. For both models, our results provide evidence that at low temperatures for $r_b/r_{\rm min}$ outside a small range around unity one always encounters knots as generic stable phases along with the usual frozen and bent-like structures. By varying the bending stiffness, we observe rather strong first-order-like structural transitions between the coexisting phases characterized by these geometrically different motifs. Through analyses of the energy distributions close to the transition point, we present exploratory estimates of the free-energy barriers between the coexisting phases.


title: Tracer dynamics in polymer networks: generalized Langevin description

abstract: Tracer diffusion in polymer networks and hydrogels is relevant in biology and technology, while it also constitutes an interesting model process for the dynamics of molecules in fluctuating, heterogeneous soft matter. Here, we study systematically the time-dependent dynamics and (non-Markovian) memory effects of tracers in polymer networks based on (Markovian) implicit-solvent Langevin simulations. In particular, we consider spherical tracer solutes at high dilution in regular, tetrafunctional bead-spring polymer networks, and control the tracer-network Lennard-Jones (LJ) interactions and the polymer density. Based on the analysis of the memory (friction) kernels, we recover the expected long-time transport coefficients, and demonstrate how the short-time tracer dynamics, polymer fluctuations, and the viscoelastic response are interlinked. Further, we fit the characteristic memory modes of the tracers with damped harmonic oscillations and identify LJ contributions, bond vibrations, and slow network relaxations, which enter the kernel with an almost linear scaling with the LJ attractions. This procedure proposes a reduced functional form for the tracer memory, allowing for a convenient inter- and extrapolation of the memory kernels. This leads eventually to highly efficient simulations utilizing the generalized Langevin equation (GLE), in which the polymer network acts as an additional thermal bath with tuneable intensity.


title: Reconstruction of Short-Lived Particles using Graph-Hypergraph Representation Learning

abstract: In collider experiments, the kinematic reconstruction of heavy, short-lived particles is vital for precision tests of the Standard Model and in searches for physics beyond it. Performing kinematic reconstruction in collider events with many final-state jets, such as the all-hadronic decay of topantitop quark pairs, is challenging. We present HyPER, a graph neural network that uses blended graph-hypergraph representation learning to reconstruct parent particles from sets of final-state objects. HyPER is tested on simulation and shown to perform favorably when compared to existing state-of-the-art reconstruction techniques, while demonstrating superior parameter efficiency. The novel hypergraph approach allows the method to be applied to particle reconstruction in a multitude of different physics processes.


title: $f$-MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning

abstract: In self-supervised contrastive learning, a widely-adopted objective function is InfoNCE, which uses the heuristic cosine similarity for the representation comparison, and is closely related to maximizing the Kullback-Leibler (KL)-based mutual information. In this paper, we aim at answering two intriguing questions: (1) Can we go beyond the KL-based objective? (2) Besides the popular cosine similarity, can we design a better similarity function? We provide answers to both questions by generalizing the KL-based mutual information to the $f$-Mutual Information in Contrastive Learning ($f$-MICL) using the $f$-divergences. To answer the first question, we provide a wide range of $f$-MICL objectives which share the nice properties of InfoNCE (e.g., alignment and uniformity), and meanwhile result in similar or even superior performance. For the second question, assuming that the joint feature distribution is proportional to the Gaussian kernel, we derive an $f$-Gaussian similarity with better interpretability and empirical performance. Finally, we identify close relationships between the $f$-MICL objective and several popular InfoNCE-based objectives. Using benchmark tasks from both vision and natural language, we empirically evaluate $f$-MICL with different $f$-divergences on various architectures (SimCLR, MoCo, and MoCo v3) and datasets. We observe that $f$-MICL generally outperforms the benchmarks and the best-performing $f$-divergence is task and dataset dependent.


title: ControlLM: Crafting Diverse Personalities for Language Models

abstract: As language models continue to scale in size and capability, they display an array of emerging behaviors, both beneficial and concerning. This heightens the need to control model behaviors. We hope to be able to control the personality traits of language models at the inference-time so as to have various character features, on top of which the requirements of different types of tasks can be met. Personality is a higher-level and more abstract behavioral representation for language models. We introduce ControlLM, which leverages differential activation patterns, derived from contrasting behavioral prompts in the model's latent space, to influence the model's personality traits at inference. This approach allows for the precise, real-time adjustment of model behavior. First, we demonstrate ControlLM's capacity to elicit diverse persona behaviors without any training, while precision control allows personality traits to closely match average human values. Subsequently, we showcase improved reasoning and question answering through selective amplification of beneficial attributes like conscientiousness and friendliness. We hope that this work will inspire research on controlling human-like behaviors of language models and provide insights for future research. Our code is publicly available at: https://github.com/wengsyx/ControlLM.


title: A new type of simplified inverse Lax-Wendroff boundary treatment I: hyperbolic conservation laws

abstract: In this paper, we design a new kind of high order inverse Lax-Wendroff (ILW) boundary treatment for solving hyperbolic conservation laws with finite difference method on a Cartesian mesh. This new ILW method decomposes the construction of ghost point values near inflow boundary into two steps: interpolation and extrapolation. At first, we impose values of some artificial auxiliary points through a polynomial interpolating the interior points near the boundary. Then, we will construct a Hermite extrapolation based on those auxiliary point values and the spatial derivatives at boundary obtained via the ILW procedure. This polynomial will give us the approximation to the ghost point value. By an appropriate selection of those artificial auxiliary points, high-order accuracy and stable results can be achieved. Moreover, theoretical analysis indicates that comparing with the original ILW method, especially for higher order accuracy, the new proposed one would require fewer terms using the relatively complicated ILW procedure and thus improve computational efficiency on the premise of maintaining accuracy and stability. We perform numerical experiments on several benchmarks, including one- and two-dimensional scalar equations and systems. The robustness and efficiency of the proposed scheme is numerically verified.


title: Knowledge-Infused LLM-Powered Conversational Health Agent: A Case Study for Diabetes Patients

abstract: Effective diabetes management is crucial for maintaining health in diabetic patients. Large Language Models (LLMs) have opened new avenues for diabetes management, facilitating their efficacy. However, current LLM-based approaches are limited by their dependence on general sources and lack of integration with domain-specific knowledge, leading to inaccurate responses. In this paper, we propose a knowledge-infused LLM-powered conversational health agent (CHA) for diabetic patients. We customize and leverage the open-source openCHA framework, enhancing our CHA with external knowledge and analytical capabilities. This integration involves two key components: 1) incorporating the American Diabetes Association dietary guidelines and the Nutritionix information and 2) deploying analytical tools that enable nutritional intake calculation and comparison with the guidelines. We compare the proposed CHA with GPT4. Our evaluation includes 100 diabetes-related questions on daily meal choices and assessing the potential risks associated with the suggested diet. Our findings show that the proposed agent demonstrates superior performance in generating responses to manage essential nutrients.


title: The Generalized Riemann Zeta heat flow

abstract: We consider the PDE flow associated to Riemann zeta and general Dirichlet $L$-functions. These are models characterized by nonlinearities appearing in classical number theory problems, and generalizing the classical holomorphic Riemann flow studied by Broughan and Barnett. Each zero of a Dirichlet $L$-function is an exact solution of the model. In this paper, we first show local existence of bounded continuous solutions in the Duhamel sense to any Dirichlet $L$-function flow with initial condition far from the pole (as long as this exists). In a second result, we prove global existence in the case of nonlinearities of the form Dirichlet $L$-functions and data initially on the right of a possible pole. Additional global well-posedness and convergence results are proved in the case of the defocusing Riemann zeta nonlinearity and initial data located on the real line and close to the trivial zeros of the zeta. The asymptotic stability of any stable zero is also proved. Finally, in the Riemann zeta case, we consider the ``focusing'' model, and prove blow-up of solutions near the pole $s=1$.


title: Understanding and tuning magnetism in layered Ising-type antiferromagnet FePSe3 for potential 2D magnet

abstract: Recent development in two-dimensional (2D) magnetic materials have motivated the search for new van der Waals magnetic materials, especially Ising-type magnets with strong magnetic anisotropy. Fe-based MPX3 (M = transition metal, X = chalcogen) compounds such as FePS3 and FePSe3 both exhibit an Ising-type magnetic order, but FePSe3 receives much less attention compared to FePS3. This work focuses on establishing the strategy to engineer magnetic anisotropy and exchange interactions in this less-explored compound. Through chalcogen and metal substitutions, the magnetic anisotropy is found to be immune against S substitution for Se whereas tunable only with heavy Mn substitution for Fe. In particular, Mn substitution leads to a continuous rotation of magnetic moments from the out-of-plane direction towards in-plane. Furthermore, the magnetic ordering temperature displays non-monotonic doping dependence for both chalcogen and metal substitutions but due to different mechanisms. These findings provide deeper insight into the Ising-type magnetism in this important van der Waals material, shedding light on the study of other Ising-type magnetic systems as well as discovering novel 2D magnets for potential applications in spintronics.


title: Empirically assessing the plausibility of unconfoundedness in observational studies

abstract: The possibility of unmeasured confounding is one of the main limitations for causal inference from observational studies. There are different methods for partially empirically assessing the plausibility of unconfoundedness. However, most currently available methods require (at least partial) assumptions about the confounding structure, which may be difficult to know in practice. In this paper we describe a simple strategy for empirically assessing the plausibility of conditional unconfoundedness (i.e., whether the candidate set of covariates suffices for confounding adjustment) which does not require any assumptions about the confounding structure, requiring instead assumptions related to temporal ordering between covariates, exposure and outcome (which can be guaranteed by design), measurement error and selection into the study. The proposed method essentially relies on testing the association between a subset of covariates (those associated with the exposure given all other covariates) and the outcome conditional on the remaining covariates and the exposure. We describe the assumptions underlying the method, provide proofs, use simulations to corroborate the theory and illustrate the method with an applied example assessing the causal effect of length-for-age measured in childhood and intelligence quotient measured in adulthood using data from the 1982 Pelotas (Brazil) birth cohort. We also discuss the implications of measurement error and some important limitations.


title: Revisiting Stochastic Realization Theory using Functional It\^o Calculus

abstract: This paper considers the problem of constructing finite-dimensional state space realizations for stochastic processes that can be represented as the outputs of a certain type of a causal system driven by a continuous semimartingale input process. The main assumption is that the output process is infinitely differentiable, where the notion of differentiability comes from the functional It\^o calculus introduced by Dupire as a causal (nonanticipative) counterpart to Malliavin's stochastic calculus of variations. The proposed approach builds on the ideas of Hijab, who had considered the case of processes driven by a Brownian motion, and makes contact with the realization theory of deterministic systems based on formal power series and Chen-Fliess functional expansions.


title: InfoNet: Neural Estimation of Mutual Information without Test-Time Optimization

abstract: Estimating mutual correlations between random variables or data streams is essential for intelligent behavior and decision-making. As a fundamental quantity for measuring statistical relationships, mutual information has been extensively studied and utilized for its generality and equitability. However, existing methods often lack the efficiency needed for real-time applications, such as test-time optimization of a neural network, or the differentiability required for end-to-end learning, like histograms. We introduce a neural network called InfoNet, which directly outputs mutual information estimations of data streams by leveraging the attention mechanism and the computational efficiency of deep learning infrastructures. By maximizing a dual formulation of mutual information through large-scale simulated training, our approach circumvents time-consuming test-time optimization and offers generalization ability. We evaluate the effectiveness and generalization of our proposed mutual information estimation scheme on various families of distributions and applications. Our results demonstrate that InfoNet and its training process provide a graceful efficiency-accuracy trade-off and order-preserving properties. We will make the code and models available as a comprehensive toolbox to facilitate studies in different fields requiring real-time mutual information estimation.


title: The double low-mass white dwarf eclipsing binary system J2102-4145 and its possible evolution

abstract: Approximately 150 low-mass white dwarfs, with masses below 0.4Msun, have been discovered. The majority of these low-mass WDs are observed in binary systems as they cannot be formed through single-star evolution within the Hubble time. In this study, we present a comprehensive analysis of the double low-mass WD eclipsing binary system J2102-4145. Our investigation involved an extensive observational campaign, resulting in the acquisition of approximately 28 hours of high-speed photometric data across multiple nights using NTT/ULTRACAM, SOAR/Goodman, and SMARTS-1m telescopes. These observations have provided critical insights into the orbital characteristics of this system, including parameters such as inclination and orbital period. To disentangle the binary components of J2102-4145, we employed the XT GRID spectral fitting method with GMOS/Gemini-South and X-Shooter data. Additionally, we used the PHOEBE package for light curve analysis on NTT/ULTRACAM high-speed time-series photometry data to constrain the binary star properties. Our analysis reveals remarkable similarities between the two components of this binary system. For the primary star, we determined Teff1 = 13688 +- 65 K, log g1 = 7.36 +- 0.01, R1 = 0.0211 +- 0.0002 Rsun, and M1 = 0.375 +- 0.003 Msun, while the secondary star is characterized by Teff2 = 12952 +- 53 K, log g2 = 7.32 +- 0.01, R2 = 0.0203 +- 0.0002 Rsun, and M2 = 0.31 +- 0.003 Msun. Furthermore, we observe a notable discrepancy between Teff and R of the less massive WD compared to evolutionary sequences for WDs from the literature, which has significant implications for our understanding of WD evolution. We discuss a potential formation scenario for this system that might explain this discrepancy and explore its future evolution. We predict that this system will merge in about 800 Myr, evolving into a helium-rich hot subdwarf star and later into a hybrid He/CO WD.


title: Squark production with R-symmetry beyond NLO at the LHC

abstract: The Minimal R-symmetric Supersymmetric Standard Model (MRSSM) provides a realisation of supersymmetry in which the parameter space is less constrained by the current LHC data than in the simplest supersymmetric scenarios. In the present paper, we obtain the most precise theoretical predictions in the MRSSM for squark production at the LHC, enabling accurate interpretations of LHC data in terms of the MRSSM. We perform threshold resummation of soft gluon corrections to the total cross sections for the production of squark-(anti)squark pairs at the LHC in the MRSSM framework. The resummation is carried out using the direct QCD method and reaches the next-to-next-to-leading-logarithmic (NNLL) accuracy, which requires calculating the one-loop matching coefficients in the relevant production channels. The resummed cross sections are then matched to the available NLO results and evaluated for $\sqrt{S}=13.6$ TeV. Compared with the Minimal Supersymmetric Standard Model (MSSM), the cross sections in the MRSSM can be significantly reduced, implying less stringent limits on squark and gluino masses. Our results carry significant implications for exploring the viability of supersymmetry at the LHC. The results of our calculation are publicly available as a numerical package.


title: Robotic Exploration using Generalized Behavioral Entropy

abstract: This work presents and evaluates a novel strategy for robotic exploration that leverages human models of uncertainty perception. To do this, we introduce a measure of uncertainty that we term ``Behavioral entropy'', which builds on Prelec's probability weighting from Behavioral Economics. We show that the new operator is an admissible generalized entropy, analyze its theoretical properties and compare it with other common formulations such as Shannon's and Renyi's. In particular, we discuss how the new formulation is more expressive in the sense of measures of sensitivity and perceptiveness to uncertainty introduced here. Then we use Behavioral entropy to define a new type of utility function that can guide a frontier-based environment exploration process. The approach's benefits are illustrated and compared in a Proof-of-Concept and ROS-unity simulation environment with a Clearpath Warthog robot. We show that the robot equipped with Behavioral entropy explores faster than Shannon and Renyi entropies.


title: Semi-classical dilaton gravity and the very blunt defect expansion

abstract: We explore dilaton gravity with general dilaton potentials in the semi-classical limit viewed both as a gas of blunt defects and also as a semi-classical theory in its own right. We compare the exact defect gas picture with that obtained by naively canonically quantizing the theory in geodesic gauge. We find a subtlety in the canonical approach due to a non-perturbative ambiguity in geodesic gauge. Unlike in JT gravity, this ambiguity arises already at the disk level. This leads to a distinct mechanism from that in JT gravity by which the semi-classical approximation breaks down at low temperatures. Along the way, we propose that new, previously un-studied saddles contribute to the density of states of dilaton gravity. This in particular leads to a re-interpretation of the disk-level density of states in JT gravity in terms of two saddles with fixed energy boundary conditions: the disk, which caps off on the outer horizon, and another, sub-leading complex saddle which caps off on the inner horizon. When the theory is studied using a defect expansion, we show how the smooth classical geometries of dilaton gravity arise from a dense gas of very blunt defects in the $G_N \to 0$ limit. The classical saddle points arise from a balance between the attractive force on the defects toward negative dilaton and a statistical pressure from the entropy of the configuration. We end with speculations on the nature of the space-like singularity present inside black holes described by certain dilaton potentials.


title: Hidden Traveling Waves bind Working Memory Variables in Recurrent Neural Networks

abstract: Traveling waves are a fundamental phenomenon in the brain, playing a crucial role in short-term information storage. In this study, we leverage the concept of traveling wave dynamics within a neural lattice to formulate a theoretical model of neural working memory, study its properties, and its real world implications in AI. The proposed model diverges from traditional approaches, which assume information storage in static, register-like locations updated by interference. Instead, the model stores data as waves that is updated by the wave's boundary conditions. We rigorously examine the model's capabilities in representing and learning state histories, which are vital for learning history-dependent dynamical systems. The findings reveal that the model reliably stores external information and enhances the learning process by addressing the diminishing gradient problem. To understand the model's real-world applicability, we explore two cases: linear boundary condition (LBC) and non-linear, self-attention-driven boundary condition (SBC). The model with the linear boundary condition results in a shift matrix plus low-rank matrix currently used in H3 state space RNN. Further, our experiments with LBC reveal that this matrix is effectively learned by Recurrent Neural Networks (RNNs) through backpropagation when modeling history-dependent dynamical systems. Conversely, the SBC parallels the autoregressive loop of an attention-only transformer with the context vector representing the wave substrate. Collectively, our findings suggest the broader relevance of traveling waves in AI and its potential in advancing neural network architectures.


title: Random features and polynomial rules

abstract: Random features models play a distinguished role in the theory of deep learning, describing the behavior of neural networks close to their infinite-width limit. In this work, we present a thorough analysis of the generalization performance of random features models for generic supervised learning problems with Gaussian data. Our approach, built with tools from the statistical mechanics of disordered systems, maps the random features model to an equivalent polynomial model, and allows us to plot average generalization curves as functions of the two main control parameters of the problem: the number of random features $N$ and the size $P$ of the training set, both assumed to scale as powers in the input dimension $D$. Our results extend the case of proportional scaling between $N$, $P$ and $D$. They are in accordance with rigorous bounds known for certain particular learning tasks and are in quantitative agreement with numerical experiments performed over many order of magnitudes of $N$ and $P$. We find good agreement also far from the asymptotic limits where $D\to \infty$ and at least one between $P/D^K$, $N/D^L$ remains finite.


title: Marked length spectrum rigidity in groups with contracting elements

abstract: This paper presents a study of the well-known marked length spectrum rigidity problem in the coarse-geometric setting. For any two (possibly non-proper) group actions $G\curvearrowright X_1$ and $G\curvearrowright X_2$ with contracting property, we prove that if the two actions have the same marked length spectrum, then the orbit map $Go_1\to Go_2$ must be a rough isometry. In the special case of cusp-uniform actions, the rough isometry can be extended to the entire space. This generalizes the existing results in hyperbolic groups and relatively hyperbolic groups. In addition, we prove a finer marked length spectrum rigidity from confined subgroups and further, geometrically dense subgroups. Our proof is based on the Extension Lemma and uses purely elementary metric geometry. This study produces new results and recovers existing ones for many more interesting groups through a unified and elementary approach.


title: Accuracy of discrete- and continuous-time mean-field theories for epidemic processes on complex networks

abstract: Discrete- and continuous-time approaches are frequently used to model the role of heterogeneity on dynamical interacting agents on the top of complex networks. While, on the one hand, one does not expect drastic differences between these approaches, and the choice is usually based on one's expertise or methodological convenience, on the other hand, a detailed analysis of the differences is necessary to guide the proper choice of one or another approach. We tackle this problem, by comparing both discrete- and continuous-time mean-field theories for the susceptible-infected-susceptible (SIS) epidemic model on random networks with power-law degree distributions. We compare the discrete epidemic link equations (ELE) and continuous pair quenched mean-field (PQMF) theories with the corresponding stochastic simulations, both theories that reckon pairwise interactions explicitly. We show that ELE converges to PQMF theory when the time step goes to zero. The epidemic localization analysis performed reckoning the inverse participation ratio (IPR) indicates that both theories present the same localization depence on the network degree exponent $\gamma$: for $\gamma<5/2$ the epidemic is localized on the maximum k-core of network with a vanishing in the infinite-size limit while for $\gamma>5/2$, the localization happens on hubs what leads to a finite value of IPR. However, the IPR and epidemic threshold of ELE depend on the time-step discretization such that a larger time-step leads to more localized epidemics. A remarkable difference between discrete and continuous time approaches is revealed in the epidemic prevalence near the epidemic threshold, in which the discrete-time stochastic simulations indicate a mean-field critical exponent $\theta=1$ instead of the value $\theta=1/(3-\gamma)$ obtained rigorously and verified numerically for the continuous-time SIS on the same networks.


title: A geometrical interpretation of critical exponents

abstract: We develop the hypothesis that the dynamics of a given system may lead to the activity being constricted to a subset of space, characterized by a fractal dimension smaller than the space dimension. We also address how the response function might be sensitive to this change in dimensionality. We discuss how this phenomenon is observable in growth processes and near critical points for systems in equilibrium. In particular, we determine the fractal dimension $d_f$ for the Ising model and validate it via computer simulations for two dimensions.


title: DeepSRGM -- Sequence Classification and Ranking in Indian Classical Music with Deep Learning

abstract: A vital aspect of Indian Classical Music (ICM) is Raga, which serves as a melodic framework for compositions and improvisations alike. Raga Recognition is an important music information retrieval task in ICM as it can aid numerous downstream applications ranging from music recommendations to organizing huge music collections. In this work, we propose a deep learning based approach to Raga recognition. Our approach employs efficient pre possessing and learns temporal sequences in music data using Long Short Term Memory based Recurrent Neural Networks (LSTM-RNN). We train and test the network on smaller sequences sampled from the original audio while the final inference is performed on the audio as a whole. Our method achieves an accuracy of 88.1% and 97 % during inference on the Comp Music Carnatic dataset and its 10 Raga subset respectively making it the state-of-the-art for the Raga recognition task. Our approach also enables sequence ranking which aids us in retrieving melodic patterns from a given music data base that are closely related to the presented query sequence.


title: Curves of growth for transiting exocomets: Application to Fe II lines in the Beta Pictoris system

abstract: This study introduces the exocomet curve of growth, a new method to analyse the variable absorptions observed in $\beta$ Pictoris spectrum and link them to the physical properties of the transiting cometary tails. We show that the absorption depth of a comet in a set of lines arising from similar excitation levels of a given chemical species follows a simple curve as a function of the gf-values of the lines. This curve is the analogue of the curve of growth for interstellar absorption lines, where equivalent widths are replaced by absorption depths. To fit this exocomet curve of growth, we introduce a model where the cometary absorption is produced by a homogeneous cloud, covering a limited fraction of the stellar disc. This model is defined by two parameters: $\alpha$, the covering factor of the cloud, and $\beta$, related to its typical the optical depth. This model is tested on two comets observed with the Hubble Space Telescope in December 1997 and October 2018, in a set of Fe II lines at 275 nm. The measured absorption depths are found to satisfactory match the two-parameter curve of growth model, indicating that both comets cover roughly 40 % of the stellar disc ($\alpha=0.4$) and have optical thicknesses close to unity. Then, we show that if we consider a set of lines arising from a wider range of energy levels, the absorbing species seems to be populated at thermodynamical equilibrium, causing the cometary absorption to follow a curve of growth as a function of $gf \cdot e^{-E_l/k_B T}$ (where T is the temperature of the absorbing medium). For the comet observed on December 6, 1997, we derive a temperature of $10500\pm500$ K and a total Fe II column density of $(1.11\pm0.09)\times10^{15}$ cm$^{-2}$. By probing the population of the highest excited energy levels ($E_l\sim25000$ cm$^{-1}$), we also estimate an electronic density of $(3\pm1)\times10^{7}$ cm$^{-3}$.


title: The property $(E_A)$ and local spectral theory

abstract: In this paper, we introduce and study the spectral property $(E_A)$. This property means that the difference between the approximate point spectrum and the upper semi-Fredholm spectrum coincides with the difference between the approximate point spectrum and the upper semi-Weyl spectrum. Together with local spectral theory, we explore the behavior of this property under certain topological conditions and derive characterizations for the operators that verify it. Furthermore, we establish sufficient conditions that guarantee that a bounded linear operator verifies the property $(E_A)$.


title: Data Engineering for Scaling Language Models to 128K Context

abstract: We study the continual pretraining recipe for scaling language models' context lengths to 128K, with a focus on data engineering. We hypothesize that long context modeling, in particular \textit{the ability to utilize information at arbitrary input locations}, is a capability that is mostly already acquired through large-scale pretraining, and that this capability can be readily extended to contexts substantially longer than seen during training~(e.g., 4K to 128K) through lightweight continual pretraining on appropriate data mixture. We investigate the \textit{quantity} and \textit{quality} of the data for continual pretraining: (1) for quantity, we show that 500 million to 5 billion tokens are enough to enable the model to retrieve information anywhere within the 128K context; (2) for quality, our results equally emphasize \textit{domain balance} and \textit{length upsampling}. Concretely, we find that naively upsampling longer data on certain domains like books, a common practice of existing work, gives suboptimal performance, and that a balanced domain mixture is important. We demonstrate that continual pretraining of the full model on 1B-5B tokens of such data is an effective and affordable strategy for scaling the context length of language models to 128K. Our recipe outperforms strong open-source long-context models and closes the gap to frontier models like GPT-4 128K.


title: OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Models

abstract: Optimization problems are pervasive in sectors from manufacturing and distribution to healthcare. However, most such problems are still solved heuristically by hand rather than optimally by state-of-the-art solvers because the expertise required to formulate and solve these problems limits the widespread adoption of optimization tools and techniques. This paper introduces OptiMUS, a Large Language Model (LLM)-based agent designed to formulate and solve (mixed integer) linear programming problems from their natural language descriptions. OptiMUS can develop mathematical models, write and debug solver code, evaluate the generated solutions, and improve its model and code based on these evaluations. OptiMUS utilizes a modular structure to process problems, allowing it to handle problems with long descriptions and complex data without long prompts. Experiments demonstrate that OptiMUS outperforms existing state-of-the-art methods on easy datasets by more than $20\%$ and on hard datasets (including a new dataset, NLP4LP, released with this paper that features long and complex problems) by more than $30\%$.


title: Universal Quantum Computing with Field-Mediated Unruh--DeWitt Qubits

abstract: A set of universal quantum gates is a vital part of the theory of quantum computing, but is absent in the developing theory of Relativistic Quantum Information (RQI). Yet, the Unruh--DeWitt (UDW) detector formalism can be elevated to unitary gates between qubits and quantum fields and has allowed RQI applications in quantum Shannon theory, such as mutual information, coherent information, and quantum capacity in field-mediated quantum channels. Recently, experimental realizations of UDW-style qubits have been proposed in two-dimensional quantum materials, but their value as a quantum technology, including quantum communication and computation, is not yet clear, especially since fields introduce many avenues for decoherence. We introduce controlled-unitary UDW logic gates between qubit and field that are comparable to the two-qubit CNOT gate. We then extend this formalism to demonstrate Quantum State Transfer (QST) (two CNOT gates) and SWAP (three CNOT gates) channels. We illustrate the performance of these quantum operation gates with the diamond distance, a measure of distinguishability between quantum channels. Distinguishability measures like diamond distance allow for a rigorous comparison between field-mediated transduction through UDW detectors and local quantum mechanical operations and so quantify the performance of UDW detectors in quantum technological applications. Using the controlled-unitary qubit-field interactions we define an exact form of the CNOT gate. With this technique we also define quantum field-mediated single qubit operations associated with the Hadamard $H$, the $S$, and $T$ gates. Thus, UDW detectors in simple settings enable a collection of gates known to provide universal quantum computing.


title: Overapproximation of Non-Linear Integer Arithmetic for Smart Contract Verification

abstract: The need to solve non-linear arithmetic constraints presents a major obstacle to the automatic verification of smart contracts. In this case study we focus on the two overapproximation techniques used by the industry verification tool Certora Prover: overapproximation of non-linear integer arithmetic using linear integer arithmetic and using non-linear real arithmetic. We compare the performance of contemporary SMT solvers on verification conditions produced by the Certora Prover using these two approximations against the natural non-linear integer arithmetic encoding. Our evaluation shows that the use of the overapproximation methods leads to solving a significant number of new problems.


title: Unlocking Structure Measuring: Introducing PDD, an Automatic Metric for Positional Discourse Coherence

abstract: Recent large language models (LLMs) have shown remarkable performance in aligning generated text with user intentions across various tasks. When it comes to long-form text generation, there has been a growing interest in generation from a discourse coherence perspective. However, existing lexical or semantic metrics such as BLEU, ROUGE, BertScore cannot effectively capture the discourse coherence. The development of discourse-specific automatic evaluation methods for assessing the output of LLMs warrants greater focus and exploration. In this paper, we present a novel automatic metric designed to quantify the discourse divergence between two long-form articles. Extensive experiments on three datasets from representative domains demonstrate that our metric aligns more closely with human preferences and GPT-4 coherence evaluation, outperforming existing evaluation methods.


title: OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset

abstract: Recent work has shown the immense potential of synthetically generated datasets for training large language models (LLMs), especially for acquiring targeted skills. Current large-scale math instruction tuning datasets such as MetaMathQA (Yu et al., 2024) and MAmmoTH (Yue et al., 2024) are constructed using outputs from closed-source LLMs with commercially restrictive licenses. A key reason limiting the use of open-source LLMs in these data generation pipelines has been the wide gap between the mathematical skills of the best closed-source LLMs, such as GPT-4, and the best open-source LLMs. Building on the recent progress in open-source LLMs, our proposed prompting novelty, and some brute-force scaling, we construct OpenMathInstruct-1, a math instruction tuning dataset with 1.8M problem-solution pairs. The dataset is constructed by synthesizing code-interpreter solutions for GSM8K and MATH, two popular math reasoning benchmarks, using the recently released and permissively licensed Mixtral model. Our best model, OpenMath-CodeLlama-70B, trained on a subset of OpenMathInstruct-1, achieves a score of 84.6% on GSM8K and 50.7% on MATH, which is competitive with the best gpt-distilled models. We release our code, models, and the OpenMathInstruct-1 dataset under a commercially permissive license.


title: Large Scale Constrained Clustering With Reinforcement Learning

abstract: Given a network, allocating resources at clusters level, rather than at each node, enhances efficiency in resource allocation and usage. In this paper, we study the problem of finding fully connected disjoint clusters to minimize the intra-cluster distances and maximize the number of nodes assigned to the clusters, while also ensuring that no two nodes within a cluster exceed a threshold distance. While the problem can easily be formulated using a binary linear model, traditional combinatorial optimization solvers struggle when dealing with large-scale instances. We propose an approach to solve this constrained clustering problem via reinforcement learning. Our method involves training an agent to generate both feasible and (near) optimal solutions. The agent learns problem-specific heuristics, tailored to the instances encountered in this task. In the results section, we show that our algorithm finds near optimal solutions, even for large scale instances.


title: TDAG: A Multi-Agent Framework based on Dynamic Task Decomposition and Agent Generation

abstract: The emergence of Large Language Models (LLMs) like ChatGPT has inspired the development of LLM-based agents capable of addressing complex, real-world tasks. However, these agents often struggle during task execution due to methodological constraints, such as error propagation and limited adaptability. To address this issue, we propose a multi-agent framework based on dynamic Task Decomposition and Agent Generation (TDAG). This framework dynamically decomposes complex tasks into smaller subtasks and assigns each to a specifically generated subagent, thereby enhancing adaptability in diverse and unpredictable real-world tasks. Simultaneously, existing benchmarks often lack the granularity needed to evaluate incremental progress in complex, multi-step tasks. In response, we introduce ItineraryBench in the context of travel planning, featuring interconnected, progressively complex tasks with a fine-grained evaluation system. ItineraryBench is designed to assess agents' abilities in memory, planning, and tool usage across tasks of varying complexity. Our experimental results reveal that TDAG significantly outperforms established baselines, showcasing its superior adaptability and context awareness in complex task scenarios.


title: Approaching the absorption limit with monolayer semiconductor superlattices

abstract: Optical absorption plays a central role in optoelectronic and photonic technologies. Strongly absorbing materials are thus needed for efficient and miniaturized devices. There exists, however, a fundamental limit of 50% absorptance for any ultrathin film in a symmetric environment. Although deviating from these conditions allows higher absorption, finding the thinnest possible material with the highest intrinsic absorption is still desirable. Here, we demonstrate strong absorption approaching the fundamental limit by artificially stacking WS$_2$ monolayers into superlattices. We compare three simple approaches based on different spacer materials to surpass the record peak absorptance of WS2 monolayers, which stands at 16% on ideal substrates. Through direct monolayer stacking without an intentional spacer, we reach a transmittance contrast of 30% for an artificial bilayer, although with limited control over interlayer distance. Using a molecular spacer via spin coating, we demonstrate controllable spacer thickness in a bilayer, reaching 28% transmittance contrast while increasing photoluminescence thanks to doping. Finally, we exploit atomic layer deposition of alumina spacers to boost the transmittance contrast to 36% for a 4-monolayer superlattice. Our results demonstrate that monolayer superlattices are a powerful platform directly applicable to improve exciton-polariton phenomena such as strong light-matter coupling and nanophotonic devices such as modulators and photodetectors.


title: Guiding light with surface exciton-polaritons in atomically thin superlattices

abstract: Two-dimensional materials give access to the ultimate physical limits of Photonics with appealing properties for ultracompact optical components such as waveguides and modulators. Specifically, in monolayer semiconductors, a strong excitonic resonance leads to a sharp oscillation in permittivity; at energies close to an exciton, the real part of the permittivity can reach high positive values or even become negative. This extreme optical response enables surface exciton-polaritons to guide visible light bound to an atomically thin layer. However, such ultrathin waveguides support a transverse electric (TE) mode with low confinement and a transverse magnetic (TM) mode with short propagation. Here, we propose that realistic semiconductor-insulator-semiconductor superlattices consisting of monolayer WS$_2$ and hexagonal boron nitride (hBN) can improve the properties of both TE and TM modes. Compared to a single monolayer, a heterostructure with a 1-nm hBN spacer improves the confinement of the TE mode from 1.2 to around 0.5 $\mu$m, whereas the out-of-plane extension of the TM mode increases from 25 to 50 nm. We propose two simple additivity rules for mode confinement valid in the ultrathin film approximation for heterostructures with increasing spacer thickness. Stacking additional WS2 monolayers into superlattices further enhances the waveguiding properties. Our results underscore the potential of monolayer superlattices as a platform for visible nanophotonics with promising optical, electrical, and magnetic tunability


title: Extracting randomness from quantum 'magic'

abstract: Magic is a critical property of quantum states that plays a pivotal role in fault-tolerant quantum computation. Simultaneously, random states have emerged as a key element in various randomized techniques within contemporary quantum science. In this study, we establish a direct connection between these two notions. More specifically, our research demonstrates that when a subsystem of a quantum state is measured, the resultant projected ensemble of the unmeasured subsystem can exhibit a high degree of randomness that is enhanced by the inherent 'magic' of the underlying state. We demonstrate this relationship rigorously for quantum state 2-designs, and present compelling numerical evidence to support its validity for higher-order quantum designs. Our findings suggest an efficient approach for leveraging magic as a resource to generate random quantum states.


title: Intent Demonstration in General-Sum Dynamic Games via Iterative Linear-Quadratic Approximations

abstract: Autonomous agents should be able to coordinate with other agents without knowing their intents ahead of time. While prior work has studied how agents can gather information about the intent of others, in this work we study the inverse problem: how agents can demonstrate their intent to others, within the framework of general-sum dynamic games. We first present a model of this intent demonstration problem and then propose an algorithm that enables an agent to trade off their task performance and intent demonstration to improve the overall system's performance. To scale to continuous states and action spaces as well as to nonlinear dynamics and costs, our algorithm leverages linear-quadratic approximations with an efficient intent teaching guarantee. Our empirical results show that intent demonstration accelerates other agents' learning and enables the demonstrating agent to balance task performance with intent expression.


title: The QCD phase diagram and Beam Energy Scan physics: a theory overview

abstract: We review recent theoretical developments relevant to heavy-ion experiments carried out within the Beam Energy Scan program at the Relativistic Heavy Ion Collider. Our main focus is on the description of the dynamics of systems created in heavy-ion collisions and establishing the necessary connection between the experimental observables and the QCD phase diagram.


title: Reward Generalization in RLHF: A Topological Perspective

abstract: Existing alignment methods share a common topology of information flow, where reward information is collected from humans, modeled with preference learning, and used to tune language models. However, this shared topology has not been systematically characterized, nor have its alternatives been thoroughly explored, leaving the problems of low data efficiency and unreliable generalization unaddressed. As a solution, we introduce a theoretical framework for investigating reward generalization in reinforcement learning from human feedback (RLHF), focusing on the topology of information flow at both macro and micro levels. At the macro level, we portray the RLHF information flow as an autoencoding process over behavior distributions, formalizing the RLHF objective of distributional consistency between human preference and model behavior. At the micro level, we present induced Bayesian networks as a theory of reward generalization in RLHF, introducing fine-grained dataset topologies into generalization bounds. Combining analysis on both levels, we propose reward modeling from tree-structured preference information. It is shown to reduce reward uncertainty by up to $\Theta(\log n/\log\log n)$ times compared to baselines, where $n$ is the dataset size. Validation on three NLP tasks shows that our tree-based reward model achieves an average win rate of 65% against baseline methods, thus improving reward generalization for free via topology design.


title: A coupled VOF/embedded boundary method to model two-phase flows on arbitrary solid surfaces

abstract: We present an hybrid VOF/embedded boundary method allowing to model two-phase flows in presence of solids with arbitrary shapes. The method relies on the coupling of existing methods: a geometric Volume of fluid (VOF) method to tackle the two-phase flow and an embedded boundary method to sharply resolve arbitrary solid geometries. Coupling these approaches consistently is not trivial and we present in detail a quad/octree spatial discretization for solving the corresponding partial differential equations. Modelling contact angle dynamics is a complex physical and numerical problem. We present a Navier-slip boundary condition compatible with the present cut cell method, validated through a Taylor-Couette test case. To impose the boundary condition when the fluid-fluid interface intersects a solid surface, a geometrical contact angle approach is developed. Our method is validated for several test cases including the spreading of a droplet on a cylinder, and the equilibrium shape of a droplet on a flat or tilted plane in 2D and 3D. The temporal evolution and convergence of the droplet spreading on a flat plane is also discussed for the moving contact line given the boundary condition (Dirichlet or Navier) used. The ability of our numerical methodology to resolve contact line statics and dynamics for different solid geometries is thus demonstrated.