title: MAIRA-2: Grounded Radiology Report Generation

abstract: Radiology reporting is a complex task that requires detailed image understanding, integration of multiple inputs, including comparison with prior imaging, and precise language generation. This makes it ideal for the development and use of generative multimodal models. Here, we extend report generation to include the localisation of individual findings on the image - a task we call grounded report generation. Prior work indicates that grounding is important for clarifying image understanding and interpreting AI-generated text. Therefore, grounded reporting stands to improve the utility and transparency of automated report drafting. To enable evaluation of grounded reporting, we propose a novel evaluation framework - RadFact - leveraging the reasoning capabilities of large language models (LLMs). RadFact assesses the factuality of individual generated sentences, as well as correctness of generated spatial localisations when present. We introduce MAIRA-2, a large multimodal model combining a radiology-specific image encoder with a LLM, and trained for the new task of grounded report generation on chest X-rays. MAIRA-2 uses more comprehensive inputs than explored previously: the current frontal image, the current lateral image, the prior frontal image and prior report, as well as the Indication, Technique and Comparison sections of the current report. We demonstrate that these additions significantly improve report quality and reduce hallucinations, establishing a new state of the art on findings generation (without grounding) on MIMIC-CXR while demonstrating the feasibility of grounded reporting as a novel and richer task.


title: Sulfur Dioxide and Other Molecular Species in the Atmosphere of the Sub-Neptune GJ 3470 b

abstract: We report observations of the atmospheric transmission spectrum of the sub-Neptune exoplanet GJ 3470 b taken using the Near-Infrared Camera (NIRCam) on JWST. Combined with two archival HST/WFC3 transit observations and fifteen archival Spitzer transit observations, we detect water, methane, sulfur dioxide, and carbon dioxide in the atmosphere of GJ 3470 b, each with a significance of >3-sigma. GJ 3470 b is the lowest mass -- and coldest -- exoplanet known to show a substantial sulfur dioxide feature in its spectrum, at $M_{p}$=11.2${\,{\rm M}_{\oplus}}$ and $T_{eq}$=600$\,$K. This indicates disequilibrium photochemistry drives sulfur dioxide production in exoplanet atmospheres over a wider range of masses and temperatures than has been reported or expected. The water, carbon dioxide, and sulfur dioxide abundances we measure indicate an atmospheric metallicity of approximately $100\times$ Solar. We see further evidence for disequilibrium chemistry in our inferred methane abundance, which is significantly lower than expected from equilibrium models consistent with our measured water and carbon dioxide abundances.


title: RiskMap: A Unified Driving Context Representation for Autonomous Motion Planning in Urban Driving Environment

abstract: Planning is complicated by the combination of perception and map information, particularly when driving in heavy traffic. Developing an extendable and efficient representation that visualizes sensor noise and provides constraints to real-time planning tasks is desirable. We aim to develop an extendable map representation offering prior to cost in planning tasks to simplify the planning process of dealing with complex driving scenarios and visualize sensor noise. In this paper, we illustrate a unified context representation empowered by a modern deep learning motion prediction model, representing statistical cognition of motion prediction for human beings. A sampling-based planner is adopted to train and compare the difference in risk map generation methods. The training tools and model structures are investigated illustrating their efficiency in this task.


title: Revisiting Human Information Foraging: Adaptations for LLM-based Chatbots

abstract: Information Foraging Theory's (IFT) framing of human information seeking choices as decision-theoretic cost-value judgments has successfully explained how people seek information among linked patches of information (e.g., linked webpages). However, the theory has to be adopted and validated in non-patchy LLM-based chatbot environments, before its postulates can be reliably applied to the design of such chat-based information seeking environments. This paper is a thought experiment that applies the IFT cost-value proposition to LLM-based chatbots and presents a set of preliminary hypotheses to guide future theory-building efforts for how people seek information in such environments.


title: Rheological properties of acid-induced carboxymethylcellulose hydrogels

abstract: Cellulose ethers represent a class of water-soluble polymers widely utilized across diverse sectors, spanning from healthcare to the construction industry. This experimental study specifically delves into aqueous suspensions of carboxymethylcellulose (CMC), a polymer that undergoes gel formation in acidic environments due to attractive interactions between hydrophobic patches along its molecular chain. We use rheometry to determine the linear viscoelastic properties of both CMC suspensions and acid-induced gels at various temperatures. Then, applying the time-temperature superposition principle, we construct master curves for the viscoelastic spectra, effectively described by fractional models. The horizontal shift factors exhibit an Arrhenius-like temperature dependence, allowing us to extract activation energies compatible with hydrophobic interactions. Furthermore, we show that acid-induced CMC gels are physical gels that display a reversible yielding transition under external shear. In particular, we discuss the influence of pH on the non-linear viscoelastic response under large-amplitude oscillatory shear. Overall, our results offer a comprehensive description of the linear and non-linear rheological properties of a compelling case of physical hydrogel involving hydrophobic interactions.


title: Ultrafast Optical Control of Rashba Interactions in a TMDC Heterostructure

abstract: We investigate spin relaxation dynamics of interlayer excitons in a MoSe2/MoS2 heterostructure induced by the Rashba effect. In such a system, Rashba interactions arise from an out-of-plane electric field due to photo-generated interlayer excitons inducing a phonon-assisted intravalley spin relaxation. We develop a theoretical description based on a microscopic approach to quantify the magnitude of Rashba interactions and test these predictions via time-resolved Kerr rotation measurements. In agreement with the calculations, we find that the Rashba-induced intravalley spin mixing becomes the dominating spin relaxation channel above T = 50 K. Our work identifies a previously unexplored spin-depolarization channel in heterostructures which can be used for ultrafast spin manipulation.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.optics quant-ph


title: Tidal Disruption Events from Stripped Stars

abstract: Observations of tidal disruption events (TDEs) show signs of Nitrogen enrichment reminiscent of other astrophysical sources such as active galactic nuclei (AGN) and star-forming galaxies. Given that TDEs probe the gas from a single star, it is possible to test if the observed enrichment is consistent with expectations from the CNO cycle by looking at the observed Nitrogen/Carbon (N/C) abundance ratios. Given that $\approx 20\%$ of solar mass stars (and an even larger fraction of more massive stars) live in close binaries, it is worthwhile to also consider what TDEs from stars influenced by binary evolution would look like. We show here that TDEs from stars stripped of their Hydrogen-rich (and Nitrogen-poor) envelopes through previous binary-induced mass loss can produce much higher observable N/C enhancements than even TDEs from massive stars. Additionally, we predict that the time-dependence of the N/C abundance ratio in the mass fallback rate of stripped stars will follow the inverse behavior of main-sequence stars, enabling a more accurate characterization of the disrupted star.


title: Learning Optimal Linear Precoding for Cell-Free Massive MIMO with GNN

abstract: We develop a graph neural network (GNN) to compute, within a time budget of 1 to 2 milliseconds required by practical systems, the optimal linear precoder (OLP) maximizing the minimal downlink user data rate for a Cell-Free Massive MIMO system - a key 6G wireless technology. The state-of-the-art method is a bisection search on second order cone programming feasibility test (B-SOCP) which is a magnitude too slow for practical systems. Our approach relies on representing OLP as a node-level prediction task on a graph. We construct a graph that accurately captures the interdependence relation between access points (APs) and user equipments (UEs), and the permutation equivariance of the Max-Min problem. Our neural network, named OLP-GNN, is trained on data obtained by B-SOCP. We tailor the OLP-GNN size, together with several artful data preprocessing and postprocessing methods to meet the runtime requirement. We show by extensive simulations that it achieves near optimal spectral efficiency in a range of scenarios with different number of APs and UEs, and for both line-of-sight and non-line-of-sight radio propagation environments.


title: Cold water emission cannot be used to infer depletion of bulk elemental oxygen [O/H] in disks

abstract: We re-examine the constraints provided by Herschel Space Observatory data regarding cold water emission from protoplanetary disks. Previous disk models that were used to interpret observed water emission concluded that oxygen (O/H) is depleted by at least 2 orders of magnitude if a standard, interstellar gas/dust mass ratio is assumed in the disk. In this work, we use model results from a recent disk parameter survey and show that most of the \textit{Herschel} constraints obtained for cold water (i.e. for transitions with an upper energy level $E_\mathrm{up}<200$ K, where the bulk of the disk water lies) can be explained with disk models adopting ISM-like oxygen elemental abundance (i.e. O/H=$3.2\times10^{-4}$) and the canonical gas/dust mass ratio of 100. We show that cold water vapor is mainly formed by photodesorption of water ice at the interface between the molecular layer and the midplane, and that its emission is relatively independent of the main disk properties like the disk gas mass and gas/dust mass ratio. We find that the abundance of water vapor in the outer disk is set by photoprocesses and depends on the (constant) vertical column density of water ice needed to attenuate the FUV photon flux, resulting in roughly constant emission for the parameters (gas mass, dust mass, disk radius) varied in our survey. Importantly, water line emission is found to be optically thick and hence sensitive to temperature more than abundance, possibly driving previous inferences of large scale oxygen depletion.


title: Chaotic motion and singularity structures of front solutions in multi-component FitzHugh-Nagumo-type systems

abstract: We study the dynamics of front solutions in a certain class of multi-component reaction-diffusion systems, where one fast component governed by an Allen-Cahn equation is weakly coupled to a system of $N$ linear slow reaction-diffusion equations. By using geometric singular perturbation theory, Evans function analysis and center manifold reduction, we demonstrate that and how the complexity of the front motion can be controlled by the choice of coupling function and the dimension $N$ of the slow part of the multi-component reaction-diffusion system. On the one hand, we show how to imprint and unfold a given scalar singularity structure. On the other hand, for $N\geq 3$ we show how chaotic behaviour of the front speed arises from the unfolding of a nilpotent singularity via the breaking of a Shil'nikov homoclinic orbit. The rigorous analysis is complemented by a numerical study that is heavily guided by our analytic findings.


title: A Lower Bound for Light Spanners in General Graphs

abstract: A recent upper bound by Le and Solomon [STOC '23] has established that every $n$-node graph has a $(1+\varepsilon)(2k-1)$-spanner with lightness $O(\varepsilon^{-1} n^{1/k})$. This bound is optimal up to its dependence on $\varepsilon$; the remaining open problem is whether this dependence can be improved or perhaps even removed entirely. We show that the $\varepsilon$-dependence cannot in fact be completely removed. For constant $k$ and for $\varepsilon:= \Theta(n^{-\frac{1}{2k-1}})$, we show a lower bound on lightness of $$\Omega\left( \varepsilon^{-1/k} n^{1/k} \right).$$ For example, this implies that there are graphs for which any $3$-spanner has lightness $\Omega(n^{2/3})$, improving on the previous lower bound of $\Omega(n^{1/2})$. An unusual feature of our lower bound is that it is conditional on the girth conjecture with parameter $k-1$ rather than $k$. We additionally show that this implies certain technical limitations to improving our lower bound further. In particular, under the same conditional, generalizing our lower bound to all $\varepsilon$ or obtaining an optimal $\varepsilon$-dependence are as hard as proving the girth conjecture for all constant $k$.


title: Evaluating the Smooth Control of Attribute Intensity in Text Generation with LLMs

abstract: Controlling the attribute intensity of text generation is crucial across scenarios (e.g., writing conciseness, chatting emotion, and explanation clarity). The remarkable capabilities of large language models (LLMs) have revolutionized text generation, prompting us to explore such \emph{smooth control} of LLM generation. Specifically, we propose metrics to assess the range, calibration, and consistency of the generated text's attribute intensity in response to varying control values, as well as its relevance to the intended context. To quantify the attribute intensity and context relevance, we propose an effective evaluation framework leveraging the Elo rating system and GPT4, both renowned for their robust alignment with human judgment. We look into two viable training-free methods for achieving smooth control of LLMs: (1) Prompting with semantic shifters, and (2) Modifying internal model representations. The evaluations of these two methods are conducted on $5$ different attributes with various models. Our code and dataset can be obtained from \url{https://github.com/ShangDataLab/Smooth-Control}.


title: Multi-Label Classification for Implicit Discourse Relation Recognition

abstract: Discourse relations play a pivotal role in establishing coherence within textual content, uniting sentences and clauses into a cohesive narrative. The Penn Discourse Treebank (PDTB) stands as one of the most extensively utilized datasets in this domain. In PDTB-3, the annotators can assign multiple labels to an example, when they believe that multiple relations are present. Prior research in discourse relation recognition has treated these instances as separate examples during training, and only one example needs to have its label predicted correctly for the instance to be judged as correct. However, this approach is inadequate, as it fails to account for the interdependence of labels in real-world contexts and to distinguish between cases where only one sense relation holds and cases where multiple relations hold simultaneously. In our work, we address this challenge by exploring various multi-label classification frameworks to handle implicit discourse relation recognition. We show that multi-label classification methods don't depress performance for single-label prediction. Additionally, we give comprehensive analysis of results and data. Our work contributes to advancing the understanding and application of discourse relations and provide a foundation for the future study


title: Adaptive Algorithmic Interventions for Escaping Pessimism Traps in Dynamic Sequential Decisions

abstract: In this paper, we relate the philosophical literature on pessimism traps to information cascades, a formal model derived from the economics and mathematics literature. A pessimism trap is a social pattern in which individuals in a community, in situations of uncertainty, begin to copy the sub-optimal actions of others, despite their individual beliefs. This maps nicely onto the concept of an information cascade, which involves a sequence of agents making a decision between two alternatives, with a private signal of the superior alternative and a public history of others' actions. Key results from the economics literature show that information cascades occur with probability one in many contexts, and depending on the strength of the signal, populations can fall into the incorrect cascade very easily and quickly. Once formed, in the absence of external perturbation, a cascade cannot be broken -- therefore, we derive an intervention that can be used to nudge a population from an incorrect to a correct cascade and, importantly, maintain the cascade once the subsidy is discontinued. We study this both theoretically and empirically.


title: Revisiting astrophysical bounds on continuous spontaneous localization models

abstract: Among the open problems in fundamental physics, few are as conceptually significant as the measurement problem in Quantum Mechanics. One of the proposed solutions to this problem is the Continuous Spontaneous Localization (CSL) model, which introduces a non-linear and stochastic modification of the Schr\"odinger equation. This model incorporates two parameters that can be subjected to experimental constraints. One of the most notable consequences of this theory is the spontaneous heating of massive objects; this anomalous heating is dependent on the CSL parameters. In this work, we will revisit some astrophysical bounds previously found, and introduce new methods for testing the spontaneous heating in a variety of compact objects. Finally, we will compare our different bounds and discuss the benefits and shortcomings of each one.


title: On The Importance of Reasoning for Context Retrieval in Repository-Level Code Editing

abstract: Recent advancements in code-fluent Large Language Models (LLMs) enabled the research on repository-level code editing. In such tasks, the model navigates and modifies the entire codebase of a project according to request. Hence, such tasks require efficient context retrieval, i.e., navigating vast codebases to gather relevant context. Despite the recognized importance of context retrieval, existing studies tend to approach repository-level coding tasks in an end-to-end manner, rendering the impact of individual components within these complicated systems unclear. In this work, we decouple the task of context retrieval from the other components of the repository-level code editing pipelines. We lay the groundwork to define the strengths and weaknesses of this component and the role that reasoning plays in it by conducting experiments that focus solely on context retrieval. We conclude that while the reasoning helps to improve the precision of the gathered context, it still lacks the ability to identify its sufficiency. We also outline the ultimate role of the specialized tools in the process of context gathering. The code supplementing this paper is available at https://github.com/JetBrains-Research/ai-agents-code-editing.


title: Rough Set improved Therapy-Based Metaverse Assisting System

abstract: Chronic neck and shoulder pain (CNSP) is a major global public health issue. Traditional treatments like physiotherapy and rehabilitation have drawbacks, including high costs, low precision, and user discomfort. This paper presents an interactive system based on Cognitive Therapy Theory (CBT) for CNSP treatment. The system includes a pain detection module using EMG and IMU to monitor pain and optimize data with Rough Set theory, and a cognitive therapy module that processes this data further for CBT-based interventions, including massage and heating therapy. An experimental plan is outlined to evaluate the system's effectiveness and performance. The goal is to create an accessible device for CNSP therapy. Additionally, the paper explores the system's application in a metaverse environment, enhancing treatment immersion and personalization. The metaverse platform simulates treatment environments and responds to real-time patient data, allowing for continuous monitoring and adjustment of treatment plans.


title: Dog Heart Rate and Blood Oxygen Metaverse Interaction System

abstract: This study developed an improved dog heart rate and blood oxygen sensor system using Arduino. Traditional methods face accuracy and reliability issues. Our system integrates advanced computational techniques with hardware-based sensing to enhance measurement precision. An Arduino microcontroller connected to a heart rate and blood oxygen sensor collects raw data, which is preprocessed and filtered to remove noise. Experimental plans include long-term monitoring of multiple dogs and comparative analysis with traditional methods to validate the system's effectiveness, aiming for widespread use in the home or veterinary clinics. Additionally, the system offers dog owners the possibility to interact with their virtual dogs in the metaverse using AR/VR, allowing them to better understand their real dogs' health conditions by observing their virtual health status.


title: Small-E: Small Language Model with Linear Attention for Efficient Speech Synthesis

abstract: Recent advancements in text-to-speech (TTS) powered by language models have showcased remarkable capabilities in achieving naturalness and zero-shot voice cloning. Notably, the decoder-only transformer is the prominent architecture in this domain. However, transformers face challenges stemming from their quadratic complexity in sequence length, impeding training on lengthy sequences and resource-constrained hardware. Moreover they lack specific inductive bias with regards to the monotonic nature of TTS alignments. In response, we propose to replace transformers with emerging recurrent architectures and introduce specialized cross-attention mechanisms for reducing repeating and skipping issues. Consequently our architecture can be efficiently trained on long samples and achieve state-of-the-art zero-shot voice cloning against baselines of comparable size. Our implementation and demos are available at https://github.com/theodorblackbird/lina-speech.


title: Coherent High-Harmonic Generation with Laser-Plasma Beams

abstract: Active energy compression scheme is presently being investigated for future laser-plasma accelerators. This method enables generating laser-plasma accelerator electron beams with a small, $\sim 10^{-5}$, relative slice energy spread. When modulated by a laser pulse, such beams can produce coherent radiation at very high, $\sim 100$-th harmonics of the modulation laser wavelength, which are hard to access by conventional techniques. The scheme has a potential of providing additional capabilities for future plasma-based facilities by generating stable, tunable, narrow-band radiation.


title: Resolving the Orientations of and Separation between an Overlapping Pair of Dipole Emitters

abstract: We prove that it is impossible to distinguish two spatially overlapping fluorescent molecules from a single rotating molecule, even if one modulates the polarization of pumping light or the detection dipole-spread function (DSF). If the target is known to be a dipole pair, existing imaging methods perform poorly for measuring their angular separation. We propose simultaneously modulating the excitation polarization and DSF, which demonstrates robust discrimination between dipole pairs versus single molecules. Our method improves the precision of measuring centroid orientation by 50% and angular separation by 4- to 6-fold over existing techniques.


title: DiffuSyn Bench: Evaluating Vision-Language Models on Real-World Complexities with Diffusion-Generated Synthetic Benchmarks

abstract: This study assesses the ability of Large Vision-Language Models (LVLMs) to differentiate between AI-generated and human-generated images. It introduces a new automated benchmark construction method for this evaluation. The experiment compared common LVLMs with human participants using a mixed dataset of AI and human-created images. Results showed that LVLMs could distinguish between the image types to some extent but exhibited a rightward bias, and perform significantly worse compared to humans. To build on these findings, we developed an automated benchmark construction process using AI. This process involved topic retrieval, narrative script generation, error embedding, and image generation, creating a diverse set of text-image pairs with intentional errors. We validated our method through constructing two caparable benchmarks. This study highlights the strengths and weaknesses of LVLMs in real-world understanding and advances benchmark construction techniques, providing a scalable and automatic approach for AI model evaluation.


title: Monte Carlo methods for stationary solutions of general-relativistic Vlasov systems: Planar accretion onto a moving Schwarzschild black hole

abstract: We perform Monte Carlo simulations of stationary planar accretion of a collisionless gas onto a moving Schwarzschild black hole. In this work -- a sequel to our previous paper on the Monte Carlo method for stationary general-relativistic Vlasov systems -- we demonstrate that our approach can be extended beyond the simplifying assumptions of the spherical symmetry or axial symmetry in the planar case. Our method of computing observable quantities, such as the particle current density, can be regarded as a rigorous coarse graining scheme, adapted to a numerical grid. Main difficulties are related to the appropriate parametrization of particle trajectories and a selection of parameters consistent with assumed requirements on the distribution function.


title: On the Hardness of Probabilistic Neurosymbolic Learning

abstract: The limitations of purely neural learning have sparked an interest in probabilistic neurosymbolic models, which combine neural networks with probabilistic logical reasoning. As these neurosymbolic models are trained with gradient descent, we study the complexity of differentiating probabilistic reasoning. We prove that although approximating these gradients is intractable in general, it becomes tractable during training. Furthermore, we introduce WeightME, an unbiased gradient estimator based on model sampling. Under mild assumptions, WeightME approximates the gradient with probabilistic guarantees using a logarithmic number of calls to a SAT solver. Lastly, we evaluate the necessity of these guarantees on the gradient. Our experiments indicate that the existing biased approximations indeed struggle to optimize even when exact solving is still feasible.


title: Modeling Time-Variable Elemental Abundances in Coronal Loop Simulations

abstract: Numerous recent X-ray observations of coronal loops in both active regions (ARs) and solar flares have shown clearly that elemental abundances vary with time. Over the course of a flare, they have been found to move from coronal values towards photospheric values near the flare peak, before slowly returning to coronal values during the gradual phase. Coronal loop models typically assume that the elemental abundances are fixed, however. In this work, we introduce a time-variable abundance factor into the 0D ebtel++ code that models the changes due to chromospheric evaporation in order to understand how this affects coronal loop cooling. We find that for strong heating events ($\gtrsim$ 1 erg s$^{-1}$ cm$^{-3}$), the abundances quickly tend towards photospheric values. For smaller heating rates, the abundances fall somewhere between coronal and photospheric values, causing the loop to cool more quickly than the time-fixed photospheric cases (typical flare simulations) and more slowly than time-fixed coronal cases (typical AR simulations). This suggests heating rates in quiescent AR loops no larger than $\approx 0.1$ erg s$^{-1}$ cm$^{-3}$ to be consistent with recent measurements of abundance factors $f \gtrsim 2$.


title: Stoichiometry-induced ferromagnetism in altermagnetic candidate MnTe

abstract: The field of spintronics has seen a surge of interest in altermagnetism due to novel predictions and many possible applications. MnTe is a leading altermagnetic candidate that is of significant interest across spintronics due to its layered antiferromagnetic structure, high Neel temperature (TN ~ 310 K) and semiconducting properties. We present results on molecular beam epitaxy (MBE) grown MnTe/InP(111) films. Here, it is found that the electronic and magnetic properties are driven by the natural stoichiometry of MnTe. Electronic transport and in situ angle-resolved photoemission spectroscopy show the films are natively metallic with the Fermi level in the valence band and the band structure is in good agreement with first principles calculations for altermagnetic spin-splitting. Neutron diffraction confirms that the film is antiferromagnetic with planar anisotropy and polarized neutron reflectometry indicates weak ferromagnetism, which is linked to a slight Mn-richness that is intrinsic to the MBE grown samples. When combined with the anomalous Hall effect, this work shows that the electronic response is strongly affected by the ferromagnetic moment. Altogether, this highlights potential mechanisms for controlling altermagnetic ordering for diverse spintronic applications.


title: Estimating molecular thermal averages with the quantum equation of motion and informationally complete measurements

abstract: By leveraging the Variational Quantum Eigensolver (VQE), the ``quantum equation of motion" (qEOM) method established itself as a promising tool for quantum chemistry on near term quantum computers, and has been used extensively to estimate molecular excited states. Here, we explore a novel application of this method, employing it to compute thermal averages of quantum systems, specifically molecules like ethylene and butadiene. A drawback of qEOM is that it requires measuring the expectation values of a large number of observables on the ground state of the system, and the number of necessary measurements can become a bottleneck of the method. In this work we focus on measurements through informationally complete positive operator-valued measures (IC-POVMs) to achieve a reduction in the measurements overheads. We show with numerical simulations that the qEOM combined with IC-POVM measurements ensures a satisfactory accuracy in the reconstruction of the thermal state with a reasonable number of shots.


title: Provable Bounds on the Hessian of Neural Networks: Derivative-Preserving Reachability Analysis

abstract: We propose a novel reachability analysis method tailored for neural networks with differentiable activations. Our idea hinges on a sound abstraction of the neural network map based on first-order Taylor expansion and bounding the remainder. To this end, we propose a method to compute analytical bounds on the network's first derivative (gradient) and second derivative (Hessian). A key aspect of our method is loop transformation on the activation functions to exploit their monotonicity effectively. The resulting end-to-end abstraction locally preserves the derivative information, yielding accurate bounds on small input sets. Finally, we employ a branch and bound framework for larger input sets to refine the abstraction recursively. We evaluate our method numerically via different examples and compare the results with relevant state-of-the-art methods.


title: Barrier distribution extraction via Gaussian process regression

abstract: This work presents a novel method for extracting potential barrier distributions from experimental fusion cross sections. We utilize a simple Gaussian process regression (GPR) framework to model the observed cross sections as a function of energy for three nuclear systems. The GPR approach offers a flexible way to represent the experimental data, accommodating potentially complex behavior without introducing strong prior assumptions. This method is applied directly to experimental data and is compared to the traditional direct extraction technique. We discuss the advantages of GPR-based barrier distribution extraction, including the capability to quantify uncertainties and robustness to noise in the experimental data.


title: PromptFix: Few-shot Backdoor Removal via Adversarial Prompt Tuning

abstract: Pre-trained language models (PLMs) have attracted enormous attention over the past few years with their unparalleled performances. Meanwhile, the soaring cost to train PLMs as well as their amazing generalizability have jointly contributed to few-shot fine-tuning and prompting as the most popular training paradigms for natural language processing (NLP) models. Nevertheless, existing studies have shown that these NLP models can be backdoored such that model behavior is manipulated when trigger tokens are presented. In this paper, we propose PromptFix, a novel backdoor mitigation strategy for NLP models via adversarial prompt-tuning in few-shot settings. Unlike existing NLP backdoor removal methods, which rely on accurate trigger inversion and subsequent model fine-tuning, PromptFix keeps the model parameters intact and only utilizes two extra sets of soft tokens which approximate the trigger and counteract it respectively. The use of soft tokens and adversarial optimization eliminates the need to enumerate possible backdoor configurations and enables an adaptive balance between trigger finding and preservation of performance. Experiments with various backdoor attacks validate the effectiveness of the proposed method and the performances when domain shift is present further shows PromptFix's applicability to models pretrained on unknown data source which is the common case in prompt tuning scenarios.


title: An investigation of escape and scaling properties of a billiard system

abstract: We investigate some statistical properties of escaping particles in a billiard system whose boundary is described by two control parameters with a hole on its boundary. Initially, we analyze the survival probability for different hole positions and sizes. We notice the survival probability follows an exponential decay with a characteristic power law tail when the hole is positioned partially or entirely over large stability islands in phase space. We find the survival probability exhibits scaling invariance with respect to the hole size. In contrast, the survival probability for holes placed in predominantly chaotic regions deviates from the exponential decay. We introduce two holes simultaneously and investigate the complexity of the escape basins for different hole sizes and control parameters by means of the basin entropy and the basin boundary entropy. We find a non-trivial relation between these entropies and the system's parameters and show that the basin entropy exhibits scaling invariance for a specific control parameter interval.


title: Everywhere & Nowhere: Envisioning a Computing Continuum for Science

abstract: Emerging data-driven scientific workflows are seeking to leverage distributed data sources to understand end-to-end phenomena, drive experimentation, and facilitate important decision-making. Despite the exponential growth of available digital data sources at the edge, and the ubiquity of non trivial computational power for processing this data, realizing such science workflows remains challenging. This paper explores a computing continuum that is everywhere and nowhere -- one spanning resources at the edges, in the core and in between, and providing abstractions that can be harnessed to support science. It also introduces recent research in programming abstractions that can express what data should be processed and when and where it should be processed, and autonomic middleware services that automate the discovery of resources and the orchestration of computations across these resources.


title: Optimizing Autonomous Driving for Safety: A Human-Centric Approach with LLM-Enhanced RLHF

abstract: Reinforcement Learning from Human Feedback (RLHF) is popular in large language models (LLMs), whereas traditional Reinforcement Learning (RL) often falls short. Current autonomous driving methods typically utilize either human feedback in machine learning, including RL, or LLMs. Most feedback guides the car agent's learning process (e.g., controlling the car). RLHF is usually applied in the fine-tuning step, requiring direct human "preferences," which are not commonly used in optimizing autonomous driving models. In this research, we innovatively combine RLHF and LLMs to enhance autonomous driving safety. Training a model with human guidance from scratch is inefficient. Our framework starts with a pre-trained autonomous car agent model and implements multiple human-controlled agents, such as cars and pedestrians, to simulate real-life road environments. The autonomous car model is not directly controlled by humans. We integrate both physical and physiological feedback to fine-tune the model, optimizing this process using LLMs. This multi-agent interactive environment ensures safe, realistic interactions before real-world application. Finally, we will validate our model using data gathered from real-life testbeds located in New Jersey and New York City.


title: Automatic Bug Detection in LLM-Powered Text-Based Games Using LLMs

abstract: Advancements in large language models (LLMs) are revolutionizing interactive game design, enabling dynamic plotlines and interactions between players and non-player characters (NPCs). However, LLMs may exhibit flaws such as hallucinations, forgetfulness, or misinterpretations of prompts, causing logical inconsistencies and unexpected deviations from intended designs. Automated techniques for detecting such game bugs are still lacking. To address this, we propose a systematic LLM-based method for automatically identifying such bugs from player game logs, eliminating the need for collecting additional data such as post-play surveys. Applied to a text-based game DejaBoom!, our approach effectively identifies bugs inherent in LLM-powered interactive games, surpassing unstructured LLM-powered bug-catching methods and filling the gap in automated detection of logical and design flaws.


title: Safe Sliding Mode Controllers for Nonlinear Uncertain Systems

abstract: In this study, we present a novel sliding mode safety-critical controller designed to address both stability and safety concerns in a class of nonlinear uncertain systems. The controller features two feedback loops: an inner loop designed by conventional sliding mode techniques and an outer safeguarding loop aimed at enhancing system safety. The inner loop, while ensuring asymptotic stability of the closed-loop system, may not guarantee compliance with safety constraints. To overcome this limitation and ensure both stability and safety, the outer loop introduces a correction term known as the safeguarding control signal. This signal is added to the unsafe control signal generated by the inner loop, effectively modifying it to meet the required safety constraints. To design the safeguarding control law, we integrate the system dynamics with an additional state variable. The dynamics of this augmented state are derived based on a stability constraint obtained from Lyapunov theory. By utilizing a control barrier function for the augmented system, we determine the safeguarding control signal, which ensures the system operates within the defined safety constraint. The proposed safety-critical controller exhibits finite-time convergence to the sliding manifold. To mitigate interference between the inner and outer loops, strategies such as defining risky sets are employed, limiting the impact of the safeguarding loop on the functionality of the inner loop. A closed-form solution for designing safeguarding control laws is derived to eliminate the necessity for solving any quadratic problems in real-time. Simulation case studies validate the effectiveness of the proposed controller in maintaining stability and safety.


title: Step Out and Seek Around: On Warm-Start Training with Incremental Data

abstract: Data often arrives in sequence over time in real-world deep learning applications such as autonomous driving. When new training data is available, training the model from scratch undermines the benefit of leveraging the learned knowledge, leading to significant training costs. Warm-starting from a previously trained checkpoint is the most intuitive way to retain knowledge and advance learning. However, existing literature suggests that this warm-starting degrades generalization. In this paper, we advocate for warm-starting but stepping out of the previous converging point, thus allowing a better adaptation to new data without compromising previous knowledge. We propose Knowledge Consolidation and Acquisition (CKCA), a continuous model improvement algorithm with two novel components. First, a novel feature regularization (FeatReg) to retain and refine knowledge from existing checkpoints; Second, we propose adaptive knowledge distillation (AdaKD), a novel approach to forget mitigation and knowledge transfer. We tested our method on ImageNet using multiple splits of the training data. Our approach achieves up to $8.39\%$ higher top1 accuracy than the vanilla warm-starting and consistently outperforms the prior art with a large margin.


title: GenAI Arena: An Open Evaluation Platform for Generative Models

abstract: Generative AI has made remarkable strides to revolutionize fields such as image and video generation. These advancements are driven by innovative algorithms, architecture, and data. However, the rapid proliferation of generative models has highlighted a critical gap: the absence of trustworthy evaluation metrics. Current automatic assessments such as FID, CLIP, FVD, etc often fail to capture the nuanced quality and user satisfaction associated with generative outputs. This paper proposes an open platform GenAI-Arena to evaluate different image and video generative models, where users can actively participate in evaluating these models. By leveraging collective user feedback and votes, GenAI-Arena aims to provide a more democratic and accurate measure of model performance. It covers three arenas for text-to-image generation, text-to-video generation, and image editing respectively. Currently, we cover a total of 27 open-source generative models. GenAI-Arena has been operating for four months, amassing over 6000 votes from the community. We describe our platform, analyze the data, and explain the statistical methods for ranking the models. To further promote the research in building model-based evaluation metrics, we release a cleaned version of our preference data for the three tasks, namely GenAI-Bench. We prompt the existing multi-modal models like Gemini, GPT-4o to mimic human voting. We compute the correlation between model voting with human voting to understand their judging abilities. Our results show existing multimodal models are still lagging in assessing the generated visual content, even the best model GPT-4o only achieves a Pearson correlation of 0.22 in the quality subscore, and behaves like random guessing in others.


title: The Onset of Magnetic Reconnection in Dynamically Evolving Current Sheets

abstract: We present the first results of three-dimensional (3D) numerical magnetohydrodynamic (MHD) simulations of the onset of magnetic reconnection via the tearing instability in dynamically thinning current sheets in the solar corona. In all our simulations, the onset of the non-linear tearing instability, which leads to the break-up of the thinning current sheet, does not occur until after the instability growth time becomes faster than the dynamic thinning time. Furthermore, as in previous 3D MHD simulations of static current sheets in the corona, for some parameters, the amount of magnetic shear is a fundamental switch-on parameter, which has consequences for coronal heating models. These results open up the possibility of using observable quantities of coronal current sheets to predict when they will break-up and release magnetic energy to power various energetic phenomena and/or heat the atmosphere.

categories: astro-ph.SR math-ph math.MP physics.plasm-ph


title: A multi-core periphery perspective: Ranking via relative centrality

abstract: Community and core-periphery are two widely studied graph structures, with their coexistence observed in real-world graphs (Rombach, Porter, Fowler \& Mucha [SIAM J. App. Math. 2014, SIAM Review 2017]). However, the nature of this coexistence is not well understood and has been pointed out as an open problem (Yanchenko \& Sengupta [Statistics Surveys, 2023]). Especially, the impact of inferring the core-periphery structure of a graph on understanding its community structure is not well utilized. In this direction, we introduce a novel quantification for graphs with ground truth communities, where each community has a densely connected part (the core), and the rest is more sparse (the periphery), with inter-community edges more frequent between the peripheries. Built on this structure, we propose a new algorithmic concept that we call relative centrality to detect the cores. We observe that core-detection algorithms based on popular centrality measures such as PageRank and degree centrality can show some bias in their outcome by selecting very few vertices from some cores. We show that relative centrality solves this bias issue and provide theoretical and simulation support, as well as experiments on real-world graphs. Core detection is known to have important applications with respect to core-periphery structures. In our model, we show a new application: relative-centrality-based algorithms can select a subset of the vertices such that it contains sufficient vertices from all communities, and points in this subset are better separable into their respective communities. We apply the methods to 11 biological datasets, with our methods resulting in a more balanced selection of vertices from all communities such that clustering algorithms have better performance on this set.


title: Negative Feedback for Music Personalization

abstract: Next-item recommender systems are often trained using only positive feedback with randomly-sampled negative feedback. We show the benefits of using real negative feedback both as inputs into the user sequence and also as negative targets for training a next-song recommender system for internet radio. In particular, using explicit negative samples during training helps reduce training time by ~60% while also improving test accuracy by ~6%; adding user skips as additional inputs also can considerably increase user coverage alongside slightly improving accuracy. We test the impact of using a large number of random negative samples to capture a 'harder' one and find that the test accuracy increases with more randomly-sampled negatives, but only to a point. Too many random negatives leads to false negatives that limits the lift, which is still lower than if using true negative feedback. We also find that the test accuracy is fairly robust with respect to the proportion of different feedback types, and compare the learned embeddings for different feedback types.


title: Efficient backward x-ray emission in a finite-length plasma irradiated by a laser pulse of ps duration

abstract: Motivated by experiments employing ps-long, kilojoule laser pulses, we examined x-ray emission in a finite-length underdense plasma irradiated by such a pulse using two dimensional particle-in-cell simulations. We found that, in addition to the expected forward emission, the plasma also efficiently emits in the backward direction. Our simulations reveal that the backward emission occurs when the laser exits the plasma. The longitudinal plasma electric field generated by the laser at the density down-ramp turns around some of the laser-accelerated electrons and re-accelerates them in the backward direction. As the electrons collide with the laser, they emit hard x-rays. The energy conversion efficiency is comparable to that for the forward emission, but the effective source size is smaller. We show that the ps laser duration is required for achieving a spatial overlap between the laser and the backward energetic electrons. At peak laser intensity of $1.4\times 10^{20}~\rm{W/cm^2}$, backward emitted photons (energies above 100~keV and $10^{\circ}$ divergence angle) account for $2 \times 10^{-5}$ of the incident laser energy. This conversion efficiency is three times higher than that for similarly selected forward emitted photons. The source size of the backward photons ($5~\rm{\mu m}$) is three times smaller than the source size of the forward photons.

categories: physics.plasm-ph physics.acc-ph physics.app-ph physics.optics


title: User Intent Recognition and Semantic Cache Optimization-Based Query Processing Framework using CFLIS and MGR-LAU

abstract: Query Processing (QP) is optimized by a Cloud-based cache by storing the frequently accessed data closer to users. Nevertheless, the lack of focus on user intention type in queries affected the efficiency of QP in prevailing works. Thus, by using a Contextual Fuzzy Linguistic Inference System (CFLIS), this work analyzed the informational, navigational, and transactional-based intents in queries for enhanced QP. Primarily, the user query is parsed using tokenization, normalization, stop word removal, stemming, and POS tagging and then expanded using the WordNet technique. After expanding the queries, to enhance query understanding and to facilitate more accurate analysis and retrieval in query processing, the named entity is recognized using Bidirectional Encoder UnispecNorm Representations from Transformers (BEUNRT). Next, for efficient QP and retrieval of query information from the semantic cache database, the data is structured using Epanechnikov Kernel-Ordering Points To Identify the Clustering Structure (EK-OPTICS). The features are extracted from the structured data. Now, sentence type is identified and intent keywords are extracted from the parsed query. Next, the extracted features, detected intents and structured data are inputted to the Multi-head Gated Recurrent Learnable Attention Unit (MGR-LAU), which processes the query based on a semantic cache database (stores previously interpreted queries to expedite effective future searches). Moreover, the query is processed with a minimum latency of 12856ms. Lastly, the Semantic Similarity (SS) is analyzed between the retrieved query and the inputted user query, which continues until the similarity reaches 0.9 and above. Thus, the proposed work surpassed the previous methodologies.


title: Towards Robotic Haptic Proxies in Virtual Reality

abstract: This work represents the initial development of a haptic display system for increased presence in virtual experiences. The developed system creates a two-way connection between a virtual space, mediated through a virtual reality headset, and a physical space, mediated through a robotic manipulator, creating the foundation for future haptic display development using the haptic proxy framework. Here, we assesses hand-tracking performance of the Meta Quest Pro headset, examining hand tracking latency and static positional error to characterize performance of our system.


title: Quantum Communication: From Fundamentals to Recent Trends, Challenges and Open Problems

abstract: With the recent advancements and developments in quantum technologies, the emerging field of quantum communication and networking has gained the attention of the researchers. Owing to the unique properties of quantum mechanics, viz., quantum superposition and entanglement, this new area of quantum communication has shown potential to replace modernday communication technologies. The enhanced security and high information sharing ability using principles of quantum mechanics has encouraged networking engineers and physicists to develop this technology for next generation wireless systems. However, a conceptual bridge between the fundamentals of quantum mechanics, photonics and the deployability of a quantum communication infrastructure is not well founded in the current literature. This paper aims to fill this gap by merging the theoretical concepts from quantum physics to the engineering and computing perspectives of quantum technology. This paper builds the fundamental concepts required for understanding quantum communication, reviews the key concepts and demonstrates how these concepts can be leveraged for accomplishing successful communication. The paper delves into implementation advancements for executing quantum communication protocols, explaining how hardware implementation enables the achievement of all basic quantum computing operations. Finally, the paper provides a comprehensive and critical review of the state-of-the-art advancements in the field of quantum communication and quantum internet; and points out the recent trends, challenges and open problems for the real-world realization of next generation networking systems.


title: CORU: Comprehensive Post-OCR Parsing and Receipt Understanding Dataset

abstract: In the fields of Optical Character Recognition (OCR) and Natural Language Processing (NLP), integrating multilingual capabilities remains a critical challenge, especially when considering languages with complex scripts such as Arabic. This paper introduces the Comprehensive Post-OCR Parsing and Receipt Understanding Dataset (CORU), a novel dataset specifically designed to enhance OCR and information extraction from receipts in multilingual contexts involving Arabic and English. CORU consists of over 20,000 annotated receipts from diverse retail settings, including supermarkets and clothing stores, alongside 30,000 annotated images for OCR that were utilized to recognize each detected line, and 10,000 items annotated for detailed information extraction. These annotations capture essential details such as merchant names, item descriptions, total prices, receipt numbers, and dates. They are structured to support three primary computational tasks: object detection, OCR, and information extraction. We establish the baseline performance for a range of models on CORU to evaluate the effectiveness of traditional methods, like Tesseract OCR, and more advanced neural network-based approaches. These baselines are crucial for processing the complex and noisy document layouts typical of real-world receipts and for advancing the state of automated multilingual document processing. Our datasets are publicly accessible (https://github.com/Update-For-Integrated-Business-AI/CORU).


title: Towards Naturalistic Voice Conversion: NaturalVoices Dataset with an Automatic Processing Pipeline

abstract: Voice conversion (VC) research traditionally depends on scripted or acted speech, which lacks the natural spontaneity of real-life conversations. While natural speech data is limited for VC, our study focuses on filling in this gap. We introduce a novel data-sourcing pipeline that makes the release of a natural speech dataset for VC, named NaturalVoices. The pipeline extracts rich information in speech such as emotion and signal-to-noise ratio (SNR) from raw podcast data, utilizing recent deep learning methods and providing flexibility and ease of use. NaturalVoices marks a large-scale, spontaneous, expressive, and emotional speech dataset, comprising over 3,800 hours speech sourced from the original podcasts in the MSP-Podcast dataset. Objective and subjective evaluations demonstrate the effectiveness of using our pipeline for providing natural and expressive data for VC, suggesting the potential of NaturalVoices for broader speech generation tasks.


title: Nanodosimetric characterisation of proton track structure: a comparison of sampling and clustering algorithms using Geant4-DNA

abstract: This study evaluates the influence of the algorithm used to calculate conditional ionisation cluster size distributions (ICSD) and nanodosimetric parameters from proton track structures obtained with Geant4-DNA simulations. The Uniform Sampling (US) and Associated Volume (AV) sampling algorithms and the DBSCAN clustering algorithm were used to calculate the ICSD conditioned on cluster sizes $\nu \ge 1$. In the AV algorithm, we explored two configurations: one where sampling volumes could overlap ("Overlap") and one where volumes could not overlap ("No Overlap"). The Overlap configuration was corrected with the weight function $w(\nu)=\nu^{-1}$ to eliminate the bias towards regions of high density of ionisations. In sampling algorithms, clusters were defined as the number of ionisations in spheres of 3.4 nm in diameter. In DBSCAN, clusters were formed according to a proximity criterion (maximum distance of 3.4 nm) between two ionisations - no additional geometrical restrictions were applied. The conditional ICSD, the mean cluster size, and a set of complementary cumulative frequencies were compared. We considered differences in the mean difference larger than two standard deviations statistically significant. Overall, differences between the No Overlap and the Overlap configurations and between the US and AV algorithms were statistically significant but relatively small, except when statistical fluctuations dominated. DBSCAN always resulted in significantly larger mean cluster sizes. We showed that the fast and efficient AV can be used instead of the relatively inefficient US to calculate conditional ICSDs without significant loss of accuracy. The differences observed between DBSCAN and the other algorithms are understood and originate in the fact that while the scoring volume is fixed for the sampling algorithms, for DBSCAN, it evolves according to the distance between ionisations.


title: Time Sensitive Knowledge Editing through Efficient Finetuning

abstract: Large Language Models (LLMs) have demonstrated impressive capability in different tasks and are bringing transformative changes to many domains. However, keeping the knowledge in LLMs up-to-date remains a challenge once pretraining is complete. It is thus essential to design effective methods to both update obsolete knowledge and induce new knowledge into LLMs. Existing locate-and-edit knowledge editing (KE) method suffers from two limitations. First, the post-edit LLMs by such methods generally have poor capability in answering complex queries that require multi-hop reasoning. Second, the long run-time of such locate-and-edit methods to perform knowledge edits make it infeasible for large scale KE in practice. In this paper, we explore Parameter-Efficient Fine-Tuning (PEFT) techniques as an alternative for KE. We curate a more comprehensive temporal KE dataset with both knowledge update and knowledge injection examples for KE performance benchmarking. We further probe the effect of fine-tuning on a range of layers in an LLM for the multi-hop QA task. We find that PEFT performs better than locate-and-edit techniques for time-sensitive knowledge edits.


title: Consensus Through Knot Discovery in Asynchronous Dynamic Networks

abstract: We state the Problem of Knot Identification as a way to achieve consensus in dynamic networks. The network adversary is asynchronous and not oblivious. The network may be disconnected throughout the computation. We determine the necessary and sufficient conditions for the existence of a solution to the Knot Identification Problem: the knots must be observable by all processes and the first observed knot must be the same for all processes. We present an algorithm KIA that solves it. We conduct KIA performance evaluation.


title: Conformal Multi-Target Hyperrectangles

abstract: We propose conformal hyperrectangular prediction regions for multi-target regression. We propose split conformal prediction algorithms for both point and quantile regression to form hyperrectangular prediction regions, which allow for easy marginal interpretation and do not require covariance estimation. In practice, it is preferable that a prediction region is balanced, that is, having identical marginal prediction coverage, since prediction accuracy is generally equally important across components of the response vector. The proposed algorithms possess two desirable properties, namely, tight asymptotic overall nominal coverage as well as asymptotic balance, that is, identical asymptotic marginal coverage, under mild conditions. We then compare our methods to some existing methods on both simulated and real data sets. Our simulation results and real data analysis show that our methods outperform existing methods while achieving the desired nominal coverage and good balance between dimensions.


title: A layer decomposition method for multi-layer elastic contact systems with interlayer Tresca friction

abstract: With the increasing demand for the accuracy of numerical simulation of pavement mechanics, the variational inequality model and its induced finite element method which can simulate the interlayer contact state becomes a potential solution. In this paper, a layer decomposition algorithm for solving variational inequality models of multi-layer elastic contact systems with interlayer Tresca friction conditions is studied. Continuous and discrete versions of the algorithm and their convergence theorems have been proposed and proved successively. Then, the algebraic form of the executable optimization algorithm and the numerical experimental results verify the practicability of the variational inequality model and its algorithm in the pavement mechanics modeling.


title: Determining Weak-Mixing Angle at $\mu$TRISTAN

abstract: $\mu$TRISTAN is a realistic high energy lepton collider based on the existing technology aiming at indirect and direct search for the physics beyond the standard model (SM). We propose a measurement to determine one of the most prominent parameters of the SM, weak mixing angle to test the SM and probe the new physics effect in M\o ller-like scattering with a wide range of interaction scales. We show that this experiment not only can determine the weak mixing angle with percent to milli-level accuracy but also scan over a wide range of interaction scales that have never been archived in a single experiment elsewhere.


title: FLUID-LLM: Learning Computational Fluid Dynamics with Spatiotemporal-aware Large Language Models

abstract: Learning computational fluid dynamics (CFD) traditionally relies on computationally intensive simulations of the Navier-Stokes equations. Recently, large language models (LLMs) have shown remarkable pattern recognition and reasoning abilities in natural language processing (NLP) and computer vision (CV). However, these models struggle with the complex geometries inherent in fluid dynamics. We introduce FLUID-LLM, a novel framework combining pre-trained LLMs with spatiotemporal-aware encoding to predict unsteady fluid dynamics. Our approach leverages the temporal autoregressive abilities of LLMs alongside spatial-aware layers, bridging the gap between previous CFD prediction methods. Evaluations on standard benchmarks reveal significant performance improvements across various fluid datasets. Our results demonstrate that FLUID-LLM effectively integrates spatiotemporal information into pre-trained LLMs, enhancing CFD task performance.


title: On the enumeration of series-parallel matroids

abstract: By the work of Ferroni and Larson, Kazhdan-Lusztig polynomials and Z-polynomials of complete graphs have combinatorial interpretations in terms of quasi series-parallel matroids. We provide explicit formulas for the number of series-parallel matroids and the number of simple series-parallel matroids of a given rank and cardinality, extending results of Ferroni-Larson and Gao-Proudfoot-Yang-Zhang.


title: Enhancing Precision in Tactile Internet-Enabled Remote Robotic Surgery: Kalman Filter Approach

abstract: Accurately estimating the position of a patient's side robotic arm in real time in a remote surgery task is a significant challenge, particularly in Tactile Internet (TI) environments. This paper presents a Kalman Filter (KF) based computationally efficient position estimation method. The study also assume no prior knowledge of the dynamic system model of the robotic arm system. Instead, The JIGSAW dataset, which is a comprehensive collection of robotic surgical data, and the Master Tool Manipulator's (MTM) input are utilized to learn the system model using System Identification (SI) toolkit available in Matlab. We further investigate the effectiveness of KF to determine the position of the Patient Side Manipulator (PSM) under simulated network conditions that include delays, jitter, and packet loss. These conditions reflect the typical challenges encountered in real-world Tactile Internet applications. The results of the study highlight KF's resilience and effectiveness in achieving accurate state estimation despite network-induced uncertainties with over 90\% estimation accuracy.


title: Mixed Finite Element Method for Multi-layer Elastic Contact Systems

abstract: With the development of multi-layer elastic systems in the field of engineering mechanics, the corresponding variational inequality theory and algorithm design have received more attention and research. In this study, a class of equivalent saddle point problems with interlayer Tresca friction conditions and the mixed finite element method are proposed and analyzed. Then, the convergence of the numerical solution of the mixed finite element method is theoretically proven, and the corresponding algebraic dual algorithm is given. Finally, through numerical experiments, the mixed finite element method is not only compared with the layer decomposition method, but also its convergence relationship with respect to the spatial discretization parameter $H$ is verified.


title: Causal Inference in Randomized Trials with Partial Clustering and Imbalanced Dependence Structures

abstract: In many randomized trials, participants are grouped into clusters, such as neighborhoods or schools, and these clusters are assumed to be the independent unit. This assumption, however, might not reflect the underlying dependence structure, with serious consequences to statistical power. First, consider a cluster randomized trial where participants are artificially grouped together for the purposes of randomization. For intervention participants the groups are the basis for intervention delivery, but for control participants the groups are dissolved. Second, consider an individually randomized group treatment trial where participants are randomized and then post-randomization, intervention participants are grouped together for intervention delivery, while the control participants continue with the standard of care. In both trial designs, outcomes among intervention participants will be dependent within each cluster, while outcomes for control participants will be effectively independent. We use causal models to non-parametrically describe the data generating process for each trial design and formalize the conditional independence in the observed data distribution. For estimation and inference, we propose a novel implementation of targeted minimum loss-based estimation (TMLE) accounting for partial clustering and the imbalanced dependence structure. TMLE is a model-robust approach, leverages covariate adjustment and machine learning to improve precision, and facilitates estimation of a large set of causal effects. In finite sample simulations, TMLE achieved comparable or markedly higher statistical power than common alternatives. Finally, application of TMLE to real data from the SEARCH-IPT trial resulted in 20-57\% efficiency gains, demonstrating the real-world consequences of our proposed approach.


title: An Enhanced Approach for the Dial a ride problem with drivers preferences

abstract: The paper addresses a variant of the Dial-A-Ride problem with additional features. It is referred to as the DARP with driver preferences, which attempts to determine a solution more driver-oriented by designing a short trip in a specific direction that has to be finished at a destination of interest within a restricted time window. For this purpose, two solutions are considered. The first involves solving the new MILP exactly using the CPLEX software. The second is a new approach that employs an iterated local search as a general framework and exploits many heuristics. Numerical experiments indicate that the approach can efficiently solve the generated DARPDP instances in a reasonable time.


title: Explicit Combinatoric Structures of Palindromes and Chromatic Number of Restriction Graphs

abstract: The palindromic fingerprint of a string $S[1\ldots n]$ is the set $PF(S) = \{(i,j)~|~ S[i\ldots j] \textit{ is a maximal }\\ \textit{palindrome substring of } S\}$. In this work, we consider the problem of string reconstruction from a palindromic fingerprint. That is, given an input set of pairs $PF \subseteq [1\ldots n] \times [1\ldots n]$ for an integer $n$, we wish to determine if $PF$ is a valid palindromic fingerprint for a string $S$, and if it is, output a string $S$ such that $PF= PF(S)$. I et al. [SPIRE2010] showed a linear reconstruction algorithm from a palindromic fingerprint that outputs the lexicographically smallest string over a minimum alphabet. They also presented an upper bound of $\mathcal{O}(\log(n))$ for the maximal number of characters in the minimal alphabet. In this paper, we show tight combinatorial bounds for the palindromic fingerprint reconstruction problem. We present the string $S_k$, which is the shortest string whose fingerprint $PF(S_k)$ cannot be reconstructed using less than $k$ characters. The results additionally solve an open problem presented by I et al.


title: OCCAM: Towards Cost-Efficient and Accuracy-Aware Image Classification Inference

abstract: Image classification is a fundamental building block for a majority of computer vision applications. With the growing popularity and capacity of machine learning models, people can easily access trained image classifiers as a service online or offline. However, model use comes with a cost and classifiers of higher capacity usually incur higher inference costs. To harness the respective strengths of different classifiers, we propose a principled approach, OCCAM, to compute the best classifier assignment strategy over image classification queries (termed as the optimal model portfolio) so that the aggregated accuracy is maximized, under user-specified cost budgets. Our approach uses an unbiased and low-variance accuracy estimator and effectively computes the optimal solution by solving an integer linear programming problem. On a variety of real-world datasets, OCCAM achieves 40% cost reduction with little to no accuracy drop.


title: Exceptionally Large Fluctuations in Orientational Order: The Lessons of Large-Deviation Theory for Liquid Crystalline Systems

abstract: The fact that simulations of condensed matter problems are limited to sizes far smaller than the macroscopic systems being emulated does have one redeeming feature: The specific dependence on N, the number of molecules being simulated, is sometimes itself a valuable piece of information. The isotropic phase of liquid crystals provides a case in point. Light scattering and 2d-IR experiments on isotropic-phase samples display increasingly large orientational fluctuations as the samples approach their nematic phase. The growing length scale of those locally ordered domains is readily seen in simulation as an ever slower convergence of the distribution of orientational order parameters with N. The rare-event character of the largest fluctuations make them difficult to sample accurately. We show in this paper how taking a large deviation theory perspective enables us to leverage simulation-derived information more effectively. A key insight of large deviation theory is that extracting the desired measurable, in our case, the extent of orientational order, is completely equivalent to finding the size of the conjugate field required to equilibrate that amount of order - and that knowing the relationship between the two gives us the relative free energy. Indeed, a variety of thermodynamic integration strategies used to evaluate free energy differences in simulation are essentially founded on this idea. However, rather than applying an artificially imposed external field, we use a priori statistical mechanical insights into the small and large-field limits of the equation of state to construct a simulation-guided, interpolated, equation of state. The free energies that result turn out to need simulation information derived mostly from the most probable configurations, rather than from the infrequent events, and therefore use simulation information far more efficiently than conventional methods.


title: Integration of Data Reduction and Near Real-Time Archiving into the Keck Observing Model

abstract: The W. M. Keck Observatory is welcoming a new era where data reduction and archiving are tightly integrated into our observing model, under the auspices of the Observatory's Data Services Initiative (DSI) project. While previously the Keck Observatory Archive (KOA) archived minimally processed, raw science data the day after observing, Keck is transitioning to a model in which it archives both raw frames and reduced data in near real-time. These data will be made available to observers and collaborators immediately upon ingestion through a dedicated new interface that will support collaboration and sharing among teams, as well as stream data directly to personal computers without access to WMKO's internal networks. Both the raw and science-ready data products will be made publicly available upon the expiration of data protections.


title: Classification of Non-native Handwritten Characters Using Convolutional Neural Network

abstract: The use of convolutional neural networks (CNNs) has accelerated the progress of handwritten character classification/recognition. Handwritten character recognition (HCR) has found applications in various domains, such as traffic signal detection, language translation, and document information extraction. However, the widespread use of existing HCR technology is yet to be seen as it does not provide reliable character recognition with outstanding accuracy. One of the reasons for unreliable HCR is that existing HCR methods do not take the handwriting styles of non-native writers into account. Hence, further improvement is needed to ensure the reliability and extensive deployment of character recognition technologies for critical tasks. In this work, the classification of English characters written by non-native users is performed by proposing a custom-tailored CNN model. We train this CNN with a new dataset called the handwritten isolated English character (HIEC) dataset. This dataset consists of 16,496 images collected from 260 persons. This paper also includes an ablation study of our CNN by adjusting hyperparameters to identify the best model for the HIEC dataset. The proposed model with five convolutional layers and one hidden layer outperforms state-of-the-art models in terms of character recognition accuracy and achieves an accuracy of $\mathbf{97.04}$%. Compared with the second-best model, the relative improvement of our model in terms of classification accuracy is $\mathbf{4.38}$%.


title: To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation

abstract: Arabic is known to present unique challenges for Automatic Speech Recognition (ASR). On one hand, its rich linguistic diversity and wide range of dialects complicate the development of robust, inclusive models. On the other, current multilingual ASR models are compute-intensive and lack proper comprehensive evaluations. In light of these challenges, we distill knowledge from large teacher models into smaller student variants that are more efficient. We also introduce a novel human-annotated dataset covering five under-represented Arabic dialects for evaluation. We further evaluate both our models and existing SoTA multilingual models on both standard available benchmarks and our new dialectal data. Our best-distilled model's overall performance ($45.0$\% WER) surpasses that of a SoTA model twice its size (SeamlessM4T-large-v2, WER=$47.0$\%) and its teacher model (Whisper-large-v2, WER=$55.1$\%), and its average performance on our new dialectal data ($56.9$\% WER) outperforms all other models. To gain more insight into the poor performance of these models on dialectal data, we conduct an error analysis and report the main types of errors the different models tend to make. The GitHub repository for the project is available at \url{https://github.com/UBC-NLP/distill-whisper-ar}.


title: Suppression of neutral pion production in deep-inelastic scattering off nuclei with the CLAS detector

abstract: We present the first three-fold differential measurement for neutral pion multiplicity ratios produced in semi-inclusive deep-inelastic electron scattering on carbon, iron and lead nuclei normalized to deuterium from CLAS at Jefferson Lab. We found that the neutral pion multiplicity ratio is maximally suppressed for the leading hadrons (energy fraction z approaching unity), suppression varying from 25% in carbon up to 75% in lead. An enhancement of the multiplicity ratio at low z and high p2T is observed, suggesting an interconnection between these two variables. This behavior is qualitatively similar to the previous two-fold differential measurement of charged pions by the HERMES Collaboration. However, in contrast to the published CLAS and HERMES results on charged pions, the largest enhancement was observed at high pT2 for the lightest nucleus - carbon and the lowest enhancement for the heaviest nucleus - lead. This behavior suggests a competition between partonic multiple scattering, which causes enhancement, and hadronic inelastic scattering, which causes suppression.


title: Magnetic response and antiferromagnetic correlations in strained kagome ribbons

abstract: We study the physics of the strong-coupling Hubbard model in a kagome lattice ribbon under mechanical tension and half-filling. It is known that in the absence of strain, the lattice symmetry of the system and strong electronic interactions induce magnetic frustration. As uniaxial strain is applied, the ribbon exhibits various configurations with energy oscillations that depend on the direction of the strain axis. The ground states are obtained by density matrix enormalization group calculations. We find that the system is characterized by strong antiferromagnetic bonds distributed throughout the lattice along directions and patterns that depend on the strain directions and may coexist with easily polarizable sites that are only weakly correlated to their neighbors. We identify frustration and correlation measures that follow the strain and interaction dependence of the system well. These results illustrate that strain-dependent magnetic susceptibility could be explored experimentally to help probe the role of symmetry and interactions in these systems.


title: Considerations for extracting moir\'e-level strain from dark field intensities in transmission electron microscopy

abstract: Bragg interferometry (BI) is an imaging technique based on four-dimensional scanning electron microscopy (4D-STEM) wherein the intensities of select overlapping Bragg disks are fit or more qualitatively analyzed in the context of simple trigonometric equations to determine local stacking order. In 4D-STEM based approaches, the collection of full diffraction patterns at each real-space position of the scanning probe allows the use of precise virtual apertures much smaller and more variable in shape than those used in conventional dark field imaging, such that even buried interfaces marginally twisted from other layers can be targeted. A coarse-grained form of dark field ptychography, BI uses simple physically derived fitting functions to extract the average structure within the illumination region and is therefore viable over large fields of view. BI has shown a particular advantage for selectively investigating the interlayer stacking and associated moir\'e reconstruction of bilayer interfaces within complex multi-layered structures. This has enabled investigation of reconstruction and substrate effects in bilayers through encapsulating hexagonal boron nitride and of select bilayer interfaces within trilayer stacks. However, the technique can be improved to provide a greater spatial resolution and probe a wider range of twisted structures, for which current limitations on acquisition parameters can lead to large illumination regions and the computationally involved post-processing can fail. Here we analyze these limitations and the computational processing in greater depth, presenting a few methods for improvement over previous works, discussing potential areas for further expansion, and illustrating the current capabilities of this approach for extracting moir\'e-scale strain.


title: Online Joint Fine-tuning of Multi-Agent Flows

abstract: A Flow is a collection of component models (``Agents'') which constructs the solution to a complex problem via iterative communication. Flows have emerged as state of the art architectures for code generation, and are the raison d'etre for frameworks like Autogen. However, flows are currently constructed via a combination of manual prompt engineering and stagewise supervised learning techniques; the latter is limited to acyclic flows with granular node supervision. In this writeup I describe a procedure for online joint fine-tuning of an entire flow inspired by the Learning to Search framework. The approach leverages simulator access to reduce preferences over entire episodes to preferences over individual node outputs; when the components are language models the latter is a well-studied problem. The approach is applicable to reward-free settings (e.g., text feedback) if an episode evaluator model is available. I apply to the multi-hop QA dataset Musique achieving a state-of-the-art result.


title: FOX: Coverage-guided Fuzzing as Online Stochastic Control

abstract: Fuzzing is an effective technique for discovering software vulnerabilities by generating random test inputs and executing them against the target program. However, fuzzing large and complex programs remains challenging due to difficulties in uncovering deeply hidden vulnerabilities. This paper addresses the limitations of existing coverage-guided fuzzers, focusing on the scheduler and mutator components. Existing schedulers suffer from information sparsity and the inability to handle fine-grained feedback metrics. The mutators are agnostic of target program branches, leading to wasted computation and slower coverage exploration. To overcome these issues, we propose an end-to-end online stochastic control formulation for coverage-guided fuzzing. Our approach incorporates a novel scheduler and custom mutator that can adapt to branch logic, maximizing aggregate edge coverage achieved over multiple stages. The scheduler utilizes fine-grained branch distance measures to identify frontier branches, where new coverage is likely to be achieved. The mutator leverages branch distance information to perform efficient and targeted seed mutations, leading to robust progress with minimal overhead. We present FOX, a proof-of-concept implementation of our control-theoretic approach, and compare it to industry-standard coverage-guided fuzzers. 6 CPU-years of extensive evaluations on the FuzzBench dataset and complex real-world programs (a total of 38 test programs) demonstrate that FOX outperforms existing state-of-the-art fuzzers, achieving average coverage improvements up to 26.45% in real-world standalone programs and 6.59% in FuzzBench programs over the state-of-the-art AFL++. In addition, it uncovers 20 unique bugs in popular real-world applications including eight that are previously unknown, showcasing real-world security impact.


title: A novel multivariate regression model for unbalanced binary data : a strong conjugacy under random effect approach

abstract: In this paper, we deduce a new multivariate regression model designed to fit correlated binary data. The multivariate distribution is derived from a Bernoulli mixed model with a nonnormal random intercept on the marginal approach. The random effect distribution is assumed to be the generalized log-gamma (GLG) distribution by considering a particular parameter setting. The complement log-log function is specified to lead to strong conjugacy between the response variable and random effect. The new discrete multivariate distribution, named MBerGLG distribution, has location and dispersion parameters. The MBerGLG distribution leads to the MBerGLG regression (MBerGLGR) model, providing an alternative approach to fitting both unbalanced and balanced correlated response binary data. Monte Carlo simulation studies show that its maximum likelihood estimators are unbiased, efficient, and consistent asymptotically. The randomized quantile residuals are performed to identify possible departures from the proposal model and the data and detect atypical subjects. Finally, two applications are presented in the data analysis section.


title: Multifidelity digital twin for real-time monitoring of structural dynamics in aquaculture net cages

abstract: As the global population grows and climate change intensifies, sustainable food production is critical. Marine aquaculture offers a viable solution, providing a sustainable protein source. However, the industry's expansion requires novel technologies for remote management and autonomous operations. Digital twin technology can advance the aquaculture industry, but its adoption has been limited. Fish net cages, which are flexible floating structures, are critical yet vulnerable components of aquaculture farms. Exposed to harsh and dynamic marine environments, the cages experience significant loads and risk damage, leading to fish escapes, environmental impacts, and financial losses. We propose a multifidelity surrogate modeling framework for integration into a digital twin for real-time monitoring of aquaculture net cage structural dynamics under stochastic marine conditions. Central to this framework is the nonlinear autoregressive Gaussian process method, which learns complex, nonlinear cross-correlations between models of varying fidelity. It combines low-fidelity simulation data with a small set of high-fidelity field sensor measurements, which offer the real dynamics but are costly and spatially sparse. Validated at the SINTEF ACE fish farm in Norway, our digital twin receives online metocean data and accurately predicts net cage displacements and mooring line loads, aligning closely with field measurements. The proposed framework is beneficial where application-specific data are scarce, offering rapid predictions and real-time system representation. The developed digital twin prevents potential damages by assessing structural integrity and facilitates remote operations with unmanned underwater vehicles. Our work also compares GP and GCNs for predicting net cage deformation, highlighting the latter's effectiveness in complex structural applications.


title: NATURAL PLAN: Benchmarking LLMs on Natural Language Planning

abstract: We introduce NATURAL PLAN, a realistic planning benchmark in natural language containing 3 key tasks: Trip Planning, Meeting Planning, and Calendar Scheduling. We focus our evaluation on the planning capabilities of LLMs with full information on the task, by providing outputs from tools such as Google Flights, Google Maps, and Google Calendar as contexts to the models. This eliminates the need for a tool-use environment for evaluating LLMs on Planning. We observe that NATURAL PLAN is a challenging benchmark for state of the art models. For example, in Trip Planning, GPT-4 and Gemini 1.5 Pro could only achieve 31.1% and 34.8% solve rate respectively. We find that model performance drops drastically as the complexity of the problem increases: all models perform below 5% when there are 10 cities, highlighting a significant gap in planning in natural language for SoTA LLMs. We also conduct extensive ablation studies on NATURAL PLAN to further shed light on the (in)effectiveness of approaches such as self-correction, few-shot generalization, and in-context planning with long-contexts on improving LLM planning.


title: The Gaussian Multiple Access Wiretap Channel with Selfish Transmitters: A Coalitional Game Theory Perspective

abstract: This paper considers the Gaussian multiple access wiretap channel (GMAC-WT) with selfish transmitters, i.e., who are each solely interested in maximizing their individual secrecy rate. The question then arises as to whether selfish transmitters can increase their individual secrecy rate by participating in a collective, i.e., multiple access, protocol instead of operating on their own. If yes, the question arises whether there is a protocol that satisfies all the participating transmitters simultaneously, in the sense that no transmitter has an incentive to deviate from the protocol. Utilizing coalitional game theory, these questions are addressed for the degraded GMAC-WT with an arbitrary number of transmitters and for the non-degraded GMAC-WT with two transmitters. In particular, for the degraded GMAC-WT, cooperation is shown to be in the best interest of all transmitters, and the existence of protocols that incentivize all transmitters to participate is established. Furthermore, a unique, fair, stable, and achievable secrecy rate allocation is determined. For the non-degraded GMAC-WT, depending on the channel parameters, there are cases where cooperation is not in the best interest of all transmitters, and cases where it is. In the latter cases, a unique, fair, stable, and achievable secrecy rate allocation is determined.


title: Selective temperature sensing in nanodiamonds using dressed states

abstract: Temperature sensing at the nanoscale is a significant experimental challenge. Here, we report an approach using dressed states to make a leading quantum sensor (the nitrogen vacancy (NV) center in diamond) selectively sensitive to temperature, even in the presence of normally-confounding magnetic fields. Using an experimentally straightforward approach, we are able to suppress the magnetic sensitivity of the NV center by a factor of seven while retaining full temperature sensitivity and narrowing the NV center linewidth. These results demonstrate the power of engineering the sensor Hamiltonian using external control fields to enable sensing with improved specificity to target signals.


title: Proofread: Fixes All Errors with One Tap

abstract: The impressive capabilities in Large Language Models (LLMs) provide a powerful approach to reimagine users' typing experience. This paper demonstrates Proofread, a novel Gboard feature powered by a server-side LLM in Gboard, enabling seamless sentence-level and paragraph-level corrections with a single tap. We describe the complete system in this paper, from data generation, metrics design to model tuning and deployment. To obtain models with sufficient quality, we implement a careful data synthetic pipeline tailored to online use cases, design multifaceted metrics, employ a two-stage tuning approach to acquire the dedicated LLM for the feature: the Supervised Fine Tuning (SFT) for foundational quality, followed by the Reinforcement Learning (RL) tuning approach for targeted refinement. Specifically, we find sequential tuning on Rewrite and proofread tasks yields the best quality in SFT stage, and propose global and direct rewards in the RL tuning stage to seek further improvement. Extensive experiments on a human-labeled golden set showed our tuned PaLM2-XS model achieved 85.56\% good ratio. We launched the feature to Pixel 8 devices by serving the model on TPU v5 in Google Cloud, with thousands of daily active users. Serving latency was significantly reduced by quantization, bucket inference, text segmentation, and speculative decoding. Our demo could be seen in \href{https://youtu.be/4ZdcuiwFU7I}{Youtube}.


title: Spin Dynamics of the Centrosymmetric Skyrmion Material GdRu2Si2

abstract: Magnetic skyrmion crystals are traditionally associated with non-centrosymmetric crystal structures; however, it has been demonstrated that skyrmion crystals can be stabilized by competing interactions in centrosymmetric crystals. To understand and optimize the physical responses associated with topologically-nontrivial skyrmion textures, it is important to quantify their magnetic interactions by comparing theoretical predictions with spectroscopic data. Here, we present neutron diffraction and spectroscopy data on the centrosymmetric skyrmion material GdRu$_2$Si$_2$, and show that the key spectroscopic features can be explained by the magnetic interactions calculated using density-functional theory calculations. We further show that the recently-proposed 2-$\mathbf{q}$ "topological spin stripe" structure yields better agreement with our data than a 1-$\mathbf{q}$ helical structure, and identify how the magnetic structure evolves with temperature.


title: (In)stability of the black hole greybody factors and ringdowns against a small-bump correction

abstract: Recently, it has been proposed that the black hole greybody factors can be important to model ringdown spectral amplitudes. We study the stability of greybody factors against a small-bump correction in the perturbation equation. We find (I) that the greybody factor is stable in the frequency region relevant to ringdown and (II) that it is destabilized at higher frequencies, especially for a sharper bump correction. This behavior is similar to the case of higher overtones, which is also very sensitive to a small correction. We clarify this (in)stability with the WKB analysis. As the greybody factor is stable at the frequency region relevant to the main part of ringdown, we conclude that the greybody factor is suitable to model ringdown amplitude. In order to investigate a bump correction in a self-consistent manner, we consider the small-bump correction that can be realized in the general framework of effective field theory of black hole perturbations.


title: Phase transition of the consistent maximal displacement of branching Brownian motion

abstract: Consider branching Brownian motion in which we begin with one particle at the origin, particles independently move according to Brownian motion, and particles split into two at rate one. It is well-known that the right-most particle at time $t$ will be near $\sqrt{2} t$. Roberts considered the so-called consistent maximal displacement and showed that with high probability, there will be a particle at time $t$ whose ancestors stayed within a distance $ct^{1/3}$ of the curve $s \mapsto \sqrt{2} s$ for all $s \in [0, t]$, where $c = (3 \pi^2)^{1/3}/\sqrt{2}$. We consider the question of how close the trajectory of a particle can stay to the curve $s \mapsto (\sqrt{2} + \varepsilon) s$ for all $s \in [0, t]$, where $\varepsilon> 0$ is small. We find that there is a phase transition, with the behavior changing when $t$ is of the order $\varepsilon^{-3/2}$. This result allows us to determine, for branching Brownian motion in which particles have a drift to the left of $\sqrt{2} + \varepsilon$ and are killed at the origin, the position at which a particle needs to begin at time zero for there to be a high probability that the process avoids extinction until time $t$.


title: Generative Assignment Flows for Representing and Learning Joint Distributions of Discrete Data

abstract: We introduce a novel generative model for the representation of joint probability distributions of a possibly large number of discrete random variables. The approach uses measure transport by randomized assignment flows on the statistical submanifold of factorizing distributions, which also enables to sample efficiently from the target distribution and to assess the likelihood of unseen data points. The embedding of the flow via the Segre map in the meta-simplex of all discrete joint distributions ensures that any target distribution can be represented in principle, whose complexity in practice only depends on the parametrization of the affinity function of the dynamical assignment flow system. Our model can be trained in a simulation-free manner without integration by conditional Riemannian flow matching, using the training data encoded as geodesics in closed-form with respect to the e-connection of information geometry. By projecting high-dimensional flow matching in the meta-simplex of joint distributions to the submanifold of factorizing distributions, our approach has strong motivation from first principles of modeling coupled discrete variables. Numerical experiments devoted to distributions of structured image labelings demonstrate the applicability to large-scale problems, which may include discrete distributions in other application areas. Performance measures show that our approach scales better with the increasing number of classes than recent related work.


title: llmNER: (Zero|Few)-Shot Named Entity Recognition, Exploiting the Power of Large Language Models

abstract: Large language models (LLMs) allow us to generate high-quality human-like text. One interesting task in natural language processing (NLP) is named entity recognition (NER), which seeks to detect mentions of relevant information in documents. This paper presents llmNER, a Python library for implementing zero-shot and few-shot NER with LLMs; by providing an easy-to-use interface, llmNER can compose prompts, query the model, and parse the completion returned by the LLM. Also, the library enables the user to perform prompt engineering efficiently by providing a simple interface to test multiple variables. We validated our software on two NER tasks to show the library's flexibility. llmNER aims to push the boundaries of in-context learning research by removing the barrier of the prompting and parsing steps.