title: InstructRAG: Instructing Retrieval-Augmented Generation with Explicit Denoising

abstract: Retrieval-augmented generation (RAG) has shown promising potential to enhance the accuracy and factuality of language models (LMs). However, imperfect retrievers or noisy corpora can introduce misleading or even erroneous information to the retrieved contents, posing a significant challenge to the generation quality. Existing RAG methods typically address this challenge by directly predicting final answers despite potentially noisy inputs, resulting in an implicit denoising process that is difficult to interpret and verify. On the other hand, the acquisition of explicit denoising supervision is often costly, involving significant human efforts. In this work, we propose InstructRAG, where LMs explicitly learn the denoising process through self-synthesized rationales -- First, we instruct the LM to explain how the ground-truth answer is derived from retrieved documents. Then, these rationales can be used either as demonstrations for in-context learning of explicit denoising or as supervised fine-tuning data to train the model. Compared to standard RAG approaches, InstructRAG requires no additional supervision, allows for easier verification of the predicted answers, and effectively improves generation accuracy. Experiments show InstructRAG consistently outperforms existing RAG methods in both training-free and trainable scenarios, achieving a relative improvement of 8.3% over the best baseline method on average across five knowledge-intensive benchmarks. Extensive analysis indicates that InstructRAG scales well with increased numbers of retrieved documents and consistently exhibits robust denoising ability even in out-of-domain datasets, demonstrating strong generalizability.


title: AGZT-Lectures on formal multiple zeta values

abstract: Formal multiple zeta values allow to study multiple zeta values by algebraic methods in a way that the open question about their transcendence is circumvented. In this note we show that Hoffman's basis conjecture for formal multiple zeta values is implied by the free odd generation conjecture for the double shuffle Lie algebra. We use the concept of a post-Lie structure for a convenient approach to the multiplication on the double shuffle group. From this, we get a coaction on the algebra of formal multiple zeta values. This in turn allows us to follow the proof of Brown's celebrated and unconditional theorem for the same result in the context of motivic multiple zeta values. We need the free odd generation conjecture twice: at first it gives a formula for the graded dimensions and secondly it is a key to derive a lift of the Zagier formula to the formal context.


title: On AI-Inspired UI-Design

abstract: Graphical User Interface (or simply UI) is a primary mean of interaction between users and their device. In this paper, we discuss three major complementary approaches on how to use Artificial Intelligence (AI) to support app designers create better, more diverse, and creative UI of mobile apps. First, designers can prompt a Large Language Model (LLM) like GPT to directly generate and adjust one or multiple UIs. Second, a Vision-Language Model (VLM) enables designers to effectively search a large screenshot dataset, e.g. from apps published in app stores. The third approach is to train a Diffusion Model (DM) specifically designed to generate app UIs as inspirational images. We discuss how AI should be used, in general, to inspire and assist creative app design rather than automating it.


title: Can Few-shot Work in Long-Context? Recycling the Context to Generate Demonstrations

abstract: Despite recent advancements in Large Language Models (LLMs), their performance on tasks involving long contexts remains sub-optimal. In-Context Learning (ICL) with few-shot examples may be an appealing solution to enhance LLM performance in this scenario; However, naively adding ICL examples with long context introduces challenges, including substantial token overhead added for each few-shot example and context mismatch between the demonstrations and the target query. In this work, we propose to automatically generate few-shot examples for long context QA tasks by recycling contexts. Specifically, given a long input context (1-3k tokens) and a query, we generate additional query-output pairs from the given context as few-shot examples, while introducing the context only once. This ensures that the demonstrations are leveraging the same context as the target query while only adding a small number of tokens to the prompt. We further enhance each demonstration by instructing the model to explicitly identify the relevant paragraphs before the answer, which improves performance while providing fine-grained attribution to the answer source. We apply our method on multiple LLMs and obtain substantial improvements (+23\% on average across models) on various QA datasets with long context, especially when the answer lies within the middle of the context. Surprisingly, despite introducing only single-hop ICL examples, LLMs also successfully generalize to multi-hop long-context QA using our approach.


title: Reinforcement Learning for Infinite-Horizon Average-Reward MDPs with Multinomial Logistic Function Approximation

abstract: We study model-based reinforcement learning with non-linear function approximation where the transition function of the underlying Markov decision process (MDP) is given by a multinomial logistic (MNL) model. In this paper, we develop two algorithms for the infinite-horizon average reward setting. Our first algorithm \texttt{UCRL2-MNL} applies to the class of communicating MDPs and achieves an $\tilde{\mathcal{O}}(dD\sqrt{T})$ regret, where $d$ is the dimension of feature mapping, $D$ is the diameter of the underlying MDP, and $T$ is the horizon. The second algorithm \texttt{OVIFH-MNL} is computationally more efficient and applies to the more general class of weakly communicating MDPs, for which we show a regret guarantee of $\tilde{\mathcal{O}}(d^{2/5} \mathrm{sp}(v^*)T^{4/5})$ where $\mathrm{sp}(v^*)$ is the span of the associated optimal bias function. We also prove a lower bound of $\Omega(d\sqrt{DT})$ for learning communicating MDPs with MNL transitions of diameter at most $D$. Furthermore, we show a regret lower bound of $\Omega(dH^{3/2}\sqrt{K})$ for learning $H$-horizon episodic MDPs with MNL function approximation where $K$ is the number of episodes, which improves upon the best-known lower bound for the finite-horizon setting.


title: Intertwined superconductivity and orbital selectivity in a three-orbital Hubbard model for the iron pnictides

abstract: We study a three-orbital Hubbard-Kanamori model relevant for iron-based superconductors using variational wave functions, which explicitly include spatial correlations and electron pairing. We span the nonmagnetic sector ranging from a filling $n=4$, which is representative of undoped iron-based superconductors, to $n=3$. In the latter case, a Mott insulating state is found, with each orbital at half filling. In the strong-coupling regime, when the electron density is increased, we find a spontaneous differentiation between the occupation of $d_{xz}$ and $d_{yz}$ orbitals, which leads to an orbital-selective state with a nematic character that becomes stronger at increasing density. One of these orbitals stays half filled for all densities while the other one hosts (together with the $d_{xy}$ orbital) the excess of electron density. Most importantly, in this regime, long-range pairing correlations appear in the orbital with the largest occupation. Our results highlight a strong link between orbital-selective correlations, nematicity, and superconductivity, which requires the presence of a significant Hund's coupling.


title: Temporal label recovery from noisy dynamical data

abstract: Analyzing dynamical data often requires information of the temporal labels, but such information is unavailable in many applications. Recovery of these temporal labels, closely related to the seriation or sequencing problem, becomes crucial in the study. However, challenges arise due to the nonlinear nature of the data and the complexity of the underlying dynamical system, which may be periodic or non-periodic. Additionally, noise within the feature space complicates the theoretical analysis. Our work develops spectral algorithms that leverage manifold learning concepts to recover temporal labels from noisy data. We first construct the graph Laplacian of the data, and then employ the second (and the third) Fiedler vectors to recover temporal labels. This method can be applied to both periodic and aperiodic cases. It also does not require monotone properties on the similarity matrix, which are commonly assumed in existing spectral seriation algorithms. We develop the $\ell_{\infty}$ error of our estimators for the temporal labels and ranking, without assumptions on the eigen-gap. In numerical analysis, our method outperforms spectral seriation algorithms based on a similarity matrix. The performance of our algorithms is further demonstrated on a synthetic biomolecule data example.


title: Contrast Sets for Evaluating Language-Guided Robot Policies

abstract: Robot evaluations in language-guided, real world settings are time-consuming and often sample only a small space of potential instructions across complex scenes. In this work, we introduce contrast sets for robotics as an approach to make small, but specific, perturbations to otherwise independent, identically distributed (i.i.d.) test instances. We investigate the relationship between experimenter effort to carry out an evaluation and the resulting estimated test performance as well as the insights that can be drawn from performance on perturbed instances. We use contrast sets to characterize policies at reduced experimenter effort in both a simulated manipulation task and a physical robot vision-and-language navigation task. We encourage the use of contrast set evaluations as a more informative alternative to small scale, i.i.d. demonstrations on physical robots, and as a scalable alternative to industry-scale real world evaluations.


title: The Source of Hydrogen in Earth's Building Blocks

abstract: Despite being pivotal to the habitability of our planet, the process by which Earth gained its present-day hydrogen budget is unclear. Due to their isotopic similarity to terrestrial rocks across a range of elements, enstatite chondrites (ECs) are thought to be the meteorites that best represent Earth's building blocks. Because of ECs' nominally anhydrous mineralogy, these building blocks have long been presumed to have supplied negligible hydrogen to the proto-Earth. Instead, hydrogen has been proposed to have been delivered to our planet after its main stage of formation by impacts from hydrated asteroids. In this case, our planet's habitability would have its origins in a stochastic process. However, ECs have recently been found to unexpectedly contain enough hydrogen to readily explain Earth's present-day water budget. Although this result would transform the processes we believe are required for rocky planets to be suitable to life, the mineralogical source of ~80% of hydrogen in these meteorites was previously unknown. As such, the reason ECs are seemingly rich in hydrogen was unclear. Here, we apply sulfur X-ray absorption near edge structure (S-XANES) spectroscopy to ECs, finding that most (~70%) of their hydrogen is bonded to sulfur. Moreover, the concentration of the S-H bond is intimately linked to the abundance of micrometre-scale pyrrhotite (Fe1-xS, 0<x<0.125), suggesting most hydrogen in these meteorites is carried in this phase. These findings elucidate the presence of hydrogen in Earth's building blocks, providing the key evidence that unlocks a systematic, rather than stochastic, origin of Earth's hydrogen.


title: XENONnT WIMP Search: Signal & Background Modeling and Statistical Inference

abstract: The XENONnT experiment searches for weakly-interacting massive particle (WIMP) dark matter scattering off a xenon nucleus. In particular, XENONnT uses a dual-phase time projection chamber with a 5.9-tonne liquid xenon target, detecting both scintillation and ionization signals to reconstruct the energy, position, and type of recoil. A blind search for nuclear recoil WIMPs with an exposure of 1.1 tonne-years yielded no signal excess over background expectations, from which competitive exclusion limits were derived on WIMP-nucleon elastic scatter cross sections, for WIMP masses ranging from 6 GeV/$c^2$ up to the TeV/$c^2$ scale. This work details the modeling and statistical methods employed in this search. By means of calibration data, we model the detector response, which is then used to derive background and signal models. The construction and validation of these models is discussed, alongside additional purely data-driven backgrounds. We also describe the statistical inference framework, including the definition of the likelihood function and the construction of confidence intervals.

categories: physics.data-an astro-ph.IM hep-ex physics.ins-det


title: Universal Role of Combined Symmetry for the Protection of the Dirac Cone in Antiferromagnetic Topological Insulators

abstract: Antiferromagnetic topological insulators (AF TIs) are predicted to exhibit exotic physical properties such as gigantic optical and topological magnetoelectric responses. While a key to achieving such phenomena relies on how to break the symmetry protecting the Dirac-cone surface state (SS) and acquire the mass of Dirac fermions, the mechanism has yet to be clarified. To address this issue, we carried out micro-focused angle-resolved photoemission spectroscopy for GdBi hosting the type-II AF order, and uncovered the stripe-type 2$\times$1 reconstruction of the Fermi surface associated with the AF band folding. Intriguingly, in contrast to NdBi with the type-I AF order displaying the surface-selective Dirac-fermion mass, GdBi shows massless behavior irrespective of AF domains due to the robust topological protection. These results strongly suggest a crucial role of the ThetaTD (time-reversal and translational) symmetry to create the Dirac-fermion mass in AF TIs.


title: Transferable Tactile Transformers for Representation Learning Across Diverse Sensors and Tasks

abstract: This paper presents T3: Transferable Tactile Transformers, a framework for tactile representation learning that scales across multi-sensors and multi-tasks. T3 is designed to overcome the contemporary issue that camera-based tactile sensing is extremely heterogeneous, i.e. sensors are built into different form factors, and existing datasets were collected for disparate tasks. T3 captures the shared latent information across different sensor-task pairings by constructing a shared trunk transformer with sensor-specific encoders and task-specific decoders. The pre-training of T3 utilizes a novel Foundation Tactile (FoTa) dataset, which is aggregated from several open-sourced datasets and it contains over 3 million data points gathered from 13 sensors and 11 tasks. FoTa is the largest and most diverse dataset in tactile sensing to date and it is made publicly available in a unified format. Across various sensors and tasks, experiments show that T3 pre-trained with FoTa achieved zero-shot transferability in certain sensor-task pairings, can be further fine-tuned with small amounts of domain-specific data, and its performance scales with bigger network sizes. T3 is also effective as a tactile encoder for long horizon contact-rich manipulation. Results from sub-millimeter multi-pin electronics insertion tasks show that T3 achieved a task success rate 25% higher than that of policies trained with tactile encoders trained from scratch, or 53% higher than without tactile sensing. Data, code, and model checkpoints are open-sourced at https://t3.alanz.info.


title: Minimalist exploration strategies for robot swarms at the edge of chaos

abstract: Effective exploration abilities are fundamental for robot swarms, especially when small, inexpensive robots are employed (e.g., micro- or nano-robots). Random walks are often the only viable choice if robots are too constrained regarding sensors and computation to implement state-of-the-art solutions. However, identifying the best random walk parameterisation may not be trivial. Additionally, variability among robots in terms of motion abilities-a very common condition when precise calibration is not possible-introduces the need for flexible solutions. This study explores how random walks that present chaotic or edge-of-chaos dynamics can be generated. We also evaluate their effectiveness for a simple exploration task performed by a swarm of simulated Kilobots. First, we show how Random Boolean Networks can be used as controllers for the Kilobots, achieving a significant performance improvement compared to the best parameterisation of a L\'evy-modulated Correlated Random Walk. Second, we demonstrate how chaotic dynamics are beneficial to maximise exploration effectiveness. Finally, we demonstrate how the exploration behavior produced by Boolean Networks can be optimized through an Evolutionary Robotics approach while maintaining the chaotic dynamics of the networks.


title: SpatialBot: Precise Spatial Understanding with Vision Language Models

abstract: Vision Language Models (VLMs) have achieved impressive performance in 2D image understanding, however they are still struggling with spatial understanding which is the foundation of Embodied AI. In this paper, we propose SpatialBot for better spatial understanding by feeding both RGB and depth images. Additionally, we have constructed the SpatialQA dataset, which involves multi-level depth-related questions to train VLMs for depth understanding. Finally, we present SpatialBench to comprehensively evaluate VLMs' capabilities in spatial understanding at different levels. Extensive experiments on our spatial-understanding benchmark, general VLM benchmarks and Embodied AI tasks, demonstrate the remarkable improvements of SpatialBot trained on SpatialQA. The model, code and data are available at https://github.com/BAAI-DCAI/SpatialBot.


title: Geometry of Classical Nambu-Goldstone Fields

abstract: A coordinate-free formulation of first order effective field theory, in which Nambu-Goldstone fields are described as sections on associated bundle, is presented. This construction, which is based only on symmetry considerations, allows for a direct derivation of number and types of Nambu-Goldstone fields in a classical field theory without any reference to effective Lagrangian. A central role in classification is shown to be played by Lorentz-symmetry breaking order parameter which induces symplectic structure in the field space of the theory.


title: Kinetic Monte Carlo methods for three-dimensional diffusive capture problems in exterior domains

abstract: Cellular scale decision making is modulated by the dynamics of signalling molecules and their diffusive trajectories from a source to small absorbing sites on the cellular surface. Diffusive capture problems are computationally challenging due to the complex geometry and the applied boundary conditions together with intrinsically long transients that occur before a particle is captured. This paper reports on a particle-based Kinetic Monte Carlo (KMC) method that provides rapid accurate simulation of arrival statistics for (i) a half-space bounded by a surface with a finite collection of absorbing traps and (ii) the domain exterior to a convex cell again with absorbing traps. We validate our method by replicating classical results and in addition, newly developed boundary homogenization theories and matched asymptotic expansions on capture rates. In the case of non-spherical domains, we describe a new shielding effect in which geometry can play a role in sharpening cellular estimates on the directionality of diffusive sources.

categories: math.NA cs.NA math.AP physics.bio-ph q-bio.QM


title: Advancing UWF-SLO Vessel Segmentation with Source-Free Active Domain Adaptation and a Novel Multi-Center Dataset

abstract: Accurate vessel segmentation in Ultra-Wide-Field Scanning Laser Ophthalmoscopy (UWF-SLO) images is crucial for diagnosing retinal diseases. Although recent techniques have shown encouraging outcomes in vessel segmentation, models trained on one medical dataset often underperform on others due to domain shifts. Meanwhile, manually labeling high-resolution UWF-SLO images is an extremely challenging, time-consuming and expensive task. In response, this study introduces a pioneering framework that leverages a patch-based active domain adaptation approach. By actively recommending a few valuable image patches by the devised Cascade Uncertainty-Predominance (CUP) selection strategy for labeling and model-finetuning, our method significantly improves the accuracy of UWF-SLO vessel segmentation across diverse medical centers. In addition, we annotate and construct the first Multi-center UWF-SLO Vessel Segmentation (MU-VS) dataset to promote this topic research, comprising data from multiple institutions. This dataset serves as a valuable resource for cross-center evaluation, verifying the effectiveness and robustness of our approach. Experimental results demonstrate that our approach surpasses existing domain adaptation and active learning methods, considerably reducing the gap between the Upper and Lower bounds with minimal annotations, highlighting our method's practical clinical value. We will release our dataset and code to facilitate relevant research: https://github.com/whq-xxh/SFADA-UWF-SLO.


title: Traveling Fronts and the Smoothing of the Collective-Motion Phase Transition in Vibrated Polar Disks

abstract: One of the most well known features of active matter is the tendencey of self-propelled particles to undergo system-wide collective motion. With low enough rotational noise or high enough global density, these systems spontaneously break symmetry and transition to a state with nonzero net momentum. The transition is currently understood as discontinuous, with phase coexistence manifesting in terms of dense travelling bands propagating through a dilute background. Here we show that the phase transition appears continuous in experiments with a system of hundreds of polar vibrated disks, and compare the fluctuations in this system to the traveling bands that are present in larger systems. We argue that this difference is due to finite size effects, which are often considered an artifact of simulations in studies with equilibrium systems, but that are of fundamental importance in many systems of self-propelled particles such as those composed of living individuals.


title: Inner automorphisms as 2-cells

abstract: Abstract inner automorphisms can be used to promote any category into a 2-category, and we study two-dimensional limits and colimits in the resulting 2-categories. Existing connected colimits and limits in the starting category become two-dimensional colimits and limits under fairly general conditions. Under the same conditions, colimits in the underlying category can be used to build many notable two-dimensional colimits such as coequifiers and coinserters. In contrast, disconnected colimits or genuinely 2-categorical limits such as inserters and equifiers and cotensors cannot exist unless no nontrivial abstract inner automorphisms exist and the resulting 2-category is locally discrete. We also study briefly when an ordinary functor can be extended to a 2-functor between the resulting 2-categories.


title: Why Matthiessen's rule is violated in the high-$T_{c}$ cuprate superconductors?

abstract: The perfect linear-in-$T$ dc resistivity in the strange metal phase of the high-$T_{c}$ cuprate superconductors is probably the most prominent manifestation of their non-Fermi liquid nature. A major puzzle about the strange metal behavior is that there is no discernible change in the trend of the dc resistivity at a temperature when we expect the electron-phonon coupling to play an essential role. The empirical Matthiessen's rule of summation of the resistivity from different scattering channels seems to be simply violated. On the other hand, the electron-phonon coupling has long been proposed to be responsible for the various spectral anomalies observed in the cuprate superconductors. In particular, the $B_{1g}$ buckling mode of the oxygen ion in the $CuO_{2}$ plane is proposed to be responsible for the peak-dip-hump spectral shape around the anti-nodal point. Here we show that the coupling to the $B_{1g}$ buckling mode is strongly suppressed by the vertex correction from the antiferromagnetic spin fluctuation in the system as a result of the destructive interference between electron-phonon matrix element at momentum differ by the antiferromagnetic wave vector. In the real space scenario, such a destructive interference effect simply amounts to the fact that the electron hopping between nearest-neighboring sites is suppressed by the antiferromagnetic spin correlation between the electrons. More generally, we argue that the electron-phonon coupling strength in the cuprate superconductors should diminish with the proximity of the Mott insulating phase as a result of similar vertex correction from the electron correlation effect. We think that this offers an interpretation for the violation of the Matthiessen's rule in the dc resistivity of the strange metal phase of the cuprate superconductors.


title: Competition of vortex core structures in superfluid $^3$He-B

abstract: Among vortex structures identified so far in superfluid $^3$He-B, the most common are the A-phase-core vortex and the double-core vortex. According to earlier numerical calculations, the double-core vortex is energetically favored nearly everywhere in the $p$-$T$ phase diagram. Nevertheless, in experiments the A-phase-core vortex has been observed down to temperatures of $0.6T_{\mathrm{c}}$ at high pressures. We use the Ginzburg-Landau formalism to calculate the energies of the two vortex structures in the experimentally relevant magnetic field as well as the energy barrier for the transition between the two structures. Assigning vanishing barrier as the boundary of the metastability region of the A-phase-core vortex, we reproduce the experimentally measured vortex phase diagram and provide an explanation for the reappearance of the double-core vortex near the critical temperature $T_{\mathrm{c}}$ at low pressures: The difference in Zeeman energy between the two vortex structures becomes relatively more important close to $T_{\mathrm{c}}$, and the A-phase-core vortex becomes unstable. In contrast to the equilibrium vortex structures, we suggest that the vortex nucleation process favors the A-phase-core vortex over the double-core vortex. Our approach can be used to analyze competition between different vortex structures in other unconventional superfluids and superconductors.


title: Advanced Maximum Adhesion Tracking Strategies in Railway Traction Drives

abstract: Modern railway traction systems are often equipped with anti-slip control strategies to comply with performance and safety requirements. A certain amount of slip is needed to increase the torque transferred by the traction motors onto the rail. Commonly, constant slip control is used to limit the slip velocity between the wheel and rail avoiding excessive slippage and vehicle derailment. This is at the price of not fully utilizing the train's traction and braking capabilities. Finding the slip at which maximum traction force occurs is challenging due to the non-linear relationship between slip and wheel-rail adhesion coefficient, as well as to its dependence on rail and wheel conditions. Perturb and observe (P\&O) and steepest gradient (SG) methods have been reported for the Maximum Adhesion Tracking (MAT) search. However, both methods exhibit weaknesses. Two new MAT strategies are proposed in this paper which overcome the limitations of existing methods, using Fuzzy Logic Controller (FLC) and Particle Swarm Optimization (PSO) respectively. Existing and proposed methods are first simulated and further validated experimentally using a scaled roller rig under identical conditions. The results show that the proposed methods improve the traction capability with lower searching time and oscillations compared to existing solutions. Tuning complexity and computational requirements will also be shown to be favorable to the proposed methods.


title: CLAMP: Majorized Plug-and-Play for Coherent 3D LIDAR Imaging

abstract: Coherent LIDAR uses a chirped laser pulse for 3D imaging of distant targets. However, existing coherent LIDAR image reconstruction methods do not account for the system's aperture, resulting in sub-optimal resolution. Moreover, these methods use majorization-minimization for computational efficiency, but do so without a theoretical treatment of convergence. In this paper, we present Coherent LIDAR Aperture Modeled Plug-and-Play (CLAMP) for multi-look coherent LIDAR image reconstruction. CLAMP uses multi-agent consensus equilibrium (a form of PnP) to combine a neural network denoiser with an accurate physics-based forward model. CLAMP introduces an FFT-based method to account for the effects of the aperture and uses majorization of the forward model for computational efficiency. We also formalize the use of majorization-minimization in consensus optimization problems and prove convergence to the exact consensus equilibrium solution. Finally, we apply CLAMP to synthetic and measured data to demonstrate its effectiveness in producing high-resolution, speckle-free, 3D imagery.


title: Stability and Generalizability in SDE Diffusion Models with Measure-Preserving Dynamics

abstract: Inverse problems describe the process of estimating the causal factors from a set of measurements or data. Mapping of often incomplete or degraded data to parameters is ill-posed, thus data-driven iterative solutions are required, for example when reconstructing clean images from poor signals. Diffusion models have shown promise as potent generative tools for solving inverse problems due to their superior reconstruction quality and their compatibility with iterative solvers. However, most existing approaches are limited to linear inverse problems represented as Stochastic Differential Equations (SDEs). This simplification falls short of addressing the challenging nature of real-world problems, leading to amplified cumulative errors and biases. We provide an explanation for this gap through the lens of measure-preserving dynamics of Random Dynamical Systems (RDS) with which we analyse Temporal Distribution Discrepancy and thus introduce a theoretical framework based on RDS for SDE diffusion models. We uncover several strategies that inherently enhance the stability and generalizability of diffusion models for inverse problems and introduce a novel score-based diffusion framework, the \textbf{D}ynamics-aware S\textbf{D}E \textbf{D}iffusion \textbf{G}enerative \textbf{M}odel (D$^3$GM). The \textit{Measure-preserving property} can return the degraded measurement to the original state despite complex degradation with the RDS concept of \textit{stability}. Our extensive experimental results corroborate the effectiveness of D$^3$GM across multiple benchmarks including a prominent application for inverse problems, magnetic resonance imaging. Code and data will be publicly available.


title: Controlling Forgetting with Test-Time Data in Continual Learning

abstract: Foundational vision-language models have shown impressive performance on various downstream tasks. Yet, there is still a pressing need to update these models later as new tasks or domains become available. Ongoing Continual Learning (CL) research provides techniques to overcome catastrophic forgetting of previous information when new knowledge is acquired. To date, CL techniques focus only on the supervised training sessions. This results in significant forgetting yielding inferior performance to even the prior model zero shot performance. In this work, we argue that test-time data hold great information that can be leveraged in a self supervised manner to refresh the model's memory of previous learned tasks and hence greatly reduce forgetting at no extra labelling cost. We study how unsupervised data can be employed online to improve models' performance on prior tasks upon encountering representative samples. We propose a simple yet effective student-teacher model with gradient based sparse parameters updates and show significant performance improvements and reduction in forgetting, which could alleviate the role of an offline episodic memory/experience replay buffer.


title: Inspiral-merger-ringdown waveforms in Einstein-scalar-Gauss-Bonnet gravity within the effective-one-body formalism

abstract: Gravitational waves (GWs) provide a unique opportunity to test General Relativity (GR) in the highly dynamical, strong-field regime. So far, the majority of the tests of GR with GW signals have been carried out following parametrized, theory-independent approaches. An alternative avenue consists in developing inspiral-merger-ringdown (IMR) waveform models in specific beyond-GR theories of gravity, by combining analytical and numerical-relativity results. In this work, we provide the first example of a full IMR waveform model in a beyond-GR theory, focusing on Einstein-scalar-Gauss-Bonnet (ESGB) gravity. This theory has attracted particular attention due to its rich phenomenology for binary black-hole (BH) mergers, thanks to the presence of non-trivial scalar fields. Starting from the state-of-the art, effective-one-body (EOB) multipolar waveform model for spin-precessing binary BHs SEOBNRv5PHM, we include theory-specific corrections to the EOB Hamiltonian, the metric and scalar energy fluxes, the GW modes, the quasi-normal-mode (QNM) spectrum and the mass and spin of the remnant BH. We also propose a way to marginalize over the uncertainty in the merger morphology with additional nuisance parameters. Interestingly, we observe that changes in the frequency of the ringdown waveform due to the final mass and spin corrections are significantly larger than those due to ESGB corrections to the QNM spectrum. By performing Bayesian parameter estimation for the GW events GW190412, GW190814 and GW230529_181500, we place constraints on the fundamental coupling of the theory ($\sqrt{\alpha_{\mathrm{GB}}} \lesssim 0.31~\mathrm{km}$ at 90% confidence). The bound could be improved by one order of magnitude by observing a single "golden" binary system with next-generation ground-based GW detectors.


title: Improving GFlowNets with Monte Carlo Tree Search

abstract: Generative Flow Networks (GFlowNets) treat sampling from distributions over compositional discrete spaces as a sequential decision-making problem, training a stochastic policy to construct objects step by step. Recent studies have revealed strong connections between GFlowNets and entropy-regularized reinforcement learning. Building on these insights, we propose to enhance planning capabilities of GFlowNets by applying Monte Carlo Tree Search (MCTS). Specifically, we show how the MENTS algorithm (Xiao et al., 2019) can be adapted for GFlowNets and used during both training and inference. Our experiments demonstrate that this approach improves the sample efficiency of GFlowNet training and the generation fidelity of pre-trained GFlowNet models.


title: Tactical Game-theoretic Decision-making with Homotopy Class Constraints

abstract: We propose a tactical homotopy-aware decision-making framework for game-theoretic motion planning in urban environments. We model urban driving as a generalized Nash equilibrium problem and employ a mixed-integer approach to tame the combinatorial aspect of motion planning. More specifically, by utilizing homotopy classes, we partition the high-dimensional solution space into finite, well-defined subregions. Each subregion (homotopy) corresponds to a high-level tactical decision, such as the passing order between pairs of players. The proposed formulation allows to find global optimal Nash equilibria in a computationally tractable manner by solving a mixed-integer quadratic program. Each homotopy decision is represented by a binary variable that activates different sets of linear collision avoidance constraints. This extra homotopic constraint allows to find solutions in a more efficient way (on a roundabout scenario on average 5-times faster). We experimentally validate the proposed approach on scenarios taken from the rounD dataset. Simulation-based testing in receding horizon fashion demonstrates the capability of the framework in achieving globally optimal solutions while yielding a 78% average decrease in the computational time with respect to an implementation without the homotopic constraints.


title: The strength of the dominance rule

abstract: It has become standard that, when a SAT solver decides that a CNF $\Gamma$ is unsatisfiable, it produces a certificate of unsatisfiability in the form of a refutation of $\Gamma$ in some proof system. The system typically used is DRAT, which is equivalent to extended resolution (ER) -- for example, until this year DRAT refutations were required in the annual SAT competition. Recently [Bogaerts et al.~2023] introduced a new proof system, associated with the tool VeriPB, which is at least as strong as DRAT and is further able to handle certain symmetry-breaking techniques. We show that this system simulates the proof system $G_1$, which allows limited reasoning with QBFs and forms the first level above ER in a natural hierarchy of proof systems. This hierarchy is not known to be strict, but nevertheless this is evidence that the system of [Bogaerts et al. 2023] is plausibly strictly stronger than ER and DRAT. In the other direction, we show that symmetry-breaking for a single symmetry can be handled inside ER.


title: Generalized Hamming weights and symbolic powers of Stanley-Reisner ideals of matroids

abstract: It is well-known that the first generalized Hamming weight of a code, more commonly called \textit{the minimum distance} of the code, corresponds to the initial degree of the Stanley-Reisner ideal of the matroid of the dual code. Our starting point in this paper is a generalization of this fact -- namely, the $r$-th generalized Hamming weight of a code is the smallest degree of a squarefree monomial in the $r$-th symbolic power of the Stanley-Reisner ideal of the matroid of the dual code (in the appropriate range for $r$). It turns out that the squarefree monomials in successive symbolic powers of the Stanley-Reisner ideal of a matroid suffice to describe all symbolic powers of the Stanley-Reisner ideal. This implies that generalized Hamming weights -- which can be defined in a natural way for matroids -- are fundamentally tied to the structure of symbolic powers of Stanley-Reisner ideals of matroids. We illustrate this by studying initial degree statistics of symbolic powers of the Stanley-Reisner ideal of a matroid in terms of generalized Hamming weights and working out many examples that are meaningful from a coding-theoretic perspective. Our results also apply to projective varieties known as matroid configurations introduced by Geramita-Harbourne-Migliore-Nagel.


title: Leveraging Large Language Models for Patient Engagement: The Power of Conversational AI in Digital Health

abstract: The rapid advancements in large language models (LLMs) have opened up new opportunities for transforming patient engagement in healthcare through conversational AI. This paper presents an overview of the current landscape of LLMs in healthcare, specifically focusing on their applications in analyzing and generating conversations for improved patient engagement. We showcase the power of LLMs in handling unstructured conversational data through four case studies: (1) analyzing mental health discussions on Reddit, (2) developing a personalized chatbot for cognitive engagement in seniors, (3) summarizing medical conversation datasets, and (4) designing an AI-powered patient engagement system. These case studies demonstrate how LLMs can effectively extract insights and summarizations from unstructured dialogues and engage patients in guided, goal-oriented conversations. Leveraging LLMs for conversational analysis and generation opens new doors for many patient-centered outcomes research opportunities. However, integrating LLMs into healthcare raises important ethical considerations regarding data privacy, bias, transparency, and regulatory compliance. We discuss best practices and guidelines for the responsible development and deployment of LLMs in healthcare settings. Realizing the full potential of LLMs in digital health will require close collaboration between the AI and healthcare professionals communities to address technical challenges and ensure these powerful tools' safety, efficacy, and equity.


title: Towards Minimal Targeted Updates of Language Models with Targeted Negative Training

abstract: Generative models of language exhibit impressive capabilities but still place non-negligible probability mass over undesirable outputs. In this work, we address the task of updating a model to avoid unwanted outputs while minimally changing model behavior otherwise, a challenge we refer to as a minimal targeted update. We first formalize the notion of a minimal targeted update and propose a method to achieve such updates using negative examples from a model's generations. Our proposed Targeted Negative Training (TNT) results in updates that keep the new distribution close to the original, unlike existing losses for negative signal which push down probability but do not control what the updated distribution will be. In experiments, we demonstrate that TNT yields a better trade-off between reducing unwanted behavior and maintaining model generation behavior than baselines, paving the way towards a modeling paradigm based on iterative training updates that constrain models from generating undesirable outputs while preserving their impressive capabilities.


title: Hitchhiker's guide on Energy-Based Models: a comprehensive review on the relation with other generative models, sampling and statistical physics

abstract: Energy-Based Models (EBMs) have emerged as a powerful framework in the realm of generative modeling, offering a unique perspective that aligns closely with principles of statistical mechanics. This review aims to provide physicists with a comprehensive understanding of EBMs, delineating their connection to other generative models such as Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), and Normalizing Flows. We explore the sampling techniques crucial for EBMs, including Markov Chain Monte Carlo (MCMC) methods, and draw parallels between EBM concepts and statistical mechanics, highlighting the significance of energy functions and partition functions. Furthermore, we delve into state-of-the-art training methodologies for EBMs, covering recent advancements and their implications for enhanced model performance and efficiency. This review is designed to clarify the often complex interconnections between these models, which can be challenging due to the diverse communities working on the topic.

categories: cs.LG math-ph math.MP physics.app-ph physics.data-an


title: ObscurePrompt: Jailbreaking Large Language Models via Obscure Input

abstract: Recently, Large Language Models (LLMs) have garnered significant attention for their exceptional natural language processing capabilities. However, concerns about their trustworthiness remain unresolved, particularly in addressing "jailbreaking" attacks on aligned LLMs. Previous research predominantly relies on scenarios with white-box LLMs or specific and fixed prompt templates, which are often impractical and lack broad applicability. In this paper, we introduce a straightforward and novel method, named ObscurePrompt, for jailbreaking LLMs, inspired by the observed fragile alignments in Out-of-Distribution (OOD) data. Specifically, we first formulate the decision boundary in the jailbreaking process and then explore how obscure text affects LLM's ethical decision boundary. ObscurePrompt starts with constructing a base prompt that integrates well-known jailbreaking techniques. Powerful LLMs are then utilized to obscure the original prompt through iterative transformations, aiming to bolster the attack's robustness. Comprehensive experiments show that our approach substantially improves upon previous methods in terms of attack effectiveness, maintaining efficacy against two prevalent defense mechanisms. We believe that our work can offer fresh insights for future research on enhancing LLM alignment.


title: Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generation

abstract: Ensuring the verifiability of model answers is a fundamental challenge for retrieval-augmented generation (RAG) in the question answering (QA) domain. Recently, self-citation prompting was proposed to make large language models (LLMs) generate citations to supporting documents along with their answers. However, self-citing LLMs often struggle to match the required format, refer to non-existent sources, and fail to faithfully reflect LLMs' context usage throughout the generation. In this work, we present MIRAGE --Model Internals-based RAG Explanations -- a plug-and-play approach using model internals for faithful answer attribution in RAG applications. MIRAGE detects context-sensitive answer tokens and pairs them with retrieved documents contributing to their prediction via saliency methods. We evaluate our proposed approach on a multilingual extractive QA dataset, finding high agreement with human answer attribution. On open-ended QA, MIRAGE achieves citation quality and efficiency comparable to self-citation while also allowing for a finer-grained control of attribution parameters. Our qualitative evaluation highlights the faithfulness of MIRAGE's attributions and underscores the promising application of model internals for RAG answer attribution.


title: Root-KGD: A Novel Framework for Root Cause Diagnosis Based on Knowledge Graph and Industrial Data

abstract: With the development of intelligent manufacturing and the increasing complexity of industrial production, root cause diagnosis has gradually become an important research direction in the field of industrial fault diagnosis. However, existing research methods struggle to effectively combine domain knowledge and industrial data, failing to provide accurate, online, and reliable root cause diagnosis results for industrial processes. To address these issues, a novel fault root cause diagnosis framework based on knowledge graph and industrial data, called Root-KGD, is proposed. Root-KGD uses the knowledge graph to represent domain knowledge and employs data-driven modeling to extract fault features from industrial data. It then combines the knowledge graph and data features to perform knowledge graph reasoning for root cause identification. The performance of the proposed method is validated using two industrial process cases, Tennessee Eastman Process (TEP) and Multiphase Flow Facility (MFF). Compared to existing methods, Root-KGD not only gives more accurate root cause variable diagnosis results but also provides interpretable fault-related information by locating faults to corresponding physical entities in knowledge graph (such as devices and streams). In addition, combined with its lightweight nature, Root-KGD is more effective in online industrial applications.


title: Challenges in Binary Classification

abstract: Binary Classification plays an important role in machine learning. For linear classification, SVM is the optimal binary classification method. For nonlinear classification, the SVM algorithm needs to complete the classification task by using the kernel function. Although the SVM algorithm with kernel function is very effective, the selection of kernel function is empirical, which means that the kernel function may not be optimal. Therefore, it is worth studying how to obtain an optimal binary classifier. In this paper, the problem of finding the optimal binary classifier is considered as a variational problem. We design the objective function of this variational problem through the max-min problem of the (Euclidean) distance between two classes. For linear classification, it can be deduced that SVM is a special case of this variational problem framework. For Euclidean distance, it is proved that the proposed variational problem has some limitations for nonlinear classification. Therefore, how to design a more appropriate objective function to find the optimal binary classifier is still an open problem. Further, it's discussed some challenges and problems in finding the optimal classifier.


abstract: In this note we construct Markov partitions for non-transitive expansive flows in dimension 3.


title: Matter Power Spectra in Modified Gravity: A Comparative Study of Approximations and $N$-Body Simulations

abstract: Testing gravity and the concordance model of cosmology, $\Lambda$CDM, at large scales is a key goal of this decade's largest galaxy surveys. Here we present a comparative study of dark matter power spectrum predictions from different numerical codes in the context of three popular theories of gravity that induce scale-independent modifications to the linear growth of structure: nDGP, Cubic Galileon and K-mouflage. In particular, we compare the predictions from full $N$-body simulations, two $N$-body codes with approximate time integration schemes, a parametrised modified $N$-body implementation and the analytic halo model reaction approach. We find the modification to the $\Lambda$CDM spectrum is in $2\%$ agreement for $z\leq1$ and $k\leq 1~h/{\rm Mpc}$ over all gravitational models and codes, in accordance with many previous studies, indicating these modelling approaches are robust enough to be used in forthcoming survey analyses under appropriate scale cuts. We further make public the new code implementations presented, specifically the halo model reaction K-mouflage implementation and the relativistic Cubic Galileon implementation.


title: Improved bounds for calibration via stronger sign preservation games

abstract: A set of probabilistic forecasts is calibrated if each prediction of the forecaster closely approximates the empirical distribution of outcomes on the subset of timesteps where that prediction was made. We study the fundamental problem of online calibrated forecasting of binary sequences, which was initially studied by Foster & Vohra (1998). They derived an algorithm with $O(T^{2/3})$ calibration error after $T$ time steps, and showed a lower bound of $\Omega(T^{1/2})$. These bounds remained stagnant for two decades, until Qiao & Valiant (2021) improved the lower bound to $\Omega(T^{0.528})$ by introducing a combinatorial game called sign preservation and showing that lower bounds for this game imply lower bounds for calibration. We introduce a strengthening of Qiao & Valiant's game that we call sign preservation with reuse (SPR). We prove that the relationship between SPR and calibrated forecasting is bidirectional: not only do lower bounds for SPR translate into lower bounds for calibration, but algorithms for SPR also translate into new algorithms for calibrated forecasting. In particular, any strategy that improves the trivial upper bound for the value of the SPR game would imply a forecasting algorithm with calibration error exponent less than 2/3, improving Foster & Vohra's upper bound for the first time. Using similar ideas, we then prove a slightly stronger lower bound than that of Qiao & Valiant, namely $\Omega(T^{0.54389})$. Our lower bound is obtained by an oblivious adversary, marking the first $\omega(T^{1/2})$ calibration lower bound for oblivious adversaries.


title: Micro-gap thermo-photo-thermionics: An alternative approach to harvesting thermo-photons and its comparison with thermophotovoltaics

abstract: This work investigates an alternative to thermophotovoltaics for harvesting thermal and optical energy via photon coupling and thermionic energy conversion. In this device, a heat source is radiatively coupled to a thermionic electron emitter through a nanoscale gap and the electron emitter is coupled to collector through a microscale gap. The analysis using fluctuational electrodynamics and finite time thermodynamics shows that for identical thermal radiator and photon to electron conversion materials, the output power density in the thermionic device can be more than twice that of the thermophotovoltaic device; the thermionic mechanism can also provide more than 30 percent improvement in the energy conversion efficiency compared to the thermophotovoltaic device. Moreover, the maximum power point voltage in the thermionic device is shown to significantly exceed the band gap of conversion material, which determines the theoretical upper limit of the open circuit voltage in a thermophotovoltaic cell. Therefore, the results of this study indicate that thermionic energy harvesting via thermo-photon coupling can be a promising alternative to thermophotovoltaics.


title: On squarefree powers of simplicial trees

abstract: In this article, we study the squarefree powers of facet ideals associated with simplicial trees. Specifically, we examine the linearity of their minimal free resolution and their regularity. Additionally, we investigate when the first syzygy module of squarefree powers of a simplicial tree is linearly related. Finally, we provide a combinatorial formula for the regularity of the squarefree powers of $t$-path ideals of path graphs.


title: Topological Equivalence Theorem and Double-Copy for Chern-Simons Scattering Amplitudes

abstract: We study the mechanism of topological mass-generation for 3d Chern-Simons gauge theories and propose a brand-new Topological Equivalence Theorem to connect scattering amplitudes of the physical gauge boson states to that of the transverse states under high energy expansion. We prove a general energy cancellation mechanism for $N$-point physical gauge boson amplitudes, which predicts large cancellations of $E^{4-L}\to E^{(4-L)- N}$ at any $L$-loop level ($L\geqslant 0$). We extend the double-copy approach to construct massive graviton amplitudes and study their structures. We newly uncover a series of strikingly large energy cancellations $E^{12}\to E^1$ of the tree-level four-graviton scattering amplitude under high energy expansion and establish a new correspondence between the two energy cancellations in the topologically massive Yang-Mills gauge theory and the topologically massive gravity theory. We further study the scattering amplitudes of Chern-Simons gauge bosons and gravitons in the nonrelativistic limit.


title: Q-SNNs: Quantized Spiking Neural Networks

abstract: Brain-inspired Spiking Neural Networks (SNNs) leverage sparse spikes to represent information and process them in an asynchronous event-driven manner, offering an energy-efficient paradigm for the next generation of machine intelligence. However, the current focus within the SNN community prioritizes accuracy optimization through the development of large-scale models, limiting their viability in resource-constrained and low-power edge devices. To address this challenge, we introduce a lightweight and hardware-friendly Quantized SNN (Q-SNN) that applies quantization to both synaptic weights and membrane potentials. By significantly compressing these two key elements, the proposed Q-SNNs substantially reduce both memory usage and computational complexity. Moreover, to prevent the performance degradation caused by this compression, we present a new Weight-Spike Dual Regulation (WS-DR) method inspired by information entropy theory. Experimental evaluations on various datasets, including static and neuromorphic, demonstrate that our Q-SNNs outperform existing methods in terms of both model size and accuracy. These state-of-the-art results in efficiency and efficacy suggest that the proposed method can significantly improve edge intelligent computing.


title: The EUSO-SPB2 Fluorescence Telescope for the Detection of Ultra-High Energy Cosmic Rays

abstract: The Extreme Universe Space Observatory on a Super Pressure Balloon 2 (EUSO-SPB2) flew on May 13$^{\text{th}}$ and 14$^{\text{th}}$ of 2023. Consisting of two novel optical telescopes, the payload utilized next-generation instrumentation for the observations of extensive air showers from near space. One instrument, the fluorescence telescope (FT) searched for Ultra-High Energy Cosmic Rays (UHECRs) by recording the atmosphere below the balloon in the near-UV with a 1~$\mu$s time resolution using 108 multi-anode photomultiplier tubes with a total of 6,912 channels. Validated by pre-flight measurements during a field campaign, the energy threshold was estimated around 2~EeV with an expected event rate of approximately 1 event per 10 hours of observation. Based on the limited time afloat, the expected number of UHECR observations throughout the flight is between 0 and 2. Consistent with this expectation, no UHECR candidate events have been found. The majority of events appear to be detector artifacts that were not rejected properly due to a shortened commissioning phase. Despite the earlier-than-expected termination of the flight, data were recorded which provide insights into the detectors stability in the near-space environment as well as the diffuse ultraviolet emissivity of the atmosphere, both of which are impactful to future experiments.


title: Rethinking Abdominal Organ Segmentation (RAOS) in the clinical scenario: A robustness evaluation benchmark with challenging cases

abstract: Deep learning has enabled great strides in abdominal multi-organ segmentation, even surpassing junior oncologists on common cases or organs. However, robustness on corner cases and complex organs remains a challenging open problem for clinical adoption. To investigate model robustness, we collected and annotated the RAOS dataset comprising 413 CT scans ($\sim$80k 2D images, $\sim$8k 3D organ annotations) from 413 patients each with 17 (female) or 19 (male) labelled organs, manually delineated by oncologists. We grouped scans based on clinical information into 1) diagnosis/radiotherapy (317 volumes), 2) partial excision without the whole organ missing (22 volumes), and 3) excision with the whole organ missing (74 volumes). RAOS provides a potential benchmark for evaluating model robustness including organ hallucination. It also includes some organs that can be very hard to access on public datasets like the rectum, colon, intestine, prostate and seminal vesicles. We benchmarked several state-of-the-art methods in these three clinical groups to evaluate performance and robustness. We also assessed cross-generalization between RAOS and three public datasets. This dataset and comprehensive analysis establish a potential baseline for future robustness research: \url{https://github.com/Luoxd1996/RAOS}.


title: AI-Assisted Dynamic Port and Waveform Switching for Enhancing UL Coverage in 5G NR

abstract: The uplink of 5G networks allows selecting the transmit waveform between cyclic prefix orthogonal frequency division multiplexing (CP-OFDM) and discrete Fourier transform spread OFDM (DFT-S-OFDM), which is appealing for cell-edge users using high-frequency bands, since it shows a smaller peak-to-average power ratio, and allows a higher transmit power. Nevertheless, DFT-S-OFDM exhibits a higher block error rate (BLER) which complicates an optimal waveform selection. In this paper, we propose an intelligent waveform-switching mechanism based on deep reinforcement learning (DRL). In this proposal, a learning agent aims at maximizing a function built using available throughput percentiles in real networks. Said percentiles are weighted so as to improve the cell-edge users' service without dramatically reducing the cell average. Aggregated measurements of signal-to-noise ratio (SNR) and timing advance (TA), available in real networks, are used in the procedure. Results show that our proposed scheme greatly outperforms both metrics compared to classical approaches.


title: Oxygen vacancies kinetics in $TaO_{2-h}$/$Ta_{2}$$O_{5-x}$ memristive interfaces

abstract: Oxygen vacancies (OV) are pervasive in metal oxides and play a pivotal role in the switching behaviour of oxide-based memristive devices. In this work we address, through a combination of experiments and theoretical simulations, OV dynamics in $Pt/TaO_{2-h}/Ta_{2}O_{5-x}/TaO_${2-y}$/Pt$ devices. In particular, we focus on the RESET transition (from low to high resistance), induced by the application of electrical pulse(s), by choosing different initial OV profiles and studying their kinetics during the mentioned process. We demonstrate that by selecting specific OV profiles it is possible to tune the characteristic time-scale of the RESET. Finally, we show that the implementation of gradual RESETs, induced by applying many (small) successive pulses, allows estimating the activation energies involved in the OV electromigration process. Our results help paving the way for OV engineering aiming at optimizing key memristive figures such as switching speed or power consumption, which are highly relevant for neuromorphic or in-memory computing implementations.


title: Leveraging Large Language Models to Measure Gender Bias in Gendered Languages

abstract: Gender bias in text corpora used in various natural language processing (NLP) contexts, such as for training large language models (LLMs), can lead to the perpetuation and amplification of societal inequalities. This is particularly pronounced in gendered languages like Spanish or French, where grammatical structures inherently encode gender, making the bias analysis more challenging. Existing methods designed for English are inadequate for this task due to the intrinsic linguistic differences between English and gendered languages. This paper introduces a novel methodology that leverages the contextual understanding capabilities of LLMs to quantitatively analyze gender representation in Spanish corpora. By utilizing LLMs to identify and classify gendered nouns and pronouns in relation to their reference to human entities, our approach provides a nuanced analysis of gender biases. We empirically validate our method on four widely-used benchmark datasets, uncovering significant gender disparities with a male-to-female ratio ranging from 4:1 to 6:1. These findings demonstrate the value of our methodology for bias quantification in gendered languages and suggest its application in NLP, contributing to the development of more equitable language technologies.


title: Simulating open quantum systems with giant atoms

abstract: Open quantum many-body systems are of both fundamental and applicational interest. However, it remains an open challenge to simulate and solve such systems, both with state-of-the-art classical methods and with quantum-simulation protocols. To overcome this challenge, we introduce a simulator for open quantum many-body systems based on giant atoms, i.e., atoms (possibly artificial), that couple to a waveguide at multiple points, which can be wavelengths apart. We first show that a simulator consisting of two giant atoms can simulate the dynamics of two coupled qubits, where one qubit is subject to different drive amplitudes and dissipation rates. This simulation enables characterizing the quantum Zeno crossover in this model. We further show that by equipping the simulator with post-selection, it becomes possible to simulate the effective non-Hermitian Hamiltonian dynamics of the system and thereby characterize the transition from oscillatory to non-oscillatory dynamics due to varying dissipation rates. We demonstrate and analyze the robustness of these simulation results against noise affecting the giant atoms. Finally, we discuss and show how giant-atom-based simulators can be scaled up for digital-analog simulation of large open quantum many-body systems, e.g., generic dissipative spin models.


title: Prose-to-P4: Leveraging High Level Languages

abstract: Languages such as P4 and NPL have enabled a wide and diverse range of networking applications that take advantage of programmable dataplanes. However, software development in these languages is difficult. To address this issue, high-level languages have been designed to offer programmers powerful abstractions that reduce the time, effort and domain-knowledge required for developing networking applications. These languages are then translated by a compiler into P4/NPL code. Inspired by the recent success of Large Language Models (LLMs) in the task of code generation, we propose to raise the level of abstraction even higher, employing LLMs to translate prose into high-level networking code. We analyze the problem, focusing on the motivation and opportunities, as well as the challenges involved and sketch out a roadmap for the development of a system that can generate high-level dataplane code from natural language instructions. We present some promising preliminary results on generating Lucid code from natural language.


title: Effects of settling on inertial particle slip velocity statistics in wall bounded flows

abstract: Developing reduced order models for the transport of solid particles in turbulence typically requires a statistical description of the particle-turbulence interactions. In this work, we utilize a statistical framework to derive continuum equations for the moments of the slip velocity of inertial settling Lagrangian particles in a turbulent boundary layer. Using coupled Eulerian-Lagrangian direct numerical simulations, we then identify the dominant mechanisms controlling the slip velocity variance, and find that for a range of St+, Sv+, and Re, the slip variance is primarily controlled by local differences between the "seen" variance and the particle velocity variance, while terms appearing due to the inhomogeneity of the turbulence are sub-leading until Sv+ becomes large. We also consider several comparative metrics to assess the relative magnitudes of the fluctuating slip velocity and the mean slip velocity, and we find that the vertical mean slip increases rapidly with Sv+, rendering the variance relatively small -- an effect found to be most substantial for Sv+>1. Finally, we compare the results to a model of the acceleration variance Berk and Coletti (2021) based the concept of a response function described in Csanady (1963), highlighting the role of the crossing trajectories mechanism. We find that while there is good agreement for low Sv+, systematic errors remain, possibly due to implicit non-local effects arising from rapid particle settling and inhomogeneous turbulence. We conclude with a discussion of the implications of this work for modeling the transport of coarse dust grains in the atmospheric surface layer.

categories: physics.flu-dyn math-ph math.MP physics.ao-ph


title: On the Consistency of Fairness Measurement Methods for Regression Tasks

abstract: With growing applications of Machine Learning (ML) techniques in the real world, it is highly important to ensure that these models work in an equitable manner. One main step in ensuring fairness is to effectively measure fairness, and to this end, various metrics have been proposed in the past literature. While the computation of those metrics are straightforward in the classification set-up, it is computationally intractable in the regression domain. To address the challenge of computational intractability, past literature proposed various methods to approximate such metrics. However, they did not verify the extent to which the output of such approximation algorithms are consistent with each other. To fill this gap, this paper comprehensively studies the consistency of the output of various fairness measurement methods through conducting an extensive set of experiments on various regression tasks. As a result, it finds that while some fairness measurement approaches show strong consistency across various regression tasks, certain methods show a relatively poor consistency in certain regression tasks. This, in turn, calls for a more principled approach for measuring fairness in the regression domain.


title: A variational perspective on the dissipative Hamiltonian structure of the Vlasov-Fokker-Planck equation

abstract: The Vlasov-Fokker-Planck equation describes the evolution of the probability density of the position and velocity of particles under the influence of external confinement, interaction, friction, and stochastic force. It is well-known that this equation can be formally seen as a dissipative Hamiltonian system in the Wasserstein space of probability measures. In order to better understand this geometric formalism, we introduce a time-discrete variational scheme, solutions of which converge to the solution of the Vlasov-Fokker-Planck equation as time-step vanishes. The implicit scheme is based on the symplectic Euler scheme, and updates the probability density at each iteration first in the velocity variable then in the position variable. The algorithm leverages the geometric structure of the Wasserstein space, and has several desirable properties. Energy functionals involved in each variational problem are geodesically-convex, which implies the unique solvability of the problem. Furthermore, the correct dissipation of the Hamiltonian is observed at the discrete level up to higher order errors.


title: IntCoOp: Interpretability-Aware Vision-Language Prompt Tuning

abstract: Image-text contrastive models such as CLIP learn transferable and robust representations for zero-shot transfer to a variety of downstream tasks. However, to obtain strong downstream performances, prompts need to be carefully curated, which can be a tedious engineering task. To address the issue of manual prompt engineering, prompt-tuning is used where a set of contextual vectors are learned by leveraging information from the training data. Despite their effectiveness, existing prompt-tuning frameworks often lack interpretability, thus limiting their ability to understand the compositional nature of images. In this work, we first identify that incorporating compositional attributes (e.g., a "green" tree frog) in the design of manual prompts can significantly enhance image-text alignment scores. Building upon this observation, we propose a novel and interpretable prompt-tuning method named IntCoOp, which learns to jointly align attribute-level inductive biases and class embeddings during prompt-tuning. To assess the effectiveness of our approach, we evaluate IntCoOp across two representative tasks in a few-shot learning setup: generalization to novel classes, and unseen domain shifts. Through extensive experiments across 10 downstream datasets on CLIP, we find that introducing attribute-level inductive biases leads to superior performance against state-of-the-art prompt tuning frameworks. Notably, in a 16-shot setup, IntCoOp improves CoOp by 7.35% in average performance across 10 diverse datasets.


title: Some non-Archimedean pluripotential theory on polarized affine cones

abstract: We undertake a preliminary step towards studying non-Archimedean pluripotential theory on polarized affine cones over a trivially valued field. We study plurisubharmonic functions and the Monge--Amp\`ere operator defined on the finite energy class, partially generalizing a result of Boucksom--Jonsson on projective varieties.


title: Transverse spin and orbital angular momenta in rotating-wave structured light

abstract: Within monochromatic optical fields, we demonstrate the rotating-wave structured light with wave vortex carrying an intrinsic transverse orbital angular momentum orthogonal to the propagation direction of light. Remarkably, we find that such a rotating-wave structured light reveals highly nontrivial features of transverse spin and orbital angular momentum densities. The normalized total angular momentum density is conserved universally, suggesting a mutual conversion of the intrinsic transverse spin and orbital angular momentum in free space. Despite such mutual conversion at local level, the integral intrinsic orbital angular momentum can be well defined with the topological charge of the vortex per photon. Moreover, the orientation of transverse spin density is governed by the direction of the Poynting momentum density, manifesting a spin-momentum-locking effect in free space.


title: A 1.8-um pitch, 47-ps jitter SPAD Array in 130nm SiGe BiCMOS Process

abstract: We introduce the world's first SPAD family design in 130 nm SiGe BiCMOS process. At 1.8um, we achieved the smallest pitch on record thanks to guard-ring sharing techniques, while keeping a relatively high fill factor of 24.2%. 4x4 SPAD arrays with two parallel selective readout circuits were designed to explore crosstalk and scalability. The SPAD family has a minimum breakdown voltage of 11 V, a maximum PDP of 40.6% and a typical timing jitter of 47 ps FWHM. The development of silicon SPADs in SiGe process paves the way to Ge-on-Si SPADs for SWIR applications, and to cryogenic optical interfaces for quantum applications.


title: Diffraction of the primes and other sets of zero density

abstract: In this paper, we show that the diffraction of the primes is absolutely continuous, showing no bright spots (Bragg peaks). We introduce the notion of counting diffraction, extending the classical notion of (density) diffraction to sets of density zero. We develop the counting diffraction theory and give many examples of sets of zero density of all possible spectral types.


title: Development of a Dual-Input Neural Model for Detecting AI-Generated Imagery

abstract: Over the past years, images generated by artificial intelligence have become more prevalent and more realistic. Their advent raises ethical questions relating to misinformation, artistic expression, and identity theft, among others. The crux of many of these moral questions is the difficulty in distinguishing between real and fake images. It is important to develop tools that are able to detect AI-generated images, especially when these images are too realistic-looking for the human eye to identify as fake. This paper proposes a dual-branch neural network architecture that takes both images and their Fourier frequency decomposition as inputs. We use standard CNN-based methods for both branches as described in Stuchi et al. [7], followed by fully-connected layers. Our proposed model achieves an accuracy of 94% on the CIFAKE dataset, which significantly outperforms classic ML methods and CNNs, achieving performance comparable to some state-of-the-art architectures, such as ResNet.


title: Bose-Einstein condensation of polaritons at room temperature in a GaAs/AlGaAs structure

abstract: We report the canonical properties of Bose-Einstein condensation of polaritons, seen previously in many low-temperature experiments, at room temperature in a GaAs/AlGaAs structure. These effects include a nonlinear energy shift of the polaritons, showing that they are not non-interacting photons, and dramatic line narrowing due to coherence, giving coherent emission with spectral width of 0.24 meV at room temperature with no external stabilization. This opens up the possibility of room temperature nonlinear optical devices based on polariton condensation.


title: Lower bound of black hole hair in pure Lovelock theory of gravity

abstract: As an alternative to the "no hair conjecture," the "no short hair conjecture" for hairy black holes was established earlier. This theorem stipulates that hair must be present above 3/2 of the event horizon radius for a hairy black hole. It is assumed that the nonlinear behavior of the matter field plays a key role in the presence of such hair. Subsequently, it was established that the hair must extend beyond the photon sphere of the corresponding black hole. We have investigated the validity of the "no short hair conjecture" in pure Lovelock gravity. Our analysis has shown that irrespective of dimensionality and Lovelock order, the hair of a static, spherically symmetric black hole extends at least up to the photon sphere.


title: Computationally efficient multi-level Gaussian process regression for functional data observed under completely or partially regular sampling designs

abstract: Gaussian process regression is a frequently used statistical method for flexible yet fully probabilistic non-linear regression modeling. A common obstacle is its computational complexity which scales poorly with the number of observations. This is especially an issue when applying Gaussian process models to multiple functions simultaneously in various applications of functional data analysis. We consider a multi-level Gaussian process regression model where a common mean function and individual subject-specific deviations are modeled simultaneously as latent Gaussian processes. We derive exact analytic and computationally efficient expressions for the log-likelihood function and the posterior distributions in the case where the observations are sampled on either a completely or partially regular grid. This enables us to fit the model to large data sets that are currently computationally inaccessible using a standard implementation. We show through a simulation study that our analytic expressions are several orders of magnitude faster compared to a standard implementation, and we provide an implementation in the probabilistic programming language Stan.


title: Synchronous Faithfulness Monitoring for Trustworthy Retrieval-Augmented Generation

abstract: Retrieval-augmented language models (RALMs) have shown strong performance and wide applicability in knowledge-intensive tasks. However, there are significant trustworthiness concerns as RALMs are prone to generating unfaithful outputs, including baseless information or contradictions with the retrieved context. This paper proposes SynCheck, a lightweight monitor that leverages fine-grained decoding dynamics including sequence likelihood, uncertainty quantification, context influence, and semantic alignment to synchronously detect unfaithful sentences. By integrating efficiently measurable and complementary signals, SynCheck enables accurate and immediate feedback and intervention, achieving 0.85 AUROC in detecting faithfulness errors across six long-form retrieval-augmented generation tasks, improving prior best method by 4%. Leveraging SynCheck, we further introduce FOD, a faithfulness-oriented decoding algorithm guided by beam search for long-form retrieval-augmented generation. Empirical results demonstrate that FOD outperforms traditional strategies such as abstention, reranking, or contrastive decoding significantly in terms of faithfulness, achieving over 10% improvement across six datasets.


title: From Single Agent to Multi-Agent: Improving Traffic Signal Control

abstract: Due to accelerating urbanization, the importance of solving the signal control problem increases. This paper analyzes various existing methods and suggests options for increasing the number of agents to reduce the average travel time. Experiments were carried out with 2 datasets. The results show that in some cases, the implementation of multiple agents can improve existing methods. For a fine-tuned large language model approach there is small enhancement on all metrics.


title: An Embedded Intelligent System for Attendance Monitoring

abstract: In this paper, we propose an intelligent embedded system for monitoring class attendance and sending the attendance list to a remote computer. The proposed system consists of two parts : an embedded device (Raspberry with PI camera) for facial recognition and a web application for attendance management. The proposed solution take into account the different challenges: the limited resources of the Raspberry Pi, the need to adapt the facial recognition model and achieving acceptable performance using images provided by the Raspberry Pi camera.


title: Multilingual De-Duplication Strategies: Applying scalable similarity search with monolingual & multilingual embedding models

abstract: This paper addresses the deduplication of multilingual textual data using advanced NLP tools. We compare a two-step method involving translation to English followed by embedding with mpnet, and a multilingual embedding model (distiluse). The two-step approach achieved a higher F1 score (82% vs. 60%), particularly with less widely used languages, which can be increased up to 89% by leveraging expert rules based on domain knowledge. We also highlight limitations related to token length constraints and computational efficiency. Our methodology suggests improvements for future multilingual deduplication tasks.


title: A nonlocal approximation of the area in codimension two

abstract: For $s\in (0,1)$ we introduce a notion of fractional $s$-mass on $(n-2)$-dimensional closed, orientable surfaces in $\R^n$. Moreover, we prove its $\Gamma$-convergence, with respect to the flat topology, and pointwise convergence to the $(n-2)$-dimensional area.


title: Detection of Moving Objects in Earth Observation Satellite Images: Verification

abstract: In multi-spectral images made by Earth observation satellites that use push-broom scanning, such as those operated by Planet Labs Corp., moving objects can be identified by the appearance of the object at a different locations in each spectral band. The apparent velocity can be measured if the relative acquisition time between images in different spectral bands is known to millisecond accuracy. The images in the Planet Labs archive are mosaics of individual exposures acquired at different times. Thus there is not a unique acquisition time for each spectral band. In an earlier paper, we proposed a method to determine the relative acquisition times from the information in the images themselves. High altitude balloons provide excellent targets to test our proposed method because of their high apparent velocity due to the orbital velocity of the satellite and geometric parallax in images aligned to the level of the ground. We use images of the Chinese balloon that crossed the US in February, 2024 as well as images of an identical balloon over Colombia to test our method. Our proposed method appears to be successful and allows the measurement of the apparent velocity of moving objects from the information available in the archive.


title: MMTE: Corpus and Metrics for Evaluating Machine Translation Quality of Metaphorical Language

abstract: Machine Translation (MT) has developed rapidly since the release of Large Language Models and current MT evaluation is performed through comparison with reference human translations or by predicting quality scores from human-labeled data. However, these mainstream evaluation methods mainly focus on fluency and factual reliability, whilst paying little attention to figurative quality. In this paper, we investigate the figurative quality of MT and propose a set of human evaluation metrics focused on the translation of figurative language. We additionally present a multilingual parallel metaphor corpus generated by post-editing. Our evaluation protocol is designed to estimate four aspects of MT: Metaphorical Equivalence, Emotion, Authenticity, and Quality. In doing so, we observe that translations of figurative expressions display different traits from literal ones.


title: Classification results, rigidity theorems and semilinear PDEs on Riemannian manifolds: a P-function approach

abstract: We consider solutions to some semilinear elliptic equations on complete noncompact Riemannian manifolds and study their classification as well as the effect of their presence on the underlying manifold. When the Ricci curvature is non-negative, we prove both the classification of positive solutions to the critical equation and the rigidity for the ambient manifold. The same results are obtained when we consider solutions to the Liouville equation on Riemannian surfaces. The results are obtained via a suitable P-function whose constancy implies the classification of both the solutions and the underlying manifold. The analysis carried out on the P-function also makes it possible to classify non-negative solutions for subcritical equations on manifolds enjoying a Sobolev inequality and satisfying an integrability condition on the negative part of the Ricci curvature. Some of our results are new even in the Euclidean case.


title: Reinforcement Learning-Based Model Matching to Reduce the Sim-Real Gap in COBRA

abstract: This paper employs a reinforcement learning-based model identification method aimed at enhancing the accuracy of the dynamics for our snake robot, called COBRA. Leveraging gradient information and iterative optimization, the proposed approach refines the parameters of COBRA's dynamical model such as coefficient of friction and actuator parameters using experimental and simulated data. Experimental validation on the hardware platform demonstrates the efficacy of the proposed approach, highlighting its potential to address sim-to-real gap in robot implementation.


title: Wind-wave interaction in finite depth: linear and nonlinear approaches, blow-up and soliton breaking in finite time, integrability perspectives

abstract: This work is an analytical investigation of the evolution of surface water waves in Miles and Jeffreys theories of wind wave interaction in water of finite depth. The present review is divided into two major parts. The first corresponds to the surface water waves in a linear regime and its nonlinear extensions. In this part, Miles theory of wave amplification by wind is extended to the case of finite depth. The dispersion relation provides a wave growth rate depending on depth. Our theoretical results are in good agreement with the data from the Australian Shallow Water Experiment and the data from the Lake George experiment. In the second part of this study, Jeffreys theory of wave amplification by wind is extended to the case of finite depth, where the Serre-Green-Naghdi is derived. We find the solitary wave solution of the system, with an increasing amplitude under the action of the wind. This continuous increase in amplitude leads to the soliton breaking and blow-up of the surface wave in finite time. The theoretical blow-up time is calculated based on actual experimental data. By applying an appropriate perturbation method, the SGN equation yields Korteweg de Vries Burger equation (KdVB). We show that the continuous transfer of energy from wind to water results in the growth of the KdVB soliton amplitude, velocity, acceleration, and energy over time while its effective wavelength decreases. This phenomenon differs from the classical results of Jeffreys approach due to finite depth. Again, blow-up and breaking occur in finite time. These times are calculated and expressed for soliton- and wind-appropriate parameters and values. These values are measurable in usual experimental facilities. The kinematics of the breaking is studied, and a detailed analysis of the breaking time is conducted using various criteria. Finally, some integrability perspectives are presented.


title: Van-Hove annihilation and nematic instability on a Kagome lattice

abstract: Novel states of matter arise in quantum materials due to strong interactions among electrons. A nematic phase breaks the point group symmetry of the crystal lattice and is known to emerge in correlated materials. Here we report the observation of an intra-unit-cell nematic order and signatures of Pomeranchuk instability in the Kagome metal ScV6Sn6. Using scanning tunneling microscopy and spectroscopy, we reveal a stripe-like nematic order breaking the crystal rotational symmetry within the Kagome lattice itself. Moreover, we identify a set of van Hove singularities adhering to the Kagome layer electrons, which appear along one direction of the Brillouin zone while being annihilated along other high-symmetry directions, revealing a rotational symmetry breaking. Via detailed spectroscopic maps, we further observe an elliptical deformation of Fermi surface, which provides direct evidence for an electronically mediated nematic order. Our work not only bridges the gap between electronic nematicity and Kagome physics, but also sheds light on the potential mechanism for realizing symmetry-broken phases in correlated electron systems.


title: Working group 1 summary: $V_{ud}$, $V_{us}$, $V_{cd}$, $V_{cs}$ and semileptonic/leptonic $D$ decays

abstract: We summarize the program of working group 1 at the 12th Workshop on the CKM Unitarity Triangle, whose main subjects covered $V_{ud}$, $V_{us}$, and first-row unitarity as well as $V_{cd}$, $V_{cs}$, and (semi-)leptonic $D$ decays.


title: The Curious Case of Twin Fast Radio Bursts: Evidence for Neutron Star Origin?

abstract: Fast radio bursts (FRBs) are brilliant short-duration flashes of radio emission originating at cosmological distances. The vast diversity in the properties of currently known FRBs, and the fleeting nature of these events make it difficult to understand their progenitors and emission mechanism(s). Here we report high time resolution polarization properties of FRB 20210912A, a highly energetic event detected by the Australian Square Kilometre Array Pathfinder (ASKAP) in the Commensal Real-time ASKAP Fast Transients (CRAFT) survey, which show intra-burst PA variation similar to Galactic pulsars and unusual variation of Faraday Rotation Measure (RM) across its two sub-bursts. The observed intra-burst PA variation and apparent RM variation pattern in FRB 20210912A may be explained by a rapidly-spinning neutron star origin, with rest-frame spin periods of ~1.1 ms. This rotation timescale is comparable to the shortest known rotation period of a pulsar, and close to the shortest possible rotation period of a neutron star. Curiously, FRB 20210912A exhibits a remarkable resemblance with the previously reported FRB 20181112A, including similar rest-frame emission timescales and polarization profiles. These observations suggest that these two FRBs may have similar origins.


title: EndoUIC: Promptable Diffusion Transformer for Unified Illumination Correction in Capsule Endoscopy

abstract: Wireless Capsule Endoscopy (WCE) is highly valued for its non-invasive and painless approach, though its effectiveness is compromised by uneven illumination from hardware constraints and complex internal dynamics, leading to overexposed or underexposed images. While researchers have discussed the challenges of low-light enhancement in WCE, the issue of correcting for different exposure levels remains underexplored. To tackle this, we introduce EndoUIC, a WCE unified illumination correction solution using an end-to-end promptable diffusion transformer (DFT) model. In our work, the illumination prompt module shall navigate the model to adapt to different exposure levels and perform targeted image enhancement, in which the Adaptive Prompt Integration (API) and Global Prompt Scanner (GPS) modules shall further boost the concurrent representation learning between the prompt parameters and features. Besides, the U-shaped restoration DFT model shall capture the long-range dependencies and contextual information for unified illumination restoration. Moreover, we present a novel Capsule-endoscopy Exposure Correction (CEC) dataset, including ground-truth and corrupted image pairs annotated by expert photographers. Extensive experiments against a variety of state-of-the-art (SOTA) methods on four datasets showcase the effectiveness of our proposed method and components in WCE illumination restoration, and the additional downstream experiments further demonstrate its utility for clinical diagnosis and surgical assistance.


title: Breaking News: Case Studies of Generative AI's Use in Journalism

abstract: Journalists are among the many users of large language models (LLMs). To better understand the journalist-AI interactions, we conduct a study of LLM usage by two news agencies through browsing the WildChat dataset, identifying candidate interactions, and verifying them by matching to online published articles. Our analysis uncovers instances where journalists provide sensitive material such as confidential correspondence with sources or articles from other agencies to the LLM as stimuli and prompt it to generate articles, and publish these machine-generated articles with limited intervention (median output-publication ROUGE-L of 0.62). Based on our findings, we call for further research into what constitutes responsible use of AI, and the establishment of clear guidelines and best practices on using LLMs in a journalistic context.


title: Safety-Critical Formation Control of Non-Holonomic Multi-Robot Systems in Communication-Limited Environments

abstract: This paper presents a robust estimator-based safety-critical controller for formation control of non-holonomic mobile robots in communication-limited environments. The proposed decentralized framework integrates a robust state estimator with a formation tracking control law that guarantees inter-agent collision avoidance using control barrier functions. String stability is incorporated into the control design to maintain stability against noise from predecessors in leader-follower formations. Rigorous stability analysis using Lyapunov functions ensures the stability of estimation errors and the convergence of the formation to desired configurations. The effectiveness and robustness of the proposed approach are validated through numerical simulations of various maneuvers and realistic Gazebo experiments involving formations in a warehouse environment. The results demonstrate the controller's ability to maintain safety, achieve precise formation control, and mitigate disturbances in scenarios without inter-robot communication.


title: Low-rank based motion correction followed by automatic frame selection in DT-CMR

abstract: Motivation: Post-processing of in-vivo diffusion tensor CMR (DT-CMR) is challenging due to the low SNR and variation in contrast between frames which makes image registration difficult, and the need to manually reject frames corrupted by motion. Goals: To develop a semi-automatic post-processing pipeline for robust DT-CMR registration and automatic frame selection. Approach: We used low intrinsic rank averaged frames as the reference to register other low-ranked frames. A myocardium-guided frame selection rejected the frames with signal loss, through-plane motion and poor registration. Results: The proposed method outperformed our previous noise-robust rigid registration on helix angle data quality and reduced negative eigenvalues in healthy volunteers.


title: A Study on the Effect of Color Spaces in Learned Image Compression

abstract: In this work, we present a comparison between color spaces namely YUV, LAB, RGB and their effect on learned image compression. For this we use the structure and color based learned image codec (SLIC) from our prior work, which consists of two branches - one for the luminance component (Y or L) and another for chrominance components (UV or AB). However, for the RGB variant we input all 3 channels in a single branch, similar to most learned image codecs operating in RGB. The models are trained for multiple bitrate configurations in each color space. We report the findings from our experiments by evaluating them on various datasets and compare the results to state-of-the-art image codecs. The YUV model performs better than the LAB variant in terms of MS-SSIM with a Bj{\o}ntegaard delta bitrate (BD-BR) gain of 7.5\% using VTM intra-coding mode as the baseline. Whereas the LAB variant has a better performance than YUV model in terms of CIEDE2000 having a BD-BR gain of 8\%. Overall, the RGB variant of SLIC achieves the best performance with a BD-BR gain of 13.14\% in terms of MS-SSIM and a gain of 17.96\% in CIEDE2000 at the cost of a higher model complexity.


title: Velocity Analysis of Moving Objects in Earth Observation Satellite Images Using Multi-Spectral Push Broom Scanning

abstract: In this study, we present a method for detecting and analyzing the velocities of moving objects in Earth observation satellite images, specifically using data from Planet Labs' push broom scanning satellites. By exploiting the sequential acquisition of multi-spectral images, we estimate the relative differences in acquisition times between spectral bands. This allows us to determine the velocities of moving objects, such as aircraft, even without precise timestamp information from the image archive. We validate our method by comparing the velocities of aircraft observed in satellite images with those reported by onboard ADS-B transponders. The results demonstrate the potential, despite challenges posed by proprietary data limitations, of a new, useful application of commercial satellite data originally intended as an ongoing, once-daily survey of single images covering the entire land-area of the Earth. Our approach extends the applicability of satellite survey imagery for dynamic object tracking and contributes to the broader use of commercial satellite data in scientific research.


title: Imagining In-distribution States: How Predictable Robot Behavior Can Enable User Control Over Learned Policies

abstract: It is crucial that users are empowered to take advantage of the functionality of a robot and use their understanding of that functionality to perform novel and creative tasks. Given a robot trained with Reinforcement Learning (RL), a user may wish to leverage that autonomy along with their familiarity of how they expect the robot to behave to collaborate with the robot. One technique is for the user to take control of some of the robot's action space through teleoperation, allowing the RL policy to simultaneously control the rest. We formalize this type of shared control as Partitioned Control (PC). However, this may not be possible using an out-of-the-box RL policy. For example, a user's control may bring the robot into a failure state from the policy's perspective, causing it to act unexpectedly and hindering the success of the user's desired task. In this work, we formalize this problem and present Imaginary Out-of-Distribution Actions, IODA, an initial algorithm which empowers users to leverage their expectations of a robot's behavior to accomplish new tasks. We deploy IODA in a user study with a real robot and find that IODA leads to both better task performance and a higher degree of alignment between robot behavior and user expectation. We also show that in PC, there is a strong and significant correlation between task performance and the robot's ability to meet user expectations, highlighting the need for approaches like IODA. Code is available at https://github.com/AABL-Lab/ioda_roman_2024