title: FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition

abstract: Despite their exceptional performance on various tasks after fine-tuning, pre-trained language models (PLMs) face significant challenges due to growing privacy concerns with data in centralized training methods. We consider federated learning (FL) to fine-tune PLMs in this paper. However, the substantial number of parameters in PLMs poses significant difficulties for client devices with limited communication and computational resources. One promising solution is to exploit parameter-efficient fine-tuning (PEFT) into FL, which trains a much smaller set of parameters than full parameter fine-tuning (FFT). Although remarkably improving training efficiency, PEFT methods may lead to degraded performance especially when data across different clients are non i.i.d, as revealed by experimental results. To overcome this, we propose FeDeRA, which extends and improves a widely used PEFT method, i.e., low-rank adaption (LoRA). FeDeRA follows LoRA by decomposing the weight matrices of the PLMs into low-rank matrices, which allows for more efficient computation and parameter updates during fine-tuning. Different from LoRA which simply initializes these low-rank matrices by random sampling or zeros, the proposed FeDeRA initializes these matrices by the results of performing singular value decomposition (SVD) on the pre-trained weight matrices. Extensive experiments across various tasks and datasets show that FeDeRA outperforms the considered PEFT baselines and is comparable to or even surpasses FFT method within the FL setting in terms of task performance. Moreover, FeDeRA requires only 1% trainable paramentes compared to FFT, significantly reducing training time costs by more than 90% to achieve the same task performance level. The experimental results also highlight the robustness of FeDeRA against data heterogeneity, as it maintains stable task performance even as data heterogeneity increases.


title: MiPa: Mixed Patch Infrared-Visible Modality Agnostic Object Detection

abstract: In this paper, we present a different way to use two modalities, in which either one modality or the other is seen by a single model. This can be useful when adapting an unimodal model to leverage more information while respecting a limited computational budget. This would mean having a single model that is able to deal with any modalities. To describe this, we coined the term anymodal learning. An example of this, is a use case where, surveillance in a room when the lights are off would be much more valuable using an infrared modality while a visible one would provide more discriminative information when lights are on. This work investigates how to efficiently leverage visible and infrared/thermal modalities for transformer-based object detection backbone to create an anymodal architecture. Our work does not create any inference overhead during the testing while exploring an effective way to exploit the two modalities during the training. To accomplish such a task, we introduce the novel anymodal training technique: Mixed Patches (MiPa), in conjunction with a patch-wise domain agnostic module, which is responsible of learning the best way to find a common representation of both modalities. This approach proves to be able to balance modalities by reaching competitive results on individual modality benchmarks with the alternative of using an unimodal architecture on three different visible-infrared object detection datasets. Finally, our proposed method, when used as a regularization for the strongest modality, can beat the performance of multimodal fusion methods while only requiring a single modality during inference. Notably, MiPa became the state-of-the-art on the LLVIP visible/infrared benchmark. Code: https://github.com/heitorrapela/MiPa


title: Sparse Sampling in Fractional Fourier Domain: Recovery Guarantees and Cram\'er-Rao Bounds

abstract: Sampling theory in fractional Fourier Transform (FrFT) domain has been studied extensively in the last decades. This interest stems from the ability of the FrFT to generalize the traditional Fourier Transform, broadening the traditional concept of bandwidth and accommodating a wider range of functions that may not be bandlimited in the Fourier sense. Beyond bandlimited functions, sampling and recovery of sparse signals has also been studied in the FrFT domain. Existing methods for sparse recovery typically operate in the transform domain, capitalizing on the spectral features of spikes in the FrFT domain. Our paper contributes two new theoretical advancements in this area. First, we introduce a novel time-domain sparse recovery method that avoids the typical bottlenecks of transform domain methods, such as spectral leakage. This method is backed by a sparse sampling theorem applicable to arbitrary FrFT-bandlimited kernels and is validated through a hardware experiment. Second, we present Cram\'er-Rao Bounds for the sparse sampling problem, addressing a gap in existing literature.


title: A Comprehensive Rubric for Annotating Pathological Speech

abstract: Rubrics are a commonly used tool for labeling voice corpora in speech quality assessment, although their application in the context of pathological speech remains relatively limited. In this study, we introduce a comprehensive rubric based on various dimensions of speech quality, including phonetics, fluency, and prosody. The objective is to establish standardized criteria for identifying errors within the speech of individuals with Down syndrome, thereby enabling the development of automated assessment systems. To achieve this objective, we utilized the Prautocal corpus. To assess the quality of annotations using our rubric, two experiments were conducted, focusing on phonetics and fluency. For phonetic evaluation, we employed the Goodness of Pronunciation (GoP) metric, utilizing automatic segmentation systems and correlating the results with evaluations conducted by a specialized speech therapist. While the obtained correlation values were not notably high, a positive trend was observed. In terms of fluency assessment, deep learning models like wav2vec were used to extract audio features, and we employed an SVM classifier trained on a corpus focused on identifying fluency issues to categorize Prautocal corpus samples. The outcomes highlight the complexities of evaluating such phenomena, with variability depending on the specific type of disfluency detected.


title: VERT: Verified Equivalent Rust Transpilation with Large Language Models as Few-Shot Learners

abstract: Rust is a programming language that combines memory safety and low-level control, providing C-like performance while guaranteeing the absence of undefined behaviors by default. Rust's growing popularity has prompted research on safe and correct transpiling of existing code-bases to Rust. Existing work falls into two categories: rule-based and large language model (LLM)-based. While rule-based approaches can theoretically produce correct transpilations that maintain input-output equivalence to the original, they often yield unreadable Rust code that uses unsafe subsets of the Rust language. On the other hand, while LLM-based approaches typically produce more readable, maintainable, and safe code, they do not provide any guarantees about correctness. In this work, we present VERT, a tool that can produce readable Rust transpilations with formal guarantees of correctness. VERT's only requirement is that there is Web Assembly compiler for the source language, which is true for most major languages. VERT first uses the Web Assembly compiler to obtain an oracle Rust program. In parallel, VERT uses an LLM to generate a readable candidate Rust program. This candidate is verified against the oracle, and if verification fails, we regenerate a new candidate transpilation until verification succeeds. We evaluate VERT by transpiling a suite of 1,394 programs taken from competitive programming style benchmarks. Combining Anthropic's Claude-2 and VERT increases Rust transpilations passing property-based testing from 31% to 54% and bounded model-checking from 1% to 42% compared to using Claude alone. In addition, we evaluate VERT's ability to generate non-trivial safe Rust on programs taken from real-world C projects that make significant use of pointers. Our results provide insights into the limitations of LLMs to write safe Rust.


title: Continuity of the continued fraction mapping revisited

abstract: The continued fraction mapping maps a number in the interval $[0,1)$ to the sequence of its partial quotients. When restricted to the set of irrationals, which is a subspace of the Euclidean space $\mathbb{R}$, the continued fraction mapping is a homeomorphism onto the product space $\mathbb{N}^{\mathbb{N}}$, where $\mathbb{N}$ is a discrete space. In this short note, we examine the continuity of the continued fraction mapping, addressing both irrational and rational points of the unit interval.


title: Switching Models of Oscillatory Networks Greatly Improve Inference of Dynamic Functional Connectivity

abstract: Functional brain networks can change rapidly as a function of stimuli or cognitive shifts. Tracking dynamic functional connectivity is particularly challenging as it requires estimating the structure of the network at each moment as well as how it is shifting through time. In this paper, we describe a general modeling framework and a set of specific models that provides substantially increased statistical power for estimating rhythmic dynamic networks, based on the assumption that for a particular experiment or task, the network state at any moment is chosen from a discrete set of possible network modes. Each model is comprised of three components: (1) a set of latent switching states that represent transitions between the expression of each network mode; (2) a set of latent oscillators, each characterized by an estimated mean oscillation frequency and an instantaneous phase and amplitude at each time point; and (3) an observation model that relates the observed activity at each electrode to a linear combination of the latent oscillators. We develop an expectation-maximization procedure to estimate the network structure for each switching state and the probability of each state being expressed at each moment. We conduct a set of simulation studies to illustrate the application of these models and quantify their statistical power, even in the face of model misspecification.


title: Exceptional sets to Shallit's law of leap years in Pierce expansions

abstract: In his 1994 work, Shallit introduced a rule for determining leap years that generalizes both the historically used Julian calendar and the contemporary Gregorian calendar. This rule depends on a so-called intercalation sequence. According to what we term Shallit's law of leap years, almost every point of the interval $[0,1]$ with respect to Lebesgue measure has the same limsup and liminf, respectively, of a quotient defined in terms of the number of leap years determined by the rule using the Pierce expansion digit sequence as an intercalation sequence. In this paper, we show that the set of exceptions to this law is dense and has full Hausdorff dimension in $[0,1]$, and that the exceptional set intersected with any non-empty open subset of $[0,1]$ has full Hausdorff dimension in $[0,1]$. As a more general result, we establish that for certain subsets of $[0,1]$ concerning the limiting behavior of Pierce expansion digits, intersecting with a non-empty open subset of $[0,1]$ preserves the Hausdorff dimension.


title: Generating self-similar membrane solutions

abstract: Several ways to reduce to a first order ODE the non-linear PDE's governing the relativistic motion of an axially symmetric membrane in 4 space time dimensions, as well as examples for a previously found non-trivial transformation generating solutions, are given.


title: VT-MRF-SPF: Variable Target Markov Random Field Scalable Particle Filter

abstract: Markov random fields (MRFs) are invaluable tools across diverse fields, and spatiotemporal MRFs (STMRFs) amplify their effectiveness by integrating spatial and temporal dimensions. However, modeling spatiotemporal data introduces additional hurdles, including dynamic spatial dimensions and partial observations, prevalent in scenarios like disease spread analysis and environmental monitoring. Tracking high-dimensional targets with complex spatiotemporal interactions over extended periods poses significant challenges in accuracy, efficiency, and computational feasibility. To tackle these obstacles, we introduce the variable target MRF scalable particle filter (VT-MRF-SPF), a fully online learning algorithm designed for high-dimensional target tracking over STMRFs with varying dimensions under partial observation. We rigorously guarantee algorithm performance, explicitly indicating overcoming the curse of dimensionality. Additionally, we provide practical guidelines for tuning graphical parameters, leading to superior performance in extensive examinations.


title: Correlated Electron Effects in Chromium Trihalide Hetostructures with Graphene: A Tight-Binding Model Perspective

abstract: In this study, we present an effective tight-binding model for an accurate description of the lowest energy quadruplet of conduction band in a ferromagnetic CrX$_3$ monolayer, tuned to the complementary \textit{ab initio} density functional theory simulations. This model, based on a minimum number of chromium orbitals, captures a distinctively flat dispersion in those bands but requires taking into account hoppings beyond nearest neighbours, revealing ligand-mediated electron pathways connecting remote chromium sites. Doping of states in the lowest conduction band of CrX$_3$ requires charge transfer, which, according to recent studies, can occur in graphene(G)/CrX$_3$ heterostructures. Here, we use the detailed description of the lowest conduction band in CrI$_3$ to show that G/CrI$_3$/G and G/CrI$_3$ are type-II heterostructures where light holes in graphene would coexist with heavy electrons in the magnetic layer, where the latter can be characterised by Wigner parameter $r_s\sim 15-20$ (as estimated for hBN-encapsulated structures).


title: Leading terms of generalized Pl\"ucker formulas

abstract: Generalized Pl\"ucker numbers are defined to count certain types of tangent lines of generic degree $d$ complex projective hypersurfaces. They can be computed by identifying them as coefficients of GL(2)-equivariant cohomology classes of certain invariant subspaces, the so-called coincident root strata, of the vector space of homogeneous degree $d$ complex polynomials in two variables. In an earlier paper L\'aszl\'o M. Feh\'er and the author gave a new, recursive method for calculating these classes. Using this method, we showed that -- similarly to the classical Pl\"ucker formulas counting the bitangents and flex lines of a degree $d$ plane curve -- generalized Pl\"ucker numbers are polynomials in the degree $d$. In this paper, by further analyzing our recursive formula, we determine the leading terms of all the generalized Pl\"ucker formulas.


title: Constructive Recognition of Special Linear Groups

abstract: We introduce a new constructive recognition algorithm for finite special linear groups in their natural representation. Given a group $G$ generated by a set of $d\times d$ matrices over a finite field $\mathbb{F}_q$, known to be isomorphic to the special linear group $\mathrm{SL}(d,q)$, the algorithm computes a special generating set $S$ for $G$. These generators enable efficient computations with the input group, including solving the word problem. Implemented in the computer algebra system GAP, our algorithm outperforms existing state-of-the-art algorithms by a significant margin. A detailed complexity analysis of the algorithm will be presented in an upcoming publication.


title: A Survey on Vision Mamba: Models, Applications and Challenges

abstract: Mamba, a recent selective structured state space model, performs excellently on long sequence modeling tasks. Mamba mitigates the modeling constraints of convolutional neural networks and offers advanced modeling capabilities similar to those of Transformers, through global receptive fields and dynamic weighting. Crucially, it achieves this without incurring the quadratic computational complexity typically associated with Transformers. Due to its advantages over the former two mainstream foundation models, Mamba exhibits great potential to be a visual foundation model. Researchers are actively applying Mamba to various computer vision tasks, leading to numerous emerging works. To help keep pace with the rapid advancements in computer vision, this paper aims to provide a comprehensive review of visual Mamba approaches. This paper begins by delineating the formulation of the original Mamba model. Subsequently, our review of visual Mamba delves into several representative backbone networks to elucidate the core insights of the visual Mamba. We then categorize related works using different modalities, including image, video, point cloud, multi-modal, and others. Specifically, for image applications, we further organize them into distinct tasks to facilitate a more structured discussion. Finally, we discuss the challenges and future research directions for visual Mamba, providing insights for future research in this quickly evolving area. A comprehensive list of visual Mamba models reviewed in this work is available at https://github.com/Ruixxxx/Awesome-Vision-Mamba-Models.


title: Conformal Prediction Sets for Populations of Graphs

abstract: The analysis of data such as graphs has been gaining increasing attention in the past years. This is justified by the numerous applications in which they appear. Several methods are present to predict graphs, but much fewer to quantify the uncertainty of the prediction. The present work proposes an uncertainty quantification methodology for graphs, based on conformal prediction. The method works both for graphs with the same set of nodes (labelled graphs) and graphs with no clear correspondence between the set of nodes across the observed graphs (unlabelled graphs). The unlabelled case is dealt with the creation of prediction sets embedded in a quotient space. The proposed method does not rely on distributional assumptions, it achieves finite-sample validity, and it identifies interpretable prediction sets. To explore the features of this novel forecasting technique, we perform two simulation studies to show the methodology in both the labelled and the unlabelled case. We showcase the applicability of the method in analysing the performance of different teams during the FIFA 2018 football world championship via their player passing networks.


title: PlanNetX: Learning an Efficient Neural Network Planner from MPC for Longitudinal Control

abstract: Model predictive control (MPC) is a powerful, optimization-based approach for controlling dynamical systems. However, the computational complexity of online optimization can be problematic on embedded devices. Especially, when we need to guarantee fixed control frequencies. Thus, previous work proposed to reduce the computational burden using imitation learning (IL) approximating the MPC policy by a neural network. In this work, we instead learn the whole planned trajectory of the MPC. We introduce a combination of a novel neural network architecture PlanNetX and a simple loss function based on the state trajectory that leverages the parameterized optimal control structure of the MPC. We validate our approach in the context of autonomous driving by learning a longitudinal planner and benchmarking it extensively in the CommonRoad simulator using synthetic scenarios and scenarios derived from real data. Our experimental results show that we can learn the open-loop MPC trajectory with high accuracy while improving the closed-loop performance of the learned control policy over other baselines like behavior cloning.


title: Performance-Aligned LLMs for Generating Fast Code

abstract: Optimizing scientific software is a difficult task because codebases are often large and complex, and performance can depend upon several factors including the algorithm, its implementation, and hardware among others. Causes of poor performance can originate from disparate sources and be difficult to diagnose. Recent years have seen a multitude of work that use large language models (LLMs) to assist in software development tasks. However, these tools are trained to model the distribution of code as text, and are not specifically designed to understand performance aspects of code. In this work, we introduce a reinforcement learning based methodology to align the outputs of code LLMs with performance. This allows us to build upon the current code modeling capabilities of LLMs and extend them to generate better performing code. We demonstrate that our fine-tuned model improves the expected speedup of generated code over base models for a set of benchmark tasks from 0.9 to 1.6 for serial code and 1.9 to 4.5 for OpenMP code.


title: Truth-value judgment in language models: belief directions are context sensitive

abstract: Recent work has demonstrated that the latent spaces of large language models (LLMs) contain directions predictive of the truth of sentences. Multiple methods recover such directions and build probes that are described as getting at a model's "knowledge" or "beliefs". We investigate this phenomenon, looking closely at the impact of context on the probes. Our experiments establish where in the LLM the probe's predictions can be described as being conditional on the preceding (related) sentences. Specifically, we quantify the responsiveness of the probes to the presence of (negated) supporting and contradicting sentences, and score the probes on their consistency. We also perform a causal intervention experiment, investigating whether moving the representation of a premise along these belief directions influences the position of the hypothesis along that same direction. We find that the probes we test are generally context sensitive, but that contexts which should not affect the truth often still impact the probe outputs. Our experiments show that the type of errors depend on the layer, the (type of) model, and the kind of data. Finally, our results suggest that belief directions are (one of the) causal mediators in the inference process that incorporates in-context information.


title: K\"{a}hler Soliton Surfaces Are Generically Toric

abstract: Let $(M, g, \omega, f, \lambda)$ be a K\"{a}hler gradient Ricci soliton in real dimension four. The first theorem states that it is an integrable Hamiltonian system in a classical sense. Furthermore, it is either of cohomogeneity one or the integrals of motion are given by the potential function $f$ and the scalar curvature $\text{S}$. The second theorem states that it must be toric under a generic assumption. That is, one assumes that the system is non-degenerate and the potential function $f$ is proper. In case $\lambda=0$, one further assumes that $f$ is bounded below or above. Then there is an effective, completely integrable Hamiltonian toric $\mathbb{T}^2$- action on $(M, \omega)$.


title: Feminist Interaction Techniques: Deterring Non-Consensual Screenshots with Interaction Techniques

abstract: Non-consensual Intimate Media (NCIM) refers to the distribution of sexual or intimate content without consent. NCIM is common and causes significant emotional, financial, and reputational harm. We developed Hands-Off, an interaction technique for messaging applications that deters non-consensual screenshots. Hands-Off requires recipients to perform a hand gesture in the air, above the device, to unlock media -- which makes simultaneous screenshotting difficult. A lab study shows that Hands-Off gestures are easy to perform and reduce non-consensual screenshots by 67 percent. We conclude by generalizing this approach and introduce the idea of Feminist Interaction Techniques (FIT), interaction techniques that encode feminist values and speak to societal problems, and reflect on FIT's opportunities and limitations.


title: Optimization of District Heating Network Parameters in Steady-State Operation

abstract: We examine the modeling, simulation, and optimization of district heating systems, which are widely used for thermal transport using steam or hot water as a carrier. We propose a generalizable framework to specify network models and scenario parameters, and develop an optimization method for evaluating system states including pressures, fluid flow rates, and temperatures throughout the network. The network modeling includes pipes, thermal plants, pumps, and passive or controllable loads as system components. We propose basic models for thermodynamic fluid transport and enforce the balance of physical quantities in steady-state flow over co-located outgoing and return networks. We formulate an optimization problem with steam and hot water as the outgoing and return carriers, as in legacy 20th century systems. The physical laws and engineering limitations are specified for each component type, and the thermal network flow optimization (TNFO) problem is formulated and solved for a realistic test network under several scenarios.


title: Learning Mixtures of Gaussians Using Diffusion Models

abstract: We give a new algorithm for learning mixtures of $k$ Gaussians (with identity covariance in $\mathbb{R}^n$) to TV error $\varepsilon$, with quasi-polynomial ($O(n^{\text{poly log}\left(\frac{n+k}{\varepsilon}\right)})$) time and sample complexity, under a minimum weight assumption. Unlike previous approaches, most of which are algebraic in nature, our approach is analytic and relies on the framework of diffusion models. Diffusion models are a modern paradigm for generative modeling, which typically rely on learning the score function (gradient log-pdf) along a process transforming a pure noise distribution, in our case a Gaussian, to the data distribution. Despite their dazzling performance in tasks such as image generation, there are few end-to-end theoretical guarantees that they can efficiently learn nontrivial families of distributions; we give some of the first such guarantees. We proceed by deriving higher-order Gaussian noise sensitivity bounds for the score functions for a Gaussian mixture to show that that they can be inductively learned using piecewise polynomial regression (up to poly-logarithmic degree), and combine this with known convergence results for diffusion models. Our results extend to continuous mixtures of Gaussians where the mixing distribution is supported on a union of $k$ balls of constant radius. In particular, this applies to the case of Gaussian convolutions of distributions on low-dimensional manifolds, or more generally sets with small covering number.

categories: cs.LG cs.DS math.PR math.ST stat.ML stat.TH


title: More RLHF, More Trust? On The Impact of Human Preference Alignment On Language Model Trustworthiness

abstract: The surge in Large Language Models (LLMs) development has led to improved performance on cognitive tasks as well as an urgent need to align these models with human values in order to safely exploit their power. Despite the effectiveness of preference learning algorithms like Reinforcement Learning From Human Feedback (RLHF) in aligning human preferences, their assumed improvements on model trustworthiness haven't been thoroughly testified. Toward this end, this study investigates how models that have been aligned with general-purpose preference data on helpfulness and harmlessness perform across five trustworthiness verticals: toxicity, stereotypical bias, machine ethics, truthfulness, and privacy. For model alignment, we focus on three widely used RLHF variants: Supervised Finetuning (SFT), Proximal Policy Optimization (PPO), and Direct Preference Optimization (DPO). Through extensive empirical investigations, we discover that the improvement in trustworthiness by RLHF is far from guaranteed, and there exists a complex interplay between preference data, alignment algorithms, and specific trustworthiness aspects. Together, our results underscore the need for more nuanced approaches for model alignment. By shedding light on the intricate dynamics of these components within model alignment, we hope this research will guide the community towards developing language models that are both capable and trustworthy.


title: Avalanche Dynamics and the Effect of Straining in Dislocation Systems with Quenched Disorder

abstract: The plastic deformation of crystalline and other heterogeneous materials often manifests in stochastic intermittent events indicating the criticality of plastic behavior. Previous studies demonstrated that the presence of short-ranged quenched disorder modifies this behavior disrupting long-range static and dynamic correlations consequently localizing dislocation avalanches. However, these observations were mostly confined to relaxed materials devoid of deformation history. In this work our focus is on how straining affects static and dynamic correlations, avalanche dynamics and local yield stresses. We demonstrate that the interplay between severe straining and confining quenched disorder induces critical behavior characterized by dislocation avalanches distinct from those at lower stresses. Namely, near the flow stress many avalanches, even if triggered locally, evolve into events affecting a larger region by exciting small clusters of dislocations all around the sample. This type of avalanches differ from the ones at low strains where plastic events typically consist of one compact cluster of dislocations which is either local or it is already quite extended at the onset of the avalanche. Furthermore, we examine the impact of avalanches on local yield stresses. It is shown in detail in this work that while some statistical features of the local yield thresholds are robust to straining, others are significantly affected by the deformation history.


title: Twist analysis of the spin-orbit correlation in QCD

abstract: We present a QCD analysis of the twist-three parton distribution functions associated with the spin-orbit correlation of quarks and gluons in the nucleon. We derive a novel longitudinal momentum sum rule which may be regarded as the momentum version of the Jaffe-Manohar spin sum rule. The result is also applicable to spinless hadrons and nuclei with trivial modifications.


title: OpenStreetView-5M: The Many Roads to Global Visual Geolocation

abstract: Determining the location of an image anywhere on Earth is a complex visual task, which makes it particularly relevant for evaluating computer vision algorithms. Yet, the absence of standard, large-scale, open-access datasets with reliably localizable images has limited its potential. To address this issue, we introduce OpenStreetView-5M, a large-scale, open-access dataset comprising over 5.1 million geo-referenced street view images, covering 225 countries and territories. In contrast to existing benchmarks, we enforce a strict train/test separation, allowing us to evaluate the relevance of learned geographical features beyond mere memorization. To demonstrate the utility of our dataset, we conduct an extensive benchmark of various state-of-the-art image encoders, spatial representations, and training strategies. All associated codes and models can be found at https://github.com/gastruc/osv5m.


title: The Essense of Useful Evaluation Through Quantitative Types (Extended Version)

abstract: Several evaluation notions for lambda calculus qualify as reasonable cost models according to Slot and van Emde Boas' Invariance Thesis. A notable result achieved by Accattoli and Dal Lago is that leftmost-outermost reduction is reasonable, where the term representation uses sharing and the steps are useful. These results, initially studied in call-by-name, have also been extended to call-by-value. However, the existing formulations of usefulness lack inductive structure, making it challenging in particular to define and reason about type systems on top of the untyped syntax. Additionally, no type-based quantitative interpretations exist for useful evaluation. In this work, we establish the first inductive definition of useful evaluation for open weak call-by-value. This new useful strategy connects to a previous implementation of usefulness through a low-level abstract machine, incurring only in linear time overhead, thus providing a reasonable cost model for open call-by-value implementation. We also propose a semantic interpretation of useful call-by-value using a non-idempotent intersection type system equipped with a notion of tightness. The resulting interpretation is quantitative, i.e. provides exact step-count information for program evaluation. This turns out to be the first semantical interpretation in the literature for a notion of useful evaluation.


title: Mapping eccentricity evolutions between numerical relativity and effective-one-body gravitational waveforms

abstract: Orbital eccentricity in compact binaries is considered to be a key tracer of their astrophysical origin, and can be inferred from gravitational-wave observations due to its imprint on the emitted signal. For a robust measurement, accurate waveform models are needed. However, ambiguities in the definition of eccentricity can obfuscate the physical meaning and result in seemingly discrepant measurements. In this work we present a suite of 28 new numerical relativity simulations of eccentric, aligned-spin binary black holes with mass ratios between 1 and 6 and initial post-Newtonian eccentricities between 0.05 and 0.3. We then develop a robust pipeline for measuring the eccentricity evolution as a function of frequency from gravitational-wave observables that is applicable even to signals that span at least $\gtrsim 7$ orbits. We assess the reliability of our procedure and quantify its robustness under different assumptions on the data. Using the eccentricity measured at the first apastron, we initialise effective-one-body waveforms and quantify how the precision in the eccentricity measurement, and therefore the choice of the initial conditions, impacts the agreement with the numerical data. We find that even small deviations in the initial eccentricity can lead to non-negligible differences in the phase and amplitude of the waveforms. However, we demonstrate that we can reliably map the eccentricities between the simulation data and analytic models, which is crucial for robustly building eccentric hybrid waveforms, and to improve the accuracy of eccentric waveform models in the strong-field regime.


title: A Multilevel Strategy to Improve People Tracking in a Real-World Scenario

abstract: The Pal\'acio do Planalto, office of the President of Brazil, was invaded by protesters on January 8, 2023. Surveillance videos taken from inside the building were subsequently released by the Brazilian Supreme Court for public scrutiny. We used segments of such footage to create the UFPR-Planalto801 dataset for people tracking and re-identification in a real-world scenario. This dataset consists of more than 500,000 images. This paper presents a tracking approach targeting this dataset. The method proposed in this paper relies on the use of known state-of-the-art trackers combined in a multilevel hierarchy to correct the ID association over the trajectories. We evaluated our method using IDF1, MOTA, MOTP and HOTA metrics. The results show improvements for every tracker used in the experiments, with IDF1 score increasing by a margin up to 9.5%.


title: High-Energy Reaction Dynamics of N$_{3}$

abstract: The atom-exchange and atomization dissociation dynamics for the N($^4$S) + N$_2(^1 \Sigma_{\rm g}^+)$ reaction is studied using a reproducing kernel Hilbert space (RKHS)-based, global potential energy surface (PES) at the MRCI-F12/aug-cc-pVTZ-F12 level of theory. For the atom exchange reaction $({\rm N_A N_B} + {\rm N_C} \rightarrow {\rm N_A N_C} + {\rm N_B}$), computed thermal rates and their temperature dependence from quasi-classical trajectory (QCT) simulations agree to within error bars with the available experiments. Companion QCT simulations using a recently published CASPT2-based PES confirm these findings. For the atomization reaction, leading to three N$(^4{\rm S})$ atoms, the computed rates from the RKHS-PES overestimate the experimentally reported rates by one order of magnitude whereas those from the PIP-PES agree favourably, and the $T$-dependence of both computations is consistent with experiment. These differences can be traced back to the different methods and basis sets used. The lifetime of the metastable N$_3$ molecule is estimated to be $\sim 200$ fs depending on the initial state of the reactants. Finally, neural network-based exhaustive state-to-distribution models are presented using both PESs for the atom exchange reaction. These models will be instrumental for a broader exploration of the reaction dynamics of air.


title: Spin coupling is all you need: Encoding strong electron correlation on quantum computers

abstract: The performance of quantum algorithms for eigenvalue problems, such as computing Hamiltonian spectra, depends strongly on the overlap of the initial wavefunction and the target eigenvector. In a basis of Slater determinants, the representation of energy eigenstates of systems with $N$ strongly correlated electrons requires a number of determinants that scales exponentially with $N$. On classical processors, this restricts simulations to systems where $N$ is small. Here, we show that quantum computers can efficiently simulate strongly correlated molecular systems by directly encoding the dominant entanglement structure in the form of spin-coupled initial states. This avoids resorting to expensive classical or quantum state preparation heuristics and instead exploits symmetries in the wavefunction. We provide quantum circuits for deterministic preparation of a family of spin eigenfunctions with ${N \choose N/2}$ Slater determinants with depth $\mathcal{O}(N)$ and $\mathcal{O}(N^2)$ local gates. Their use as highly entangled initial states in quantum algorithms reduces the total runtime of quantum phase estimation and related fault-tolerant methods by orders of magnitude. Furthermore, we assess the application of spin-coupled wavefunctions as initial states for a range of heuristic quantum algorithms, namely the variational quantum eigensolver, adiabatic state preparation, and different versions of quantum subspace diagonalization (QSD) including QSD based on real-time-evolved states. We also propose a novel QSD algorithm that exploits states obtained through adaptive quantum eigensolvers. For all algorithms, we demonstrate that using spin-coupled initial states drastically reduces the quantum resources required to simulate strongly correlated ground and excited states. Our work paves the way towards scalable quantum simulation of electronic structure for classically challenging systems.


title: SCN as a Local Probe of Protein Structural Dynamics

abstract: The dynamics of lysozyme is probed by attaching -SCN to all alanine-residues. The 1-dimensional infrared spectra exhibit frequency shifts in the position of the maximum absorption by 4 cm$^{-1}$ which is consistent with experiments in different solvents and indicates moderately strong interactions of the vibrational probe with its environment. Isotopic substitution $^{12}$C $\rightarrow ^{13}$C leads to a red-shift by $-47$ cm$^{-1}$ which is consistent with experiments with results on CN-substituted copper complexes in solution. The low-frequency, far-infrared part of the protein spectra contain label-specific information in the difference spectra when compared with the wild type protein. Depending on the positioning of the labels, local structural changes are observed. For example, introducing the -SCN label at Ala129 leads to breaking of the $\alpha-$helical structure with concomitant change in the far-infrared spectrum. Finally, changes in the local hydration of SCN-labelled Alanine residues as a function of time can be related to angular reorientation of the label. It is concluded that -SCN is potentially useful for probing protein dynamics, both in the high-frequency (CN-stretch) and far-infrared part of the spectrum.


title: Spivavtor: An Instruction Tuned Ukrainian Text Editing Model

abstract: We introduce Spivavtor, a dataset, and instruction-tuned models for text editing focused on the Ukrainian language. Spivavtor is the Ukrainian-focused adaptation of the English-only CoEdIT model. Similar to CoEdIT, Spivavtor performs text editing tasks by following instructions in Ukrainian. This paper describes the details of the Spivavtor-Instruct dataset and Spivavtor models. We evaluate Spivavtor on a variety of text editing tasks in Ukrainian, such as Grammatical Error Correction (GEC), Text Simplification, Coherence, and Paraphrasing, and demonstrate its superior performance on all of them. We publicly release our best-performing models and data as resources to the community to advance further research in this space.


title: Human-in-the-Loop Synthetic Text Data Inspection with Provenance Tracking

abstract: Data augmentation techniques apply transformations to existing texts to generate additional data. The transformations may produce low-quality texts, where the meaning of the text is changed and the text may even be mangled beyond human comprehension. Analyzing the synthetically generated texts and their corresponding labels is slow and demanding. To winnow out texts with incorrect labels, we develop INSPECTOR, a human-in-the-loop data inspection technique. INSPECTOR combines the strengths of provenance tracking techniques with assistive labeling. INSPECTOR allows users to group related texts by their transformation provenance, i.e., the transformations applied to the original text, or feature provenance, the linguistic features of the original text. For assistive labeling, INSPECTOR computes metrics that approximate data quality, and allows users to compare the corresponding label of each text against the predictions of a large language model. In a user study, INSPECTOR increases the number of texts with correct labels identified by 3X on a sentiment analysis task and by 4X on a hate speech detection task. The participants found grouping the synthetically generated texts by their common transformation to be the most useful technique. Surprisingly, grouping texts by common linguistic features was perceived to be unhelpful. Contrary to prior work, our study finds that no single technique obviates the need for human inspection effort. This validates the design of INSPECTOR which combines both analysis of data provenance and assistive labeling to reduce human inspection effort.


title: The $\Omega_c \to \pi^+ \, (\pi^0,\, \eta)\, \pi \Xi^*$ reactions and the two $\Xi(1820)$ states

abstract: We have studied the $\Omega_c \to \pi^+ (\pi^0, \eta) \pi \Xi^*$ decays, where the final $\pi \Xi^*$ comes from the decay of two resonances around the nominal $\Xi(1820)$, which are generated from the interaction of coupled channels made of a pseudoscalar and a baryon of the decuplet. The $\pi \Xi^*$ mass distributions obtained in the six different reactions studied are quite different and we single out four of them, which are free of a tree level contribution, showing more clearly the effect of the resonances. The lower mass resonance is clearly seen as a sharp peak, but the higher mass resonance manifests itself through an interference with the lower one that leads to a dip in the mass distribution around $1850 \, {\rm MeV}$. Such a feature is similar to the dip observed in the $s$-wave $\pi \pi$ cross section around the $980 \, {\rm MeV}$ coming from the interference of the $f_0(500)$ and $f_0(980)$ resonances. Its observation in coming upgrades of present facilities will shed light on the existence of these two resonances and their nature.


title: A Thom Isotopy Theorem for nonproper semialgebraic maps

abstract: We prove a version of the Thom Isotopy Theorem for nonproper semialgebraic maps $f\colon X\rightarrow \mathbb{R}^m$, where $X \subset\mathbb{R}^n$ is a semialgebraic set and $f$ is the restriction to $X$ of a smooth semialgebraic map $F:\mathbb{R}^n\to \mathbb{R}^m$.


title: Reputation in Repeated Global Games of Regime Change with Exit

abstract: I study a repeated binary-action supermodular game with endogenous exit where many short-lived agents attempt to coordinate a revolt against a regime. The regime undertakes costly actions to increase the short-run players' coordination frictions, though acts only after if the revolt is unsuccessful, inducing a lack-of-commitment problem. In the complete-information repeated game, a folk theorem holds, with payoff multiplicity arising due to both the regime's dynamic incentives and agents' stage-game strategic complementarities. Neither the regime's reputational incentives nor belief dispersion among agents (via global-games type uncertainty) alone meaningfully refine the equilibrium payoff set. Together, though, the interaction between these two forces uniquely select the regime's highest payoff in equilibrium. Furthermore, under a Markov refinement, they select a unique equilibrium where the regime plays their optimal commitment action. Methodologically, I develop tools to analyze repeated games with endogenous exit where the regime's commitment action flexibly varies with their discount rate.


title: Mikhail Lomonosov: Discourse on Greater Accuracy of Navigation

abstract: Mikhail Lomonosov (1711-1765) is the eminent Russian polymath and a towering figure of the European Enlightenment. This English translation of his seminal work Discourse on Greater Accuracy of Navigation concludes the series of English translations of nine most significant scientific treatises, all of which Lomonosov himself compiled in the volume titled Lomonosow Opera Academica, intended for dissemination among European Academies.


title: A Survey on Diffusion Models for Time Series and Spatio-Temporal Data

abstract: The study of time series is crucial for understanding trends and anomalies over time, enabling predictive insights across various sectors. Spatio-temporal data, on the other hand, is vital for analyzing phenomena in both space and time, providing a dynamic perspective on complex system interactions. Recently, diffusion models have seen widespread application in time series and spatio-temporal data mining. Not only do they enhance the generative and inferential capabilities for sequential and temporal data, but they also extend to other downstream tasks. In this survey, we comprehensively and thoroughly review the use of diffusion models in time series and spatio-temporal data, categorizing them by model category, task type, data modality, and practical application domain. In detail, we categorize diffusion models into unconditioned and conditioned types and discuss time series and spatio-temporal data separately. Unconditioned models, which operate unsupervised, are subdivided into probability-based and score-based models, serving predictive and generative tasks such as forecasting, anomaly detection, classification, and imputation. Conditioned models, on the other hand, utilize extra information to enhance performance and are similarly divided for both predictive and generative tasks. Our survey extensively covers their application in various fields, including healthcare, recommendation, climate, energy, audio, and transportation, providing a foundational understanding of how these models analyze and generate data. Through this structured overview, we aim to provide researchers and practitioners with a comprehensive understanding of diffusion models for time series and spatio-temporal data analysis, aiming to direct future innovations and applications by addressing traditional challenges and exploring innovative solutions within the diffusion model framework.


title: PrescientFuzz: A more effective exploration approach for grey-box fuzzing

abstract: In this paper, we introduce an approach for improving the early exploration of grey-box fuzzing campaigns; allowing the fuzzer to reach the interesting coverage earlier. To do this, it leverages information from the system under test's (SUT's) control flow graph in order to decide which inputs are likely to lead to discovering most coverage when mutated.


title: Hungarian cubes

abstract: We prove the consistency of the relation $\left( \begin{smallmatrix} \nu \\ \mu \\ \lambda \end{smallmatrix} \right) \rightarrow \left( \begin{smallmatrix} \nu \\ \mu \\ \lambda \end{smallmatrix} \right)$ when $\lambda<\mu= {\rm cf}(\mu)<\nu={\rm cf}(\nu)\leq 2^\mu$.


title: An optimal lower bound for smooth convex functions

abstract: First order methods endowed with global convergence guarantees operate using global lower bounds on the objective. The tightening of the bounds has been shown to increase both the theoretical guarantees and the practical performance. In this work, we define a global lower bound for smooth differentiable objectives that is optimal with respect to the collected oracle information. The bound can be readily employed by the Gradient Method with Memory to improve its performance. Further using the machinery underlying the optimal bounds, we introduce a modified version of the estimate sequence that we use to construct an Optimized Gradient Method with Memory possessing the best known convergence guarantees for its class of algorithms, even in terms of the proportionality constant. We additionally equip the method with an adaptive convergence guarantee adjustment procedure that is an effective replacement for line-search. Simulation results on synthetic but otherwise difficult smooth problems validate the theoretical properties of the bound and proposed methods.


title: Hide and Seek: How Does Watermarking Impact Face Recognition?

abstract: The recent progress in generative models has revolutionized the synthesis of highly realistic images, including face images. This technological development has undoubtedly helped face recognition, such as training data augmentation for higher recognition accuracy and data privacy. However, it has also introduced novel challenges concerning the responsible use and proper attribution of computer generated images. We investigate the impact of digital watermarking, a technique for embedding ownership signatures into images, on the effectiveness of face recognition models. We propose a comprehensive pipeline that integrates face image generation, watermarking, and face recognition to systematically examine this question. The proposed watermarking scheme, based on an encoder-decoder architecture, successfully embeds and recovers signatures from both real and synthetic face images while preserving their visual fidelity. Through extensive experiments, we unveil that while watermarking enables robust image attribution, it results in a slight decline in face recognition accuracy, particularly evident for face images with challenging poses and expressions. Additionally, we find that directly training face recognition models on watermarked images offers only a limited alleviation of this performance decline. Our findings underscore the intricate trade off between watermarking and face recognition accuracy. This work represents a pivotal step towards the responsible utilization of generative models in face recognition and serves to initiate discussions regarding the broader implications of watermarking in biometrics.


title: IPixMatch: Boost Semi-supervised Semantic Segmentation with Inter-Pixel Relation

abstract: The scarcity of labeled data in real-world scenarios is a critical bottleneck of deep learning's effectiveness. Semi-supervised semantic segmentation has been a typical solution to achieve a desirable tradeoff between annotation cost and segmentation performance. However, previous approaches, whether based on consistency regularization or self-training, tend to neglect the contextual knowledge embedded within inter-pixel relations. This negligence leads to suboptimal performance and limited generalization. In this paper, we propose a novel approach IPixMatch designed to mine the neglected but valuable Inter-Pixel information for semi-supervised learning. Specifically, IPixMatch is constructed as an extension of the standard teacher-student network, incorporating additional loss terms to capture inter-pixel relations. It shines in low-data regimes by efficiently leveraging the limited labeled data and extracting maximum utility from the available unlabeled data. Furthermore, IPixMatch can be integrated seamlessly into most teacher-student frameworks without the need of model modification or adding additional components. Our straightforward IPixMatch method demonstrates consistent performance improvements across various benchmark datasets under different partitioning protocols.


title: Comprehensive Synthesis of Magnetic Tornado: Co-spatial Incidence of Chromospheric Swirls and EUV Brightening

abstract: Magnetic tornadoes, characterized as impulsive Alfven waves initiated by photospheric vortices in intergranular lanes, are considered efficient energy channels to the corona. Despite their acknowledged importance for solar coronal heating, their observational counterparts from the corona have not been well understood. To address this issue, we use a radiative MHD simulation of a coronal loop with footpoints rooted in the upper convection zone, and synthesize the chromospheric and coronal emissions corresponding to a magnetic tornado. Considering SDO/AIA 171 A and Solar Orbiter/EUI 174 A channels, our synthesis reveals that the coronal response to magnetic tornadoes can be observed as an EUV brightening of which width is ~2 Mm. This brightening is located above the synthesized chromospheric swirl observed in Ca II 8542 A, Ca II K, and Mg II k lines, which can be detected by instruments such as SST/CRISP, GST/FISS, and IRIS. Considering the height correspondence of the synthesized brightening, magnetic tornadoes can be an alternative mechanism for the small-scale EUV brightenings such as the solar "campfires''. Our findings indicate that coordinated observations encompassing the chromosphere to the corona are indispensable for comprehending the origin of coronal EUV brightenings.


title: Learning general Gaussian mixtures with efficient score matching

abstract: We study the problem of learning mixtures of $k$ Gaussians in $d$ dimensions. We make no separation assumptions on the underlying mixture components: we only require that the covariance matrices have bounded condition number and that the means and covariances lie in a ball of bounded radius. We give an algorithm that draws $d^{\mathrm{poly}(k/\varepsilon)}$ samples from the target mixture, runs in sample-polynomial time, and constructs a sampler whose output distribution is $\varepsilon$-far from the unknown mixture in total variation. Prior works for this problem either (i) required exponential runtime in the dimension $d$, (ii) placed strong assumptions on the instance (e.g., spherical covariances or clusterability), or (iii) had doubly exponential dependence on the number of components $k$. Our approach departs from commonly used techniques for this problem like the method of moments. Instead, we leverage a recently developed reduction, based on diffusion models, from distribution learning to a supervised learning task called score matching. We give an algorithm for the latter by proving a structural result showing that the score function of a Gaussian mixture can be approximated by a piecewise-polynomial function, and there is an efficient algorithm for finding it. To our knowledge, this is the first example of diffusion models achieving a state-of-the-art theoretical guarantee for an unsupervised learning task.


title: Odd viscosity suppresses intermittency in direct turbulent cascades

abstract: Intermittency refers to the broken self-similarity of turbulent flows caused by anomalous spatio-temporal fluctuations. In this Letter, we ask how intermittency is affected by a non-dissipative viscosity, known as odd viscosity, which appears in parity-breaking fluids such as magnetized polyatomic gases, electron fluids under magnetic field and spinning colloids or grains. Using a combination of Navier-Stokes simulations and theory, we show that intermittency is suppressed by odd viscosity at small scales. This effect is caused by parity-breaking waves, induced by odd viscosity, that break the multiple scale invariances of the Navier-Stokes equations. Building on this insight, we construct a two-channel helical shell model that reproduces the basic phenomenology of turbulent odd-viscous fluids including the suppression of anomalous scaling. Our findings illustrate how a fully developed direct cascade that is entirely self-similar can emerge below a tunable length scale, paving the way for designing turbulent flows with adjustable levels of intermittency.


title: RSCaMa: Remote Sensing Image Change Captioning with State Space Model

abstract: Remote Sensing Image Change Captioning (RSICC) aims to describe surface changes between multi-temporal remote sensing images in language, including the changed object categories, locations, and dynamics of changing objects (e.g., added or disappeared). This poses challenges to spatial and temporal modeling of bi-temporal features. Despite previous methods progressing in the spatial change perception, there are still weaknesses in joint spatial-temporal modeling. To address this, in this paper, we propose a novel RSCaMa model, which achieves efficient joint spatial-temporal modeling through multiple CaMa layers, enabling iterative refinement of bi-temporal features. To achieve efficient spatial modeling, we introduce the recently popular Mamba (a state space model) with a global receptive field and linear complexity into the RSICC task and propose the Spatial Difference-aware SSM (SD-SSM), overcoming limitations of previous CNN- and Transformer-based methods in the receptive field and computational complexity. SD-SSM enhances the model's ability to capture spatial changes sharply. In terms of efficient temporal modeling, considering the potential correlation between the temporal scanning characteristics of Mamba and the temporality of the RSICC, we propose the Temporal-Traversing SSM (TT-SSM), which scans bi-temporal features in a temporal cross-wise manner, enhancing the model's temporal understanding and information interaction. Experiments validate the effectiveness of the efficient joint spatial-temporal modeling and demonstrate the outstanding performance of RSCaMa and the potential of the Mamba in the RSICC task. Additionally, we systematically compare three different language decoders, including Mamba, GPT-style decoder, and Transformer decoder, providing valuable insights for future RSICC research. The code will be available at \emph{\url{https://github.com/Chen-Yang-Liu/RSCaMa}}


title: Overcoming Knowledge Barriers: Online Imitation Learning from Observation with Pretrained World Models

abstract: Incorporating the successful paradigm of pretraining and finetuning from Computer Vision and Natural Language Processing into decision-making has become increasingly popular in recent years. In this paper, we study Imitation Learning from Observation with pretrained models and find existing approaches such as BCO and AIME face knowledge barriers, specifically the Embodiment Knowledge Barrier (EKB) and the Demonstration Knowledge Barrier (DKB), greatly limiting their performance. The EKB arises when pretrained models lack knowledge about unseen observations, leading to errors in action inference. The DKB results from policies trained on limited demonstrations, hindering adaptability to diverse scenarios. We thoroughly analyse the underlying mechanism of these barriers and propose AIME-v2 upon AIME as a solution. AIME-v2 uses online interactions with data-driven regulariser to alleviate the EKB and mitigates the DKB by introducing a surrogate reward function to enhance policy training. Experimental results on tasks from the DeepMind Control Suite and Meta-World benchmarks demonstrate the effectiveness of these modifications in improving both sample-efficiency and converged performance. The study contributes valuable insights into resolving knowledge barriers for enhanced decision-making in pretraining-based approaches. Code will be available at https://github.com/argmax-ai/aime-v2.


title: Neural network prediction of model parameters for strong lensing samples from Hyper Suprime-Cam Survey

abstract: Galaxies that cause the strong gravitational lensing of background galaxies provide us crucial information about the distribution of matter around them. Traditional modelling methods that analyse such strong lenses are both time and resource consuming, require sophisticated lensing codes and modelling expertise. To study the large lens population expected from imaging surveys such as LSST, we need fast and automated analysis methods. In this work, we build and train a simple convolutional neural network with an aim to rapidly predict model parameters of gravitational lenses. We focus on the most important lens mass model parameters, namely, the Einstein radius, the axis ratio and the position angle of the major axis of the mass distribution. The network is trained on a variety of simulated data with an increasing degree of realism and shows satisfactory performance on simulated test data. The trained network is then applied to the real sample of galaxy-scale candidate lenses from the Subaru HSC, a precursor survey to LSST. Unlike the simulated lenses, we do not have the ground truth for the real lenses. Therefore, we have compared our predictions with those from YattaLens, a lens modelling pipeline. Additionally, we also compare the parameter predictions for 10 HSC lenses that were also studied by other conventional modelling methods. These comparisons show a fair quantitative agreement on the Einstein radius, although the axis ratio and the position angle from the network as well as the individual modelling methods, seem to have systematic uncertainties beyond the quoted errors.


title: Celestial Optical Theorem

abstract: We establish the nonperturbative celestial optical theorem from the unitarity of $S$-matrix. This theorem provides a set of nonperturbative bootstrap equations of the conformal partial wave (CPW) coefficients. The celestial optical theorem implies that the imaginary part of CPW coefficient with appropriate conformal dimensions is non-negative. By making certain assumptions and using the celestial optical theorem, we derive nonperturbative results concerning the analytic structure of CPW coefficients. We discover that the CPW coefficients of four massless particles must and only have simple poles located at specific positions. The CPW coefficients involving massive particles exhibit double-trace poles, indicating the existence of double-trace operators in nonperturbative CCFT. It is worth noting that, in contrast to AdS/CFT, the conformal dimensions of double-trace operators do not receive anomalous dimensions.


title: High-performance gate-controlled superconducting switches: large output voltage and reproducibility

abstract: Logic circuits consist of devices that can be controlled between two distinct states. The recent demonstration that a superconducting current flowing in a constriction can be controlled via a gate voltage ($V_G$) - can lead to superconducting logic with better performance than existing logics. However, before such logic is developed, high reproducibility in the functioning of GCS devices and optimization of their performance must be achieved. Here, we report an investigation of gated Nb devices showing GCS with unprecedently-high reproducibility. Based on the investigation of a statistically-significant number of devices, we demonstrate that the GCS is independent of the constriction width, in contrast with previous reports, and confirm a strong correlation between the GCS and the leakage current ($I_{leak}$) induced by $V_G$. We also achieve a voltage output in our devices larger than the typical values reported to date by at least one order of magnitude, which is relevant for the future interconnection of devices, and show that $I_{leak}$ can be used as a tool to modulate the operational $V_G$ of devices on a $SiO_2$ substrates. These results altogether represent an important step forward towards the optimization of reproducibility and performance of GCS devices, and the future development of a GCS-based logic.


title: Non-planar integrated correlator in $\mathcal{N}=4$ SYM

abstract: Integrated correlator of four superconformal stress-tensor primaries in $SU(N)$ $\mathcal{N}=4$ super Yang-Mills (SYM) theory in the perturbative limit takes a remarkably simple form, where the $L$-loop coefficient is given by a rational multiple of $\zeta(2L+1)$. In this letter, we extend the previous analysis of expressing the perturbative integrated correlator as a linear combination of periods of $f$-graphs, graphical representations for loop integrands, to the non-planar sector at four loops. At this loop order, multiple zeta values make their first appearance when evaluating periods of non-planar $f$-graphs, but cancel non-trivially in the weighted sum. The remaining single zeta value, along with the rational number prefactor, makes a perfect agreement with the prediction from supersymmmetric localisation.


title: Finite Element Approximation of the Fractional Porous Medium Equation

abstract: We construct a finite element method for the numerical solution of a fractional porous medium equation on a bounded open Lipschitz polytopal domain $\Omega \subset \mathbb{R}^{d}$, where $d = 2$ or $3$. The pressure in the model is defined as the solution of a fractional Poisson equation, involving the fractional Neumann Laplacian in terms of its spectral definition. We perform a rigorous passage to the limit as the spatial and temporal discretization parameters tend to zero and show that a subsequence of the sequence of finite element approximations defined by the proposed numerical method converges to a bounded and nonnegative weak solution of the initial-boundary-value problem under consideration. This result can be therefore viewed as a constructive proof of the existence of a nonnegative, energy-dissipative, weak solution to the initial-boundary-value problem for the fractional porous medium equation under consideration, based on the Neumann Laplacian. The convergence proof relies on results concerning the finite element approximation of the spectral fractional Laplacian and compactness techniques for nonlinear partial differential equations, together with properties of the equation, which are shown to be inherited by the numerical method. We also prove that the total energy associated with the problem under consideration exhibits exponential decay in time.


title: Capacity threshold for the Ising perceptron

abstract: We show that the capacity of the Ising perceptron is with high probability upper bounded by the constant $\alpha_\star \approx 0.833$ conjectured by Krauth and M\'ezard, under the condition that an explicit two-variable function $\mathscr{S}_\star(\lambda_1,\lambda_2)$ is maximized at $(1,0)$. The earlier work of Ding and Sun proves the matching lower bound subject to a similar numerical condition, and together these results give a conditional proof of the conjecture of Krauth and M\'ezard.


title: The impact of noise on the simulation of NMR spectroscopy on NISQ devices

abstract: We present the simulation of nuclear magnetic resonance (NMR) spectroscopy of small organic molecules with two promising quantum computing platforms, namely IBM's quantum processors based on superconducting qubits and IonQ's Aria trapped ion quantum computer addressed via Amazon Bracket. We analyze the impact of noise on the obtained NMR spectra, and we formulate an effective decoherence rate that quantifies the threshold noise that our proposed algorithm can tolerate. Furthermore we showcase how our noise analysis allows us to improve the spectra. Our investigations pave the way to better employ such application-driven quantum tasks on current noisy quantum devices.


title: On classes of bounded tree rank, their interpretations, and efficient sparsification

abstract: Graph classes of bounded tree rank were introduced recently in the context of the model checking problem for first-order logic of graphs. These graph classes are a common generalization of graph classes of bounded degree and bounded treedepth, and they are a special case of graph classes of bounded expansion. We introduce a notion of decomposition for these classes and show that these decompositions can be efficiently computed. Also, a natural extension of our decomposition leads to a new characterization and decomposition for graph classes of bounded expansion (and an efficient algorithm computing this decomposition). We then focus on interpretations of graph classes of bounded tree rank. We give a characterization of graph classes interpretable in graph classes of tree rank $2$. Importantly, our characterization leads to an efficient sparsification procedure: For any graph class $C$ interpretable in a efficiently bounded graph class of tree rank at most $2$, there is a polynomial time algorithm that to any $G \in C$ computes a (sparse) graph $H$ from a fixed graph class of tree rank at most $2$ such that $G = I(H)$ for a fixed interpretation $I$. To the best of our knowledge, this is the first efficient "interpretation reversal" result that generalizes the result of Gajarsk\'y et al. [LICS 2016], who showed an analogous result for graph classes interpretable in classes of graphs of bounded degree.


title: Detecting critical treatment effect bias in small subgroups

abstract: Randomized trials are considered the gold standard for making informed decisions in medicine, yet they often lack generalizability to the patient populations in clinical practice. Observational studies, on the other hand, cover a broader patient population but are prone to various biases. Thus, before using an observational study for decision-making, it is crucial to benchmark its treatment effect estimates against those derived from a randomized trial. We propose a novel strategy to benchmark observational studies beyond the average treatment effect. First, we design a statistical test for the null hypothesis that the treatment effects estimated from the two studies, conditioned on a set of relevant features, differ up to some tolerance. We then estimate an asymptotically valid lower bound on the maximum bias strength for any subgroup in the observational study. Finally, we validate our benchmarking strategy in a real-world setting and show that it leads to conclusions that align with established medical knowledge.


title: On Clustering Induced Voronoi Diagrams

abstract: In this paper, we study a generalization of the classical Voronoi diagram, called clustering induced Voronoi diagram (CIVD). Different from the traditional model, CIVD takes as its sites the power set $U$ of an input set $P$ of objects. For each subset $C$ of $P$, CIVD uses an influence function $F(C,q)$ to measure the total (or joint) influence of all objects in $C$ on an arbitrary point $q$ in the space $\mathbb{R}^d$, and determines the influence-based Voronoi cell in $\mathbb{R}^d$ for $C$. This generalized model offers a number of new features (e.g., simultaneous clustering and space partition) to Voronoi diagram which are useful in various new applications. We investigate the general conditions for the influence function which ensure the existence of a small-size (e.g., nearly linear) approximate CIVD for a set $P$ of $n$ points in $\mathbb{R}^d$ for some fixed $d$. To construct CIVD, we first present a standalone new technique, called approximate influence (AI) decomposition, for the general CIVD problem. With only $O(n\log n)$ time, the AI decomposition partitions the space $\mathbb{R}^{d}$ into a nearly linear number of cells so that all points in each cell receive their approximate maximum influence from the same (possibly unknown) site (i.e., a subset of $P$). Based on this technique, we develop assignment algorithms to determine a proper site for each cell in the decomposition and form various $(1-\epsilon)$-approximate CIVDs for some small fixed $\epsilon>0$. Particularly, we consider two representative CIVD problems, vector CIVD and density-based CIVD, and show that both of them admit fast assignment algorithms; consequently, their $(1-\epsilon)$-approximate CIVDs can be built in $O(n \log^{\max\{3,d+1\}}n)$ and $O(n \log^{2} n)$ time, respectively.


title: Studies of $T_{cc}^+$ Decays and Transverse-Momentum-Dependent $J/\psi$ Production Using Effective Field Theory

abstract: We describe the application of effective field theories for quantum chromodynamics (QCD) to two bound states involving heavy quarks: the $T_{cc}^+$ exotic meson and the $J/\psi$. We study the decay of the $T_{cc}^+$ in an effective theory for hadronic molecules, and find agreement with experiment. We also use the nonrelativistic QCD (NRQCD) factorization formalism to derive the leading-order transverse momentum dependent fragmentation functions (FFs) for quarks and gluons fragmenting to $J/\psi$. We then make use of these TMD FFs to compare the $J/\psi$ production mechanisms of light quark fragmentation and photon-gluon fusion, where the conclusions we draw can motivate future experiments at the Electron Ion Collider, shedding light on the inner structure of nucleons and testing ideas from NRQCD factorization. These results showcase the utility of effective field theories in explaining experiments and testing key concepts in nuclear/particle physics.


title: On the uncommonness of minimal rank-2 systems of linear equations

abstract: We prove that suitably generic pairs of linear equations on an even number of variables are uncommon. This verifies a conjecture of Kam\v{c}ev, Morrison and the second author. Moreover, we prove that any large system containing such a $(2\times k)$-system as a minimal subsystem is uncommon.


title: Sample-Efficient Robust Multi-Agent Reinforcement Learning in the Face of Environmental Uncertainty

abstract: To overcome the sim-to-real gap in reinforcement learning (RL), learned policies must maintain robustness against environmental uncertainties. While robust RL has been widely studied in single-agent regimes, in multi-agent environments, the problem remains understudied -- despite the fact that the problems posed by environmental uncertainties are often exacerbated by strategic interactions. This work focuses on learning in distributionally robust Markov games (RMGs), a robust variant of standard Markov games, wherein each agent aims to learn a policy that maximizes its own worst-case performance when the deployed environment deviates within its own prescribed uncertainty set. This results in a set of robust equilibrium strategies for all agents that align with classic notions of game-theoretic equilibria. Assuming a non-adaptive sampling mechanism from a generative model, we propose a sample-efficient model-based algorithm (DRNVI) with finite-sample complexity guarantees for learning robust variants of various notions of game-theoretic equilibria. We also establish an information-theoretic lower bound for solving RMGs, which confirms the near-optimal sample complexity of DRNVI with respect to problem-dependent factors such as the size of the state space, the target accuracy, and the horizon length.


title: Gyrokinetic investigation of toroidal Alfven eigenmode (TAE) turbulence

abstract: Toroidal Alfv\'en eigenmodes (TAEs) can transport fusion-born energetic particles out of the plasma volume, thereby decreasing plasma self-heating efficiency and possibly damaging reactor walls. Therefore, understanding TAE destabilisation and identifying saturation mechanisms is crucial to achieving burning plasma. While TAEs have been studies extensively in the past using kinetic-MHD codes, here a fully gyrokinetic study is employed which allows for additional physics. In the case studied, the primary drive mechanism is identified as the resonance between the magnetic drifts and the TAE, and this is seen to be disrupted by equilibrium flow shear which can stabilize the mode by rotating it in the the poloidal plane. It is found that zonal flows do not play a significant role in the saturation of these TAEs, and there are no saturation mechanisms present in the local gyrokinetic picture that are able to saturate the mode at physically relevant transport levels in the case of TAE-only turbulence. Instead, we confirm that the global profile flattening of fast-ion density is the key saturation mechanism. The nonlinear excitation of TAE travelling along the electron diamagnetic direction and its beating with the ion diamagnetic TAE, resulting in large amplitude oscillations that may help detect TAEs more easily in tokamaks, is also reported.


title: Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting

abstract: Speculative decoding has demonstrated its effectiveness in accelerating the inference of large language models while maintaining a consistent sampling distribution. However, the conventional approach of training a separate draft model to achieve a satisfactory token acceptance rate can be costly. Drawing inspiration from early exiting, we propose a novel self-speculative decoding framework \emph{Kangaroo}, which uses a fixed shallow sub-network as a self-draft model, with the remaining layers serving as the larger target model. We train a lightweight and efficient adapter module on top of the sub-network to bridge the gap between the sub-network and the full model's representation ability. It is noteworthy that the inference latency of the self-draft model may no longer be negligible compared to the large model, necessitating strategies to increase the token acceptance rate while minimizing the drafting steps of the small model. To address this challenge, we introduce an additional early exiting mechanism for generating draft tokens. Specifically, we halt the small model's subsequent prediction during the drafting phase once the confidence level for the current token falls below a certain threshold. Extensive experiments on the Spec-Bench demonstrate the effectiveness of Kangaroo. Under single-sequence verification, Kangaroo achieves speedups up to $1.68\times$ on Spec-Bench, outperforming Medusa-1 with 88.7\% fewer additional parameters (67M compared to 591M). The code for Kangaroo is available at https://github.com/Equationliu/Kangaroo.


title: Interaction driven topological phase transitions of hardcore bosons on a two-leg ladder

abstract: We investigate the topological properties of hardcore bosons possessing nearest-neighbor repulsive interactions on a two-leg ladder. We show that by allowing nearest neighbour dimerized interactions instead of hopping dimerization, the system exhibits topological phases and phase transitions under proper conditions. First, by assuming uniform hopping throughout the ladder, we show that when interaction along the legs are dimerized and the dimerization pattern is different in the legs, a trivial rung-Mott insulator to a topological bond order phase transition occurs as a function of the dimerization strength. However, for a fixed dimerization strength, the system exhibits a topological to trivial phase transition with increase in the rung hopping. A completely different scenario appears when the rung interaction is turned on. We obtain that for a ladder with uniform hopping, the repulsive interaction either turns the topological phase into a trivial rung-Mott insulator or a charge density wave phase. Such topological features are absent when the dimerization pattern in the nearest neighbour interaction is considered to be identical in both the legs of the ladder. We numerically obtain the ground state properties and also show the signatures of topological phase transitions through Thouless charge pumping.


title: Two-axis twisting using Floquet-engineered XYZ spin models with polar molecules

abstract: Polar molecules confined in an optical lattice are a versatile platform to explore spin-motion dynamics based on strong, long-range dipolar interactions. The precise tunability of Ising and spin-exchange interactions with both microwave and dc electric fields makes the molecular system particularly suitable for engineering complex many-body dynamics. Here, we used Floquet engineering to realize interesting quantum many-body systems of polar molecules. Using a spin encoded in the two lowest rotational states of ultracold KRb molecules, we mutually validated XXZ spin models tuned by a Floquet microwave pulse sequence against those tuned by a dc electric field through observations of Ramsey contrast dynamics, setting the stage for the realization of Hamiltonians inaccessible with static fields. In particular, we observed two-axis twisting mean-field dynamics, generated by a Floquet-engineered XYZ model using itinerant molecules in 2D layers. In the future, Floquet-engineered Hamiltonians could generate entangled states for molecule-based precision measurement or could take advantage of the rich molecular structure for quantum simulation of multi-level systems.


title: On the behavior of pressure in a low Mach number flow

abstract: In our recent works, we proposed a theory of turbulence via the mean field effect of an intermolecular potential, which in part relies on an empirically observed "equilibrated" behavior of the pressure variable in a low Mach number flow -- that is, while other variables may exhibit considerable variations at low Mach numbers, the pressure is (nearly) constant. At the same time, conventional kinetic theory does not offer a satisfactory explanation for such a behavior of the pressure variable, instead leading to an isentropic flow in the form of the usual compressible Euler equations. In the current work, we introduce a novel correction term into the pair correlation function of the BBGKY closure for the collision integral, which adjusts the density of incident or recedent pairs of particles depending on the macroscopic compression or expansion rate of the gas. Remarkably, this term does not affect the density and momentum transport equations, and manifests solely in the pressure transport equation. We also find that the effect of the novel term on the pressure dynamics matches the observed behavior -- that is, it tends to attenuate the acoustic waves and smooth out the pressure solution. It appears that the missing piece of the low Mach number puzzle has finally been identified.


title: Colloidal dispersions of sterically and electrostatically stabilized PbS quantum dots: the effect of stabilization mechanism on structure factors, second virial coefficients, and film-forming properties

abstract: Electrostatically stabilized nanocrystals (NCs) and, in particular, quantum dots (QDs) hold promise for forming strongly coupled superlattices due to their compact and electronically conductive surface ligands. However, studies on the colloidal dispersion and interparticle interactions of electrostatically stabilized sub-10 nm NCs have been limited, hindering the optimization of colloidal stability and self-assembly. In this study, we employed small-angle X ray scattering (SAXS) experiments to investigate the interparticle interactions and arrangement of PbS QDs with thiostannate ligands (PbS-Sn2S64-) in polar solvents. The study reveals significant deviations from ideal solution behavior in electrostatically stabilized QD dispersions. Our results demonstrate that PbS-Sn2S64- QDs exhibit long-range interactions within the solvent, in contrast to the short-range steric repulsion characteristic of PbS QDs with oleate ligands (PbS-OA). Introducing highly charged multivalent electrolytes screens electrostatic interactions between charged QDs, reducing the length scale of the repulsive interactions. Furthermore, we calculate the second virial (B2) coefficients from SAXS data, providing insights into how surface chemistry, solvent, and size influence pair potentials. Finally, we explore the influence of long-range interparticle interactions of PbS-Sn2S64- QDs on the morphology of films produced by drying or spin-coating colloidal solutions. The long-range repulsive term of PbS-Sn2S64- QDs promotes the formation of amorphous films, and screening the electrostatic repulsion by addition of an electrolyte enables the formation of a crystalline film. These findings highlight the critical role of NC-NC interactions in tailoring the properties of functional nanomaterials.


title: Observation of Generalized t-J Spin Dynamics with Tunable Dipolar Interactions

abstract: Long-range and anisotropic dipolar interactions profoundly modify the dynamics of particles hopping in a periodic lattice potential. Here, we report the realization of a generalized t-J model with dipolar interactions using a system of ultracold fermionic molecules with spin encoded in the two lowest rotational states. We systematically explore the role of dipolar Ising and spin-exchange couplings and the effect of motion on spin dynamics. The model parameters can be controlled independently, with dipolar couplings tuned by electric fields and motion regulated by optical lattices. Using Ramsey spectroscopy, we observed interaction-driven contrast decay that depends strongly both on the strength of the anisotropy between Ising and spin-exchange couplings and on motion. These observations are supported by theory models established in different motional regimes that provide intuitive pictures of the underlying physics. This study paves the way for future exploration of kinetic spin dynamics and quantum magnetism with highly tunable molecular platforms in regimes challenging for existing numerical and analytical methods, and it could shed light on the complex behaviors observed in real materials.


title: Fate of surface gaps in magnetic topological insulators

abstract: In magnetic topological insulators, the surface states can exhibit a gap due to the breaking of time-reversal symmetry. Various experiments, while suggesting the existence of the surface gap, have raised questions about its underlying mechanism in the presence of different magnetic orderings. Here, we demonstrate that magnon-mediated electron-electron interactions, whose effects are not limited to the surfaces perpendicular to the magnetic ordering, can significantly influence surface states and their effective gaps. On the surfaces perpendicular to the spin quantization axis, many-body interactions can enhance the band gap to a degree that surpasses the non-interacting scenario. Then, on surfaces parallel to the magnetic ordering, we find that strong magnon-induced fermionic interactions can lead to features resembling a massless-like gap. These remarkable results largely stem from the fact that magnon-mediated interactions exhibit considerable long-range behavior compared to direct Coulomb interactions among electrons, thereby dominating the many-body properties at the surface of magnetic topological insulators.


title: Strong solutions to McKean-Vlasov SDEs associated to a class of degenerate Fokker-Planck equations with coefficients of Nemytskii-type

abstract: While the nondegenerate case is well-known, there are only few results on the existence of strong solutions to McKean-Vlasov SDEs with coefficients of Nemytskii-type in the degenerate case. We consider a broad class of degenerate nonlinear Fokker-Planck(-Kolmogorov) equations with coefficients of Nemytskii-type. This includes, in particular, the classical porous medium equation perturbed by a first-order term with initial datum in a subset of probability densities, which is dense with respect to the topology inherited from $L^1$, and, in the one-dimensional setting, the classical porous medium equation with initial datum in an arbitrary point $x\in\mathbb{R}$. For these kind of equations the existence of a Schwartz-distributional solution $u$ is well-known. We show that there exists a unique strong solution to the associated degenerate McKean-Vlasov SDE with time marginal law densities $u$. In particular, every weak solution to this equation with time marginal law densities $u$ can be written as a functional of the driving Brownian motion. Moreover, plugging any Brownian motion into this very functional yields a weak solution with time marginal law densities $u$.


title: TheaterGen: Character Management with LLM for Consistent Multi-turn Image Generation

abstract: Recent advances in diffusion models can generate high-quality and stunning images from text. However, multi-turn image generation, which is of high demand in real-world scenarios, still faces challenges in maintaining semantic consistency between images and texts, as well as contextual consistency of the same subject across multiple interactive turns. To address this issue, we introduce TheaterGen, a training-free framework that integrates large language models (LLMs) and text-to-image (T2I) models to provide the capability of multi-turn image generation. Within this framework, LLMs, acting as a "Screenwriter", engage in multi-turn interaction, generating and managing a standardized prompt book that encompasses prompts and layout designs for each character in the target image. Based on these, Theatergen generate a list of character images and extract guidance information, akin to the "Rehearsal". Subsequently, through incorporating the prompt book and guidance information into the reverse denoising process of T2I diffusion models, Theatergen generate the final image, as conducting the "Final Performance". With the effective management of prompt books and character images, TheaterGen significantly improves semantic and contextual consistency in synthesized images. Furthermore, we introduce a dedicated benchmark, CMIGBench (Consistent Multi-turn Image Generation Benchmark) with 8000 multi-turn instructions. Different from previous multi-turn benchmarks, CMIGBench does not define characters in advance. Both the tasks of story generation and multi-turn editing are included on CMIGBench for comprehensive evaluation. Extensive experimental results show that TheaterGen outperforms state-of-the-art methods significantly. It raises the performance bar of the cutting-edge Mini DALLE 3 model by 21% in average character-character similarity and 19% in average text-image similarity.


title: Analytically weak solutions to stochastic heat equations with spatially rough noise

abstract: In [HHL+17] the authors showed existence and uniqueness of solutions to the nonlinear one-dimensional stochastic heat equation driven by a Gaussian noise that is white in time and rougher than white in space (in particular, its covariance is not a measure). Here we present a simple alternative to derive such results by considering the equations in the analytically weak sense, using either the variational approach or Krylov's $L^p$-theory. Various improvements are obtained as corollaries.


title: Anomaly and invertible field theory with higher-form symmetry: Extended group cohomology

abstract: In the realm of invertible symmetry, the topological approach based on classifying spaces dominates the classification of 't Hooft anomalies and symmetry protected topological phases. We explore the alternative algebraic approach based on cochains that directly characterize the lattice lagrangian of invertible field theories and the anomalous phase factor of topological operator rearrangements. In the current literature, the algebraic approach has been systematically described for only finite 0-form symmetries. In this initial work, we generalize it to finite higher-form symmetries with trivial higher-group structure. We carefully analyze the algebraic cochains and abstract a purely algebraic structure that naturally generalizes group cohomology. Using techniques from simplicial homotopy theory, we show its isomorphism to the cohomology of classifying spaces. The proof is based on an explicit construction of Eilenberg-MacLane spaces and their products.


title: DPO Meets PPO: Reinforced Token Optimization for RLHF

abstract: In the classical Reinforcement Learning from Human Feedback (RLHF) framework, Proximal Policy Optimization (PPO) is employed to learn from sparse, sentence-level rewards -- a challenging scenario in traditional deep reinforcement learning. Despite the great successes of PPO in the alignment of state-of-the-art closed-source large language models (LLMs), its open-source implementation is still largely sub-optimal, as widely reported by numerous research studies. To address these issues, we introduce a framework that models RLHF problems as a Markov decision process (MDP), enabling the capture of fine-grained token-wise information. Furthermore, we provide theoretical insights that demonstrate the superiority of our MDP framework over the previous sentence-level bandit formulation. Under this framework, we introduce an algorithm, dubbed as Reinforced Token Optimization (\texttt{RTO}), which learns the token-wise reward function from preference data and performs policy optimization based on this learned token-wise reward signal. Theoretically, \texttt{RTO} is proven to have the capability of finding the near-optimal policy sample-efficiently. For its practical implementation, \texttt{RTO} innovatively integrates Direct Preference Optimization (DPO) and PPO. DPO, originally derived from sparse sentence rewards, surprisingly provides us with a token-wise characterization of response quality, which is seamlessly incorporated into our subsequent PPO training stage. Extensive real-world alignment experiments verify the effectiveness of the proposed approach.


title: Holmes: Benchmark the Linguistic Competence of Language Models

abstract: We introduce Holmes, a benchmark to assess the linguistic competence of language models (LMs) - their ability to grasp linguistic phenomena. Unlike prior prompting-based evaluations, Holmes assesses the linguistic competence of LMs via their internal representations using classifier-based probing. In doing so, we disentangle specific phenomena (e.g., part-of-speech of words) from other cognitive abilities, like following textual instructions, and meet recent calls to assess LMs' linguistic competence in isolation. Composing Holmes, we review over 250 probing studies and feature more than 200 datasets to assess syntax, morphology, semantics, reasoning, and discourse phenomena. Analyzing over 50 LMs reveals that, aligned with known trends, their linguistic competence correlates with model size. However, surprisingly, model architecture and instruction tuning also significantly influence performance, particularly in morphology and syntax. Finally, we propose FlashHolmes, a streamlined version of Holmes designed to lower the high computation load while maintaining high-ranking precision.


title: Swin2-MoSE: A New Single Image Super-Resolution Model for Remote Sensing

abstract: Due to the limitations of current optical and sensor technologies and the high cost of updating them, the spectral and spatial resolution of satellites may not always meet desired requirements. For these reasons, Remote-Sensing Single-Image Super-Resolution (RS-SISR) techniques have gained significant interest. In this paper, we propose Swin2-MoSE model, an enhanced version of Swin2SR. Our model introduces MoE-SM, an enhanced Mixture-of-Experts (MoE) to replace the Feed-Forward inside all Transformer block. MoE-SM is designed with Smart-Merger, and new layer for merging the output of individual experts, and with a new way to split the work between experts, defining a new per-example strategy instead of the commonly used per-token one. Furthermore, we analyze how positional encodings interact with each other, demonstrating that per-channel bias and per-head bias can positively cooperate. Finally, we propose to use a combination of Normalized-Cross-Correlation (NCC) and Structural Similarity Index Measure (SSIM) losses, to avoid typical MSE loss limitations. Experimental results demonstrate that Swin2-MoSE outperforms SOTA by up to 0.377 ~ 0.958 dB (PSNR) on task of 2x, 3x and 4x resolution-upscaling (Sen2Venus and OLI2MSI datasets). We show the efficacy of Swin2-MoSE, applying it to a semantic segmentation task (SeasoNet dataset). Code and pretrained are available on https://github.com/IMPLabUniPr/swin2-mose/tree/official_code


title: Searching for planet-driven dust spirals in ALMA visibilities

abstract: ALMA (Atacama Large Millimetre/submillimetre Array) observations of the thermal emission from protoplanetary disc dust have revealed a wealth of substructures that could evidence embedded planets, but planet-driven spirals, one of the more compelling lines of evidence, remain relatively rare. Existing works have focused on detecting these spirals using methods that operate in image space. Here, we explore the planet detection capabilities of fitting planet-driven spirals to disc observations directly in visibility space. We test our method on synthetic ALMA observations of planet-containing model discs for a range of disc/observational parameters, finding it significantly outperforms image residuals in identifying spirals in these observations and is able to identify spirals in regions of the parameter space in which no gaps are detected. These tests suggest that a visibility-space fitting approach warrants further investigation and may be able to find planet-driven spirals in observations that have not yet been found with existing approaches. We also test our method on six discs in the Taurus molecular cloud observed with ALMA at 1.33 mm, but find no evidence for planet-driven spirals. We find that the minimum planet masses necessary to drive detectable spirals range from $\approx$ 0.03 to 0.5 $M_{\text{Jup}}$ over orbital radii of 10 to 100 au, with planet masses below these thresholds potentially hiding in such disc observations. Conversely, we suggest that planets $\gtrsim$ 0.5 to 1 $M_{\text{Jup}}$ can likely be ruled out over orbital radii of $\approx$ 20 to 60 au on the grounds that we would have detected them if they were present.