title: Model Selection of Zero-shot Anomaly Detectors in the Absence of Labeled Validation Data

abstract: Anomaly detection requires detecting abnormal samples in large unlabeled datasets. While progress in deep learning and the advent of foundation models has produced powerful zero-shot anomaly detection methods, their deployment in practice is often hindered by the lack of labeled data -- without it, their detection performance cannot be evaluated reliably. In this work, we propose SWSA (Selection With Synthetic Anomalies): a general-purpose framework to select image-based anomaly detectors with a generated synthetic validation set. Our proposed anomaly generation method assumes access to only a small support set of normal images and requires no training or fine-tuning. Once generated, our synthetic validation set is used to create detection tasks that compose a validation framework for model selection. In an empirical study, we find that SWSA often selects models that match selections made with a ground-truth validation set, resulting in higher AUROCs than baseline methods. We also find that SWSA selects prompts for CLIP-based anomaly detection that outperform baseline prompt selection strategies on all datasets, including the challenging MVTec-AD and VisA datasets.


title: Adaptive Neural Ranking Framework: Toward Maximized Business Goal for Cascade Ranking Systems

abstract: Cascade ranking is widely used for large-scale top-k selection problems in online advertising and recommendation systems, and learning-to-rank is an important way to optimize the models in cascade ranking. Previous works on learning-to-rank usually focus on letting the model learn the complete order or top-k order, and adopt the corresponding rank metrics (e.g. OPA and NDCG@k) as optimization targets. However, these targets can not adapt to various cascade ranking scenarios with varying data complexities and model capabilities; and the existing metric-driven methods such as the Lambda framework can only optimize a rough upper bound of limited metrics, potentially resulting in sub-optimal and performance misalignment. To address these issues, we propose a novel perspective on optimizing cascade ranking systems by highlighting the adaptability of optimization targets to data complexities and model capabilities. Concretely, we employ multi-task learning to adaptively combine the optimization of relaxed and full targets, which refers to metrics Recall@m@k and OPA respectively. We also introduce permutation matrix to represent the rank metrics and employ differentiable sorting techniques to relax hard permutation matrix with controllable approximate error bound. This enables us to optimize both the relaxed and full targets directly and more appropriately. We named this method as Adaptive Neural Ranking Framework (abbreviated as ARF). Furthermore, we give a specific practice under ARF. We use the NeuralSort to obtain the relaxed permutation matrix and draw on the variant of the uncertainty weight method in multi-task learning to optimize the proposed losses jointly. Experiments on a total of 4 public and industrial benchmarks show the effectiveness and generalization of our method, and online experiment shows that our method has significant application value.


title: Combating Label Noise With A General Surrogate Model For Sample Selection

abstract: Modern deep learning systems are data-hungry. Learning with web data is one of the feasible solutions, but will introduce label noise inevitably, which can hinder the performance of deep neural networks. Sample selection is an effective way to deal with label noise. The key is to separate clean samples based on some criterion. Previous methods pay more attention to the small loss criterion where small-loss samples are regarded as clean ones. Nevertheless, such a strategy relies on the learning dynamics of each data instance. Some noisy samples are still memorized due to frequently occurring corrupted learning patterns. To tackle this problem, a training-free surrogate model is preferred, freeing from the effect of memorization. In this work, we propose to leverage the vision-language surrogate model CLIP to filter noisy samples automatically. CLIP brings external knowledge to facilitate the selection of clean samples with its ability of text-image alignment. Furthermore, a margin adaptive loss is designed to regularize the selection bias introduced by CLIP, providing robustness to label noise. We validate the effectiveness of our proposed method on both real-world and synthetic noisy datasets. Our method achieves significant improvement without CLIP involved during the inference stage.


title: Making Every Photon Count: A Quantum Polyspectra Approach to the Dynamics of Blinking Quantum Emitters at Low Photon Rates Without Binning

abstract: The blinking statistics of quantum emitters and their corresponding Markov models play an important role in high resolution microscopy of biological samples as well as in nano-optoelectronics and many other fields of science and engineering. Current methods for analyzing the blinking statistics like the full counting statistics or the Viterbi algorithm break down for low photon rates. We present an evaluation scheme that eliminates the need for both a minimum photon flux and the usual binning of photon events which limits the measurement bandwidth. Our approach is based on higher order spectra of the measurement record which we model within the recently introduced method of quantum polyspectra from the theory of continuous quantum measurements. By virtue of this approach we can determine on- and off-switching rates of a semiconductor quantum dot at light levels 1000 times lower than in a standard experiment and 20 times lower than achieved with a scheme from full counting statistics. Thus a very powerful high-bandwidth approach to the parameter learning task of single photon hidden Markov models has been established with applications in many fields of science.


title: Coherence-enhanced thermodynamic performance in a periodically-driven inelastic heat engine

abstract: Quantum thermodynamics with microscopic inelastic scattering processes has been intensively investigated in recent years. Here, we apply quantum master equation combined with full counting statistics approach to investigate the role of quantum coherence on the periodically-driven inelastic heat engine. We demonstrate that the inelastic quantum heat engine exhibits dramatic advantage of thermodynamic performance compared to their elastic counterpart. Moreover, it is found that inelastic currents, {output work}, and the efficiency can be enhanced by quantum coherence. In particular, the geometric effect proves crucial in achieving maximal values of generated output work and energy conversion efficiency. The Berry curvature boosted by quantum coherence unveils the underlying mechanism of periodically-driven inelastic heat engine. Our findings may provide some insights for further understanding and optimizing periodically-driven heat engines via quantum coherence resource and inelastic scattering processes.


title: Hall response of locally correlated two-dimensional electrons at low density

abstract: We study the Hall constant in a homogeneous two-dimensional fluid of correlated electrons immersed in a perpendicular magnetic field, with special focus on the regime of low carrier density. The model consists of a one-band tight-binding model and a momentum-independent causal self-energy, representing interaction-induced correlations effects that are restricted to be local in space. We write general gauge-invariant equations for the conductivity tensor at first order in the magnetic field and solve them numerically (analytically when possible) in a minimal model of anisotropic square lattice with constant self-energy. Our results show that deviations from the universal behavior of the Hall constant, as observed in the semiclassical regime, appear upon entering the quantum regime, where the Fermi energy and interaction are comparable energy scales.


title: Stance Detection with Collaborative Role-Infused LLM-Based Agents

abstract: Stance detection automatically detects the stance in a text towards a target, vital for content analysis in web and social media research. Despite their promising capabilities, LLMs encounter challenges when directly applied to stance detection. First, stance detection demands multi-aspect knowledge, from deciphering event-related terminologies to understanding the expression styles in social media platforms. Second, stance detection requires advanced reasoning to infer authors' implicit viewpoints, as stance are often subtly embedded rather than overtly stated in the text. To address these challenges, we design a three-stage framework COLA (short for Collaborative rOle-infused LLM-based Agents) in which LLMs are designated distinct roles, creating a collaborative system where each role contributes uniquely. Initially, in the multidimensional text analysis stage, we configure the LLMs to act as a linguistic expert, a domain specialist, and a social media veteran to get a multifaceted analysis of texts, thus overcoming the first challenge. Next, in the reasoning-enhanced debating stage, for each potential stance, we designate a specific LLM-based agent to advocate for it, guiding the LLM to detect logical connections between text features and stance, tackling the second challenge. Finally, in the stance conclusion stage, a final decision maker agent consolidates prior insights to determine the stance. Our approach avoids extra annotated data and model training and is highly usable. We achieve state-of-the-art performance across multiple datasets. Ablation studies validate the effectiveness of each design role in handling stance detection. Further experiments have demonstrated the explainability and the versatility of our approach. Our approach excels in usability, accuracy, effectiveness, explainability and versatility, highlighting its value.


title: Annihilating class groups in $p$-elementary extensions

abstract: We derive new cases of conjectures of Rubin and of Burns--Kurihara--Sano concerning derivatives of Dirichlet $L$-series at $s = 0$ in $p$-elementary extensions of number fields for arbitrary prime numbers $p$. In naturally arising examples of such extensions one therefore obtains annihilators of class groups from $S$-truncated Dirichlet $L$-series for `large-enough' sets of places $S$.


title: A Liouville theorem in the Heisenberg group

abstract: In this paper we classify positive solutions to the critical semilinear elliptic equation in $\mathbb{H}^n$. We prove that they are the Jerison-Lee's bubbles, provided $n=1$ or $n\geq 2$ and a suitable control at infinity holds. The proofs are based on a classical Jerison-Lee's differential identity and on pointwise/integral estimates recently obtained for critical semilinear and quasilinear elliptic equations in $\mathbb{R}^n$. In particular, the result in $\mathbb{H}^1$ can be seen as the analogue of the celebrated Caffarelli-Gidas-Spruck classification theorem.


title: New fractional-type weights and the boundedness of some operators

abstract: The purpose of this study is twofold. On the one hand, we establish a new class of fractional-type multiple weights ${A_{\vec p( \cdot ),q( \cdot )}}$, which can be regarded as a variable exponents generalization of ${A_{\vec p,q}}$, a multilinear generalization of ${A_{p( \cdot ),q( \cdot )}}$, and a fractional-type generalization of ${A_{\vec p( \cdot )}}$. Moreover, it can be characterized by multilinear fractional-type operators ${\mathscr T}_\alpha$. This generalizes the work by Moen (2009), Cruz-Uribe and Wang (2017), and Cruz-Uribe and Guzm\'an (2020), which is also called multilinear Hardy-Littlewood-Sobolev theorem on weighted variable exponents Lebesgue spaces. On the other hand, we also set up a new class of fractional-type variable matrix weights ${{\mathbb{A}}_{p( \cdot ),q( \cdot )}}$ that are characterized by fractional-type averaging operators ${\mathscr A}_{\alpha,Q}$ and fractional Christ-Goldberg maximal operator ${{\mathcal M}_{\alpha ,W}}$.


title: Composite 2-Higgs Doublet Model: Strong Effects on Higgs Pair Production

abstract: We show how effects of compositeness emerging in a Composite 2-Higgs Doublet Model can enter Standard Model (SM)-like Higgs pair production at the Large Hadron Collider in both resonant and non-resonant mode. Such effects can arise from modified trilinear Higgs self-couplings and top-Yukawa couplings as well as from loops of new heavy quarks and additional quartic Higgs-fermion interactions. In the resonant case, significant distortions of the Breit- Wigner shape of a new scalar state decaying into the two SM-like Higgs states may occur due to interference effects amongst not only the SM-like diagrams but also those involving the new heavy quarks. In the non-resonant case, a modification of the underlying line-shape and a local maximum at twice a new heavy quark mass appear simultaneously. We quantify these effects by taking into account the relevant theoretical and latest experimental bounds.


title: Pointwise modulus of continuity of the Lyapunov exponent and integrated density of states for analytic multi-frequency quasiperiodic $M(2, \mathbb{C})$ cocycles

abstract: It is known that the Lyapunov exponent for multifrequency analytic cocycles is weak-H\"older continuous in cocycle for certain Diophantine frequencies, and that this implies certain regularity of the integrated density of states in energy for Jacobi operators. In this paper, we establish the pointwise modulus of continuity in both cocycle and frequency and obtain analogous regularity of the integrated density of states in energy, potential, and frequency.


title: Spin Splitting and Disorder in HgTe-Based Massless Dirac Fermion Landau Levels

abstract: An experimental study of Landau levels (LLs) in a system of two-dimensional massless Dirac fermions based on a critical thickness HgTe quantum well has been carried out. The magnetotransport and the capacitive response have been investigated simultaneously. It is shown that the formation of Shubnikov-de Haas (SdH) oscillations associated with odd v filling factors occurs in a magnetic field whose strength grows monotonically with v. This behavior is consistent with calculations of the electron spectrum, which predicts a decrease in cyclotron gaps with increasing v. Oscillations with even filling factors, corresponding to spin gaps, behave less trivially. First, the SdH oscillations with filling factors of 4 and higher are resolved in a magnetic field that is 2-2.5 times smaller than the field required to resolve neighboring SdH oscillations with odd filling factors of 3 and higher. This indicates a significant increase in the size of the spin gap caused by an interface inversion asymmetry (IIA) leading to Dirac cone splitting in a zero magnetic field. Using the spin splitting value gamma as a fitting parameter, we obtained the best agreement between experimental data and calculations at gamma=1.5 meV. Next, spin splitting for the zeroth and first LLs is observed in 2-3 times stronger magnetic fields than for the other levels, indicating an increase in disorder near the Dirac point, due to the lack of screening.


title: Optimal transport for some symmetric, multidimensional integer partitions

abstract: A result of Hohloch links the theory of integer partitions with the Monge formulation of the optimal transport problem, giving the optimal transport map between (Young diagrams of) integer partitions and their corresponding symmetric partitions. Our aim is to extend Hohloch's result to the higher dimensional case. In doing so, we show the Kantorovich formulation of the optimal transport problem provides the tool to study the matching of higher dimensional partitions with their corresponding symmetric partitions.


title: The monotone-light factorization for n-categories via n-preorders

abstract: Starting with a symmetric monoidal adjunction with certain properties, one derives another symmetric monoidal adjunction with the same properties between the respective categories of all V-categories. If one begins with a reflection of a full replete subcategory, the derived adjunction is also a reflection of the same kind. Semi-left-exactness (also called admissibility in categorical Galois theory) or the stronger stable units property is inherited by the derived reflection. Applying these results, one concludes that the reflection of the category of all n-categories into the category of n-preorders has stable units. Then, it is also shown that this reflection determines a monotone-light factorization system on n-categories, n>=1, and that the light morphisms are precisely the n-functors faithful with respect to n-cells. In order to achieve such results, it was also shown that n-functors surjective both on vertically composable triples of horizontally composable pairs of n-cells, and on horizontally composable triples of vertically composable pairs of n-cells are effective descent morphisms in the category of all n-categories nCat, n>=1.


title: Performance Analysis of a Low-Complexity OTFS Integrated Sensing and Communication System

abstract: This work proposes a low-complexity estimation approach for an orthogonal time frequency space (OTFS)-based integrated sensing and communication (ISAC) system. In particular, we first define four low-dimensional matrices used to compute the channel matrix through simple algebraic manipulations. Secondly, we establish an analytical criterion, independent of system parameters, to identify the most informative elements within these derived matrices, leveraging the properties of the Dirichlet kernel. This allows the distilling of such matrices, keeping only those entries that are essential for detection, resulting in an efficient, low-complexity implementation of the sensing receiver. Numerical results, which refer to a vehicular scenario, demonstrate that the proposed approximation technique effectively preserves the sensing performance, evaluated in terms of root mean square error (RMSE) of the range and velocity estimation, while concurrently reducing the computational effort enormously.


title: Gaining Wisdom from Setbacks: Aligning Large Language Models via Mistake Analysis

abstract: The rapid development of large language models (LLMs) has not only provided numerous opportunities but also presented significant challenges. This becomes particularly evident when LLMs inadvertently generate harmful or toxic content, either unintentionally or because of intentional inducement. Existing alignment methods usually direct LLMs toward the favorable outcomes by utilizing human-annotated, flawless instruction-response pairs. Conversely, this study proposes a novel alignment technique based on mistake analysis, which deliberately exposes LLMs to erroneous content to learn the reasons for mistakes and how to avoid them. In this case, mistakes are repurposed into valuable data for alignment, effectively helping to avoid the production of erroneous responses. Without external models or human annotations, our method leverages a model's intrinsic ability to discern undesirable mistakes and improves the safety of its generated responses. Experimental results reveal that our method outperforms existing alignment approaches in enhancing model safety while maintaining the overall utility.


title: Quantum hardware calculations of the activation and dissociation of nitrogen on iron clusters and surfaces

abstract: Catalytic processes are vital in the chemical industry, with nitrogen-to-ammonia conversion being a major industrial process. Designing catalysts relies on computational chemistry methods like Density Functional Theory (DFT), which have limitations in accuracy, especially for complex materials. Quantum computing advancements offer promise for precise ab-initio methods. We introduce a hybrid quantum-classical workflow to model chemical reactions on surfaces, demonstrated on nitrogen activation and dissociation on small Fe clusters and an iron surface. We decoupled key electronic structures using CASSCF, translated them into qubits, and estimated energies with quantum and classical simulations, showing potential for quantum computing in catalysis research as technology scales up.


title: Higher-order finite element de Rham complexes, partially localized flux reconstructions, and applications

abstract: We construct finite element de~Rham complexes of higher and possibly non-uniform polynomial order in finite element exterior calculus (FEEC). Starting from the finite element differential complex of lowest-order, known as the complex of Whitney forms, we incrementally construct the higher-order complexes by adjoining exact local complexes associated to simplices. We define a commuting canonical interpolant. On the one hand, this research provides a base for studying $hp$-adaptive methods in finite element exterior calculus. On the other hand, our construction of higher-order spaces enables a new tool in numerical analysis which we call "partially localized flux reconstruction". One major application of this concept is in the area of equilibrated a~posteriori error estimators: we generalize the Braess-Sch\"oberl error estimator to edge elements of higher and possibly non-uniform order.


title: G-SPEED: General SParse Efficient Editing MoDel

abstract: Large Language Models~(LLMs) have demonstrated incredible capabilities in understanding, generating, and manipulating languages. Through human-model interactions, LLMs can automatically understand human-issued instructions and output the expected contents, which can significantly increase working efficiency. In various types of real-world demands, editing-oriented tasks account for a considerable proportion, which involves an interactive process that entails the continuous refinement of existing texts to meet specific criteria. Due to the need for multi-round human-model interaction and the generation of complicated editing tasks, there is an emergent need for efficient general editing models. In this paper, we propose \underline{\textbf{G}}eneral \underline{\textbf{SP}}arse \underline{\textbf{E}}fficient \underline{\textbf{E}}diting Mo\underline{\textbf{D}}el~(\textbf{G-SPEED}), which can fulfill diverse editing requirements through a single model while maintaining low computational costs. Specifically, we first propose a novel unsupervised text editing data clustering algorithm to deal with the data scarcity problem. Subsequently, we introduce a sparse editing model architecture to mitigate the inherently limited learning capabilities of small language models. The experimental outcomes indicate that G-SPEED, with its 508M parameters, can surpass LLMs equipped with 175B parameters. Our code and model checkpoints are available at \url{https://github.com/Banner-Z/G-SPEED}.


title: DemoSG: Demonstration-enhanced Schema-guided Generation for Low-resource Event Extraction

abstract: Most current Event Extraction (EE) methods focus on the high-resource scenario, which requires a large amount of annotated data and can hardly be applied to low-resource domains. To address EE more effectively with limited resources, we propose the Demonstration-enhanced Schema-guided Generation (DemoSG) model, which benefits low-resource EE from two aspects: Firstly, we propose the demonstration-based learning paradigm for EE to fully use the annotated data, which transforms them into demonstrations to illustrate the extraction process and help the model learn effectively. Secondly, we formulate EE as a natural language generation task guided by schema-based prompts, thereby leveraging label semantics and promoting knowledge transfer in low-resource scenarios. We conduct extensive experiments under in-domain and domain adaptation low-resource settings on three datasets, and study the robustness of DemoSG. The results show that DemoSG significantly outperforms current methods in low-resource scenarios.


title: xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection

abstract: Widely used learned metrics for machine translation evaluation, such as COMET and BLEURT, estimate the quality of a translation hypothesis by providing a single sentence-level score. As such, they offer little insight into translation errors (e.g., what are the errors and what is their severity). On the other hand, generative large language models (LLMs) are amplifying the adoption of more granular strategies to evaluation, attempting to detail and categorize translation errors. In this work, we introduce xCOMET, an open-source learned metric designed to bridge the gap between these approaches. xCOMET integrates both sentence-level evaluation and error span detection capabilities, exhibiting state-of-the-art performance across all types of evaluation (sentence-level, system-level, and error span detection). Moreover, it does so while highlighting and categorizing error spans, thus enriching the quality assessment. We also provide a robustness analysis with stress tests, and show that xCOMET is largely capable of identifying localized critical errors and hallucinations.


title: Passive Inference Attacks on Split Learning via Adversarial Regularization

abstract: Split Learning (SL) has emerged as a practical and efficient alternative to traditional federated learning. While previous attempts to attack SL have often relied on overly strong assumptions or targeted easily exploitable models, we seek to develop more practical attacks. We introduce SDAR, a novel attack framework against SL with an honest-but-curious server. SDAR leverages auxiliary data and adversarial regularization to learn a decodable simulator of the client's private model, which can effectively infer the client's private features under the vanilla SL, and both features and labels under the U-shaped SL. We perform extensive experiments in both configurations to validate the effectiveness of our proposed attacks. Notably, in challenging but practical scenarios where existing passive attacks struggle to reconstruct the client's private data effectively, SDAR consistently achieves attack performance comparable to active attacks. On CIFAR-10, at the deep split level of 7, SDAR achieves private feature reconstruction with less than 0.025 mean squared error in both the vanilla and the U-shaped SL, and attains a label inference accuracy of over 98% in the U-shaped setting, while existing attacks fail to produce non-trivial results.


title: Topologically Stable BPS and Non-BPS States in Supersymmetric $\mathcal{N}=2$ Baby-Skyrme Model

abstract: The supersymmetric baby-Skyrme model is an interesting field theoretical model, and its BPS states have been studied using the usual methods. Here, we propose a novel method to rigorously obtain both topologically stable BPS and non-BPS states in the $\mathcal{N}=2$ baby Skyrme Model. It is observed that the BPS states found using this novel method coincide with the BPS states found using the usual methods. However, we are also able to obtain the non-BPS states, which break all of the supersymmetry of the theory. Furthermore, there exists a one-parameter family of non-BPS solutions that are connected to the half-BPS solutions, where half of the supersymmetry is restored when the parameter is set to zero. The proposed method is very general, and we expect that it might be useful for investigating the topologically stable non-BPS states of other theories. Thus, this method could possibly have wide applications for the study of non-BPS states in supersymmetric theories.


title: Bayesian decision-theoretic model selection for monitored systems

abstract: Engineers are often faced with the decision to select the most appropriate model for simulating the behavior of engineered systems, among a candidate set of models. Experimental monitoring data can generate significant value by supporting engineers toward such decisions. Such data can be leveraged within a Bayesian model updating process, enabling the uncertainty-aware calibration of any candidate model. The model selection task can subsequently be cast into a problem of decision-making under uncertainty, where one seeks to select the model that yields an optimal balance between the reward associated with model precision, in terms of recovering target Quantities of Interest (QoI), and the cost of each model, in terms of complexity and compute time. In this work, we examine the model selection task by means of Bayesian decision theory, under the prism of availability of models of various refinements, and thus varying levels of fidelity. In doing so, we offer an exemplary application of this framework on the IMAC-MVUQ Round-Robin Challenge. Numerical investigations show various outcomes of model selection depending on the target QoI.


title: ManyQuadrupeds: Learning a Single Locomotion Policy for Diverse Quadruped Robots

abstract: Learning a locomotion policy for quadruped robots has traditionally been constrained to a specific robot morphology, mass, and size. The learning process must usually be repeated for every new robot, where hyperparameters and reward function weights must be re-tuned to maximize performance for each new system. Alternatively, attempting to train a single policy to accommodate different robot sizes, while maintaining the same degrees of freedom (DoF) and morphology, requires either complex learning frameworks, or mass, inertia, and dimension randomization, which leads to prolonged training periods. In our study, we show that drawing inspiration from animal motor control allows us to effectively train a single locomotion policy capable of controlling a diverse range of quadruped robots. The robot differences encompass: a variable number of DoFs, (i.e. 12 or 16 joints), three distinct morphologies, a broad mass range spanning from 2 kg to 200 kg, and nominal standing heights ranging from 18 cm to 100 cm. Our policy modulates a representation of the Central Pattern Generator (CPG) in the spinal cord, effectively coordinating both frequencies and amplitudes of the CPG to produce rhythmic output (Rhythm Generation), which is then mapped to a Pattern Formation (PF) layer. Across different robots, the only varying component is the PF layer, which adjusts the scaling parameters for the stride height and length. Subsequently, we evaluate the sim-to-real transfer by testing the single policy on both the Unitree Go1 and A1 robots. Remarkably, we observe robust performance, even when adding a 15 kg load, equivalent to 125% of the A1 robot's nominal mass.


title: Type-aware Decoding via Explicitly Aggregating Event Information for Document-level Event Extraction

abstract: Document-level event extraction (DEE) faces two main challenges: arguments-scattering and multi-event. Although previous methods attempt to address these challenges, they overlook the interference of event-unrelated sentences during event detection and neglect the mutual interference of different event roles during argument extraction. Therefore, this paper proposes a novel Schema-based Explicitly Aggregating~(SEA) model to address these limitations. SEA aggregates event information into event type and role representations, enabling the decoding of event records based on specific type-aware representations. By detecting each event based on its event type representation, SEA mitigates the interference caused by event-unrelated information. Furthermore, SEA extracts arguments for each role based on its role-aware representations, reducing mutual interference between different roles. Experimental results on the ChFinAnn and DuEE-fin datasets show that SEA outperforms the SOTA methods.


title: Critical behavior of the dimerized Si(001) surface: Continuous order-disorder phase transition in the two-dimensional Ising universality class

abstract: The critical behavior of the order-disorder phase transition in the buckled dimer structure of the Si(001) surface is investigated both theoretically by means of first-principles calculations and experimentally by spot profile analysis low-energy electron diffraction (SPA-LEED). We use density functional theory (DFT) with three different functionals commonly used for Si to determine the coupling constants of an effective lattice Hamiltonian describing the dimer interactions. Experimentally, the phase transition from the low-temperature $c(4 {\times} 2)$- to the high-temperature $p(2 {\times} 1)$-reconstructed surface is followed through the intensity and width of the superstructure spots within the temperature range 78-400 K. Near the critical temperature $T_c = 190.6\,\mathrm{K}$, we observe universal critical behavior of spot intensities and correlation lengths which falls into the universality class of the two-dimensional (2D) Ising model. From the ratio of correlation lengths along and across the dimer rows we determine effective nearest-neighbor couplings of an anisotropic 2D Ising model, $J_\parallel = (-24.9 \pm 0.9_\mathrm{stat} \pm 1.3_\mathrm{sys})\,\mathrm{meV}$ and $J_\perp = (-0.8 \pm 0.1_\mathrm{stat})\,\mathrm{meV}$. We find that the experimentally determined coupling constants of the Ising model can be reconciled with those of the more complex lattice Hamiltonian from DFT when the critical behavior is of primary interest. The anisotropy of the interactions derived from the experimental data via the 2D Ising model is best matched by DFT calculations using the PBEsol functional. The trends in the calculated anisotropy are consistent with the surface stress anisotropy predicted by the DFT functionals, pointing towards the role of surface stress reduction as a driving force for establishing the $c(4 {\times} 2)$-reconstructed ground state.


title: Efficient Representation of Lattice Path Matroids

abstract: Efficient deterministic algorithms to construct representations of lattice path matroids over finite fields are presented. They are built on known constructions of hierarchical secret sharing schemes, a recent characterization of hierarchical matroid ports, and the existence of isolating weight functions for lattice path matroids whose values are polynomial on the size of the ground set.


title: On the Transferability of Learning Models for Semantic Segmentation for Remote Sensing Data

abstract: Recent deep learning-based methods outperform traditional learning methods on remote sensing (RS) semantic segmentation/classification tasks. However, they require large training datasets and are generally known for lack of transferability due to the highly disparate RS image content across different geographical regions. Yet, there is no comprehensive analysis of their transferability, i.e., to which extent a model trained on a source domain can be readily applicable to a target domain. Therefore, in this paper, we aim to investigate the raw transferability of traditional and deep learning (DL) models, as well as the effectiveness of domain adaptation (DA) approaches in enhancing the transferability of the DL models (adapted transferability). By utilizing four highly diverse RS datasets, we train six models with and without three DA approaches to analyze their transferability between these datasets quantitatively. Furthermore, we developed a straightforward method to quantify the transferability of a model using the spectral indices as a medium and have demonstrated its effectiveness in evaluating the model transferability at the target domain when the labels are unavailable. Our experiments yield several generally important yet not well-reported observations regarding the raw and adapted transferability. Moreover, our proposed label-free transferability assessment method is validated to be better than posterior model confidence. The findings can guide the future development of generalized RS learning models. The trained models are released under this link: https://github.com/GDAOSU/Transferability-Remote-Sensing


title: Metastable phase of UTe$_2$ formed under high pressure above 5 GPa

abstract: Uranium ditelluride (UTe$_2$) has attracted recent interest due to its unique superconducting properties, which include the potential for a topological odd-parity superconducting state. Recently, ac-calorimetry measurements under pressure indicate a change in the ground state of UTe$_2$ from superconducting to antiferromagnetic at 1.4 GPa. Here, we investigate the effect of pressure on the crystal structure of UTe$_2$ up to 25 GPa at room temperature using x-ray diffraction. We find that UTe$_2$, which at ambient conditions has an orthorhombic ($Immm$) structure, transforms to a body-centered tetragonal ($I4/mmm$) structure at 5 GPa in a quasi-hydrostatic neon (Ne) pressure transmitting medium. In the absence of a pressure-transmitting medium, this transformation occurs between 5 and 8 GPa. The data were fit with a third-order Birch-Murnaghan equation of state resulting in values of $B_0$=46.0 $\pm$ 0.6 GPa, $B^{\prime}$=9.3 $\pm$ 0.5 (no pressure medium) and $B_0$=42.5 $\pm$ 2.0 GPa, $B^{\prime}$=9.3 (fixed) (neon pressure medium) for the $Immm$ phase. For the $I4/mmm$ phase, $B_0$=78.9 $\pm$ 0.5 GPa and $B^{\prime}$=4.2 $\pm$ 0.1 (no pressure transmitting medium), and $B_0$=70.0 $\pm$ 1.1 GPa and $B^{\prime}$=4.1 $\pm$ 0.2 (neon pressure medium). The high-pressure tetragonal phase is retained after decompression to ambient pressure, with approximately 30% remaining after 2 days. We argue that the observed phase transition into a higher symmetry structure at P~5 GPa (orthorhombic to tetragonal), is accompanied by an increase in the shortest distance between uranium atoms from 3.6 Angstrom (orthorhombic) to 3.9 Angstrom (tetragonal), which suggests localization of the 5f electrons, albeit with a 10.7% decrease in volume.


title: UNO-DST: Leveraging Unlabelled Data in Zero-Shot Dialogue State Tracking

abstract: Previous zero-shot dialogue state tracking (DST) methods only apply transfer learning, ignoring unlabelled data in the target domain. We transform zero-shot DST into few-shot DST by utilising such unlabelled data via joint and self-training methods. Our method incorporates auxiliary tasks that generate slot types as inverse prompts for main tasks, creating slot values during joint training. Cycle consistency between these two tasks enables the generation and selection of quality samples in unknown target domains for subsequent fine-tuning. This approach also facilitates automatic label creation, thereby optimizing the training and fine-tuning of DST models. We demonstrate this method's effectiveness on general language models in zero-shot scenarios, improving average joint goal accuracy by 8% across all domains in MultiWOZ.


title: Evaluation and improvement of Segment Anything Model for interactive histopathology image segmentation

abstract: With the emergence of the Segment Anything Model (SAM) as a foundational model for image segmentation, its application has been extensively studied across various domains, including the medical field. However, its potential in the context of histopathology data, specifically in region segmentation, has received relatively limited attention. In this paper, we evaluate SAM's performance in zero-shot and fine-tuned scenarios on histopathology data, with a focus on interactive segmentation. Additionally, we compare SAM with other state-of-the-art interactive models to assess its practical potential and evaluate its generalization capability with domain adaptability. In the experimental results, SAM exhibits a weakness in segmentation performance compared to other models while demonstrating relative strengths in terms of inference time and generalization capability. To improve SAM's limited local refinement ability and to enhance prompt stability while preserving its core strengths, we propose a modification of SAM's decoder. The experimental results suggest that the proposed modification is effective to make SAM useful for interactive histology image segmentation. The code is available at \url{https://github.com/hvcl/SAM_Interactive_Histopathology}


title: Multivariate Scalar on Multidimensional Distribution Regression

abstract: We develop a new method for multivariate scalar on multidimensional distribution regression. Traditional approaches typically analyze isolated univariate scalar outcomes or consider unidimensional distributional representations as predictors. However, these approaches are sub-optimal because: i) they fail to utilize the dependence between the distributional predictors: ii) neglect the correlation structure of the response. To overcome these limitations, we propose a multivariate distributional analysis framework that harnesses the power of multivariate density functions and multitask learning. We develop a computationally efficient semiparametric estimation method for modelling the effect of the latent joint density on multivariate response of interest. Additionally, we introduce a new conformal algorithm for quantifying the uncertainty of regression models with multivariate responses and distributional predictors, providing valuable insights into the conditional distribution of the response. We have validated the effectiveness of our proposed method through comprehensive numerical simulations, clearly demonstrating its superior performance compared to traditional methods. The application of the proposed method is demonstrated on tri-axial accelerometer data from the National Health and Nutrition Examination Survey (NHANES) 2011-2014 for modelling the association between cognitive scores across various domains and distributional representation of physical activity among older adult population. Our results highlight the advantages of the proposed approach, emphasizing the significance of incorporating complete spatial information derived from the accelerometer device.


title: Metric Ensembles For Hallucination Detection

abstract: Abstractive text summarization has garnered increased interest as of late, in part due to the proliferation of large language models (LLMs). One of the most pressing problems related to generation of abstractive summaries is the need to reduce "hallucinations," information that was not included in the document being summarized, and which may be wholly incorrect. Due to this need, a wide array of metrics estimating consistency with the text being summarized have been proposed. We examine in particular a suite of unsupervised metrics for summary consistency, and measure their correlations with each other and with human evaluation scores in the wiki_bio_gpt3_hallucination dataset. We then compare these evaluations to models made from a simple linear ensemble of these metrics. We find that LLM-based methods outperform other unsupervised metrics for hallucination detection. We also find that ensemble methods can improve these scores even further, provided that the metrics in the ensemble have sufficiently similar and uncorrelated error rates. Finally, we present an ensemble method for LLM-based evaluations that we show improves over this previous SOTA.


title: Linearly polarized gluon density in the rescaling model

abstract: The low-x behavior of the linearly polarized gluon density h_{g}(x,k_t^2, Q^2) in nuclei is studied in the rescaling model at small transverse momentum k_t.


title: LocSelect: Target Speaker Localization with an Auditory Selective Hearing Mechanism

abstract: The prevailing noise-resistant and reverberation-resistant localization algorithms primarily emphasize separating and providing directional output for each speaker in multi-speaker scenarios, without association with the identity of speakers. In this paper, we present a target speaker localization algorithm with a selective hearing mechanism. Given a reference speech of the target speaker, we first produce a speaker-dependent spectrogram mask to eliminate interfering speakers' speech. Subsequently, a Long short-term memory (LSTM) network is employed to extract the target speaker's location from the filtered spectrogram. Experiments validate the superiority of our proposed method over the existing algorithms for different scale invariant signal-to-noise ratios (SNR) conditions. Specifically, at SNR = -10 dB, our proposed network LocSelect achieves a mean absolute error (MAE) of 3.55 and an accuracy (ACC) of 87.40%.


title: Fast quantum control of cavities using an improved protocol without coherent errors

abstract: The selective number-dependent arbitrary phase (SNAP) gates form a powerful class of quantum gates, imparting arbitrarily chosen phases to the Fock modes of a cavity. However, for short pulses, coherent errors limit the performance. Here we demonstrate in theory and experiment that such errors can be completely suppressed, provided that the pulse times exceed a specific limit. The resulting shorter gate times also reduce incoherent errors. Our approach needs only a small number of frequency components, the resulting pulses can be interpreted easily, and it is compatible with fault-tolerant schemes.


title: Contractibility of the geometric stability manifold of a surface

abstract: Using a recent description of the geometric stability manifold, we show the geometric stability manifold associated to any smooth projective complex surface is contractible. We then use this result to demonstrate infinitely many new families of surfaces whose stability manifold is contractible.


title: Few-Shot Learning Patterns in Financial Time-Series for Trend-Following Strategies

abstract: Forecasting models for systematic trading strategies do not adapt quickly when financial market conditions rapidly change, as was seen in the advent of the COVID-19 pandemic in 2020, causing many forecasting models to take loss-making positions. To deal with such situations, we propose a novel time-series trend-following forecaster that can quickly adapt to new market conditions, referred to as regimes. We leverage recent developments from the deep learning community and use few-shot learning. We propose the Cross Attentive Time-Series Trend Network -- X-Trend -- which takes positions attending over a context set of financial time-series regimes. X-Trend transfers trends from similar patterns in the context set to make forecasts, then subsequently takes positions for a new distinct target regime. By quickly adapting to new financial regimes, X-Trend increases Sharpe ratio by 18.9% over a neural forecaster and 10-fold over a conventional Time-series Momentum strategy during the turbulent market period from 2018 to 2023. Our strategy recovers twice as quickly from the COVID-19 drawdown compared to the neural-forecaster. X-Trend can also take zero-shot positions on novel unseen financial assets obtaining a 5-fold Sharpe ratio increase versus a neural time-series trend forecaster over the same period. Furthermore, the cross-attention mechanism allows us to interpret the relationship between forecasts and patterns in the context set.


title: NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Rails

abstract: NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems. Guardrails (or rails for short) are a specific way of controlling the output of an LLM, such as not talking about topics considered harmful, following a predefined dialogue path, using a particular language style, and more. There are several mechanisms that allow LLM providers and developers to add guardrails that are embedded into a specific model at training, e.g. using model alignment. Differently, using a runtime inspired from dialogue management, NeMo Guardrails allows developers to add programmable rails to LLM applications - these are user-defined, independent of the underlying LLM, and interpretable. Our initial results show that the proposed approach can be used with several LLM providers to develop controllable and safe LLM applications using programmable rails.


title: Adaptive Robot Assistance: Expertise and Influence in Multi-User Task Planning

abstract: This paper addresses the challenge of enabling a single robot to effectively assist multiple humans in decision-making for task planning domains. We introduce a comprehensive framework designed to enhance overall team performance by considering both human expertise in making the optimal decisions and robot influence on human decision-making. Our model integrates these factors seamlessly within the task-planning domain, formulating the problem as a partially observable Markov decision process (POMDP) while treating expertise and influence as unobservable components of the system state. To solve for the robot's actions in such systems, we propose an efficient Attention-Switching policy. This policy capitalizes on the inherent structure of such systems, solving multiple smaller POMDPs to generate heuristics for prioritizing interactions with different human teammates, thereby reducing the state space and improving scalability. Our empirical results on a simulated kit fulfillment task demonstrate improved team performance when the robot's policy accounts for both expertise and influence. This research represents a significant step forward in the field of adaptive robot assistance, paving the way for integration into cost-effective small and mid-scale industries, where substantial investments in robotic infrastructure may not be economically viable.


title: A Tutorial on Chirp Spread Spectrum for LoRaWAN: Basics and Key Advances

abstract: Chirps spread spectrum (CSS) modulation is the heart of long-range (LoRa) modulation used in the context of long-range wide area network (LoRaWAN) in internet of things (IoT) scenarios. Despite being a proprietary technology owned by Semtech Corp., LoRa modulation has drawn much attention from the research and industry communities in recent years. However, to the best of our knowledge, a comprehensive tutorial, investigating the CSS modulation in the LoRaWAN application, is missing in the literature. Therefore, in the first part of this paper, we provide a thorough analysis and tutorial of CSS modulation modified by LoRa specifications, discussing various aspects such as signal generation, detection, error performance, and spectral characteristics. Moreover, a summary of key recent advances in the context of CSS modulation applications in IoT networks is presented in the second part of this paper under four main categories of transceiver configuration and design, data rate improvement, interference modeling, and synchronization algorithms.


title: Flavour Physics at LHCb -- 50 years of the KM paradigm

abstract: The LHCb experiment is in operation since 2009 and has provided measurements of the KM matrix with unprecedented precision. 50 years after the original paper we are in the position of pinning down the parameters of the theory, or possibly to show its limitations. In these proceedings the status of LHCb is shown in a historical perspective, along with some anecdotes.


title: ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models

abstract: Reinforcement Learning from Human Feedback (RLHF) is key to aligning Large Language Models (LLMs), typically paired with the Proximal Policy Optimization (PPO) algorithm. While PPO is a powerful method designed for general reinforcement learning tasks, it is overly sophisticated for LLMs, leading to laborious hyper-parameter tuning and significant computation burdens. To make RLHF efficient, we present ReMax, which leverages 3 properties of RLHF: fast simulation, deterministic transitions, and trajectory-level rewards. These properties are not exploited in PPO, making it less suitable for RLHF. Building on the renowned REINFORCE algorithm, ReMax does not require training an additional value model as in PPO and is further enhanced with a new variance reduction technique. ReMax offers several benefits over PPO: it is simpler to implement, eliminates more than 4 hyper-parameters in PPO, reduces GPU memory usage, and shortens training time. ReMax can save about 46% GPU memory than PPO when training a 7B model and enables training on A800-80GB GPUs without the memory-saving offloading technique needed by PPO. Applying ReMax to a Mistral-7B model resulted in a 94.78% win rate on the AlpacaEval leaderboard and a 7.739 score on MT-bench, setting a new SOTA for open-source 7B models. These results show the effectiveness of ReMax while addressing the limitations of PPO in LLMs.


title: An efficient numerical method for the anisotropic phase field dendritic crystal growth model

abstract: In this paper, we propose and analyze an efficient numerical method for the anisotropic phase field dendritic crystal growth model, which is challenging because we are facing the nonlinear coupling and anisotropic coefficient in the model. The proposed method is a two-step scheme. In the first step, an intermediate solution is computed by using BDF schemes of order up to three for both the phase-field and heat equations. In the second step the intermediate solution is stabilized by multiplying an auxiliary variable. The key of the second step is to stabilize the overall scheme while maintaining the convergence order of the stabilized solution. In order to overcome the difficulty caused by the gradient-dependent anisotropic coefficient and the nonlinear terms, some stabilization terms are added to the BDF schemes in the first step. The second step makes use of a generalized auxiliary variable approach with relaxation. The Fourier spectral method is applied for the spatial discretization. Our analysis shows that the proposed scheme is unconditionally stable and has accuracy in time up to third order. We also provide a sophisticated implementation showing that the computational complexity of our schemes is equivalent to solving two linear equations and some algebraic equations. To the best of our knowledge, this is the cheapest unconditionally stable schemes reported in the literature. Some numerical examples are given to verify the efficiency of the proposed method.


title: Quadric cones on the boundary of the Mori cone for very general blowups of the plane

abstract: We show the existence of cones over 8-dimensional rational spheres at the boundary of the Mori cone of the blow-up of the plane at $s\geq 13$ very general points. This gives evidence for De Fernex's strong $\Delta$-conjecture, which is known to imply Nagata's conjecture. This also implies the existence of a multitude of good and wonderful rays as defined in Ciliberto-Harbourne-Miranda-Ro\'e 2013.


title: Prompt Engineering or Fine Tuning: An Empirical Assessment of Large Language Models in Automated Software Engineering Tasks

abstract: In this paper, we investigate the effectiveness of state-of-the-art LLM, i.e., GPT-4, with three different prompting engineering techniques (i.e., basic prompting, in-context learning, and task-specific prompting) against 18 fine-tuned LLMs on three typical ASE tasks, i.e., code generation, code summarization, and code translation. Our quantitative analysis of these prompting strategies suggests that prompt engineering GPT-4 cannot necessarily and significantly outperform fine-tuning smaller/older LLMs in all three tasks. For comment generation, GPT-4 with the best prompting strategy (i.e., task-specific prompt) had outperformed the first-ranked fine-tuned model by 8.33% points on average in BLEU. However, for code generation, the first-ranked fine-tuned model outperforms GPT-4 with best prompting by 16.61% and 28.3% points, on average in BLEU. For code translation, GPT-4 and fine-tuned baselines tie as they outperform each other on different translation tasks. To explore the impact of different prompting strategies, we conducted a user study with 27 graduate students and 10 industry practitioners. From our qualitative analysis, we find that the GPT-4 with conversational prompts (i.e., when a human provides feedback and instructions back and forth with a model to achieve best results) showed drastic improvement compared to GPT-4 with automatic prompting strategies. Moreover, we observe that participants tend to request improvements, add more context, or give specific instructions as conversational prompts, which goes beyond typical and generic prompting strategies. Our study suggests that, at its current state, GPT-4 with conversational prompting has great potential for ASE tasks, but fully automated prompt engineering with no human in the loop requires more study and improvement.


title: Efficient Sim-to-real Transfer of Contact-Rich Manipulation Skills with Online Admittance Residual Learning

abstract: Learning contact-rich manipulation skills is essential. Such skills require the robots to interact with the environment with feasible manipulation trajectories and suitable compliance control parameters to enable safe and stable contact. However, learning these skills is challenging due to data inefficiency in the real world and the sim-to-real gap in simulation. In this paper, we introduce a hybrid offline-online framework to learn robust manipulation skills. We employ model-free reinforcement learning for the offline phase to obtain the robot motion and compliance control parameters in simulation \RV{with domain randomization}. Subsequently, in the online phase, we learn the residual of the compliance control parameters to maximize robot performance-related criteria with force sensor measurements in real time. To demonstrate the effectiveness and robustness of our approach, we provide comparative results against existing methods for assembly, pivoting, and screwing tasks.


title: Normalized solutions for p-Laplacian equations with potential

abstract: In this paper, we consider the existence of normalized solutions for the following $p$-Laplacian equation \begin{equation*} \left\{\begin{array}{ll} -\Delta_{p}u-V(x)\lvert u\rvert^{p-2}u+\lambda\lvert u\rvert^{p-2}u=\lvert u\rvert^{q-2}u&\mbox{in}\ \mathbb{R}^N, \int_{\mathbb{R}^N}\lvert u\rvert^pdx=a^p, \end{array}\right. \end{equation*} where $N\geqslant 1$, $p>1$, $p+\frac{p^2}{N}<q<p^*=\frac{Np}{N-p}$(if $N\leqslant p$, then $p^*=+\infty$), $a>0$ and $\lambda\in\mathbb{R}$ is a Lagrange multiplier which appears due to the mass constraint. Firstly, under some smallness assumptions on $V$, but no any assumptions on $a$, we obtain a mountain pass solution with positive energy, while no solution with negative energy. Secondly, assuming that the mass $a$ has an upper bound depending on $V$, we obtain two solutions, one is a local minimizer with negative energy, the other is a mountain pass solution with positive energy.


title: A linear parameters study of ion cyclotron emission using drift ring beam distribution

abstract: Ion cyclotron emission (ICE) holds great potential as a diagnostic tool for fast ions in fusion devices. The theory of magnetoacoustic cyclotron instability (MCI), as an emission mechanism for ICE, states that MCI is driven by a velocity distribution of fast ions that approximates a drift ring beam. The influence of key parameters on the linear MCI is systematically investigated using the linear kinetic dispersion relation solver BO (Xie H. 2019 Comput. Phys. Comm. 244 343). The computational spectra region considered extends up to 40 times the ion cyclotron frequency. By examining the influence of these key parameters on MCI, several novel results have been obtained. In the case of MCI excited by super-Alfv\'enic fast ions, the parallel velocity spread significantly affects the bandwidth of harmonics and the continuous spectrum, while the perpendicular velocity spread has a decisive effect on the MCI growth rate. As the velocity spread increases, the linear relationship between the MCI growth rate and the square root of the number density ratio transitions to a linear relationship between the MCI growth rate and the number density ratio. This finding provides a linear perspective explanation for the observed linear relation between fast ion number density and ICE intensity in JET. Furthermore, high harmonics are more sensitive to changes in propagation angle than low harmonics because a decrease in the propagation angle alters the dispersion relation of the fast Alfv\'en wave. In the case of MCI excited by sub-Alfv\'enic fast ions, a significant growth rate increase occurs at high harmonics due to the transition of sub-Alfv\'enic fast ions to super-Alfv\'enic fast ions.


title: Quantum Transport of Charge Density Wave Electrons in Layered Materials

abstract: The charge density wave (CDW) is a condensate that often forms in layered materials. It is known to carry electric current \emph{en masse}, but the transport mechanism remains poorly understood at the microscopic level. Its quantum nature is revealed by several lines of evidence. Experiments often show lack of CDW displacement when biased just below the threshold for nonlinear transport, indicating the CDW never reaches the critical point for classical depinning. Quantum behavior is also revealed by oscillations of period $h/2e$ in CDW conductance vs. magnetic flux, sometimes accompanied by telegraph-like switching, in $\text{TaS}_3$ rings above 77 K. Here we discuss further evidence for quantum CDW electron transport. We find that, for temperatures ranging from 9 to 474 K, CDW current-voltage plots of three trichalcogenide materials agree almost precisely with a modified Zener-tunneling curve and with time-correlated soliton tunneling model simulations. In our model we treat the Schr\"{o}dinger equation as an emergent classical equation that describes fluidic Josephson-like coupling of paired electrons between evolving topological states. We find that an extension of this \lq classically robust' quantum picture explains both the $h/2e$ magnetoconductance oscillations and switching behavior in CDW rings. We consider potential applications for thermally robust quantum information processing systems.


title: Unifying Image Processing as Visual Prompting Question Answering

abstract: Image processing is a fundamental task in computer vision, which aims at enhancing image quality and extracting essential features for subsequent vision applications. Traditionally, task-specific models are developed for individual tasks and designing such models requires distinct expertise. Building upon the success of large language models (LLMs) in natural language processing (NLP), there is a similar trend in computer vision, which focuses on developing large-scale models through pretraining and in-context learning. This paradigm shift reduces the reliance on task-specific models, yielding a powerful unified model to deal with various tasks. However, these advances have predominantly concentrated on high-level vision tasks, with less attention paid to low-level vision tasks. To address this issue, we propose a universal model for general image processing that covers image restoration, image enhancement, image feature extraction tasks, etc. Our proposed framework, named PromptGIP, unifies these diverse image processing tasks within a universal framework. Inspired by NLP question answering (QA) techniques, we employ a visual prompting question answering paradigm. Specifically, we treat the input-output image pair as a structured question-answer sentence, thereby reprogramming the image processing task as a prompting QA problem. PromptGIP can undertake diverse cross-domain tasks using provided visual prompts, eliminating the need for task-specific finetuning. Our methodology offers a universal and adaptive solution to general image processing. While PromptGIP has demonstrated a certain degree of out-of-domain task generalization capability, further research is expected to fully explore its more powerful emergent generalization.


title: Diagonalization in a quantum kicked rotor model with non-analytic potential

abstract: In this paper we study the lattice quasi-periodic operators with power-law long-range hopping and meromorphic monotone potentials, and diagonalize the operators via a Nash-Moser iteration scheme. As applications, we obtain uniform power-law localization, uniform dynamical localization and Lipschitz continuity of the integrated density of states (IDS) for such operators. Our main motivation comes from investigating quantum suppression of chaos in a quantum kicked rotor model with non-analytical potential.


title: iSWAP-type geometric gates induced by paths on Schmidt sphere

abstract: We propose iSWAP-type quantum gates based on geometric phases purely associated with paths on the Schmidt sphere [Phys. Rev. A 62, 022109 (2000)]. These geometric Schmidt gates can entangle qubit pairs to an arbitrary degree; in particular, they can create maximally entangled states from product states by an appropriate choice of base point on the Schmidt sphere. We identify Hamiltonians that generate pure paths on the Schmidt sphere by reverse engineering and demonstrate explicitly that the resulting Hamiltonians can be implemented in systems of transmon qubits. The geometric Schmidt gates are characterized by vanishing dynamical phases and are complementary to geometric single-qubit gates that take place on the Bloch sphere.


title: Wavelet-based image decomposition method for NuSTAR stray light background studies

abstract: The large side aperture of the NuSTAR telescope for unfocused photons (so-called stray light) is a known source of rich astrophysical information. To support many studies based on the NuSTAR stray light data, we present a fully automatic method for determining detector area suitable for background analysis and free from any kind of focused X-ray flux. The method's main idea is `a trous' wavelet image decomposition, capable of detecting structures of any spatial scale and shape, which makes the method of general use. Applied to the NuSTAR data, the method provides a detector image region with the highest possible statistical quality, suitable for the NuSTAR stray light studies. We developed an open-source Python nuwavdet package, which implements the presented method. The package contains subroutines to generate detector image region for further stray light analysis and/or to produce a list of detector bad-flagged pixels for processing in the NuSTAR Data Analysis Software for conventional X-ray analysis.


title: Distribution prediction for image compression: An experimental re-compressor for JPEG images

abstract: We propose a new scheme to re-compress JPEG images in a lossless way. Using a JPEG image as an input the algorithm partially decodes the signal to obtain quantized DCT coefficients and then re-compress them in a more effective way.


title: Quantifying the relative importance of the spatial and temporal resolution in energy systems optimisation model

abstract: An increasing number of studies using energy system optimisation models are conducted with higher spatial and temporal resolution. This comes with a computational cost which places a limit on the size, complexity, and detail of the model. In this paper, we explore the relative importance of structural aspects of energy system models, spatial and temporal resolution, compared to uncertainties in input parameters such as final energy demand, discount rate and capital costs. We use global sensitivity analysis to uncover these interactions for two developing countries, Kenya, and Benin, which still lack universal access to electricity. We find that temporal resolution has a high influence on all assessed results parameters, and spatial resolution has a significant influence on the expansion of distribution lines to the unelectrified population. The larger overall influence of temporal resolution indicates that this should be prioritised compared to spatial resolution.


title: On various Carleson-type geometric lemmas and uniform rectifiability in metric spaces

abstract: We introduce new flatness coefficients, which we call \emph{$\iota$-numbers}, for Ahlfors regular sets in metric spaces. We investigate the relation between Carleson-type geometric lemmas for $\iota$-numbers and other concepts related to quantitative rectifiability. We characterize uniform $1$-rectifiability in rather general metric spaces, and uniform $k$-rectfiability in Euclidean spaces, using $\iota$-numbers. The characterization of uniform $1$-rectifiability in the metric setting proceeds by quantifying an isometric embedding theorem due to Menger, and by an abstract argument that allows to pass from a local covering by continua to a global covering by $1$-regular connected sets. The Euclidean result, on the other hand, is a consequence of an abstract statement about approximation by generalized planes, which applies also to the study of low-dimensional sets in Heisenberg groups.


title: Semantic Parsing by Large Language Models for Intricate Updating Strategies of Zero-Shot Dialogue State Tracking

abstract: Zero-shot Dialogue State Tracking (DST) addresses the challenge of acquiring and annotating task-oriented dialogues, which can be time-consuming and costly. However, DST extends beyond simple slot-filling and requires effective updating strategies for tracking dialogue state as conversations progress. In this paper, we propose ParsingDST, a new In-Context Learning (ICL) method, to introduce additional intricate updating strategies in zero-shot DST. Our approach reformulates the DST task by leveraging powerful Large Language Models (LLMs) and translating the original dialogue text to JSON through semantic parsing as an intermediate state. We also design a novel framework that includes more modules to ensure the effectiveness of updating strategies in the text-to-JSON process. Experimental results demonstrate that our approach outperforms existing zero-shot DST methods on MultiWOZ, exhibiting significant improvements in Joint Goal Accuracy (JGA) and slot accuracy compared to existing ICL methods. Our code has been released.


title: Reproducing Bayesian Posterior Distributions for Exoplanet Atmospheric Parameter Retrievals with a Machine Learning Surrogate Model

abstract: We describe a machine-learning-based surrogate model for reproducing the Bayesian posterior distributions for exoplanet atmospheric parameters derived from transmission spectra of transiting planets with typical retrieval software such as TauRex. The model is trained on ground truth distributions for seven parameters: the planet radius, the atmospheric temperature, and the mixing ratios for five common absorbers: $H_2O$, $CH_4$, $NH_3$, $CO$ and $CO_2$. The model performance is enhanced by domain-inspired preprocessing of the features and the use of semi-supervised learning in order to leverage the large amount of unlabelled training data available. The model was among the winning solutions in the 2023 Ariel Machine Learning Data Challenge.

categories: astro-ph.EP astro-ph.IM cs.LG physics.data-an


title: Observation of GRB 221009A early afterglow in X/$\gamma$-ray energy band

abstract: The early afterglow of a Gamma-ray burst (GRB) can provide critical information on the jet and progenitor of the GRB. The extreme brightness of GRB 221009A allows us to probe its early afterglow in unprecedented detail. In this letter, we report comprehensive observation results of the early afterglow of GRB 221009A (from $T_0$+660 s to $T_0$+1860 s, where $T_0$ is the \textit{Insight}-HXMT/HE trigger time) in X/$\gamma$-ray energy band (from 20 keV to 20 MeV) by \textit{Insight}-HXMT/HE, GECAM-C and \textit{Fermi}/GBM. We find that the spectrum of the early afterglow in 20 keV-20 MeV could be well described by a cutoff power-law with an extra power-law which dominates the low and high energy bands respectively. The cutoff power-law $E_{\rm peak}$ is $\sim$ 30 keV and the power-law photon index is $\sim$ 1.8 throughout the early afterglow phase. By fitting the light curves in different energy bands, we find that a significant achromatic break (from keV to TeV) is required at $T_0$ + 1246$^{+27}_{-26}$ s (i.e. 1021 s since the afterglow starting time $T_{\rm AG}$=$T_0$+225 s), providing compelling evidence of a jet break. Interestingly, both the pre-break and post-break decay slopes vary with energy, and these two slopes become closer in the lower energy band, making the break less identifiable. Intriguingly, the spectrum of the early afterglow experienced a slight hardening before the break and a softening after the break. These results provide new insights into the understanding of this remarkable GRB.


title: From Spectral Theorem to Statistical Independence with Application to System Identification

abstract: High dimensional random dynamical systems are ubiquitous, including -- but not limited to -- cyber-physical systems, daily return on different stocks of S&P 1500 and velocity profile of interacting particle systems around McKeanVlasov limit. Mathematically, underlying phenomenon can be captured via a stable $n$-dimensional linear transformation `$A$' and additive randomness. System identification aims at extracting useful information about underlying dynamical system, given a length $N$ trajectory from it (corresponds to an $n \times N$ dimensional data matrix). We use spectral theorem for non-Hermitian operators to show that spatio-temperal correlations are dictated by the discrepancy between algebraic and geometric multiplicity of distinct eigenvalues corresponding to state transition matrix. Small discrepancies imply that original trajectory essentially comprises of multiple lower dimensional random dynamical systems living on $A$ invariant subspaces and are statistically independent of each other. In the process, we provide first quantitative handle on decay rate of finite powers of state transition matrix $\|A^{k}\|$ . It is shown that when a stable dynamical system has only one distinct eigenvalue and discrepancy of $n-1$: $\|A\|$ has a dependence on $n$, resulting dynamics are spatially inseparable and consequently there exist at least one row with covariates of typical size $\Theta\big(\sqrt{N-n+1}$ $e^{n}\big)$ i.e., even under stability assumption, covariates can suffer from curse of dimensionality. In the light of these findings we set the stage for non-asymptotic error analysis in estimation of state transition matrix $A$ via least squares regression on observed trajectory by showing that element-wise error is essentially a variant of well-know Littlewood-Offord problem.

categories: math.ST cs.LG cs.SY eess.SY math.PR stat.TH


title: A second-order SO(3)-preserving and energy-stable scheme for orthonormal frame gradient flow model of biaxial nematic liquid crystals

abstract: In this paper, we present a novel second-order generalised rotational discrete gradient scheme for numerically approximating the orthonormal frame gradient flow of biaxial nematic liquid crystals. This scheme relies on reformulating the original gradient flow system into an equivalent generalised "rotational" form. A second-order discrete gradient approximation of the energy variation is then devised such that it satisfies an energy difference relation. The proposed numerical scheme has two remarkable properties: (i) it strictly obeys the orthonormal property of the tensor field and (ii) it satisfies the energy dissipation law at the discrete level, regardless of the time step sizes. We provide ample numerical results to validate the accuracy, efficiency, unconditional stability and SO(3)-preserving property of this scheme. In addition, comparisons of the simulation results between the biaxial orthonormal frame gradient flow model and uniaxial Oseen-Frank gradient flow are made to demonstrate the ability of the former to characterize non-axisymmetric local anisotropy.


title: Active Suppression of Quantum Dephasing in Resonantly Driven Ensembles

abstract: We have used quantum control to suppress the impact of random atom positions on coherent population transfer within atom pairs, enabling the observation of dipole-dipole driven Rabi oscillations in a Rydberg gas with hundreds of atoms. The method exploits the reduced coupling-strength sensitivity of the off-resonant Rabi frequency, and coherently amplifies the achievable population transfer in analogy to quasi-phase-matching in non-linear optics. Simulations reproduce the experimental results and demonstrate the potential benefits of the technique to other many-body quantum control applications.


title: A spectrally accurate step-by-step method for the numerical solution of fractional differential equations

abstract: In this paper we consider the numerical solution of fractional differential equations. In particular, we study a step-by-step graded mesh procedure based on an expansion of the vector field using orthonormal Jacobi polynomials. Under mild hypotheses, the proposed procedure is capable of getting spectral accuracy. A few numerical examples are reported to confirm the theoretical findings.


title: Ultra-broadband and compact 2$\times$2 3-dB silicon adiabatic coupler based on supermode-injected adjoint shape optimization

abstract: The 2$\times$2 3-dB couplers are one of the most widely used and important components in silicon photonics. We propose an ultra-broadband and compact 2$\times$2 3-dB adiabatic coupler defined by b-splines and optimized with an efficient supermode-injected adjoint shape optimization. By employing mode adiabatic evolution and mode coupling at two different wavelength ranges, respectively, we achieve an ultra-broad bandwidth of 530 nm from 1150nm to1680nm with a power imbalance below $\pm$0.76 dB in a compact coupling length of 30 $\mu m$ according to our simulation results. The supermode-injected adjoint shape optimization can also be applied to the design of other photonic devices based on supermode manipulation.


title: A novel classification method of 2+1 spacetimes based on the Cotton scalars

abstract: A new effective approach to the algebraic classification of geometries in 2+1 gravity is presented. It uses five real Cotton scalars $\Psi_A$ of distinct boost weights, which are 3D analogues of the Newman-Penrose scalars representing the Weyl tensor in 4D. The classification into types I, II, D, III, N, O is directly related to the multiplicity of the four Cotton-aligned null directions (CANDs). We derive a synoptic algorithm based on the invariants constructed from $\Psi_A$, and we show its agreement with the Petrov scheme based on eigenvalues and canonical Jordan form of the Cotton-York tensor. Our method is simpler and also general because it can be used in any 2+1 theory, such as Einstein's gravity or topologically massive gravity. As an example we analyze the algebraic structure of Robinson-Trautman spacetimes which include charged black holes with a cosmological constant.


title: Positive solutions to nonlinear elliptic problems involving Sobolev exponent

abstract: In this paper we consider nonlinear elliptic PDEs of the type $$-\Delta_p u+a(x)|u|^{p-2}u=|u|^{p^*-2}u \qquad \mbox{ in }\Omega,$$ where $1<p<N$ and $p^*=Np/(N-p)$ is the critical Sobolev exponent, and allowing the asymptotic behavior of the weight function $a$ to be sensitive to the direction. We provide a unified variational approach to obtain existence of distinct solutions in either the unbounded case $\Omega=\mathbb{R}^N$ or when $\Omega$ is a smooth bounded domain. A key point is a precise description of the compactness properties of certain sequences of approximating solutions (Palais-Smale sequences), for which we use novel observations on nonexistence in certain regimes. Most of our main results are new in the case of the classical Laplace operator, $p=2$.


title: Generalized mutual information and their reference priors under Csizar f-divergence

abstract: In Bayesian theory, the role of information is central. The influence exerted by prior information on posterior outcomes often jeopardizes Bayesian studies, due to the potentially subjective nature of the prior choice. In modeling where a priori knowledge is lacking, the reference prior theory emerges as a proficient tool. Based on the criterion of mutual information, this theory makes it possible to construct a non-informative prior whose choice can be qualified as objective. In this paper, we contribute to the enrichment of reference prior theory. Indeed, we unveil an original analogy between reference prior theory and Global Sensitivity Analysis, from which we propose a natural generalization of the mutual information definition. Leveraging dissimilarity measures between probability distributions, such as f-divergences, we provide a formalized framework for what we term generalized reference priors. Our main result offers a limit of mutual information, simplifying the definition of reference priors as its maximal arguments. This approach opens a new way that facilitates the theoretical derivation of reference priors under constraints or within specific classes. In the absence of constraints, we further prove that the Jeffreys prior maximizes the generalized mutual information considered.


title: Learning optimal integration of spatial and temporal information in noisy chemotaxis

abstract: We investigate the boundary between chemotaxis driven by spatial estimation of gradients and chemotaxis driven by temporal estimation. While it is well known that spatial chemotaxis becomes disadvantageous for small organisms at high noise levels, it is unclear whether there is a discontinuous switch of optimal strategies or a continuous transition exists. Here, we employ deep reinforcement learning to study the possible integration of spatial and temporal information in an a priori unconstrained manner. We parameterize such a combined chemotactic policy by a recurrent neural network and evaluate it using a minimal theoretical model of a chemotactic cell. By comparing with constrained variants of the policy, we show that it converges to purely temporal and spatial strategies at small and large cell sizes, respectively. We find that the transition between the regimes is continuous, with the combined strategy outperforming in the transition region both the constrained variants as well as models that explicitly integrate spatial and temporal information. Finally, by utilizing the attribution method of integrated gradients, we show that the policy relies on a non-trivial combination of spatially and temporally derived gradient information in a ratio that varies dynamically during the chemotactic trajectories.


title: One For All & All For One: Bypassing Hyperparameter Tuning with Model Averaging For Cross-Lingual Transfer

abstract: Multilingual language models enable zero-shot cross-lingual transfer (ZS-XLT): fine-tuned on sizable source-language task data, they perform the task in target languages without labeled instances. The effectiveness of ZS-XLT hinges on the linguistic proximity between languages and the amount of pretraining data for a language. Because of this, model selection based on source-language validation is unreliable: it picks model snapshots with suboptimal target-language performance. As a remedy, some work optimizes ZS-XLT by extensively tuning hyperparameters: the follow-up work then routinely struggles to replicate the original results. Other work searches over narrower hyperparameter grids, reporting substantially lower performance. In this work, we therefore propose an unsupervised evaluation protocol for ZS-XLT that decouples performance maximization from hyperparameter tuning. As a robust and more transparent alternative to extensive hyperparameter tuning, we propose to accumulatively average snapshots from different runs into a single model. We run broad ZS-XLT experiments on both higher-level semantic tasks (NLI, extractive QA) and a lower-level token classification task (NER) and find that conventional model selection based on source-language validation quickly plateaus to suboptimal ZS-XLT performance. On the other hand, our accumulative run-by-run averaging of models trained with different hyperparameters boosts ZS-XLT performance and closely correlates with "oracle" ZS-XLT, i.e., model selection based on target-language validation performance.


title: Label-efficient Segmentation via Affinity Propagation

abstract: Weakly-supervised segmentation with label-efficient sparse annotations has attracted increasing research attention to reduce the cost of laborious pixel-wise labeling process, while the pairwise affinity modeling techniques play an essential role in this task. Most of the existing approaches focus on using the local appearance kernel to model the neighboring pairwise potentials. However, such a local operation fails to capture the long-range dependencies and ignores the topology of objects. In this work, we formulate the affinity modeling as an affinity propagation process, and propose a local and a global pairwise affinity terms to generate accurate soft pseudo labels. An efficient algorithm is also developed to reduce significantly the computational cost. The proposed approach can be conveniently plugged into existing segmentation networks. Experiments on three typical label-efficient segmentation tasks, i.e. box-supervised instance segmentation, point/scribble-supervised semantic segmentation and CLIP-guided semantic segmentation, demonstrate the superior performance of the proposed approach.


title: Comparing Comparators in Generalization Bounds

abstract: We derive generic information-theoretic and PAC-Bayesian generalization bounds involving an arbitrary convex comparator function, which measures the discrepancy between the training and population loss. The bounds hold under the assumption that the cumulant-generating function (CGF) of the comparator is upper-bounded by the corresponding CGF within a family of bounding distributions. We show that the tightest possible bound is obtained with the comparator being the convex conjugate of the CGF of the bounding distribution, also known as the Cram\'er function. This conclusion applies more broadly to generalization bounds with a similar structure. This confirms the near-optimality of known bounds for bounded and sub-Gaussian losses and leads to novel bounds under other bounding distributions.

categories: cs.LG cs.IT math.IT math.ST stat.ML stat.TH


title: Takens Theorem for nonautonomous partially hyperbolic dynamical systems

abstract: Takens Theorem for a partially hyperbolic dynamics provides a normal linearization along the center manifold. In this paper, we give the nonautonomous version of Takens Theorem under non-resonance conditions formulated in terms of the dichotomy spectrum. In our proof, one difficulty is to solve homological equations for the normal form theory which involve a center variable, while another difficulty is to find the dichotomy spectrum of a certain matrix cocycle that is block lower triangular. In order to overcome those difficulties, in comparison with the autonomous case, we need an additional term in the (nonautonomous) non-resonance conditions to guarantee certain spectral gap conditions. This additional term disappears naturally in the autonomous case.


title: On explicit embeddings of $\mathbb{Q}$ into finitely presented groups

abstract: Explicit embeddings of the group $\mathbb{Q}$ into a finitely presented group $\mathcal{Q}$ and into a $2$-generator finitely presented group $T_{\mathcal{Q}}$ are suggested. The constructed embeddings reflect questions mentioned by Johnson, Bridson, de la Harpe in the literature in late $1990$s about possibility of such embeddings for $\mathbb{Q}$. Technique used here is based on the methods with integer-valued sequences sets used by Higman, and with specific free constructions of groups, including free product with amalgamation, HNN-extension, an auxiliary technical structure of $*$-construction, etc.


title: Microscaling Data Formats for Deep Learning

abstract: Narrow bit-width data formats are key to reducing the computational and storage costs of modern deep learning applications. This paper evaluates Microscaling (MX) data formats that combine a per-block scaling factor with narrow floating-point and integer types for individual elements. MX formats balance the competing needs of hardware efficiency, model accuracy, and user friction. Empirical results on over two dozen benchmarks demonstrate practicality of MX data formats as a drop-in replacement for baseline FP32 for AI inference and training with low user friction. We also show the first instance of training generative language models at sub-8-bit weights, activations, and gradients with minimal accuracy loss and no modifications to the training recipe.


title: Efficient Quantum Circuits based on the Quantum Natural Gradient

abstract: Efficient preparation of arbitrary entangled quantum states is crucial for quantum computation. This is particularly important for noisy intermediate scale quantum simulators relying on variational hybrid quantum-classical algorithms. To that end, we propose symmetry-conserving modified quantum approximate optimization algorithm~(SCom-QAOA) circuits. The depths of these circuits depend not only on the desired fidelity to the target state, but also on the amount of entanglement the state contains. The parameters of the SCom-QAOA circuits are optimized using the quantum natural gradient method based on the Fubini-Study metric. The SCom-QAOA circuit transforms an unentangled state into a ground state of a gapped one-dimensional Hamiltonian with a circuit-depth that depends not on the system-size, but rather on the finite correlation length. In contrast, the circuit depth grows proportionally to the system size for preparing low-lying states of critical one-dimensional systems. Even in the latter case, SCom-QAOA circuits with depth less than the system-size were sufficient to generate states with fidelity in excess of 99\%, which is relevant for near-term applications. The proposed scheme enlarges the set of the initial states accessible for variational quantum algorithms and widens the scope of investigation of non-equilibrium phenomena in quantum simulators.


title: A Langlands dual realization of coherent sheaves on the nilpotent cone

abstract: Let $G$ and $\check{G}$ be Langlands dual connected reductive groups. We establish a monoidal equivalence of $\infty$-categories between equivariant quasicoherent sheaves on the formal neighborhood of the nilpotent cone in $G$ and Steinberg-Whittaker D-modules on the loop group of $\check{G}$, as conjectured by Bezrukavnikov. More generally, we establish equivalences between various spectral and automorphic realizations of affine Hecke categories and their modules, confirming conjectures of Bezrukavnikov.


title: Implementation of a laser-neutron pump-probe capability at HYSPEC

abstract: Exciting new fundamental scientific questions are currently being raised regarding nonequilibrium dynamics in spin systems, as this directly relates to low power and low loss energy transport for spintronics. Inelastic neutron scattering (INS) is an indispensable tool to study spin excitations in complex magnetic materials. However, conventional INS spectrometers currently only perform steady-state measurements and probe averaged properties over many collision events between spin excitations in thermodynamic equilibrium, while the exact picture of re-equilibration of these excitations remains unknown. In this work, we designed and implemented a time-resolved laser-neutron pump-probe capability at HYSPEC (Hybrid Spectrometer, beamline 14-B) at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory. This capability allows us to excite out-of-equilibrium magnons with a nanosecond pulsed laser source and probe the resulting dynamics using INS. Here, we discussed technical aspects to implement such a capability in a neutron beamline, including choices of suitable neutron instrumentation and material systems, laser excitation scheme, experimental configurations, and relevant firmware and software development to allow for time-synchronized pump-probe measurements. We demonstrated that the laser-induced nonequilibrium structural factor is able to be resolved by INS in a quantum magnet. The method developed in this work will provide SNS with advanced capabilities for performing out-of-equilibrium measurements, opening up an entirely new research direction to study out-of-equilibrium phenomena using neutrons.


title: AST: Effective Dataset Distillation through Alignment with Smooth and High-Quality Expert Trajectories

abstract: Training large AI models typically requires large-scale datasets in the machine learning process, making training and parameter-tuning process both time-consuming and costly. Some researchers address this problem by carefully synthesizing a very small number of highly representative and informative samples from real-world datasets. This approach, known as Dataset Distillation (DD), proposes a perspective for data-efficient learning. Despite recent progress in this field, the performance of existing methods still cannot meet expectations, and distilled datasets cannot effectively replace original datasets. In this paper, unlike previous methods that focus solely on improving the effectiveness of student distillation, we recognize and leverage the important mutual influence between expert and student models. We observed that the smoothness of expert trajectories has a significant impact on subsequent student parameter alignment. Based on this, we propose an effective DD framework named AST, standing for Alignment with Smooth and high-quality expert Trajectories. We devise the integration of clipping loss and gradient penalty to regulate the rate of parameter changes in expert trajectory generation. To further refine the student parameter alignment with expert trajectory, we put forward representative initialization for the synthetic dataset and balanced inner-loop loss in response to the sensitivity exhibited towards randomly initialized variables during distillation. We also propose two enhancement strategies, namely intermediate matching loss and weight perturbation, to mitigate the potential occurrence of cumulative errors. We conduct extensive experiments on datasets of different scales, sizes, and resolutions. The results demonstrate that the proposed method significantly outperforms prior methods.


title: High-angular-momentum Rydberg states in a room-temperature vapor cell for DC electric-field sensing

abstract: We prepare and analyze Rydberg states with orbital quantum numbers $\ell \le 6$ using three-optical-photon electromagnetically-induced transparency (EIT) and radio-frequency (RF) dressing, and employ the high-$\ell$ states in electric-field sensing. Rubidium-85 atoms in a room-temperature vapor cell are first promoted into the $25F_{5/2}$ state via Rydberg-EIT with three infrared laser beams. Two RF dressing fields then (near-)resonantly couple $25 \ell$ Rydberg states with high $\ell$. The dependence of the RF-dressed Rydberg-state level structure on RF powers, RF and laser frequencies is characterized using EIT. Furthermore, we discuss the principles of DC-electric-field sensing using high-$\ell$ Rydberg states, and experimentally demonstrate the method using test electric fields of $\lesssim$~50~V/m induced via photo-illumination of the vapor-cell wall. We measure the highly nonlinear dependence of the DC-electric-field strength on the power of the photo-illumination laser. Numerical calculations, which reproduce our experimental observations well, elucidate the underlying physics. Our study is relevant to high-precision spectroscopy of high-$\ell$ Rydberg states, Rydberg-atom-based electric-field sensing, and plasma electric-field diagnostics.


title: ViPE: Visualise Pretty-much Everything

abstract: Figurative and non-literal expressions are profoundly integrated in human communication. Visualising such expressions allow us to convey our creative thoughts, and evoke nuanced emotions. Recent text-to-image models like Stable Diffusion, on the other hand, struggle to depict non-literal expressions. Recent works primarily deal with this issue by compiling humanly annotated datasets on a small scale, which not only demands specialised expertise but also proves highly inefficient. To address this issue, we introduce ViPE: Visualise Pretty-much Everything. ViPE offers a series of lightweight and robust language models that have been trained on a large-scale set of lyrics with noisy visual descriptions that represent their implicit meaning. The synthetic visual descriptions are generated by GPT3.5 relying on neither human annotations nor images. ViPE effectively expresses any arbitrary piece of text into a visualisable description, enabling meaningful and high-quality image generation. We provide compelling evidence that ViPE is more robust than GPT3.5 in synthesising visual elaborations. ViPE also exhibits an understanding of figurative expressions comparable to human experts, providing a powerful and open-source backbone to many downstream applications such as music video and caption generation.


title: Use of probabilistic phrases in a coordination game: human versus GPT-4

abstract: English speakers use probabilistic phrases such as likely to communicate information about the probability or likelihood of events. Communication is successful to the extent that the listener grasps what the speaker means to convey and, if communication is successful, individuals can potentially coordinate their actions based on shared knowledge about uncertainty. We first assessed human ability to estimate the probability and the ambiguity (imprecision) of twenty-three probabilistic phrases in a coordination game in two different contexts, investment advice and medical advice. We then had GPT4 (OpenAI), a Large Language Model, complete the same tasks as the human participants. We found that the median human participant and GPT4 assigned probability estimates that were in good agreement (proportions of variance accounted for close to .90). GPT4's estimates of probability both in the investment and Medical contexts were as close or closer to that of the human participants as the human participants' estimates were to one another. Estimates of probability for both the human participants and GPT4 were little affected by context. In contrast, human and GPT4 estimates of ambiguity were not in such good agreement.