title: Auditing health-related recommendations in social media: A Case Study of Abortion on YouTube

abstract: Recommendation algorithms (RS) used by social media, like YouTube, significantly shape our information consumption across various domains, especially in healthcare. Hence, algorithmic auditing becomes crucial to uncover their potential bias and misinformation, particularly in the context of controversial topics like abortion. We introduce a simple yet effective sock puppet auditing approach to investigate how YouTube recommends abortion-related videos to individuals with different backgrounds. Our framework allows for efficient auditing of RS, regardless of the complexity of the underlying algorithms


title: On the addition of a large scalar multiplet to the Standard Model

abstract: We consider the addition of a single $SU(2)$ multiplet of complex scalar fields to the Standard Model (SM). We explicitly consider the various possible values of the weak isospin $J$ of that multiplet, up to and including $J = 7/2$. We allow the multiplet to have arbitrary weak hypercharge. The scalar fields of the multiplet are assumed to have no vacuum expectation value; the mass differences among the components of the multiplet originate in its coupling, present in the scalar potential (SP), to the Higgs doublet of the SM. We derive exact bounded-from-below and unitarity conditions on the SP, thereby constraining those mass differences. We compare those constraints to the ones that may be derived from the oblique parameters.


title: Anomaly Detection in Power Grids via Context-Agnostic Learning

abstract: An important tool grid operators use to safeguard against failures, whether naturally occurring or malicious, involves detecting anomalies in the power system SCADA data. In this paper, we aim to solve a real-time anomaly detection problem. Given time-series measurement values coming from a fixed set of sensors on the grid, can we identify anomalies in the network topology or measurement data? Existing methods, primarily optimization-based, mostly use only a single snapshot of the measurement values and do not scale well with the network size. Recent data-driven ML techniques have shown promise by using a combination of current and historical data for anomaly detection but generally do not consider physical attributes like the impact of topology or load/generation changes on sensor measurements and thus cannot accommodate regular context-variability in the historical data. To address this gap, we propose a novel context-aware anomaly detection algorithm, GridCAL, that considers the effect of regular topology and load/generation changes. This algorithm converts the real-time power flow measurements to context-agnostic values, which allows us to analyze measurement coming from different grid contexts in an aggregate fashion, enabling us to derive a unified statistical model that becomes the basis of anomaly detection. Through numerical simulations on networks up to 2383 nodes, we show that our approach is accurate, outperforming state-of-the-art approaches, and is computationally efficient.


title: Novel first-order phase transition and critical points in SU(3) Yang-Mills theory with spatial compactification

abstract: We investigate the thermodynamics and phase structure of $SU(3)$ Yang-Mills theory on $\mathbb{T}^2\times\mathbb{R}^2$ in Euclidean spacetime in an effective-model approach. The model incorporates two Polyakov loops along two compactified directions as dynamical variables, and is constructed to reproduce thermodynamics on $\mathbb{T}^2\times\mathbb{R}^2$ measured on the lattice. The model analysis indicates the existence of a novel first-order phase transition on $\mathbb{T}^2\times\mathbb{R}^2$ in the deconfined phase, which terminates at critical points that should belong to the two-dimensional $Z_2$ universality class. We argue that the interplay of the Polyakov loops induced by their cross term in the Polyakov-loop potential is responsible for the manifestation of the first-order transition.


title: High-Dimension Human Value Representation in Large Language Models

abstract: The widespread application of Large Language Models (LLMs) across various tasks and fields has necessitated the alignment of these models with human values and preferences. Given various approaches of human value alignment, ranging from Reinforcement Learning with Human Feedback (RLHF), to constitutional learning, etc. there is an urgent need to understand the scope and nature of human values injected into these models before their release. There is also a need for model alignment without a costly large scale human annotation effort. We propose UniVaR, a high-dimensional representation of human value distributions in LLMs, orthogonal to model architecture and training data. Trained from the value-relevant output of eight multilingual LLMs and tested on the output from four multilingual LLMs, namely LlaMA2, ChatGPT, JAIS and Yi, we show that UniVaR is a powerful tool to compare the distribution of human values embedded in different LLMs with different langauge sources. Through UniVaR, we explore how different LLMs prioritize various values in different languages and cultures, shedding light on the complex interplay between human values and language modeling.


title: Snake Story: Exploring Game Mechanics for Mixed-Initiative Co-creative Storytelling Games

abstract: Mixed-initiative co-creative storytelling games have existed for some time as a way to merge storytelling with play. However, modern mixed-initiative co-creative storytelling games predominantly prioritize story creation over gameplay mechanics, which might not resonate with all players. As such, there is untapped potential for creating mixed-initiative games with more complex mechanics in which players can engage with both co-creation and gameplay goals. To explore the potential of more prominent gameplay in mixed-initiative co-creative storytelling games, we created Snake Story, a variation of the classic Snake game featuring a human-AI co-writing element. To explore how players interact with the mixed-initiative game, we conducted a qualitative playtest with 11 participants. Analysis of both think-aloud and interview data revealed that players' strategies and experiences were affected by their perception of Snake Story as either a collaborative tool, a traditional game, or a combination of both. Based on these findings, we present design considerations for future development in mixed-initiative co-creative gaming.


title: Q-ITAGS: Quality-Optimized Spatio-Temporal Heterogeneous Task Allocation with a Time Budget

abstract: Complex multi-objective missions require the coordination of heterogeneous robots at multiple inter-connected levels, such as coalition formation, scheduling, and motion planning. The associated challenges are exacerbated when solutions to these interconnected problems need to both maximize task performance and respect practical constraints on time and resources. In this work, we formulate a new class of spatio-temporal heterogeneous task allocation problems that consider these complexities. We contribute a novel framework, named Quality-Optimized Incremental Task Allocation Graph Search (Q-ITAGS), to solve such problems. Q-ITAGS builds upon our prior work in trait-based coordination and offers a flexible interleaved framework that i) explicitly models and optimizes the effect of collective capabilities on task performance via learnable trait-quality maps, and ii) respects both resource constraints and spatio-temporal constraints, including a user-specified time budget (i.e., maximum makespan). In addition to algorithmic contributions, we derive theoretical suboptimality bounds in terms of task performance that varies as a function of a single hyperparameter. Our detailed experiments involving a simulated emergency response task and a real-world video game dataset reveal that i) Q-ITAGS results in superior team performance compared to a state-of-the-art method, while also respecting complex spatio-temporal and resource constraints, ii) Q-ITAGS efficiently learns trait-quality maps to enable effective trade-off between task performance and resource constraints, and iii) Q-ITAGS' suboptimality bounds consistently hold in practice.


title: Bootstrap percolation is local

abstract: Metastability thresholds lie at the heart of bootstrap percolation theory. Yet proving precise lower bounds is notoriously hard. We show that for two of the most classical models, two-neighbour and Frob\"ose, upper bounds are sharp to essentially arbitrary precision, by linking them to their local counterparts. In Frob\"ose bootstrap percolation, iteratively, any vertex of the square lattice that is the only healthy vertex of a $1\times1$ square becomes infected and infections never heal. We prove that if vertices are initially infected independently with probability $p\to0$, then with high probability the origin becomes infected after \[\exp\left(\frac{\pi^2}{6p}-\frac{\pi\sqrt{2+\sqrt2}}{\sqrt p}+\frac{O(\log^2(1/p))}{\sqrt[3]p}\right)\] time steps. We achieve this by proposing a new paradigmatic view on bootstrap percolation based on locality. Namely, we show that studying the Frob\"ose model is equivalent in an extremely strong sense to studying its local version. As a result, we completely bypass Holroyd's classical but technical hierarchy method, yielding the first term above and systematically used throughout bootstrap percolation for the last two decades. Instead, the proof features novel links to large deviation theory, eigenvalue perturbations and others. We also use the locality viewpoint to resolve the so-called bootstrap percolation paradox. Indeed, we propose and implement an exact (deterministic) algorithm which exponentially outperforms previous Monte Carlo approaches. This allows us to clearly showcase and quantify the slow convergence we prove rigorously. The same approach applies, with more extensive computations, to the two-neighbour model, in which vertices are infected when they have at least two infected neighbours and do not recover. We expect it to be applicable to a wider range of models and correspondingly conclude with a number of open problems.

categories: math.PR cond-mat.stat-mech math-ph math.CO math.MP


title: HGRN2: Gated Linear RNNs with State Expansion

abstract: Hierarchically gated linear RNN (HGRN,Qin et al. 2023) has demonstrated competitive training speed and performance in language modeling, while offering efficient inference. However, the recurrent state size of HGRN remains relatively small, which limits its expressiveness.To address this issue, inspired by linear attention, we introduce a simple outer-product-based state expansion mechanism so that the recurrent state size can be significantly enlarged without introducing any additional parameters. The linear attention form also allows for hardware-efficient training.Our extensive experiments verify the advantage of HGRN2 over HGRN1 in language modeling, image classification, and Long Range Arena.Our largest 3B HGRN2 model slightly outperforms Mamba and LLaMa Architecture Transformer for language modeling in a controlled experiment setting; and performs competitively with many open-source 3B models in downstream evaluation while using much fewer total training tokens.


title: Poincar\'{e} disk as a model of squeezed states of a harmonic oscillator

abstract: Single-mode squeezed states exhibit a direct correspondence with points on the Poincar\'e disk. In this study, we delve into this correspondence and describe the motions of the disk generated by a quadratic Hamiltonian. This provides a geometric representation of squeezed states and their evolution. We discuss applications in bang-bang and adiabatic control problems involving squeezed states.


title: WiNNbeta: Batch and drift correction method by white noise normalization for metabolomic studies

abstract: We developed a method called batch and drift correction method by White Noise Normalization (WiNNbeta) to correct individual metabolites for batch effects and drifts. This method tests for white noise properties to identify metabolites in need of correction and corrects them by using fine-tuned splines. To test the method performance we applied WiNNbeta to LC-MS data from our metabolomic studies and computed CVs before and after WiNNbeta correction in quality control samples.


title: On orthogonality to uniquely ergodic systems

abstract: We solve Boshernitzan's problem of characterization (in terms of so called Furstenberg systems) of bounded sequences that are orthogonal to all uniquely ergodic systems. Some variations of Boshernitzan's problem involving characteristic classes are considered. As an application, we characterize sequences orthogonal to all uniquely ergodic systems whose (unique) invariant measure yields a discrete spectrum automorphism as those satisfying an averaged Chowla property.


title: Distributions and Collision Rates of ALP Stars in the Milky Way

abstract: We apply current analytical knowledge on the characteristic mass and linear evolution of miniclusters down to redshift $z=0$ to the hypothetical minicluster distribution of the Milky Way. Using the mass-radius relation and a core-halo relation for stable soliton solutions composed of axion-like particles (ALPs), we connect the galactic minicluster mass distribution to that of their ALP star cores. We consider different temperature evolutions of the ALP field with masses in the range $10^{-12}\,\mathrm{eV} \leq m_a \leq 10^{-3}\,$eV and infer the abundance and properties of QCD axion- and ALP stars in our galaxy. We re-evaluate detection prospects for collisions of neutron stars with both ALP stars and miniclusters as well as relativistic ALP bursts, so-called Bosenovae. Our analysis shows that the collision rates between miniclusters and neutron stars can become as large as $\sim 10^5\,$yr$^{-1}$ galaxy$^{-1}$, but that the fraction of encounters that can lead to resonance between ALP mass and magnetosphere plasma frequency is generally well below $\sim 1\,$yr$^{-1}$ galaxy$^{-1}$, depending on the ALP model. We confirm previous results that merger rates of ALP stars are extremely small $< 10^{-12}\,$yr$^{-1}$ galaxy$^{-1}$, while their host miniclusters can merge much more frequently, up to $\sim 10^3\,$yr$^{-1}$ galaxy$^{-1}$ for the QCD axion. We find that Bosenovae and parametric resonance are much more likely to lead to observable signatures than neutron star encounters. We also suggest that a combination of accretion and parametric resonance can lead to observable radio lines for a wide range of ALP masses $m_a$ and photon-couplings $g_{a\gamma\gamma}$.


title: A new scheme for isomer pumping and depletion with high-power lasers

abstract: We propose a novel scheme for the population and depletion of nuclear isomers. The scheme combines the $\gamma$-photons with energies $\gtrsim 10$ keV emitted during the interaction of a contemporary high-intensity laser pulse with a plasma and one or multiple photon beams supplied by intense lasers. Due to nonlinear effects, two- or multi-photon absorption dominates over the conventional multi-step one-photon process for an optimized gamma flash. Moreover, this nonlinear effect can be greatly enhanced with the help of externally supplied photons. These photons act such that the effective cross-section experienced by the $\gamma$-photons becomes tunable, growing with the intensity $I_0$ of the beam. Assuming $I_{0}\sim 10^{18}$ Wcm$^{-2}$ for the photon beam, an effective cross-section as large as $10^{-21}$ cm$^2$ to $10^{-28}$ cm$^2$ for the $\gamma-$photon can be achieved. Thus, within state-of-the-art 10 PW laser facilities, the yields from two-photon absorption can reach $10^6$ to $10^9$ isomers per shot for selected states that are separated from their ground state by E2 transitions. Similar yields for transitions with higher multipolarities can be accommodated by multi-photon absorption with additional photons provided.


title: Nearby cycles at infinity as a triangulated functor

abstract: Let $k$ be a field and $g \colon Y \longrightarrow X$, $f \colon X \longrightarrow \mathbb{A}_k^1$ be morphisms of quasi-projective $k$-varieties. In his thesis, Ayoub developed the theory of motivic nearby cycles functors $\Psi_{f},\Psi_{f \circ g}$. They are equipped with several base change morphisms such as $\mu_g \colon g_{\sigma!}\Psi_{f \circ g} \longrightarrow \Psi_f g_{\eta !}$, $\nu_g\colon \Psi_{f \circ g}g_{\eta}^! \longrightarrow g_{\sigma}^!\Psi_f$, which are isomorphisms if $g$ is projective and smooth, respectively. In this article, we remove the quasi-projectiveness of varieties in these base change morphisms by following a classical formulation of Deligne. As an application, we prove that the cone of $\mu_g$ is a triangulated functor. It turns out that nearby cycles at infinity constructed by Raibaut is incarnation of this cone functor.


title: High-performance matrix-free unfitted finite element operator evaluation

abstract: Unfitted finite element methods, like CutFEM, have traditionally been implemented in a matrix-based fashion, where a sparse matrix is assembled and later applied to vectors while solving the resulting linear system. With the goal of increasing performance and enabling algorithms with polynomial spaces of higher degrees, this contribution chooses a more abstract approach by matrix-free evaluation of the operator action on vectors instead. The proposed method loops over cells and locally evaluates the cell, face, and interface integrals, including the contributions from cut cells and the different means of stabilization. The main challenge is the efficient numerical evaluation of terms in the weak form with unstructured quadrature points arising from the unfitted discretization in cells cut by the interface. We present design choices and performance optimizations for tensor-product elements and demonstrate the performance by means of benchmarks and application examples. We demonstrate a speedup of more than one order of magnitude for the operator evaluation of a discontinuous Galerkin discretization with polynomial degree three compared to a sparse matrix-vector product and develop performance models to quantify the performance properties over a wide range of polynomial degrees.


title: Quantum computation in fermionic thermal field theories

abstract: Thermal properties of quantum fields at finite temperature are crucial to understanding strongly interacting matter and recent development in quantum computing has provided an alternative and promising avenue of study. In this work, we study thermal field theories involving only fermions using quantum algorithms. We first delve into the presentations of fermion fields via qubits on digital quantum computers alongside the quantum algorithms such as quantum imaginary time evolutions employed to evaluate thermal properties of generic quantum field theories. Specifically, we show numerical results such as the thermal distribution and the energy density of thermal field theories for Majorana fermions in 1+1 dimensions using quantum simulators. In addition to free field theory, we also study the effects of interactions resulting from coupling with a spatially homogeneous Majorana field. In both cases, we show analytically that thermal properties of the system can be described using phase-space distributions, and the quantum simulation results agree with analytical and semiclassical expectations. Our work is an important step to understand thermal fixed points, preparing for quantum simulation of thermalization in real time.


title: Optimal Control for Linear Systems with $L^1$-norm Cost

abstract: We study $L^1$-optimal stabilization of linear systems with finite and infinite horizons. Main results concern the existence, uniqueness and structure of optimal solutions, and the robustness of optimal cost.


title: Convergence, divergence, and inherent oscillations in MFS solutions of two-dimensional Laplace-Neumann problems

abstract: The method of fundamental solutions (MFS), also known as the method of auxiliary sources (MAS), is a well-known computational method for the solution of boundary-value problems. The final solution ("MAS solution") is obtained once we have found the amplitudes of $N$ auxiliary "MAS sources." Past studies have demonstrated that it is possible for the MAS solution to converge to the true solution even when the $N$ auxiliary sources diverge and oscillate. The present paper extends the past studies by demonstrating this possibility within the context of Laplace's equation with Neumann boundary conditions. One can thus obtain the correct solution from sources that, when $N$ is large, must be considered unphysical. We carefully explain the underlying reasons for the unphysical results, distinguish from other difficulties that might concurrently arise, and point to significant differences with time-dependent problems that were studied in the past.


title: Dynamical Reorientation of Spin Multipoles in Silicon Carbide by Transverse Magnetic Fields

abstract: The long-lived and optically addressable high-spin state of the negatively charged silicon vacancy ($\mathrm{V_{Si}}$) in silicon carbide makes it a promising system for applications in quantum technologies. Most studies of its spin dynamics have been performed in external magnetic fields applied along the symmetry axis. Here, we find that the application of weak magnetic fields perpendicular to the symmetry axis leads to nontrivial behavior caused by dynamical reorientation of the $\mathrm{V_{Si}}$ spin multipole under optical excitation. Particularly, we observe the inversion of the quadrupole spin polarization in the excited state and appearance of the dipole spin polarization in the ground state. The latter is much higher than thermal polarization and cannot be induced solely by optical excitation. Our theoretical calculations reproduce well all sharp features in the spin resonance spectra, and shine light on the complex dynamics of spin multipoles in these kinds of solid-state systems.


title: A Novel Optimization-Based Collision Avoidance For Autonomous On-Orbit Assembly

abstract: The collision avoidance constraints are prominent as non-convex, non-differentiable, and challenging when defined in optimization-based motion planning problems. To overcome these issues, this paper presents a novel non-conservative collision avoidance technique using the notion of convex optimization to establish the distance between robotic spacecraft and space structures for autonomous on-orbit assembly operations. The proposed technique defines each ellipsoidal- and polyhedral-shaped object as the union of convex compact sets, each represented non-conservatively by a real-valued convex function. Then, the functions are introduced as a set of constraints to a convex optimization problem to produce a new set of differentiable constraints resulting from the optimality conditions. These new constraints are later fed into an optimal control problem to enforce collision avoidance where the motion planning for the autonomous on-orbit assembly takes place. Numerical experiments for two assembly scenarios in tight environments are presented to demonstrate the capability and effectiveness of the proposed technique. The results show that this framework leads to optimal non-conservative trajectories for robotic spacecraft in tight environments. Although developed for autonomous on-orbit assembly, this technique could be used for any generic motion planning problem where collision avoidance is crucial.


title: DesignQA: A Multimodal Benchmark for Evaluating Large Language Models' Understanding of Engineering Documentation

abstract: This research introduces DesignQA, a novel benchmark aimed at evaluating the proficiency of multimodal large language models (MLLMs) in comprehending and applying engineering requirements in technical documentation. Developed with a focus on real-world engineering challenges, DesignQA uniquely combines multimodal data-including textual design requirements, CAD images, and engineering drawings-derived from the Formula SAE student competition. Different from many existing MLLM benchmarks, DesignQA contains document-grounded visual questions where the input image and input document come from different sources. The benchmark features automatic evaluation metrics and is divided into segments-Rule Comprehension, Rule Compliance, and Rule Extraction-based on tasks that engineers perform when designing according to requirements. We evaluate state-of-the-art models like GPT4 and LLaVA against the benchmark, and our study uncovers the existing gaps in MLLMs' abilities to interpret complex engineering documentation. Key findings suggest that while MLLMs demonstrate potential in navigating technical documents, substantial limitations exist, particularly in accurately extracting and applying detailed requirements to engineering designs. This benchmark sets a foundation for future advancements in AI-supported engineering design processes. DesignQA is publicly available at: https://github.com/anniedoris/design_qa/.


title: Controlling measurement induced phase transitions with tunable detector coupling

abstract: We study the evolution of a quantum many-body system driven by two competing measurements, which induces a topological entanglement transition between two distinct area law phases. We employ a positive operator-valued measurement with variable coupling between the system and detector within free Fermion dynamics. This approach allows us to continuously track the universal properties of the transition between projective and continuous monitoring. Our findings suggest that the percolation universality of the transition in the projective limit is unstable when the system-detector coupling is reduced.

categories: quant-ph cond-mat.mes-hall cond-mat.stat-mech cond-mat.str-el


title: Low-rank Adaptation for Spatio-Temporal Forecasting

abstract: Spatio-temporal forecasting is crucial in real-world dynamic systems, predicting future changes using historical data from diverse locations. Existing methods often prioritize the development of intricate neural networks to capture the complex dependencies of the data, yet their accuracy fails to show sustained improvement. Besides, these methods also overlook node heterogeneity, hindering customized prediction modules from handling diverse regional nodes effectively. In this paper, our goal is not to propose a new model but to present a novel low-rank adaptation framework as an off-the-shelf plugin for existing spatial-temporal prediction models, termed ST-LoRA, which alleviates the aforementioned problems through node-level adjustments. Specifically, we first tailor a node adaptive low-rank layer comprising multiple trainable low-rank matrices. Additionally, we devise a multi-layer residual fusion stacking module, injecting the low-rank adapters into predictor modules of various models. Across six real-world traffic datasets and six different types of spatio-temporal prediction models, our approach minimally increases the parameters and training time of the original models by less than 4%, still achieving consistent and sustained performance enhancement.


title: The effects of stellar feedback on molecular clumps in the Lagoon Nebula (M8)

abstract: The Lagoon Nebula (M8) is host to multiple regions with recent and ongoing massive star formation. With M8-Main and M8 East, two prominent regions of massive star formation have been studied in detail over the past years, while large parts of the nebula have received little attention. These largely unexplored regions comprise a large sample of molecular clumps that are affected by the presence of massive O- and B-type stars. We establish an inventory of species observed towards 37 known molecular clumps in M8 by conducting an unbiased line survey for each clump. For this, we used APEX and the IRAM 30m telescope for pointed on-off observations on the clumps. These observations cover bandwidths of 53GHz and 40GHz in frequency ranges from 210GHz to 280GHz and from 70GHz to 117GHz, respectively. Temperatures are derived from rotational transitions of CH3CN, CH3C2H and para-H2CO. Additional archival data from the Spitzer, Herschel, MSX, APEX, WISE, JCMT and AKARI telescopes are used to derive physical parameters of the dust emission by fitting spectral energy distributions to the observed flux densities. Across the observed M8 region, we identify 346 transitions from 70 different molecular species, including isotopologues. We detect tracers of photo-dissociation regions across all the clumps and 38% of these clumps show signs of star formation. We find that PDR tracers are most abundant in clumps with relatively lower H2 column densities. When comparing M8 clumps to ATLASGAL sources at similar distances, we find them to be slightly less massive and have compatible luminosities and radii. This possibly indicates a fragmentation of the gas caused by the O- and B-type stars. In contrast, dust temperatures of the clumps in M8 are found to be increased by approximately 5K (25%) indicating substantial external heating of the clumps by radiation of the present massive stars.


title: AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMs

abstract: As large language models (LLMs) become increasingly prevalent and integrated into autonomous systems, ensuring their safety is imperative. Despite significant strides toward safety alignment, recent work GCG~\citep{zou2023universal} proposes a discrete token optimization algorithm and selects the single suffix with the lowest loss to successfully jailbreak aligned LLMs. In this work, we first discuss the drawbacks of solely picking the suffix with the lowest loss during GCG optimization for jailbreaking and uncover the missed successful suffixes during the intermediate steps. Moreover, we utilize those successful suffixes as training data to learn a generative model, named AmpleGCG, which captures the distribution of adversarial suffixes given a harmful query and enables the rapid generation of hundreds of suffixes for any harmful queries in seconds. AmpleGCG achieves near 100\% attack success rate (ASR) on two aligned LLMs (Llama-2-7B-chat and Vicuna-7B), surpassing two strongest attack baselines. More interestingly, AmpleGCG also transfers seamlessly to attack different models, including closed-source LLMs, achieving a 99\% ASR on the latest GPT-3.5. To summarize, our work amplifies the impact of GCG by training a generative model of adversarial suffixes that is universal to any harmful queries and transferable from attacking open-source LLMs to closed-source LLMs. In addition, it can generate 200 adversarial suffixes for one harmful query in only 4 seconds, rendering it more challenging to defend.


title: LaVy: Vietnamese Multimodal Large Language Model

abstract: Large Language Models (LLMs) and Multimodal Large language models (MLLMs) have taken the world by storm with impressive abilities in complex reasoning and linguistic comprehension. Meanwhile there are plethora of works related to Vietnamese Large Language Models, the lack of high-quality resources in multimodality limits the progress of Vietnamese MLLMs. In this paper, we pioneer in address this by introducing LaVy, a state-of-the-art Vietnamese MLLM, and we also introduce LaVy-Bench benchmark designated for evaluating MLLMs's understanding on Vietnamese visual language tasks. Our project is public at https://github.com/baochi0212/LaVy


title: A Bayesian Estimator of Sample Size

abstract: We consider a Bayesian estimator of sample size (BESS) and an application to oncology dose optimization clinical trials. BESS is built upon three pillars, Sample size, Evidence from observed data, and Confidence in posterior inference. It uses a simple logic of "given the evidence from data, a specific sample size can achieve a degree of confidence in the posterior inference." The key distinction between BESS and standard sample size estimation (SSE) is that SSE, typically based on Frequentist inference, specifies the true parameters values in its calculation while BESS assumes possible outcome from the observed data. As a result, the calibration of the sample size is not based on type I or type II error rates, but on posterior probabilities. We demonstrate that BESS leads to a more interpretable statement for investigators, and can easily accommodates prior information as well as sample size re-estimation. We explore its performance in comparison to the standard SSE and demonstrate its usage through a case study of oncology optimization trial. BESS can be applied to general hypothesis tests. An R tool is available at https://ccte.uchicago.edu/BESS.


title: A Parsimonious Setup for Streamflow Forecasting using CNN-LSTM

abstract: Significant strides have been made in advancing streamflow predictions, notably with the introduction of cutting-edge machine-learning models. Predominantly, Long Short-Term Memories (LSTMs) and Convolution Neural Networks (CNNs) have been widely employed in this domain. While LSTMs are applicable in both rainfall-runoff and time series settings, CNN-LSTMs have primarily been utilized in rainfall-runoff scenarios. In this study, we extend the application of CNN-LSTMs to time series settings, leveraging lagged streamflow data in conjunction with precipitation and temperature data to predict streamflow. Our results show a substantial improvement in predictive performance in 21 out of 32 HUC8 basins in Nebraska, showcasing noteworthy increases in the Kling-Gupta Efficiency (KGE) values. These results highlight the effectiveness of CNN-LSTMs in time series settings, particularly for spatiotemporal hydrological modeling, for more accurate and robust streamflow predictions.


title: Non-perturbative quantum gravity denounces singular Black Holes

abstract: Although General Relativity predicts the presence of a singularity inside of a Black Hole, it is not a complete theory of gravity. A real structure of a Black Hole interior near an expected singularity depends on the UV completion of gravity. In this paper, we establish that the question whether singular spherically symmetric solutions are absent is governed by the functional form of a non-perturbative graviton propagator. We explicitly show in a framework of a ghost-free infinite derivative gravity that for the graviton propagator of an exponential form favored by the unitarity a singularity is not possible unless an unphysical situation when the total mass of the Black Hole is infinite is considered.


title: Leveraging Large Language Models (LLMs) to Support Collaborative Human-AI Online Risk Data Annotation

abstract: In this position paper, we discuss the potential for leveraging LLMs as interactive research tools to facilitate collaboration between human coders and AI to effectively annotate online risk data at scale. Collaborative human-AI labeling is a promising approach to annotating large-scale and complex data for various tasks. Yet, tools and methods to support effective human-AI collaboration for data annotation are under-studied. This gap is pertinent because co-labeling tasks need to support a two-way interactive discussion that can add nuance and context, particularly in the context of online risk, which is highly subjective and contextualized. Therefore, we provide some of the early benefits and challenges of using LLMs-based tools for risk annotation and suggest future directions for the HCI research community to leverage LLMs as research tools to facilitate human-AI collaboration in contextualized online data annotation. Our research interests align very well with the purposes of the LLMs as Research Tools workshop to identify ongoing applications and challenges of using LLMs to work with data in HCI research. We anticipate learning valuable insights from organizers and participants into how LLMs can help reshape the HCI community's methods for working with data.


title: Robust elastic full-waveform inversion using an alternating direction method of multipliers with reconstructed wavefields

abstract: Elastic full-waveform inversion (EFWI) is a process used to estimate subsurface properties by fitting seismic data while satisfying wave propagation physics. The problem is formulated as a least-squares data fitting minimization problem with two sets of constraints: Partial-differential equation (PDE) constraints governing elastic wave propagation and physical model constraints implementing prior information. The alternating direction method of multipliers is used to solve the problem, resulting in an iterative algorithm with well-conditioned subproblems. Although wavefield reconstruction is the most challenging part of the iteration, sparse linear algebra techniques can be used for moderate-sized problems and frequency domain formulations. The Hessian matrix is blocky with diagonal blocks, making model updates fast. Gradient ascent is used to update Lagrange multipliers by summing PDE violations. Various numerical examples are used to investigate algorithmic components, including model parameterizations, physical model constraints, the role of the Hessian matrix in suppressing interparameter cross-talk, computational efficiency with the source sketching method, and the effect of noise and near-surface effects.


title: Orders of Magnitude Improved Cyclotron-Mode Cooling for Non-Destructive Spin Quantum Transition Spectroscopy with Single Trapped Antiprotons

abstract: We demonstrate efficient sub-thermal cooling of the modified cyclotron mode of a single trapped antiproton and reach particle temperatures $T_+=E_+/k_\text{B}$ below $200\,$mK in preparation times shorter than $500\,$s. This corresponds to the fastest resistive single-particle cyclotron cooling to sub-thermal temperatures ever demonstrated. By cooling trapped particles to such low energies, we demonstrate the detection of antiproton spin transitions with an error-rate $<0.000025$, more than three orders of magnitude better than in previous best experiments. This method will have enormous impact on multi-Penning-trap experiments that measure magnetic moments with single nuclear spins for tests of matter/antimatter symmetry, high-precision mass-spectrometry, and measurements of electron $g$-factors bound to highly-charged ions that test quantum electrodynamics.


title: The expected kinematic matter dipole is robust against source evolution

abstract: Recent measurements using catalogues of quasars and radio galaxies have shown that the dipole anisotropy in the large-scale distribution of matter is about twice as large as is expected in the standard $\Lambda$CDM model, indeed in any cosmology based on the Friedman-Lema\^itre-Robertson-Walker (FLRW) metric. This expectation is based on the kinematic interpretation of the dipole anisotropy of the cosmic microwave background, i.e. as arising due to our local peculiar velocity. The effect of aberration and Doppler boosting on the projected number counts on the sky of cosmologically distant objects in a flux-limited catalogue can then be calculated and confronted with observations. This fundamental consistency test of FLRW models proposed by Ellis & Baldwin (1984) was revisited by Dalang & Bonvin (2022) [arXiv:2111.03616] who argued that redshift evolution of the sources can significantly affect the expected matter dipole. In this note we demonstrate that the Ellis & Baldwin test is in fact robust to such effects, hence the > 5$\sigma$ dipole anomaly uncovered by Secrest et al. (2021, 2022) [arXiv:2009.14826, arXiv:2206.05624] remains an outstanding challenge to the $\Lambda$CDM model.


title: Parameter Hierarchical Optimization for Visible-Infrared Person Re-Identification

abstract: Visible-infrared person re-identification (VI-reID) aims at matching cross-modality pedestrian images captured by disjoint visible or infrared cameras. Existing methods alleviate the cross-modality discrepancies via designing different kinds of network architectures. Different from available methods, in this paper, we propose a novel parameter optimizing paradigm, parameter hierarchical optimization (PHO) method, for the task of VI-ReID. It allows part of parameters to be directly optimized without any training, which narrows the search space of parameters and makes the whole network more easier to be trained. Specifically, we first divide the parameters into different types, and then introduce a self-adaptive alignment strategy (SAS) to automatically align the visible and infrared images through transformation. Considering that features in different dimension have varying importance, we develop an auto-weighted alignment learning (AAL) module that can automatically weight features according to their importance. Importantly, in the alignment process of SAS and AAL, all the parameters are immediately optimized with optimization principles rather than training the whole network, which yields a better parameter training manner. Furthermore, we establish the cross-modality consistent learning (CCL) loss to extract discriminative person representations with translation consistency. We provide both theoretical justification and empirical evidence that our proposed PHO method outperform existing VI-reID approaches.


title: Representability of Elliptic Moduli Problems in Derived $C^{\infty}$-Geometry

abstract: We study moduli spaces of solutions of nonlinear Partial Differential Equations on manifolds in the framework of derived $C^{\infty}$-geometry. For an arbitrary smooth stack $S$, we define $S$-families of nonlinear PDEs acting between $S$-families of submersions over an $S$-family of manifolds and show that in case the family of PDEs is elliptic and the base family of manifolds is proper over $S$, then the moduli stack of solutions is relatively representable by quasi-smooth derived $C^{\infty}$-schemes over $S$. Along the way, we develop tools to analyse the local structure of families of mapping stacks between manifolds and explain how to compare mapping stacks in smooth and in derived geometry. To access the notion of a family of PDEs over an arbitrary smooth base stack, we introduce a formalism of stacks of relative jets. Finally, we show how natural ideas from (higher) topos theory can be leveraged to facilitate the application of nonlinear Fredholm analysis to derived stacks of solutions of elliptic PDEs.


title: FusionMamba: Efficient Image Fusion with State Space Model

abstract: Image fusion aims to generate a high-resolution multi/hyper-spectral image by combining a high-resolution image with limited spectral information and a low-resolution image with abundant spectral data. Current deep learning (DL)-based methods for image fusion primarily rely on CNNs or Transformers to extract features and merge different types of data. While CNNs are efficient, their receptive fields are limited, restricting their capacity to capture global context. Conversely, Transformers excel at learning global information but are hindered by their quadratic complexity. Fortunately, recent advancements in the State Space Model (SSM), particularly Mamba, offer a promising solution to this issue by enabling global awareness with linear complexity. However, there have been few attempts to explore the potential of the SSM in information fusion, which is a crucial ability in domains like image fusion. Therefore, we propose FusionMamba, an innovative method for efficient image fusion. Our contributions mainly focus on two aspects. Firstly, recognizing that images from different sources possess distinct properties, we incorporate Mamba blocks into two U-shaped networks, presenting a novel architecture that extracts spatial and spectral features in an efficient, independent, and hierarchical manner. Secondly, to effectively combine spatial and spectral information, we extend the Mamba block to accommodate dual inputs. This expansion leads to the creation of a new module called the FusionMamba block, which outperforms existing fusion techniques such as concatenation and cross-attention. We conduct a series of experiments on five datasets related to three image fusion tasks. The quantitative and qualitative evaluation results demonstrate that our method achieves SOTA performance, underscoring the superiority of FusionMamba. The code is available at https://github.com/PSRben/FusionMamba.


title: Boosting Self-Supervision for Single-View Scene Completion via Knowledge Distillation

abstract: Inferring scene geometry from images via Structure from Motion is a long-standing and fundamental problem in computer vision. While classical approaches and, more recently, depth map predictions only focus on the visible parts of a scene, the task of scene completion aims to reason about geometry even in occluded regions. With the popularity of neural radiance fields (NeRFs), implicit representations also became popular for scene completion by predicting so-called density fields. Unlike explicit approaches. e.g. voxel-based methods, density fields also allow for accurate depth prediction and novel-view synthesis via image-based rendering. In this work, we propose to fuse the scene reconstruction from multiple images and distill this knowledge into a more accurate single-view scene reconstruction. To this end, we propose Multi-View Behind the Scenes (MVBTS) to fuse density fields from multiple posed images, trained fully self-supervised only from image data. Using knowledge distillation, we use MVBTS to train a single-view scene completion network via direct supervision called KDBTS. It achieves state-of-the-art performance on occupancy prediction, especially in occluded regions.


title: Goal Recognition via Linear Programming

abstract: Goal Recognition is the task by which an observer aims to discern the goals that correspond to plans that comply with the perceived behavior of subject agents given as a sequence of observations. Research on Goal Recognition as Planning encompasses reasoning about the model of a planning task, the observations, and the goals using planning techniques, resulting in very efficient recognition approaches. In this article, we design novel recognition approaches that rely on the Operator-Counting framework, proposing new constraints, and analyze their constraints' properties both theoretically and empirically. The Operator-Counting framework is a technique that efficiently computes heuristic estimates of cost-to-goal using Integer/Linear Programming (IP/LP). In the realm of theory, we prove that the new constraints provide lower bounds on the cost of plans that comply with observations. We also provide an extensive empirical evaluation to assess how the new constraints improve the quality of the solution, and we found that they are especially informed in deciding which goals are unlikely to be part of the solution. Our novel recognition approaches have two pivotal advantages: first, they employ new IP/LP constraints for efficiently recognizing goals; second, we show how the new IP/LP constraints can improve the recognition of goals under both partial and noisy observability.


title: Compositional Growth Models

abstract: We review models of compositional growth, which were introduced to explain the growth statistics of various quantities ranging from firm sizes to GDP. In these models, entities are decomposed into units that grow independently. Thus, the growth rate of the entity is the addition of the growth rates of the composing units, with possibly heterogeneous weights. We review such models and show that they can be understood through a unifying theoretical framework, explaining the resulting growth rate distributions using mixtures of Gaussians.


title: Astrophysics and Nuclear Physics Informed Interactions in Dense Matter: Insights from PSR J0437-4715

abstract: We investigate how vector and isovector interactions can be determined within the density regime of neutron stars, while fulfilling nuclear and astrophysics constrains. We make use of the Chiral Mean Field (CMF) model, a SU(3) nonlinear realization of the sigma model within the mean-field approximation, for the first time within a Bayesian analysis framework. We show that neutron-matter $\chi$EFT constraints at low density are only satisfied if the vector-isovector mixed interaction term is included, e.g., a $\omega^2\rho^2$ term. We also show the behavior of the model with respect to the conformal limit. We demonstrate that the CMF model is able to predict a value for the parameter $d_c$ related to the trace anomaly and its derivative takes values below 0.2 above four times saturation density within a hadronic model that does not include a phase transition to deconfined matter. We compare these effects with results from other (non-chiral) Relativistic Mean Field models to assess how different approaches to incorporating the same physical constraints affect predictions of neutron-star properties and dense matter equations of state. We also include data from the gravitation wave event GW230529 detected by the LIGO-Virgo-Kagra collaboration and the most recent radius measurement of PSR J0437-4715 from the NASA NICER mission. Our analysis reveals that this new NICER measurement leads to an average reduction of approximately $\sim 0.15$ km radius in the posterior of the neutron-star mass-radius relationship.


title: Rate-Optimal Non-Asymptotics for the Quadratic Prediction Error Method

abstract: We study the quadratic prediction error method -- i.e., nonlinear least squares -- for a class of time-varying parametric predictor models satisfying a certain identifiability condition. While this method is known to asymptotically achieve the optimal rate for a wide range of problems, there have been no non-asymptotic results matching these optimal rates outside of a select few, typically linear, model classes. By leveraging modern tools from learning with dependent data, we provide the first rate-optimal non-asymptotic analysis of this method for our more general setting of nonlinearly parametrized model classes. Moreover, we show that our results can be applied to a particular class of identifiable AutoRegressive Moving Average (ARMA) models, resulting in the first optimal non-asymptotic rates for identification of ARMA models.

categories: math.ST cs.LG cs.SY eess.SY stat.ML stat.TH


title: Toward ultra-efficient high fidelity predictions of wind turbine wakes: Augmenting the accuracy of engineering models via LES-trained machine learning

abstract: This study proposes a novel machine learning (ML) methodology for the efficient and cost-effective prediction of high-fidelity three-dimensional velocity fields in the wake of utility-scale turbines. The model consists of an auto-encoder convolutional neural network with U-Net skipped connections, fine-tuned using high-fidelity data from large-eddy simulations (LES). The trained model takes the low-fidelity velocity field cost-effectively generated from the analytical engineering wake model as input and produces the high-fidelity velocity fields. The accuracy of the proposed ML model is demonstrated in a utility-scale wind farm for which datasets of wake flow fields were previously generated using LES under various wind speeds, wind directions, and yaw angles. Comparing the ML model results with those of LES, the ML model was shown to reduce the error in the prediction from 20% obtained from the GCH model to less than 5%. In addition, the ML model captured the non-symmetric wake deflection observed for opposing yaw angles for wake steering cases, demonstrating a greater accuracy than the GCH model. The computational cost of the ML model is on par with that of the analytical wake model while generating numerical outcomes nearly as accurate as those of the high-fidelity LES.


title: Distributed Record Linkage in Healthcare Data with Apache Spark

abstract: Healthcare data is a valuable resource for research, analysis, and decision-making in the medical field. However, healthcare data is often fragmented and distributed across various sources, making it challenging to combine and analyze effectively. Record linkage, also known as data matching, is a crucial step in integrating and cleaning healthcare data to ensure data quality and accuracy. Apache Spark, a powerful open-source distributed big data processing framework, provides a robust platform for performing record linkage tasks with the aid of its machine learning library. In this study, we developed a new distributed data-matching model based on the Apache Spark Machine Learning library. To ensure the correct functioning of our model, the validation phase has been performed on the training data. The main challenge is data imbalance because a large amount of data is labeled false, and a small number of records are labeled true. By utilizing SVM and Regression algorithms, our results demonstrate that research data was neither over-fitted nor under-fitted, and this shows that our distributed model works well on the data.


title: InfiBench: Evaluating the Question-Answering Capabilities of Code Large Language Models

abstract: Large Language Models for code (code LLMs) have witnessed tremendous progress in recent years. With the rapid development of code LLMs, many popular evaluation benchmarks, such as HumanEval, DS-1000, and MBPP, have emerged to measure the performance of code LLMs with a particular focus on code generation tasks. However, they are insufficient to cover the full range of expected capabilities of code LLMs, which span beyond code generation to answering diverse coding-related questions. To fill this gap, we propose InfiBench, the first large-scale freeform question-answering (QA) benchmark for code to our knowledge, comprising 234 carefully selected high-quality Stack Overflow questions that span across 15 programming languages. InfiBench uses four types of model-free automatic metrics to evaluate response correctness where domain experts carefully concretize the criterion for each question. We conduct a systematic evaluation for over 100 latest code LLMs on InfiBench, leading to a series of novel and insightful findings. Our detailed analyses showcase potential directions for further advancement of code LLMs. InfiBench is fully open source and continuously expanding to foster more scientific and systematic practices for code LLM evaluation.


title: SiGNN: A Spike-induced Graph Neural Network for Dynamic Graph Representation Learning

abstract: In the domain of dynamic graph representation learning (DGRL), the efficient and comprehensive capture of temporal evolution within real-world networks is crucial. Spiking Neural Networks (SNNs), known as their temporal dynamics and low-power characteristic, offer an efficient solution for temporal processing in DGRL task. However, owing to the spike-based information encoding mechanism of SNNs, existing DGRL methods employed SNNs face limitations in their representational capacity. Given this issue, we propose a novel framework named Spike-induced Graph Neural Network (SiGNN) for learning enhanced spatialtemporal representations on dynamic graphs. In detail, a harmonious integration of SNNs and GNNs is achieved through an innovative Temporal Activation (TA) mechanism. Benefiting from the TA mechanism, SiGNN not only effectively exploits the temporal dynamics of SNNs but also adeptly circumvents the representational constraints imposed by the binary nature of spikes. Furthermore, leveraging the inherent adaptability of SNNs, we explore an in-depth analysis of the evolutionary patterns within dynamic graphs across multiple time granularities. This approach facilitates the acquisition of a multiscale temporal node representation.Extensive experiments on various real-world dynamic graph datasets demonstrate the superior performance of SiGNN in the node classification task.


title: On Unified Prompt Tuning for Request Quality Assurance in Public Code Review

abstract: Public Code Review (PCR) can be implemented through a Software Question Answering (SQA) community, which facilitates high knowledge dissemination. Current methods mainly focus on the reviewer's perspective, including finding a capable reviewer, predicting comment quality, and recommending/generating review comments. Our intuition is that satisfying review necessity requests can increase their visibility, which in turn is a prerequisite for better review responses. To this end, we propose a unified framework called UniPCR to complete developer-based request quality assurance (i.e., predicting request necessity and recommending tags subtask) under a Masked Language Model (MLM). Specifically, we reformulate both subtasks via 1) text prompt tuning, which converts two subtasks into MLM by constructing prompt templates using hard prompt; 2) code prefix tuning, which optimizes a small segment of generated continuous vectors as the prefix of the code representation using soft prompt. Experimental results on the Public Code Review dataset for the time span 2011-2022 demonstrate that our UniPCR framework adapts to the two subtasks and outperforms comparable accuracy-based results with state-of-the-art methods for request quality assurance. These conclusions highlight the effectiveness of our unified framework from the developer's perspective in public code review.


title: HomoGenius: a Foundation Model of Homogenization for Rapid Prediction of Effective Mechanical Properties using Neural Operators

abstract: Homogenization is an essential tool for studying multiscale physical phenomena. However, traditional numerical homogenization, heavily reliant on finite element analysis, requires extensive computation costs, particularly in handling complex geometries, materials, and high-resolution problems. To address these limitations, we propose a numerical homogenization model based on operator learning: HomoGenius. The proposed model can quickly provide homogenization results for arbitrary geometries, materials, and resolutions, increasing the efficiency by a factor of 80 compared to traditional numerical homogenization methods. We validate effectiveness of our model in predicting the effective elastic modulus on periodic materials (TPMS: Triply Periodic Minimal Surface), including complex geometries, various Poisson's ratios and elastic modulus, and different resolutions for training and testing. The results show that our model possesses high precision, super efficiency, and learning capability.


title: On the Durdevic approach to quantum principal bundles

abstract: We revisit and extend the Durdevic theory of complete calculi on quantum principal bundles. In this setting one naturally obtains a graded Hopf-Galois extension of the higher order calculus and an intrinsic decomposition of degree 1-forms into horizontal and vertical forms. This proposal is appealing, since it is consistently equipped with a canonical braiding and exactness of the Atiyah sequence is guaranteed. Moreover, we provide examples of complete calculi, including the noncommutative 2-torus, the quantum Hopf fibration and differential calculi on crossed product algebras.


title: Existence of Optimal Stationary Singular Controls and Mean Field Game Equilibria

abstract: In this paper, we examine the stationary relaxed singular control problem within a multi-dimensional framework for a single agent, as well as its Mean Field Game (MFG) equivalent. We demonstrate that optimal relaxed controls exist for both maximization and minimization cases. These relaxed controls are defined by random measures across the state and control spaces, with the state process described as a solution to the associated martingale problem. By leveraging findings from [Kurtz-Stockbridge 2001], we establish the equivalence between the martingale problem and the stationary forward equation. This allows us to reformulate the relaxed control problem into a linear programming problem within the measure space. We prove the sequential compactness of these measures, thereby confirming the feasibility of achieving an optimal solution. Subsequently, our focus shifts to Mean Field Games. Drawing on insights from the single-agent problem and employing Kakutani--Glicksberg--Fan fixed point theorem, we derive the existence of a mean field game equilibria.


title: Towards Faster Training of Diffusion Models: An Inspiration of A Consistency Phenomenon

abstract: Diffusion models (DMs) are a powerful generative framework that have attracted significant attention in recent years. However, the high computational cost of training DMs limits their practical applications. In this paper, we start with a consistency phenomenon of DMs: we observe that DMs with different initializations or even different architectures can produce very similar outputs given the same noise inputs, which is rare in other generative models. We attribute this phenomenon to two factors: (1) the learning difficulty of DMs is lower when the noise-prediction diffusion model approaches the upper bound of the timestep (the input becomes pure noise), where the structural information of the output is usually generated; and (2) the loss landscape of DMs is highly smooth, which implies that the model tends to converge to similar local minima and exhibit similar behavior patterns. This finding not only reveals the stability of DMs, but also inspires us to devise two strategies to accelerate the training of DMs. First, we propose a curriculum learning based timestep schedule, which leverages the noise rate as an explicit indicator of the learning difficulty and gradually reduces the training frequency of easier timesteps, thus improving the training efficiency. Second, we propose a momentum decay strategy, which reduces the momentum coefficient during the optimization process, as the large momentum may hinder the convergence speed and cause oscillations due to the smoothness of the loss landscape. We demonstrate the effectiveness of our proposed strategies on various models and show that they can significantly reduce the training time and improve the quality of the generated images.


title: ExeGPT: Constraint-Aware Resource Scheduling for LLM Inference

abstract: This paper presents ExeGPT, a distributed system designed for constraint-aware LLM inference. ExeGPT finds and runs with an optimal execution schedule to maximize inference throughput while satisfying a given latency constraint. By leveraging the distribution of input and output sequences, it effectively allocates resources and determines optimal execution configurations, including batch sizes and partial tensor parallelism. We also introduce two scheduling strategies based on Round-Robin Allocation and Workload-Aware Allocation policies, suitable for different NLP workloads. We evaluate ExeGPT on six LLM instances of T5, OPT, and GPT-3 and five NLP tasks, each with four distinct latency constraints. Compared to FasterTransformer, ExeGPT achieves up to 15.2x improvements in throughput and 6x improvements in latency. Overall, ExeGPT achieves an average throughput gain of 2.9x across twenty evaluation scenarios. Moreover, when adapting to changing sequence distributions, the cost of adjusting the schedule in ExeGPT is reasonably modest. ExeGPT proves to be an effective solution for optimizing and executing LLM inference for diverse NLP workload and serving conditions.


title: Usability and Performance Analysis of Embedded Development Environment for On-device Learning

abstract: This research empirically examines embedded development tools viable for on-device TinyML implementation. The research evaluates various development tools with various abstraction levels on resource-constrained IoT devices, from basic hardware manipulation to deployment of minimalistic ML training. The analysis encompasses memory usage, energy consumption, and performance metrics during model training and inference and usability of the different solutions. Arduino Framework offers ease of implementation but with increased energy consumption compared to the native option, while RIOT OS exhibits efficient energy consumption despite higher memory utilization with equivalent ease of use. The absence of certain critical functionalities like DVFS directly integrated into the OS highlights limitations for fine hardware control.


title: Taming Stable Diffusion for Text to 360{\deg} Panorama Image Generation

abstract: Generative models, e.g., Stable Diffusion, have enabled the creation of photorealistic images from text prompts. Yet, the generation of 360-degree panorama images from text remains a challenge, particularly due to the dearth of paired text-panorama data and the domain gap between panorama and perspective images. In this paper, we introduce a novel dual-branch diffusion model named PanFusion to generate a 360-degree image from a text prompt. We leverage the stable diffusion model as one branch to provide prior knowledge in natural image generation and register it to another panorama branch for holistic image generation. We propose a unique cross-attention mechanism with projection awareness to minimize distortion during the collaborative denoising process. Our experiments validate that PanFusion surpasses existing methods and, thanks to its dual-branch structure, can integrate additional constraints like room layout for customized panorama outputs. Code is available at https://chengzhag.github.io/publication/panfusion.


title: Reinforcement Learning with Generalizable Gaussian Splatting

abstract: An excellent representation is crucial for reinforcement learning (RL) performance, especially in vision-based reinforcement learning tasks. The quality of the environment representation directly influences the achievement of the learning task. Previous vision-based RL typically uses explicit or implicit ways to represent environments, such as images, points, voxels, and neural radiance fields. However, these representations contain several drawbacks. They cannot either describe complex local geometries or generalize well to unseen scenes, or require precise foreground masks. Moreover, these implicit neural representations are akin to a ``black box", significantly hindering interpretability. 3D Gaussian Splatting (3DGS), with its explicit scene representation and differentiable rendering nature, is considered a revolutionary change for reconstruction and representation methods. In this paper, we propose a novel Generalizable Gaussian Splatting framework to be the representation of RL tasks, called GSRL. Through validation in the RoboMimic environment, our method achieves better results than other baselines in multiple tasks, improving the performance by 10%, 44%, and 15% compared with baselines on the hardest task. This work is the first attempt to leverage generalizable 3DGS as a representation for RL.


title: Visualization for physics analysis improvement and applications in BESIII

abstract: Modern particle physics experiments usually rely on highly complex and large-scale spectrometer devices. In high energy physics experiments, visualization helps detector design, data quality monitoring, offline data processing, and has great potential for improving physics analysis. In addition to the traditional physics data analysis based on statistical methods, visualization provides unique intuitive advantages in searching for rare signal events and reducing background noises. By applying the event display tool to several physics analyses in the BESIII experiment, we demonstrate that visualization can benefit potential physics discovery and improve the signal significance. With the development of modern visualization techniques, it is expected to play a more important role in future data processing and physics analysis of particle physics experiments.


title: Deep learning-based auto-segmentation of paraganglioma for growth monitoring

abstract: Volume measurement of a paraganglioma (a rare neuroendocrine tumor that typically forms along major blood vessels and nerve pathways in the head and neck region) is crucial for monitoring and modeling tumor growth in the long term. However, in clinical practice, using available tools to do these measurements is time-consuming and suffers from tumor-shape assumptions and observer-to-observer variation. Growth modeling could play a significant role in solving a decades-old dilemma (stemming from uncertainty regarding how the tumor will develop over time). By giving paraganglioma patients treatment, severe symptoms can be prevented. However, treating patients who do not actually need it, comes at the cost of unnecessary possible side effects and complications. Improved measurement techniques could enable growth model studies with a large amount of tumor volume data, possibly giving valuable insights into how these tumors develop over time. Therefore, we propose an automated tumor volume measurement method based on a deep learning segmentation model using no-new-UNnet (nnUNet). We assess the performance of the model based on visual inspection by a senior otorhinolaryngologist and several quantitative metrics by comparing model outputs with manual delineations, including a comparison with variation in manual delineation by multiple observers. Our findings indicate that the automatic method performs (at least) equal to manual delineation. Finally, using the created model, and a linking procedure that we propose to track the tumor over time, we show how additional volume measurements affect the fit of known growth functions.


title: Floer Homology with DG Coefficients. Applications to cotangent bundles

abstract: We define Hamiltonian Floer homology with differential graded (DG) local coefficients for symplectically aspherical manifolds. The differential of the underlying complex involves chain representatives of the fundamental classes of the moduli spaces of Floer trajectories of arbitrary dimension. This setup allows in particular to define and compute Floer homology with coefficients in chains on fibers of fibrations over the free loop space of the underlying symplectic manifold. We develop the DG Floer toolset, including continuation maps and homotopies, and we also define and study symplectic homology groups with DG local coefficients. We define spectral invariants and establish general criteria for almost existence of contractible periodic orbits on regular energy levels of Hamiltonian systems inside Liouville domains. In the case of cotangent bundles, we prove a Viterbo isomorphism theorem with DG local coefficients. This serves as a stepping stone for applications to the almost existence of contractible closed characteristics on closed smooth hypersurfaces. In this context, our methods allow to access for the first time the dichotomy between closed manifolds that are aspherical and those that are not.


title: An efficient domain-independent approach for supervised keyphrase extraction and ranking

abstract: We present a supervised learning approach for automatic extraction of keyphrases from single documents. Our solution uses simple to compute statistical and positional features of candidate phrases and does not rely on any external knowledge base or on pre-trained language models or word embeddings. The ranking component of our proposed solution is a fairly lightweight ensemble model. Evaluation on benchmark datasets shows that our approach achieves significantly higher accuracy than several state-of-the-art baseline models, including all deep learning-based unsupervised models compared with, and is competitive with some supervised deep learning-based models too. Despite the supervised nature of our solution, the fact that does not rely on any corpus of "golden" keywords or any external knowledge corpus means that our solution bears the advantages of unsupervised solutions to a fair extent.


title: Triple Component Matrix Factorization: Untangling Global, Local, and Noisy Components

abstract: In this work, we study the problem of common and unique feature extraction from noisy data. When we have N observation matrices from N different and associated sources corrupted by sparse and potentially gross noise, can we recover the common and unique components from these noisy observations? This is a challenging task as the number of parameters to estimate is approximately thrice the number of observations. Despite the difficulty, we propose an intuitive alternating minimization algorithm called triple component matrix factorization (TCMF) to recover the three components exactly. TCMF is distinguished from existing works in literature thanks to two salient features. First, TCMF is a principled method to separate the three components given noisy observations provably. Second, the bulk of the computation in TCMF can be distributed. On the technical side, we formulate the problem as a constrained nonconvex nonsmooth optimization problem. Despite the intricate nature of the problem, we provide a Taylor series characterization of its solution by solving the corresponding Karush-Kuhn-Tucker conditions. Using this characterization, we can show that the alternating minimization algorithm makes significant progress at each iteration and converges into the ground truth at a linear rate. Numerical experiments in video segmentation and anomaly detection highlight the superior feature extraction abilities of TCMF.


title: Lyapunov-stable Neural Control for State and Output Feedback: A Novel Formulation

abstract: Learning-based neural network (NN) control policies have shown impressive empirical performance in a wide range of tasks in robotics and control. However, formal (Lyapunov) stability guarantees over the region-of-attraction (ROA) for NN controllers with nonlinear dynamical systems are challenging to obtain, and most existing approaches rely on expensive solvers such as sums-of-squares (SOS), mixed-integer programming (MIP), or satisfiability modulo theories (SMT). In this paper, we demonstrate a new framework for learning NN controllers together with Lyapunov certificates using fast empirical falsification and strategic regularizations. We propose a novel formulation that defines a larger verifiable region-of-attraction (ROA) than shown in the literature, and refines the conventional restrictive constraints on Lyapunov derivatives to focus only on certifiable ROAs. The Lyapunov condition is rigorously verified post-hoc using branch-and-bound with scalable linear bound propagation-based NN verification techniques. The approach is efficient and flexible, and the full training and verification procedure is accelerated on GPUs without relying on expensive solvers for SOS, MIP, nor SMT. The flexibility and efficiency of our framework allow us to demonstrate Lyapunov-stable output feedback control with synthesized NN-based controllers and NN-based observers with formal stability guarantees, for the first time in literature. Source code at https://github.com/Verified-Intelligence/Lyapunov_Stable_NN_Controllers


title: Curvature and Weitzenbock formula for spectral triples

abstract: Using the Levi-Civita connection on the noncommutative differential one-forms of a spectral triple $(\B,\H,\D)$, we define the full Riemann curvature tensor, the Ricci curvature tensor and scalar curvature. We give a definition of Dirac spectral triples and derive a general Weitzenbock formula for them. We apply these tools to $\theta$-deformations of compact Riemannian manifolds. We show that the Riemann and Ricci tensors transform naturally under $\theta$-deformation, whereas the connection Laplacian, Clifford representation of the curvature and the scalar curvature are all invariant under deformation.


title: Results on pattern avoidance in parking functions

abstract: In this paper, we mainly study two notions of pattern avoidance in parking functions. First, for any collection of length 3 patterns, we compute the number of parking functions of size $n$ that avoid them under the first notion. This is motivated by recent work of Adeniran and Pudwell, who obtained analogous results using a second notion of pattern avoidance. Then, we provide new purely bijective proofs for two of their results, and improve the formula of another one. Finally, we apply similar enumeration techniques to the work of Novelli and Thibon on certain Hopf algebras of generalised parking functions, and compute their graded dimensions.


title: Damage identification of offshore jacket platforms in a digital twin framework considering optimal sensor placement

abstract: A new digital twin (DT) framework with optimal sensor placement (OSP) is proposed to accurately calculate the modal responses and identify the damage ratios of the offshore jacket platforms. The proposed damage identification framework consists of two models (namely one OSP model and one damage identification model). The OSP model adopts the multi-objective Lichtenberg algorithm (MOLA) to perform the sensor number/location optimization to make a good balance between the sensor cost and the modal calculation accuracy. In the damage identification model, the Markov Chain Monte Carlo (MCMC)-Bayesian method is developed to calculate the structural damage ratios based on the modal information obtained from the sensory measurements, where the uncertainties of the structural parameters are quantified. The proposed method is validated using an offshore jacket platform, and the analysis results demonstrate efficient identification of the structural damage location and severity.


title: Content Knowledge Identification with Multi-Agent Large Language Models (LLMs)

abstract: Teachers' mathematical content knowledge (CK) is of vital importance and need in teacher professional development (PD) programs. Computer-aided asynchronous PD systems are the most recent proposed PD techniques, which aim to help teachers improve their PD equally with fewer concerns about costs and limitations of time or location. However, current automatic CK identification methods, which serve as one of the core techniques of asynchronous PD systems, face challenges such as diversity of user responses, scarcity of high-quality annotated data, and low interpretability of the predictions. To tackle these challenges, we propose a Multi-Agent LLMs-based framework, LLMAgent-CK, to assess the user responses' coverage of identified CK learning goals without human annotations. By taking advantage of multi-agent LLMs in strong generalization ability and human-like discussions, our proposed LLMAgent-CK presents promising CK identifying performance on a real-world mathematical CK dataset MaCKT. Moreover, our case studies further demonstrate the working of the multi-agent framework.


title: Overcoming the chemical complexity bottleneck in on-the-fly machine learned molecular dynamics simulations

abstract: We develop a framework for on-the-fly machine learned force field molecular dynamics simulations based on the multipole featurization scheme that overcomes the bottleneck with the number of chemical elements. Considering bulk systems with up to 6 elements, we demonstrate that the number of density functional theory calls remains approximately independent of the number of chemical elements, in contrast to the increase in the smooth overlap of atomic positions scheme.


title: Live and Learn: Continual Action Clustering with Incremental Views

abstract: Multi-view action clustering leverages the complementary information from different camera views to enhance the clustering performance. Although existing approaches have achieved significant progress, they assume all camera views are available in advance, which is impractical when the camera view is incremental over time. Besides, learning the invariant information among multiple camera views is still a challenging issue, especially in continual learning scenario. Aiming at these problems, we propose a novel continual action clustering (CAC) method, which is capable of learning action categories in a continual learning manner. To be specific, we first devise a category memory library, which captures and stores the learned categories from historical views. Then, as a new camera view arrives, we only need to maintain a consensus partition matrix, which can be updated by leveraging the incoming new camera view rather than keeping all of them. Finally, a three-step alternate optimization is proposed, in which the category memory library and consensus partition matrix are optimized. The empirical experimental results on 6 realistic multi-view action collections demonstrate the excellent clustering performance and time/space efficiency of the CAC compared with 15 state-of-the-art baselines.


title: EduAgent: Generative Student Agents in Learning

abstract: Student simulation in online education is important to address dynamic learning behaviors of students with diverse backgrounds. Existing simulation models based on deep learning usually need massive training data, lacking prior knowledge in educational contexts. Large language models (LLMs) may contain such prior knowledge since they are pre-trained from a large corpus. However, because student behaviors are dynamic and multifaceted with individual differences, directly prompting LLMs is not robust nor accurate enough to capture fine-grained interactions among diverse student personas, learning behaviors, and learning outcomes. This work tackles this problem by presenting a newly annotated fine-grained large-scale dataset and proposing EduAgent, a novel generative agent framework incorporating cognitive prior knowledge (i.e., theoretical findings revealed in cognitive science) to guide LLMs to first reason correlations among various behaviors and then make simulations. Our two experiments show that EduAgent could not only mimic and predict learning behaviors of real students but also generate realistic learning behaviors of virtual students without real data.


title: Magnetostatic bounds on stability of hopfions in bulk helimagnets

abstract: Magnetic hopfions are three-dimensional localized topological solitons in the volume of a magnet. In this work, starting with a classical free energy density of a helimagnet, an approximate variational model of hopfions is studied. The hopfion stability regions on the uniaxial anisotropy-external magnetic field phase diagram are computed and their evolution with increasing magnetostatic interaction strength is considered. It is found that magnetostatic interaction destabilizes the hopfions and, above the certain strength (relative to Dzyaloshinskii-Moriya interaction), destroys their stability completely. Numerical estimates for this bound are provided. They can help focus the search for materials, supporting bulk magnetic hopfions.


title: Rho-1: Not All Tokens Are What You Need

abstract: Previous language model pre-training methods have uniformly applied a next-token prediction loss to all training tokens. Challenging this norm, we posit that ''Not all tokens in a corpus are equally important for language model training''. Our initial analysis examines token-level training dynamics of language model, revealing distinct loss patterns for different tokens. Leveraging these insights, we introduce a new language model called Rho-1. Unlike traditional LMs that learn to predict every next token in a corpus, Rho-1 employs Selective Language Modeling (SLM), which selectively trains on useful tokens that aligned with the desired distribution. This approach involves scoring pretraining tokens using a reference model, and then training the language model with a focused loss on tokens with higher scores. When continual pretraining on 15B OpenWebMath corpus, Rho-1 yields an absolute improvement in few-shot accuracy of up to 30% in 9 math tasks. After fine-tuning, Rho-1-1B and 7B achieved state-of-the-art results of 40.6% and 51.8% on MATH dataset, respectively - matching DeepSeekMath with only 3% of the pretraining tokens. Furthermore, when pretraining on 80B general tokens, Rho-1 achieves 6.8% average enhancement across 15 diverse tasks, increasing both efficiency and performance of the language model pre-training.


title: Machine Learning-based Approach for Ex-post Assessment of Community Risk and Resilience Based on Coupled Human-infrastructure Systems Performance

abstract: There is a limitation in the literature of data-driven analyses for the ex-post evaluation of community risk and resilience, particularly using features related to the performance of coupled human-infrastructure systems. To address this gap, in this study we created a machine learning-based method for the ex-post assessment of community risk and resilience and their interplay based on features related to the coupled human-infrastructure systems performance. Utilizing feature groups related to population protective actions, infrastructure/building performance features, and recovery features, we examined the risk and resilience performance of communities in the context of the 2017 Hurricane Harvey in Harris County, Texas. These features related to the coupled human-infrastructure systems performance were processed using the K-means clustering method to classify census block groups into four distinct clusters then, based on feature analysis, these clusters were labeled and designated into four quadrants of risk-resilience archetypes. Finally, we analyzed the disparities in risk-resilience status of spatial areas across different clusters as well as different income groups. The findings unveil the risk-resilience status of spatial areas shaped by their coupled human-infrastructure systems performance and their interactions. The results also inform about features that contribute to high resilience in high-risk areas. For example, the results indicate that in high-risk areas, evacuation rates contributed to a greater resilience, while in low-risk areas, preparedness contributed to greater resilience.


title: Spin-Energy Entanglement of a Time-Focused Neutron

abstract: Intra-particle entanglement of individual particles such as neutrons could enable a new class of scattering probes that are sensitive to entanglement in quantum systems and materials. In this work, we present experimental results demonstrating quantum contextuality as a result of entanglement between the spin and energy modes (i.e., degrees of freedom) of single neutrons in a beam using a pair of resonant radio-frequency neutron spin flippers in the MIEZE configuration (Modulated IntEnsity with Zero Effort). We verified the mode-entanglement by measuring a Clauser-Horne-Shimony-Holt (CHSH) contextuality witness $S$ defined in the spin and energy subsystems, observing a clear breach of the classical bound of $|S| \leq 2$, obtaining $S = 2.40 \pm 0.02$. These entangled beams could enable novel approaches for directly probing dynamics and entanglement in quantum materials whose low-energy excitation scales match those of the incident entangled neutron.

categories: quant-ph cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el physics.ins-det


title: AD-NEv++ : The multi-architecture neuroevolution-based multivariate anomaly detection framework

abstract: Anomaly detection tools and methods enable key analytical capabilities in modern cyberphysical and sensor-based systems. Despite the fast-paced development in deep learning architectures for anomaly detection, model optimization for a given dataset is a cumbersome and time-consuming process. Neuroevolution could be an effective and efficient solution to this problem, as a fully automated search method for learning optimal neural networks, supporting both gradient and non-gradient fine tuning. However, existing frameworks incorporating neuroevolution lack of support for new layers and architectures and are typically limited to convolutional and LSTM layers. In this paper we propose AD-NEv++, a three-stage neuroevolution-based method that synergically combines subspace evolution, model evolution, and fine-tuning. Our method overcomes the limitations of existing approaches by optimizing the mutation operator in the neuroevolution process, while supporting a wide spectrum of neural layers, including attention, dense, and graph convolutional layers. Our extensive experimental evaluation was conducted with widely adopted multivariate anomaly detection benchmark datasets, and showed that the models generated by AD-NEv++ outperform well-known deep learning architectures and neuroevolution-based approaches for anomaly detection. Moreover, results show that AD-NEv++ can improve and outperform the state-of-the-art GNN (Graph Neural Networks) model architecture in all anomaly detection benchmarks.


title: An End-to-End Structure with Novel Position Mechanism and Improved EMD for Stock Forecasting

abstract: As a branch of time series forecasting, stock movement forecasting is one of the challenging problems for investors and researchers. Since Transformer was introduced to analyze financial data, many researchers have dedicated themselves to forecasting stock movement using Transformer or attention mechanisms. However, existing research mostly focuses on individual stock information but ignores stock market information and high noise in stock data. In this paper, we propose a novel method using the attention mechanism in which both stock market information and individual stock information are considered. Meanwhile, we propose a novel EMD-based algorithm for reducing short-term noise in stock data. Two randomly selected exchange-traded funds (ETFs) spanning over ten years from US stock markets are used to demonstrate the superior performance of the proposed attention-based method. The experimental analysis demonstrates that the proposed attention-based method significantly outperforms other state-of-the-art baselines. Code is available at https://github.com/DurandalLee/ACEFormer.


title: Differentiable All-pole Filters for Time-varying Audio Systems

abstract: Infinite impulse response filters are an essential building block of many time-varying audio systems, such as audio effects and synthesisers. However, their recursive structure impedes end-to-end training of these systems using automatic differentiation. Although non-recursive filter approximations like frequency sampling and frame-based processing have been proposed and widely used in previous works, they cannot accurately reflect the gradient of the original system. We alleviate this difficulty by re-expressing a time-varying all-pole filter to backpropagate the gradients through itself, so the filter implementation is not bound to the technical limitations of automatic differentiation frameworks. This implementation can be employed within audio systems containing filters with poles for efficient gradient evaluation. We demonstrate its training efficiency and expressive capabilities for modelling real-world dynamic audio systems on a phaser, time-varying subtractive synthesiser, and feed-forward compressor. We make our code and audio samples available and provide the trained audio effect and synth models in a VST plugin at https://diffapf.github.io/web/.


title: The Newman algorithm for constructing polynomials with restricted coefficients and many real roots

abstract: Under certain natural sufficient conditions on the sequence of uniformly bounded closed sets $E_k\subset\mathbb{R}$ of admissible coefficients, we construct a polynomial $P_n(x)=1+\sum_{k=1}^n\varepsilon_k x^k$, $\varepsilon_k\in E_k$, with at least $c\sqrt{n}$ distinct roots in $[0,1]$, which matches the classical upper bound up to the value of the constant $c>0$. Our sufficient conditions cover the Littlewood ($E_k=\{-1,1\}$) and Newman ($E_k=\{0,(-1)^k\}$) polynomials and are also necessary for the existence of such polynomials with arbitrarily many roots in the case when the sequence $E_k$ is periodic.


title: OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

abstract: Autonomous agents that accomplish complex computer tasks with minimal human interventions have the potential to transform human-computer interaction, significantly enhancing accessibility and productivity. However, existing benchmarks either lack an interactive environment or are limited to environments specific to certain applications or domains, failing to reflect the diverse and complex nature of real-world computer use, thereby limiting the scope of tasks and agent scalability. To address this issue, we introduce OSWorld, the first-of-its-kind scalable, real computer environment for multimodal agents, supporting task setup, execution-based evaluation, and interactive learning across various operating systems such as Ubuntu, Windows, and macOS. OSWorld can serve as a unified, integrated computer environment for assessing open-ended computer tasks that involve arbitrary applications. Building upon OSWorld, we create a benchmark of 369 computer tasks involving real web and desktop apps in open domains, OS file I/O, and workflows spanning multiple applications. Each task example is derived from real-world computer use cases and includes a detailed initial state setup configuration and a custom execution-based evaluation script for reliable, reproducible evaluation. Extensive evaluation of state-of-the-art LLM/VLM-based agents on OSWorld reveals significant deficiencies in their ability to serve as computer assistants. While humans can accomplish over 72.36% of the tasks, the best model achieves only 12.24% success, primarily struggling with GUI grounding and operational knowledge. Comprehensive analysis using OSWorld provides valuable insights for developing multimodal generalist agents that were not possible with previous benchmarks. Our code, environment, baseline models, and data are publicly available at https://os-world.github.io.


title: Ferret-v2: An Improved Baseline for Referring and Grounding with Large Language Models

abstract: While Ferret seamlessly integrates regional understanding into the Large Language Model (LLM) to facilitate its referring and grounding capability, it poses certain limitations: constrained by the pre-trained fixed visual encoder and failed to perform well on broader tasks. In this work, we unveil Ferret-v2, a significant upgrade to Ferret, with three key designs. (1) Any resolution grounding and referring: A flexible approach that effortlessly handles higher image resolution, improving the model's ability to process and understand images in greater detail. (2) Multi-granularity visual encoding: By integrating the additional DINOv2 encoder, the model learns better and diverse underlying contexts for global and fine-grained visual information. (3) A three-stage training paradigm: Besides image-caption alignment, an additional stage is proposed for high-resolution dense alignment before the final instruction tuning. Experiments show that Ferret-v2 provides substantial improvements over Ferret and other state-of-the-art methods, thanks to its high-resolution scaling and fine-grained visual processing.


title: A Lightweight Protocol for Matchgate Fidelity Estimation

abstract: We present a low-depth randomised algorithm for the estimation of entanglement fidelity between an $n$-qubit matchgate circuit $\mathcal{U}$ and its noisy implementation $\mathcal{E}$. Our procedure makes use of a modified Pauli-Liouville representation of quantum channels, with Clifford algebra elements as a basis. We show that this choice of representation leads to a block-diagonal compound matrix structure of matchgate superoperators which enables construction of efficient protocols for estimating the fidelity, achieving a $1/\sqrt{n}$ speedup over protocols of Flammia \& Liu [PRL 106, 230501]. Finally, we offer simple extensions of our protocol which (without additional overhead) benchmark matchgate circuits intertwined by Clifford circuits, and circuits composed of exclusively nearest-neighbour $XY(\theta)$ gates or Givens rotations - forming the first known method for direct benchmarking of matchgate subgroups.


title: Spectral Multifractality and Emergent Energyscales Across the Many-Body Localisation Transition

abstract: We present a scaling theory of the many-body localisation transition in terms of emergent, characteristic energyscales. The analysis is based on the decomposition of the eigenstates in the basis of trivially localised states, resolved in the energies of the latter, which we refer to as the spectral decomposition of the eigenstates. The characteristic energyscales emerge when the multifractal properties, or lack thereof, of the spectral decomposition are studied at different scales. These characteristic scales correspond to the ones, above which the spectral decompositions exhibit their global behaviour, namely full ergodicity in the ergodic phase and multifractality in the many-body localised phase. On the other hand, at scales below the characteristic ones, the decomposition in the ergodic phase shows finer (multi)fractal structures whereas in the localised phase, the decomposition picks out well-separated, localised resonant peaks. The scaling of these characteristic energyscales across the many-body localisation transition admits a scaling theory consistent with a Kosterlitz-Thouless type scenario and bears striking resemblances to that of inverse participation ratios of eigenstates.

categories: cond-mat.dis-nn cond-mat.quant-gas cond-mat.stat-mech quant-ph