title: TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generation

abstract: Video generation has many unique challenges beyond those of image generation. The temporal dimension introduces extensive possible variations across frames, over which consistency and continuity may be violated. In this study, we move beyond evaluating simple actions and argue that generated videos should incorporate the emergence of new concepts and their relation transitions like in real-world videos as time progresses. To assess the Temporal Compositionality of video generation models, we propose TC-Bench, a benchmark of meticulously crafted text prompts, corresponding ground truth videos, and robust evaluation metrics. The prompts articulate the initial and final states of scenes, effectively reducing ambiguities for frame development and simplifying the assessment of transition completion. In addition, by collecting aligned real-world videos corresponding to the prompts, we expand TC-Bench's applicability from text-conditional models to image-conditional ones that can perform generative frame interpolation. We also develop new metrics to measure the completeness of component transitions in generated videos, which demonstrate significantly higher correlations with human judgments than existing metrics. Our comprehensive experimental results reveal that most video generators achieve less than 20% of the compositional changes, highlighting enormous space for future improvement. Our analysis indicates that current video generation models struggle to interpret descriptions of compositional changes and synthesize various components across different time steps.


title: Mistral-C2F: Coarse to Fine Actor for Analytical and Reasoning Enhancement in RLHF and Effective-Merged LLMs

abstract: Despite the advances in Large Language Models (LLMs), exemplified by models like GPT-4 and Claude, smaller-scale LLMs such as Llama and Mistral often struggle with generating in-depth and coherent dialogues. This paper presents a novel two-step Coarse-to-Fine Actor model to address the inherent limitations in conversational and analytical capabilities of small-sized LLMs. Our approach begins with the Policy-based Coarse Actor, employing a technique we term "Continuous Maximization". The Coarse Actor establishes an enhanced, knowledge-rich pool adept at aligning with human preference styles in analysis and reasoning. Through the RLHF process, it employs Continuous Maximization, a strategy that dynamically and adaptively extends the output length limit, enabling the generation of more detailed and analytical content. Subsequently, the Fine Actor refines this analytical content, addressing the generation of excessively redundant information from the Coarse Actor. We introduce a "Knowledge Residue Merger" approach, refining the content from the Coarse Actor and merging it with an existing Instruction model to improve quality, correctness, and reduce redundancies. We applied our methodology to the popular Mistral model, creating Mistral-C2F, which has demonstrated exceptional performance across 11 general language tasks and the MT-Bench Dialogue task, outperforming similar-scale models and even larger models with 13B and 30B parameters. Our model has significantly improved conversational and analytical reasoning abilities.


title: Pruning is Optimal for Learning Sparse Features in High-Dimensions

abstract: While it is commonly observed in practice that pruning networks to a certain level of sparsity can improve the quality of the features, a theoretical explanation of this phenomenon remains elusive. In this work, we investigate this by demonstrating that a broad class of statistical models can be optimally learned using pruned neural networks trained with gradient descent, in high-dimensions. We consider learning both single-index and multi-index models of the form $y = \sigma^*(\boldsymbol{V}^{\top} \boldsymbol{x}) + \epsilon$, where $\sigma^*$ is a degree-$p$ polynomial, and $\boldsymbol{V} \in \mathbbm{R}^{d \times r}$ with $r \ll d$, is the matrix containing relevant model directions. We assume that $\boldsymbol{V}$ satisfies a certain $\ell_q$-sparsity condition for matrices and show that pruning neural networks proportional to the sparsity level of $\boldsymbol{V}$ improves their sample complexity compared to unpruned networks. Furthermore, we establish Correlational Statistical Query (CSQ) lower bounds in this setting, which take the sparsity level of $\boldsymbol{V}$ into account. We show that if the sparsity level of $\boldsymbol{V}$ exceeds a certain threshold, training pruned networks with a gradient descent algorithm achieves the sample complexity suggested by the CSQ lower bound. In the same scenario, however, our results imply that basis-independent methods such as models trained via standard gradient descent initialized with rotationally invariant random weights can provably achieve only suboptimal sample complexity.


title: Vivid-ZOO: Multi-View Video Generation with Diffusion Model

abstract: While diffusion models have shown impressive performance in 2D image/video generation, diffusion-based Text-to-Multi-view-Video (T2MVid) generation remains underexplored. The new challenges posed by T2MVid generation lie in the lack of massive captioned multi-view videos and the complexity of modeling such multi-dimensional distribution. To this end, we propose a novel diffusion-based pipeline that generates high-quality multi-view videos centered around a dynamic 3D object from text. Specifically, we factor the T2MVid problem into viewpoint-space and time components. Such factorization allows us to combine and reuse layers of advanced pre-trained multi-view image and 2D video diffusion models to ensure multi-view consistency as well as temporal coherence for the generated multi-view videos, largely reducing the training cost. We further introduce alignment modules to align the latent spaces of layers from the pre-trained multi-view and the 2D video diffusion models, addressing the reused layers' incompatibility that arises from the domain gap between 2D and multi-view data. In support of this and future research, we further contribute a captioned multi-view video dataset. Experimental results demonstrate that our method generates high-quality multi-view videos, exhibiting vivid motions, temporal coherence, and multi-view consistency, given a variety of text prompts.


title: Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classification

abstract: Generative AI offers a simple, prompt-based alternative to fine-tuning smaller BERT-style LLMs for text classification tasks. This promises to eliminate the need for manually labeled training data and task-specific model training. However, it remains an open question whether tools like ChatGPT can deliver on this promise. In this paper, we show that smaller, fine-tuned LLMs (still) consistently and significantly outperform larger, zero-shot prompted models in text classification. We compare three major generative AI models (ChatGPT with GPT-3.5/GPT-4 and Claude Opus) with several fine-tuned LLMs across a diverse set of classification tasks (sentiment, approval/disapproval, emotions, party positions) and text categories (news, tweets, speeches). We find that fine-tuning with application-specific training data achieves superior performance in all cases. To make this approach more accessible to a broader audience, we provide an easy-to-use toolkit alongside this paper. Our toolkit, accompanied by non-technical step-by-step guidance, enables users to select and fine-tune BERT-like LLMs for any classification task with minimal technical and computational effort.


title: Towards minimal self-testing of qubit states and measurements in prepare-and-measure scenarios

abstract: Self-testing is a promising approach to certifying quantum states or measurements. Originally, it relied solely on the outcome statistics of the measurements involved in a device-independent (DI) setup. Extra physical assumptions about the system make the setup semi-DI. In the latter approach, we consider a prepare-and-measure scenario in which the dimension of the mediating particle is assumed to be two. In a setup involving four (three) preparations and three (two) projective measurements in addition to the target, we exemplify how to self-test any four- (three-) outcome extremal positive operator-valued measure using a linear witness. One of our constructions also achieves self-testing of any number of states with the help of as many projective measurements as the dimensionality of the space spanned by the corresponding Bloch vectors. These constructions are conjectured to be minimal in terms of the number of preparations and measurements required. In addition, we implement one of our prepare-and-measure constructions on IBM and IonQ quantum processors and certify the existence of a complex qubit Hilbert space based on the data obtained from these experiments.


title: On Fox's trapezoidal conjecture

abstract: We investigate Fox's trapezoidal conjecture for alternating links. We show that it holds for diagrammatic Murasugi sums of special alternating links, where all sums involved have length less than three (which includes diagrammatic plumbing). It also holds for links containing a large twist region, which we call twist-concentrated. Furthermore, we show some weaker inequalities between consecutive coefficients of the Alexander polynomial of an alternating 3-braid closure, and extend this to arbitrary alternating links. We then study an extension of the trapezoidal conjecture due to Hirasawa and Murasugi, which states that the stable length of the Alexander polynomial of an alternating link can be bounded from above using the signature. We estabilish this and determine when equality holds for diagrammatic Murasugi sums of special alternating knots where each sum has length less than three, and also for twist-concentrated 3-braids. Finally, we study the behavior of the Hirasawa-Murasugi inequality under concordance.


title: Dark Neutrino Moments From Light Loops

abstract: Active and sterile neutrinos may acquire "dark moments" via one-loop diagrams with a massless dark photon and new light particles in the loop. Due to the kinetic mixing between the dark photon and the Standard Model photon, neutrinos would obtain effective electromagnetic moments. This mechanism allows for enhanced electromagnetic moments that can evade constraints on particles directly charged under electromagnetism. We show that in a wide region of parameter space, the model features testable predictions for the anapole and magnetic moment of active and sterile neutrinos with dark matter direct detection experiments sensitive to the solar neutrino flux.


title: Contractibility of Vietoris-Rips Complexes of dense subsets in $(\mathbb{R}^n, \ell_1)$ via hyperconvex embeddings

abstract: We consider the contractibility of Vietoris-Rips complexes of dense subsets of $(\mathbb{R}^n,\ell_1)$ with sufficiently large scales. This is motivated by a question by Matthew Zaremsky regarding whether for each $n$ natural there is a $r_n>0$ so that the Vietoris-Rips complex of $(\mathbb{Z}^n,\ell_1)$ at scale $r$ is contractible for all $r\geq r_n$. We approach this question using results that relates to the neighborhood of embeddings into hyperconvex metric space of a metric space $X$ and its connection to the Vietoris-Rips complex of $X$. In this manner, we provide positive answers to the question above for the case $n=2$ and $3$.


title: Exploring Fuzzing as Data Augmentation for Neural Test Generation

abstract: Testing is an essential part of modern software engineering to build reliable programs. As testing the software is important but expensive, automatic test case generation methods have become popular in software development. Unlike traditional search-based coverage-guided test generation like fuzzing, neural test generation backed by large language models can write tests that are semantically meaningful and can be understood by other maintainers. However, compared to regular code corpus, unit tests in the datasets are limited in amount and diversity. In this paper, we present a novel data augmentation technique **FuzzAug**, that combines the advantages of fuzzing and large language models. FuzzAug not only keeps valid program semantics in the augmented data, but also provides more diverse inputs to the function under test, helping the model to associate correct inputs embedded with the function's dynamic behaviors with the function under test. We evaluate FuzzAug's benefits by using it on a neural test generation dataset to train state-of-the-art code generation models. By augmenting the training set, our model generates test cases with $11\%$ accuracy increases. Models trained with FuzzAug generate unit test functions with double the branch coverage compared to those without it. FuzzAug can be used across various datasets to train advanced code generation models, enhancing their utility in automated software testing. Our work shows the benefits of using dynamic analysis results to enhance neural test generation. Code and data will be publicly available.


title: Interventional Causal Discovery in a Mixture of DAGs

abstract: Causal interactions among a group of variables are often modeled by a single causal graph. In some domains, however, these interactions are best described by multiple co-existing causal graphs, e.g., in dynamical systems or genomics. This paper addresses the hitherto unknown role of interventions in learning causal interactions among variables governed by a mixture of causal systems, each modeled by one directed acyclic graph (DAG). Causal discovery from mixtures is fundamentally more challenging than single-DAG causal discovery. Two major difficulties stem from (i) inherent uncertainty about the skeletons of the component DAGs that constitute the mixture and (ii) possibly cyclic relationships across these component DAGs. This paper addresses these challenges and aims to identify edges that exist in at least one component DAG of the mixture, referred to as true edges. First, it establishes matching necessary and sufficient conditions on the size of interventions required to identify the true edges. Next, guided by the necessity results, an adaptive algorithm is designed that learns all true edges using ${\cal O}(n^2)$ interventions, where $n$ is the number of nodes. Remarkably, the size of the interventions is optimal if the underlying mixture model does not contain cycles across its components. More generally, the gap between the intervention size used by the algorithm and the optimal size is quantified. It is shown to be bounded by the cyclic complexity number of the mixture model, defined as the size of the minimal intervention that can break the cycles in the mixture, which is upper bounded by the number of cycles among the ancestors of a node.


title: Scaling Analysis of the Swirling Wake of a Porous Disc: Application to Wind Turbines

abstract: We report a comprehensive study of the wake of a porous disc, the design of which has been modified to incorporate a swirling motion at an inexpensive cost. The swirl intensity is passively controlled by varying the internal disc geometry, i.e. the pitch angle of the blades. A swirl number is introduced to characterise the competition between the linear (drag) and the azimuthal (swirl) momentums on the wake recovery. Assuming that swirl dominates the near wake and non-equilibrium turbulence theory applies, new scaling laws of the mean wake properties are derived. To assess these theoretical predictions, an in-depth analysis of the aerodynamics of these original porous discs has been conducted experimentally. It is found that at the early stage of wake recovery, the swirling motion induces a low-pressure core, which controls the mean velocity deficit properties. The measurements collected in the swirling wake of the porous discs support the new scaling laws proposed in this work. Finally, it is shown that, as far as swirl is injected in the wake, the characteristics of the mean velocity deficit profiles match very well those of both lab-scale and real-scale wind turbine data extracted from the literature. Overall, our results emphasise that by setting the initial conditions of the wake recovery, swirl is a key ingredient to be taken into account in order to faithfully replicate the mean wake of wind turbines.


title: Causal Inference on Missing Exposure via Robust Estimation

abstract: How to deal with missing data in observational studies is a common concern for causal inference. When the covariates are missing at random (MAR), multiple approaches have been provided to help solve the issue. However, if the exposure is MAR, few approaches are available and careful adjustments on both missingness and confounding issues are required to ensure a consistent estimate of the true causal effect on the response. In this article, a new inverse probability weighting (IPW) estimator based on weighted estimating equations (WEE) is proposed to incorporate weights from both the missingness and propensity score (PS) models, which can reduce the joint effect of extreme weights in finite samples. Additionally, we develop a triple robust (TR) estimator via WEE to further protect against the misspecification of the missingness model. The asymptotic properties of WEE estimators are proved using properties of estimating equations. Based on the simulation studies, WEE methods outperform others including imputation-based approaches in terms of bias and variability. Finally, an application study is conducted to identify the causal effect of the presence of cardiovascular disease on mortality for COVID-19 patients.


title: Superconducting Diode Effect in Quantum Spin Hall Insulator-based Josephson Junctions

abstract: The superconducting diode effect (SDE) is a magneto-electric phenomenon where an external magnetic field imparts a non-zero center-of-mass momentum to Cooper pairs, either facilitating or hindering the flow of supercurrent depending on its direction. We propose that quantum spin Hall insulator (QSHI)-based Josephson junctions can serve as versatile platforms for non-dissipative electronics exhibiting the SDE when triggered by a phase bias and an out-of-plane magnetic field. By computing the contributions from Andreev bound states and the continuum of quasi-particle states, we provide both numerical and analytical results scrutinizing various aspects of the SDE, including its quality Q-factor. The maximum value of the $Q$-factor is found to be universal at low (zero) temperatures, which ties its origin to underlying topological properties that are independent of the junction's specific details. As the magnetic field increases, the SDE diminishes due to the closing of the induced superconducting gap caused by orbital effects. To observe the SDE, the QSHI-based Josephson junction must be designed so that its edges are transport-wise non-equivalent. Additionally, we explore the SDE in a more exotic yet realistic scenario, where the fermionic ground-state parity of the Josephson junction remains conserved while driving a current. In this 4$\pi$-periodic situation, we predict an enhancement of the SDE compared to its 2$\pi$-periodic, parity-unconstrained counterpart.


title: Investigating meV-scale Equilibrium Atomic Dynamics with X-Rays: focus on disordered materials

abstract: This paper reviews non-resonant meV-resolved inelastic x-ray scattering (IXS) as a complementary method to inelastic neutron scattering (INS). Two aspects of IXS that are notable in this context are (1) that IXS allows straightforward measurements of phonons in small (sub-mm, and even $\sim 0.01$ mm) samples with $\sim 1$ meV resolution and excellent Q resolution and (2) that IXS avoids the kinematic constraints of INS. The first allows both new geometries (thin films, diamond anvil cells) and easy access to new materials, while the second allows high quality data on disordered materials, such as scans with sub-meV resolution to arbitrarily high energy transfer become possible , even at momentum transfers as small as 1/nm. The review briefly discusses the spectrometers and compares the practical forms for the dynamic structure factor for crystals, glasses and liquids. This is followed by a longer review of work on liquids and then shorter discussion of work on glasses, crystals, and discussion of specific geometries. This paper complements the longer introduction/review of IXS at arxiv:1504.01098 .


title: Elucidating the roles of collision energy and photon momentum transfer in the formation of ultralong-range Rydberg molecules

abstract: Spectroscopic measurements of the rotational distribution of $^{84}$Sr and $^{86}$Sr 5sns $^1S_0$ ultralong-range Rydberg molecular dimers created via photoassociation in a cold gas are reported. The dimers are produced by two-photon excitation via the 5s5p $^1P_1$ intermediate state. The use of singlet states permits detailed study of the roles that the initial atom-atom interaction, photon momentum transfer during Rydberg excitation, and sample temperature play in determining the spectral lineshape and final dimer rotational distribution. The results are in good agreement with the predictions of a model that includes these effects. The present work further highlights the sensitivity of ultralong-range Rydberg molecule formation to the state of the initial cold gas.


title: Expressing turbulent kinetic energy as coarse-grained enstrophy or strain deformations

abstract: In turbulent flows, the element of fluid gets deformed by chaotic motion due to the formation of sharp velocity gradients. A direct connection between the element of fluid stresses and the energy balance still remains elusive. Here, an exact identity of incompressible turbulence is derived linking the velocity gradient norm across the scales to the total kinetic energy. In the context of three dimensional (3D) homogeneous turbulence, this relation can be specialised obtaining the expression of total kinetic energy decomposed either in terms of fluid element deformations due to strain motion or via the resolved scale enstrophy. Applied to data from direct numerical simulations (DNS), the decomposition reveals that, beyond the scales dominated by the external forcing, extensional and contractile deformations account approximately for 55% and 40% of the kinetic energy of the associated scale saturating to these values at the small scales; less than the remaining 5% is carried by the indefinite-type ones. From both these two identities one can derive an exact expression of the omni-directional energy spectrum which is formulated via an ultraviolet-infrared mixing of scales. Data from DNS indicated that this formulation of the energy spectrum reproduces both analytically and numerically the power-law behaviour of the well known Kolmogorov spectral scaling.


title: HelpSteer2: Open-source dataset for training top-performing reward models

abstract: High-quality preference datasets are essential for training reward models that can effectively guide large language models (LLMs) in generating high-quality responses aligned with human preferences. As LLMs become stronger and better aligned, permissively licensed preference datasets, such as Open Assistant, HH-RLHF, and HelpSteer need to be updated to remain effective for reward modeling. Methods that distil preference data from proprietary LLMs such as GPT-4 have restrictions on commercial usage imposed by model providers. To improve upon both generated responses and attribute labeling quality, we release HelpSteer2, a permissively licensed preference dataset (CC-BY-4.0). Using a powerful internal base model trained on HelpSteer2, we are able to achieve the SOTA score (92.0%) on Reward-Bench's primary dataset, outperforming currently listed open and proprietary models, as of June 12th, 2024. Notably, HelpSteer2 consists of only ten thousand response pairs, an order of magnitude fewer than existing preference datasets (e.g., HH-RLHF), which makes it highly efficient for training reward models. Our extensive experiments demonstrate that reward models trained with HelpSteer2 are effective in aligning LLMs. In particular, we propose SteerLM 2.0, a model alignment approach that can effectively make use of the rich multi-attribute score predicted by our reward models. HelpSteer2 is available at https://huggingface.co/datasets/nvidia/HelpSteer2 and code is available at https://github.com/NVIDIA/NeMo-Aligner


title: Gaussian curvature on random planar maps and Liouville quantum gravity

abstract: We investigate the notion of curvature in the context of Liouville quantum gravity (LQG) surfaces. We define the Gaussian curvature for LQG, which we conjecture is the scaling limit of discrete curvature on random planar maps. Motivated by this, we study asymptotics for the discrete curvature of $\epsilon$-mated CRT maps. More precisely, we prove that the discrete curvature integrated against a $C_c^2$ test function is of order $\epsilon^{o(1)},$ which is consistent with our scaling limit conjecture. On the other hand, we prove the total discrete curvature on a fixed space-filling SLE segment scaled by $\epsilon^{\frac{1}{4}}$ converges in distribution to an explicit random variable.


title: Multi-reference Quantum Davidson Algorithm for Quantum Dynamics

abstract: Simulating quantum systems is one of the most promising tasks where quantum computing can potentially outperform classical computing. However, the robustness needed for reliable simulations of medium to large systems is beyond the reach of existing quantum devices. To address this, Quantum Krylov Subspace (QKS) methods have been developed, enhancing the ability to perform accelerated simulations on noisy intermediate-scale quantum computers. In this study, we introduce and evaluate two QKS methods derived from the QDavidson algorithm, a novel approach for determining the ground and excited states of many-body systems. Unlike other QKS methods that pre-generate the Krylov subspace through real- or imaginary-time evolution, QDavidson iteratively adds basis vectors into the Krylov subspace. This iterative process enables faster convergence with fewer iterations and necessitates shallower circuit depths, marking a significant advancement in the field of quantum simulation.


title: The Generalized Scalar Weak Gravity Conjecture and its Implications

abstract: We propose a generalized formulation of the Scalar Weak Gravity Conjecture (SWGC) based on the analogy with the derivation of the Gauge Weak Gravity Conjecture (GWGC). We discuss some phenomenological implications of this Generalized SWGC, including the scale of New Physics (NP) when applied to the SM Higgs sector, and the bounds on the axion's couplings to fermions and the photon when applied to the axion. The Generalized SWGC constraints rule out most of the parameter space of axion-nucleon couplings, leaving only a tiny parameter space.


title: Forming the Trappist-1 system in two steps during the recession of the disc inner edge

abstract: Trappist-1 hosts 7 planets where period ratios of neighbouring pairs are close to the 8:5, 5:3, 3:2, 3:2, 4:3, and 3:2 ratios in increasing distance from the star. The Laplace angles associated with neighbouring triplets are observed to be librating, proving the resonant nature of the system. This compact, resonant configuration is a manifest sign of disc-driven migration; however, the preferred outcome of such evolution is the establishment of first-order resonances, not the high-order resonances observed in the inner system. Here, we explain the observed orbital configuration in a model that is largely independent on the specific disc migration and orbital circularisation efficiencies. Together with migration, the two key elements of our model are: i) the inner border of the protoplanetary disc receded with time; and ii) the system was initially separated in two sub-systems. Specifically, the inner b, c d and e planets were initially placed in a 3:2 resonance chain and then evolved to the 8:5 -- 5:3 commensurability between planets b, c and d under the effect of the recession of the inner edge of the disc, whereas the outer planets migrated to the inner edge at a later time, establishing the remaining resonances. Our results pivot on the dynamical role of the presently unobservable recession of the inner edge of protoplanetary discs. They also reveal the role of recurring phases of convergent migration followed by resonant repulsion with associated orbital circularisation when resonant chains interact with migration barriers.


title: Harnessing Plasmonic Interference for Nanoscale Ultrafast Electron Sources

abstract: In this paper we demonstrate the use of plasmonic focusing in conjunction with non-linear photoemisison to develop geometrically flat nanoscale electron sources with less than 40 pm-rad root mean squared (rms) normalized transverse emittance. Circularly polarized light is incident on a gold Archimedean spiral structure to generate surface-plasmon-polaritons which interfere coherently at the center resulting in a 50 nm rms emisison area. Such a nanostructured flat surface enables simultaneous spatio-temporal confinement of emitted electrons at the nanometer and femtosecond level and can be used as an advanced electron source for high-repetition-rate ultrafast electron diffraction and microscopy experiments as well as next-generation of miniaturized particle accelerators.


title: Building Software Engineering Capacity through a University Open Source Program Office

abstract: This work introduces an innovative program for training the next generation of software engineers within university settings, addressing the limitations of traditional software engineering courses. Initial program costs were significant, totaling $551,420 in direct expenditures to pay for program staff salaries and benefits over two years. We present a strategy for reducing overall costs and establishing sustainable funding sources to perpetuate the program, which has yielded educational, research, professional, and societal benefits.


title: Analyzing Large Language Models for Classroom Discussion Assessment

abstract: Automatically assessing classroom discussion quality is becoming increasingly feasible with the help of new NLP advancements such as large language models (LLMs). In this work, we examine how the assessment performance of 2 LLMs interacts with 3 factors that may affect performance: task formulation, context length, and few-shot examples. We also explore the computational efficiency and predictive consistency of the 2 LLMs. Our results suggest that the 3 aforementioned factors do affect the performance of the tested LLMs and there is a relation between consistency and performance. We recommend a LLM-based assessment approach that has a good balance in terms of predictive performance, computational efficiency, and consistency.


title: Quantitative determination of twist angle and strain in Van der Waals moir\'e superlattices

abstract: Scanning probe techniques are popular, non-destructive ways to visualize the real space structure of Van der Waals moir\'es. The high lateral spatial resolution provided by these techniques enables extracting the moir\'e lattice vectors from a scanning probe image. We have found that the extracted values, while precise, are not necessarily accurate. Scan-to-scan variations in the behavior of the piezos which drive the scanning probe, and thermally-driven slow relative drift between probe and sample, produce systematic errors in the extraction of lattice vectors. In this Letter, we identify the errors and provide a protocol to correct for them. Applying this protocol to an ensemble of ten successive scans of near-magic-angle twisted bilayer graphene, we are able to reduce our errors in extracting lattice vectors to less than 1%. This translates to extracting twist angles with a statistical uncertainty less than 0.001{\deg} and uniaxial heterostrain with uncertainty on the order of 0.002%.


title: FIP-GNN: Graph neural networks for scalable prediction of grain-level fatigue indicator parameters

abstract: High-cycle fatigue is a critical performance metric of structural alloys for many applications. The high cost, time, and labor involved in experimental fatigue testing call for efficient and accurate computer models of fatigue life. We present graph neural networks for polycrystals that, for the first time, can (i) predict fatigue indicator parameters -- grain-level responses to cyclic loading well beyond monotonic elastic and inelastic regimes reported in literature; and (ii) generalize these predictions to large microstructure volume elements with grain populations well beyond those used in training. These advances can make significant contributions to statistically rigorous and computationally efficient modeling of high-cycle fatigue -- a long-standing challenge in the field.


title: Simultaneous incremental support adjustment and metagame solving: An equilibrium-finding framework for continuous-action games

abstract: We present a framework for computing approximate mixed-strategy Nash equilibria of continuous-action games. It is a modification of the traditional double oracle algorithm, extended to multiple players and continuous action spaces. Unlike prior methods, it maintains fixed-cardinality pure strategy sets for each player. Thus, unlike prior methods, only a constant amount of memory is necessary. Furthermore, it does not require exact metagame solving on each iteration, which can be computationally expensive for large metagames. Moreover, it does not require global best-response computation on each iteration, which can be computationally expensive or even intractable for high-dimensional action spaces and general games. Our method incrementally reduces the exploitability of the strategy profile in the finite metagame, pushing it toward Nash equilibrium. Simultaneously, it incrementally improves the pure strategies that best respond to this strategy profile in the full game. We evaluate our method on various continuous-action games, showing that it obtains approximate mixed-strategy Nash equilibria with low exploitability.


title: On Strongly-equitable Social Welfare Orders Without the Axiom of Choice

abstract: Social welfare orders seek to combine the disparate preferences of an infinite sequence of generations into a single, societal preference order in some reasonably-equitable way. In [2] Dubey and Laguzzi study a type of social welfare order which they call SEA, for strongly equitable and (finitely) anonymous. They prove that the existence of a SEA order implies the existence of a set of reals which does not have the Baire property, and observe that a nonprincipal ultrafilter on $\mathbb{N}$ can be used to construct a SEA order. Questions arising in their work include whether the existence of a SEA order implies the existence of either a set of real numbers which is not Lebesgue-measurable or of a nonprincipal ultrafilter on $\mathbb{N}$. We answer both these questions, the solution to the second using the techniques of geometric set theory as set out by Larson and Zapletal in [11]. The outcome is that the existence of a SEA order does imply the existence of a set of reals which is not Lebesgue-measurable, and does not imply the existence of a nonprincipal ultrafilter on $\mathbb{N}$.


title: Variational Bayes Inference for Spatial Error Models with Missing Data

abstract: The spatial error model (SEM) is a type of simultaneous autoregressive (SAR) model for analysing spatially correlated data. Markov chain Monte Carlo (MCMC) is one of the most widely used Bayesian methods for estimating SEM, but it has significant limitations when it comes to handling missing data in the response variable due to its high computational cost. Variational Bayes (VB) approximation offers an alternative solution to this problem. Two VB-based algorithms employing Gaussian variational approximation with factor covariance structure are presented, joint VB (JVB) and hybrid VB (HVB), suitable for both missing at random and not at random inference. When dealing with many missing values, the JVB is inaccurate, and the standard HVB algorithm struggles to achieve accurate inferences. Our modified versions of HVB enable accurate inference within a reasonable computational time, thus improving its performance. The performance of the VB methods is evaluated using simulated and real datasets.


title: Opportunities in deep learning methods development for computational biology

abstract: Advances in molecular technologies underlie an enormous growth in the size of data sets pertaining to biology and biomedicine. These advances parallel those in the deep learning subfield of machine learning. Components in the differentiable programming toolbox that makes deep learning possible are allowing computer scientists to address an increasingly large array of problems with flexible and effective tools. However many of these tools have not fully proliferated into the computational biology and bioinformatics fields. In this perspective we survey some of these advances and highlight exemplary examples of their utilization in the biosciences, with the goal of increasing awareness among practitioners of emerging opportunities to blend expert knowledge with newly emerging deep learning architectural tools.


title: AlphaZeroES: Direct score maximization outperforms planning loss minimization

abstract: Planning at execution time has been shown to dramatically improve performance for agents in both single-agent and multi-agent settings. A well-known family of approaches to planning at execution time are AlphaZero and its variants, which use Monte Carlo Tree Search together with a neural network that guides the search by predicting state values and action probabilities. AlphaZero trains these networks by minimizing a planning loss that makes the value prediction match the episode return, and the policy prediction at the root of the search tree match the output of the full tree expansion. AlphaZero has been applied to both single-agent environments (such as Sokoban) and multi-agent environments (such as chess and Go) with great success. In this paper, we explore an intriguing question: In single-agent environments, can we outperform AlphaZero by directly maximizing the episode score instead of minimizing this planning loss, while leaving the MCTS algorithm and neural architecture unchanged? To directly maximize the episode score, we use evolution strategies, a family of algorithms for zeroth-order blackbox optimization. Our experiments indicate that, across multiple environments, directly maximizing the episode score outperforms minimizing the planning loss.


title: On Security Weaknesses and Vulnerabilities in Deep Learning Systems

abstract: The security guarantee of AI-enabled software systems (particularly using deep learning techniques as a functional core) is pivotal against the adversarial attacks exploiting software vulnerabilities. However, little attention has been paid to a systematic investigation of vulnerabilities in such systems. A common situation learned from the open source software community is that deep learning engineers frequently integrate off-the-shelf or open-source learning frameworks into their ecosystems. In this work, we specifically look into deep learning (DL) framework and perform the first systematic study of vulnerabilities in DL systems through a comprehensive analysis of identified vulnerabilities from Common Vulnerabilities and Exposures (CVE) and open-source DL tools, including TensorFlow, Caffe, OpenCV, Keras, and PyTorch. We propose a two-stream data analysis framework to explore vulnerability patterns from various databases. We investigate the unique DL frameworks and libraries development ecosystems that appear to be decentralized and fragmented. By revisiting the Common Weakness Enumeration (CWE) List, which provides the traditional software vulnerability related practices, we observed that it is more challenging to detect and fix the vulnerabilities throughout the DL systems lifecycle. Moreover, we conducted a large-scale empirical study of 3,049 DL vulnerabilities to better understand the patterns of vulnerability and the challenges in fixing them. We have released the full replication package at https://github.com/codelzz/Vulnerabilities4DLSystem. We anticipate that our study can advance the development of secure DL systems.


title: Security of AI Agents

abstract: The study and development of AI agents have been boosted by large language models. AI agents can function as intelligent assistants and complete tasks on behalf of their users with access to tools and the ability to execute commands in their environments, Through studying and experiencing the workflow of typical AI agents, we have raised several concerns regarding their security. These potential vulnerabilities are not addressed by the frameworks used to build the agents, nor by research aimed at improving the agents. In this paper, we identify and describe these vulnerabilities in detail from a system security perspective, emphasizing their causes and severe effects. Furthermore, we introduce defense mechanisms corresponding to each vulnerability with meticulous design and experiments to evaluate their viability. Altogether, this paper contextualizes the security issues in the current development of AI agents and delineates methods to make AI agents safer and more reliable.


title: $T_{cc}$ in the Diabatic Diquark Model: Effects of $D^*D$ Isospin

abstract: $T_{cc}^+$ is an isoscalar 4-quark state with mass lying barely below the $D^{*+} D^0$ threshold, and several times further below the $D^{*0} D^+$ threshold. It allows both di-meson molecular and elementary diquark-antidiquark $(cc)(\bar u \bar d)$ substructures. The diabatic generalization of the adiabatic approximation within the Born-Oppenheimer formalism rigorously incorporates the mixing of such elementary eigenstates with states corresponding to two-particle thresholds. We examine the separate influence of the two $D^* \! D$ isospin channels and find that the influence of $D^{*+} D^0$ is larger than that of $D^{*0} D^+$ but not overwhelmingly so, and that $T_{cc}^+$ contains an $O(10\%)$ $(cc)(\bar u \bar d)$ component. We then explore the variation of these results if the isospin breaking between the di-meson thresholds is varied, and also the sensitivity of our results to variation of the mixing-potential parameters.


title: UnO: Unsupervised Occupancy Fields for Perception and Forecasting

abstract: Perceiving the world and forecasting its future state is a critical task for self-driving. Supervised approaches leverage annotated object labels to learn a model of the world -- traditionally with object detections and trajectory predictions, or temporal bird's-eye-view (BEV) occupancy fields. However, these annotations are expensive and typically limited to a set of predefined categories that do not cover everything we might encounter on the road. Instead, we learn to perceive and forecast a continuous 4D (spatio-temporal) occupancy field with self-supervision from LiDAR data. This unsupervised world model can be easily and effectively transferred to downstream tasks. We tackle point cloud forecasting by adding a lightweight learned renderer and achieve state-of-the-art performance in Argoverse 2, nuScenes, and KITTI. To further showcase its transferability, we fine-tune our model for BEV semantic occupancy forecasting and show that it outperforms the fully supervised state-of-the-art, especially when labeled data is scarce. Finally, when compared to prior state-of-the-art on spatio-temporal geometric occupancy prediction, our 4D world model achieves a much higher recall of objects from classes relevant to self-driving.


title: The cancellation property for projective modules over integral group rings

abstract: We obtain a partial classification of the finite groups $G$ for which the integral group ring $\mathbb{Z} G$ has projective cancellation, i.e. for which $P \oplus \mathbb{Z} G \cong Q \oplus \mathbb{Z} G$ implies $P \cong Q$ for projective $\mathbb{Z} G$-modules $P$ and $Q$. To do this, we prove a cancellation theorem based on a relative version of the Eichler condition and use it to establish the cancellation property for a large class of finite groups. We then use a group theoretic argument to precisely determine the class of groups not covered by this result. The final classification is then obtained by applying results of Swan, Chen and Bley-Hofmann-Johnston which show failure of the cancellation property for certain groups.


title: Infinity inner products and open Gromov--Witten invariants

abstract: The open Gromov--Witten (OGW) potential is a function from the set of weak bounding cochains on a closed Lagrangian in a closed symplectic manifold to the Novikov ring. Existing definitions of the OGW potential assume that the ground field of the Novikov ring is either $\mathbb{R}$ or $\mathbb{C}$. In this paper, we give an alternate definition of the OGW potential in the pearly model for Lagrangian Floer theory which yields an invariant valued in the Novikov ring over any field of characteristic zero. We work under simplifying regularity hypotheses which are satisfied, for instance, by any monotone Lagrangian. Our OGW potential is defined in terms of an appropriate weakening of a strictly cyclic pairing on a curved $A_{\infty}$-algebra, which can be thought of as a version of a proper Calabi--Yau structure. Such a structure is obtained by constructing a version of the cyclic open-closed map on the pearly Lagrangian Floer cochain complex. We also explain an analogue of our construction in de Rham cohomology, and show that it recovers the OGW potential constructed by Solomon and Tukachinsky.


title: On the archetypal `flavours', indices and teleconnections of ENSO revealed by global sea surface temperatures

abstract: El Ni\~no-Southern Oscillation global (ENSO) imprint on sea surface temperature comes in many guises. To identify its tropical fingerprints and impacts on the rest of the climate system, we propose a global approach based on archetypal analysis (AA), a pattern recognition method based on the identification of extreme configurations in the dataset under investigation. Relying on detrended sea surface temperature monthly anomalies over the 1982 to 2022 period, the technique recovers central and eastern Pacific ENSO types identified by more traditional methods and allows one to hierarchically add extra flavours and nuances to both persistent and transient phases of the phenomenon. Archetypal patterns found compare favorably to phase identification from K-means, fuzzy C-means and recently published network-based machine-learning algorithms. The AA implementation is modified for the identification of ENSO phases in sub-seasonal-to-seasonal prediction systems and complements current alert systems in characterising the diversity of ENSO and its teleconnections. Tropical and extra-tropical teleconnection composites from various oceanic and atmospheric fields derived from the analysis are shown to be robust and physically relevant. Extending AA to sub-surface ocean fields improves the discrimination between phases when the characterisation of ENSO based on sea surface temperature is uncertain. We show that AA on detrended sea-level monthly anomalies provides a clearer expression of ENSO types.


title: Global AI Governance in Healthcare: A Cross-Jurisdictional Regulatory Analysis

abstract: Artificial Intelligence (AI) is being adopted across the world and promises a new revolution in healthcare. While AI-enabled medical devices in North America dominate 42.3% of the global market, the use of AI-enabled medical devices in other countries is still a story waiting to be unfolded. We aim to delve deeper into global regulatory approaches towards AI use in healthcare, with a focus on how common themes are emerging globally. We compare these themes to the World Health Organization's (WHO) regulatory considerations and principles on ethical use of AI for healthcare applications. Our work seeks to take a global perspective on AI policy by analyzing 14 legal jurisdictions including countries representative of various regions in the world (North America, South America, South East Asia, Middle East, Africa, Australia, and the Asia-Pacific). Our eventual goal is to foster a global conversation on the ethical use of AI in healthcare and the regulations that will guide it. We propose solutions to promote international harmonization of AI regulations and examine the requirements for regulating generative AI, using China and Singapore as examples of countries with well-developed policies in this area.


title: Thermoresponsive PNIPAM/FeRh smart composite activated by magnetic field for doxorubicin release

abstract: The ability to control by physical properties of the thermoresponsive polymer of PNIPAM by magnetocaloric effect was demonstrated by in-situ experiments on PNIPAM/FeRh smart composite. The concept of drug release loaded in smart composite by applying of 3 T magnetic field was demonstrated using an example of doxorubicin. Released results of the magnetic field applying the drug were detected using IV-VIS and Raman spectroscopy. In vitro, studies have demonstrated a high degree of PNIPAM/FeRh scaffold biocompatibility for primary mouse embryonic fibroblasts (PMEF) cell culture. PMEFs effectively ad-hered to the PNIPAM/FeRh scaffold surface and showed high metabolic and proliferative activity for 72 h after seeding.


title: Orthogonalized Estimation of Difference of $Q$-functions

abstract: Offline reinforcement learning is important in many settings with available observational data but the inability to deploy new policies online due to safety, cost, and other concerns. Many recent advances in causal inference and machine learning target estimation of causal contrast functions such as CATE, which is sufficient for optimizing decisions and can adapt to potentially smoother structure. We develop a dynamic generalization of the R-learner (Nie and Wager 2021, Lewis and Syrgkanis 2021) for estimating and optimizing the difference of $Q^\pi$-functions, $Q^\pi(s,1)-Q^\pi(s,0)$ (which can be used to optimize multiple-valued actions). We leverage orthogonal estimation to improve convergence rates in the presence of slower nuisance estimation rates and prove consistency of policy optimization under a margin condition. The method can leverage black-box nuisance estimators of the $Q$-function and behavior policy to target estimation of a more structured $Q$-function contrast.


title: Constraints on Ultra Heavy Dark Matter Properties from Dwarf Spheroidal Galaxies with LHAASO Observations

abstract: In this work we try to search for signals generated by ultra-heavy dark matter at the Large High Altitude Air Shower Observatory (LHAASO) data. We look for possible gamma-ray by dark matter annihilation or decay from 16 dwarf spheroidal galaxies in the field of view of LHAASO. Dwarf spheroidal galaxies are among the most promising targets for indirect detection of dark matter which have low fluxes of astrophysical $\gamma$-ray background while large amount of dark matter. By analyzing more than 700 days observational data at LHAASO, no significant dark matter signal from 1 TeV to 1 EeV is detected. Accordingly we derive the most stringent constraints on the ultra-heavy dark matter annihilation cross-section up to EeV. The constraints on the lifetime of dark matter in decay mode are also derived.


title: Positive-energy Dirac particles in cosmology

abstract: We provide general relativistic treatment of the single-component field described by Dirac's positive-energy wave equation of 1971. It is motivated by Bogomolny's proposal to regard that field as a possible candidate for dark matter. Our emphasis is on standard (flat) Friedmann-Robertson-Walker cosmology. The early universe is not considered, though there is a strong indication that the field may play a role in internally driven generation of cosmic anisotropy.


title: Matching with a Status Quo: The Agreeable Core

abstract: We provide a framework to unify classic models of two-sided matching with recent models of recontracting. In the classic model, agents from two sides must be matched; in models of recontracting, agents improve a status quo match. We generalize the core (matches not blocked by any coalition) from cooperative game theory to our setting by restricting the set of permissible coalitions to coalitions containing neither or both agents in a status quo match, dubbed "agreeable" coalitions. The agreeable core is the set of all weak improvements of the status quo that are not blocked by any agreeable coalition. Our main result is that the agreeable core is nonempty and can be found through a computationally efficient and economically meaningful algorithm: our Propose-Exchange algorithm. The applications of the agreeable core include early decision, out-of-match agreements in the NRMP, matching with minimum constraints, and efficiency in school choice.


title: Impacts of Backside Insulation on the Dynamic On-Resistance of Lateral p-GaN HEMTs-on-Si

abstract: We examined the effect of backside insulation on the dynamic on-resistance of lateral p-GaN HEMTs. To gain a comprehensive understanding of the dynamic onresistance difference between substrate grounded and substrate floating p-GaN HEMTs, we conducted in-circuit double pulse testing and long-term direct current (DC) bias stress. We have realized that while backside insulation can enhance the breakdown voltage of lateral p-GaN HEMTs, it also comes with a tradeoff in device reliability. Results through Sentaurus TCAD simulation suggest that the use of backside insulation in devices gradually disperses potential to the buffer barrier. As a result, the potential barrier at the buffer edge of the 2DEG channel decreases significantly, leading to considerable electron trappings at buffer traps. This breakdown voltage and reliability tradeoff also applies to HEMT technologies using insulating substrates.


title: VLind-Bench: Measuring Language Priors in Large Vision-Language Models

abstract: Large Vision-Language Models (LVLMs) have demonstrated outstanding performance across various multimodal tasks. However, they suffer from a problem known as language prior, where responses are generated based solely on textual patterns while disregarding image information. Addressing the issue of language prior is crucial, as it can lead to undesirable biases or hallucinations when dealing with images that are out of training distribution. Despite its importance, current methods for accurately measuring language priors in LVLMs are poorly studied. Although existing benchmarks based on counterfactual or out-of-distribution images can partially be used to measure language priors, they fail to disentangle language priors from other confounding factors. To this end, we propose a new benchmark called VLind-Bench, which is the first benchmark specifically designed to measure the language priors, or blindness, of LVLMs. It not only includes tests on counterfactual images to assess language priors but also involves a series of tests to evaluate more basic capabilities such as commonsense knowledge, visual perception, and commonsense biases. For each instance in our benchmark, we ensure that all these basic tests are passed before evaluating the language priors, thereby minimizing the influence of other factors on the assessment. The evaluation and analysis of recent LVLMs in our benchmark reveal that almost all models exhibit a significant reliance on language priors, presenting a strong challenge in the field.


title: Differentiable Optics with dLux I: Deep calibration of Flat Field and Phase Retrieval with Automatic Differentiation

abstract: The sensitivity limits of space telescopes are imposed by uncalibrated errors in the point spread function, photon-noise, background light, and detector sensitivity. These are typically calibrated with specialized wavefront sensor hardware and with flat fields obtained on the ground or with calibration sources, but these leave vulnerabilities to residual time-varying or non-common path aberrations and variations in the detector conditions. It is therefore desirable to infer these from science data alone, facing the prohibitively high dimensional problems of phase retrieval and pixel-level calibration. We introduce a new Python package for physical optics simulation, dLux, which uses the machine learning framework JAX to achieve GPU acceleration and automatic differentiation (autodiff), and apply this to simulating astronomical imaging. In this first of a series of papers, we show that gradient descent enabled by autodiff can be used to simultaneously perform phase retrieval and calibration of detector sensitivity, scaling efficiently to inferring millions of parameters. This new framework enables high dimensional optimization and inference in data analysis and hardware design in astronomy and beyond, which we explore in subsequent papers in this series.


title: Differentiable Optics with dLux II: Optical Design Maximising Fisher Information

abstract: The design of astronomical hardware operating at the diffraction limit requires optimization of physical optical simulations of the instrument with respect to desired figures of merit, such as throughput or astrometric accuracy. These systems can be high dimensional, with highly nonlinear relationships between outputs and the adjustable parameters of the hardware. In this series of papers we present and apply dLux, an open-source end-to-end differentiable optical modelling framework. Automatic differentiation enables not just efficient high-dimensional optimization of astronomical hardware designs, but also Bayesian experimental design directly targeting the precision of experimental outcomes. Automatic second derivatives enable the exact and numerically stable calculation of parameter covariance forecasts, and higher derivatives of these enable direct optimization of these forecasts. We validate this method against analytic theory and illustrate its utility in evaluating the astrometric precision of a parametrized telescope model, and the design of a diffractive pupil to achieve optimal astrometric performance for exoplanet searches. The source code and tutorial software are open source and publicly available, targeting researchers who may wish to harness dLux for their own optical simulation problems.


title: When LLM Meets DRL: Advancing Jailbreaking Efficiency via DRL-guided Search

abstract: Recent studies developed jailbreaking attacks, which construct jailbreaking prompts to ``fool'' LLMs into responding to harmful questions. Early-stage jailbreaking attacks require access to model internals or significant human efforts. More advanced attacks utilize genetic algorithms for automatic and black-box attacks. However, the random nature of genetic algorithms significantly limits the effectiveness of these attacks. In this paper, we propose RLbreaker, a black-box jailbreaking attack driven by deep reinforcement learning (DRL). We model jailbreaking as a search problem and design an RL agent to guide the search, which is more effective and has less randomness than stochastic search, such as genetic algorithms. Specifically, we design a customized DRL system for the jailbreaking problem, including a novel reward function and a customized proximal policy optimization (PPO) algorithm. Through extensive experiments, we demonstrate that RLbreaker is much more effective than existing jailbreaking attacks against six state-of-the-art (SOTA) LLMs. We also show that RLbreaker is robust against three SOTA defenses and its trained agents can transfer across different LLMs. We further validate the key design choices of RLbreaker via a comprehensive ablation study.


title: Linear spectroscopy of collective modes and the gap structure in two-dimensional superconductors

abstract: We consider optical response in multi-band, multi-layer two-dimensional superconductors. Within a simple model, we show that collective modes of the condensate, such as Leggett and clapping modes, can be detected in linear response. We show how trigonal warping of the superconducting order parameter can help facilitate detection of clapping modes. Taking rhombohedral trilayer graphene as an example, we consider several possible pairing mechanisms and show that all-electronic mechanisms may produce in-gap clapping modes. These modes, if present, should be detectable in the absorption of microwaves applied via gate electrodes; their detection would constitute strong evidence for unconventional pairing. Lastly, we show that absorption at frequencies above the superconducting gap $2|\Delta|$ also contains a wealth of information about the gap structure. Our results suggest that linear spectroscopy can be a powerful tool for the characterization of unconventional two-dimensional superconductors.


title: mOSCAR: A Large-scale Multilingual and Multimodal Document-level Corpus

abstract: Multimodal Large Language Models (mLLMs) are trained on a large amount of text-image data. While most mLLMs are trained on caption-like data only, Alayrac et al. [2022] showed that additionally training them on interleaved sequences of text and images can lead to the emergence of in-context learning capabilities. However, the dataset they used, M3W, is not public and is only in English. There have been attempts to reproduce their results but the released datasets are English-only. In contrast, current multilingual and multimodal datasets are either composed of caption-like only or medium-scale or fully private data. This limits mLLM research for the 7,000 other languages spoken in the world. We therefore introduce mOSCAR, to the best of our knowledge the first large-scale multilingual and multimodal document corpus crawled from the web. It covers 163 languages, 315M documents, 214B tokens and 1.2B images. We carefully conduct a set of filtering and evaluation steps to make sure mOSCAR is sufficiently safe, diverse and of good quality. We additionally train two types of multilingual model to prove the benefits of mOSCAR: (1) a model trained on a subset of mOSCAR and captioning data and (2) a model train on captioning data only. The model additionally trained on mOSCAR shows a strong boost in few-shot learning performance across various multilingual image-text tasks and benchmarks, confirming previous findings for English-only mLLMs.


title: Data-driven Thermal Modeling for Electrically Excited Synchronous Motors -- A Supervised Machine Learning Approach

abstract: This paper proposes a data-driven supervised machine learning (ML) for online thermal modeling of electrically excited synchronous motors (EESMs). EESMs are desired for EVs due to their high performance, efficiency, and durability at a relatively low cost. Therefore, obtaining precise EESM temperature estimations are significantly important, because online accurate temperature estimation can lead to EESM performance improvement and guaranteeing its safety and reliability. In this study, in addition to the default inputs' data, EESM losses data is leveraged to improve the performance of the proposed ML approach for thermal modeling. Exponentially weighted moving averages and standard deviations of the inputs are also incorporated in the learning process to consider the memory effect for modeling a dynamical thermal model. Using the experimental data of an EESM prototype, the performance of ordinary least squares (OLS) method is evaluated through a complete training, testing and cross-validation process. Finally, simulation results will provide the key performance metrics of OLS for EESM thermal modeling.


title: Introducing Diminutive Causal Structure into Graph Representation Learning

abstract: When engaging in end-to-end graph representation learning with Graph Neural Networks (GNNs), the intricate causal relationships and rules inherent in graph data pose a formidable challenge for the model in accurately capturing authentic data relationships. A proposed mitigating strategy involves the direct integration of rules or relationships corresponding to the graph data into the model. However, within the domain of graph representation learning, the inherent complexity of graph data obstructs the derivation of a comprehensive causal structure that encapsulates universal rules or relationships governing the entire dataset. Instead, only specialized diminutive causal structures, delineating specific causal relationships within constrained subsets of graph data, emerge as discernible. Motivated by empirical insights, it is observed that GNN models exhibit a tendency to converge towards such specialized causal structures during the training process. Consequently, we posit that the introduction of these specific causal structures is advantageous for the training of GNN models. Building upon this proposition, we introduce a novel method that enables GNN models to glean insights from these specialized diminutive causal structures, thereby enhancing overall performance. Our method specifically extracts causal knowledge from the model representation of these diminutive causal structures and incorporates interchange intervention to optimize the learning process. Theoretical analysis serves to corroborate the efficacy of our proposed method. Furthermore, empirical experiments consistently demonstrate significant performance improvements across diverse datasets.


title: Real-time Digital RF Emulation -- I: The Direct Path Computational Model

abstract: In this paper we consider the problem of developing a computational model for emulating an RF channel. The motivation for this is that an accurate and scalable emulator has the potential to minimize the need for field testing, which is expensive, slow, and difficult to replicate. Traditionally, emulators are built using a tapped delay line model where long filters modeling the physical interactions of objects are implemented directly. For an emulation scenario consisting of $M$ objects all interacting with one another, the tapped delay line model's computational requirements scale as $O(M^3)$ per sample: there are $O(M^2)$ channels, each with $O(M)$ complexity. In this paper, we develop a new ``direct path" model that, while remaining physically faithful, allows us to carefully factor the emulator operations, resulting in an $O(M^2)$ per sample scaling of the computational requirements. The impact of this is drastic, a $200$ object scenario sees about a $100\times$ reduction in the number of per sample computations. Furthermore, the direct path model gives us a natural way to distribute the computations for an emulation: each object is mapped to a computational node, and these nodes are networked in a fully connected communication graph. Alongside a discussion of the model and the physical phenomena it emulates, we show how to efficiently parameterize antenna responses and scattering profiles within this direct path framework. To verify the model and demonstrate its viability in hardware, we provide several numerical experiments produced using a cycle level C++ simulator of a hardware implementation of the model.


title: Matching with Nested and Bundled Pandora Boxes

abstract: We consider max-weighted matching with costs for learning the weights, modeled as a "Pandora's Box" on each endpoint of an edge. Each vertex has an initially-unknown value for being matched to a neighbor, and an algorithm must pay some cost to observe this value. The goal is to maximize the total matched value minus costs. Our model is inspired by two-sided settings, such as matching employees to employers. Importantly for such settings, we allow for negative values which cause existing approaches to fail. We first prove upper bounds for algorithms in two natural classes. Any algorithm that "bundles" the two Pandora boxes incident to an edge is an $o(1)$-approximation. Likewise, any "vertex-based" algorithm, which uses properties of the separate Pandora's boxes but does not consider the interaction of their value distributions, is an $o(1)$-approximation. Instead, we utilize Pandora's Nested-Box Problem, i.e. multiple stages of inspection. We give a self-contained, fully constructive optimal solution to the nested-boxes problem, which may have structural observations of interest compared to prior work. By interpreting each edge as a nested box, we leverage this solution to obtain a constant-factor approximation algorithm. Finally, we show any ``edge-based'' algorithm, which considers the interactions of values along an edge but not with the rest of the graph, is also an $o(1)$-approximation.


title: A Novel Diamond-like Carbon based photocathode for PICOSEC Micromegas detectors

abstract: The PICOSEC Micromegas (MM) detector is a precise timing gaseous detector based on a MM detector operating in a two-stage amplification mode and a Cherenkov radiator. Prototypes equipped with cesium iodide (CsI) photocathodes have shown promising time resolutions as precise as 24 picoseconds (ps) for Minimum Ionizing Particles. However, due to the high hygroscopicity and susceptibility to ion bombardment of the CsI photocathodes, alternative photocathode materials are needed to improve the robustness of PICOSEC MM. Diamond-like Carbon (DLC) film have been introduced as a novel robust photocathode material, which have shown promising results. A batch of DLC photocathodes with different thicknesses were produced and evaluated using ultraviolet light. The quantum efficiency measurements indicate that the optimized thickness of the DLC photocathode is approximately 3 nm. Furthermore, DLC photocathodes show good resistance to ion bombardment in aging test compared to the CsI photocathode. Finally, a PICOSEC MM prototype equipped with DLC photocathodes was tested in muon beams. A time resolution of around 42 ps with a detection efficiency of 97% for 150 GeV/c muons were obtained. These results indicate the great potential of DLC as a photocathode for the PICOSEC MM detector.


title: Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis

abstract: Text-to-image models have shown remarkable progress in generating high-quality images from user-provided prompts. Despite this, the quality of these images varies due to the models' sensitivity to human language nuances. With advancements in large language models, there are new opportunities to enhance prompt design for image generation tasks. Existing research primarily focuses on optimizing prompts for direct interaction, while less attention is given to scenarios involving intermediary agents, like the Stable Diffusion model. This study proposes a Multi-Agent framework to optimize input prompts for text-to-image generation models. Central to this framework is a prompt generation mechanism that refines initial queries using dynamic instructions, which evolve through iterative performance feedback. High-quality prompts are then fed into a state-of-the-art text-to-image model. A professional prompts database serves as a benchmark to guide the instruction modifier towards generating high-caliber prompts. A scoring system evaluates the generated images, and an LLM generates new instructions based on calculated gradients. This iterative process is managed by the Upper Confidence Bound (UCB) algorithm and assessed using the Human Preference Score version 2 (HPS v2). Preliminary ablation studies highlight the effectiveness of various system components and suggest areas for future improvements.


title: Real-time Digital RF Emulation -- II: A Near Memory Custom Accelerator

abstract: A near memory hardware accelerator, based on a novel direct path computational model, for real-time emulation of radio frequency systems is demonstrated. Our evaluation of hardware performance uses both application-specific integrated circuits (ASIC) and field programmable gate arrays (FPGA) methodologies: 1). The ASIC testchip implementation, using TSMC 28nm CMOS, leverages distributed autonomous control to extract concurrency in compute as well as low latency. It achieves a $518$ MHz per channel bandwidth in a prototype $4$-node system. The maximum emulation range supported in this paradigm is $9.5$ km with $0.24$ $\mu$s of per-sample emulation latency. 2). The FPGA-based implementation, evaluated on a Xilinx ZCU104 board, demonstrates a $9$-node test case (two Transmitters, one Receiver, and $6$ passive reflectors) with an emulation range of $1.13$ km to $27.3$ km at $215$ MHz bandwidth.


title: A non-circular concept of number inspired by Gottlob Frege's definition

abstract: Gottlob Frege ingeniously presented a purely logical definition of the concept of number. However, one can claim that his definition is, in some way, circular, as it relies on the concept of one-to-one relation. The concept of number only makes sense when it presents the property of projection/reflection or binding. When we consider a number as an abstraction of objects, whatever they may be, saying that a number that belongs to the concept F is the same as that which belongs to the concept G means there is a projection/reflection, or binding, between the objects in F and the objects in G. We present a definition based on both equivalent approaches. First, we introduce the definition based on the relations of projection and reflection; then, we present the definition based on the relation of binding.


title: TSE-PI: Target Sound Extraction under Reverberant Environments with Pitch Information

abstract: Target sound extraction (TSE) separates the target sound from the mixture signals based on provided clues. However, the performance of existing models significantly degrades under reverberant conditions. Inspired by auditory scene analysis (ASA), this work proposes a TSE model provided with pitch information named TSE-PI. Conditional pitch extraction is achieved through the Feature-wise Linearly Modulated layer with the sound-class label. A modified Waveformer model combined with pitch information, employing a learnable Gammatone filterbank in place of the convolutional encoder, is used for target sound extraction. The inclusion of pitch information is aimed at improving the model's performance. The experimental results on the FSD50K dataset illustrate 2.4 dB improvements of target sound extraction under reverberant environments when incorporating pitch information and Gammatone filterbank.


title: Comparison of superconducting pairing in doped cuprates and nickelates within an extended Hubbard model

abstract: Within an extended Hubbard model, we investigate the superconducting pairing behavior of infinite-layer nickelate $\mathrm{NdNiO_2}$ and cuprates superconductors by using the determinant quantum Monte Carlo method. Our focus is on comparing their dominant pairing symmetries. The results indicate that the $d_{x^2-y^2}$ pairing interaction is significantly enhanced at low temperatures in both doped nickelates and cuprates, while other typical pairing symmetries are effectively suppressed, highlighting the dominance of $d_{x^2-y^2}$ pairing form. Additionally, we find that the effective pairing interaction for $d_{x^2-y^2}$ pairing in doped nickelates is slightly lower than that in doped cuprates, which may be attributed to the different degrees of Fermi surface warping caused by the third nearest hopping $t''$. Further studies show that the hole doping and interaction strength have significant effects on the $d_{x^2-y^2}$ pairing interaction within the selected parameter range. The $d_{x^2-y^2}$ pairing interaction is notably weakened when the hole doping increases, while it is significantly enhanced with increasing Coulomb interaction strength $U$. This comparative analysis reveals the similarities and differences in the pairing behaviors of doped nickelates and cuprates, which may provide further insights into understanding the superconducting properties of these two classes of materials.


title: Enhancing Psychotherapy Counseling: A Data Augmentation Pipeline Leveraging Large Language Models for Counseling Conversations

abstract: We introduce a pipeline that leverages Large Language Models (LLMs) to transform single-turn psychotherapy counseling sessions into multi-turn interactions. While AI-supported online counseling services for individuals with mental disorders exist, they are often constrained by the limited availability of multi-turn training datasets and frequently fail to fully utilize therapists' expertise. Our proposed pipeline effectively addresses these limitations. The pipeline comprises two main steps: 1) Information Extraction and 2) Multi-turn Counseling Generation. Each step is meticulously designed to extract and generate comprehensive multi-turn counseling conversations from the available datasets. Experimental results from both zero-shot and few-shot generation scenarios demonstrate that our approach significantly enhances the ability of LLMs to produce higher quality multi-turn dialogues in the context of mental health counseling. Our pipeline and dataset are publicly available https://github.com/jwkim-chat/A-Data-Augmentation-Pipeline-Leveraging-Large-Language-Models-for-Counseling-Conversations.


title: TikTag: Breaking ARM's Memory Tagging Extension with Speculative Execution

abstract: ARM Memory Tagging Extension (MTE) is a new hardware feature introduced in ARMv8.5-A architecture, aiming to detect memory corruption vulnerabilities. The low overhead of MTE makes it an attractive solution to mitigate memory corruption attacks in modern software systems and is considered the most promising path forward for improving C/C++ software security. This paper explores the potential security risks posed by speculative execution attacks against MTE. Specifically, this paper identifies new TikTag gadgets capable of leaking the MTE tags from arbitrary memory addresses through speculative execution. With TikTag gadgets, attackers can bypass the probabilistic defense of MTE, increasing the attack success rate by close to 100%. We demonstrate that TikTag gadgets can be used to bypass MTE-based mitigations in real-world systems, Google Chrome and the Linux kernel. Experimental results show that TikTag gadgets can successfully leak an MTE tag with a success rate higher than 95% in less than 4 seconds. We further propose new defense mechanisms to mitigate the security risks posed by TikTag gadgets.


title: Updated Picture of the Active Galactic Nuclei with Dusty/Dust-free Gas Structures and Effects of the Radiation Pressure

abstract: This study investigates the properties of two gas structures of X-ray selected active galactic nuclei (AGNs), that is, dusty and dust-free gas components, by separating them with the line-of-sight dust extinction ($A_V$) and the neutral gas column density ($N_{\mathrm{H}}$). The typical column density of the dusty and dust-free gas differs depending on the Seyfert type, indicating that both structures have anisotropic column density distributions. The number of targets with the dusty gas column density ($N_{\mathrm{H,d}}$) of $\log N_{\mathrm{H,d}}\ [\mathrm{cm^{-2}}]>23$ is much smaller than that with the same column density of the dust-free gas. This result indicates that the optically-thick part of the dusty gas structure is very thin. There are very few targets with a larger Eddington ratio ($f_{\mathrm{Edd}}$) than the effective Eddington limit of the dusty gas and the covering factor of the dusty gas with $22\leq \log N_{\mathrm{H,d}}\ [\mathrm{cm^{-2}}]<24$ exhibits a clear drop at the effective Eddington limit. These results support the scenario wherein the covering factor of the dusty torus decreases in a high Eddington ratio owing to the radiation-driven dusty gas outflow. The covering factor of the dust-free gas with the column density ($N_{\mathrm{H,df}}$) of $22\leq \log N_{\mathrm{H,df}}\ [\mathrm{cm^{-2}}]<24$ similarly exhibits the decrease in high Eddington ratio, although it may be owing to the dust-free gas outflow driven by certain other mechanisms than the radiation pressure. Finally, we propose an updated picture of the AGN gas structure based on our results and the literature.


title: Restricted Open-shell cluster Mean-Field theory for Strongly Correlated Systems

abstract: The cluster-based Mean Field method (cMF) and it's second order perturbative correction[1], was introduced by Jim\'enez-Hoyos and Scuseria to reduce the cost of modeling strongly correlated systems by dividing an active space up into small clusters, which are individually solved in the mean-field presence of each other. In that work, clusters with unpaired electrons are treated naturally, by allowing the $\alpha$ and $\beta$ orbitals to spin polarize. While that provided significant energetic stabilization, the resulting cMF wavefunction was spin-contaminated, making it difficult to use as a reference state for spin-pure post-cMF methods. In this work, we propose the Restricted Open-shell cMF (RO-cMF) method, extending the cMF approach to systems with open-shell clusters, while not permitting spin-polarization. While the resulting RO-cMF energies are necessarily higher in energy than the unrestricted orbital cMF, the new RO-cMF provides a simple reference state for post-cMF methods that recover the missing inter-cluster correlations. We provide a detailed explanation of the method, and report demonstrative calculations of exchange coupling constants for three systems: a di-iron complex, a di-chromium complex, and a dimerized organic radical. We also report the first perturbatively corrected RO-cMF-PT2 results as well.


title: Uniform Large Deviation Principles of Fractional Reaction-Diffusion Equations Driven by Superlinear Multiplicative Noise on R^n

abstract: In this paper, we investigate the uniform large deviation principle of the fractional stochastic reaction-diffusion equation on the entire space R^n as the noise intensity approaches zero. The nonlinear drift term is dissipative and has a polynomial growth of any order. The nonlinear diffusion term is locally Lipschitz continuous and has a superlinear growth rate. By the weak convergence method, we establish the Freidlin-Wentzell uniform large deviations over bounded initial data as well as the Dembo-Zeitouni uniform large deviations over compact initial data. The main difficulties are caused by the superlinear growth of noise coefficients and the non-compactness of Sobolev embeddings on unbounded domains. The dissipativeness of the drift term and the idea of uniform tail-ends estimates of solutions are employed to circumvent these difficulties.


title: ECBD: Evidence-Centered Benchmark Design for NLP

abstract: Benchmarking is seen as critical to assessing progress in NLP. However, creating a benchmark involves many design decisions (e.g., which datasets to include, which metrics to use) that often rely on tacit, untested assumptions about what the benchmark is intended to measure or is actually measuring. There is currently no principled way of analyzing these decisions and how they impact the validity of the benchmark's measurements. To address this gap, we draw on evidence-centered design in educational assessments and propose Evidence-Centered Benchmark Design (ECBD), a framework which formalizes the benchmark design process into five modules. ECBD specifies the role each module plays in helping practitioners collect evidence about capabilities of interest. Specifically, each module requires benchmark designers to describe, justify, and support benchmark design choices -- e.g., clearly specifying the capabilities the benchmark aims to measure or how evidence about those capabilities is collected from model responses. To demonstrate the use of ECBD, we conduct case studies with three benchmarks: BoolQ, SuperGLUE, and HELM. Our analysis reveals common trends in benchmark design and documentation that could threaten the validity of benchmarks' measurements.


title: AGFA-Net: Attention-Guided and Feature-Aggregated Network for Coronary Artery Segmentation using Computed Tomography Angiography

abstract: Coronary artery disease (CAD) remains a prevalent cardiovascular condition, posing significant health risks worldwide. This pathology, characterized by plaque accumulation in coronary artery walls, leads to myocardial ischemia and various symptoms, including chest pain and shortness of breath. Accurate segmentation of coronary arteries from coronary computed tomography angiography (CCTA) images is crucial for diagnosis and treatment planning. Traditional segmentation methods face challenges in handling low-contrast images and complex anatomical structures. In this study, we propose an attention-guided, feature-aggregated 3D deep network (AGFA-Net) for coronary artery segmentation using CCTA images. AGFA-Net leverages attention mechanisms and feature refinement modules to capture salient features and enhance segmentation accuracy. Evaluation on a dataset comprising 1,000 CCTA scans demonstrates AGFA-Net's superior performance, achieving an average Dice coefficient similarity of 86.74% and a Hausdorff distance of 0.23 mm during 5-fold cross-validation. Ablation studies further validate the effectiveness of the proposed modules, highlighting their contributions to improved segmentation accuracy. Overall, AGFA-Net offers a robust and reliable solution for coronary artery segmentation, addressing challenges posed by varying vessel sizes, complex anatomies, and low image contrast.


title: RL-JACK: Reinforcement Learning-powered Black-box Jailbreaking Attack against LLMs

abstract: Modern large language model (LLM) developers typically conduct a safety alignment to prevent an LLM from generating unethical or harmful content. Recent studies have discovered that the safety alignment of LLMs can be bypassed by jailbreaking prompts. These prompts are designed to create specific conversation scenarios with a harmful question embedded. Querying an LLM with such prompts can mislead the model into responding to the harmful question. The stochastic and random nature of existing genetic methods largely limits the effectiveness and efficiency of state-of-the-art (SOTA) jailbreaking attacks. In this paper, we propose RL-JACK, a novel black-box jailbreaking attack powered by deep reinforcement learning (DRL). We formulate the generation of jailbreaking prompts as a search problem and design a novel RL approach to solve it. Our method includes a series of customized designs to enhance the RL agent's learning efficiency in the jailbreaking context. Notably, we devise an LLM-facilitated action space that enables diverse action variations while constraining the overall search space. We propose a novel reward function that provides meaningful dense rewards for the agent toward achieving successful jailbreaking. Through extensive evaluations, we demonstrate that RL-JACK is overall much more effective than existing jailbreaking attacks against six SOTA LLMs, including large open-source models and commercial models. We also show the RL-JACK's resiliency against three SOTA defenses and its transferability across different models. Finally, we validate the insensitivity of RL-JACK to the variations in key hyper-parameters.


title: Standard Language Ideology in AI-Generated Language

abstract: In this position paper, we explore standard language ideology in language generated by large language models (LLMs). First, we outline how standard language ideology is reflected and reinforced in LLMs. We then present a taxonomy of open problems regarding standard language ideology in AI-generated language with implications for minoritized language communities. We introduce the concept of standard AI-generated language ideology, the process by which AI-generated language regards Standard American English (SAE) as a linguistic default and reinforces a linguistic bias that SAE is the most "appropriate" language. Finally, we discuss tensions that remain, including reflecting on what desirable system behavior looks like, as well as advantages and drawbacks of generative AI tools imitating--or often not--different English language varieties. Throughout, we discuss standard language ideology as a manifestation of existing global power structures in and through AI-generated language before ending with questions to move towards alternative, more emancipatory digital futures.


title: Trade, Growth, and Product Innovation

abstract: Can trade integration induce product innovation? I document that countries that joined the European Union (EU) started producing more product varieties, investing more in R&D, and trading more compared to candidate countries that did not join at a given horizon. Additionally, I show that a plausibly exogenous increase in market access increases the probability of a given country starting production of and exporting a given product. To rationalize this reduced-form evidence, I propose a new quantitative framework that integrates the forces of specialization and market size. This is a dynamic general equilibrium model of frictional trade and endogenous growth with arbitrarily many asymmetric countries that nests the Eaton-Kortum model of trade and the Romer growth model as special cases. The key result is an analytical expression to decompose gains from trade into dynamic and static components. In this framework, the product innovation growth rate increases with higher market access. Finally, a quantitative version of the model suggests that: (a) the EU enlargement increased its long-run yearly growth rate by about 0.10pp; and (b) dynamic gains can account for between 65-90% of total welfare gains from trade.


title: Primordial magnetic relics and their signatures

abstract: Primordial black holes bearing magnetic charges may bypass the constraints imposed by Hawking radiation, thereby enabling reasonable present-day populations, even for masses below $10^{15}\,\text{g}$ -- a range previously considered improbable. They could, therefore, conceivably contribute to a component of dark matter. We investigate novel Faraday rotation signatures exhibited by primordial magnetic black holes while also establishing new Parker-type bounds on their populations. For the latter, we bound the dark matter fraction from intergalactic magnetic fields in cosmic voids $\left(f_{\text{DM}} \lesssim 10^{-8}\right)$ and cosmic web filaments $\left(f_{\text{ DM}} \lesssim 10^{-4}\right)$, notably eclipsing previous bounds. Exploring Faraday rotation effects, we discern a pronounced rotation of the polarization angle and the rotation measure values for extremal primordial magnetic black holes with masses $M^{\text{ ex.}}_{\text{ BH}}\gtrsim 10^{-6}~ \text{M}_\odot$. This makes them potentially detectable in current observations. A comparative investigation finds that the effects are notably greater than for a neutron star, like a Magnetar, with a similar magnetic field at the surface. Moreover, the polarization angle maps for primordial magnetic black holes exhibit unique features, notably absent in other astrophysical magnetic configurations. In this context, we also introduce a simple integral measure, offering a quantitative measure for their discrimination in many scenarios. These traits potentially suggest a robust avenue for their observational detection and differentiation.


title: Structure Phase Change Induced by Nonequilibrium Effects in Molecular Scale Junctions

abstract: The interrelationship between a material's structure and its properties lies at the heart of materials-related research. Finding how the changes of one affect the other is of primary importance in theoretical and computational materials studies. In this work, based on Hershfield nonequilibrium quantum statistics and the mean-field approach with steady-state density functional theory, we derive a first-principles method to calculate nonequilibrium effects induced forces acting on atoms, enabling structure optimizations and molecular dynamics simulations for molecular junctions under external biases. By applying the method to a few molecular devices, we found that in general, the external bias can induce profound nonequilibrium effects on both electronic/transport properties and the geometric structure of these devices, and consequent changes in electronic properties and geometric structure are closely interrelated. Particularly, when the bias voltage is above 1.0 V, significant structure phase changes could occur, causing dramatic changes in I-V characteristics and vibrational spectra. These findings greatly broaden our understanding of quantum electronic devices and provide a new avenue for discovering novel transport phenomena at molecular scale.


title: Finite-size generators for weak integrability breaking perturbations in the Heisenberg chain

abstract: An integrable model perturbed by special ''weak integrability-breaking'' perturbations thermalizes at timescales much longer than predicted by Fermi's golden rule. Recently, a systematic construction of such perturbations based on the so-called long-range deformations of integrable chains was formulated. These perturbations, obtained as truncations of the long-range deformations in some small parameter expansions, can be viewed as produced by unitary rotations of the short-range integrable models. For infinite systems, several ''generators'' (extensive local, boosted, and bilocal operators) of weak perturbations are known. The main aim of this work is to understand the appropriate generators in finite systems with periodic boundaries since simple counterparts to boosted and bilocal operators are not known in such cases. We approach this by studying the structure of the adiabatic gauge potential (AGP), a proxy for such generators in finite chains, which was originally introduced as a very sensitive measure of quantum chaos. We prove an exact relation between the AGPs for the boosted and bilocal classes of generators and note that the counterpart to boost does not seem to have a closed analytic form in finite systems but shows quasi-locality nonetheless. We also introduce and study strictly local variants of weak integrability-breaking perturbations.


title: Where Do Large Language Models Fail When Generating Code?

abstract: Large Language Models (LLMs) have shown great potential in code generation. However, current LLMs still cannot reliably generate correct code. Moreover, it is unclear what kinds of code generation errors LLMs can make. To address this, we conducted an empirical study to analyze incorrect code snippets generated by six popular LLMs on the HumanEval dataset. We analyzed these errors alongside two dimensions of error characteristics -- semantic characteristics and syntactic characteristics -- to derive a comprehensive code generation error taxonomy for LLMs through open coding and thematic analysis. We then labeled all 558 incorrect code snippets based on this taxonomy. Our results showed that the six LLMs exhibited different distributions of semantic and syntactic characteristics. Furthermore, we analyzed the correlation between different error characteristics and factors such as prompt length, code length, and test-pass rate. Finally, we highlight the challenges that LLMs may encounter when generating code and propose implications for future research on reliable code generation with LLMs.


title: Relative belief inferences from decision theory

abstract: Relative belief inferences are shown to arise as Bayes rules or limiting Bayes rules. These inferences are invariant under reparameterizations and possess a number of optimal properties. In particular, relative belief inferences are based on a direct measure of statistical evidence.


title: A Tangible Multi-Display Toolkit to Support the Collaborative Design Exploration of AV-Pedestrian Interfaces

abstract: The advent of cyber-physical systems, such as robots and autonomous vehicles (AVs), brings new opportunities and challenges for the domain of interaction design. Though there is consensus about the value of human-centred development, there is a lack of documented tailored methods and tools for involving multiple stakeholders in design exploration processes. In this paper we present a novel approach using a tangible multi-display toolkit. Orchestrating computer-generated imagery across multiple displays, the toolkit enables multiple viewing angles and perspectives to be captured simultaneously (e.g. top-view, first-person pedestrian view). Participants are able to directly interact with the simulated environment through tangible objects. At the same time, the objects physically simulate the interface's behaviour (e.g. through an integrated LED display). We evaluated the toolkit in design sessions with experts to collect feedback and input on the design of an AV-pedestrian interface. The paper reports on how the combination of tangible objects and multiple displays supports collaborative design explorations.


title: Link between cascade transitions and correlated Chern insulators in magic-angle twisted bilayer graphene

abstract: Chern insulators are topologically non-trivial states of matter characterized by incompressible bulk and chiral edge states. Incorporating topological Chern bands with strong electronic correlations provides a versatile playground for studying emergent quantum phenomena. In this study, we resolve the correlated Chern insulators (CCIs) in magic-angle twisted bilayer graphene (MATBG) through Rydberg exciton sensing spectroscopy, and unveil their direct link with the zero-field cascade features in the electronic compressibility. The compressibility minima in the cascade are found to deviate substantially from nearby integer fillings (by $\Delta\nu$) and coincide with the onsets of CCIs in doping densities, yielding a quasi-universal relation $B_c$=$\Phi_0\Delta\nu/C$ (onset magnetic field $B_c$, magnetic flux quantum $\Phi_0$ and Chern number $C$). We suggest these onsets lie on the intersection where the integer filling of localized "f-orbitals" and Chern bands are simultaneously reached. Our findings update the field-dependent phase diagram of MATBG and directly support the topological heavy fermion model.