title: Making Old Things New: A Unified Algorithm for Differentially Private Clustering

abstract: As a staple of data analysis and unsupervised learning, the problem of private clustering has been widely studied under various privacy models. Centralized differential privacy is the first of them, and the problem has also been studied for the local and the shuffle variation. In each case, the goal is to design an algorithm that computes privately a clustering, with the smallest possible error. The study of each variation gave rise to new algorithms: the landscape of private clustering algorithms is therefore quite intricate. In this paper, we show that a 20-year-old algorithm can be slightly modified to work for any of these models. This provides a unified picture: while matching almost all previously known results, it allows us to improve some of them and extend it to a new privacy model, the continual observation setting, where the input is changing over time and the algorithm must output a new solution at each time step.


title: Multimodal Learning To Improve Segmentation With Intraoperative CBCT & Preoperative CT

abstract: Intraoperative medical imaging, particularly Cone-beam computed tomography (CBCT), is an important tool facilitating computer aided interventions, despite a lower visual quality. While this degraded image quality can affect downstream segmentation, the availability of high quality preoperative scans represents potential for improvements. Here we consider a setting where preoperative CT and intraoperative CBCT scans are available, however, the alignment (registration) between the scans is imperfect. We propose a multimodal learning method that fuses roughly aligned CBCT and CT scans and investigate the effect of CBCT quality and misalignment (affine and elastic transformations facilitating misalignment) on the final segmentation performance. As an application scenario, we focus on the segmentation of liver and liver tumor semantic segmentation and evaluate the effect of intraoperative image quality and misalignment on segmentation performance. To accomplish this, high quality, labelled CTs are defined as preoperative and used as a basis to simulate intraoperative CBCT. We show that the fusion of preoperative CT and simulated, intraoperative CBCT mostly improves segmentation performance and that even clearly misaligned preoperative data has the potential to improve segmentation performance.


title: A Two-dimensional Zero-shot Dialogue State Tracking Evaluation Method using GPT-4

abstract: Dialogue state tracking (DST) is evaluated by exact matching methods, which rely on large amounts of labeled data and ignore semantic consistency, leading to over-evaluation. Currently, leveraging large language models (LLM) in evaluating natural language processing tasks has achieved promising results. However, using LLM for DST evaluation is still under explored. In this paper, we propose a two-dimensional zero-shot evaluation method for DST using GPT-4, which divides the evaluation into two dimensions: accuracy and completeness. Furthermore, we also design two manual reasoning paths in prompting to further improve the accuracy of evaluation. Experimental results show that our method achieves better performance compared to the baselines, and is consistent with traditional exact matching based methods.


title: Statistical Evolution of ODI Cricket: Analyzing Performance Trends and Effect Sizes

abstract: In the dynamic realm of One Day International (ODI) cricket, the sport has undergone significant transformations over the past four decades. This study digs into the intricate evolution of ODI cricket from 1987 to 2023, analyzing about 4000 matches to uncover pivotal performance indicators such as batting prowess, bowling efficiency, and partnership dynamics. Employing statistical methodologies, including Cohen's effect size, we scrutinize the observed changes that have shaped ODI cricket's landscape. Our findings reveal nuanced trends: while first innings scores have shown stability with sporadic high outliers in recent years, the impact of achieving scores exceeding 300 has notably increased. Furthermore, batting depth and early wickets lost in the first innings continue to significantly influence match outcomes, highlighting strategic shifts in team approaches. We also observe improvements in second innings bowling effectiveness, particularly in wicket-taking ability, underscoring evolving defensive strategies. This research contributes a statistical foundation to comprehensively understand the evolving dynamics of ODI cricket, offering insights crucial for strategic decision-making and further analysis in sports analytics.


title: Communication-Efficient MARL for Platoon Stability and Energy-efficiency Co-optimization in Cooperative Adaptive Cruise Control of CAVs

abstract: Cooperative adaptive cruise control (CACC) has been recognized as a fundamental function of autonomous driving, in which platoon stability and energy efficiency are outstanding challenges that are difficult to accommodate in real-world operations. This paper studied the CACC of connected and autonomous vehicles (CAVs) based on the multi-agent reinforcement learning algorithm (MARL) to optimize platoon stability and energy efficiency simultaneously. The optimal use of communication bandwidth is the key to guaranteeing learning performance in real-world driving, and thus this paper proposes a communication-efficient MARL by incorporating the quantified stochastic gradient descent (QSGD) and a binary differential consensus (BDC) method into a fully-decentralized MARL framework. We benchmarked the performance of our proposed BDC-MARL algorithm against several several non-communicative andcommunicative MARL algorithms, e.g., IA2C, FPrint, and DIAL, through the evaluation of platoon stability, fuel economy, and driving comfort. Our results show that BDC-MARL achieved the highest energy savings, improving by up to 5.8%, with an average velocity of 15.26 m/s and an inter-vehicle spacing of 20.76 m. In addition, we conducted different information-sharing analyses to assess communication efficacy, along with sensitivity analyses and scalability tests with varying platoon sizes. The practical effectiveness of our approach is further demonstrated using real-world scenarios sourced from open-sourced OpenACC.


title: Ruby Teaming: Improving Quality Diversity Search with Memory for Automated Red Teaming

abstract: We propose Ruby Teaming, a method that improves on Rainbow Teaming by including a memory cache as its third dimension. The memory dimension provides cues to the mutator to yield better-quality prompts, both in terms of attack success rate (ASR) and quality diversity. The prompt archive generated by Ruby Teaming has an ASR of 74%, which is 20% higher than the baseline. In terms of quality diversity, Ruby Teaming outperforms Rainbow Teaming by 6% and 3% on Shannon's Evenness Index (SEI) and Simpson's Diversity Index (SDI), respectively.


title: Monolithic Multi-parameter Terahertz Nano-micro Detector Based on Plasmon Polariton Atomic Cavity

abstract: Terahertz signals hold significant potential for ultra-wideband communication and high-resolution radar, necessitating miniaturized detectors capable of multi-parameter detection of intensity, frequency, polarization, and phase. Conventional detectors cannot meet these requirements. Here, we propose plasmon polariton atomic cavities (PPAC) made from single-atom-thick graphene, demonstrating the monolithic multifunctional miniaturized detector. With a footprint one-tenth the incident wavelength, the detector offers benchmarking intensity-, frequency-, and polarization-sensitive detection, rapid response, and sub-diffraction spatial resolution, all operating at room temperature across 0.22 to 4.24 THz. We present the monolithic detection applications for free-space THz polarization-coded communication and stealth imaging of physical properties. These results showcase the PPAC's unique ability to achieve strong absorption and weak signal detection with a thickness of only 10^-5 of the excitation wavelength, which is inaccessible with other approaches.


title: Seshadri constants on $\mathbb{P}^1\times\mathbb{P}^1$, and a solution to the symplectic packing problem

abstract: In this paper we compute the $r$-point Seshadri constant on $\mathbb{P}^1\times\mathbb{P}^1$ for those line bundles where the answer might be expected to be governed by $(-1)$-curves. As a consequence we solve the symplectic packing problem for $\mathbb{P}^1\times\mathbb{P}^1$. Some results on the $r$-point Seshadri constant for other line bundles are given. These latter results use a useful new "reflection method". In the analysis there is a striking difference between the cases when $r$ is odd and when $r$ is even. When $r$ is even the problem admits an infinite order automorphism, and there are infinitely many $(-1)$-curves to consider. In contrast, when $r$ is odd only a finite number (usually $4$) types of $(-1)$-curves are relevant to our answer.


title: Can LLM be a Personalized Judge?

abstract: Ensuring that large language models (LLMs) reflect diverse user values and preferences is crucial as their user bases expand globally. It is therefore encouraging to see the growing interest in LLM personalization within the research community. However, current works often rely on the LLM-as-a-Judge approach for evaluation without thoroughly examining its validity. In this paper, we investigate the reliability of LLM-as-a-Personalized-Judge, asking LLMs to judge user preferences based on personas. Our findings suggest that directly applying LLM-as-a-Personalized-Judge is less reliable than previously assumed, showing low and inconsistent agreement with human ground truth. The personas typically used are often overly simplistic, resulting in low predictive power. To address these issues, we introduce verbal uncertainty estimation into the LLM-as-a-Personalized-Judge pipeline, allowing the model to express low confidence on uncertain judgments. This adjustment leads to much higher agreement (above 80%) on high-certainty samples for binary tasks. Through human evaluation, we find that the LLM-as-a-Personalized-Judge achieves comparable performance to third-party humans evaluation and even surpasses human performance on high-certainty samples. Our work indicates that certainty-enhanced LLM-as-a-Personalized-Judge offers a promising direction for developing more reliable and scalable methods for evaluating LLM personalization.


title: Dissecting van der Waals interactions with Density Functional Theory -- Wannier-basis approach

abstract: A new scheme for the computation of dispersive interactions from first principles is presented. This cost-effective approach relies on a Wannier function representation compatible with density function theory descriptions. This is an electronic-based many-body method that captures the full electronic and optical response properties of the materials. It provides the foundation to discern van der Waals and induction energies as well as the role of anisotropy and different stacking patterns when computing dispersive interactions in systems. Calculated results for binding energies in layered materials, such as graphite, hBN, and MoS$_2$ give encouraging comparisons with available experimental data. Strategies for broadened computational descriptions of dispersive interactions are also discussed. Our investigation aims at stimulating new experimental studies to measure van der Waals energies in a wider range of materials, especially in layered systems.

categories: cond-mat.mtrl-sci cond-mat.mes-hall physics.chem-ph physics.comp-ph quant-ph


title: Discriminative Hamiltonian Variational Autoencoder for Accurate Tumor Segmentation in Data-Scarce Regimes

abstract: Deep learning has gained significant attention in medical image segmentation. However, the limited availability of annotated training data presents a challenge to achieving accurate results. In efforts to overcome this challenge, data augmentation techniques have been proposed. However, the majority of these approaches primarily focus on image generation. For segmentation tasks, providing both images and their corresponding target masks is crucial, and the generation of diverse and realistic samples remains a complex task, especially when working with limited training datasets. To this end, we propose a new end-to-end hybrid architecture based on Hamiltonian Variational Autoencoders (HVAE) and a discriminative regularization to improve the quality of generated images. Our method provides an accuracte estimation of the joint distribution of the images and masks, resulting in the generation of realistic medical images with reduced artifacts and off-distribution instances. As generating 3D volumes requires substantial time and memory, our architecture operates on a slice-by-slice basis to segment 3D volumes, capitilizing on the richly augmented dataset. Experiments conducted on two public datasets, BRATS (MRI modality) and HECKTOR (PET modality), demonstrate the efficacy of our proposed method on different medical imaging modalities with limited data.


title: Moral Hazard with Network Effects

abstract: I study a moral hazard problem between a principal and multiple agents who experience positive peer effects represented by a (weighted) network. Under the optimal linear contract, the principal provides high-powered incentives to central agents in the network in order to exploit the larger incentive spillovers such agents create. The analysis reveals a novel measure of network centrality that captures rich channels of direct and indirect incentive spillovers and characterizes the optimal contract and its induced equilibrium efforts. The notion of centrality relevant for incentive spillovers in the model emphasizes the role of pairs of agents who link to common neighbors in the network. This characterization leads to a measure of marginal network effects and identifies the agents whom the principal targets with stronger incentives in response to the addition (or strengthening) of a link. When the principal can position agents with heterogeneous costs of effort in the network, the principal prefers to place low-cost agents in central positions. The results shed light on how firms can increase productivity through corporate culture, office layout, and social interactions.


title: Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Prompting

abstract: Socio-demographic prompting is a commonly employed approach to study cultural biases in LLMs as well as for aligning models to certain cultures. In this paper, we systematically probe four LLMs (Llama 3, Mistral v0.2, GPT-3.5 Turbo and GPT-4) with prompts that are conditioned on culturally sensitive and non-sensitive cues, on datasets that are supposed to be culturally sensitive (EtiCor and CALI) or neutral (MMLU and ETHICS). We observe that all models except GPT-4 show significant variations in their responses on both kinds of datasets for both kinds of prompts, casting doubt on the robustness of the culturally-conditioned prompting as a method for eliciting cultural bias in models or as an alignment strategy. The work also calls rethinking the control experiment design to tease apart the cultural conditioning of responses from "placebo effect", i.e., random perturbations of model responses due to arbitrary tokens in the prompt.


title: Deep material networks for fiber suspensions with infinite material contrast

abstract: We extend the laminate based framework of direct Deep Material Networks (DMNs) to treat suspensions of rigid fibers in a non-Newtonian solvent. To do so, we derive two-phase homogenization blocks that are capable of treating incompressible fluid phases and infinite material contrast. In particular, we leverage existing results for linear elastic laminates to identify closed form expressions for the linear homogenization functions of two-phase layered emulsions. To treat infinite material contrast, we rely on the repeated layering of two-phase layered emulsions in the form of coated layered materials. We derive necessary and sufficient conditions which ensure that the effective properties of coated layered materials with incompressible phases are non-singular, even if one of the phases is rigid. With the derived homogenization blocks and non-singularity conditions at hand, we present a novel DMN architecture, which we name the Flexible DMN (FDMN) architecture. We build and train FDMNs to predict the effective stress response of shear-thinning fiber suspensions with a Cross-type matrix material. For 31 fiber orientation states, six load cases, and over a wide range of shear rates relevant to engineering processes, the FDMNs achieve validation errors below 4.31% when compared to direct numerical simulations with Fast-Fourier-Transform based computational techniques. Compared to a conventional machine learning approach introduced previously by the consortium of authors, FDMNs offer better accuracy at an increased computational cost for the considered material and flow scenarios.


title: A note on one sided extrapolation of compactness and applications

abstract: In this paper one sided counterparts of compactness extrapolation results of Hyt\"onen and Lappas are provided. As a consequence of those results, compactness results for one sided singular integrals, commutators of one sided fractional integrals and a certain class of L^{r}-H\"ormander operators are provided. The results for commutators of $L^{r}$-H\"ormander operators seem new even in the classical setting.


title: Diffusion Generative Modelling for Divide-and-Conquer MCMC

abstract: Divide-and-conquer MCMC is a strategy for parallelising Markov Chain Monte Carlo sampling by running independent samplers on disjoint subsets of a dataset and merging their output. An ongoing challenge in the literature is to efficiently perform this merging without imposing distributional assumptions on the posteriors. We propose using diffusion generative modelling to fit density approximations to the subposterior distributions. This approach outperforms existing methods on challenging merging problems, while its computational cost scales more efficiently to high dimensional problems than existing density estimation approaches.


title: See It from My Perspective: Diagnosing the Western Cultural Bias of Large Vision-Language Models in Image Understanding

abstract: Vision-language models (VLMs) can respond to queries about images in many languages. However, beyond language, culture affects how we see things. For example, individuals from Western cultures focus more on the central figure in an image while individuals from Eastern cultures attend more to scene context. In this work, we present a novel investigation that demonstrates and localizes VLMs' Western bias in image understanding. We evaluate large VLMs across subjective and objective visual tasks with culturally diverse images and annotations. We find that VLMs perform better on the Western subset than the Eastern subset of each task. Controlled experimentation tracing the source of this bias highlights the importance of a diverse language mix in text-only pre-training for building equitable VLMs, even when inference is performed in English. Moreover, while prompting in the language of a target culture can lead to reductions in bias, it is not a substitute for building AI more representative of the world's languages.


title: ROTI-GCV: Generalized Cross-Validation for right-ROTationally Invariant Data

abstract: Two key tasks in high-dimensional regularized regression are tuning the regularization strength for good predictions and estimating the out-of-sample risk. It is known that the standard approach -- $k$-fold cross-validation -- is inconsistent in modern high-dimensional settings. While leave-one-out and generalized cross-validation remain consistent in some high-dimensional cases, they become inconsistent when samples are dependent or contain heavy-tailed covariates. To model structured sample dependence and heavy tails, we use right-rotationally invariant covariate distributions - a crucial concept from compressed sensing. In the common modern proportional asymptotics regime where the number of features and samples grow comparably, we introduce a new framework, ROTI-GCV, for reliably performing cross-validation. Along the way, we propose new estimators for the signal-to-noise ratio and noise variance under these challenging conditions. We conduct extensive experiments that demonstrate the power of our approach and its superiority over existing methods.


title: Is Efficient PAC Learning Possible with an Oracle That Responds 'Yes' or 'No'?

abstract: The empirical risk minimization (ERM) principle has been highly impactful in machine learning, leading both to near-optimal theoretical guarantees for ERM-based learning algorithms as well as driving many of the recent empirical successes in deep learning. In this paper, we investigate the question of whether the ability to perform ERM, which computes a hypothesis minimizing empirical risk on a given dataset, is necessary for efficient learning: in particular, is there a weaker oracle than ERM which can nevertheless enable learnability? We answer this question affirmatively, showing that in the realizable setting of PAC learning for binary classification, a concept class can be learned using an oracle which only returns a single bit indicating whether a given dataset is realizable by some concept in the class. The sample complexity and oracle complexity of our algorithm depend polynomially on the VC dimension of the hypothesis class, thus showing that there is only a polynomial price to pay for use of our weaker oracle. Our results extend to the agnostic learning setting with a slight strengthening of the oracle, as well as to the partial concept, multiclass and real-valued learning settings. In the setting of partial concept classes, prior to our work no oracle-efficient algorithms were known, even with a standard ERM oracle. Thus, our results address a question of Alon et al. (2021) who asked whether there are algorithmic principles which enable efficient learnability in this setting.


title: "Not Aligned" is Not "Malicious": Being Careful about Hallucinations of Large Language Models' Jailbreak

abstract: "Jailbreak" is a major safety concern of Large Language Models (LLMs), which occurs when malicious prompts lead LLMs to produce harmful outputs, raising issues about the reliability and safety of LLMs. Therefore, an effective evaluation of jailbreaks is very crucial to develop its mitigation strategies. However, our research reveals that many jailbreaks identified by current evaluations may actually be hallucinations-erroneous outputs that are mistaken for genuine safety breaches. This finding suggests that some perceived vulnerabilities might not represent actual threats, indicating a need for more precise red teaming benchmarks. To address this problem, we propose the $\textbf{B}$enchmark for reli$\textbf{AB}$ilit$\textbf{Y}$ and jail$\textbf{B}$reak ha$\textbf{L}$l$\textbf{U}$cination $\textbf{E}$valuation (BabyBLUE). BabyBLUE introduces a specialized validation framework including various evaluators to enhance existing jailbreak benchmarks, ensuring outputs are useful malicious instructions. Additionally, BabyBLUE presents a new dataset as an augmentation to the existing red teaming benchmarks, specifically addressing hallucinations in jailbreaks, aiming to evaluate the true potential of jailbroken LLM outputs to cause harm to human society.


title: AsterX: a new open-source GPU-accelerated GRMHD code for dynamical spacetimes

abstract: We present AsterX, a novel open-source, GPU-accelerated, fully general relativistic magnetohydrodynamic (GRMHD) code designed for dynamic spacetimes in 3D Cartesian coordinates, and tailored for exascale computing. We utilize block-structured adaptive mesh refinement (AMR) through CarpetX, the new driver for the Einstein Toolkit, which is built on AMReX, a software framework for massively parallel applications. AsterX employs the Valencia formulation for GRMHD, coupled with the 'Z4c' formalism for spacetime evolution, while incorporating high resolution shock capturing schemes to accurately handle the hydrodynamics. AsterX has undergone rigorous testing in both static and dynamic spacetime, demonstrating remarkable accuracy and agreement with other codes in literature. Benchmarking the code through scaling tests on OLCF's Frontier supercomputer, we demonstrate a weak scaling efficiency of about 67%-77% on 4096 nodes compared to an 8-node performance.


title: Benchmarking of LLM Detection: Comparing Two Competing Approaches

abstract: This article gives an overview of the field of LLM text recognition. Different approaches and implemented detectors for the recognition of LLM-generated text are presented. In addition to discussing the implementations, the article focuses on benchmarking the detectors. Although there are numerous software products for the recognition of LLM-generated text, with a focus on ChatGPT-like LLMs, the quality of the recognition (recognition rate) is not clear. Furthermore, while it can be seen that scientific contributions presenting their novel approaches strive for some kind of comparison with other approaches, the construction and independence of the evaluation dataset is often not comprehensible. As a result, discrepancies in the performance evaluation of LLM detectors are often visible due to the different benchmarking datasets. This article describes the creation of an evaluation dataset and uses this dataset to investigate the different detectors. The selected detectors are benchmarked against each other.


title: The Black Hole Explorer: Using the Photon Ring to Visualize Spacetime Around the Black Hole

abstract: The Black Hole Explorer (BHEX), an orbiting, multi-band, millimeter radio-telescope, in hybrid combination with millimeter terrestrial radio-telescopes, is designed to discover and measure the thin photon ring around the supermassive black holes M87* and Sgr A*. As background to the BHEX instruments, this paper explores various aspects of the photon ring, focusing on the intricate flow of light around a spinning black hole, and tracking, through visual simulations, photons as they course along geodesics. Ultimately, the aim of these visualizations is to advance the foundational aims of the BHEX instrument, and through this experiment to articulate spacetime geometry via the photon ring.


title: Effective Rank Analysis and Regularization for Enhanced 3D Gaussian Splatting

abstract: 3D reconstruction from multi-view images is one of the fundamental challenges in computer vision and graphics. Recently, 3D Gaussian Splatting (3DGS) has emerged as a promising technique capable of real-time rendering with high-quality 3D reconstruction. This method utilizes 3D Gaussian representation and tile-based splatting techniques, bypassing the expensive neural field querying. Despite its potential, 3DGS encounters challenges, including needle-like artifacts, suboptimal geometries, and inaccurate normals, due to the Gaussians converging into anisotropic Gaussians with one dominant variance. We propose using effective rank analysis to examine the shape statistics of 3D Gaussian primitives, and identify the Gaussians indeed converge into needle-like shapes with the effective rank 1. To address this, we introduce effective rank as a regularization, which constrains the structure of the Gaussians. Our new regularization method enhances normal and geometry reconstruction while reducing needle-like artifacts. The approach can be integrated as an add-on module to other 3DGS variants, improving their quality without compromising visual fidelity.


title: Modified homotopy approach for diffractive production in the saturation region

abstract: In this paper we continue to develop the homotopy method for solving of the non linear evolution equation for the diffractive production in deep inelastic scattering(DIS). We introduce part of the nonlinear corrections as a first step of this approach. This simplified nonlinear evolution equation is solved analytically taking into account the initial and boundary conditions for the process. At the second step of our approach we demonstrated that the perturbative procedure can be used for the remaining parts of the non-linear corrections. It turns out that these corrections are small and can be estimated in the regular iterative procedure.


title: Endor: Hardware-Friendly Sparse Format for Offloaded LLM Inference

abstract: The increasing size of large language models (LLMs) challenges their usage on resource-constrained platforms. For example, memory on modern GPUs is insufficient to hold LLMs that are hundreds of Gigabytes in size. Offloading is a popular method to escape this constraint by storing weights of an LLM model to host CPU memory and SSD, then loading each weight to GPU before every use. In our case study of offloaded inference, we found that due to the low bandwidth between storage devices and GPU, the latency of transferring large model weights from its offloaded location to GPU memory becomes the critical bottleneck with actual compute taking nearly 0% of runtime. To effectively reduce the weight transfer latency, we propose a novel sparse format that compresses the unstructured sparse pattern of pruned LLM weights to non-zero values with high compression ratio and low decompression overhead. Endor achieves this by expressing the positions of non-zero elements with a bitmap. Compared to offloaded inference using the popular Huggingface Accelerate, applying Endor accelerates OPT-66B by 1.70x and Llama2-70B by 1.78x. When direct weight transfer from SSD to GPU is leveraged, Endor achieves 2.25x speedup on OPT-66B and 2.37x speedup on Llama2-70B.


title: BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models

abstract: Large Language Models (LLMs) often suffer from overconfidence during inference, particularly when adapted to downstream domain-specific tasks with limited data. Previous work addresses this issue by employing approximate Bayesian estimation after the LLMs are trained, enabling them to quantify uncertainty. However, such post-training approaches' performance is severely limited by the parameters learned during training. In this paper, we go beyond post-training Bayesianization and propose Bayesian Low-Rank Adaptation by Backpropagation (BLoB), an algorithm that continuously and jointly adjusts both the mean and covariance of LLM parameters throughout the whole fine-tuning process. Our empirical results verify the effectiveness of BLoB in terms of generalization and uncertainty estimation, when evaluated on both in-distribution and out-of-distribution data.


title: Score-fPINN: Fractional Score-Based Physics-Informed Neural Networks for High-Dimensional Fokker-Planck-Levy Equations

abstract: We introduce an innovative approach for solving high-dimensional Fokker-Planck-L\'evy (FPL) equations in modeling non-Brownian processes across disciplines such as physics, finance, and ecology. We utilize a fractional score function and Physical-informed neural networks (PINN) to lift the curse of dimensionality (CoD) and alleviate numerical overflow from exponentially decaying solutions with dimensions. The introduction of a fractional score function allows us to transform the FPL equation into a second-order partial differential equation without fractional Laplacian and thus can be readily solved with standard physics-informed neural networks (PINNs). We propose two methods to obtain a fractional score function: fractional score matching (FSM) and score-fPINN for fitting the fractional score function. While FSM is more cost-effective, it relies on known conditional distributions. On the other hand, score-fPINN is independent of specific stochastic differential equations (SDEs) but requires evaluating the PINN model's derivatives, which may be more costly. We conduct our experiments on various SDEs and demonstrate numerical stability and effectiveness of our method in dealing with high-dimensional problems, marking a significant advancement in addressing the CoD in FPL equations.


title: Neural Quantum State Study of Fracton Models

abstract: Fracton models host unconventional topological orders in three and higher dimensions and provide promising candidates for quantum memory platforms. Understanding their robustness against quantum fluctuations is an important task but also poses great challenges due to the lack of efficient numerical tools. In this work, we establish neural quantum states (NQS) as new tools to study phase transitions in these models. Exact and efficient parametrizations are derived for three prototypical fracton codes - the checkerboard and X-cube model, as well as Haah's code - both in terms of a restricted Boltzmann machine (RBM) and a correlation-enhanced RBM. We then adapt the correlation-enhanced RBM architecture to a perturbed checkerboard model and reveal its strong first-order phase transition between the fracton phase and a trivial field-polarizing phase. To this end, we simulate this highly entangled system on lattices of up to 512 qubits with high accuracy, representing a cutting-edge application of variational neural-network methods. Our work demonstrates the remarkable potential of NQS in studying complicated three-dimensional problems and highlights physics-oriented constructions of NQS architectures.


title: TourRank: Utilizing Large Language Models for Documents Ranking with a Tournament-Inspired Strategy

abstract: Large Language Models (LLMs) are increasingly employed in zero-shot documents ranking, yielding commendable results. However, several significant challenges still persist in LLMs for ranking: (1) LLMs are constrained by limited input length, precluding them from processing a large number of documents simultaneously; (2) The output document sequence is influenced by the input order of documents, resulting in inconsistent ranking outcomes; (3) Achieving a balance between cost and ranking performance is quite challenging. To tackle these issues, we introduce a novel documents ranking method called TourRank, which is inspired by the tournament mechanism. This approach alleviates the impact of LLM's limited input length through intelligent grouping, while the tournament-like points system ensures robust ranking, mitigating the influence of the document input sequence. We test TourRank with different LLMs on the TREC DL datasets and the BEIR benchmark. Experimental results show that TourRank achieves state-of-the-art performance at a reasonable cost.


title: Voltage control of spin resonance in phase change materials

abstract: Metal-insulator transitions (MITs) in resistive switching materials can be triggered by an electric stimulus that produces significant changes in the electrical response. When these phases have distinct magnetic characteristics, dramatic changes in spin excitations are also expected. The transition metal oxide La0.7Sr0.3MnO3 (LSMO) is a ferromagnetic metal at low temperatures and a paramagnetic insulator above room temperature. When LSMO is in its metallic phase a critical electrical bias has been shown to lead to an MIT that results in the formation of a paramagnetic resistive barrier transverse to the applied electric field. Using spin-transfer ferromagnetic resonance spectroscopy, we show that even for electrical biases less than the critical value that triggers the MIT, there is magnetic phase separation with the spin-excitation resonances varying systematically with applied bias. Thus, applied voltages provide a means to alter spin resonance characteristics of interest for neuromorphic circuits.


title: ZTF SN Ia DR2: Exploring SN Ia properties in the vicinity of under-dense environments

abstract: The unprecedented statistics of detected Type Ia supernovae (SNe Ia) brought by the Zwicky Transient Facility enables us to probe the impact of the Large-Scale Structure on the properties of these objects. The goal of this paper is to explore the possible impact of the under-dense part of the large-scale structure on the intrinsic SALT2 light curve properties of SNe Ia and uncover possible biases in SN Ia analyses. With a volume-limited selection of ZTF-Cosmo-DR2 Type Ia supernovae overlapping with the SDSS-DR7 survey footprint, we investigate the distribution of their properties with regard to voids detected in the SDSS-DR7 galaxy sample. We further use Voronoi volumes as proxy for local density environments within the large-scale structure. We find a moderate dependency of the stretch toward the localisation around the void centre and none when considering colour. The local Voronoi volumes mostly affect the fraction of low/high stretch supernovae. With the current statistics available, we consider that the impact of high or low local density environment can be considered as a proxy for the colour of the host galaxy. Under-dense environments should not cause any biases in supernova analyses.


title: R-Eval: A Unified Toolkit for Evaluating Domain Knowledge of Retrieval Augmented Large Language Models

abstract: Large language models have achieved remarkable success on general NLP tasks, but they may fall short for domain-specific problems. Recently, various Retrieval-Augmented Large Language Models (RALLMs) are proposed to address this shortcoming. However, existing evaluation tools only provide a few baselines and evaluate them on various domains without mining the depth of domain knowledge. In this paper, we address the challenges of evaluating RALLMs by introducing the R-Eval toolkit, a Python toolkit designed to streamline the evaluation of different RAG workflows in conjunction with LLMs. Our toolkit, which supports popular built-in RAG workflows and allows for the incorporation of customized testing data on the specific domain, is designed to be user-friendly, modular, and extensible. We conduct an evaluation of 21 RALLMs across three task levels and two representative domains, revealing significant variations in the effectiveness of RALLMs across different tasks and domains. Our analysis emphasizes the importance of considering both task and domain requirements when choosing a RAG workflow and LLM combination. We are committed to continuously maintaining our platform at https://github.com/THU-KEG/R-Eval to facilitate both the industry and the researchers.


title: Knowledge-to-Jailbreak: One Knowledge Point Worth One Attack

abstract: Large language models (LLMs) have been increasingly applied to various domains, which triggers increasing concerns about LLMs' safety on specialized domains, e.g. medicine. However, testing the domain-specific safety of LLMs is challenging due to the lack of domain knowledge-driven attacks in existing benchmarks. To bridge this gap, we propose a new task, knowledge-to-jailbreak, which aims to generate jailbreaks from domain knowledge to evaluate the safety of LLMs when applied to those domains. We collect a large-scale dataset with 12,974 knowledge-jailbreak pairs and fine-tune a large language model as jailbreak-generator, to produce domain knowledge-specific jailbreaks. Experiments on 13 domains and 8 target LLMs demonstrate the effectiveness of jailbreak-generator in generating jailbreaks that are both relevant to the given knowledge and harmful to the target LLMs. We also apply our method to an out-of-domain knowledge base, showing that jailbreak-generator can generate jailbreaks that are comparable in harmfulness to those crafted by human experts. Data and code: https://github.com/THU-KEG/Knowledge-to-Jailbreak/.


title: HoLLMwood: Unleashing the Creativity of Large Language Models in Screenwriting via Role Playing

abstract: Generative AI has demonstrated unprecedented creativity in the field of computer vision, yet such phenomena have not been observed in natural language processing. In particular, large language models (LLMs) can hardly produce written works at the level of human experts due to the extremely high complexity of literature writing. In this paper, we present HoLLMwood, an automated framework for unleashing the creativity of LLMs and exploring their potential in screenwriting, which is a highly demanding task. Mimicking the human creative process, we assign LLMs to different roles involved in the real-world scenario. In addition to the common practice of treating LLMs as ${Writer}$, we also apply LLMs as ${Editor}$, who is responsible for providing feedback and revision advice to ${Writer}$. Besides, to enrich the characters and deepen the plots, we introduce a role-playing mechanism and adopt LLMs as ${Actors}$ that can communicate and interact with each other. Evaluations on automatically generated screenplays show that HoLLMwood substantially outperforms strong baselines in terms of coherence, relevance, interestingness and overall quality.


title: Lopsided distribution of MATLAS and ELVES dwarf satellite systems around isolated host galaxies

abstract: The properties of satellite dwarf galaxies pose important empirical constraints to verify cosmological models on galaxy scales. Their phase-space correlations, in particular, offer interesting insights into various models. Next to the planes-of-satellites phenomenon, the lopsided distribution of satellites relative to their host galaxy has been studied observationally and in cosmological simulations. It is still unclear how observed lopsidedness aligns with expectations from simulations. We measure lopsidedness in observed isolated satellite systems using six different metrics. We study 47 systems from the MATLAS survey beyond the Local Volume (LV) as well as 21 LV satellite systems from the ELVES survey. We find that the so-called wedge metric, counting the number of dwarfs in wedges with varying opening angles, is best suited to capture a system's overall lopsidedness. Under this metric, our analysis reveals that ~16 percent of the tested satellite systems exhibit a statistically significant degree of lopsidedness when compared to systems with randomly generated satellite position angles. This presents a notable excess over the expected 5% (2 sigma level) of significantly lopsided systems in a sample with no overall inherent lopsidedness. However, using multiple metrics provides a more complete picture. Combining all tested metrics, the number of significantly lopsided systems increases to ~21 percent. Contrary to recent results from the literature, we find more lopsided systems among the red early-type galaxies in the MATLAS survey compared to the mostly blue late-type hosts in ELVES. We further find that satellite galaxies at larger distances from the host, potentially recently accreted, are likely the primary contributors to the reported excess of lopsidedness. Our results enable comparisons with similar systems in simulations to assess consistency with the standard model.


title: Edge Classification on Graphs: New Directions in Topological Imbalance

abstract: Recent years have witnessed the remarkable success of applying Graph machine learning (GML) to node/graph classification and link prediction. However, edge classification task that enjoys numerous real-world applications such as social network analysis and cybersecurity, has not seen significant advancement. To address this gap, our study pioneers a comprehensive approach to edge classification. We identify a novel `Topological Imbalance Issue', which arises from the skewed distribution of edges across different classes, affecting the local subgraph of each edge and harming the performance of edge classifications. Inspired by the recent studies in node classification that the performance discrepancy exists with varying local structural patterns, we aim to investigate if the performance discrepancy in topological imbalanced edge classification can also be mitigated by characterizing the local class distribution variance. To overcome this challenge, we introduce Topological Entropy (TE), a novel topological-based metric that measures the topological imbalance for each edge. Our empirical studies confirm that TE effectively measures local class distribution variance, and indicate that prioritizing edges with high TE values can help address the issue of topological imbalance. Based on this, we develop two strategies - Topological Reweighting and TE Wedge-based Mixup - to focus training on (synthetic) edges based on their TEs. While topological reweighting directly manipulates training edge weights according to TE, our wedge-based mixup interpolates synthetic edges between high TE wedges. Ultimately, we integrate these strategies into a novel topological imbalance strategy for edge classification: TopoEdge. Through extensive experiments, we demonstrate the efficacy of our proposed strategies on newly curated datasets and thus establish a new benchmark for (imbalanced) edge classification.


title: The Role of Inherent Bellman Error in Offline Reinforcement Learning with Linear Function Approximation

abstract: In this paper, we study the offline RL problem with linear function approximation. Our main structural assumption is that the MDP has low inherent Bellman error, which stipulates that linear value functions have linear Bellman backups with respect to the greedy policy. This assumption is natural in that it is essentially the minimal assumption required for value iteration to succeed. We give a computationally efficient algorithm which succeeds under a single-policy coverage condition on the dataset, namely which outputs a policy whose value is at least that of any policy which is well-covered by the dataset. Even in the setting when the inherent Bellman error is 0 (termed linear Bellman completeness), our algorithm yields the first known guarantee under single-policy coverage. In the setting of positive inherent Bellman error ${\varepsilon_{\mathrm{BE}}} > 0$, we show that the suboptimality error of our algorithm scales with $\sqrt{\varepsilon_{\mathrm{BE}}}$. Furthermore, we prove that the scaling of the suboptimality with $\sqrt{\varepsilon_{\mathrm{BE}}}$ cannot be improved for any algorithm. Our lower bound stands in contrast to many other settings in reinforcement learning with misspecification, where one can typically obtain performance that degrades linearly with the misspecification error.


title: Tokenization Falling Short: The Curse of Tokenization

abstract: Language models typically tokenize raw text into sequences of subword identifiers from a predefined vocabulary, a process inherently sensitive to typographical errors, length variations, and largely oblivious to the internal structure of tokens-issues we term the curse of tokenization. In this study, we delve into these drawbacks and demonstrate that large language models (LLMs) remain susceptible to these problems. This study systematically investigates these challenges and their impact on LLMs through three critical research questions: (1) complex problem solving, (2) token structure probing, and (3) resilience to typographical variation. Our findings reveal that scaling model parameters can mitigate the issue of tokenization; however, LLMs still suffer from biases induced by typos and other text format variations. Our experiments show that subword regularization such as BPE-dropout can mitigate this issue. We will release our code and data to facilitate further research.


title: Independent [k]-Roman Domination on Graphs

abstract: Given a function $f\colon V(G) \to \mathbb{Z}_{\geq 0}$ on a graph $G$, $AN(v)$ denotes the set of neighbors of $v \in V(G)$ that have positive labels under $f$. In 2021, Ahangar et al.~introduced the notion of $[k]$-Roman Dominating Function ([$k$]-RDF) of a graph $G$, which is a function $f\colon V(G) \to \{0,1,\ldots,k+1\}$ such that $\sum_{u \in N[v]}f(u) \geq k + |AN(v)|$ for all $v \in V(G)$ with $f(v)<k$. The weight of $f$ is $\sum_{v \in V(G)}f(v)$. The $[k]$-Roman domination number, denoted by $\gamma_{[kR]}(G)$, is the minimum weight of a $[k]$-RDF of $G$. The notion of [$k$]-RDF for $k=1$ has been extensively investigated in the scientific literature since 2004, when introduced by Cockayne et al. as Roman Domination. An independent [$k$]-Roman dominating function ([$k$]-IRDF) $f\colon V(G) \to \{0,1,\ldots,k+1\}$ of a graph $G$ is a [$k$]-RDF of $G$ such that the set of vertices with positive labels is an independent set. The independent [$k$]-Roman domination number of $G$ is the minimum weight of a [$k$]-IRDF of $G$ and is denoted by $i_{[kR]}(G)$. In this paper, we propose the study of independent [$k$]-Roman domination on graphs for arbitrary $k \geq 1$. We prove that, for all $k\geq 3$, the decision problems associated with $i_{[kR]}(G)$ and $\gamma_{[kR]}(G)$ are NP-complete for planar bipartite graphs with maximum degree 3. We also present lower and upper bounds for $i_{[kR]}(G)$. Moreover, we present lower and upper bounds for the parameter $i_{[kR]}(G)$ for two families of 3-regular graphs called generalized Blanu\v{s}a snarks and Loupekine snarks.


title: Lightweight Model Pre-training via Language Guided Knowledge Distillation

abstract: This paper studies the problem of pre-training for small models, which is essential for many mobile devices. Current state-of-the-art methods on this problem transfer the representational knowledge of a large network (as a Teacher) into a smaller model (as a Student) using self-supervised distillation, improving the performance of the small model on downstream tasks. However, existing approaches are insufficient in extracting the crucial knowledge that is useful for discerning categories in downstream tasks during the distillation process. In this paper, for the first time, we introduce language guidance to the distillation process and propose a new method named Language-Guided Distillation (LGD) system, which uses category names of the target downstream task to help refine the knowledge transferred between the teacher and student. To this end, we utilize a pre-trained text encoder to extract semantic embeddings from language and construct a textual semantic space called Textual Semantics Bank (TSB). Furthermore, we design a Language-Guided Knowledge Aggregation (LGKA) module to construct the visual semantic space, also named Visual Semantics Bank (VSB). The task-related knowledge is transferred by driving a student encoder to mimic the similarity score distribution inferred by a teacher over TSB and VSB. Compared with other small models obtained by either ImageNet pre-training or self-supervised distillation, experiment results show that the distilled lightweight model using the proposed LGD method presents state-of-the-art performance and is validated on various downstream tasks, including classification, detection, and segmentation. We have made the code available at https://github.com/mZhenz/LGD.


title: Multi-parameter Hopf bifurcations of rimming flows

abstract: In order to investigate the emergence of periodic oscillations of rimming flows, we study analytically the stability of steady states for the model of (Benilov, Kopteva, O'Brien, 2005), which describes the dynamics of a thin fluid film coating the inner wall of a rotating cylinder and includes effects of surface tension, gravity, and hydrostatic pressure. We apply multi-parameter perturbation methods to eigenvalues of Fr\'echet derivatives and prove the transition of a pair of conjugate eigenvalues from the stable to the unstable complex half-plane under appropriate variations of parameters. In order to prove rigorously the corresponding branching of periodic solutions from critical equilibria, we extend the multi-parameter Hopf-bifurcation theory to the case of infinite-dimensional dynamical systems.


title: A search for the fine-structure constant evolution from fast radio bursts and type Ia supernovae data

abstract: The search for a space-time variation of the fundamental constants has been explored over the years to test our physical theories. In this paper, we use the dispersion measure ($DM$) of fast radio bursts (FRB) combined with type Ia supernovae (SNe) data to investigate a possible redshift evolution of the fine-structure constant ($\alpha$), considering the runaway dilaton scenario, which predicts $\frac{\Delta \alpha}{\alpha} = - \gamma\ln{(1+z)}$, where $\gamma$ is a constant proportional to the current value of the coupling between the dilaton field and hadronic matter. We derive all the relevant expressions for the $DM$ dependence concerning the fine-structure constant and constrain the parameter $\gamma$ from measurements of 17 well-localized FRBs and 1048 SNe data from the Pantheon compilation. We also use Monte Carlo simulations to forecast the constraining power of larger samples of FRB measurements for data sets with $N = 500$ and $N = 1000$ points. We found that the uncertainty on $\gamma$ can be improved by one order of magnitude and that limits on $\frac{\Delta \alpha}{\alpha}$ beyond $\sigma \sim 10^{-2}$ will depend crucially on better control of statistical and systematic uncertainties of upcoming FRB data.


title: Partial Scalar Curvatures and Topological Obstructions for Submanifolds

abstract: We investigate specific intrinsic curvatures $\rho_k$ (where $1\leq k\leq n$) that interpolate between the minimum Ricci curvature $\rho_1$ and the normalized scalar curvature $\rho_n=\rho$ of $n$-dimensional Riemannian manifolds. For $n$-dimensional submanifolds in space forms, these curvatures satisfy an inequality involving the mean curvature $H$ and the normal scalar curvature $\rho^\perp$, which reduces to the well-known DDVV inequality when $k=n$. We derive topological obstructions for compact $n$-dimensional submanifolds based on universal lower bounds of the $L^{n/2}$-norms of certain functions involving $\rho_k,H$ and $\rho^\perp$. These obstructions are expressed in terms of the Betti numbers. Our main result applies for any $1\leq k \leq n-1$, but it generally fails for $k=n$, where the involved norm vanishes precisely for Wintgen ideal submanifolds. We demonstrate this by providing a method of constructing new compact 3-dimensional minimal Wintgen ideal submanifolds in even-dimensional spheres. Specifically, we prove that such submanifolds exist in $\mathbb{S}^6$ with arbitrarily large first Betti number.


title: Wake dynamics of wind turbines in unsteady streamwise flow conditions

abstract: The unsteady flow physics of wind-turbine wakes under dynamic forcing conditions are critical to the modeling and control of wind farms for optimal power density. Unsteady forcing in the streamwise direction may be generated by unsteady inflow conditions in the atmospheric boundary layer, dynamic induction control of the turbine, or streamwise surge motions of a floating offshore wind turbine due to floating-platform oscillations. This study seeks to identify the dominant flow mechanisms in unsteady wakes forced by a periodic upstream inflow condition. A theoretical framework for the problem is derived, which describes traveling-wave undulations in the wake radius and streamwise velocity. These dynamics encourage the aggregation of tip vortices into large structures that are advected along in the wake. Flow measurements in the wake of a periodically surging turbine were obtained in an optically accessible towing-tank facility, with an average diameter-based Reynolds number of 300,000 and with surge-velocity amplitudes of up to 40% of the mean inflow velocity. Qualitative agreement between trends in the measurements and model predictions is observed, supporting the validity of the theoretical analyses. The experiments also demonstrate large enhancements in the recovery of the wake relative to the steady-flow case, with wake-length reductions of up to 46.5% and improvements in the available power at 10 diameters downstream of up to 15.7%. These results provide fundamental insights into the dynamics of unsteady wakes and serve as additional evidence that unsteady fluid mechanics can be leveraged to increase the power density of wind farms.


title: Correspondence between grey-body factors and quasinormal modes

abstract: Quasinormal modes and grey-body factors are spectral characteristics corresponding to different boundary conditions: the former imply purely outgoing waves to the event horizon and infinity, while the latter allow for an incoming wave from the horizon, thus describing a scattering problem. Nevertheless, we show that there a link between these two characteristics. We establish an approximate correspondence between the quasinormal modes and grey-body factors, which becomes exact in the high-frequency (eikonal) regime. We show that, in the eikonal regime, the grey-body factors of spherically symmetric black holes can be remarkably simply expressed via the fundamental quasinormal mode, while at smaller l, the correction terms include values of the overtones. This might be interesting in the context of the recently observed connection between grey-body factors and the amplitudes of gravitational waves from black holes. The correspondence might explain why grey-body factors are more stable, i.e. less sensitive, than higher overtones to small deformation of the effective potential.


title: Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs

abstract: Language Model Programs, i.e. sophisticated pipelines of modular language model (LM) calls, are increasingly advancing NLP tasks, but they require crafting prompts that are jointly effective for all modules. We study prompt optimization for LM programs, i.e. how to update these prompts to maximize a downstream metric without access to module-level labels or gradients. To make this tractable, we factorize our problem into optimizing the free-form instructions and few-shot demonstrations of every module and introduce several strategies to craft task-grounded instructions and navigate credit assignment across modules. Our strategies include (i) program- and data-aware techniques for proposing effective instructions, (ii) a stochastic mini-batch evaluation function for learning a surrogate model of our objective, and (iii) a meta-optimization procedure in which we refine how LMs construct proposals over time. Using these insights we develop MIPRO, a novel optimizer that outperforms baselines on five of six diverse LM programs using a best-in-class open-source model (Llama-3-8B), by as high as 12.9% accuracy. We will release our new optimizers and benchmark in DSPy at https://github.com/stanfordnlp/dspy


title: Robust positive model reduction via monotone matrices

abstract: This work focuses on the problem of exact model reduction of positive linear systems, by leveraging minimal realization theory. While even determining the existence of a positive reachable realization remains an open problem, we are able to fully characterize the cases in which the new model is obtained with non-negative reduction matrices, and hence positivity of the reduced model is robust with respect to small perturbations of original system. The characterization is obtained by specializing monotone matrix theory to positive matrices. In addition, we provide positive reduction also when minimal ones are not available, by exploiting algebraic techniques.


title: GridSweep Simulation: Measuring Subsynchronous Impedance Spectra of Distribution Feeder

abstract: Peaks and troughs in the subsynchronous impedance spectrum of a distribution feeder may be a useful indication of oscillation risk, or more importantly lack of oscillation risk, if inverter-based resource (IBR) deployments are increased on that feeder. GridSweep is a new instrument for measuring the subsynchronous impedance spectra of distribution feeders. It combines an active probing device that modulates a 120-volt 1-kW load sinusoidally at a user-selected GPS-phase locked frequency from 1.0 to 40.0 Hz, and with a recorder that takes ultra-high-precision continuous point-on-wave (CPOW) 120-volt synchrowaveforms at 4 kHz. This paper presents a computer simulation of GridSweep's probing and measurement capability. We construct an electromagnetic transient (EMT) simulation of a single-phase distribution feeder equipped with multiple inverter-based resources (IBRs). We include a model of the GridSweep probing device, then demonstrate the model's capability to measure the subsynchronous apparent impedance spectrum of the feeder. Peaks in that spectrum align with the system's dominant oscillation modes caused by IBRs.


title: Meta Reasoning for Large Language Models

abstract: We introduce Meta-Reasoning Prompting (MRP), a novel and efficient system prompting method for large language models (LLMs) inspired by human meta-reasoning. Traditional in-context learning-based reasoning techniques, such as Tree-of-Thoughts, show promise but lack consistent state-of-the-art performance across diverse tasks due to their specialized nature. MRP addresses this limitation by guiding LLMs to dynamically select and apply different reasoning methods based on the specific requirements of each task, optimizing both performance and computational efficiency. With MRP, LLM reasoning operates in two phases. Initially, the LLM identifies the most appropriate reasoning method using task input cues and objective descriptions of available methods. Subsequently, it applies the chosen method to complete the task. This dynamic strategy mirrors human meta-reasoning, allowing the model to excel in a wide range of problem domains. We evaluate the effectiveness of MRP through comprehensive benchmarks. The results demonstrate that MRP achieves or approaches state-of-the-art performance across diverse tasks. MRP represents a significant advancement in enabling LLMs to identify cognitive challenges across problems and leverage benefits across different reasoning approaches, enhancing their ability to handle diverse and complex problem domains efficiently. Every LLM deserves a Meta-Reasoning Prompting to unlock its full potential and ensure adaptability in an ever-evolving landscape of challenges and applications.


title: Circuit-Efficient Qubit-Excitation-based Variational Quantum Eigensolver

abstract: The wave function Ansatze are crucial in the context of the Variational Quantum Eigensolver (VQE). In the Noisy Intermediate-Scale Quantum era, the design of low-depth wave function Ansatze is of great importance for executing quantum simulations of electronic structure on noisy quantum devices. In this work, we present a circuit-efficient implementation of two-body Qubit-Excitation-Based (QEB) operator for building shallow-circuit wave function Ansatze within the framework of Adaptive Derivative-Assembled Pseudo-Trotter (ADAPT) VQE. This new algorithm is applied to study ground- and excited-sate problems for small molecules, demonstrating significant reduction of circuit depths compared to fermionic excitation-based and QEB ADAPT-VQE algorithms. This circuit-efficient algorithm shows great promise for quantum simulations of electronic structures, leading to improved performance on current quantum hardware.


title: Kelvin-Helmholtz instability and heating in oscillating loops perturbed by power-law transverse wave drivers

abstract: Instabilities in oscillating loops are believed to be essential for dissipating the wave energy and heating the solar coronal plasma. Our aim is to study the development of the Kelvin-Helmholtz (KH) instability in an oscillating loop that is driven by random footpoint motions. Using the PLUTO code, we performed 3D simulations of a straight gravitationally stratified flux tube. The loop footpoints are embedded in chromospheric plasma, in the presence of thermal conduction and an artificially broadened transition region. Using drivers with a power-law spectrum, one with a red noise spectrum and one with the low-frequency part subtracted, we excited standing oscillations and the KH instability in our loops, after one-and-a-half periods of the oscillation. We see that our broadband drivers lead to fully deformed, turbulent loop cross-sections over the entire coronal part of the loop due to the spatially extended KH instability. The low RMS velocity of our driver without the low-frequency components supports the working hypothesis that the KH instability can easily manifest in oscillating coronal loops. We report for the first time in driven transverse oscillations of loops the apparent propagation of density perturbations due to the onset of the KH instability, from the apex towards the footpoints. Both drivers input sufficient energy to drive enthalpy and mass flux fluctuations along the loop, while also causing heating near the driven footpoint of the oscillating loop, which becomes more prominent when a low-frequency component is included in the velocity driver. Finally, our power-law driver with the low-frequency component provides a RMS input Poynting flux of the same order as the radiative losses of the quiet-Sun corona, giving us promising prospects for the contribution of decayless oscillations in coronal heating.


title: Coronal energy release by MHD avalanches II. EUV line emission from a multi-threaded coronal loop

abstract: MHD kink instability can trigger the fragmentation of a twisted magnetic flux tube into small-scale current sheets that dissipate as aperiodic impulsive heating events. This instability propagates as an avalanche to nearby flux tubes and leads to a nanoflare storm. Our previous work was devoted to related 3D MHD numerical modeling with a stratified and realistic atmosphere. This work addresses predictions for the EUV imaging spectroscopy of such structure and evolution of a loop, with an average temperature of 2.5 MK in the solar corona. We set a particular focus on the forthcoming MUSE mission. From the output of the numerical simulations, we synthesized the intensities, Doppler shifts, and non-thermal line broadening in 3 EUV spectral lines in the MUSE passbands: Fe IX 171A, Fe XV 284 A, and Fe XIX 108 A, at 1 MK, 2 MK, and 10 MK, respectively, according to the MUSE expected pixel size, temporal resolution, and temperature response functions. We provide maps showing different view angles and realistic spectra. Finally, we discuss the relevant evolutionary processes from the perspective of possible observations. We find that the MUSE observations might be able to detect the fine structure determined by tube fragmentation. In particular, the Fe IX line is mostly emitted at the loop footpoints, where we track the motions that drive the magnetic stressing and detect the upward motion of evaporating plasma from the chromosphere. In Fe XV, we see the bulk of the loop with increasing intensity. The Fe XIX line is very faint within the chosen simulation parameters; thus, any transient brightening around the loop apex may possibly be emphasized by the folding of sheet-like structure. In conclusion, we show that coronal loop observations with MUSE can pinpoint some crucial features of MHD-modeled ignition processes, such as the related dynamics, helping to identify the heating processes.


title: Neutron Production in Simulations of Extensive Air Showers

abstract: Although the electromagnetic and muonic components of extensive air showers have been studied in great detail, no comprehensive simulation study of the neutron component is available. This is related to the complexity of neutron transport processes that is typically not treated in standard simulation tools. In this work we use the Monte Carlo simulation package Fluka to study the production and the transport of neutrons in extensive air showers over the full range of neutron energies, extending down to thermal neutrons. The importance of different neutron production mechanisms and their impact on predicted neutron distributions in energy, lateral distance, atmospheric depth, and arrival time are discussed. In addition, the dependencies of the predictions on the properties of the primary particle are studied. The results are compared to the equivalent distributions of muons, which serve as reference.


title: Multiple Descents in Unsupervised Learning: The Role of Noise, Domain Shift and Anomalies

abstract: The phenomenon of double descent has recently gained attention in supervised learning. It challenges the conventional wisdom of the bias-variance trade-off by showcasing a surprising behavior. As the complexity of the model increases, the test error initially decreases until reaching a certain point where the model starts to overfit the train set, causing the test error to rise. However, deviating from classical theory, the error exhibits another decline when exceeding a certain degree of over-parameterization. We study the presence of double descent in unsupervised learning, an area that has received little attention and is not yet fully understood. We conduct extensive experiments using under-complete auto-encoders (AEs) for various applications, such as dealing with noisy data, domain shifts, and anomalies. We use synthetic and real data and identify model-wise, epoch-wise, and sample-wise double descent for all the aforementioned applications. Finally, we assessed the usability of the AEs for detecting anomalies and mitigating the domain shift between datasets. Our findings indicate that over-parameterized models can improve performance not only in terms of reconstruction, but also in enhancing capabilities for the downstream task.


title: Nemotron-4 340B Technical Report

abstract: We release the Nemotron-4 340B model family, including Nemotron-4-340B-Base, Nemotron-4-340B-Instruct, and Nemotron-4-340B-Reward. Our models are open access under the NVIDIA Open Model License Agreement, a permissive model license that allows distribution, modification, and use of the models and its outputs. These models perform competitively to open access models on a wide range of evaluation benchmarks, and were sized to fit on a single DGX H100 with 8 GPUs when deployed in FP8 precision. We believe that the community can benefit from these models in various research studies and commercial applications, especially for generating synthetic data to train smaller language models. Notably, over 98% of data used in our model alignment process is synthetically generated, showcasing the effectiveness of these models in generating synthetic data. To further support open research and facilitate model development, we are also open-sourcing the synthetic data generation pipeline used in our model alignment process.


title: Superstatistics as the thermodynamic limit of driven classical systems

abstract: Superstatistics is an elegant framework for the description of steady-state thermodynamics, mostly used for systems with long-range interactions such as plasmas. In this work, we show that the potential energy distribution of a classical system under externally imposed energy fluctuations can also be described by superstatistics in the thermodynamic limit. As an example, we apply this formalism to the thermodynamics of a finite Lennard-Jones crystal with constant microcanonical heat capacity driven by sinusoidal energy oscillations. Our results show that molecular dynamics simulations of the Lennard-Jones crystal are in agreement with the provided theoretical predictions.


title: Prompts as Auto-Optimized Training Hyperparameters: Training Best-in-Class IR Models from Scratch with 10 Gold Labels

abstract: We develop a method for training small-scale (under 100M parameter) neural information retrieval models with as few as 10 gold relevance labels. The method depends on generating synthetic queries for documents using a language model (LM), and the key step is that we automatically optimize the LM prompt that is used to generate these queries based on training quality. In experiments with the BIRCO benchmark, we find that models trained with our method outperform RankZephyr and are competitive with RankLLama, both of which are 7B parameter models trained on over 100K labels. These findings point to the power of automatic prompt optimization for synthetic dataset generation.


title: A First Physical-World Trajectory Prediction Attack via LiDAR-induced Deceptions in Autonomous Driving

abstract: Trajectory prediction forecasts nearby agents' moves based on their historical trajectories. Accurate trajectory prediction is crucial for autonomous vehicles. Existing attacks compromise the prediction model of a victim AV by directly manipulating the historical trajectory of an attacker AV, which has limited real-world applicability. This paper, for the first time, explores an indirect attack approach that induces prediction errors via attacks against the perception module of a victim AV. Although it has been shown that physically realizable attacks against LiDAR-based perception are possible by placing a few objects at strategic locations, it is still an open challenge to find an object location from the vast search space in order to launch effective attacks against prediction under varying victim AV velocities. Through analysis, we observe that a prediction model is prone to an attack focusing on a single point in the scene. Consequently, we propose a novel two-stage attack framework to realize the single-point attack. The first stage of prediction-side attack efficiently identifies, guided by the distribution of detection results under object-based attacks against perception, the state perturbations for the prediction model that are effective and velocity-insensitive. In the second stage of location matching, we match the feasible object locations with the found state perturbations. Our evaluation using a public autonomous driving dataset shows that our attack causes a collision rate of up to 63% and various hazardous responses of the victim AV. The effectiveness of our attack is also demonstrated on a real testbed car. To the best of our knowledge, this study is the first security analysis spanning from LiDAR-based perception to prediction in autonomous driving, leading to a realistic attack on prediction. To counteract the proposed attack, potential defenses are discussed.


title: Tackling the Curse of Dimensionality in Fractional and Tempered Fractional PDEs with Physics-Informed Neural Networks

abstract: Fractional and tempered fractional partial differential equations (PDEs) are effective models of long-range interactions, anomalous diffusion, and non-local effects. Traditional numerical methods for these problems are mesh-based, thus struggling with the curse of dimensionality (CoD). Physics-informed neural networks (PINNs) offer a promising solution due to their universal approximation, generalization ability, and mesh-free training. In principle, Monte Carlo fractional PINN (MC-fPINN) estimates fractional derivatives using Monte Carlo methods and thus could lift CoD. However, this may cause significant variance and errors, hence affecting convergence; in addition, MC-fPINN is sensitive to hyperparameters. In general, numerical methods and specifically PINNs for tempered fractional PDEs are under-developed. Herein, we extend MC-fPINN to tempered fractional PDEs to address these issues, resulting in the Monte Carlo tempered fractional PINN (MC-tfPINN). To reduce possible high variance and errors from Monte Carlo sampling, we replace the one-dimensional (1D) Monte Carlo with 1D Gaussian quadrature, applicable to both MC-fPINN and MC-tfPINN. We validate our methods on various forward and inverse problems of fractional and tempered fractional PDEs, scaling up to 100,000 dimensions. Our improved MC-fPINN/MC-tfPINN using quadrature consistently outperforms the original versions in accuracy and convergence speed in very high dimensions.


title: Instruct, Not Assist: LLM-based Multi-Turn Planning and Hierarchical Questioning for Socratic Code Debugging

abstract: Socratic questioning is an effective teaching strategy, encouraging critical thinking and problem-solving. The conversational capabilities of large language models (LLMs) show great potential for providing scalable, real-time student guidance. However, current LLMs often give away solutions directly, making them ineffective instructors. We tackle this issue in the code debugging domain with TreeInstruct, an Instructor agent guided by a novel state space-based planning algorithm. TreeInstruct asks probing questions to help students independently identify and resolve errors. It estimates a student's conceptual and syntactical knowledge to dynamically construct a question tree based on their responses and current knowledge state, effectively addressing both independent and dependent mistakes concurrently in a multi-turn interaction setting. In addition to using an existing single-bug debugging benchmark, we construct a more challenging multi-bug dataset of 150 coding problems, incorrect solutions, and bug fixes -- all carefully constructed and annotated by experts. Extensive evaluation shows TreeInstruct's state-of-the-art performance on both datasets, proving it to be a more effective instructor than baselines. Furthermore, a real-world case study with five students of varying skill levels further demonstrates TreeInstruct's ability to guide students to debug their code efficiently with minimal turns and highly Socratic questioning.


title: The effect of hyperuniform disorder on band gaps

abstract: The properties of semiconductors, insulators, and photonic crystals are defined by their electronic or photonic bands, and the gaps between them. When the material is disordered, Lifshitz tails appear: these are localized states that bifurcate from the band edge and act to effectively close the band gap. While Lifshitz tails are well understood when the disorder is spatially uncorrelated, there has been recent interest in the case of hyperuniform disorder, i.e., when the disorder fluctuations are highly correlated and approach zero at long length scales. In this paper, we analytically solve the Lifshitz tail problem for hyperuniform systems using a path integral and instanton approach. We find the functional form of the density-of-states as a function of the energy difference from the band edge. We also examine the effect of hyperuniform disorder on the density of states of Weyl semimetals, which do not have a band gap.


title: OGNI-DC: Robust Depth Completion with Optimization-Guided Neural Iterations

abstract: Depth completion is the task of generating a dense depth map given an image and a sparse depth map as inputs. It has important applications in various downstream tasks. In this paper, we present OGNI-DC, a novel framework for depth completion. The key to our method is "Optimization-Guided Neural Iterations" (OGNI). It consists of a recurrent unit that refines a depth gradient field and a differentiable depth integrator that integrates the depth gradients into a depth map. OGNI-DC exhibits strong generalization, outperforming baselines by a large margin on unseen datasets and across various sparsity levels. Moreover, OGNI-DC has high accuracy, achieving state-of-the-art performance on the NYUv2 and the KITTI benchmarks. Code is available at https://github.com/princeton-vl/OGNI-DC.


title: Incentive Contracts and Peer Effects in the Workplace

abstract: Risk-averse workers in a team exert effort to produce joint output. Workers' incentives are connected via chains of productivity spillovers, represented by a network of peer-effects. We study the problem of a principal offering wage contracts that simultaneously incentivize and insure agents. We solve for the optimal linear contract for any network and show that optimal incentives are loaded more heavily on workers that are more central in a specific way. We conveniently link firm profits to network structure via the networks spectral properties. When firms can't personalize contracts, better connected workers extract rents. In this case, a group composition result follows: large within-group differences in centrality can decrease firm's profits. Finally, we find that modular production has important implications for how peer structures distribute incentives.


title: Latent Denoising Diffusion GAN: Faster sampling, Higher image quality

abstract: Diffusion models are emerging as powerful solutions for generating high-fidelity and diverse images, often surpassing GANs under many circumstances. However, their slow inference speed hinders their potential for real-time applications. To address this, DiffusionGAN leveraged a conditional GAN to drastically reduce the denoising steps and speed up inference. Its advancement, Wavelet Diffusion, further accelerated the process by converting data into wavelet space, thus enhancing efficiency. Nonetheless, these models still fall short of GANs in terms of speed and image quality. To bridge these gaps, this paper introduces the Latent Denoising Diffusion GAN, which employs pre-trained autoencoders to compress images into a compact latent space, significantly improving inference speed and image quality. Furthermore, we propose a Weighted Learning strategy to enhance diversity and image quality. Experimental results on the CIFAR-10, CelebA-HQ, and LSUN-Church datasets prove that our model achieves state-of-the-art running speed among diffusion models. Compared to its predecessors, DiffusionGAN and Wavelet Diffusion, our model shows remarkable improvements in all evaluation metrics. Code and pre-trained checkpoints: \url{https://github.com/thanhluantrinh/LDDGAN.git}


title: Scalable Expressiveness through Preprocessed Graph Perturbations

abstract: Graph Neural Networks (GNNs) have emerged as the predominant method for analyzing graph-structured data. However, canonical GNNs have limited expressive power and generalization capability, thus triggering the development of more expressive yet computationally intensive methods. One such approach is to create a series of perturbed versions of input graphs and then repeatedly conduct multiple message-passing operations on all variations during training. Despite their expressive power, this approach does not scale well on larger graphs. To address this scalability issue, we introduce Scalable Expressiveness through Preprocessed Graph Perturbation (SE2P). This model offers a flexible, configurable balance between scalability and generalizability with four distinct configuration classes. At one extreme, the configuration prioritizes scalability through minimal learnable feature extraction and extensive preprocessing; at the other extreme, it enhances generalizability with more learnable feature extractions, though this increases scalability costs. We conduct extensive experiments on real-world datasets to evaluate the generalizability and scalability of SE2P variants compared to various state-of-the-art benchmarks. Our results indicate that, depending on the chosen SE2P configuration, the model can enhance generalizability compared to benchmarks while achieving significant speed improvements of up to 8-fold.


title: Measuring memorization in RLHF for code completion

abstract: Reinforcement learning with human feedback (RLHF) has become the dominant method to align large models to user preferences. Unlike fine-tuning, for which there are many studies regarding training data memorization, it is not clear how memorization is affected by or introduced in the RLHF alignment process. Understanding this relationship is important as real user data may be collected and used to align large models; if user data is memorized during RLHF and later regurgitated, this could raise privacy concerns. In this work, we analyze how training data memorization can surface and propagate through each phase of RLHF. We focus our study on code completion models, as code completion is one of the most popular use cases for large language models. We find that RLHF significantly decreases the chance that data used for reward modeling and reinforcement learning is memorized, in comparison to aligning via directly fine-tuning on this data, but that examples already memorized during the fine-tuning stage of RLHF, will, in the majority of cases, remain memorized after RLHF.


title: Threat analysis and adversarial model for Smart Grids

abstract: The power grid is a critical infrastructure that allows for the efficient and robust generation, transmission, delivery and consumption of electricity. In the recent years, the physical components have been equipped with computing and network devices, which optimizes the operation and maintenance of the grid. The cyber domain of this smart power grid opens a new plethora of threats, which adds to classical threats on the physical domain. Accordingly, different stakeholders including regulation bodies, industry and academy, are making increasing efforts to provide security mechanisms to mitigate and reduce cyber-risks. Despite these efforts, there have been various cyberattacks that have affected the smart grid, leading in some cases to catastrophic consequences, showcasing that the industry might not be prepared for attacks from high profile adversaries. At the same time, recent work shows a lack of agreement among grid practitioners and academic experts on the feasibility and consequences of academic-proposed threats. This is in part due to inadequate simulation models which do not evaluate threats based on attackers full capabilities and goals. To address this gap, in this work we first analyze the main attack surfaces of the smart grid, and then conduct a threat analysis from the adversarial model perspective, including different levels of knowledge, goals, motivations and capabilities. To validate the model, we provide real-world examples of the potential capabilities by studying known vulnerabilities in critical components, and then analyzing existing cyber-attacks that have affected the smart grid, either directly or indirectly.


title: Refusal in Language Models Is Mediated by a Single Direction

abstract: Conversational large language models are fine-tuned for both instruction-following and safety, resulting in models that obey benign requests but refuse harmful ones. While this refusal behavior is widespread across chat models, its underlying mechanisms remain poorly understood. In this work, we show that refusal is mediated by a one-dimensional subspace, across 13 popular open-source chat models up to 72B parameters in size. Specifically, for each model, we find a single direction such that erasing this direction from the model's residual stream activations prevents it from refusing harmful instructions, while adding this direction elicits refusal on even harmless instructions. Leveraging this insight, we propose a novel white-box jailbreak method that surgically disables refusal with minimal effect on other capabilities. Finally, we mechanistically analyze how adversarial suffixes suppress propagation of the refusal-mediating direction. Our findings underscore the brittleness of current safety fine-tuning methods. More broadly, our work showcases how an understanding of model internals can be leveraged to develop practical methods for controlling model behavior.


title: Non-split alternating links bound unique minimal genus Seifert surfaces up to isotopy in the 4-ball

abstract: We show that any two minimal genus, oriented, boundary parallel surfaces bounded by a non-split alternating link into the 4-ball are smoothly isotopic fixing boundary. In other words, any two minimal genus Seifert surfaces for a non-split alternating link become smoothly isotopic fixing boundary once their interiors are pushed into the 4-ball.


title: Exploring wormhole solutions with global monopole charge in the context of $f(Q)$ gravity

abstract: This study explores the potential existence of traversable wormholes influenced by a global monopole charge within the $f(Q)$ gravity framework. To elucidate the characteristics of these wormholes, we conducted a comprehensive analysis of wormhole solutions employing three different forms of redshift function under a linear $f(Q)$ model. Wormhole shape functions were derived for barotropic, anisotropic, and isotropic Equations of State (EoS) cases. However, in the isotropic EoS case, the calculated shape function failed to satisfy the asymptotic flatness condition. Additionally, we observed that our obtained shape functions adhered to the flaring-out conditions under an asymptotic background for the remaining EoS cases. Furthermore, we examined the energy conditions at the wormhole throat with a radius $r_0$. We noted the influences of the global monopole's parameter $\eta$, the EoS parameter $\omega$, and $n$ in violating energy conditions, particularly the null energy conditions. Finally, we conducted a stability analysis utilizing the Tolman-Oppenheimer-Volkov (TOV) equation and found that our obtained wormhole solution is stable.


title: Graph Neural Re-Ranking via Corpus Graph

abstract: Re-ranking systems aim to reorder an initial list of documents to satisfy better the information needs associated with a user-provided query. Modern re-rankers predominantly rely on neural network models, which have proven highly effective in representing samples from various modalities. However, these models typically evaluate query-document pairs in isolation, neglecting the underlying document distribution that could enhance the quality of the re-ranked list. To address this limitation, we propose Graph Neural Re-Ranking (GNRR), a pipeline based on Graph Neural Networks (GNNs), that enables each query to consider documents distribution during inference. Our approach models document relationships through corpus subgraphs and encodes their representations using GNNs. Through extensive experiments, we demonstrate that GNNs effectively capture cross-document interactions, improving performance on popular ranking metrics. In TREC-DL19, we observe a relative improvement of 5.8% in Average Precision compared to our baseline. These findings suggest that integrating the GNN segment offers significant advantages, especially in scenarios where understanding the broader context of documents is crucial.


title: Zero-Shot Generalization during Instruction Tuning: Insights from Similarity and Granularity

abstract: Understanding alignment techniques begins with comprehending zero-shot generalization brought by instruction tuning, but little of the mechanism has been understood. Existing work has largely been confined to the task level, without considering that tasks are artificially defined and, to LLMs, merely consist of tokens and representations. This line of research has been limited to examining transfer between tasks from a task-pair perspective, with few studies focusing on understanding zero-shot generalization from the perspective of the data itself. To bridge this gap, we first demonstrate through multiple metrics that zero-shot generalization during instruction tuning happens very early. Next, we investigate the facilitation of zero-shot generalization from both data similarity and granularity perspectives, confirming that encountering highly similar and fine-grained training data earlier during instruction tuning, without the constraints of defined "tasks", enables better generalization. Finally, we propose a more grounded training data arrangement method, Test-centric Multi-turn Arrangement, and show its effectiveness in promoting continual learning and further loss reduction. For the first time, we show that zero-shot generalization during instruction tuning is a form of similarity-based generalization between training and test data at the instance level. We hope our analysis will advance the understanding of zero-shot generalization during instruction tuning and contribute to the development of more aligned LLMs. Our code is released at https://github.com/HBX-hbx/dynamics_of_zero-shot_generalization.


title: Magnitude homology equivalence of Euclidean sets

abstract: Magnitude homology is an $\mathbf{R}^+$-graded homology theory of metric spaces that captures information on the complexity of geodesics. Here we address the question: when are two metric spaces magnitude homology equivalent, in the sense that there exist back-and-forth maps inducing mutually inverse maps in homology? We give a concrete geometric necessary and sufficient condition in the case of closed Euclidean sets. Along the way, we introduce the convex-geometric concepts of inner boundary and core, and prove a strengthening for closed convex sets of the classical theorem of Carath\'eodory.


title: Control of Unknown Quadrotors from a Single Throw

abstract: This paper presents a method to recover quadrotor UAV from a throw, when no control parameters are known before the throw. We leverage the availability of high-frequency rotor speed feedback available in racing drone hardware and software to find control effectiveness values and fit a motor model using recursive least squares (RLS) estimation. Furthermore, we propose an excitation sequence that provides large actuation commands while guaranteeing to stay within gyroscope sensing limits. After 450ms of excitation, an INDI attitude controller uses the 52 fitted parameters to arrest rotational motion and recover an upright attitude. Finally, a NDI position controller drives the craft to a position setpoint. The proposed algorithm runs efficiently on microcontrollers found in common UAV flight controllers, and was shown to recover an agile quadrotor every time in 57 live experiments with as low as 3.5m throw height, demonstrating robustness against initial rotations and noise. We also demonstrate control of randomized quadrotors in simulated throws, where the parameter fitting RMS error is typically within 10% of the true value.


title: Detecting the massive vector field with extreme mass-ratio inspirals

abstract: The future space-borne gravitational wave detector, Laser Interferometer Space Antenna (LISA), has the potential of detecting the fundamental fields, such as the charge and mass ultra-light scalar field. In this paper we study the effect of lighter vector field on the gravitational waveforms from extreme mass-ratio inspirals (EMRI) system, consisting of a stellar-mass object and the massive black hole (MBH) in the Einstein-Proca theory of a massive vector field coupling to gravity. Using the perturbation theory, we compute the energy fluxes including the contributions of the Proca field and the gravitational field, then obtain the adiabatic inspiraling orbits and corresponding waveforms. Our results demonstrate that the vector charge and mass carried by the secondary body lead to detectable effects on EMRI waveform, and LISA has the potential to measure the mass of the Proca field with greater precision.


title: Computation and Control of Unstable Steady States for Mean Field Multiagent Systems

abstract: We study interacting particle systems driven by noise, modeling phenomena such as opinion dynamics. We are interested in systems that exhibit phase transitions i.e. non-uniqueness of stationary states for the corresponding McKean-Vlasov PDE, in the mean field limit. We develop an efficient numerical scheme for identifying all steady states (both stable and unstable) of the mean field McKean-Vlasov PDE, based on a spectral Galerkin approximation combined with a deflated Newton's method to handle the multiplicity of solutions. Having found all possible equilibra, we formulate an optimal control strategy for steering the dynamics towards a chosen unstable steady state. The control is computed using iterated open-loop solvers in a receding horizon fashion. We demonstrate the effectiveness of the proposed steady state computation and stabilization methodology on several examples, including the noisy Hegselmann-Krause model for opinion dynamics and the Haken-Kelso-Bunz model from biophysics. The numerical experiments validate the ability of the approach to capture the rich self-organization landscape of these systems and to stabilize unstable configurations of interest. The proposed computational framework opens up new possibilities for understanding and controlling the collective behavior of noise-driven interacting particle systems, with potential applications in various fields such as social dynamics, biological synchronization, and collective behavior in physical and social systems.


title: Site-percolation transition of run-and-tumble particles

abstract: We study percolation transition of run and tumble particles (RTPs) on a two dimensional square lattice. RTPs in these models run to the nearest neighbour along their internal orientation with unit rate, and to other nearest neighbours with rates $p$. In addition, they tumble to change their internal orientation with rate $\omega$. We show that for small tumble rates, RTP-clusters created by joining occupied nearest neighbours irrespective of their orientation form a phase separated state when the rate of positional diffusion $p$ crosses a threshold; with further increase of $p$ the clusters disintegrate and another transition to a mixed phase occurs. The critical exponents of this re-entrant site-percolation transition of RTPs vary continuously along the critical line in the $\omega$-$p$ plane, but a scaling function remains invariant. This function is identical to the corresponding universal scaling function of percolation transition observed in the Ising model. We also show that the critical exponents of the underlying motility induced phase separation transition are related to corresponding percolation-critical-exponents by constant multiplicative factors known from the correspondence of magnetic and percolation critical exponents of Ising model.


title: 1000 African Voices: Advancing inclusive multi-speaker multi-accent speech synthesis

abstract: Recent advances in speech synthesis have enabled many useful applications like audio directions in Google Maps, screen readers, and automated content generation on platforms like TikTok. However, these systems are mostly dominated by voices sourced from data-rich geographies with personas representative of their source data. Although 3000 of the world's languages are domiciled in Africa, African voices and personas are under-represented in these systems. As speech synthesis becomes increasingly democratized, it is desirable to increase the representation of African English accents. We present Afro-TTS, the first pan-African accented English speech synthesis system able to generate speech in 86 African accents, with 1000 personas representing the rich phonological diversity across the continent for downstream application in Education, Public Health, and Automated Content Creation. Speaker interpolation retains naturalness and accentedness, enabling the creation of new voices.