title: Probabilistic Representations of Ordered Exponentials: Vector-Valued Schr\"odinger Semigroups and the Combinatorics of Anderson Localization

abstract: We provide two applications of an elementary (yet seemingly unknown) probabilistic representation of matrix ordered exponentials, which generalizes the Feynman-Kac formula in finite dimensions and the change of measure formula between two continuous-time Markov processes on a finite state space. Our first and main application consists of a new Feynman-Kac formula for a class of vector-valued Schr\"odinger operators on the line, which is driven by two sources of randomness: The usual Brownian motion, and a continuous-time Markov process on a finite state space. An important feature of these formulas -- which is at the core of our motivation -- is that they enable the calculation of the joint moments of the semigroup kernels when the matrix potential function contains a continuous Gaussian noise. In particular, our moment formulas shed new light on what the joint moments of the Feynman-Kac kernels of the multivariate stochastic Airy operators of Bloemendal and Vir\'ag (Ann. Probab., 44(4):2726--2769, 2016.) should be; we state a precise conjecture to that effect, which we pursue in a forthcoming paper. Our second application consists of Feynman-Kac formulas for the expected square modulus $\mathbf E\big[|\Psi(t,x)|^2\big]$ of the solutions of the Schr\"odinger equation $\partial_t\Psi=-\mathsf i\mathcal H(t)\Psi$ with a time-dependent Hamiltonian $\mathcal H(t)$. Using this, we show that when we take $\mathcal H(t)=-\Delta+q(t,x)$ restricted to a finite box within $\mathbb Z^d$, where $q(t,x)$ is a possibly time-dependent Gaussian process, $\mathbf E\big[|\Psi(t,x)|^2\big]$ can be written as a relatively simple expectation that involves self- and mutual-intersections of random walks. In particular, this formula hints at a unified combinatorial mechanism that explains the occurrence of localization for both time-dependent and time-independent noises.


title: Pion distribution functions from low-order Mellin moments

abstract: Exploiting an evolution scheme for parton distribution functions (DFs) that is all-orders exact, contemporary lattice-QCD (lQCD) results for low-order Mellin moments of the pion valence quark DF are shown to be mutually consistent. The analysis introduces a means by which key odd moments can be obtained from the even moments in circumstances where only the latter are available. Combining these elements, one arrives at parameter-free lQCD-based predictions for the pointwise behaviour of pion valence, glue, and sea DFs, with sound uncertainty estimates. The behaviour of the pion DFs at large light-front momentum fraction, $x> 0.85$, is found to be consistent with QCD expectations and continuum analyses of pion structure functions, i.e., damping like $(1 -x)^{\beta_{\rm parton}}$, with $\beta_{\rm valence} \approx 2.4$, $\beta_{\rm glue} \approx 3.6$, $\beta_{\rm sea} \approx 4.6$. It may be possible to test these predictions using data from forthcoming experiments.


title: COMET: A Cross-Layer Optimized Optical Phase Change Main Memory Architecture

abstract: Traditional DRAM-based main memory systems face several challenges with memory refresh overhead, high latency, and low throughput as the industry moves towards smaller DRAM cells. These issues have been exacerbated by the emergence of data-intensive applications in recent years. Memories based on phase change materials (PCMs) offer promising solutions to these challenges. PCMs store data in the material's phase, which can shift between amorphous and crystalline states when external thermal energy is supplied. This is often achieved using electrical pulses. Alternatively, using laser pulses and integration with silicon photonics offers a unique opportunity to realize high-bandwidth and low-latency photonic memories. Such a memory system may in turn open the possibility of realizing fully photonic computing systems. But to realize photonic memories, several challenges that are unique to the photonic domain such as crosstalk, optical loss management, and laser power overhead have to be addressed. In this work, we present COMET, the first cross-layer optimized optical main memory architecture that uses PCMs. In architecting COMET, we explore how to use silicon photonics and PCMs together to design a large-scale main memory system while addressing associated challenges. We explore challenges and propose solutions at the PCM cell, photonic memory circuit, and memory architecture levels. Based on our evaluations, COMET offers 7.1x better bandwidth, 15.1x lower EPB, and 3x lower latencies than the best-known prior work on photonic main memory architecture design.


title: Polynomial bounds for surfaces in cusped 3-manifolds

abstract: We find polynomial upper bounds on the number of isotopy classes of connected essential surfaces embedded in many cusped 3-manifolds and their Dehn fillings. Our bounds are universal, in the sense that we obtain the same explicit formula for all 3-manifolds that we consider, with the formula dependent on the Euler characteristic of the surface and similar numerical quantities encoding topology of the ambient 3-manifold. Universal and polynomial bounds have been obtained previously for classical alternating links in the 3-sphere and their Dehn fillings, but only for surfaces that are closed or spanning. Here, we consider much broader classes of 3-manifolds and all topological types of surfaces. The 3-manifolds are called weakly generalized alternating links; they include, for example, many links that are not classically alternating and/or do not lie in the 3-sphere, many virtual links and toroidally alternating links.


title: Adversarial Imitation Learning On Aggregated Data

abstract: Inverse Reinforcement Learning (IRL) learns an optimal policy, given some expert demonstrations, thus avoiding the need for the tedious process of specifying a suitable reward function. However, current methods are constrained by at least one of the following requirements. The first one is the need to fully solve a forward Reinforcement Learning (RL) problem in the inner loop of the algorithm, which might be prohibitively expensive in many complex environments. The second one is the need for full trajectories from the experts, which might not be easily available. The third one is the assumption that the expert data is homogeneous rather than a collection from various experts or possibly alternative solutions to the same task. Such constraints make IRL approaches either not scalable or not usable on certain existing systems. In this work we propose an approach which removes these requirements through a dynamic, adaptive method called Adversarial Imitation Learning on Aggregated Data (AILAD). It learns conjointly both a non linear reward function and the associated optimal policy using an adversarial framework. The reward learner only uses aggregated data. Moreover, it generates diverse behaviors producing a distribution over the aggregated data matching that of the experts.


title: Uncertainty Quantification in Neural-Network Based Pain Intensity Estimation

abstract: Improper pain management can lead to severe physical or mental consequences, including suffering, and an increased risk of opioid dependency. Assessing the presence and severity of pain is imperative to prevent such outcomes and determine the appropriate intervention. However, the evaluation of pain intensity is challenging because different individuals experience pain differently. To overcome this, researchers have employed machine learning models to evaluate pain intensity objectively. However, these efforts have primarily focused on point estimation of pain, disregarding the inherent uncertainty and variability present in the data and model. Consequently, the point estimates provide only partial information for clinical decision-making. This study presents a neural network-based method for objective pain interval estimation, incorporating uncertainty quantification. This work explores three algorithms: the bootstrap method, lower and upper bound estimation (LossL) optimized by genetic algorithm, and modified lower and upper bound estimation (LossS) optimized by gradient descent algorithm. Our empirical results reveal that LossS outperforms the other two by providing a narrower prediction interval. As LossS outperforms, we assessed its performance in three different scenarios for pain assessment: (1) a generalized approach (single model for the entire population), (2) a personalized approach (separate model for each individual), and (3) a hybrid approach (separate model for each cluster of individuals). Our findings demonstrate the hybrid approach's superior performance, with notable practicality in clinical contexts. It has the potential to be a valuable tool for clinicians, enabling objective pain intensity assessment while taking uncertainty into account. This capability is crucial in facilitating effective pain management and reducing the risks associated with improper treatment.


title: Relaxation strength for multilinear optimization: McCormick strikes back

abstract: We consider linear relaxations for multilinear optimization problems. In a recent paper, Khajavirad proved that the extended flower relaxation is at least as strong as the relaxation of any recursive McCormick linearization (Operations Research Letters 51 (2023) 146-152). In this paper we extend the result to more general linearizations, and present a simpler proof. Moreover, we complement Khajavirad's result by showing that the intersection of the relaxations of such linearizations and the extended flower relaxation are equally strong.


title: Distances on the $\mathrm{CLE}_4$, critical Liouville quantum gravity and $3/2$-stable maps

abstract: The purpose of this article is threefold. First, we show that when one explores a conformal loop ensemble of parameter $\kappa=4$ ($\mathrm{CLE}_4$) on an independent $2$-Liouville quantum gravity ($2$-LQG) disk, the surfaces which are cut out are independent quantum disks. To achieve this, we rely on approximations of the explorations of a $\mathrm{CLE}_4$: we first approximate the $\mathrm{SLE}_4^{\langle \mu \rangle}(-2)$ explorations for $\mu \in \mathbb{R}$ using explorations of the $\mathrm{CLE}_\kappa$ as $\kappa \uparrow 4$ and then we approximate the uniform exploration by letting $\mu \to \infty$. Second, we describe the relation between the so-called natural quantum distance and the conformally invariant distance to the boundary introduced by Werner and Wu. Third, we establish the scaling limit of the distances from the boundary to the large faces of $3/2$-stable maps and relate the limit to the $\mathrm{CLE}_4$-decorated $2$-LQG.


title: Low-Rank Adaptation for Multilingual Summarization: An Empirical Study

abstract: Although the advancements of pre-trained Large Language Models have significantly accelerated recent progress in NLP, their ever-increasing size poses significant challenges for conventional fine-tuning, especially in memory-intensive tasks. We investigate the potential of Parameter-Efficient Fine-Tuning, focusing on Low-Rank Adaptation (LoRA), in the domain of multilingual summarization, a task that is both challenging (due to typically long inputs), and relatively unexplored. We conduct an extensive study across different data availability scenarios, including high- and low-data settings, and cross-lingual transfer, leveraging models of different sizes. Our findings reveal that LoRA is competitive with full fine-tuning when trained with high quantities of data, and excels in low-data scenarios and cross-lingual transfer. We also study different strategies for few-shot cross-lingual transfer, finding that continued LoRA tuning outperforms full fine-tuning and the dynamic composition of language-specific LoRA modules.


title: Topological Symmetries of the Heawood family

abstract: The {\em topological symmetry group} of an embedding $\Gamma$ of an abstract graph $\gamma$ in $S^3$ is the group of automorphisms of $\gamma$ which can be realized by homeomorphisms of the pair $(S^3, \Gamma)$. These groups are motivated by questions about the symmetries of molecules in space. In this paper, we find all the groups which can be realized as topological symmetry groups for each of the graphs in the Heawood family. This is an important collection of spatial graphs, containing the only intrinsically knotted graphs with 21 or fewer edges. As a consequence, we discover that the graphs in this family are all intrinsically chiral.


title: Estimating the volumes of correlations sets in causal networks

abstract: Causal networks beyond that in the paradigmatic Bell's theorem can lead to new kinds and applications of non-classical behavior. Their study, however, has been hindered by the fact that they define a non-convex set of correlations and only very incomplete or approximated descriptions have been obtained so far, even for the simplest scenarios. Here, we take a different stance on the problem and consider the relative volume of classical or non-classical correlations a given network gives rise to. Among many other results, we show instances where the inflation technique, arguably the most disseminated tool in the community, is unable to detect a significant portion of the non-classical behaviors. Interestingly, we also show that the use of interventions, a central tool in causal inference, can enhance substantially our ability to witness non-classicality.


title: Gaussian Approximation of Convex Sets by Intersections of Halfspaces

abstract: We study the approximability of general convex sets in $\mathbb{R}^n$ by intersections of halfspaces, where the approximation quality is measured with respect to the standard Gaussian distribution $N(0,I_n)$ and the complexity of an approximation is the number of halfspaces used. While a large body of research has considered the approximation of convex sets by intersections of halfspaces under distance metrics such as the Lebesgue measure and Hausdorff distance, prior to our work there has not been a systematic study of convex approximation under the Gaussian distribution. We establish a range of upper and lower bounds, both for general convex sets and for specific natural convex sets that are of particular interest. Our results demonstrate that the landscape of approximation is intriguingly different under the Gaussian distribution versus previously studied distance measures. For example, we show that $2^{\Theta(\sqrt{n})}$ halfspaces are both necessary and sufficient to approximate the origin-centered $\ell_2$ ball of Gaussian volume 1/2 to any constant accuracy, and that for $1 \leq p < 2$, the origin-centered $\ell_p$ ball of Gaussian volume 1/2 can be approximated to any constant accuracy as an intersection of $2^{\widetilde{O}(n^{3/4})}$ many halfspaces. These bounds are quite different from known approximation results under more commonly studied distance measures. Our results are proved using techniques from many different areas. These include classical results on convex polyhedral approximation, Cram\'er-type bounds on large deviations from probability theory, and -- perhaps surprisingly -- a range of topics from computational complexity, including computational learning theory, unconditional pseudorandomness, and the study of influences and noise sensitivity in the analysis of Boolean functions.


title: Towards Evaluating AI Systems for Moral Status Using Self-Reports

abstract: As AI systems become more advanced and widely deployed, there will likely be increasing debate over whether AI systems could have conscious experiences, desires, or other states of potential moral significance. It is important to inform these discussions with empirical evidence to the extent possible. We argue that under the right circumstances, self-reports, or an AI system's statements about its own internal states, could provide an avenue for investigating whether AI systems have states of moral significance. Self-reports are the main way such states are assessed in humans ("Are you in pain?"), but self-reports from current systems like large language models are spurious for many reasons (e.g. often just reflecting what humans would say). To make self-reports more appropriate for this purpose, we propose to train models to answer many kinds of questions about themselves with known answers, while avoiding or limiting training incentives that bias self-reports. The hope of this approach is that models will develop introspection-like capabilities, and that these capabilities will generalize to questions about states of moral significance. We then propose methods for assessing the extent to which these techniques have succeeded: evaluating self-report consistency across contexts and between similar models, measuring the confidence and resilience of models' self-reports, and using interpretability to corroborate self-reports. We also discuss challenges for our approach, from philosophical difficulties in interpreting self-reports to technical reasons why our proposal might fail. We hope our discussion inspires philosophers and AI researchers to criticize and improve our proposed methodology, as well as to run experiments to test whether self-reports can be made reliable enough to provide information about states of moral significance.


title: Finding AI-Generated Faces in the Wild

abstract: AI-based image generation has continued to rapidly improve, producing increasingly more realistic images with fewer obvious visual flaws. AI-generated images are being used to create fake online profiles which in turn are being used for spam, fraud, and disinformation campaigns. As the general problem of detecting any type of manipulated or synthesized content is receiving increasing attention, here we focus on a more narrow task of distinguishing a real face from an AI-generated face. This is particularly applicable when tackling inauthentic online accounts with a fake user profile photo. We show that by focusing on only faces, a more resilient and general-purpose artifact can be detected that allows for the detection of AI-generated faces from a variety of GAN- and diffusion-based synthesis engines, and across image resolutions (as low as 128 x 128 pixels) and qualities.


title: A solver for linear scalar ordinary differential equations whose running time is bounded independent of frequency

abstract: When the eigenvalues of the coefficient matrix for a linear scalar ordinary differential equation are of large magnitude, its solutions exhibit complicated behaviour, such as high-frequency oscillations, rapid growth or rapid decay. The cost of representing such solutions using standard techniques grows with the magnitudes of the eigenvalues. As a consequence, the running times of most solvers for ordinary differential equations also grow with these eigenvalues. However, a large class of scalar ordinary differential equations with slowly-varying coefficients admit slowly-varying phase functions that can be represented at a cost which is bounded independent of the magnitudes of the eigenvalues of the corresponding coefficient matrix. Here, we introduce a numerical algorithm for constructing slowly-varying phase functions which represent the solutions of a linear scalar ordinary differential equation. Our method's running time depends on the complexity of the equation's coefficients, but is bounded independent of the magnitudes of the equation's eigenvalues. Once the phase functions have been constructed, essentially any reasonable initial or boundary value problem for the scalar equation can be easily solved. We present the results of numerical experiments showing that, despite its greater generality, our algorithm is competitive with state-of-the-art methods for solving highly-oscillatory second order differential equations. We also compare our method with Magnus-type exponential integrators and find that our approach is orders of magnitude faster in the high-frequency regime.


title: Graph-Induced Syntactic-Semantic Spaces in Transformer-Based Variational AutoEncoders

abstract: The injection of syntactic information in Variational AutoEncoders (VAEs) has been shown to result in an overall improvement of performances and generalisation. An effective strategy to achieve such a goal is to separate the encoding of distributional semantic features and syntactic structures into heterogeneous latent spaces via multi-task learning or dual encoder architectures. However, existing works employing such techniques are limited to LSTM-based VAEs. In this paper, we investigate latent space separation methods for structural syntactic injection in Transformer-based VAE architectures (i.e., Optimus). Specifically, we explore how syntactic structures can be leveraged in the encoding stage through the integration of graph-based and sequential models, and how multiple, specialised latent representations can be injected into the decoder's attention mechanism via low-rank operators. Our empirical evaluation, carried out on natural language sentences and mathematical expressions, reveals that the proposed end-to-end VAE architecture can result in a better overall organisation of the latent space, alleviating the information loss occurring in standard VAE setups, resulting in enhanced performances on language modelling and downstream generation tasks.


title: Investigations of atomic \& molecular processes of NBI-heated discharges in the MAST Upgrade Super-X divertor with implications for reactors

abstract: This experimental study presents an in-depth investigation of the performance of the MAST-U Super-X divertor during NBI-heated operation (up to 2.5 MW) focussing on volumetric ion sources and sinks as well as power losses during detachment. The particle balance and power loss analysis revealed the crucial role of Molecular Activated Recombination and Dissociation (MAR and MAD) ion sinks in divertor particle and power balance, which remain pronounced in the change from ohmic to higher power (NBI heated) L-mode conditions. The importance of MAR and MAD remains with double the absorbed NBI heating. MAD results in significant power dissipation (up to $\sim 20 \%$ of $P_{SOL}$), mostly in the cold ($T_e < 5$ eV) detached region. Theoretical and experimental evidence is found for the potential contribution of $D^-$ to MAR and MAD, which warrants further study. These results suggest that MAR and MAD can be relevant in higher power conditions than the ohmic conditions studied previously. Post-processing reactor-scale simulations shows that MAR and MAD can play a significant role in divertor physics and synthetic diagnostic signals of reactor-scale devices, which are currently underestimated in exhaust simulations. This raises implications for the accuracy of reactor-scale divertor simulations of particularly tightly baffled (alternative) divertor configurations.


title: Drivable 3D Gaussian Avatars

abstract: We present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the recently presented 3D Gaussian Splatting (3DGS) technique to render realistic humans at real-time framerates, using dense calibrated multi-view videos as input. To deform those primitives, we depart from the commonly used point deformation method of linear blend skinning (LBS) and use a classic volumetric deformation method: cage deformations. Given their smaller size, we drive these deformations with joint angles and keypoints, which are more suitable for communication applications. Our experiments on nine subjects with varied body shapes, clothes, and motions obtain higher-quality results than state-of-the-art methods when using the same training and test data.


title: DREAMPlaceFPGA-MP: An Open-Source GPU-Accelerated Macro Placer for Modern FPGAs with Cascade Shapes and Region Constraints

abstract: FPGA macro placement plays a pivotal role in routability and timing closer to the modern FPGA physical design flow. In modern FPGAs, macros could be subject to complex cascade shape constraints requiring instances to be placed in consecutive sites. In addition, in real-world FPGA macro placement scenarios, designs could have various region constraints that specify boundaries within which certain design instances and macros should be placed. In this work, we present DREAMPlaceFPGA-MP, an open-source GPU-accelerated FPGA macro-placer that efficiently generates legal placements for macros while honoring cascade shape requirements and region constraints. Treating multiple macros in a cascade shape as a large single instance and restricting instances to their respective regions, DREAMPlaceFPGA-MP obtains roughly legal placements. The macros are legalized in multiple steps to efficiently handle cascade shapes and region constraints. Our experimental results demonstrate that DREAMPlaceFPGA-MP is among the top contestants of the MLCAD 2023 FPGA Macro-Placement Contest.


title: MOSAIC: A Multi-Objective Optimization Framework for Sustainable Datacenter Management

abstract: In recent years, cloud service providers have been building and hosting datacenters across multiple geographical locations to provide robust services. However, the geographical distribution of datacenters introduces growing pressure to both local and global environments, particularly when it comes to water usage and carbon emissions. Unfortunately, efforts to reduce the environmental impact of such datacenters often lead to an increase in the cost of datacenter operations. To co-optimize the energy cost, carbon emissions, and water footprint of datacenter operation from a global perspective, we propose a novel framework for multi-objective sustainable datacenter management (MOSAIC) that integrates adaptive local search with a collaborative decomposition-based evolutionary algorithm to intelligently manage geographical workload distribution and datacenter operations. Our framework sustainably allocates workloads to datacenters while taking into account multiple geography- and time-based factors including renewable energy sources, variable energy costs, power usage efficiency, carbon factors, and water intensity in energy. Our experimental results show that, compared to the best-known prior work frameworks, MOSAIC can achieve 27.45x speedup and 1.53x improvement in Pareto Hypervolume while reducing the carbon footprint by up to 1.33x, water footprint by up to 3.09x, and energy costs by up to 1.40x. In the simultaneous three-objective co-optimization scenario, MOSAIC achieves a cumulative improvement across all objectives (carbon, water, cost) of up to 4.61x compared to the state-of-the-arts.


title: Asking More Informative Questions for Grounded Retrieval

abstract: When a model is trying to gather information in an interactive setting, it benefits from asking informative questions. However, in the case of a grounded multi-turn image identification task, previous studies have been constrained to polar yes/no questions, limiting how much information the model can gain in a single turn. We present an approach that formulates more informative, open-ended questions. In doing so, we discover that off-the-shelf visual question answering (VQA) models often make presupposition errors, which standard information gain question selection methods fail to account for. To address this issue, we propose a method that can incorporate presupposition handling into both question selection and belief updates. Specifically, we use a two-stage process, where the model first filters out images which are irrelevant to a given question, then updates its beliefs about which image the user intends. Through self-play and human evaluations, we show that our method is successful in asking informative open-ended questions, increasing accuracy over the past state-of-the-art by 14%, while resulting in 48% more efficient games in human evaluations.


title: Unsupervised segmentation of irradiation$\unicode{x2010}$induced order$\unicode{x2010}$disorder phase transitions in electron microscopy

abstract: We present a method for the unsupervised segmentation of electron microscopy images, which are powerful descriptors of materials and chemical systems. Images are oversegmented into overlapping chips, and similarity graphs are generated from embeddings extracted from a domain$\unicode{x2010}$pretrained convolutional neural network (CNN). The Louvain method for community detection is then applied to perform segmentation. The graph representation provides an intuitive way of presenting the relationship between chips and communities. We demonstrate our method to track irradiation$\unicode{x2010}$induced amorphous fronts in thin films used for catalysis and electronics. This method has potential for "on$\unicode{x2010}$the$\unicode{x2010}$fly" segmentation to guide emerging automated electron microscopes.


title: Long-legged Divertors and Neutral Baffling as a Solution to the Tokamak Power Exhaust Challenge

abstract: Exhausting the power from the hot fusion core to the plasma facing components is one of fusion's biggest challenges. The MAST Upgrade tokamak uniquely integrates strong containment of neutrals within the exhaust area (divertor), away from the hot fusion core, with extreme divertor shaping. This enables improving power exhaust through long-legged divertors with a high magnetic field gradient (total flux expansion). This study shows compelling MAST-U results for the improved power exhaust of long-legged, totally flux expanded, divertors, without any adverse impact to the hot fusion core, representing a significant step forward in addressing the fusion power exhaust challenge. Our comparative analysis of various divertor shapes demonstrates that even modest adjustments can significantly enhance exhaust performance while preserving core plasma performance. Through novel analysis, we attribute the reductions in particle and power loads to the expanded plasma-neutral interaction volume within long-legged divertors, in agreement with reduced models and simulation results. Strong segregation of neutrals enables the benefits of long-legged, totally flux expanded, divertors to be retrieved. Our study underscores the critical role of strategic divertor shaping in enhancing exhaust performance, stability and core-edge integration; signifying an essential advancement towards sustainable fusion energy.


title: Quantum Group Intertwiner Space From Quantum Curved Tetrahedron

abstract: In this paper, we develop a quantum theory of homogeneously curved tetrahedron geometry, by applying the combinatorial quantization to the phase space of tetrahedron shapes defined in arXiv:1506.03053. Our method is based on the relation between this phase space and the moduli space of SU(2) flat connections on a 4-punctured sphere. The quantization results in the physical Hilbert space as the solution of the quantum closure constraint, which quantizes the classical closure condition $M_4M_3M_2M_1=1$, $M_\nu\in$ SU(2), for the homogeneously curved tetrahedron. The quantum group Uq(su(2)) emerges as the gauge symmetry of a quantum tetrahedron. The physical Hilbert space of the quantum tetrahedron coincides with the Hilbert space of 4-valent intertwiners of Uq(su(2)). In addition, we define the area operators quantizing the face areas of the tetrahedron and compute the spectrum. The resulting spectrum is consistent with the usual Loop-Quantum-Gravity area spectrum in the large spin regime but is different for small spins. This work closely relates to 3+1 dimensional Loop Quantum Gravity in presence of cosmological constant and provides a justification for the emergence of quantum group in the theory.


title: CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation

abstract: Large Language Models (LLMs) have demonstrated remarkable performance on assisting humans in programming and facilitating programming automation. However, existing benchmarks for evaluating the code understanding and generation capacities of LLMs suffer from severe limitations. First, most benchmarks are insufficient as they focus on a narrow range of popular programming languages and specific tasks, whereas real-world software development scenarios show a critical need to implement systems with multilingual and multitask programming environments to satisfy diverse requirements. Second, most benchmarks fail to consider the actual executability and the consistency of execution results of the generated code. To bridge these gaps between existing benchmarks and expectations from practical applications, we introduce CodeScope, an execution-based, multilingual, multitask, multidimensional evaluation benchmark for comprehensively measuring LLM capabilities on coding tasks. CodeScope covers 43 programming languages and eight coding tasks. It evaluates the coding performance of LLMs from three dimensions (perspectives): length, difficulty, and efficiency. To facilitate execution-based evaluations of code generation, we develop MultiCodeEngine, an automated code execution engine that supports 14 programming languages. Finally, we systematically evaluate and analyze eight mainstream LLMs and demonstrate the superior breadth and challenges of CodeScope for evaluating LLMs on code understanding and generation tasks compared to other benchmarks. The CodeScope benchmark and code are publicly available at https://github.com/WeixiangYAN/CodeScope.


title: Carbon Responder: Coordinating Demand Response for the Datacenter Fleet

abstract: The increasing integration of renewable energy sources results in fluctuations in carbon intensity throughout the day. To mitigate their carbon footprint, datacenters can implement demand response (DR) by adjusting their load based on grid signals. However, this presents challenges for private datacenters with diverse workloads and services. One of the key challenges is efficiently and fairly allocating power curtailment across different workloads. In response to these challenges, we propose the Carbon Responder framework. The Carbon Responder framework aims to reduce the carbon footprint of heterogeneous workloads in datacenters by modulating their power usage. Unlike previous studies, Carbon Responder considers both online and batch workloads with different service level objectives and develops accurate performance models to achieve performance-aware power allocation. The framework supports three alternative policies: Efficient DR, Fair and Centralized DR, and Fair and Decentralized DR. We evaluate Carbon Responder polices using production workload traces from a private hyperscale datacenter. Our experimental results demonstrate that the efficient Carbon Responder policy reduces the carbon footprint by around 2x as much compared to baseline approaches adapted from existing methods. The fair Carbon Responder policies distribute the performance penalties and carbon reduction responsibility fairly among workloads.


title: PEMA: An Offsite-Tunable Plug-in External Memory Adaptation for Language Models

abstract: Pre-trained language models (PLMs) show impressive performance in various downstream NLP tasks. However, pre-training large language models demands substantial memory and training compute. Furthermore, due to the substantial resources required, many PLM weights are confidential. Consequently, users are compelled to share their data with model owners for fine-tuning specific tasks. To overcome the limitations, we introduce Plug-in External Memory Adaptation (PEMA), a Parameter-Efficient Fine-Tuning (PEFT) method, enabling PLM fine-tuning without requiring access to all the weights. PEMA integrates with context representations from test data during inference to perform downstream tasks. It uses external memory to store PLM-generated context representations mapped with target tokens. Our method utilizes weight matrices of LoRA-like bottlenecked adapter in the PLM's final layer to enhance efficiency. Our approach also includes Gradual Unrolling, a novel interpolation strategy to improve generation quality. We validate PEMA's effectiveness through experiments on syntactic and real datasets for machine translation and style transfer. Our findings show that PEMA outperforms other PEFT approaches in memory and latency efficiency for training, and also excels in maintaining sentence meaning and generating appropriate language and styles.


title: A Two-Field Formulation for Surfactant Transport within the Algebraic Volume of Fluid Method

abstract: Surfactant transport plays an important role in many technical processes and industrial applications such as chemical reactors, microfluidics, printing and coating technology. High fidelity numerical simulations of two-phase flow phenomena reveal rich insights into the flow dynamics, heat, mass and species transport. In the present study, a two-field formulation for surfactant transport within the algebraic volume of fluid method is presented. The slight diffuse nature of representing the interface in the algebraic volume of fluid method is utilized to track the concentration of surfactant at the interface as a volumetric concentration. Transport of insoluble and soluble surfactants is investigated by tracking two different concentrations of the surfactant, one within the bulk of the liquid and the other one at the interface. These two transport equations are in turn coupled by source terms considering the ad-/desorption processes at a liquid-gas interface. Appropriate boundary conditions at a solid-fluid interface are formulated to ensure surfactant conservation, while also enabling to study the ad-/desorption processes at a solid-fluid interface. The developed numerical method is verified by comparing the numerical simulations with well-known analytical and numerical reference solutions. The presented numerical methodology offers a seamless integration of surfactant transport into the algebraic volume of fluid method, where the latter has many advantages such as volume conservation and an inherent ability of handling large interface deformations and topological changes.


title: AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications

abstract: Adversarial testing of large language models (LLMs) is crucial for their safe and responsible deployment. We introduce a novel approach for automated generation of adversarial evaluation datasets to test the safety of LLM generations on new downstream applications. We call it AI-assisted Red-Teaming (AART) - an automated alternative to current manual red-teaming efforts. AART offers a data generation and augmentation pipeline of reusable and customizable recipes that reduce human effort significantly and enable integration of adversarial testing earlier in new product development. AART generates evaluation datasets with high diversity of content characteristics critical for effective adversarial testing (e.g. sensitive and harmful concepts, specific to a wide range of cultural and geographic regions and application scenarios). The data generation is steered by AI-assisted recipes to define, scope and prioritize diversity within the application context. This feeds into a structured LLM-generation process that scales up evaluation priorities. Compared to some state-of-the-art tools, AART shows promising results in terms of concept coverage and data quality.


title: ACID: Abstractive, Content-Based IDs for Document Retrieval with Language Models

abstract: Generative retrieval (Wang et al., 2022; Tay et al., 2022) is a new approach for end-to-end document retrieval that directly generates document identifiers given an input query. Techniques for designing effective, high-quality document IDs remain largely unexplored. We introduce ACID, in which each document's ID is composed of abstractive keyphrases generated by a large language model, rather than an integer ID sequence as done in past work. We compare our method with the current state-of-the-art technique for ID generation, which produces IDs through hierarchical clustering of document embeddings. We also examine simpler methods to generate natural-language document IDs, including the naive approach of using the first k words of each document as its ID or words with high BM25 scores in that document. We show that using ACID improves top-10 and top-20 accuracy by 15.6% and 14.4% (relative) respectively versus the state-of-the-art baseline on the MSMARCO 100k retrieval task, and 4.4% and 4.0% respectively on the Natural Questions 100k retrieval task. Our results demonstrate the effectiveness of human-readable, natural-language IDs in generative retrieval with LMs. The code for reproducing our results and the keyword-augmented datasets will be released on formal publication.


title: Variational Temporal IRT: Fast, Accurate, and Explainable Inference of Dynamic Learner Proficiency

abstract: Dynamic Item Response Models extend the standard Item Response Theory (IRT) to capture temporal dynamics in learner ability. While these models have the potential to allow instructional systems to actively monitor the evolution of learner proficiency in real time, existing dynamic item response models rely on expensive inference algorithms that scale poorly to massive datasets. In this work, we propose Variational Temporal IRT (VTIRT) for fast and accurate inference of dynamic learner proficiency. VTIRT offers orders of magnitude speedup in inference runtime while still providing accurate inference. Moreover, the proposed algorithm is intrinsically interpretable by virtue of its modular design. When applied to 9 real student datasets, VTIRT consistently yields improvements in predicting future learner performance over other learner proficiency models.


title: Fast Parallel Tensor Times Same Vector for Hypergraphs

abstract: Hypergraphs are a popular paradigm to represent complex real-world networks exhibiting multi-way relationships of varying sizes. Mining centrality in hypergraphs via symmetric adjacency tensors has only recently become computationally feasible for large and complex datasets. To enable scalable computation of these and related hypergraph analytics, here we focus on the Sparse Symmetric Tensor Times Same Vector (S$^3$TTVc) operation. We introduce the Compound Compressed Sparse Symmetric (CCSS) format, an extension of the compact CSS format for hypergraphs of varying hyperedge sizes and present a shared-memory parallel algorithm to compute S$^3$TTVc. We experimentally show S$^3$TTVc computation using the CCSS format achieves better performance than the naive baseline, and is subsequently more performant for hypergraph $H$-eigenvector centrality.


title: Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experiment

abstract: The interactive nature of Large Language Models (LLMs) theoretically allows models to refine and improve their answers, yet systematic analysis of the multi-turn behavior of LLMs remains limited. In this paper, we propose the FlipFlop experiment: in the first round of the conversation, an LLM completes a classification task. In a second round, the LLM is challenged with a follow-up phrase like "Are you sure?", offering an opportunity for the model to reflect on its initial answer, and decide whether to confirm or flip its answer. A systematic study of ten LLMs on seven classification tasks reveals that models flip their answers on average 46% of the time and that all models see a deterioration of accuracy between their first and final prediction, with an average drop of 17% (the FlipFlop effect). We conduct finetuning experiments on an open-source LLM and find that finetuning on synthetically created data can mitigate - reducing performance deterioration by 60% - but not resolve sycophantic behavior entirely. The FlipFlop experiment illustrates the universality of sycophantic behavior in LLMs and provides a robust framework to analyze model behavior and evaluate future models.


title: Stopping Methods for Technology Assisted Reviews based on Point Processes

abstract: Technology Assisted Review (TAR), which aims to reduce the effort required to screen collections of documents for relevance, is used to develop systematic reviews of medical evidence and identify documents that must be disclosed in response to legal proceedings. Stopping methods are algorithms which determine when to stop screening documents during the TAR process, helping to ensure that workload is minimised while still achieving a high level of recall. This paper proposes a novel stopping method based on point processes, which are statistical models that can be used to represent the occurrence of random events. The approach uses rate functions to model the occurrence of relevant documents in the ranking and compares four candidates, including one that has not previously been used for this purpose (hyperbolic). Evaluation is carried out using standard datasets (CLEF e-Health, TREC Total Recall, TREC Legal), and this work is the first to explore stopping method robustness by reporting performance on a range of rankings of varying effectiveness. Results show that the proposed method achieves the desired level of recall without requiring an excessive number of documents to be examined in the majority of cases and also compares well against multiple alternative approaches.


title: DALA: A Distribution-Aware LoRA-Based Adversarial Attack against Language Models

abstract: Language models (LMs) can be manipulated by adversarial attacks, which introduce subtle perturbations to input data. While recent attack methods can achieve a relatively high attack success rate (ASR), we've observed that the generated adversarial examples have a different data distribution compared with the original examples. Specifically, these adversarial examples exhibit reduced confidence levels and greater divergence from the training data distribution. Consequently, they are easy to detect using straightforward detection methods, diminishing the efficacy of such attacks. To address this issue, we propose a Distribution-Aware LoRA-based Adversarial Attack (DALA) method. DALA considers distribution shifts of adversarial examples to improve the attack's effectiveness under detection methods. We further design a novel evaluation metric, the Non-detectable Attack Success Rate (NASR), which integrates both ASR and detectability for the attack task. We conduct experiments on four widely used datasets to validate the attack effectiveness and transferability of adversarial examples generated by DALA against both the white-box BERT-base model and the black-box LLaMA2-7b model. Our codes are available at https://anonymous.4open.science/r/DALA-A16D/.


title: High-speed surface-property recognition by 140-GHz frequency

abstract: In the field of integrated sensing and communication, there's a growing need for advanced environmental perception. The terahertz (THz) frequency band, significant for ultra-high-speed data connections, shows promise in environmental sensing, particularly in detecting surface textures crucial for autonomous system's decision-making. However, traditional numerical methods for parameter estimation in these environments struggle with accuracy, speed, and stability, especially in high-speed scenarios like vehicle-to-everything communications. This study introduces a deep learning approach for identifying surface roughness using a 140-GHz setup tailored for high-speed conditions. A high-speed data acquisition system was developed to mimic real-world scenarios, and a diverse set of rough surface samples was collected for realistic high-speed datasets to train the models. The model was trained and validated in three challenging scenarios: random occlusions, sparse data, and narrow-angle observations. The results demonstrate the method's effectiveness in high-speed conditions, suggesting terahertz frequencies' potential in future sensing and communication applications.


title: Derivation of sixth-order exponential Runge--Kutta methods for stiff systems

abstract: This work constructs the first-ever sixth-order exponential Runge--Kutta (ExpRK) methods for the time integration of stiff parabolic PDEs. First, we leverage the exponential B-series theory to restate the stiff order conditions for ExpRK methods of arbitrary order based on an essential set of trees only. Then, we explicitly provide the 36 order conditions required for sixth-order methods and present convergence results. In addition, we are able to solve the 36 stiff order conditions in both their weak and strong forms, resulting in two families of sixth-order parallel stages ExpRK schemes. Interestingly, while these new schemes require a high number of stages, they can be implemented efficiently similar to the cost of a 6-stage method. Numerical experiments are given to confirm the accuracy and efficiency of the new schemes.


title: Golden Ratio Information for Neural Spike Code

abstract: Spike bursting is a ubiquitous feature of all neuronal systems. Assuming the spiking states form an alphabet for a communication system, what is the optimal information processing rate? and what is the channel capacity? Here we demonstrate that the quaternary alphabet of spike number code gives the maximal processing rate, and that a binary source in Golden Ratio distribution gives rise to the channel capacity. A multi-time scaled neural circuit is shown to satisfy the hypotheses of this neural communication system.


title: Data downloaded via parachute from a NASA super-pressure balloon

abstract: In April to May 2023, the superBIT telescope was lifted to the Earth's stratosphere by a helium-filled super-pressure balloon, to acquire astronomical imaging from above (99.5% of) the Earth's atmosphere. It was launched from New Zealand then, for 40 days, circumnavigated the globe five times at a latitude 40 to 50 degrees South. Attached to the telescope were four 'DRS' (Data Recovery System) capsules containing 5 TB solid state data storage, plus a GNSS receiver, Iridium transmitter, and parachute. Data from the telescope were copied to these, and two were dropped over Argentina. They drifted 61 km horizontally while they descended 32 km, but we predicted their descent vectors within 2.4 km: in this location, the discrepancy appears irreducible below 2 km because of high speed, gusty winds and local topography. The capsules then reported their own locations to within a few metres. We recovered the capsules and successfully retrieved all of superBIT's data - despite the telescope itself being later destroyed on landing.


title: The study of x-ray spectrum of the Coma cluster

abstract: The X-ray spectrum of the Coma galaxy cluster was studied using the data from the XMM-Newton observatory. We combined 7 observations performed with the MOS camera of XMM-Newton in the 40'x 40' region centered at the Coma cluster. The analyzed observations were performed in 2000-2005 and have a total duration of 196 ksec. We focus on the analysis of the MOS camera spectra due to their lower affection by strong instrumental line-like background. The obtained spectrum was fitted with a model including contributions from the Solar system/Milky Way hot plasma and a power law X-ray background. The contribution of the instrumental background was modeled as a power law (not convolved with the effective area) and a number of Gaussian lines. The contribution from the Coma cluster was modeled with a single-temperature hot plasma emission. In addition, we searched for possible non-thermal radiation present in the vicinity of the center of the Coma cluster, originating e.g. from synchrotron emission of relativistic electrons on a turbulent magnetic field. We compared the results with previous works by other authors and spectra obtained from other instruments that operate in the similar energy range of 1-10 keV. Careful and detailed spectrum analysis shall be a necessary contribution to our future work - searching for axion-like particles' manifestations in the Coma cluster.


title: Incremental Cost-Effectiveness Statistical Inference: Calculations and Communications

abstract: We illustrate use of nonparametric statistical methods to compare alternative treatments for a particular disease or condition on both their relative effectiveness and their relative cost. These Incremental Cost Effectiveness (ICE) methods are based upon Bootstrapping, i.e. Resampling with Replacement from observational or clinical-trial data on individual patients. We first show how a reasonable numerical value for the "Shadow Price of Health" can be chosen using functions within the ICEinfer R-package when effectiveness is not measured in "QALY"s. We also argue that simple histograms are ideal for communicating key findings to regulators, while our more detailed graphics may well be more informative and compelling for other health-care stakeholders.


title: Exploring the Jungle of Bias: Political Bias Attribution in Language Models via Dependency Analysis

abstract: The rapid advancement of Large Language Models (LLMs) has sparked intense debate regarding the prevalence of bias in these models and its mitigation. Yet, as exemplified by both results on debiasing methods in the literature and reports of alignment-related defects from the wider community, bias remains a poorly understood topic despite its practical relevance. To enhance the understanding of the internal causes of bias, we analyse LLM bias through the lens of causal fairness analysis, which enables us to both comprehend the origins of bias and reason about its downstream consequences and mitigation. To operationalize this framework, we propose a prompt-based method for the extraction of confounding and mediating attributes which contribute to the LLM decision process. By applying Activity Dependency Networks (ADNs), we then analyse how these attributes influence an LLM's decision process. We apply our method to LLM ratings of argument quality in political debates. We find that the observed disparate treatment can at least in part be attributed to confounding and mitigating attributes and model misalignment, and discuss the consequences of our findings for human-AI alignment and bias mitigation. Our code and data are at https://github.com/david-jenny/LLM-Political-Study.


title: Protective Effects of Halite to Vacuum and Vacuum-Ultraviolet Radiation: A Potential Scenario During a Young Sun Superflare

abstract: Halite (NaCl mineral) has exhibited the potential to preserve microorganisms for millions of years on Earth. This mineral was also identified on Mars and in meteorites. In this study, we investigated the potential of halite crystals to protect microbial life forms on the surface of an airless body (e.g., meteorite), for instance, during a lithopanspermia process (interplanetary travel step) in the early Solar System. To investigate the effect of the radiation of the young Sun on microorganisms, we performed extensive simulation experiments by employing a synchrotron facility. We focused on two exposure conditions: vacuum (low Earth orbit, 10^{-4}Pa) and vacuum-ultraviolet (VUV) radiation (range 57.6 - 124 nm, flux 7.14 W m^{-2}), with the latter representing an extreme scenario with high VUV fluxes comparable to the amount of radiation of a stellar superflare from the young Sun. The stellar VUV parameters were estimated by using the very well-studied solar analog of the young Sun, k^{1}Cet. To evaluate the protective effects of halite, we entrapped a halophilic archaeon (Haloferax volcanii) and a non-halophilic bacterium (Deinococcus radiodurans) in laboratory-grown halite. Control groups were cells entrapped in salt crystals (mixtures of different salts and NaCl) and non-trapped (naked) cells, respectively. All groups were exposed either to vacuum alone or to vacuum plus VUV. Our results demonstrate that halite can serve as protection against vacuum and VUV radiation, regardless of the type of microorganism. In addition, we found that the protection is higher than provided by crystals obtained from mixtures of salts. This extends the protective effects of halite documented in previous studies and reinforces the possibility to consider the crystals of this mineral as potential preservation structures in airless bodies or as vehicles for the interplanetary transfer of microorganisms.


title: Towards Generalizable SER: Soft Labeling and Data Augmentation for Modeling Temporal Emotion Shifts in Large-Scale Multilingual Speech

abstract: Recognizing emotions in spoken communication is crucial for advanced human-machine interaction. Current emotion detection methodologies often display biases when applied cross-corpus. To address this, our study amalgamates 16 diverse datasets, resulting in 375 hours of data across languages like English, Chinese, and Japanese. We propose a soft labeling system to capture gradational emotional intensities. Using the Whisper encoder and data augmentation methods inspired by contrastive learning, our method emphasizes the temporal dynamics of emotions. Our validation on four multilingual datasets demonstrates notable zero-shot generalization. We publish our open source model weights and initial promising results after fine-tuning on Hume-Prosody.


title: Multi-Radar Inertial Odometry for 3D State Estimation using mmWave Imaging Radar

abstract: State estimation is a crucial component for the successful implementation of robotic systems, relying on sensors such as cameras, LiDAR, and IMUs. However, in real-world scenarios, the performance of these sensors is degraded by challenging environments, e.g. adverse weather conditions and low-light scenarios. The emerging 4D imaging radar technology is capable of providing robust perception in adverse conditions. Despite its potential, challenges remain for indoor settings where noisy radar data does not present clear geometric features. Moreover, disparities in radar data resolution and field of view (FOV) can lead to inaccurate measurements. While prior research has explored radar-inertial odometry based on Doppler velocity information, challenges remain for the estimation of 3D motion because of the discrepancy in the FOV and resolution of the radar sensor. In this paper, we address Doppler velocity measurement uncertainties. We present a method to optimize body frame velocity while managing Doppler velocity uncertainty. Based on our observations, we propose a dual imaging radar configuration to mitigate the challenge of discrepancy in radar data. To attain high-precision 3D state estimation, we introduce a strategy that seamlessly integrates radar data with a consumer-grade IMU sensor using fixed-lag smoothing optimization. Finally, we evaluate our approach using real-world 3D motion data.


title: On syzygies of Mori fibre spaces

abstract: We introduce homological and homotopical $r$-syzygies of Mori fibre spaces as a generalization of Sarkisov links and relations of Sarkisov links. For any proper morphism $Y/R$, we construct a contractible (if not empty) CW complex such that there is a 1-1 correspondence between its cells and the central models of $Y/R$. We derive from this CW complex a long exact sequence and a spectral sequence converging to the (co)homology of the relative birational automorphism group of $Y/R$. As an application, we compute the second group homology of the second Cremona group.


title: Converting Transformers to Polynomial Form for Secure Inference Over Homomorphic Encryption

abstract: Designing privacy-preserving deep learning models is a major challenge within the deep learning community. Homomorphic Encryption (HE) has emerged as one of the most promising approaches in this realm, enabling the decoupling of knowledge between the model owner and the data owner. Despite extensive research and application of this technology, primarily in convolutional neural networks, incorporating HE into transformer models has been challenging because of the difficulties in converting these models into a polynomial form. We break new ground by introducing the first polynomial transformer, providing the first demonstration of secure inference over HE with transformers. This includes a transformer architecture tailored for HE, alongside a novel method for converting operators to their polynomial equivalent. This innovation enables us to perform secure inference on LMs with WikiText-103. It also allows us to perform image classification with CIFAR-100 and Tiny-ImageNet. Our models yield results comparable to traditional methods, bridging the performance gap with transformers of similar scale and underscoring the viability of HE for state-of-the-art applications. Finally, we assess the stability of our models and conduct a series of ablations to quantify the contribution of each model component.


title: Theory of Infectious Diseases with Testing and Testing-less Covid-19 Endemic

abstract: What is the long term dynamics of the Covid-19 pandemic? How will it end? Here we constructed an infectious disease model with testing and analyzed the existence and stability of its endemic states. For a large parameter set, including those relevant to the SARS-CoV-2 virus, we demonstrated the existence of one endemic equilibrium without testing and one endemic equilibrium with testing and proved their local and global stabilities for some cases. Our results suggest that the pandemic is to end with a testing-less endemic state through a novel and surprising mechanism called stochastic trapping.


title: Directional Ballistic Transport for Partially Periodic Schr\"odinger Operators

abstract: We study the transport properties of Schr\"{o}dinger operators on $\mathbb{R}^d$ and $\mathbb{Z}^d$ with potentials that are periodic in some directions and compactly supported in the others. Such systems are known to produce "surface states" that are confined near the support of the potential. We show that, under very mild assumptions, a class of surface states exhibits what we describe as directional ballistic transport, consisting of a strong form of ballistic transport in the periodic directions and its absence in the other directions. Furthermore, on $\mathbb{Z}^2$, we show that a dense set of surface states exhibit directional ballistic transport. In appendices, we generalize Simon's classic result on the absence of ballistic transport for pure point states [36], and prove a folklore theorem on ballistic transport for scattering states. In particular, this final result allows for a proof of ballistic transport for a dense set subset of $\ell^2(\mathbb{Z}^2)$ for periodic strip models.


title: High-Resolution Particle-In-Cell Simulations of Two-Dimensional Bernstein-Greene-Kruskal Modes

abstract: We present two dimensional (2D) particle-in-cell (PIC) simulations of 2D Bernstein-Greene-Kruskal (BGK) modes, which are exact nonlinear steady-state solutions of the Vlasov-Poisson equations, on a 2D plane perpendicular to a background magnetic field, with a cylindrically symmetric electric potential localized on the plane. PIC simulations are initialized using analytic electron distributions and electric potentials from the theory. We confirm the validity of such solutions using high-resolutions up to a 2048^2 grid. We show that the solutions are dynamically stable for a stronger background magnetic field, while keeping other parameters of the model fixed, but become unstable when the field strength is weaker than a certain value. When a mode becomes unstable, we observe that the instability begins with the excitation of azimuthal electrostatic waves that ends with a spiral pattern.

categories: physics.plasm-ph astro-ph.GA physics.comp-ph physics.space-ph


title: XplainLLM: A QA Explanation Dataset for Understanding LLM Decision-Making

abstract: Large Language Models (LLMs) have recently made impressive strides in natural language understanding tasks. Despite their remarkable performance, understanding their decision-making process remains a big challenge. In this paper, we look into bringing some transparency to this process by introducing a new explanation dataset for question answering (QA) tasks that integrates knowledge graphs (KGs) in a novel way. Our dataset includes 12,102 question-answer-explanation (QAE) triples. Each explanation in the dataset links the LLM's reasoning to entities and relations in the KGs. The explanation component includes a why-choose explanation, a why-not-choose explanation, and a set of reason-elements that underlie the LLM's decision. We leverage KGs and graph attention networks (GAT) to find the reason-elements and transform them into why-choose and why-not-choose explanations that are comprehensible to humans. Through quantitative and qualitative evaluations, we demonstrate the potential of our dataset to improve the in-context learning of LLMs, and enhance their interpretability and explainability. Our work contributes to the field of explainable AI by enabling a deeper understanding of the LLMs decision-making process to make them more transparent and thereby, potentially more reliable, to researchers and practitioners alike. Our dataset is available at: https://github.com/chen-zichen/XplainLLM_dataset.git


title: Non-Uniform Smoothness for Gradient Descent

abstract: The analysis of gradient descent-type methods typically relies on the Lipschitz continuity of the objective gradient. This generally requires an expensive hyperparameter tuning process to appropriately calibrate a stepsize for a given problem. In this work we introduce a local first-order smoothness oracle (LFSO) which generalizes the Lipschitz continuous gradients smoothness condition and is applicable to any twice-differentiable function. We show that this oracle can encode all relevant problem information for tuning stepsizes for a suitably modified gradient descent method and give global and local convergence results. We also show that LFSOs in this modified first-order method can yield global linear convergence rates for non-strongly convex problems with extremely flat minima, and thus improve over the lower bound on rates achievable by general (accelerated) first-order methods.


title: Emergent modified gravity: The perfect fluid and gravitational collapse

abstract: Emergent modified gravity is a canonical theory based on general covariance where the spacetime is not fundamental, but rather an emergent object. This feature allows for modifications of the classical theory and can be used to model new effects, such as those suggested by quantum gravity. We discuss how matter fields can be coupled to emergent modified gravity, realize the coupling of the perfect fluid, identify the symmetries of the system, and explicitly obtain the Hamiltonian in spherical symmetry. We formulate the Oppenheimer-Snyder collapse model in canonical terms, permitting us to extend the model to emergent modified gravity and obtain an exact solution to the dust collapsing from spatial infinity including some effects suggested by quantum gravity. In this solution the collapsing dust forms a black hole, then the star radius reaches a minimum with vanishing velocity and finite positive acceleration, and proceeds to emerge out now behaving as a white hole. While the geometry on the minimum-radius surface is regular in the vacuum, it is singular in the presence of dust. However, the fact that the geometry is emergent, and the fundamental fields that compose the phase-space are regular, allows us to continue the canonical solution in a meaningful way, obtaining the global structure for the interior of the star. The star-interior solution is complemented by the vacuum solution describing the star-exterior region by a continuous junction at the star radius. This gluing process can be viewed as the imposition of boundary conditions, which is non-unique and does not follow from the equations of motion. This ambiguity gives rise to different possible physical outcomes of the collapse. We discuss two such phenomena: the formation of a wormhole and the transition from a black hole to a white hole.


title: Bank Performance Determinants: State of the Art and Future Research Avenues

abstract: Banks' performance is an important topic for both professionals and researchers. Given the important literature on this subject, this paper aims to bring an up-to-date and organized review of literature on the determinants of banks performance. This paper discusses the main approaches that molded the debate on banks performance and their main determinants. An in-depth understanding of these latter may allow on the one hand, bank managers and regulators to improve the sector efficiency and to deal with the new trends shaping the future of their industry and on the other hand, academicians to enrich research and knowledge on this field. Through the analysis of 54 studies published in 42 peer-reviewed journals, we show that despite the importance of the existent literature, the subject of bank performance factors did not reveal all its secrets and still constitute a fertile field for critical debates, especially since the COVID-19 and the increasingly pressing rise in power of digital transformation and artificial intelligence in general and FinTechs in particular. The study concludes by suggesting new promising research avenues.


title: Computing the k-th Eigenvalue of Symmetric $H^2$-Matrices

abstract: The numerical solution of eigenvalue problems is essential in various application areas of scientific and engineering domains. In many problem classes, the practical interest is only a small subset of eigenvalues so it is unnecessary to compute all of the eigenvalues. Notable examples are the electronic structure problems where the $k$-th smallest eigenvalue is closely related to the electronic properties of materials. In this paper, we consider the $k$-th eigenvalue problems of symmetric dense matrices with low-rank off-diagonal blocks. We present a linear time generalized LDL decomposition of $\mathcal{H}^2$ matrices and combine it with the bisection eigenvalue algorithm to compute the $k$-th eigenvalue with controllable accuracy. In addition, if more than one eigenvalue is required, some of the previous computations can be reused to compute the other eigenvalues in parallel. Numerical experiments show that our method is more efficient than the state-of-the-art dense eigenvalue solver in LAPACK/ScaLAPACK and ELPA. Furthermore, tests on electronic state calculations of carbon nanomaterials demonstrate that our method outperforms the existing HSS-based bisection eigenvalue algorithm on 3D problems.


title: Analysis of the neutral fluxes in the divertor region of Wendelstein 7-X under attached and detached conditions using EMC3-EIRENE

abstract: This paper analyzes the neutral fluxes in the divertor region of the W7-X standard configuration for different input powers, both under attached and detached conditions. The performed analysis is conducted through EMC3-EIRENE simulations. They show the importance of the horizontal divertor to generate neutrals, and resolve the neutral plugging in the divertor region. Simulations of detached cases show a decrease in the number of generated neutrals compared to the attached simulations, in addition to a higher fraction of the ion flux arriving on the baffles during detachment. As the ionization takes place further inside the plasma during detachment, a larger percentage of the generated neutral particles leave the divertor as neutrals. The leakage in the poloidal and toroidal direction increases, just as the fraction of collected particles at the pumping gap. The fraction of pumped particles increases with a factor two, but stays below one percent. This demonstrates that detachment with the current target geometry, although it improves the power exhaust, is not yet leading to an increased particle exhaust.


title: Toucan: Token-Aware Character Level Language Modeling

abstract: Character-level language models obviate the need for separately trained tokenizers, but efficiency suffers from longer sequence lengths. Learning to combine character representations into tokens has made training these models more efficient, but they still require decoding characters individually. We propose Toucan, an augmentation to character-level models to make them "token-aware". Comparing our method to prior work, we demonstrate significant speed-ups in character generation without a loss in language modeling performance. We then explore differences between our learned dynamic tokenization of character sequences with popular fixed vocabulary solutions such as Byte-Pair Encoding and WordPiece, finding our approach leads to a greater amount of longer sequences tokenized as single items. Our project and code are available at https://nlp.jhu.edu/nuggets/.


title: Cross Device Federated Intrusion Detector for Early Stage Botnet Propagation in IoT

abstract: A botnet is an army of zombified computers infected with malware and controlled by malicious actors to carry out tasks such as Distributed Denial of Service (DDoS) attacks. Billions of Internet of Things (IoT) devices are primarily targeted to be infected as bots since they are configured with weak credentials or contain common vulnerabilities. Detecting botnet propagation by monitoring the network traffic is difficult as they easily blend in with regular network traffic. The traditional machine learning (ML) based Intrusion Detection System (IDS) requires the raw data to be captured and sent to the ML processor to detect intrusion. In this research, we examine the viability of a cross-device federated intrusion detection mechanism where each device runs the ML model on its data and updates the model weights to the central coordinator. This mechanism ensures the client's data is not shared with any third party, terminating privacy leakage. The model examines each data packet separately and predicts anomalies. We evaluate our proposed mechanism on a real botnet propagation dataset called MedBIoT. Overall, the proposed method produces an average accuracy of 71%, precision 78%, recall 71%, and f1-score 68%. In addition, we also examined whether any device taking part in federated learning can employ a poisoning attack on the overall system.


title: Multiple-Question Multiple-Answer Text-VQA

abstract: We present Multiple-Question Multiple-Answer (MQMA), a novel approach to do text-VQA in encoder-decoder transformer models. The text-VQA task requires a model to answer a question by understanding multi-modal content: text (typically from OCR) and an associated image. To the best of our knowledge, almost all previous approaches for text-VQA process a single question and its associated content to predict a single answer. In order to answer multiple questions from the same image, each question and content are fed into the model multiple times. In contrast, our proposed MQMA approach takes multiple questions and content as input at the encoder and predicts multiple answers at the decoder in an auto-regressive manner at the same time. We make several novel architectural modifications to standard encoder-decoder transformers to support MQMA. We also propose a novel MQMA denoising pre-training task which is designed to teach the model to align and delineate multiple questions and content with associated answers. MQMA pre-trained model achieves state-of-the-art results on multiple text-VQA datasets, each with strong baselines. Specifically, on OCR-VQA (+2.5%), TextVQA (+1.4%), ST-VQA (+0.6%), DocVQA (+1.1%) absolute improvements over the previous state-of-the-art approaches.


title: DEED: Dynamic Early Exit on Decoder for Accelerating Encoder-Decoder Transformer Models

abstract: Encoder-decoder transformer models have achieved great success on various vision-language (VL) tasks, but they suffer from high inference latency. Typically, the decoder takes up most of the latency because of the auto-regressive decoding. To accelerate the inference, we propose an approach of performing Dynamic Early Exit on Decoder (DEED). We build a multi-exit encoder-decoder transformer model which is trained with deep supervision so that each of its decoder layers is capable of generating plausible predictions. In addition, we leverage simple yet practical techniques, including shared generation head and adaptation modules, to keep accuracy when exiting at shallow decoder layers. Based on the multi-exit model, we perform step-level dynamic early exit during inference, where the model may decide to use fewer decoder layers based on its confidence of the current layer at each individual decoding step. Considering different number of decoder layers may be used at different decoding steps, we compute deeper-layer decoder features of previous decoding steps just-in-time, which ensures the features from different decoding steps are semantically aligned. We evaluate our approach with two state-of-the-art encoder-decoder transformer models on various VL tasks. We show our approach can reduce overall inference latency by 30%-60% with comparable or even higher accuracy compared to baselines.


title: Flow control by a hybrid use of machine learning and control theory

abstract: Flow control has a great potential to contribute to the sustainable society through mitigation of environmental burden. However, high dimensional and nonlinear nature of fluid flows poses challenges in designing efficient control laws. This paper aims to propose a hybrid method (i.e., machine learning and control theory) for feedback control of fluid flows. We propose a partially nonlinear linear-system extraction autoencoder (pn-LEAE), which consists of convolutional neural networks-based autoencoder (CNN-AE) and a custom layer to extract a low-dimensional latent dynamics. This pn-LEAE basically extracts a linear dynamical system so that the modern control theory can easily be applied, but at the same time, it is designed to capture a nonlinear development of the latent dynamics. We demonstrate the effectiveness of the linear system extracted by the pn-LEAE, as well as the designed control law's effectiveness for a flow around a circular cylinder at the Reynolds number of ${\rm Re}_{D}=100$. This is the first attempt utilizing CNN-AE for linearization of fluid flows involving transient development to design a feedback control law.


title: A Statistical Verification Method of Random Permutations for Hiding Countermeasure Against Side-Channel Attacks

abstract: As NIST is putting the final touches on the standardization of PQC (Post Quantum Cryptography) public key algorithms, it is a racing certainty that peskier cryptographic attacks undeterred by those new PQC algorithms will surface. Such a trend in turn will prompt more follow-up studies of attacks and countermeasures. As things stand, from the attackers' perspective, one viable form of attack that can be implemented thereupon is the so-called "side-channel attack". Two best-known countermeasures heralded to be durable against side-channel attacks are: "masking" and "hiding". In that dichotomous picture, of particular note are successful single-trace attacks on some of the NIST's PQC then-candidates, which worked to the detriment of the former: "masking". In this paper, we cast an eye over the latter: "hiding". Hiding proves to be durable against both side-channel attacks and another equally robust type of attacks called "fault injection attacks", and hence is deemed an auspicious countermeasure to be implemented. Mathematically, the hiding method is fundamentally based on random permutations. There has been a cornucopia of studies on generating random permutations. However, those are not tied to implementation of the hiding method. In this paper, we propose a reliable and efficient verification of permutation implementation, through employing Fisher-Yates' shuffling method. We introduce the concept of an n-th order permutation and explain how it can be used to verify that our implementation is more efficient than its previous-gen counterparts for hiding countermeasures.


title: Ratios conjecture of cubic $L$-functions of prime moduli

abstract: We develop $L$-functions ratios conjecture with one shift in the numerator and denominator in certain ranges for the family of cubic Hecke $L$-functions of prime moduli over the Eisenstein field using multiple Dirichlet series under the generalized Riemann hypothesis. As applications, we evaluate asymptotically the first moment of central values as well as the one-level density of the same family of $L$-functions.


title: Intermittency and Dissipative Structures Arising from Relativistic Magnetized Turbulence

abstract: Kinetic simulations of relativistic turbulence have significantly advanced our understanding of turbulent particle acceleration. Recent progress has highlighted the need for an updated acceleration theory that can account for acceleration within the plasma's coherent structures. Here, we investigate how turbulent intermittency models connect statistical fluctuations in turbulence to regions of high dissipation. This connection is established by employing a generalized She-Leveque model to describe the exponents $\zeta_p$ for the structure functions $S^p \propto l^{\zeta_p}$. The fitting of the scaling exponents provide us with a measure of the co-dimension of the dissipative structures, and we subsequently measure their filling fraction. We perform our analysis for a range of magnetizations $\sigma$ and magnetic field fluctuations ${\delta B_0}/{B_0}$. We find that increasing the values of $\sigma$ and ${\delta B_0}/{B_0}$ allows the cascade to break sheets into smaller regions of dissipation that resemble chains of plasmoids. However, as their dissipation increases, the dissipative regions become less volume filling. With this work we aim to inform future turbulent acceleration theories that incorporate particle energization from interactions with coherent structures within relativistic turbulence.


title: Integrated Local Energy Decay for Damped Magnetic Wave Equations on Stationary Space-Times

abstract: We establish local energy decay for damped magnetic wave equations on stationary, asymptotically flat space-times subject to the geometric control condition. More specifically, we allow for the addition of time-independent magnetic and scalar potentials, which negatively affect energy coercivity and may add in unwieldy spectral effects. By asserting the non-existence of eigenvalues in the lower half-plane and resonances on the real line, we are able to apply spectral theory from the work of Metcalfe, Sterbenz, and Tataru and combine with a generalization of prior work by the present author to extend the latter work and establish local energy decay, under one additional symmetry hypothesis. Namely, we assume that either the imaginary part of the magnetic potentials are uniformly small or, more interestingly and novelly, that the damping term is the dominant principal term in the skew-adjoint part of the damped wave operator within the region where the metric perturbation from that of Minkowski space is permitted to be large. We also obtain an energy dichotomy if we do not prohibit non-zero real resonances. In order to make the structure of the argument more cohesive, we contextualize the present work within requisite existing theory.


title: Soft Phenotyping for Sepsis via EHR Time-aware Soft Clustering

abstract: Objective: Sepsis is one of the most serious hospital conditions associated with high mortality. Sepsis is the result of a dysregulated immune response to infection that can lead to multiple organ dysfunction and death. Due to the wide variability in the causes of sepsis, clinical presentation, and the recovery trajectories, identifying sepsis sub-phenotypes is crucial to advance our understanding of sepsis characterization, to choose targeted treatments and optimal timing of interventions, and to improve prognostication. Prior studies have described different sub-phenotypes of sepsis using organ-specific characteristics. These studies applied clustering algorithms to electronic health records (EHRs) to identify disease sub-phenotypes. However, prior approaches did not capture temporal information and made uncertain assumptions about the relationships among the sub-phenotypes for clustering procedures. Methods: We developed a time-aware soft clustering algorithm guided by clinical variables to identify sepsis sub-phenotypes using data available in the EHR. Results: We identified six novel sepsis hybrid sub-phenotypes and evaluated them for medical plausibility. In addition, we built an early-warning sepsis prediction model using logistic regression. Conclusion: Our results suggest that these novel sepsis hybrid sub-phenotypes are promising to provide more accurate information on sepsis-related organ dysfunction and sepsis recovery trajectories which can be important to inform management decisions and sepsis prognosis.


title: Multi-channel Conversational Speaker Separation via Neural Diarization

abstract: When dealing with overlapped speech, the performance of automatic speech recognition (ASR) systems substantially degrades as they are designed for single-talker speech. To enhance ASR performance in conversational or meeting environments, continuous speaker separation (CSS) is commonly employed. However, CSS requires a short separation window to avoid many speakers inside the window and sequential grouping of discontinuous speech segments. To address these limitations, we introduce a new multi-channel framework called "speaker separation via neural diarization" (SSND) for meeting environments. Our approach utilizes an end-to-end diarization system to identify the speech activity of each individual speaker. By leveraging estimated speaker boundaries, we generate a sequence of embeddings, which in turn facilitate the assignment of speakers to the outputs of a multi-talker separation model. SSND addresses the permutation ambiguity issue of talker-independent speaker separation during the diarization phase through location-based training, rather than during the separation process. This unique approach allows multiple non-overlapped speakers to be assigned to the same output stream, making it possible to efficiently process long segments-a task impossible with CSS. Additionally, SSND is naturally suitable for speaker-attributed ASR. We evaluate our proposed diarization and separation methods on the open LibriCSS dataset, advancing state-of-the-art diarization and ASR results by a large margin.


title: Influence of Video Dynamics on EEG-based Single-Trial Video Target Surveillance System

abstract: Target detection models are one of the widely used deep learning-based applications for reducing human efforts on video surveillance and patrol. However, the application of conventional computer vision-based target detection models in military usage can result in limited performance, due to the lack of sample data of hostile targets. In this paper, we present the possibility of the electroencephalography-based video target detection model, which could be applied as a supportive module of the military video surveillance system. The proposed framework and detection model showed prospective performance achieving a mean macro F-beta of 0.6522 with asynchronous real-time data from five subjects, in a certain video stimulus, but not on some video stimuli. By analyzing the results of experiments using each video stimulus, we present the factors that would affect the performance of electroencephalography-based video target detection models.


title: A connection between the poles of the zeta function of a recurrence sequence and the module of relations of its roots

abstract: Answering a question left open in previous research, we study the enumeration of poles of the zeta function $\varphi(s)$ associated to an integer linear recurrence sequence $\{a_n\}$. This enumeration can count poles more than once, and we prove that this happens if and only if the module of relations of the roots of the recurrence is nontrivial. A review of the existing literature on the module of relations yields a series of sufficient conditions for the enumeration of poles of $\varphi(s)$ to be injective. All of this is illustrated by examples of both cases.


title: Infrared thermochromic antenna composite for self-adaptive thermoregulation

abstract: Self-adaptive thermoregulation, the mechanism living organisms use to balance their temperature, holds great promise for decarbonizing cooling and heating processes. The functionality can be effectively emulated by engineering the thermal emissivity of materials to adapt to background temperature variations. Yet, solutions that marry large emissivity switching (${\Delta}\epsilon$) with scalability, cost-effectiveness and design freedom are still lacking. Here, we fill this gap by introducing infrared dipole antennas made of tunable thermochromic materials. We demonstrate that non-spherical antennas (rods, stars and flakes) made of vanadium-dioxide can exhibit a massive (~200-fold) increase in their absorption cross-section as temperature rises. Embedding these antennas in polymer films, or simply spraying them directly, creates free-form thermoregulation composites, featuring an outstanding ${\Delta}\epsilon\sim0.6$ in spectral ranges that can be tuned at will. Our research paves the way for versatile self-adaptive heat management solutions (coatings, fibers, membranes and films) that could find application in radiative-cooling, heat-sensing, thermal-camouflage, and other.


title: On the minimum degree of minimally $ t $-tough, claw-free graphs

abstract: A graph $ G $ is minimally $ t $-tough if the toughness of $ G $ is $ t $ and deletion of any edge from $ G $ decreases its toughness. Katona et al. conjectured that the minimum degree of any minimally $ t $-tough graph is $ \lceil 2t\rceil $ and proved that the minimum degree of minimally $ \frac{1}2 $-tough and $ 1 $-tough, claw-free graphs is 1 and 2, respectively. We have show that every minimally $ 3/2 $-tough, claw-free graph has a vertex of degree of $ 3 $. In this paper, we give an upper bound on the minimum degree of minimally $t$-tough, claw-free graphs for $ t\geq 2 $.


title: Spatio-Temporal Graph Neural Point Process for Traffic Congestion Event Prediction

abstract: Traffic congestion event prediction is an important yet challenging task in intelligent transportation systems. Many existing works about traffic prediction integrate various temporal encoders and graph convolution networks (GCNs), called spatio-temporal graph-based neural networks, which focus on predicting dense variables such as flow, speed and demand in time snapshots, but they can hardly forecast the traffic congestion events that are sparsely distributed on the continuous time axis. In recent years, neural point process (NPP) has emerged as an appropriate framework for event prediction in continuous time scenarios. However, most conventional works about NPP cannot model the complex spatio-temporal dependencies and congestion evolution patterns. To address these limitations, we propose a spatio-temporal graph neural point process framework, named STGNPP for traffic congestion event prediction. Specifically, we first design the spatio-temporal graph learning module to fully capture the long-range spatio-temporal dependencies from the historical traffic state data along with the road network. The extracted spatio-temporal hidden representation and congestion event information are then fed into a continuous gated recurrent unit to model the congestion evolution patterns. In particular, to fully exploit the periodic information, we also improve the intensity function calculation of the point process with a periodic gated mechanism. Finally, our model simultaneously predicts the occurrence time and duration of the next congestion. Extensive experiments on two real-world datasets demonstrate that our method achieves superior performance in comparison to existing state-of-the-art approaches.


title: Supervised low-rank semi-nonnegative matrix factorization with frequency regularization for forecasting spatio-temporal data

abstract: We propose a novel methodology for forecasting spatio-temporal data using supervised semi-nonnegative matrix factorization (SSNMF) with frequency regularization. Matrix factorization is employed to decompose spatio-temporal data into spatial and temporal components. To improve clarity in the temporal patterns, we introduce a nonnegativity constraint on the time domain along with regularization in the frequency domain. Specifically, regularization in the frequency domain involves selecting features in the frequency space, making an interpretation in the frequency domain more convenient. We propose two methods in the frequency domain: soft and hard regularizations, and provide convergence guarantees to first-order stationary points of the corresponding constrained optimization problem. While our primary motivation stems from geophysical data analysis based on GRACE (Gravity Recovery and Climate Experiment) data, our methodology has the potential for wider application. Consequently, when applying our methodology to GRACE data, we find that the results with the proposed methodology are comparable to previous research in the field of geophysical sciences but offer clearer interpretability.


title: Formal Proofs as Structured Explanations: Proposing Several Tasks on Explainable Natural Language Inference

abstract: In this position paper, we propose a way of exploiting formal proofs to put forward several explainable natural language inference (NLI) tasks. The formal proofs will be produced by a reliable and high-performing logic-based NLI system. Taking advantage of the in-depth information available in the generated formal proofs, we show how it can be used to define NLI tasks with structured explanations. The proposed tasks can be ordered according to difficulty defined in terms of the granularity of explanations. We argue that the tasks will suffer with substantially fewer shortcomings than the existing explainable NLI tasks (or datasets).


title: The Cosmology of Dark Energy Radiation

abstract: In this work, we quantify the cosmological signatures of dark energy radiation -- a novel description of dark energy, which proposes that the dynamical component of dark energy is comprised of a thermal bath of relativistic particles sourced by thermal friction from a slowly rolling scalar field. For a minimal model with particle production emerging from first principles, we find that the abundance of radiation sourced by dark energy can be as large as $\Omega_{\text{DER}} = 0.03$, exceeding the bounds on relic dark radiation by three orders of magnitude. Although the background and perturbative evolution of dark energy radiation is distinct from Quintessence, we find that current and near-future cosmic microwave background and supernova data will not distinguish these models of dark energy. We also find that our constraints on all models are dominated by their impact on the expansion rate of the Universe. Considering extensions that allow the dark radiation to populate neutrinos, axions, and dark photons, we evaluate the direct detection prospects of a thermal background comprised of these candidates consistent with cosmological constraints on dark energy radiation. Our study indicates that a resolution of $\sim 6 \, \text{meV}$ is required to achieve sensitivity to relativistic neutrinos compatible with dark energy radiation in a neutrino capture experiment on tritium. We also find that dark matter axion experiments lack sensitivity to a relativistic thermal axion background, even if enhanced by dark energy radiation, and dedicated search strategies are required to probe new parameter space. We derive constraints arising from a dark photon background from oscillations into visible photons, and find that viable parameter space can be explored with the LAte Dark Energy RAdiation (LADERA) experiment.


title: ColorTrace: Fungible token coloring and attribution

abstract: We formally define the fungible token coloring problem of attributing (coloring) fungible tokens to originating entities (minters), and present, to our knowledge, the first practical onchain algorithm to solve it. Tracking attribution of colored tokens losslessly using existing approaches such as the Colored Coins protocol is computationally intractable due to the per-wallet storage requirements growing in proportion to the number of minters. Our first contribution is an elegant solution to the single-chain token coloring problem, where colored tokens are atomically burned and minted to ensure each wallet only contains tokens of a single color. Our second contribution is an extension to this single-chain token coloring algorithm to allow safe and efficient crosschain token transfers. We present ColorTrace, an onchain algorithm to achieve globally consistent, economically feasible, fungible token coloring.


title: Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation

abstract: We study semi-supervised sequence generation tasks, where the few labeled examples are too scarce to finetune a model, and meanwhile, few-shot prompted large language models (LLMs) exhibit room for improvement. In this paper, we present the discovery that a student model distilled from a few-shot prompted LLM can commonly generalize better than its teacher to unseen examples on such tasks. We find that the student is able to learn a general pattern from the high-quality pseudolabels produced by the teacher during knowledge distillation (KD), and favorably not a general pattern from the low-quality pseudolables. Leveraging this discovery, we propose a new method, Multistage Collaborative Knowledge Distillation from an LLM (MCKD), for these tasks. MCKD first few-shot prompts an LLM to produce pseudolabels for unlabeled data. Then at each stage of an iterative KD process, a new pair of students is trained on disjoint partitions of the pseudolabeled data, and produces new and improved pseudolabels for their unseen partitions. We conduct extensive experiments on four syntactic and semantic parsing datasets and show the effectiveness of MCKD for low-resource semi-supervised sequence generation. On CRAFT biomedical parsing, for example, 3-stage MCKD with 50 labeled examples outperforms an LLM teacher and vanilla KD by 7.5% and 3.7% parsing F1, respectively, and matches the performance of supervised finetuning with 500 labeled examples.