title: C/O Ratios and the formation of wide separation exoplanets

abstract: The gas and solid-state C/O ratios provide context to potentially link the atmospheric composition of planets to that of the natal disk. We provide a synthesis of extant estimates of the gaseous C/O and C/H ratios in planet-forming disks obtained primarily through analysis of Atacama Large Millimeter Array observations. These estimates are compared to atmospheric abundances of wide separation (> 10 au) gas giants. The resolved disk gas C/O ratios, from seven systems, generally exhibit C/O > 1 with sub-solar, or depleted, carbon content. In contrast, wide separation gas giants have atmospheric C/O ratios that cluster near or slightly above the presumed stellar value with a range of elemental C/H. From the existing disk composition, we infer that the solid-state mm/cm-sized pebbles have a total C/O ratio (solid cores and ices) that is solar (stellar) in content. We explore simple models that reconstruct the exoplanet atmospheric composition from the disk, while accounting for silicate cloud formation in the planet atmosphere. If wide separate planets formed via the core-accretion mechanism, they must acquire their metals from pebble or planetesimal accretion. Further, the dispersion in giant planet C/H content is best matched by a disk composition with modest and variable factors of carbon depletion. An origin of the wide separation gas giants via gravitational instability cannot be ruled out as stellar C/O ratios should natively form in this scenario. However, the variation in planet metallicity with a stellar C/O ratio potentially presents challenges to these models.


title: Soft Prompting for Unlearning in Large Language Models

abstract: The widespread popularity of Large Language Models (LLMs), partly due to their unique ability to perform in-context learning, has also brought to light the importance of ethical and safety considerations when deploying these pre-trained models. In this work, we focus on investigating machine unlearning for LLMs motivated by data protection regulations. In contrast to the growing literature on fine-tuning methods to achieve unlearning, we focus on a comparatively lightweight alternative called soft prompting to realize the unlearning of a subset of training data. With losses designed to enforce forgetting as well as utility preservation, our framework \textbf{S}oft \textbf{P}rompting for \textbf{U}n\textbf{l}earning (SPUL) learns prompt tokens that can be appended to an arbitrary query to induce unlearning of specific examples at inference time without updating LLM parameters. We conduct a rigorous evaluation of the proposed method and our results indicate that SPUL can significantly improve the trade-off between utility and forgetting in the context of text classification with LLMs. We further validate our method using multiple LLMs to highlight the scalability of our framework and provide detailed insights into the choice of hyperparameters and the influence of the size of unlearning data. Our implementation is available at \url{https://github.com/karuna-bhaila/llm_unlearning}.


title: Long-range magnetic order induced surface state in GdBi and DyBi

abstract: The recent discovery of unconventional surface-state pairs, which give rise to Fermi arcs and spin textures, in antiferromagnetically ordered rare-earth monopnictides attracted the interest in these materials. We use angle-resolved photoemission spectroscopy (ARPES) measurements in conjunction with density functional theory (DFT) calculations to investigate the evolution of the electronic structure of GdBi and DyBi. We find that new surface states, including a Dirac cone, emerge in the AFM state. However, they are located along a direction in momentum space that is different than what was found in NdSb, NdBi, and CeBi. The observed changes in the electronic structure are consistent with the presence of AFM-II-A type order.


title: Critical wetting in the (2+1)D Solid-On-Solid model

abstract: In this note, we study the low temperature $(2+1)$D SOS interface above a hard floor with critical pinning potential $\lambda_w= \log (\frac{1}{1-e^{-4\beta}})$. At $\lambda<\lambda_w$ entropic repulsion causes the surface to delocalize and be rigid at height $\frac1{4\beta}\log n+O(1)$; at $\lambda>\lambda_w$ it is localized at some $O(1)$ height. We show that at $\lambda=\lambda_w$, there is delocalization, with rigidity now at height $\lfloor \frac1{6\beta}\log n+\frac13\rfloor$, confirming a conjecture of Lacoin.


title: Outer Space Cyberattacks: Generating Novel Scenarios to Avoid Surprise

abstract: Though general awareness around it may be low, space cyberattacks are an increasingly urgent problem given the vital role that space systems play in the modern world. Open-source or public discussions about it typically revolve around only a couple generic scenarios, namely satellite hacking and signals jamming or spoofing. But there are so many more possibilities. The report offers a scenario-prompt generator -- a taxonomy of sorts, called the ICARUS matrix -- that can create more than 4 million unique scenario-prompts. We will offer a starting set of 42 scenarios, briefly describing each one, to begin priming the imagination-pump so that many more researchers can bring their diverse expertise and perspectives to bear on the problem. A failure to imagine novel scenarios is a major risk in being taken by surprise and severely harmed by threat actors who are constantly devising new ways, inventive and resourceful ways, to breach the digital systems that control our wired world. To stay vigilant, defenders likewise need to be imaginative to keep up in this adversarial dance between hunter and prey in cybersecurity. More than offering novel scenarios, we will also explore the drivers of the space cybersecurity problem, which include at least seven factors we have identified. For instance, the shared threat of space debris would seem to push rational states and actors to avoid kinetic conflicts in orbit, which weighs in favor of cyberoperations as the dominant form of space conflicts. Outer space is the next frontier for cybersecurity. To guard against space cyberattacks, we need to understand and anticipate them, and imagination is at the very heart of both cybersecurity and frontiers.


title: Not All Prompts Are Made Equal: Prompt-based Pruning of Text-to-Image Diffusion Models

abstract: Text-to-image (T2I) diffusion models have demonstrated impressive image generation capabilities. Still, their computational intensity prohibits resource-constrained organizations from deploying T2I models after fine-tuning them on their internal target data. While pruning techniques offer a potential solution to reduce the computational burden of T2I models, static pruning methods use the same pruned model for all input prompts, overlooking the varying capacity requirements of different prompts. Dynamic pruning addresses this issue by utilizing a separate sub-network for each prompt, but it prevents batch parallelism on GPUs. To overcome these limitations, we introduce Adaptive Prompt-Tailored Pruning (APTP), a novel prompt-based pruning method designed for T2I diffusion models. Central to our approach is a prompt router model, which learns to determine the required capacity for an input text prompt and routes it to an architecture code, given a total desired compute budget for prompts. Each architecture code represents a specialized model tailored to the prompts assigned to it, and the number of codes is a hyperparameter. We train the prompt router and architecture codes using contrastive learning, ensuring that similar prompts are mapped to nearby codes. Further, we employ optimal transport to prevent the codes from collapsing into a single one. We demonstrate APTP's effectiveness by pruning Stable Diffusion (SD) V2.1 using CC3M and COCO as target datasets. APTP outperforms the single-model pruning baselines in terms of FID, CLIP, and CMMD scores. Our analysis of the clusters learned by APTP reveals they are semantically meaningful. We also show that APTP can automatically discover previously empirically found challenging prompts for SD, e.g., prompts for generating text images, assigning them to higher capacity codes.


title: Grade Score: Quantifying LLM Performance in Option Selection

abstract: This study introduces the "Grade Score", a novel metric designed to evaluate the consistency and fairness of Large Language Models (LLMs) when used as multiple-choice judges with respect to order bias and choice consistency. The Grade Score combines Entropy, which measures order bias, and Mode Frequency, which assesses choice stability, offering insights into LLMs' reliability and impartiality. The study explores techniques such as prompt engineering and option sampling strategies to optimize the Grade Score, demonstrating their effectiveness in enhancing LLMs' performance. Results showcase varying performances among LLMs with respect to prompts and highlight the positive impact of including irrelevant options. The study also identifies an emergent behavior in instruction-following models, where they adapt to instructions targeting specific biases, demonstrating their adaptability. The Grade Score facilitates comparisons between LLMs and encourages ongoing research towards optimizing their decision-making processes, with potential implications for improving their reliability and fairness in various applications. All code is available on GitHub https://github.com/IoDmitri/GradeLab


title: ARTIST: Improving the Generation of Text-rich Images by Disentanglement

abstract: Diffusion models have demonstrated exceptional capabilities in generating a broad spectrum of visual content, yet their proficiency in rendering text is still limited: they often generate inaccurate characters or words that fail to blend well with the underlying image. To address these shortcomings, we introduce a new framework named ARTIST. This framework incorporates a dedicated textual diffusion model to specifically focus on the learning of text structures. Initially, we pretrain this textual model to capture the intricacies of text representation. Subsequently, we finetune a visual diffusion model, enabling it to assimilate textual structure information from the pretrained textual model. This disentangled architecture design and the training strategy significantly enhance the text rendering ability of the diffusion models for text-rich image generation. Additionally, we leverage the capabilities of pretrained large language models to better interpret user intentions, contributing to improved generation quality. Empirical results on the MARIO-Eval benchmark underscore the effectiveness of the proposed method, showing an improvement of up to 15\% in various metrics.


title: $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

abstract: Existing benchmarks do not test language agents on their interaction with human users or ability to follow domain-specific rules, both of which are vital for deploying them in real world applications. We propose $\tau$-bench, a benchmark emulating dynamic conversations between a user (simulated by language models) and a language agent provided with domain-specific API tools and policy guidelines. We employ an efficient and faithful evaluation process that compares the database state at the end of a conversation with the annotated goal state. We also propose a new metric (pass^k) to evaluate the reliability of agent behavior over multiple trials. Our experiments show that even state-of-the-art function calling agents (like gpt-4o) succeed on <50% of the tasks, and are quite inconsistent (pass^8 <25% in retail). Our findings point to the need for methods that can improve the ability of agents to act consistently and follow rules reliably.


title: A Construction of Optimal Quasi-cyclic Locally Recoverable Codes using Constituent Codes

abstract: A locally recoverable code of locality $r$ over $\mathbb{F}_{q}$ is a code where every coordinate of a codeword can be recovered using the values of at most $r$ other coordinates of that codeword. Locally recoverable codes are efficient at restoring corrupted messages and data which make them highly applicable to distributed storage systems. Quasi-cyclic codes of length $n=m\ell$ and index $\ell$ are linear codes that are invariant under cyclic shifts by $\ell$ places. %Quasi-cyclic codes are generalizations of cyclic codes and are isomorphic to $\mathbb{F}_{q} [x]/ \langle x^m-1 \rangle$-submodules of $\mathbb{F}_{q^\ell} [x] / \langle x^m-1 \rangle$. In this paper, we decompose quasi-cyclic locally recoverable codes into a sum of constituent codes where each constituent code is a linear code over a field extension of $\mathbb{F}_q$. Using these constituent codes with set parameters, we propose conditions which ensure the existence of almost optimal and optimal quasi-cyclic locally recoverable codes with increased dimension and code length.


title: Error Estimators for the Small-Biot Lumped Approximation for the Conduction Dunking Problem

abstract: We consider the dunking problem: a solid body at uniform temperature $T_{\text i}$ is placed in a environment characterized by farfield temperature $T_\infty$ and spatially uniform time-independent heat transfer coefficient. We permit heterogeneous material composition: spatially dependent density, specific heat, and thermal conductivity. Mathematically, the problem is described by a heat equation with Robin boundary conditions. The crucial parameter is the Biot number -- a nondimensional heat transfer (Robin) coefficient; we consider the limit of small Biot number. We introduce first-order and second-order asymptotic approximations (in Biot number) for several quantities of interest, notably the spatial domain average temperature as a function of time; the first-order approximation is simply the standard engineering `lumped' model. We then provide asymptotic error estimates for the first-order and second-order approximations for small Biot number, and also, for the first-order approximation, alternative strict bounds valid for all Biot number. Companion numerical solutions of the heat equation confirm the effectiveness of the error estimates for small Biot number. The second-order approximation and the first-order and second-order error estimates depend on several functional outputs associated to an elliptic partial differential equation; the latter is derived from Biot-sensitivity analysis of the heat equation eigenproblem in the limit of small Biot number. Most important is $\phi$, the only functional output required for the first-order error estimates; $\phi$ admits a simple physical interpretation in terms of conduction length scale. We investigate the domain and property dependence of $\phi$: most notably, we characterize spatial domains for which the standard lumped-model error criterion -- Biot number (based on volume-to-area length scale) small -- is deficient.


title: MEDeA: Multi-view Efficient Depth Adjustment

abstract: The majority of modern single-view depth estimation methods predict relative depth and thus cannot be directly applied in many real-world scenarios, despite impressive performance in the benchmarks. Moreover, single-view approaches cannot guarantee consistency across a sequence of frames. Consistency is typically addressed with test-time optimization of discrepancy across views; however, it takes hours to process a single scene. In this paper, we present MEDeA, an efficient multi-view test-time depth adjustment method, that is an order of magnitude faster than existing test-time approaches. Given RGB frames with camera parameters, MEDeA predicts initial depth maps, adjusts them by optimizing local scaling coefficients, and outputs temporally-consistent depth maps. Contrary to test-time methods requiring normals, optical flow, or semantics estimation, MEDeA produces high-quality predictions with a depth estimation network solely. Our method sets a new state-of-the-art on TUM RGB-D, 7Scenes, and ScanNet benchmarks and successfully handles smartphone-captured data from ARKitScenes dataset.


title: Combinatorial interpretations of cranks of overpartitions and partitions into distinct odd parts

abstract: We give combinatorial interpretations of two residual cranks of overpartitions defined by Bringmann, Lovejoy and Osburn in 2009 analogous to the crank of partitions given by Andrews and Garvan in 1988. As a consequence, we improve upon their definitions and find the true residual cranks of overpartitions. Furthermore, we investigate the combinatorial interpretation of an $M_2$-crank of partitions without repeated odd parts and explore connections of these statistics with their companion rank counterparts and the tenth order mock theta functions of Ramanujan.


title: Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning

abstract: Supervised fine-tuning enhances the problem-solving abilities of language models across various mathematical reasoning tasks. To maximize such benefits, existing research focuses on broadening the training set with various data augmentation techniques, which is effective for standard single-round question-answering settings. Our work introduces a novel technique aimed at cultivating a deeper understanding of the training problems at hand, enhancing performance not only in standard settings but also in more complex scenarios that require reflective thinking. Specifically, we propose reflective augmentation, a method that embeds problem reflection into each training instance. It trains the model to consider alternative perspectives and engage with abstractions and analogies, thereby fostering a thorough comprehension through reflective reasoning. Extensive experiments validate the achievement of our aim, underscoring the unique advantages of our method and its complementary nature relative to existing augmentation techniques.


title: Unregulated Divergences of Feynman Integrals

abstract: Feynman integrals can be expanded asymptotically with respect to some small parameters at the integrand level, a technique known as the expansion by regions. A naive expansion by regions may break down due to divergences not regulated by the spacetime dimension, exemplified by the rapidity divergences. A criterion to identify unregulated divergences is provided in this article. The analysis is conducted using both parametric and Mellin-Barnes representations, leading to a consistent conclusion. Based on this analysis, it is proven that {\it the presence of unregulated divergences implies the degeneracies of regions}, which may help to explain phenomena like the collinear anomaly.


title: UniGLM: Training One Unified Language Model for Text-Attributed Graphs

abstract: Representation learning on text-attributed graphs (TAGs), where nodes are represented by textual descriptions, is crucial for textual and relational knowledge systems and recommendation systems. Currently, state-of-the-art embedding methods for TAGs primarily focus on fine-tuning language models (e.g., BERT) using structure-aware training signals. While effective, these methods are tailored for individual TAG and cannot generalize across various graph scenarios. Given the shared textual space, leveraging multiple TAGs for joint fine-tuning, aligning text and graph structure from different aspects, would be more beneficial. Motivated by this, we introduce a novel Unified Graph Language Model (UniGLM) framework, the first graph embedding model that generalizes well to both in-domain and cross-domain TAGs. Specifically, UniGLM is trained over multiple TAGs with different domains and scales using self-supervised contrastive learning. UniGLM includes an adaptive positive sample selection technique for identifying structurally similar nodes and a lazy contrastive module that is devised to accelerate training by minimizing repetitive encoding calculations. Extensive empirical results across 9 benchmark TAGs demonstrate UniGLM's efficacy against leading embedding baselines in terms of generalization (various downstream tasks and backbones) and transfer learning (in and out of domain scenarios). The code is available at https://github.com/NYUSHCS/UniGLM.


title: InternalInspector $I^2$: Robust Confidence Estimation in LLMs through Internal States

abstract: Despite their vast capabilities, Large Language Models (LLMs) often struggle with generating reliable outputs, frequently producing high-confidence inaccuracies known as hallucinations. Addressing this challenge, our research introduces InternalInspector, a novel framework designed to enhance confidence estimation in LLMs by leveraging contrastive learning on internal states including attention states, feed-forward states, and activation states of all layers. Unlike existing methods that primarily focus on the final activation state, InternalInspector conducts a comprehensive analysis across all internal states of every layer to accurately identify both correct and incorrect prediction processes. By benchmarking InternalInspector against existing confidence estimation methods across various natural language understanding and generation tasks, including factual question answering, commonsense reasoning, and reading comprehension, InternalInspector achieves significantly higher accuracy in aligning the estimated confidence scores with the correctness of the LLM's predictions and lower calibration error. Furthermore, InternalInspector excels at HaluEval, a hallucination detection benchmark, outperforming other internal-based confidence estimation methods in this task.


title: FAWN: Floor-And-Walls Normal Regularization for Direct Neural TSDF Reconstruction

abstract: Leveraging 3D semantics for direct 3D reconstruction has a great potential yet unleashed. For instance, by assuming that walls are vertical, and a floor is planar and horizontal, we can correct distorted room shapes and eliminate local artifacts such as holes, pits, and hills. In this paper, we propose FAWN, a modification of truncated signed distance function (TSDF) reconstruction methods, which considers scene structure by detecting walls and floor in a scene, and penalizing the corresponding surface normals for deviating from the horizontal and vertical directions. Implemented as a 3D sparse convolutional module, FAWN can be incorporated into any trainable pipeline that predicts TSDF. Since FAWN requires 3D semantics only for training, no additional limitations on further use are imposed. We demonstrate, that FAWN-modified methods use semantics more effectively, than existing semantic-based approaches. Besides, we apply our modification to state-of-the-art TSDF reconstruction methods, and demonstrate a quality gain in SCANNET, ICL-NUIM, TUM RGB-D, and 7SCENES benchmarks.


title: A monolithic first--order BSSNOK formulation of the Einstein--Euler equations and its solution with path-conservative finite difference CWENO schemes

abstract: We present a new, monolithic first--order (both in time and space) BSSNOK formulation of the coupled Einstein--Euler equations. The entire system of hyperbolic PDEs is solved in a completely unified manner via one single numerical scheme applied to both the conservative sector of the matter part and to the first--order strictly non--conservative sector of the spacetime evolution. The coupling between matter and space-time is achieved via algebraic source terms. The numerical scheme used for the solution of the new monolithic first order formulation is a path-conservative central WENO (CWENO) finite difference scheme, with suitable insertions to account for the presence of the non--conservative terms. By solving several crucial tests of numerical general relativity, including a stable neutron star, Riemann problems in relativistic matter with shock waves and the stable long-time evolution of single and binary puncture black holes up and beyond the binary merger, we show that our new CWENO scheme, introduced two decades ago for the compressible Euler equations of gas dynamics, can be successfully applied also to numerical general relativity, solving all equations at the same time with one single numerical method. In the future the new monolithic approach proposed in this paper may become an attractive alternative to traditional methods that couple central finite difference schemes with Kreiss-Oliger dissipation for the space-time part with totally different TVD schemes for the matter evolution and which are currently the state of the art in the field.


title: Learning Molecular Representation in a Cell

abstract: Predicting drug efficacy and safety in vivo requires information on biological responses (e.g., cell morphology and gene expression) to small molecule perturbations. However, current molecular representation learning methods do not provide a comprehensive view of cell states under these perturbations and struggle to remove noise, hindering model generalization. We introduce the Information Alignment (InfoAlign) approach to learn molecular representations through the information bottleneck method in cells. We integrate molecules and cellular response data as nodes into a context graph, connecting them with weighted edges based on chemical, biological, and computational criteria. For each molecule in a training batch, InfoAlign optimizes the encoder's latent representation with a minimality objective to discard redundant structural information. A sufficiency objective decodes the representation to align with different feature spaces from the molecule's neighborhood in the context graph. We demonstrate that the proposed sufficiency objective for alignment is tighter than existing encoder-based contrastive methods. Empirically, we validate representations from InfoAlign in two downstream tasks: molecular property prediction against up to 19 baseline methods across four datasets, plus zero-shot molecule-morphology matching.


title: The XMM-Newton and NuSTAR view of IRASF11119+3257. I Detection of multiple UFO components and a very cold corona

abstract: IRASF11119 is an ultra-luminous IR galaxy with post-merger morphology, hosting a type-1 QSO at z=0.189. Its 2013 Suzaku spectrum shows a prominent Ultra Fast Outflow (UFO) absorption feature (v_out~0.25c). In 2021, we obtained the first XMM-Newton long look of the target, coordinated with a simultaneous NuSTAR observation. The new high-quality data allow us to detect at P>99.8% c.l. multiple absorption features associated with the known UFO. Furthermore, an emission plus absorption feature at 1.1-1.3 keV reveals the presence of a blueshifted P-Cygni profile in the soft band. We associate the hard band features with blends of FeXXV and FeXXVI He$\alpha$-Ly$\alpha$ and He$\beta$-Ly$\beta$ line pairs and infer a large column (N$_H$~$10^{24}$ cm$^{-2}$) of highly ionized (log$\xi$~5) gas outflowing at v_out=0.27c. The 1 keV feature can be associated with a blend of Fe and Ne transitions, produced by a lower column (N$_H$~$10^{21}$ cm$^{-2}$) and ionization (log$\xi$~2.6) gas component outflowing at the same speed. Using a radiative-transfer disk wind model to fit the highly ionized UFO, we derive a large mass outflow rate, comparable with the mass accretion rate (M$_{out}$=4.25 M$_{Sun}$/yr, ~1.6 M$_{acc}$), and kinetic energy and momentum flux among the highest reported in the literature. We measure an extremely low high-energy cut-off (E$_c$~25 keV). Several other cases in the literature suggest that a steep X-ray continuum may be related to the formation of powerful winds. The lack of a significant momentum boost between the nuclear UFO and the different phases of the large-scale outflow, observed in IRASF11119 and in a growing number of sources with powerful UFOs, can be explained by (i) a momentum-driven expansion, (ii) an inefficient coupling of the UFO with the host ISM, or (iii) by repeated energy-driven expansion episodes with low duty-cycle, that average out on long time-scales.


title: WellDunn: On the Robustness and Explainability of Language Models and Large Language Models in Identifying Wellness Dimensions

abstract: Language Models (LMs) are being proposed for mental health applications where the heightened risk of adverse outcomes means predictive performance may not be a sufficient litmus test of a model's utility in clinical practice. A model that can be trusted for practice should have a correspondence between explanation and clinical determination, yet no prior research has examined the attention fidelity of these models and their effect on ground truth explanations. We introduce an evaluation design that focuses on the robustness and explainability of LMs in identifying Wellness Dimensions (WD). We focus on two mental health and well-being datasets: (a) Multi-label Classification-based MultiWD, and (b) WellXplain for evaluating attention mechanism veracity against expert-labeled explanations. The labels are based on Halbert Dunn's theory of wellness, which gives grounding to our evaluation. We reveal four surprising results about LMs/LLMs: (1) Despite their human-like capabilities, GPT-3.5/4 lag behind RoBERTa, and MedAlpaca, a fine-tuned LLM fails to deliver any remarkable improvements in performance or explanations. (2) Re-examining LMs' predictions based on a confidence-oriented loss function reveals a significant performance drop. (3) Across all LMs/LLMs, the alignment between attention and explanations remains low, with LLMs scoring a dismal 0.0. (4) Most mental health-specific LMs/LLMs overlook domain-specific knowledge and undervalue explanations, causing these discrepancies. This study highlights the need for further research into their consistency and explanations in mental health and well-being.


title: A Scalable and Effective Alternative to Graph Transformers

abstract: Graph Neural Networks (GNNs) have shown impressive performance in graph representation learning, but they face challenges in capturing long-range dependencies due to their limited expressive power. To address this, Graph Transformers (GTs) were introduced, utilizing self-attention mechanism to effectively model pairwise node relationships. Despite their advantages, GTs suffer from quadratic complexity w.r.t. the number of nodes in the graph, hindering their applicability to large graphs. In this work, we present Graph-Enhanced Contextual Operator (GECO), a scalable and effective alternative to GTs that leverages neighborhood propagation and global convolutions to effectively capture local and global dependencies in quasilinear time. Our study on synthetic datasets reveals that GECO reaches 169x speedup on a graph with 2M nodes w.r.t. optimized attention. Further evaluations on diverse range of benchmarks showcase that GECO scales to large graphs where traditional GTs often face memory and time limitations. Notably, GECO consistently achieves comparable or superior quality compared to baselines, improving the SOTA up to 4.5%, and offering a scalable and effective solution for large-scale graph learning.


title: Not Eliminate but Aggregate: Post-Hoc Control over Mixture-of-Experts to Address Shortcut Shifts in Natural Language Understanding

abstract: Recent models for natural language understanding are inclined to exploit simple patterns in datasets, commonly known as shortcuts. These shortcuts hinge on spurious correlations between labels and latent features existing in the training data. At inference time, shortcut-dependent models are likely to generate erroneous predictions under distribution shifts, particularly when some latent features are no longer correlated with the labels. To avoid this, previous studies have trained models to eliminate the reliance on shortcuts. In this study, we explore a different direction: pessimistically aggregating the predictions of a mixture-of-experts, assuming each expert captures relatively different latent features. The experimental results demonstrate that our post-hoc control over the experts significantly enhances the model's robustness to the distribution shift in shortcuts. Besides, we show that our approach has some practical advantages. We also analyze our model and provide results to support the assumption.


title: Pluriharmonic solutions to Yang-Mills equations: a $C^*$-algebras approach

abstract: This partially expository paper provides a view of Yang-Mills equations from the perspective of complex variables, operator theory, and $C^{*}$-algebras. Through operator-valued pluriharmonic and skew-Hermitian differential forms, it constructs a new class of instanton solutions. Furthermore, it provides a complex variable version of the Yang-Mills Lagrangian and the Belavin-Polyakov-Schwartz-Tyupkin instanton.


title: Entropic Regression DMD (ERDMD) Discovers Informative Sparse and Nonuniformly Time Delayed Models

abstract: In this work, we present a method which determines optimal multi-step dynamic mode decomposition (DMD) models via entropic regression, which is a nonlinear information flow detection algorithm. Motivated by the higher-order DMD (HODMD) method of \cite{clainche}, and the entropic regression (ER) technique for network detection and model construction found in \cite{bollt, bollt2}, we develop a method that we call ERDMD that produces high fidelity time-delay DMD models that allow for nonuniform time space, and the time spacing is discovered by consider most informativity based on ER. These models are shown to be highly efficient and robust. We test our method over several data sets generated by chaotic attractors and show that we are able to build excellent reconstructions using relatively minimal models. We likewise are able to better identify multiscale features via our models which enhances the utility of dynamic mode decomposition.


title: Threshold numbers of multipartite graphs with small parts

abstract: Jamison and Sprague defined multithreshold graphs as a generalization of the well-studied threshold graphs. A graph $G=(V,E)$ is called a \textit{$k$-threshold graph} with \textit{thresholds} $\theta_1<\theta_2<...<\theta_k$ if we can assign a real number $r(v)$ to each vertex $v\in V$ such that for any two vertices $u,v\in V$, we have $uv\in E$ if and only if $r(u)+r(v)$ is greater than or equal to an odd number of $\theta_1,\theta_2,...,\theta_k$. The smallest integer $k$ such that $G$ is a $k$-threshold graph is called the \textit{threshold number} of $G$. For the complete multipartite graphs and the cluster graphs, Chen and Hao determined the exact threshold numbers of those graphs with each part/cluster not being small; Puleo proved a lower bound on the threshold numbers of $nK_3$; Kittipassorn and Sumalroj further determined the exact threshold numbers of $K_{n\times 3}$, $nK_3$, $K_{n\times 4}$, and $nK_4$. On the basis of Kittipassorn and Sumalroj's results, we determine the exact threshold numbers of $K_{n_1\times 1, n_2\times 2, n_3\times 3}$ and $n_1 K_1\cup n_2 K_2\cup n_3 K_3$, which solve a problem proposed by Sumalroj.


title: skandiver: a divergence-based analysis tool for identifying intercellular mobile genetic elements

abstract: Mobile genetic elements (MGEs) are as ubiquitous in nature as they are varied in type, ranging from viral insertions to transposons to incorporated plasmids. Horizontal transfer of MGEs across bacterial species may also pose a significant threat to global health due to their capability to harbour antibiotic resistance genes. However, despite cheap and rapid whole genome sequencing, the varied nature of MGEs makes it difficult to fully characterize them, and existing methods for detecting MGEs often don't agree on what should count. In this manuscript, we first define and argue in favor of a divergence-based characterization of mobile-genetic elements. Using that paradigm, we present skandiver, a tool designed to efficiently detect MGEs from whole genome assemblies without the need for gene annotation or markers. skandiver determines mobile elements via genome fragmentation, average nucleotide identity (ANI), and divergence time. By building on the scalable skani software for ANI computation, skandiver can query hundreds of complete assemblies against $>$65,000 representative genomes in a few minutes and 19 GB memory, providing scalable and efficient method for elucidating mobile element profiles in incomplete, uncharacterized genomic sequences. For isolated and integrated large plasmids (>10kbp), skandiver's recall was 48\% and 47\%, MobileElementFinder was 59\% and 17\%, and geNomad was 86\% and 32\%, respectively. For isolated large plasmids, skandiver's recall (48\%) is lower than state-of-the-art reference-based methods geNomad (86\%) and MobileElementFinder (59\%). However, skandiver achieves higher recall on integrated plasmids and, unlike other methods, without comparing against a curated database, making skandiver suitable for discovery of novel MGEs. Availability: https://github.com/YoukaiFromAccounting/skandiver


title: STNAGNN: Spatiotemporal Node Attention Graph Neural Network for Task-based fMRI Analysis

abstract: Task-based fMRI uses actions or stimuli to trigger task-specific brain responses and measures them using BOLD contrast. Despite the significant task-induced spatiotemporal brain activation fluctuations, most studies on task-based fMRI ignore the task context information aligned with fMRI and consider task-based fMRI a coherent sequence. In this paper, we show that using the task structures as data-driven guidance is effective for spatiotemporal analysis. We propose STNAGNN, a GNN-based spatiotemporal architecture, and validate its performance in an autism classification task. The trained model is also interpreted for identifying autism-related spatiotemporal brain biomarkers.


title: Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarks

abstract: Medical knowledge is context-dependent and requires consistent reasoning across various natural language expressions of semantically equivalent phrases. This is particularly crucial for drug names, where patients often use brand names like Advil or Tylenol instead of their generic equivalents. To study this, we create a new robustness dataset, RABBITS, to evaluate performance differences on medical benchmarks after swapping brand and generic drug names using physician expert annotations. We assess both open-source and API-based LLMs on MedQA and MedMCQA, revealing a consistent performance drop ranging from 1-10\%. Furthermore, we identify a potential source of this fragility as the contamination of test data in widely used pre-training datasets. All code is accessible at https://github.com/BittermanLab/RABBITS, and a HuggingFace leaderboard is available at https://huggingface.co/spaces/AIM-Harvard/rabbits-leaderboard.


title: Optimal withdrawals in a general diffusion model with control rates subject to a state-dependent upper bound

abstract: We consider a classical stochastic control problem in which a diffusion process is controlled by a withdrawal process up to a termination time. The objective is to maximize the expected discounted value of the withdrawals until the first-passage time below level zero. In this work, we are considering absolutely continuous control strategies in a general diffusion model. Our main contribution is a solution to the control problem under study, which is achieved by using a probabilistic guess-and-verify approach. We prove that the optimal strategy belongs to the family of bang-bang strategies, i.e. strategies in which, above an optimal barrier level, we withdraw at the highest-allowed rate, while no withdrawals are made below this barrier. Some nontrivial examples are studied numerically.


title: Hierarchy construction for non-abelian fractional quantum Hall states via anyon condensation

abstract: For a given parent fractional quantum Hall (FQH) state at filling fraction $\nu$, the hierarchy construction produces FQH states at nearby filling fractions $\{\nu_n\}$ by condensing minimally charged quasiholes or quasiparticles of the parent state into their own FQH states. The hierarchy construction has been useful for relating families of FQH states and for the experimental identification of the topological order of parent states via the presence of daughter states. We reinterpret the hierarchy construction as a two-step procedure: stacking with a second FQH state and condensing a condensable algebra of bosons. This two-step procedure can be applied to both abelian and non-abelian FQH states, and it does not require calculations with a wavefunction. We show this construction reproduces the hierarchies for the Laughlin and Pfaffian states, and can be applied further to propose hierarchies for various non-abelian FQH states.


title: Satyrn: A Platform for Analytics Augmented Generation

abstract: Large language models (LLMs) are capable of producing documents, and retrieval augmented generation (RAG) has shown itself to be a powerful method for improving accuracy without sacrificing fluency. However, not all information can be retrieved from text. We propose an approach that uses the analysis of structured data to generate fact sets that are used to guide generation in much the same way that retrieved documents are used in RAG. This analytics augmented generation (AAG) approach supports the ability to utilize standard analytic techniques to generate facts that are then converted to text and passed to an LLM. We present a neurosymbolic platform, Satyrn that leverages AAG to produce accurate, fluent, and coherent reports grounded in large scale databases. In our experiments, we find that Satyrn generates reports in which over 86% accurate claims while maintaining high levels of fluency and coherence, even when using smaller language models such as Mistral-7B, as compared to GPT-4 Code Interpreter in which just 57% of claims are accurate.


title: Precisely Measuring the Cosmic Reionization History from IGM Damping Wings Towards Quasars

abstract: We introduce a new approach for analyzing the IGM damping wings imprinted on the proximity zones of quasars in the epoch of reionization (EoR). Whereas past work has typically forgone the additional constraining power afforded by the blue side continuum ($1216\,\r{A} \lesssim \lambda \lesssim 1280\,\r{A}$) and/or opted not to model the large correlated IGM transmission fluctuations in the proximity zone ($\lambda \lesssim 1216\,\r{A}$), we construct a generative probabilistic model for the entire spectrum accounting for all sources of error - the stochasticity induced by patchy reionization, the impact of the quasar's ionizing radiation on the IGM, the unknown intrinsic spectrum of the quasar, and spectral noise. This principled Bayesian method allows us to marginalize out nuisance parameters associated with the quasar's radiation and its unknown intrinsic spectrum to precisely measure the IGM neutral fraction, $\langle x_{\rm HI}\rangle$. A key element of our analysis is the use of dimensionality reduction (DR) to describe the intrinsic quasar spectrum via a small number of nuisance parameters. Using a large sample of $15,559$ SDSS/BOSS quasars at $z \gtrsim 2.15$ we trained and quantified the performance of six distinct DR methods, and find that a six parameter PCA model (five coefficients plus a normalization) performs best, with complex machine learning approaches providing no advantage. By conducting statistical inference on 100 realistic mock EoR quasar spectra, we demonstrate the reliability of the credibility contours that we obtain on $\langle x_{\rm HI}\rangle$ and the quasar lifetime, $t_{\rm Q}$. The new method introduced here will transform IGM damping wings into a precision probe of reionization, on the same solid methodological and statistical footing as other precision cosmological measurements.


title: Quantifying the Precision of IGM Damping Wing Measurements Towards Quasars

abstract: We investigate the precision with which the Lyman-$\alpha$ damping wing signature imprinted on the spectra of high-redshift quasars (QSOs) by the foreground neutral intergalactic medium (IGM) can measure the history of cosmic reionization. We leverage a novel inference pipeline based on a generative probabilistic model for the entire spectrum (both red- and blueward of the Lyman-$\alpha$ line), accounting for all relevant sources of uncertainty - the stochasticity caused by patchy reionization, the impact of the quasar's ionizing radiation on the IGM, it's unknown intrinsic spectrum, and spectral noise. Performing fast JAX-based Hamiltonian Monte-Carlo (HMC) parameter inference, we precisely measure the underlying global IGM neutral fraction as well as the lifetime of the quasar. Running a battery of tests on over a thousand mocks, we find optimal precision when running the pipeline with a six parameter PCA continuum model (five coefficients and a normalization) on $\mathrm{S}/\mathrm{N} \sim 10$ spectra, binned to a $\sim 500\,\mathrm{km}/\mathrm{s}$ velocity pixel scale, and extending at least out to the C IV $\lambda\,1549\,\text{\r{A}}$ emission line. After marginalizing out nuisance parameters associated with the quasar continuum, a single spectrum constrains the IGM neutral fraction to $28.0_{-8.8}^{+8.2}\,\%$ and the quasar lifetime to $0.80_{-0.55}^{+0.22}\,\mathrm{dex}$, improving notably towards spectra with a stronger IGM damping wing imprint. Higher precision can be achieved by averaging over statistical quasar samples. We identify two primary sources of uncertainty that contribute approximately equally to the total error budget: the uncertain quasar continuum model and the stochastic distribution of neutral regions arising from both the reionization topology and the location of the quasar's ionization front.


title: DTGB: A Comprehensive Benchmark for Dynamic Text-Attributed Graphs

abstract: Dynamic text-attributed graphs (DyTAGs) are prevalent in various real-world scenarios, where each node and edge are associated with text descriptions, and both the graph structure and text descriptions evolve over time. Despite their broad applicability, there is a notable scarcity of benchmark datasets tailored to DyTAGs, which hinders the potential advancement in many research fields. To address this gap, we introduce Dynamic Text-attributed Graph Benchmark (DTGB), a collection of large-scale, time-evolving graphs from diverse domains, with nodes and edges enriched by dynamically changing text attributes and categories. To facilitate the use of DTGB, we design standardized evaluation procedures based on four real-world use cases: future link prediction, destination node retrieval, edge classification, and textual relation generation. These tasks require models to understand both dynamic graph structures and natural language, highlighting the unique challenges posed by DyTAGs. Moreover, we conduct extensive benchmark experiments on DTGB, evaluating 7 popular dynamic graph learning algorithms and their variants of adapting to text attributes with LLM embeddings, along with 6 powerful large language models (LLMs). Our results show the limitations of existing models in handling DyTAGs. Our analysis also demonstrates the utility of DTGB in investigating the incorporation of structural and textual dynamics. The proposed DTGB fosters research on DyTAGs and their broad applications. It offers a comprehensive benchmark for evaluating and advancing models to handle the interplay between dynamic graph structures and natural language. The dataset and source code are available at https://github.com/zjs123/DTGB.


title: Dijet spectrum in nonlocal and asymptotically nonlocal theories

abstract: Asymptotically nonlocal field theories approximate ghost-free nonlocal theories at low energies, yet are theories of finite order in the number of derivatives. These theories have an emergent nonlocal scale that regulates loop diagrams and can provide a solution to the hierarchy problem. Asymptotic nonlocality has been studied previously in scalar theories, Abelian and non-Abelian gauge theories with complex scalars, and linearized gravity. Here we extend that work by considering an asymptotically nonlocal generalization of QCD, which can be used for realistic phenomenological investigations. In particular, we derive Feynman rules relevant for the study of the production of dijets at hadron colliders and compute the parton-level cross sections at leading order. We use these to determine a bound on the scale of new physics from Large Hadron Collider data, both for a typical choice of model parameters, and in the nonlocal limit.


title: COMMUNITY-CROSS-INSTRUCT: Unsupervised Instruction Generation for Aligning Large Language Models to Online Communities

abstract: Social scientists use surveys to probe the opinions and beliefs of populations, but these methods are slow, costly, and prone to biases. Recent advances in large language models (LLMs) enable creating computational representations or "digital twins" of populations that generate human-like responses mimicking the population's language, styles, and attitudes. We introduce Community-Cross-Instruct, an unsupervised framework for aligning LLMs to online communities to elicit their beliefs. Given a corpus of a community's online discussions, Community-Cross-Instruct automatically generates instruction-output pairs by an advanced LLM to (1) finetune an foundational LLM to faithfully represent that community, and (2) evaluate the alignment of the finetuned model to the community. We demonstrate the method's utility in accurately representing political and fitness communities on Reddit. Unlike prior methods requiring human-authored instructions, Community-Cross-Instruct generates instructions in a fully unsupervised manner, enhancing scalability and generalization across domains. This work enables cost-effective and automated surveying of diverse online communities.


title: Gauging C on the Lattice

abstract: We discuss general aspects of charge conjugation symmetry in Euclidean lattice field theories, including its dynamical gauging. Our main focus is $O(2) = U(1)\rtimes \mathbb{Z}_2 $ gauge theory, which we construct using a non-abelian generalization of the Villain formulation via gauging the charge conjugation symmetry of pure $U(1)$ gauge theory. We describe how to construct gauge-invariant non-local operators in a theory with gauged charge conjugation symmetry, and use it to define Wilson and 't Hooft lines as well as non-invertible symmetry operators. Our lattice discretization preserves the higher-group and non-invertible symmetries of $O(2)$ gauge theory, which we explore in detail. In particular, these symmetries give rise to selection rules for extended operators and their junctions, and constrain the properties of the worldvolume degrees of freedom on twist vortices (also known as Alice or Cheshire strings). We propose a phase diagram of the theory coupled to dynamical magnetic monopoles and twist vortices, where the various generalized symmetries are typically only emergent.


title: A study of the Berezinskii-Kosterlitz-Thouless transition in the XY model in a honeycomb lattice

abstract: In this study, we examined the Berezinskii-Kosterlitz-Thouless (BKT) phase transition in the two-dimensional XY model on a honeycomb lattice. The XY model consists of normalized vectors arranged in a plane and is used to represent two-dimensional magnetic systems. It has applications in areas such as spintronics, superconductivity, and topological quantum computing. To calculate the thermodynamic properties of the system, we used numerical Monte Carlo simulations with the Metropolis algorithm and the Simulated Annealing protocol. The transition temperature was calculated using the second and fourth-order helicity modulus as the order parameter. We also calculated the vortex density and the formation energy of vortex-antivortex pairs. Our findings suggest that the critical temperature is $T_{BKT} = 0.576 \pm 0.001$, and the vortex formation energy is $2\mu=4.0 \pm 0.5$. When compared to the square lattice, both results support the notion of the honeycomb lattice's instability.


title: Inversion for Inferring Solar Meridional Circulation: The Case with Constraints on Angular Momentum Transport inside the Sun

abstract: We have carried out inversions of travel times as measured by Gizon et al. (2020) to infer the internal profile of the solar meridional circulation (MC). A linear inverse problem has been solved by the regularized least-squares method with a constraint that the angular momentum (AM) transport by MC should be equatorward (HK21-type constraint). Our motivation for using this constraint is based on the result by Hotta and Kusano (2021) where the solar equator-fast rotation was reproduced successfully without any manipulation. The inversion result indicates that the MC profile is a double-cell structure if the so-called HK21 regime, in which AM transported by MC sustains the equator-fast rotation, correctly describes the physics inside the solar convective zone. The sum of the squared residuals computed with the inferred double-cell MC profile is comparable to that computed with the single-cell MC profile obtained when we exclude the HK21-type constraint, showing that both profiles can explain the data more or less at the same level. However, we also find that adding the HK21-type constraint degrades the resolution of the averaging kernels. Although it is difficult for us to determine the large-scale morphology of the solar MC at the moment, our attempt highlights the relevance of investigating the solar MC profile from both theoretical and observational perspectives.


title: Conformance Checking of Fuzzy Logs against Declarative Temporal Specifications

abstract: Traditional conformance checking tasks assume that event data provide a faithful and complete representation of the actual process executions. This assumption has been recently questioned: more and more often events are not traced explicitly, but are instead indirectly obtained as the result of event recognition pipelines, and thus inherently come with uncertainty. In this work, differently from the typical probabilistic interpretation of uncertainty, we consider the relevant case where uncertainty refers to which activity is actually conducted, under a fuzzy semantics. In this novel setting, we consider the problem of checking whether fuzzy event data conform with declarative temporal rules specified as Declare patterns or, more generally, as formulae of linear temporal logic over finite traces (LTLf). This requires to relax the assumption that at each instant only one activity is executed, and to correspondingly redefine boolean operators of the logic with a fuzzy semantics. Specifically, we provide a threefold contribution. First, we define a fuzzy counterpart of LTLf tailored to our purpose. Second, we cast conformance checking over fuzzy logs as a verification problem in this logic. Third, we provide a proof-of-concept, efficient implementation based on the PyTorch Python library, suited to check conformance of multiple fuzzy traces at once.


title: Multi-Dimensional Pruning: Joint Channel, Layer and Block Pruning with Latency Constraint

abstract: As we push the boundaries of performance in various vision tasks, the models grow in size correspondingly. To keep up with this growth, we need very aggressive pruning techniques for efficient inference and deployment on edge devices. Existing pruning approaches are limited to channel pruning and struggle with aggressive parameter reductions. In this paper, we propose a novel multi-dimensional pruning framework that jointly optimizes pruning across channels, layers, and blocks while adhering to latency constraints. We develop a latency modeling technique that accurately captures model-wide latency variations during pruning, which is crucial for achieving an optimal latency-accuracy trade-offs at high pruning ratio. We reformulate pruning as a Mixed-Integer Nonlinear Program (MINLP) to efficiently determine the optimal pruned structure with only a single pass. Our extensive results demonstrate substantial improvements over previous methods, particularly at large pruning ratios. In classification, our method significantly outperforms prior art HALP with a Top-1 accuracy of 70.0(v.s. 68.6) and an FPS of 5262 im/s(v.s. 4101 im/s). In 3D object detection, we establish a new state-of-the-art by pruning StreamPETR at a 45% pruning ratio, achieving higher FPS (37.3 vs. 31.7) and mAP (0.451 vs. 0.449) than the dense baseline.


title: A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets

abstract: Novel view synthesis has seen major advances in recent years, with 3D Gaussian splatting offering an excellent level of visual quality, fast training and real-time rendering. However, the resources needed for training and rendering inevitably limit the size of the captured scenes that can be represented with good visual quality. We introduce a hierarchy of 3D Gaussians that preserves visual quality for very large scenes, while offering an efficient Level-of-Detail (LOD) solution for efficient rendering of distant content with effective level selection and smooth transitions between levels.We introduce a divide-and-conquer approach that allows us to train very large scenes in independent chunks. We consolidate the chunks into a hierarchy that can be optimized to further improve visual quality of Gaussians merged into intermediate nodes. Very large captures typically have sparse coverage of the scene, presenting many challenges to the original 3D Gaussian splatting training method; we adapt and regularize training to account for these issues. We present a complete solution, that enables real-time rendering of very large scenes and can adapt to available resources thanks to our LOD method. We show results for captured scenes with up to tens of thousands of images with a simple and affordable rig, covering trajectories of up to several kilometers and lasting up to one hour. Project Page: https://repo-sam.inria.fr/fungraph/hierarchical-3d-gaussians/


title: Deep HM-SORT: Enhancing Multi-Object Tracking in Sports with Deep Features, Harmonic Mean, and Expansion IOU

abstract: This paper introduces Deep HM-SORT, a novel online multi-object tracking algorithm specifically designed to enhance the tracking of athletes in sports scenarios. Traditional multi-object tracking methods often struggle with sports environments due to the similar appearances of players, irregular and unpredictable movements, and significant camera motion. Deep HM-SORT addresses these challenges by integrating deep features, harmonic mean, and Expansion IOU. By leveraging the harmonic mean, our method effectively balances appearance and motion cues, significantly reducing ID-swaps. Additionally, our approach retains all tracklets indefinitely, improving the re-identification of players who leave and re-enter the frame. Experimental results demonstrate that Deep HM-SORT achieves state-of-the-art performance on two large-scale public benchmarks, SportsMOT and SoccerNet Tracking Challenge 2023. Specifically, our method achieves 80.1 HOTA on the SportsMOT dataset and 85.4 HOTA on the SoccerNet-Tracking dataset, outperforming existing trackers in key metrics such as HOTA, IDF1, AssA, and MOTA. This robust solution provides enhanced accuracy and reliability for automated sports analytics, offering significant improvements over previous methods without introducing additional computational cost.


title: Uncertainty modeling for fine-tuned implicit functions

abstract: Implicit functions such as Neural Radiance Fields (NeRFs), occupancy networks, and signed distance functions (SDFs) have become pivotal in computer vision for reconstructing detailed object shapes from sparse views. Achieving optimal performance with these models can be challenging due to the extreme sparsity of inputs and distribution shifts induced by data corruptions. To this end, large, noise-free synthetic datasets can serve as shape priors to help models fill in gaps, but the resulting reconstructions must be approached with caution. Uncertainty estimation is crucial for assessing the quality of these reconstructions, particularly in identifying areas where the model is uncertain about the parts it has inferred from the prior. In this paper, we introduce Dropsembles, a novel method for uncertainty estimation in tuned implicit functions. We demonstrate the efficacy of our approach through a series of experiments, starting with toy examples and progressing to a real-world scenario. Specifically, we train a Convolutional Occupancy Network on synthetic anatomical data and test it on low-resolution MRI segmentations of the lumbar spine. Our results show that Dropsembles achieve the accuracy and calibration levels of deep ensembles but with significantly less computational cost.


title: Equivalence Classes of Quantum Error-Correcting Codes

abstract: Quantum error-correcting codes (QECC's) are needed to combat the inherent noise affecting quantum processes. Using ZX calculus, we represent QECC's in a form called a ZX diagram, consisting of a tensor network. In this paper, we present canonical forms for CSS codes and CSS states (which are CSS codes with 0 inputs), and we show the resulting canonical forms for the toric code and certain surface codes. Next, we introduce the notion of prime code diagrams, ZX diagrams of codes that have a single connected component with the property that no sequence of rewrite rules can split such a diagram into two connected components. We also show the Fundamental Theorem of Clifford Codes, proving the existence and uniqueness of the prime decomposition of Clifford codes. Next, we tabulate equivalence classes of ZX diagrams under a different definition of equivalence that allows output permutations and any local operations on the outputs. Possible representatives of these equivalence classes are analyzed. This work expands on previous works in exploring the canonical forms of QECC's in their ZX diagram representations.


title: When Reasoning Meets Information Aggregation: A Case Study with Sports Narratives

abstract: Reasoning is most powerful when an LLM accurately aggregates relevant information. We examine the critical role of information aggregation in reasoning by requiring the LLM to analyze sports narratives. To succeed at this task, an LLM must infer points from actions, identify related entities, attribute points accurately to players and teams, and compile key statistics to draw conclusions. We conduct comprehensive experiments with real NBA basketball data and present SportsGen, a new method to synthesize game narratives. By synthesizing data, we can rigorously evaluate LLMs' reasoning capabilities under complex scenarios with varying narrative lengths and density of information. Our findings show that most models, including GPT-4o, often fail to accurately aggregate basketball scores due to frequent scoring patterns. Open-source models like Llama-3 further suffer from significant score hallucinations. Finally, the effectiveness of reasoning is influenced by narrative complexity, information density, and domain-specific terms, highlighting the challenges in analytical reasoning tasks.


title: $L^p$ asymptotic stability of 1D damped wave equation with nonlinear distributed damping

abstract: In this paper, we study the one-dimensional wave equation with localized nonlinear damping and Dirichlet boundary conditions, in the $L^p$ framework, with $p\in [1,\infty)$. We start by addressing the well-posedness problem. We prove the existence and the uniqueness of weak and strong solutions for $p\in [1,\infty)$, under suitable assumptions on the damping function. Then we study the asymptotic behaviour of the associated energy when $p \in (1,\infty)$, and we provide decay estimates that appear to be almost optimal as compared to a similar problem with boundary damping. Our study is motivated by earlier works, in particular, \cite{Haraux2009, Chitour-Marx-Prieur-2020}. Our proofs combine arguments from \cite{KMJC2022} (wave equation in the $L^p$ framework with a linear damping) with a technique of weighted energy estimates (\cite{PM-COCV}) and new integral inequalities when $p>2$, and with convex analysis tools when $p\in (1,2)$.


title: A shortcut to an optimal quantum linear system solver

abstract: Given a linear system of equations $A\boldsymbol{x}=\boldsymbol{b}$, quantum linear system solvers (QLSSs) approximately prepare a quantum state $|\boldsymbol{x}\rangle$ for which the amplitudes are proportional to the solution vector $\boldsymbol{x}$. Asymptotically optimal QLSSs have query complexity $O(\kappa \log(1/\varepsilon))$, where $\kappa$ is the condition number of $A$, and $\varepsilon$ is the approximation error. However, runtime guarantees for existing optimal and near-optimal QLSSs do not have favorable constant prefactors, in part because they rely on complex or difficult-to-analyze techniques like variable-time amplitude amplification and adiabatic path-following. Here, we give a conceptually simple QLSS that does not use these techniques. If the solution norm $\lVert\boldsymbol{x}\rVert$ is known exactly, our QLSS requires only a single application of kernel reflection (a straightforward extension of the eigenstate filtering (EF) technique of previous work) and the query complexity of the QLSS is $(1+O(\varepsilon))\kappa \ln(2\sqrt{2}/\varepsilon)$. If the norm is unknown, our method allows it to be estimated up to a constant factor using $O(\log\log(\kappa))$ applications of kernel projection (a direct generalization of EF) yielding a straightforward QLSS with near-optimal $O(\kappa \log\log(\kappa)\log\log\log(\kappa)+\kappa\log(1/\varepsilon))$ total complexity. Alternatively, by reintroducing a concept from the adiabatic path-following technique, we show that $O(\kappa)$ complexity can be achieved for norm estimation, yielding an optimal QLSS with $O(\kappa\log(1/\varepsilon))$ complexity while still avoiding the need to invoke the adiabatic theorem. Finally, we compute an explicit upper bound of $56\kappa+1.05\kappa \ln(1/\varepsilon)+o(\kappa)$ for the complexity of our optimal QLSS.


title: Mutual Learning for Finetuning Click-Through Rate Prediction Models

abstract: Click-Through Rate (CTR) prediction has become an essential task in digital industries, such as digital advertising or online shopping. Many deep learning-based methods have been implemented and have become state-of-the-art models in the domain. To further improve the performance of CTR models, Knowledge Distillation based approaches have been widely used. However, most of the current CTR prediction models do not have much complex architectures, so it's hard to call one of them 'cumbersome' and the other one 'tiny'. On the other hand, the performance gap is also not very large between complex and simple models. So, distilling knowledge from one model to the other could not be worth the effort. Under these considerations, Mutual Learning could be a better approach, since all the models could be improved mutually. In this paper, we showed how useful the mutual learning algorithm could be when it is between equals. In our experiments on the Criteo and Avazu datasets, the mutual learning algorithm improved the performance of the model by up to 0.66% relative improvement.


title: Energy extraction from the Reissner-Nordstr\"om de Sitter black hole

abstract: The energy extraction from an electrostatic black hole by the decay or splitting of electrically charged particles is analyzed. We determine the energetic conditions that make the extraction process viable and present a general expression for the efficiency in terms of the parameters of the electrostatic black hole and the decaying particles. We also examine the conditions that optimize the efficiency of the extraction process. We analyze two particular cases, the first one is the extraction process from a Reissner Nordstr\"om black hole, for charged test particles with nonvanishing angular momentum; the second one and more interesting corresponds to the energy extraction from a Reissner Nordstr\"om de Sitter black hole. For the latter there are two regions where the energy extraction is possible, the generalized ergosphere and a cosmological ergosphere induced by the cosmological horizon. Under certain conditions the two ergospheres get connected and cover the whole region between the event horizon and the cosmological horizon, and therefore the energy extraction is possible at any point in the vicinity of the black hole. Moreover, the efficiency of the energy extraction can be the same for different break up points and also there is the possibility of a different efficiency for the same break up point. The conditions that maximize the efficiency are determined as well.


title: Many-Body Quantum Geometric Dipole

abstract: Collective excitations of many-body electron systems can carry internal structure, tied to the quantum geometry of the Hilbert space in which they are embedded. This has been shown explicitly for particle-hole-like excitations, which carry a ``quantum geometric dipole'' (QGD) that is essentially an electric dipole moment associated with the state. We demonstrate in this work that this property can be formulated in a generic way, which does not require wavefunctions expressed in terms of single particle-hole states. Our formulation exploits the density matrix associated with a branch of excitations that evolves continuously with its momentum ${\bf K}$, from which one may extract single-particle states allowing a construction of the QGD. We demonstrate the formulation using the single-mode approximation for excited states of two quantum Hall systems: the first for an integrally filled Landau level, and the second for a fractional quantum Hall state at filling factor $\nu=1/m$, with $m$ an odd integer. In both cases we obtain the same result for the QGD, which can be attributed to the translational invariance assumed of the system. Our study demonstrates that the QGD is an intrinsic property of collective modes which is valid beyond approximations one might make for their wavefunctions.

categories: cond-mat.mes-hall cond-mat.str-el math-ph math.MP quant-ph


title: Data-Aware Hybrid Tableaux

abstract: Labelled tableaux have been a traditional approach to define satisfiability checking procedures for Modal Logics. In many cases, they can also be used to obtained tight complexity bounds and lead to efficient implementations of reasoning tools. More recently, it has been shown that the expressive power provided by the operators characterizing Hybrid Logics (nominals and satisfiability modalities) can be used to internalize labels, leading to well-behaved inference procedures for fairly expressive logics. The resulting procedures are attractive because they do not use external mechanisms outside the language of the logic at hand, and have good logical and computational properties. Lately, many proof systems based on Hybrid Logic have been investigated, in particular related to Modal Logics featuring some form of data comparison. In this paper, we introduce an internalized tableaux calculus for XPath, arguably one of the most prominent approaches for querying semistructured data. More precisely, we define data-aware tableaux for XPath featuring data comparison operators and enriched with nominals and the satisfiability modalities from Hybrid Logic. We prove that the calculus is sound, complete and terminating. Moreover, we show that tableaux can be constructed in polynomial space, without compromising completeness, establishing in this way that the satisfiability problem for the considered logic is PSPACE-complete. Finally, we explore different extensions of the calculus, in particular to handle data trees and other frame classes.


title: Is poisoning a real threat to LLM alignment? Maybe more so than you think

abstract: Recent advancements in Reinforcement Learning with Human Feedback (RLHF) have significantly impacted the alignment of Large Language Models (LLMs). The sensitivity of reinforcement learning algorithms such as Proximal Policy Optimization (PPO) has led to new line work on Direct Policy Optimization (DPO), which treats RLHF in a supervised learning framework. The increased practical use of these RLHF methods warrants an analysis of their vulnerabilities. In this work, we investigate the vulnerabilities of DPO to poisoning attacks under different scenarios and compare the effectiveness of preference poisoning, a first of its kind. We comprehensively analyze DPO's vulnerabilities under different types of attacks, i.e., backdoor and non-backdoor attacks, and different poisoning methods across a wide array of language models, i.e., LLama 7B, Mistral 7B, and Gemma 7B. We find that unlike PPO-based methods, which, when it comes to backdoor attacks, require at least 4\% of the data to be poisoned to elicit harmful behavior, we exploit the true vulnerabilities of DPO more simply so we can poison the model with only as much as 0.5\% of the data. We further investigate the potential reasons behind the vulnerability and how well this vulnerability translates into backdoor vs non-backdoor attacks.


title: A dynamical system model of gentrification: Exploring a simple rent control strategy

abstract: Motivated by the need to understand the factors driving gentrification, we introduce and analyze two simple dynamical systems that model the interplay between three potential drivers of the phenomenon. The constructed systems are based on the assumption that three canonical drivers exist: a subpopulation that increases the desirability of a neighborhood, the desirability of a neighborhood, and the average price of real estate in a neighborhood. The second model modifies the first and implements a simple rent control scheme. For both models, we investigate the linear stability of equilibria and numerically determine the characteristics of oscillatory solutions as a function of system parameters. Introducing a rent control scheme stabilizes the system, in the sense that the parameter regime under which solutions approach equilibrium is expanded. However, oscillatory time series generated by the rent control model are generally more disorganized than those generated by the non-rent control model; in fact, long-term transient chaos was observed under certain conditions in the rent control case. Our results illustrate that even simple models of urban gentrification can lead to complex temporal behavior.


title: Relaxation of particle-laden interfaces: geometric and preparation effects

abstract: The relaxation of uni-axially compressed particle rafts through a finite opening found at the opposite side is experimentally studied. Three main behaviours are identified. The lowest relaxation degree corresponds to local unjamming. The other extreme corresponds to full relaxation and is characterized by the unjamming of the entire raft. In between, intermediate relaxation is observed. The unjammed domain first grows along the compression direction with an almost constant width and possibly extends through the entire raft length. In this case, a second phase may start during which erosion enables the unjammed channel to develop normally to the compression direction. Employing different raft geometries, i.e. various length and compression levels, and openings of various widths, we rationalize the occurrence of these different behaviours, which we attribute to the mechanical robustness of the force chain network. The threshold for channel formation and erosion are interpreted as its rupture against excessive shear and elongation, respectively. By further comparing results obtained for rafts prepared according to three different mixing degrees, we evidence that these thresholds are strongly affected by the raft history and quantify these effects in terms of shift of the rupture limits.


title: Who's asking? User personas and the mechanics of latent misalignment

abstract: Despite investments in improving model safety, studies show that misaligned capabilities remain latent in safety-tuned models. In this work, we shed light on the mechanics of this phenomenon. First, we show that even when model generations are safe, harmful content can persist in hidden representations and can be extracted by decoding from earlier layers. Then, we show that whether the model divulges such content depends significantly on its perception of who it is talking to, which we refer to as user persona. In fact, we find manipulating user persona to be even more effective for eliciting harmful content than direct attempts to control model refusal. We study both natural language prompting and activation steering as control methods and show that activation steering is significantly more effective at bypassing safety filters. We investigate why certain personas break model safeguards and find that they enable the model to form more charitable interpretations of otherwise dangerous queries. Finally, we show we can predict a persona's effect on refusal given only the geometry of its steering vector.


title: DistillNeRF: Perceiving 3D Scenes from Single-Glance Images by Distilling Neural Fields and Foundation Model Features

abstract: We propose DistillNeRF, a self-supervised learning framework addressing the challenge of understanding 3D environments from limited 2D observations in autonomous driving. Our method is a generalizable feedforward model that predicts a rich neural scene representation from sparse, single-frame multi-view camera inputs, and is trained self-supervised with differentiable rendering to reconstruct RGB, depth, or feature images. Our first insight is to exploit per-scene optimized Neural Radiance Fields (NeRFs) by generating dense depth and virtual camera targets for training, thereby helping our model to learn 3D geometry from sparse non-overlapping image inputs. Second, to learn a semantically rich 3D representation, we propose distilling features from pre-trained 2D foundation models, such as CLIP or DINOv2, thereby enabling various downstream tasks without the need for costly 3D human annotations. To leverage these two insights, we introduce a novel model architecture with a two-stage lift-splat-shoot encoder and a parameterized sparse hierarchical voxel representation. Experimental results on the NuScenes dataset demonstrate that DistillNeRF significantly outperforms existing comparable self-supervised methods for scene reconstruction, novel view synthesis, and depth estimation; and it allows for competitive zero-shot 3D semantic occupancy prediction, as well as open-world scene understanding through distilled foundation model features. Demos and code will be available at https://distillnerf.github.io/.


title: Conditions for Changing-Look AGNs from Accretion Disk-Induced Tidal Disruption Events

abstract: The phenomenon of changing-look (CL) behavior in active galactic nuclei (AGN) is characterized by dramatic changes in luminosity and/or emission line profiles over relatively short periods, ranging from months to years. The origin of CL-AGNs remains a mystery, but one proposed explanation involves the response of the inner AGN disk to tidal disruption events (TDEs) around the supermassive black hole (SMBH). In this Letter, we calculate the predicted frequency of AGN TDEs as a function of SMBH mass and compare the results to the observed CL-AGN distribution. We find that if the fraction of CL-AGNs caused by AGN-TDEs is high, then: (1) most SMBHs in CL-AGN are near maximal spin, with the dimensionless spin parameter $a>0.9$; (2) AGN inner disks have a high surface density ($\geq 10^{7}\, {\rm g\, cm^{-2}}$); (3) typical AGN lifetimes are $\sim 10$-$100$ Myr; and (4) a nuclear star cluster initial mass function (IMF) that scales as $\sim m_*^{-1.6}$ is preferred. Future observations of CL-AGN will help constrain the fraction of CL-AGNs caused by AGN-TDEs, SMBH spins, AGN lifetimes, and the nuclear star cluster IMF.


title: The Sobolev extension problem on trees and in the plane

abstract: Let $V$ be a finite tree with radially decaying weights. We show that there exists a set $E \subset \mathbb{R}^2$ for which the following two problems are equivalent: (1) Given a (real-valued) function $\phi$ on the leaves of $V$, extend it to a function $\Phi$ on all of $V$ so that $||\Phi||_{L^{1,p}(V)}$ has optimal order of magnitude. Here, $L^{1,p}(V)$ is a weighted Sobolev space on $V$. (2) Given a function $f:E \rightarrow \mathbb{R}$, extend it to a function $F \in L^{2,p}(\mathbb{R}^2)$ so that $||F||_{L^{2,p}(\mathbb{R}^2)}$ has optimal order of magnitude.


title: Circular transformation of the European steel industry renders scrap metal a strategic resource

abstract: The steel industry is a major contributor to CO2 emissions, accounting for 7% of global emissions. The European steel industry is seeking to reduce its emissions by increasing the use of electric arc furnaces (EAFs), which can produce steel from scrap, marking a major shift towards a circular steel economy. Here, we show by combining trade with business intelligence data that this shift requires a deep restructuring of the global and European scrap trade, as well as a substantial scaling of the underlying business ecosystem. We find that the scrap imports of European countries with major EAF installations have steadily decreased since 2007 while globally scrap trade started to increase recently. Our statistical modelling shows that every 1,000 tonnes of EAF capacity installed is associated with an increase in annual imports of 550 tonnes and a decrease in annual exports of 1,000 tonnes of scrap, suggesting increased competition for scrap metal as countries ramp up their EAF capacity. Furthermore, each scrap company enables an increase of around 79,000 tonnes of EAF-based steel production per year in the EU. Taking these relations as causal and extrapolating to the currently planned EAF capacity, we find that an additional 730 (SD 140) companies might be required, employing about 35,000 people (IQR 29,000-50,000) and generating an additional estimated turnover of USD 35 billion (IQR 27-48). Our results thus suggest that scrap metal is likely to become a strategic resource. They highlight the need for a massive restructuring of the industry's supply networks and identify the resulting growth opportunities for companies.


title: Effects of self-consistent extended Hubbard interactions and spin-orbit couplings on energy bands of semiconductors and topological insulators

abstract: A first-principles computational method with self-consistent on-site and inter-site Hubbard functionals is able to treat local and non-local Coulomb interactions on an equal footing. To apply the method to understand solids with strong spin-orbit coupling (SOC), we have extended a psuedohybrid functional approach developed by Agapito-Curtarolo-Buongiorno Nardelli to implement self-consistent extended Hubbard energy functionals for noncollinear spin states. With this, energy bands of semiconductors with various SOC strengths such as Si, Ge, GaAs, GaSb, CdSe and PdO are obtained, agreeing with results from fully relativistic $GW$ approximation (FR-GWA) as well as experiments. We also compute energy gaps of HgTe, CuTlS$_2$, and CuTlSe$_2$ and assign them to be topological insulators correctly, unlike characteristic failures for judging topological properties from typical hybrid functionals. We demonstrate feasibility of our method to handle large systems by computing surface bands of topological insulators, Bi$_{\text{2}}$Se$_{\text{3}}$ and Bi$_2$Te$_3$ with varying thickness up to eight quintuple layers. Considering its low computational cost comparable to conventional {\it ab intio} methods and improved accuracy to FR-GWA, we expect that our method provides an opportunity to study large scale correlated systems with the strong SOC efficiently and reliably.


title: Adaptive Uncertainty Quantification for Trajectory Prediction Under Distributional Shift

abstract: Trajectory prediction models that can infer both finite future trajectories and their associated uncertainties of the target vehicles in an online setting (e.g., real-world application scenarios) is crucial for ensuring the safe and robust navigation and path planning of autonomous vehicle motion. However, the majority of existing trajectory prediction models have neither considered reducing the uncertainty as one objective during the training stage nor provided reliable uncertainty quantification during inference stage under potential distribution shift. Therefore, in this paper, we propose the Conformal Uncertainty Quantification under Distribution Shift framework, CUQDS, to quantify the uncertainty of the predicted trajectories of existing trajectory prediction models under potential data distribution shift, while considering improving the prediction accuracy of the models and reducing the estimated uncertainty during the training stage. Specifically, CUQDS includes 1) a learning-based Gaussian process regression module that models the output distribution of the base model (any existing trajectory prediction or time series forecasting neural networks) and reduces the estimated uncertainty by additional loss term, and 2) a statistical-based Conformal P control module to calibrate the estimated uncertainty from the Gaussian process regression module in an online setting under potential distribution shift between training and testing data.


title: Curves on complete intersections and measures of irrationality

abstract: We study the minimal degrees and gonalities of curves on complete intersections. We prove a classical conjecture which asserts that the degree of any curve on a general complete intersection $X \subseteq \mathbb{P}^N$ cut out by polynomials of large degrees is bounded from below by the degree of $X$. As an application, we verify a conjecture of Bastianelli--De Poi--Ein--Lazarsfeld--Ullery on measures of irrationality for complete intersections.


title: Scaling limit of the ground state Bethe roots for the inhomogeneous XXZ spin-$\frac{1}{2}$ chain

abstract: It is known that for the Heisenberg XXZ spin-$\frac{1}{2}$ chain in the critical regime, the scaling limit of the vacuum Bethe roots yields an infinite set of numbers that coincide with the energy spectrum of the quantum mechanical 3D anharmonic oscillator. The discovery of this curious relation, among others, gave rise to the approach referred to as the ODE/IQFT (or ODE/IM) correspondence. Here we consider a multiparametric generalization of the Heisenberg spin chain, which is associated with the inhomogeneous six-vertex model. When quasi-periodic boundary conditions are imposed the lattice system may be explored within the Bethe Ansatz technique. We argue that for the critical spin chain, with a properly formulated scaling limit, the scaled Bethe roots for the ground state are described by second order differential equations, which are multi-parametric generalizations of the Schr\"{o}dinger equation for the anharmonic oscillator.

categories: math-ph cond-mat.stat-mech hep-th math.MP math.QA


title: Centering Policy and Practice: Research Gaps around Usable Differential Privacy

abstract: As a mathematically rigorous framework that has amassed a rich theoretical literature, differential privacy is considered by many experts to be the gold standard for privacy-preserving data analysis. Others argue that while differential privacy is a clean formulation in theory, it poses significant challenges in practice. Both perspectives are, in our view, valid and important. To bridge the gaps between differential privacy's promises and its real-world usability, researchers and practitioners must work together to advance policy and practice of this technology. In this paper, we outline pressing open questions towards building usable differential privacy and offer recommendations for the field, such as developing risk frameworks to align with user needs, tailoring communications for different stakeholders, modeling the impact of privacy-loss parameters, investing in effective user interfaces, and facilitating algorithmic and procedural audits of differential privacy systems.


title: End-to-end Text-to-SQL Generation within an Analytics Insight Engine

abstract: Recent advancements in Text-to-SQL have pushed database management systems towards greater democratization of data access. Today's language models are at the core of these advancements. They enable impressive Text-to-SQL generation as experienced in the development of Distyl AI's Analytics Insight Engine. Its early deployment with enterprise customers has highlighted three core challenges. First, data analysts expect support with authoring SQL queries of very high complexity. Second, requests are ad-hoc and, as such, require low latency. Finally, generation requires an understanding of domain-specific terminology and practices. The design and implementation of our Text-to-SQL generation pipeline, powered by large language models, tackles these challenges. The core tenants of our approach rely on external knowledge that we extract in a pre-processing phase, on retrieving the appropriate external knowledge at query generation time, and on decomposing SQL query generation following a hierarchical CTE-based structure. Finally, an adaptation framework leverages feedback to update the external knowledge, in turn improving query generation over time. We give an overview of our end-to-end approach and highlight the operators generating SQL during inference.


title: Cryogenic Compact mm-Wave Broadband SPST Switch in 22nm FDSOI CMOS for Monolithic Quantum Processors

abstract: This paper reports the experimental characterization at the cryogenic temperature of a compact mm-wave broadband single-pole single-throw (SPST) switch in 22nm FDSOI CMOS technology. The switch consists of two n-MOSFETs with a special device option to reduce the substrate parasitic effects, and a third n-MOSFET to improve isolation. Unlike prior wideband mm-wave switches, it does not require any large passive components, allowing a very compact design, low loss and high isolation performance. The cryogenic measurements at 2 K show an insertion loss lower than 2.3 dB, an isolation better than 25.3 dB, and the return loss better than -11.5 dB, over the entire frequency range from DC to 70 GHz.


title: Challenges to the Lambda CDM Cosmology

abstract: Observations of the cosmic microwave backgroundradiation are described to remarkable accuracy by the six-parameterLambda CDM cosmology. However, the key ingredients of this model, namely dark matter, dark energy and cosmic inflation are not understood at a fundamental level. It is therefore important to investigate tensions between the CMB and other cosmological probes. I will review aspects of tensions with direct measurements of the Hubble constant H_0, measurements of weak gravitational lensing, and the recent hints of evolving dark energy reported by the Dark Energy Spectroscopic Instrument (DESI) collaboration.


title: Irreducible discrete subgroups in products of simple Lie groups

abstract: We produce an example of an irreducible discrete subgroup in the product $SL(2,\R)\times SL(2,\R)$ which is not a lattice. This answers a question asked in [15].


title: Computing in the Life Sciences: From Early Algorithms to Modern AI

abstract: Computing in the life sciences has undergone a transformative evolution, from early computational models in the 1950s to the applications of artificial intelligence (AI) and machine learning (ML) seen today. This paper highlights key milestones and technological advancements through the historical development of computing in the life sciences. The discussion includes the inception of computational models for biological processes, the advent of bioinformatics tools, and the integration of AI/ML in modern life sciences research. Attention is given to AI-enabled tools used in the life sciences, such as scientific large language models and bio-AI tools, examining their capabilities, limitations, and impact to biological risk. This paper seeks to clarify and establish essential terminology and concepts to ensure informed decision-making and effective communication across disciplines.


title: Can LLMs Learn Macroeconomic Narratives from Social Media?

abstract: This study empirically tests the $\textit{Narrative Economics}$ hypothesis, which posits that narratives (ideas that are spread virally and affect public beliefs) can influence economic fluctuations. We introduce two curated datasets containing posts from X (formerly Twitter) which capture economy-related narratives (Data will be shared upon paper acceptance). Employing Natural Language Processing (NLP) methods, we extract and summarize narratives from the tweets. We test their predictive power for $\textit{macroeconomic}$ forecasting by incorporating the tweets' or the extracted narratives' representations in downstream financial prediction tasks. Our work highlights the challenges in improving macroeconomic models with narrative data, paving the way for the research community to realistically address this important challenge. From a scientific perspective, our investigation offers valuable insights and NLP tools for narrative extraction and summarization using Large Language Models (LLMs), contributing to future research on the role of narratives in economics.


title: Cancellable Memory Requests: A transparent, lightweight Spectre mitigation

abstract: Speculation is fundamental to achieving high CPU performance, yet it enables vulnerabilities such as Spectre attacks, which remain a significant challenge to mitigate without incurring substantial performance overheads. These attacks typically unfold in three steps: they speculatively access sensitive data (access), alter the cache state (transmit), and then utilize a cache timing attack (e.g., Flush+Reload) to extract the secret (receive). Most Spectre attacks exploit a cache timing side channel during the transmit and receive steps. Our key observation is that Spectre attacks do not require the transmit instruction to complete before mis-prediction is detected and mis-speculated instructions are squashed. Instead, it suffices for the instruction to execute and dispatch a request to the memory hierarchy. Responses from memory that arrive after squashing occurs still alter the cache state, including those related to mis-speculated memory accesses. We therefore propose a novel mitigation technique, Cancellable Memory Requests (CMR), that cancels mis-speculated memory requests. Immediately upon squashing, a cancellation is sent to the cache hierarchy, propagating downstream and preventing any changes to caches that have not yet received a response. This reduces the likelihood of cache state changes, thereby reducing the likelihood of Spectre attacks succeeding. We implement CMR on gem5 and show that it thwarts practical Spectre attacks, and has near-zero performance overheads. We show that CMR can completely thwart Spectre attacks in four real-world processors with realistic system configurations.


title: Precision measurement of the $\Xi^-_b$ baryon lifetime

abstract: A sample of $pp$ collision data, corresponding to an integrated luminosity of 5.5 fb$^{-1}$ and collected by the LHCb experiment during Run 2, is used to measure the ratio of the lifetime of the $\Xi^-_b$ baryon to that of the $\Lambda^0_b$ baryon, $r_{\tau}\equiv\tau_{\Xi^-_b}/\tau_{\Lambda^0_b}$. The value ${r_{\tau}^{\rm Run\,2}=1.076\pm0.013\pm0.006}$ is obtained, where the first uncertainty is statistical and the second systematic. This value is averaged with the corresponding value from Run 1 to obtain ${r_{\tau}^{\rm Run\,1,2} = 1.078\pm0.012\pm0.007}$. Multiplying by the world-average value of the $\Lambda^0_b$ lifetime yields $\tau_{\Xi^-_b}^{\rm Run~1,2} = 1.578\pm0.018\pm0.010\pm0.011$ ps, where the uncertainties are statistical, systematic, and due to the limited knowledge of the $\Lambda^0_b$ lifetime. This measurement improves the precision of the current world average of the $\Xi^-_b$ lifetime by about a factor of two, and is in good agreement with the most recent theoretical predictions.


title: Thermodynamic Transferability in Coarse-Grained Force Fields using Graph Neural Networks

abstract: Coarse-graining is a molecular modeling technique in which an atomistic system is represented in a simplified fashion that retains the most significant system features that contribute to a target output, while removing the degrees of freedom that are less relevant. This reduction in model complexity allows coarse-grained molecular simulations to reach increased spatial and temporal scales compared to corresponding all-atom models. A core challenge in coarse-graining is to construct a force field that represents the interactions in the new representation in a way that preserves the atomistic-level properties. Many approaches to building coarse-grained force fields have limited transferability between different thermodynamic conditions as a result of averaging over internal fluctuations at a specific thermodynamic state point. Here, we use a graph-convolutional neural network architecture, the Hierarchically Interacting Particle Neural Network with Tensor Sensitivity (HIP-NN-TS), to develop a highly automated training pipeline for coarse grained force fields which allows for studying the transferability of coarse-grained models based on the force-matching approach. We show that this approach not only yields highly accurate force fields, but also that these force fields are more transferable through a variety of thermodynamic conditions. These results illustrate the potential of machine learning techniques such as graph neural networks to improve the construction of transferable coarse-grained force fields.


title: 4D Printing of Programmable Digital Metamaterials

abstract: Modern 3D printers allow for the accurate placing of microscopic material voxels, to form complex three-dimensional structures. The advancing capabilities in multi-material printing, coupled with the discovery of printable responsive materials, pave the way for the 3D printing of digital materials, and for the 3D printing of shape-transforming structures, or 4D printing. In this work, we leverage and combine these advancements to develop a versatile methodology for crafting digitized 4D-printed shape-transforming sheets. We 3D print digital responsive sheets, composed of active and passive voxels that are meticulously positioned to form thin structures that can be actuated on demand. This methodology enables us to encode the lateral geometry and the reference curvature, separately and simultaneously. Our approach grants us comprehensive control over the resulting shape, unlocking novel opportunities in synthetic shape-morphing materials. Furthermore, it has the potential to program anomalous mechanical properties and to be extended to multi-material and metamaterial systems.