title: Reasoning about concepts with LLMs: Inconsistencies abound

abstract: The ability to summarize and organize knowledge into abstract concepts is key to learning and reasoning. Many industrial applications rely on the consistent and systematic use of concepts, especially when dealing with decision-critical knowledge. However, we demonstrate that, when methodically questioned, large language models (LLMs) often display and demonstrate significant inconsistencies in their knowledge. Computationally, the basic aspects of the conceptualization of a given domain can be represented as Is-A hierarchies in a knowledge graph (KG) or ontology, together with a few properties or axioms that enable straightforward reasoning. We show that even simple ontologies can be used to reveal conceptual inconsistencies across several LLMs. We also propose strategies that domain experts can use to evaluate and improve the coverage of key domain concepts in LLMs of various sizes. In particular, we have been able to significantly enhance the performance of LLMs of various sizes with openly available weights using simple knowledge-graph (KG) based prompting strategies.


title: Item response parameter estimation performance using Gaussian quadrature and Laplace

abstract: Item parameter estimation in pharmacometric item response theory (IRT) models is predominantly performed using the Laplace estimation algorithm as implemented in NONMEM. In psychometrics a wide range of different software tools, including several packages for the open-source software R for implementation of IRT are also available. Each have their own set of benefits and limitations and to date a systematic comparison of the primary estimation algorithms has not been evaluated. A simulation study evaluating varying number of hypothetical sample sizes and item scenarios at baseline was performed using both Laplace and Gauss-hermite quadrature (GHQ-EM). In scenarios with at least 20 items and more than 100 subjects, item parameters were estimated with good precision and were similar between estimation algorithms as demonstrated by several measures of bias and precision. The minimal differences observed for certain parameters or sample size scenarios were reduced when translating to the total score scale. The ease of use, speed of estimation and relative accuracy of the GHQ-EM method employed in mirt make it an appropriate alternative or supportive analytical approach to NONMEM for potential pharmacometrics IRT applications.


title: Randomized Exploration for Reinforcement Learning with Multinomial Logistic Function Approximation

abstract: We study reinforcement learning with multinomial logistic (MNL) function approximation where the underlying transition probability kernel of the Markov decision processes (MDPs) is parametrized by an unknown transition core with features of state and action. For the finite horizon episodic setting with inhomogeneous state transitions, we propose provably efficient algorithms with randomized exploration having frequentist regret guarantees. For our first algorithm, $\texttt{RRL-MNL}$, we adapt optimistic sampling to ensure the optimism of the estimated value function with sufficient frequency and establish that $\texttt{RRL-MNL}$ is both statistically and computationally efficient, achieving a $\tilde{O}(\kappa^{-1} d^{\frac{3}{2}} H^{\frac{3}{2}} \sqrt{T})$ frequentist regret bound with constant-time computational cost per episode. Here, $d$ is the dimension of the transition core, $H$ is the horizon length, $T$ is the total number of steps, and $\kappa$ is a problem-dependent constant. Despite the simplicity and practicality of $\texttt{RRL-MNL}$, its regret bound scales with $\kappa^{-1}$, which is potentially large in the worst case. To improve the dependence on $\kappa^{-1}$, we propose $\texttt{ORRL-MNL}$, which estimates the value function using local gradient information of the MNL transition model. We show that its frequentist regret bound is $\tilde{O}(d^{\frac{3}{2}} H^{\frac{3}{2}} \sqrt{T} + \kappa^{-1} d^2 H^2)$. To the best of our knowledge, these are the first randomized RL algorithms for the MNL transition model that achieve both computational and statistical efficiency. Numerical experiments demonstrate the superior performance of the proposed algorithms.


title: An approximation for return time distributions of random walks on sparse networks

abstract: We propose an approximation for the first return time distribution of random walks on undirected networks. We combine a message-passing solution with a mean-field approximation, to account for the short- and long-term behaviours respectively. We test this approximation on several classes of large graphs and find excellent agreement between our approximations and the true distributions. While the statistical properties of a random walk will depend on the structure of the network, the observed agreement between our approximations and numerical calculations implies that while local structure is clearly very influential, global structure is only important in a relatively superficial way, namely through the total number of edges.


title: Lethal surface ozone concentrations are possible on habitable zone exoplanets

abstract: Ozone ($\textrm{O}_3$) is important for the survival of life on Earth because it shields the surface from ionising ultraviolet (UV) radiation. However, the existence of $\textrm{O}_3$ in Earth's atmosphere is not always beneficial. Resulting from anthropogenic activity, $\textrm{O}_3$ exists as a biologically harmful pollutant at the surface when it forms in the presence of sunlight and other pollutants. As a strong oxidiser, $\textrm{O}_3$ can be lethal to several different organisms; thus, when assessing the potential habitability of an exoplanet, a key part is determining whether toxic gases could be present at its surface. Using the Whole Atmosphere Community Climate Model version 6 (WACCM6; a three-dimensional chemistry-climate model), twelve atmospheric simulations of the terrestrial exoplanet TRAPPIST-1 e are performed with a variety of $\textrm{O}_2$ concentrations and assuming two different stellar spectra proposed in the literature. Four atmospheric simulations of the exoplanet Proxima Centauri b are also included. Some scenarios for both exoplanets exhibit time-averaged surface $\textrm{O}_3$ mixing ratios exceeding harmful levels of 40 ppbv, with 2200 ppbv the maximum concentration found in the cases simulated. These concentrations are toxic and can be fatal to most life on Earth. In other scenarios $\textrm{O}_3$ remains under harmful limits over a significant fraction of the surface, despite there being present regions which may prove inhospitable. In the case that $\textrm{O}_3$ is detected in a terrestrial exoplanet's atmosphere, determining the surface concentration is an important step when evaluating a planet's habitability.


title: Enhancing Battlefield Awareness: An Aerial RIS-assisted ISAC System with Deep Reinforcement Learning

abstract: This paper considers a joint communication and sensing technique for enhancing situational awareness in practical battlefield scenarios. In particular, we propose an aerial reconfigurable intelligent surface (ARIS)-assisted integrated sensing and communication (ISAC) system consisting of a single access point (AP), an ARIS, multiple users, and a sensing target. With deep reinforcement learning (DRL), we jointly optimize the transmit beamforming of the AP, the RIS phase shifts, and the trajectory of the ARIS under signal-to-interference-noise ratio (SINR) constraints. Numerical results demonstrate that the proposed technique outperforms the conventional benchmark schemes by suppressing the self-interference and clutter echo signals or optimizing the RIS phase shifts.


title: Multi-watt 1 GHz single-cycle frequency combs

abstract: Single-cycle optical pulses offer a strong carrier-envelope-offset (CEO) dependent electric field and the highest peak intensity for a given pulse energy. Absence of demonstrated GHz single-cycle lasers constrains exploration of single/sub-cycle dynamics at this repetition rate. By leveraging fiber soliton effects and suppressing higher-order dispersion, we achieve single-cycle pulse generation at a 1 GHz repetition rate in an all-fiber format. The laser produces 7.1 fs (1.1-cycle) pulses with 1.8 W average power, centered around 1970 nm. Temporal characterization shows 60% of the pulse energy is concentrated in the pulse center, yielding a peak power of 110 kW. The seed laser demonstrates a 43 dB signal-to-noise ratio for the CEO frequency, facilitating comb stabilization and CEO control. Our model, which matches experimental observations, identifies conditions for achieving single-cycle duration and predicts scalability to a 2 GHz repetition rate. This work presents the first GHz single-cycle source. We envision these advances will drive studies in single/sub-cycle light-matter interaction, spectroscopy, microscopy, and CEO-sensitive nonlinear optics.


title: Role of Spatial Curvature in a Dark Energy Interacting Model

abstract: This paper investigates the effects of spatial curvature in a model where dark matter and dark energy interact. The analysis employs a range of datasets, including CMB, BAO, Type Ia Supernova, $H(z)$ from cosmic chronometers, $H_0$ measurements from Megamasers and SH0ES, growth rate data and strong lensing time delay measurements, to assess the model's fit and explore the late-time dynamics of the interacting dark sector in a non-flat cosmological framework. The study indicates that introducing curvature can significantly impact the Hubble constant ($H_0$) and the structure growth parameter ($S_8$), potentially easing tensions between early and late universe observations. The observational data shows an indication for a closed universe. This implies that the presence of curvature and its influence cannot be neglected entirely.


title: Projected Augmented Wave (PAW) Method with multiple pseudo statesmapped onto the same all electron wavefunction

abstract: The Projected Augmented Wave (PAW) Method is based on generating a transform between the pseudo wavefunction and all electron wavefunction. For the accuracy of the method it is important that the local part of the transform (in each atomic sphere $\mathbf{R}$) be over a complete basis set (with deviations from completeness leading to corrections to the total energy not computed within current implementations of PAW). Here we show how to make this basis much closer to complete without significant additional computational work by allowing for multiple smooth pseudo wavefunction states to be mapped onto the same all electron wavefunction.


title: Iterative Feature Boosting for Explainable Speech Emotion Recognition

abstract: In speech emotion recognition (SER), using predefined features without considering their practical importance may lead to high dimensional datasets, including redundant and irrelevant information. Consequently, high-dimensional learning often results in decreasing model accuracy while increasing computational complexity. Our work underlines the importance of carefully considering and analyzing features in order to build efficient SER systems. We present a new supervised SER method based on an efficient feature engineering approach. We pay particular attention to the explainability of results to evaluate feature relevance and refine feature sets. This is performed iteratively through feature evaluation loop, using Shapley values to boost feature selection and improve overall framework performance. Our approach allows thus to balance the benefits between model performance and transparency. The proposed method outperforms human-level performance (HLP) and state-of-the-art machine learning methods in emotion recognition on the TESS dataset. The source code of this paper is publicly available at https://github.com/alaaNfissi/Iterative-Feature-Boosting-for-Explainable-Speech-Emotion-Recognition.


title: Eclipse Qrisp QAOA: description and preliminary comparison with Qiskit counterparts

abstract: This paper focuses on the presentation and evaluation of the high-level quantum programming language Eclipse Qrisp. The presented framework, used for developing and compiling quantum algorithms, is measured in terms of efficiency for its implementation of the Quantum Approximation Optimization Algorithm (QAOA) Module. We measure this efficiency and compare it against two alternative QAOA algorithm implementations using IBM's Qiskit toolkit. The evaluation process has been carried out over a benchmark composed of 15 instances of the well-known Maximum Cut Problem. Through this preliminary experimentation, Eclipse Qrisp demonstrated promising results, outperforming both versions of its counterparts in terms of results quality and circuit complexity.


title: Tropical Expressivity of Neural Networks

abstract: We propose an algebraic geometric framework to study the expressivity of linear activation neural networks. A particular quantity that has been actively studied in the field of deep learning is the number of linear regions, which gives an estimate of the information capacity of the architecture. To study and evaluate information capacity and expressivity, we work in the setting of tropical geometry -- a combinatorial and polyhedral variant of algebraic geometry -- where there are known connections between tropical rational maps and feedforward neural networks. Our work builds on and expands this connection to capitalize on the rich theory of tropical geometry to characterize and study various architectural aspects of neural networks. Our contributions are threefold: we provide a novel tropical geometric approach to selecting sampling domains among linear regions; an algebraic result allowing for a guided restriction of the sampling domain for network architectures with symmetries; and an open source library to analyze neural networks as tropical Puiseux rational maps. We provide a comprehensive set of proof-of-concept numerical experiments demonstrating the breadth of neural network architectures to which tropical geometric theory can be applied to reveal insights on expressivity characteristics of a network. Our work provides the foundations for the adaptation of both theory and existing software from computational tropical geometry and symbolic computation to deep learning.


title: InstructionCP: A fast approach to transfer Large Language Models into target language

abstract: The rapid development of large language models (LLMs) in recent years has largely focused on English, resulting in models that respond exclusively in English. To adapt these models to other languages, continual pre-training (CP) is often employed, followed by supervised fine-tuning (SFT) to maintain conversational abilities. However, CP and SFT can reduce a model's ability to filter harmful content. We propose Instruction Continual Pre-training (InsCP), which integrates instruction tags into the CP process to prevent loss of conversational proficiency while acquiring new languages. Our experiments demonstrate that InsCP retains conversational and Reinforcement Learning from Human Feedback (RLHF) abilities. Empirical evaluations on language alignment, reliability, and knowledge benchmarks confirm the efficacy of InsCP. Notably, this approach requires only 0.1 billion tokens of high-quality instruction-following data, thereby reducing resource consumption.


title: The Solar System Notification Alert Processing System (SNAPS): Asteroid Population Outlier Detection

abstract: The Solar System Notification Alert Processing System (SNAPS) is a ZTF and Rubin Observatory alert broker that will send alerts to the community regarding interesting events in the Solar System. SNAPS is actively monitoring Solar System objects and one of its functions is to compare objects (primarily main belt asteroids) to one another to find those that are outliers relative to the population. In this paper, we use the SNAPShot1 dataset which contains 31,693 objects from ZTF and derive outlier scores for each of these objects. SNAPS employs an unsupervised approach; consequently, to derive outlier rankings for each object, we propose four different outlier metrics such that we can explore variants of outlier scores and add confidence to outlier rankings. We also provide outlier scores for each object in each permutation of 15 feature spaces, between 2 and 15 features, which yields 32,752 total feature spaces. We show that we can derive population outlier rankings each month at Rubin Observatory scale using four Nvidia A100 GPUs, and present several avenues of scientific investigation that can be explored using population outlier detection.


title: On the nested algebraic Bethe ansatz for spin chains with simple $\mathfrak{g}$-symmetry

abstract: We propose a new framework for the nested algebraic Bethe ansatz for a closed, rational spin chain with $\mathfrak{g}$-symmetry for any simple Lie algebra $\mathfrak{g}$. Starting the nesting process by removing a single simple root from $\mathfrak{g}$, we use the residual $U(1)$ charge and the block Gauss decomposition of the $R$-matrix to derive many standard results in the Bethe ansatz, such as the nesting of Yangian algebras, and the AB commutation relation.


title: Non-intrusive data-driven model order reduction for circuits based on Hammerstein architectures

abstract: We demonstrate that data-driven system identification techniques can provide a basis for effective, non-intrusive model order reduction (MOR) for common circuits that are key building blocks in microelectronics. Our approach is motivated by the practical operation of these circuits and utilizes a canonical Hammerstein architecture. To demonstrate the approach we develop a parsimonious Hammerstein model for a non-linear CMOS differential amplifier. We train this model on a combination of direct current (DC) and transient Spice (Xyce) circuit simulation data using a novel sequential strategy to identify the static nonlinear and linear dynamical parts of the model. Simulation results show that the Hammerstein model is an effective surrogate for the differential amplifier circuit that accurately and efficiently reproduces its behavior over a wide range of operating points and input frequencies.


title: Robo-Instruct: Simulator-Augmented Instruction Alignment For Finetuning CodeLLMs

abstract: Large language models (LLMs) have shown great promise at generating robot programs from natural language given domain-specific robot application programming interfaces (APIs). However, the performance gap between proprietary LLMs and smaller open-weight LLMs remains wide. This raises a question: Can we fine-tune smaller open-weight LLMs for generating domain-specific robot programs to close the performance gap with proprietary LLMs? While Self-Instruct is a promising solution by generating a diverse set of training data, it cannot verify the correctness of these programs. In contrast, a robot simulator with a well-defined world can identify execution errors but limits the diversity of programs that it can verify. In this work, we introduce Robo-Instruct, which brings the best of both worlds -- it promotes the diversity of Self-Instruct while providing the correctness of simulator-based checking. Robo-Instruct introduces RoboSim to synthesize a consistent world state on the fly by inferring properties relevant to the program being checked, and simulating actions accordingly. Furthermore, the instructions and programs generated by Self-Instruct may be subtly inconsistent -- such as the program missing a step implied by the instruction. Robo-Instruct further addresses this with InstAlign, an instruction-program alignment procedure that revises the task instruction to reflect the actual results of the generated program. Given a few seed task descriptions and the robot APIs, Robo-Instruct is capable of generating a training dataset using only a small open-weight model. This dataset can then be used to fine-tune small open-weight language models, enabling them to match or even exceed the performance of several proprietary LLMs, such as GPT-3.5-Turbo and Gemini-Pro.


title: Transformers and Slot Encoding for Sample Efficient Physical World Modelling

abstract: World modelling, i.e. building a representation of the rules that govern the world so as to predict its evolution, is an essential ability for any agent interacting with the physical world. Recent applications of the Transformer architecture to the problem of world modelling from video input show notable improvements in sample efficiency. However, existing approaches tend to work only at the image level thus disregarding that the environment is composed of objects interacting with each other. In this paper, we propose an architecture combining Transformers for world modelling with the slot-attention paradigm, an approach for learning representations of objects appearing in a scene. We describe the resulting neural architecture and report experimental results showing an improvement over the existing solutions in terms of sample efficiency and a reduction of the variation of the performance over the training examples. The code for our architecture and experiments is available at https://github.com/torchipeppo/transformers-and-slot-encoding-for-wm


title: Conic Section on the Sky: Shadows of Linearly Superrotated Black Holes

abstract: Soft hairs are intrinsically infrared features of a black hole, which may also affect near-horizon physics. In this work, we study one of the primary observables through which we can study the effects of a particular type of soft hair in Einstein's gravity: the shadow of a non-rotating black hole implanted with linear {\it regular} superrotational hair. We show that such soft hairs deform the shadow from the characteristic circular shape of bald Schwarzschild black holes into ellipses. Such a unique effect can be observed in future black hole imaging projects. This starkly contrasts with the supertranslated counterpart, for which the only changes are the static shift of the circular shadow's position and thus cannot be detectable. Our results demonstrate the richness of observable effects due to the infrared structures of Einstein's gravity.


title: Convergence Analysis for A Stochastic Maximum Principle Based Data Driven Feedback Control Algorithm

abstract: This paper presents convergence analysis of a novel data-driven feedback control algorithm designed for generating online controls based on partial noisy observational data. The algorithm comprises a particle filter-enabled state estimation component, estimating the controlled system's state via indirect observations, alongside an efficient stochastic maximum principle type optimal control solver. By integrating weak convergence techniques for the particle filter with convergence analysis for the stochastic maximum principle control solver, we derive a weak convergence result for the optimization procedure in search of optimal data-driven feedback control. Numerical experiments are performed to validate the theoretical findings.


title: A Survey Study on the State of the Art of Programming Exercise Generation using Large Language Models

abstract: This paper analyzes Large Language Models (LLMs) with regard to their programming exercise generation capabilities. Through a survey study, we defined the state of the art, extracted their strengths and weaknesses and finally proposed an evaluation matrix, helping researchers and educators to decide which LLM is the best fitting for the programming exercise generation use case. We also found that multiple LLMs are capable of producing useful programming exercises. Nevertheless, there exist challenges like the ease with which LLMs might solve exercises generated by LLMs. This paper contributes to the ongoing discourse on the integration of LLMs in education.


title: Phylogenetic degrees for Jukes-Cantor model

abstract: Jukes-Cantor model is one of the most meaningful statistical models from a biological perspective. We are interested in computing the algebraic degrees for phylogenetic varieties, which we call phylogenetic degrees, associated to the Jukes-Cantor model and any tree. As these varieties are toric, their geometry is hidden in the associated polytopes. For this reason, we provide two different combinatorial approaches to compute the volume for these polytopes.


title: The Parton Branching evolution package uPDFevolv2

abstract: uPDFevolv2 is a software package designed for evolving collinear and Transverse Momentum Dependent (TMD) parton densities using the DGLAP evolution equation. A comprehensive description of both the theoretical framework and technical implementation is given, accompanied by a detailed guide on program usage, focusing on customizable parameters. This report is as a technical release note for uPDFevolv version 2.5.03.


title: Aharonov-Bohm flux and dual gaps effects on energy levels in graphene magnetic quantum dots

abstract: We address the question of how the Aharonov-Bohm flux $\Phi_{AB}$ can affect the energy levels of graphene magnetic quantum dots (GMQDs) of radius $R$. To answer this question, we consider GMQDs induced by a magnetic field $B$ and subjected to two different gaps - an internal gap $\Delta_1$ and an external gap $\Delta_2$. After determining the eigenspinors and ensuring continuity at the boundary of the GMQDs, we formulate an analytical equation describing the corresponding energy levels. Our results show that the energy levels can exhibit either a symmetric or an asymmetric behavior depending on the valleys $K$ and $K'$ together with the quantum angular momentum $m$. In addition, we find that $\Phi_{AB}$ causes an increase in the band gap width when $\Delta_1$ is present inside the GMQDs. This effect is less significant when a gap is present outside, resulting in a longer lifetime of the confined electronic states. Further increases in \(\Phi_{AB}\) reduce the number of levels between the conduction and valence bands, thereby increasing the band gap. These results demonstrate that the electronic properties of graphene can be tuned by the presence of the AB flux, offering the potential to control the behavior of graphene-based quantum devices.


title: An Ultra-High Vacuum Scanning Tunneling Microscope with Pulse Tube and Joule-Thomson cooling operating at sub-pm z-noise

abstract: We describe a compact ultra-high vacuum (UHV) scanning tunneling microscope (STM) system that does not need any external supply of cooling liquids. It achieves temperatures down to 1.5 K and a z-noise down to 300 fmRMS for the frequency range of 0.1 Hz - 5 kHz (feedback loop off). It employs a pulse tube cryocooler (PTC) and a Joule-Thomson (JT) stage inducing only small temperature oscillations at the STM with amplitude below 1 mK. The challenge to combine an effective vibrational decoupling from the PTC with sufficient thermal conduction is tackled by a multipartite approach. We realize a minimal stiffness of the UHV bellows that connect the PTC and the STM chamber. Fine Copper wires mechanically decouple the PTC stages from cooling plates that carry the thermal shields, the JT stage and the STM. Soft springs decouple the STM from the JT stage. Finally, the STM body has an optimized conical shape and is made of the light and stiff material Shapal Hi MSoft such that a strong reduction of low frequency vibrations results for the tunnel junction. The voltage noise in the tunnel junction is 0.12 mV and an RF antenna close to the tunnel junction provides radio frequency excitations up to 40 GHz with amplitudes up to 10 mV.

categories: physics.ins-det cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.other cond-mat.supr-con


title: SPARE: Symmetrized Point-to-Plane Distance for Robust Non-Rigid Registration

abstract: Existing optimization-based methods for non-rigid registration typically minimize an alignment error metric based on the point-to-point or point-to-plane distance between corresponding point pairs on the source surface and target surface. However, these metrics can result in slow convergence or a loss of detail. In this paper, we propose SPARE, a novel formulation that utilizes a symmetrized point-to-plane distance for robust non-rigid registration. The symmetrized point-to-plane distance relies on both the positions and normals of the corresponding points, resulting in a more accurate approximation of the underlying geometry and can achieve higher accuracy than existing methods. To solve this optimization problem efficiently, we propose an alternating minimization solver using a majorization-minimization strategy. Moreover, for effective initialization of the solver, we incorporate a deformation graph-based coarse alignment that improves registration quality and efficiency. Extensive experiments show that the proposed method greatly improves the accuracy of non-rigid registration problems and maintains relatively high solution efficiency. The code is publicly available at https://github.com/yaoyx689/spare.


title: Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memory

abstract: In this work, we describe our approach to developing an intelligent and robust social robotic system for the Nadine social robot platform. We achieve this by integrating Large Language Models (LLMs) and skilfully leveraging the powerful reasoning and instruction-following capabilities of these types of models to achieve advanced human-like affective and cognitive capabilities. This approach is novel compared to the current state-of-the-art LLM-based agents which do not implement human-like long-term memory or sophisticated emotional appraisal. The naturalness of social robots, consisting of multiple modules, highly depends on the performance and capabilities of each component of the system and the seamless integration of the components. We built a social robot system that enables generating appropriate behaviours through multimodal input processing, bringing episodic memories accordingly to the recognised user, and simulating the emotional states of the robot induced by the interaction with the human partner. In particular, we introduce an LLM-agent frame for social robots, SoR-ReAct, serving as a core component for the interaction module in our system. This design has brought forth the advancement of social robots and aims to increase the quality of human-robot interaction.


title: Motivic classes of curvilinear Hilbert schemes and Igusa zeta functions

abstract: This paper delves into the study of curvilinear Hilbert schemes associated with a singular variety $(X,0)$ and the relationship between their motivic classes and the motivic measure on the arc scheme $X_\infty$ of $X$ introduced by Denef and Loeser. We introduce an Igusa zeta function specifically tailored for curvilinear Hilbert schemes for which we provide an explicit formulation in terms of an embedded resolution of the singularity, and we consequently obtain a recursive formula to compute the motivic classes of curvilinear Hilbert schemes in terms of the resolution. In addition, the paper explores and analyzes the geometry and combinatorics of curvilinear Hilbert schemes in the context of plane curve singularities and their topological invariants.


title: Multidimensional spatiotemporal clustering -- An application to environmental sustainability scores in Europe

abstract: The assessment of corporate sustainability performance is extremely relevant in facilitating the transition to a green and low-carbon intensity economy. However, companies located in different areas may be subject to different sustainability and environmental risks and policies. Henceforth, the main objective of this paper is to investigate the spatial and temporal pattern of the sustainability evaluations of European firms. We leverage on a large dataset containing information about companies' sustainability performances, measured by MSCI ESG ratings, and geographical coordinates of firms in Western Europe between 2013 and 2023. By means of a modified version of the Chavent et al. (2018) hierarchical algorithm, we conduct a spatial clustering analysis, combining sustainability and spatial information, and a spatiotemporal clustering analysis, which combines the time dynamics of multiple sustainability features and spatial dissimilarities, to detect groups of firms with homogeneous sustainability performance. We are able to build cross-national and cross-industry clusters with remarkable differences in terms of sustainability scores. Among other results, in the spatio-temporal analysis, we observe a high degree of geographical overlap among clusters, indicating that the temporal dynamics in sustainability assessment are relevant within a multidimensional approach. Our findings help to capture the diversity of ESG ratings across Western Europe and may assist practitioners and policymakers in evaluating companies facing different sustainability-linked risks in different areas.


title: TAIA: Large Language Models are Out-of-Distribution Data Learners

abstract: Fine-tuning on task-specific question-answer pairs is a predominant method for enhancing the performance of instruction-tuned large language models (LLMs) on downstream tasks. However, in certain specialized domains, such as healthcare or harmless content generation, it is nearly impossible to obtain a large volume of high-quality data that matches the downstream distribution. To improve the performance of LLMs in data-scarce domains with domain-mismatched data, we re-evaluated the Transformer architecture and discovered that not all parameter updates during fine-tuning contribute positively to downstream performance. Our analysis reveals that within the self-attention and feed-forward networks, only the fine-tuned attention parameters are particularly beneficial when the training set's distribution does not fully align with the test set. Based on this insight, we propose an effective inference-time intervention method: Training All parameters but Inferring with only Attention (\trainallInfAttn). We empirically validate \trainallInfAttn using two general instruction-tuning datasets and evaluate it on seven downstream tasks involving math, reasoning, and knowledge understanding across LLMs of different parameter sizes and fine-tuning techniques. Our comprehensive experiments demonstrate that \trainallInfAttn achieves superior improvements compared to both the fully fine-tuned model and the base model in most scenarios, with significant performance gains. The high tolerance of \trainallInfAttn to data mismatches makes it resistant to jailbreaking tuning and enhances specialized tasks using general data.


title: Space-time superpositions as fluctuating geometries

abstract: Superpositions of black holes can be described geometrically using a combined canonical formulation for space-time and quantum states. A previously introduced black-hole model that includes quantum fluctuations of metric components is shown here to give full access to the corresponding space-time geometry of weak-field gravity in terms of suitable line elements with quantum corrections. These results can be interpreted as providing covariant formulations of the gravitational force implied by a distribution of black holes in superposition. They can also be understood as a distribution of quantum matter constituents in superposition for a single black hole. A detailed analysis in the weak-field limit reveals quantum corrections to Newton's potential in generic semiclassical states, as well as new bounds on quantum fluctuations, implied by the covariance condition, rather than the usual uncertainty principle. These results provide additional control on quantum effects in Newton's potential that can be used in a broad range of predictions to be compared with observations.


title: Occam Gradient Descent

abstract: Deep learning neural network models must be large enough to adapt to their problem domain, while small enough to avoid overfitting training data during gradient descent. To balance these competing demands, overprovisioned deep learning models such as transformers are trained for a single epoch on large data sets, and hence inefficient with both computing resources and training data. In response to these inefficiencies, we exploit learning theory to derive Occam Gradient Descent, an algorithm that interleaves adaptive reduction of model size to minimize generalization error, with gradient descent on model weights to minimize fitting error. In contrast, traditional gradient descent greedily minimizes fitting error without regard to generalization error. Our algorithm simultaneously descends the space of weights and topological size of any neural network without modification, and is effective in our experiments in outperforming traditional gradient descent with or without post-train pruning in accuracy, compute and model compression.


title: Using Large Language Models for Humanitarian Frontline Negotiation: Opportunities and Considerations

abstract: Humanitarian negotiations in conflict zones, called \emph{frontline negotiation}, are often highly adversarial, complex, and high-risk. Several best-practices have emerged over the years that help negotiators extract insights from large datasets to navigate nuanced and rapidly evolving scenarios. Recent advances in large language models (LLMs) have sparked interest in the potential for AI to aid decision making in frontline negotiation. Through in-depth interviews with 13 experienced frontline negotiators, we identified their needs for AI-assisted case analysis and creativity support, as well as concerns surrounding confidentiality and model bias. We further explored the potential for AI augmentation of three standard tools used in frontline negotiation planning. We evaluated the quality and stability of our ChatGPT-based negotiation tools in the context of two real cases. Our findings highlight the potential for LLMs to enhance humanitarian negotiations and underscore the need for careful ethical and practical considerations.


title: Time-delay interferometry with onboard optical delays

abstract: Time-delay interferometry (TDI) is a data processing technique for space-based gravitational-wave detectors to create laser-noise-free equal-optical-path-length interferometers virtually on the ground. It relies on the interspacecraft signal propagation delays, which are delivered by intersatellite ranging monitors. Also delays due to onboard signal propagation and processing have a nonnegligible impact on the TDI combinations. However, these onboard delays were only partially considered in previous TDI-related research; onboard optical path lengths have been neglected so far. In this paper, we study onboard optical path lengths in TDI. We derive analytical models for their coupling to the second-generation TDI Michelson combinations and verify these models numerically. Furthermore, we derive a compensation scheme for onboard optical path lengths in TDI and validate its performance via numerical simulations.


title: A collection of cancellative, right LCM, not group-embeddable monoids

abstract: By classical results of Malcev, cancellative monoids need not be group-embeddable. In this paper, we describe and give presentations for and study an infinite family $\mathcal{M}_n$ of cancellative monoids which are not group-embeddable, originating from Malcev's original work. We show that $\mathcal{M}_n$ is right LCM for $n \geq 2$, owing to applications in the study of $\mathrm{C}^*$-algebras by Brix, Bruce and Dor-On. We finish by showing that $\mathcal{M}_1$ is not right LCM, but is $2$-aligned.


title: Well-posedness of Hibler's parabolic-hyperbolic sea ice model

abstract: This paper proves the local-in-time strong well-posedness of a parabolic-hyperbolic regularized version of Hibler's sea ice model. The latter model is the most frequently used sea ice model in climate science. Lagrangian coordinates are employed to handle the hyperbolic terms in the balance laws. The resulting problem is regarded as a quasilinear non-autonomous evolution equation. Maximal $\mathrm{L}^p$-regularity of the underlying linearized problem is obtained on an anisotropic ground space in order to deal with the lack of regularization in the balance laws.


title: Generation planning and operation under power stability constraints: A Hydro-Quebec use case

abstract: Hydro-Quebec (HQ) is a vertically integrated utility that produces, transmits, and distributes most of the electricity in the province of Quebec. The power grid it operates has a particular architecture created by large hydroelectric dams located far north and the extensive 735kV transmission grid that allows the generated power to reach the majority of the load located thousands of kilometers away in the southern region of Quebec. The specificity of the grid has led HQ to develop monitoring tools responsible for generating so-called stability limits. Those stability limits take into account several nonlinear phenomena such as angular stability, frequency stability, or voltage stability. Since generation planning and operation tools rely mostly on mixed integer linear programming formulation, HQ had to adapt its tools to integrate stability limits into them. This paper presents the challenges it faced, especially considering its reserve monitoring tool and unit commitment tool.


title: Unified Explanations in Machine Learning Models: A Perturbation Approach

abstract: A high-velocity paradigm shift towards Explainable Artificial Intelligence (XAI) has emerged in recent years. Highly complex Machine Learning (ML) models have flourished in many tasks of intelligence, and the questions have started to shift away from traditional metrics of validity towards something deeper: What is this model telling me about my data, and how is it arriving at these conclusions? Inconsistencies between XAI and modeling techniques can have the undesirable effect of casting doubt upon the efficacy of these explainability approaches. To address these problems, we propose a systematic, perturbation-based analysis against a popular, model-agnostic method in XAI, SHapley Additive exPlanations (Shap). We devise algorithms to generate relative feature importance in settings of dynamic inference amongst a suite of popular machine learning and deep learning methods, and metrics that allow us to quantify how well explanations generated under the static case hold. We propose a taxonomy for feature importance methodology, measure alignment, and observe quantifiable similarity amongst explanation models across several datasets.


title: Control of the local and nonlocal electromagnetic response in all-dielectric reconfigurable metasurfaces

abstract: Reconfigurable metasurfaces are potent platforms to control the propagation properties of light dynamically. Among different reconfiguration mechanisms available at optical frequencies, using non-volatile phase change materials is one of the most prominent. Tuning the refractive index of these materials, and thus changing the electromagnetic response of the device, can be achieved by external modulation that enables the transition between their amorphous and crystalline structural states. In this work, we study a structure that exploits these materials to fully control the electromagnetic response, i.e., electric, magnetic, and electromagnetic coupling. Powered by this controllability, we present how the metasurface can be designed to perform beam steering and switchable one-way absorption applications. In addition, we demonstrate that the same platform can be designed to work in a nonlocal regime to implement a more efficient way of controlling light.


title: One QuantLLM for ALL: Fine-tuning Quantized LLMs Once for Efficient Deployments

abstract: Large Language Models (LLMs) have advanced rapidly but face significant memory demands. While quantization has shown promise for LLMs, current methods typically require lengthy training to alleviate the performance degradation from quantization loss. However, deploying LLMs across diverse scenarios with different resource constraints, e.g., servers and personal computers, requires repeated training per application, which amplifies the lengthy training problem. Given that, it is advantageous to train a once-for-all (OFA) supernet capable of yielding diverse optimal subnets for downstream applications through one-shot training. Nonetheless, the scale of current language models impedes efficiency and amplifies interference from weight sharing between subnets. We make an initial attempt to extend the once-for-all framework to large language models. Specifically, we decouple shared weights to eliminate the interference and incorporate Low-Rank adapters for training efficiency. Furthermore, we observe the imbalance allocation of training resources from the traditional uniform sampling. A non-parametric scheduler is introduced to adjust the sampling rate for each quantization configuration, achieving a more balanced allocation among subnets with varying demands. We validate the approach on LLaMA2 families, and downstream evaluation confirms our ability to maintain high performance while significantly reducing deployment time faced with multiple scenarios.


title: The development of drug resistance in metastatic tumours under chemotherapy: an evolutionary perspective

abstract: We present a mathematical model of the evolutionary dynamics of a metastatic tumour under chemotherapy, comprising non-local partial differential equations for the phenotype-structured cell populations in the primary tumour and its metastasis. These equations are coupled with a physiologically-based pharmacokinetic model of drug delivery, implementing a realistic delivery schedule. The model is carefully calibrated from the literature, focusing on BRAF-mutated melanoma treated with Dabrafenib as a case study. By means of long-time asymptotic analysis, global sensitivity analysis and numerical simulations, we explore the impact of cell migration from the primary to the metastatic site, physiological aspects of the tumour sites and drug dose on the development of drug resistance and treatment efficacy. Our findings provide a possible explanation for empirical evidence indicating that chemotherapy may foster metastatic spread and that metastatic sites may be less impacted by chemotherapy.


title: Jina CLIP: Your CLIP Model Is Also Your Text Retriever

abstract: Contrastive Language-Image Pretraining (CLIP) is widely used to train models to align images and texts in a common embedding space by mapping them to fixed-sized vectors. These models are key to multimodal information retrieval and related tasks. However, CLIP models generally underperform in text-only tasks compared to specialized text models. This creates inefficiencies for information retrieval systems that keep separate embeddings and models for text-only and multimodal tasks. We propose a novel, multi-task contrastive training method to address this issue, which we use to train the jina-clip-v1 model to achieve the state-of-the-art performance on both text-image and text-text retrieval tasks.


title: Cavity-Enhanced Emission and Absorption of Color Centers in a Diamond Membrane With Selectable Strain

abstract: Group IV color centers in diamond are among the most promising optically active spin systems with strong optical transitions and long spin coherences. The ground-state splitting of the center is particularly important to suppress the interaction with coherence-limiting phonons, which improves the coherence properties and sets the upper limit for the operating temperature. Negatively charged silicon-vacancy centers have an ordinary ground-state splitting of only 48GHz, resulting in required temperatures below one Kelvin, which can only be achieved by dilution refrigerators. Here, we increase the ground-state splitting by up to an order of magnitude by induced strain in a single-crystal diamond membrane. Furthermore, we demonstrate cavity-assisted spectroscopy enabled by coupling the emitter ensemble with a selectable strain to the mode of a Fabry-Perot microcavity. Calculation of the absorption cross-section yields $\sigma_{ens} = $4.9*10^-11 cm^2. Together with the Purcell-enhanced twofold reduction in emitter lifetime below 1ns, this makes the system a promising spin-photon interface at moderate temperatures of 4K.


title: Measurements of jet cross-section ratios in 13 TeV proton--proton collisions with ATLAS

abstract: Measurements of jet cross-section ratios between inclusive bins of jet multiplicity are performed in 140 fb$^{-1}$ of proton--proton collisions with $\sqrt{s}=13$ TeV center-of-mass energy, recorded with the ATLAS detector at CERN's Large Hadron Collider. Observables that are sensitive the energy-scale and angular distribution of radiation due to the strong interaction in the final state are measured double-differentially, in bins of jet multiplicity, and are unfolded to account for acceptance and detector-related effects. Additionally, the scalar sum of the two leading jets' transverse momenta is measured triple-differentially, in bins of the third jet's transverse momentum as well as bins of jet multiplicity. The measured distributions are used to construct ratios of the inclusive jet-multiplicity bins, which have been shown to be sensitive to the strong coupling $\alpha_{\textrm S}$ while being less sensitive than other observables to systematic uncertainties and parton distribution functions. The measured distributions are compared with state-of-the-art QCD calculations, including next-to-next-to-leading-order predictions. Studies leading to reduced jet energy scale uncertainties significantly improve the precision of this work, and are documented herein.


title: The energy shear of protohaloes

abstract: As it collapses to form a halo, the shape of a protohalo patch is deformed by the initial shear field. This deformation is often modeled using the "deformation" tensor, constructed from second derivatives of the gravitational potential, whose trace gives the initial overdensity. However, especially for lower mass protohalos, this matrix is not always positive definite: one of its eigenvalues has a different sign from the others. We show that the evolution of a patch is better described by the "energy shear" tensor, which is positive definite and plays a direct role in the evolution. This positive-definiteness simplifies models of halo abundances, assembly and of the cosmic web.


title: Proper time path integrals for gravitational waves: an improved wave optics framework

abstract: When gravitational waves travel from their source to an observer, they interact with matter structures along their path, causing distinct deformations in their waveforms. In this study we introduce a novel theoretical framework for wave optics effects in gravitational lensing, addressing the limitations of existing approaches. We achieve this by incorporating the proper time technique, typically used in field theory studies, into gravitational lensing. This approach allows us to extend the standard formalism beyond the eikonal and paraxial approximations, which are traditionally assumed, and to account for polarization effects, which are typically neglected in the literature. We demonstrate that our method provides a robust generalization of conventional approaches, including them as special cases. Our findings enhance our understanding of gravitational wave propagation, which is crucial for accurately interpreting gravitational wave observations and extracting unbiased information about the lenses from the gravitational wave waveforms.


title: Lasso-based state estimation for cyber-physical systems under sensor attacks

abstract: The development of algorithms for secure state estimation in vulnerable cyber-physical systems has been gaining attention in the last years. A consolidated assumption is that an adversary can tamper a relatively small number of sensors. In the literature, block-sparsity methods exploit this prior information to recover the attack locations and the state of the system. In this paper, we propose an alternative, Lasso-based approach and we analyse its effectiveness. In particular, we theoretically derive conditions that guarantee successful attack/state recovery, independently of established time sparsity patterns. Furthermore, we develop a sparse state observer, by starting from the iterative soft thresholding algorithm for Lasso, to perform online estimation. Through several numerical experiments, we compare the proposed methods to the state-of-the-art algorithms.


title: The unexpected uses of a bowling pin: anisotropic flow in fixed-target $^{208}$Pb+$^{20}$Ne collisions as a probe of quark-gluon plasma

abstract: The System for Measuring Overlap with Gas (SMOG2) at the LHCb detector enables the study of fixed-target ion-ion collisions at relativistic energies ($\sqrt{s_{\rm NN}}\sim100$ GeV in the centre-of-mass). With input from \textit{ab initio} calculations of the structure of $^{16}$O and $^{20}$Ne, we compute 3+1D hydrodynamic predictions for the anisotropic flow of Pb+Ne and Pb+O collisions, to be tested with upcoming LHCb data. This will allow the detailed study of quark-gluon plasma (QGP) formation as well as experimental tests of the predicted nuclear shapes. Elliptic flow ($v_2$) in Pb+Ne collisions is greatly enhanced compared to the Pb+O baseline due to the shape of $^{20}$Ne, which is deformed in a bowling-pin geometry. Owing to the large $^{208}$Pb radius, this effect is seen in a broad centrality range, a unique feature of this collision configuration. Larger elliptic flow further enhances the quadrangular flow ($v_4$) of Pb+Ne collisions via non-linear coupling, and impacts the sign of the kurtosis of the elliptic flow vector distribution ($c_2\{4\}$). Exploiting the shape of $^{20}$Ne proves thus an ideal method to investigate the formation of QGP in fixed-target experiments at LHCb, and demonstrates the power of SMOG2 as a tool to image nuclear ground states.


title: Low-rank and sparse approximations for contact mechanics

abstract: (Rephrased) Non-conformance decision-making processes in high-precision manufacturing of engineering structures are often delayed due to numerical simulations that are needed for analyzing the defective parts and assemblies. Interfaces between parts of assemblies can only be simulated using the modeling of contact. Thus, efficient parametric ROMs are necessary for performing contact mechanics simulations in near real-time scenarios. Typical strategies for reducing the cost of contact models use low-rank approximations. Assumptions include the existence of a low-dimensional subspace for displacement and a low-dimensional non-negative subcone for contact pressure. However, the contact pressure exhibits a local nature, as the position of contact can vary with parameters like loading or geometry. The adequacy of low-rank approximations for contact mechanics is investigated and alternative routes based on sparse regression techniques are explored. It is shown that the local nature leads to loss of linear separability of contact pressure, thereby limiting the accuracy of low-rank methods. The applicability of the low-rank assumption to contact pressure is analyzed using 3 different criteria: compactness, generalization and specificity. Subsequently, over-complete dictionaries with a large number of snapshots to mitigate the inseparability issues is investigated. Two strategies are devised: a greedy active-set method where the dictionary elements are selected greedily and a convex hull approximation method that eliminates the necessity of explicitly enforcing non-penetration constraints in convex problems. Lastly, Dynamic Time Warping is studied as a possible non-linear interpolation method that permits the exploration of the non-linear manifoldm synthesising snapshots not computed in the training set with low complexity; reducing the offline costs.


title: Filter Design for Estimation of Stellar Metallicity: Insights from Experiments with Gaia XP Spectra

abstract: We search for an optimal filter design for the estimation of stellar metallicity, based on synthetic photometry from Gaia XP spectra convolved with a series of filter-transmission curves defined by different central wavelengths and bandwidths. Unlike previous designs based solely on maximizing metallicity sensitivity, we find that the optimal solution provides a balance between the sensitivity and uncertainty of the spectra. With this optimal filter design, the best precision of metallicity estimates for relatively bright ($G \sim 11.5$) stars is excellent, $\sigma_{\rm [Fe/H]} = 0.034$\,dex for FGK dwarf stars, superior to that obtained utilizing custom sensitivity-optimized filters (e.g., SkyMapper\,$v$). By selecting hundreds of high-probabability member stars of the open cluster M67, our analysis reveals that the intrinsic photometric-metallicity scatter of these cluster members is only 0.036\,dex, consistent with this level of precision. Our results clearly demonstrate that the internal precision of photometric-metallicity estimates can be extremely high, even providing the opportunity to perform chemical tagging for very large numbers of field stars in the Milky Way. This experiment shows that it is crucial to take into account uncertainty alongside the sensitivity when designing filters for measuring the stellar metallicity and other parameters.


title: PostDoc: Generating Poster from a Long Multimodal Document Using Deep Submodular Optimization

abstract: A poster from a long input document can be considered as a one-page easy-to-read multimodal (text and images) summary presented on a nice template with good design elements. Automatic transformation of a long document into a poster is a very less studied but challenging task. It involves content summarization of the input document followed by template generation and harmonization. In this work, we propose a novel deep submodular function which can be trained on ground truth summaries to extract multimodal content from the document and explicitly ensures good coverage, diversity and alignment of text and images. Then, we use an LLM based paraphraser and propose to generate a template with various design aspects conditioned on the input content. We show the merits of our approach through extensive automated and human evaluations.


title: On limit models and parametrized noetherian rings

abstract: We study limit models in the abstract elementary class of modules with embeddings as algebraic objects. We characterize parametrized noetherian rings using the degree of injectivity of certain limit models. We show that the number of limit models and how close a ring is from being noetherian are inversely proportional. $\textbf{Theorem.}$ Let $n \geq 0$ The following are equivalent. 1. $R$ is left $(<\aleph_{n } )$-noetherian but not left $(< \aleph_{n -1 })$-noetherian. 2.The abstract elementary class of modules with embeddings has exactly $n +1$ non-isomorphic $\lambda$-limit models for every $\lambda \geq (\operatorname{card}(R) + \aleph_0)^+$ such that the class is stable in $\lambda$. We further show that there are rings such that the abstract elementary class of modules with embeddings has exactly $\kappa$ non-isomorphic $\lambda$-limit models for every infinite cardinal $\kappa$.


title: TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models

abstract: Mainstream approaches to aligning large language models (LLMs) heavily rely on human preference data, particularly when models require periodic updates. The standard process for iterative alignment of LLMs involves collecting new human feedback for each update. However, the data collection process is costly and challenging to scale. To address this issue, we introduce the "TS-Align" framework, which fine-tunes a policy model using pairwise feedback data automatically mined from its outputs. This automatic mining process is efficiently accomplished through the collaboration between a large-scale teacher model and a small-scale student model. The policy fine-tuning process can be iteratively repeated using on-policy generations within our proposed teacher-student collaborative framework. Through extensive experiments, we demonstrate that our final aligned policy outperforms the base policy model with an average win rate of 69.7% across seven conversational or instruction-following datasets. Furthermore, we show that the ranking capability of the teacher is effectively distilled into the student through our pipeline, resulting in a small-scale yet effective reward model for policy model alignment.


title: Boost Your Own Human Image Generation Model via Direct Preference Optimization with AI Feedback

abstract: The generation of high-quality human images through text-to-image (T2I) methods is a significant yet challenging task. Distinct from general image generation, human image synthesis must satisfy stringent criteria related to human pose, anatomy, and alignment with textual prompts, making it particularly difficult to achieve realistic results. Recent advancements in T2I generation based on diffusion models have shown promise, yet challenges remain in meeting human-specific preferences. In this paper, we introduce a novel approach tailored specifically for human image generation utilizing Direct Preference Optimization (DPO). Specifically, we introduce an efficient method for constructing a specialized DPO dataset for training human image generation models without the need for costly human feedback. We also propose a modified loss function that enhances the DPO training process by minimizing artifacts and improving image fidelity. Our method demonstrates its versatility and effectiveness in generating human images, including personalized text-to-image generation. Through comprehensive evaluations, we show that our approach significantly advances the state of human image generation, achieving superior results in terms of natural anatomies, poses, and text-image alignment.


title: Data-efficient fine-tuning of foundational models for first-principles quality sublimation enthalpies

abstract: Calculating sublimation enthalpies of molecular crystal polymorphs is relevant to a wide range of technological applications. However, predicting these quantities at first-principles accuracy -- even with the aid of machine learning potentials -- is a challenge that requires sub-kJ/mol accuracy in the potential energy surface and finite-temperature sampling. We present an accurate and data-efficient protocol based on fine-tuning of the foundational MACE-MP-0 model and showcase its capabilities on sublimation enthalpies and physical properties of ice polymorphs. Our approach requires only a few tens of training structures to achieve sub-kJ/mol accuracy in the sublimation enthalpies and sub 1 % error in densities for polymorphs at finite temperature and pressure. Exploiting this data efficiency, we explore simulations of hexagonal ice at the random phase approximation level of theory at experimental temperatures and pressures, calculating its physical properties, like pair correlation function and density, with good agreement with experiments. Our approach provides a way forward for predicting the stability of molecular crystals at finite thermodynamic conditions with the accuracy of correlated electronic structure theory.


title: ESG-FTSE: A corpus of news articles with ESG relevance labels and use cases

abstract: We present ESG-FTSE, the first corpus comprised of news articles with Environmental, Social and Governance (ESG) relevance annotations. In recent years, investors and regulators have pushed ESG investing to the mainstream due to the urgency of climate change. This has led to the rise of ESG scores to evaluate an investment's credentials as socially responsible. While demand for ESG scores is high, their quality varies wildly. Quantitative techniques can be applied to improve ESG scores, thus, responsible investing. To contribute to resource building for ESG and financial text mining, we pioneer the ESG-FTSE corpus. We further present the first of its kind ESG annotation schema. It has three levels: a binary classification (relevant versus irrelevant news articles), ESG classification (ESG-related news articles), and target company. Both supervised and unsupervised learning experiments for ESG relevance detection were conducted to demonstrate that the corpus can be used in different settings to derive accurate ESG predictions. Keywords: corpus annotation, ESG labels, annotation schema, news article, natural language processing


title: System Identification for Lithium-Ion Batteries with Nonlinear Coupled Electro-Thermal Dynamics via Bayesian Optimization

abstract: Essential to various practical applications of lithium-ion batteries is the availability of accurate equivalent circuit models. This paper presents a new coupled electro-thermal model for batteries and studies how to extract it from data. We consider the problem of maximum likelihood parameter estimation, which, however, is nontrivial to solve as the model is nonlinear in both its dynamics and measurement. We propose to leverage the Bayesian optimization approach, owing to its machine learning-driven capability in handling complex optimization problems and searching for global optima. To enhance the parameter search efficiency, we dynamically narrow and refine the search space in Bayesian optimization. The proposed system identification approach can efficiently determine the parameters of the coupled electro-thermal model. It is amenable to practical implementation, with few requirements on the experiment, data types, and optimization setups, and well applicable to many other battery models.


title: BeerReview: A Blockchain-enabled Peer Review Platform

abstract: In an era of increasing concerns over intellectual property rights, traditional peer review systems face challenges including plagiarism, malicious attacks, and unauthorized data access. BeerReview, a blockchain-enabled peer review platform, offers a robust solution, enabling experts and scholars to participate actively in the review process without concerns about plagiarism or security threats. Following the completion of its alpha testing, BeerReview demonstrates the potential for expanded deployment. This platform offers improved convenience and more robust intellectual property protection within the peer review process with open source initiative.


title: On the generalization of the study of a letter power substitution on modulo-recurrent words

abstract: Let us consider an infinite word and $k\geq 1$ an integer. By steps of $k$, we substitute a letter ofthis infinite word by the power of an external letter. The new word obtaining by this process is called $k$ to $k$ substitution of a power letter. After the application of this new notion on modulo-reccurent words and in particular on Sturmian words. We establish the complexity function of those words.


title: MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model

abstract: We present MOFA-Video, an advanced controllable image animation method that generates video from the given image using various additional controllable signals (such as human landmarks reference, manual trajectories, and another even provided video) or their combinations. This is different from previous methods which only can work on a specific motion domain or show weak control abilities with diffusion prior. To achieve our goal, we design several domain-aware motion field adapters (\ie, MOFA-Adapters) to control the generated motions in the video generation pipeline. For MOFA-Adapters, we consider the temporal motion consistency of the video and generate the dense motion flow from the given sparse control conditions first, and then, the multi-scale features of the given image are wrapped as a guided feature for stable video diffusion generation. We naively train two motion adapters for the manual trajectories and the human landmarks individually since they both contain sparse information about the control. After training, the MOFA-Adapters in different domains can also work together for more controllable video generation. Project Page: https://myniuuu.github.io/MOFA_Video/


title: Astrophysical aspects of $^{12}$C$(p,{\gamma})^{13}$N reaction

abstract: The Carbon-Nitrogen-Oxygen (CNO) cycle is fundamental to the process of hydrogen burning in stars, serving as a pivotal mechanism. At its core, the primary reaction involves the radiative capture of a proton by $^{12}$C, crucially influencing the isotopic ratio of $^{12}$C to $^{13}$C observed in celestial bodies, including our Solar System. We have addressed this reaction mechanism by extrapolating to low-energy cross sections and S-factors with the aid of astrophysical R-matrix. Our investigation aims to shed light on its implications for nuclear reaction rates, thus influencing the abundance ratio of $^{12}$C to $^{13}$C in the cosmic environment.


title: EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Images

abstract: 3D Gaussian Splatting (3D-GS) has demonstrated exceptional capabilities in 3D scene reconstruction and novel view synthesis. However, its training heavily depends on high-quality, sharp images and accurate camera poses. Fulfilling these requirements can be challenging in non-ideal real-world scenarios, where motion-blurred images are commonly encountered in high-speed moving cameras or low-light environments that require long exposure times. To address these challenges, we introduce Event Stream Assisted Gaussian Splatting (EvaGaussians), a novel approach that integrates event streams captured by an event camera to assist in reconstructing high-quality 3D-GS from blurry images. Capitalizing on the high temporal resolution and dynamic range offered by the event camera, we leverage the event streams to explicitly model the formation process of motion-blurred images and guide the deblurring reconstruction of 3D-GS. By jointly optimizing the 3D-GS parameters and recovering camera motion trajectories during the exposure time, our method can robustly facilitate the acquisition of high-fidelity novel views with intricate texture details. We comprehensively evaluated our method and compared it with previous state-of-the-art deblurring rendering methods. Both qualitative and quantitative comparisons demonstrate that our method surpasses existing techniques in restoring fine details from blurry images and producing high-fidelity novel views.


title: Novel oracle constructions for quantum random access memory

abstract: We present new designs for quantum random access memory. More precisely, for each function, $f : \mathbb{F}_2^n \rightarrow \mathbb{F}_2^d$, we construct oracles, $\mathcal{O}_f$, with the property \begin{equation} \mathcal{O}_f \left| x \right\rangle_n \left| 0 \right\rangle_d = \left| x \right\rangle_n \left| f(x) \right\rangle_d. \end{equation} Our methods are based on the Walsh-Hadamard Transform of $f$, viewed as an integer valued function. In general, the complexity of our method scales with the sparsity of the Walsh-Hadamard Transform and not the sparsity of $f$, yielding more favorable constructions in cases such as binary optimization problems and function with low-degree Walsh-Hadamard Transforms. Furthermore, our design comes with a tuneable amount of ancillas that can trade depth for size. In the ancilla-free design, these oracles can be $\epsilon$-approximated so that the Clifford + $T$ depth is $O \left( \left( n + \log_2 \left( \tfrac{d}{\epsilon} \right) \right) \mathcal{W}_f \right)$, where $\mathcal{W}_f$ is the number of nonzero components in the Walsh-Hadamard Transform. The depth of the shallowest version is $O \left( n + \log_2 \left( \tfrac{d}{\epsilon} \right) \right)$, using $n + d \mathcal{W}_f$ qubit. The connectivity of these circuits is also only logarithmic in $\mathcal{W}_f$. As an application, we show that for boolean functions with low approximate degrees (as in the case of read-once formulas) the complexities of the corresponding QRAM oracles scale only as $2^{\widetilde{O} \left( \sqrt{n} \log_2 \left( n \right) \right)}$.


title: High-order Van Hove singularities and their connection to flat bands

abstract: The flattening of single-particle band structures plays an important role in the quest for novel quantum states of matter due to the crucial role of interactions. Recent advances in theory and experiment made it possible to construct and tune systems with nearly flat bands, ranging from graphene multilayers and moire' materials to kagome' metals and ruthenates. While theoretical models predict exactly flat bands under certain ideal conditions, evidence was provided that these systems host high-order Van Hove points, i.e., points of high local band flatness and power-law divergence in energy of the density of states. In this review, we examine recent developments in engineering and realising such weakly dispersive bands. We focus on high-order Van Hove singularities and explore their connection to exactly flat bands. We provide classification schemes and discuss interaction effects. We also review experimental evidence for high-order Van Hove singularities and point out future research directions.

categories: cond-mat.str-el cond-mat.mtrl-sci cond-mat.supr-con math-ph math.MP


title: Lopsided Elastic Dumbbell Suspension

abstract: We derive the constitutive equation for a suspension of lopsided Hookean dumbbells. By lopsided, we mean that one bead is larger than the other. We find that all results derived for symmetric Hookean dumbbells can be taken over for lopsided ones by replacing$ \frac{2}{\zeta}$ with $\frac{1}{\zeta_1}+\frac{1}{\zeta_2}$, where ${\zeta}$, ${\zeta}_1$ and ${\zeta}_2$ are the bead friction coefficients for the symmetric dumbbell beads, and the first and second beads of the lopsided dumbbell respectively.


title: Love-C relations for elastic hybrid stars

abstract: Neutron stars (NSs) provide a unique laboratory to study matter under extreme densities. Recent observations from gravitational and electromagnetic waves have enabled constraints on NS properties, such as tidal deformability (related to the tidal Love number) and stellar compactness. Although each of these two NS observables depends strongly on the stellar internal structure, the relation between them (called the Love-C relation) is known to be equation-of-state insensitive. In this study, we investigate the effects of a possible crystalline phase in the core of hybrid stars (HSs) on the mass-radius and Love-C relations, where HSs are a subclass of NS models with a quark matter core and a nuclear matter envelope with a sharp phase transition in between. We find that both the maximum mass and the corresponding radius increase as one increases the stiffness of the quark matter core controlled by the speed of sound, while the density discontinuity at the nuclear-quark matter transition effectively softens the equations of state. Deviations of the Love-C relation for elastic HSs from that of fluid NSs become more pronounced with a larger shear modulus, lower transition pressure, and larger density gap and can be as large as 60%. These findings suggest a potential method for testing the existence of distinct phases within HSs, though deviations are not large enough to be detected with current measurements of the tidal deformability and compactness.


title: Positivity and universal Pl\"ucker coordinates for spaces of quasi-exponentials

abstract: A quasi-exponential is an entire function of the form $e^{cu}p(u)$, where $p(u)$ is a polynomial and $c \in \mathbb{C}$. Let $V = \langle e^{h_1u}p_1(u), \dots, e^{h_Nu}p_N(u) \rangle$ be a vector space with a basis of quasi-exponentials. We show that if $h_1, \dots, h_N$ are nonnegative and all of the complex zeros of the Wronskian $\operatorname{Wr}(V)$ are real, then $V$ is totally nonnegative in the sense that all of its Grassmann-Pl\"{u}cker coordinates defined by the Taylor expansion about $u=t$ are nonnegative, for any real $t$ greater than all of the zeros of $\operatorname{Wr}(V)$. Our proof proceeds by showing that the higher Gaudin Hamiltonians $T_\lambda^G(t)$ introduced in [ALTZ14] are universal Pl\"ucker coordinates about $u=t$ for the Wronski map on spaces of quasi-exponentials. The result that $V$ is totally nonnegative follows from the fact that $T_\lambda^G(t)$ is positive semidefinite, which we establish using partial traces. We also show that if $h_1 = \cdots = h_N = 0$ then $T_\lambda^G(t)$ equals $\beta^\lambda(t)$, which is the universal Pl\"ucker coordinate for the Wronski map on spaces of polynomials introduced in [KP23].


title: Feature Fusion for Improved Classification: Combining Dempster-Shafer Theory and Multiple CNN Architectures

abstract: Addressing uncertainty in Deep Learning (DL) is essential, as it enables the development of models that can make reliable predictions and informed decisions in complex, real-world environments where data may be incomplete or ambiguous. This paper introduces a novel algorithm leveraging Dempster-Shafer Theory (DST) to integrate multiple pre-trained models to form an ensemble capable of providing more reliable and enhanced classifications. The main steps of the proposed method include feature extraction, mass function calculation, fusion, and expected utility calculation. Several experiments have been conducted on CIFAR-10 and CIFAR-100 datasets, demonstrating superior classification accuracy of the proposed DST-based method, achieving improvements of 5.4% and 8.4%, respectively, compared to the best individual pre-trained models. Results highlight the potential of DST as a robust framework for managing uncertainties related to data when applying DL in real-world scenarios.


title: The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof

abstract: Many algorithms and observed phenomena in deep learning appear to be affected by parameter symmetries -- transformations of neural network parameters that do not change the underlying neural network function. These include linear mode connectivity, model merging, Bayesian neural network inference, metanetworks, and several other characteristics of optimization or loss-landscapes. However, theoretical analysis of the relationship between parameter space symmetries and these phenomena is difficult. In this work, we empirically investigate the impact of neural parameter symmetries by introducing new neural network architectures that have reduced parameter space symmetries. We develop two methods, with some provable guarantees, of modifying standard neural networks to reduce parameter space symmetries. With these new methods, we conduct a comprehensive experimental study consisting of multiple tasks aimed at assessing the effect of removing parameter symmetries. Our experiments reveal several interesting observations on the empirical impact of parameter symmetries; for instance, we observe linear mode connectivity between our networks without alignment of weight spaces, and we find that our networks allow for faster and more effective Bayesian neural network training.


title: Distributed maze exploration using multiple agents and optimal goal assignment

abstract: Robotic exploration has long captivated researchers aiming to map complex environments efficiently. Techniques such as potential fields and frontier exploration have traditionally been employed in this pursuit, primarily focusing on solitary agents. Recent advancements have shifted towards optimizing exploration efficiency through multiagent systems. However, many existing approaches overlook critical real-world factors, such as broadcast range limitations, communication costs, and coverage overlap. This paper addresses these gaps by proposing a distributed maze exploration strategy (CU-LVP) that assumes constrained broadcast ranges and utilizes Voronoi diagrams for better area partitioning. By adapting traditional multiagent methods to distributed environments with limited broadcast ranges, this study evaluates their performance across diverse maze topologies, demonstrating the efficacy and practical applicability of the proposed method. The code and experimental results supporting this study are available in the following repository: https://github.com/manouslinard/multiagent-exploration/.


title: Grokfast: Accelerated Grokking by Amplifying Slow Gradients

abstract: One puzzling artifact in machine learning dubbed grokking is where delayed generalization is achieved tenfolds of iterations after near perfect overfitting to the training data. Focusing on the long delay itself on behalf of machine learning practitioners, our goal is to accelerate generalization of a model under grokking phenomenon. By regarding a series of gradients of a parameter over training iterations as a random signal over time, we can spectrally decompose the parameter trajectories under gradient descent into two components: the fast-varying, overfitting-yielding component and the slow-varying, generalization-inducing component. This analysis allows us to accelerate the grokking phenomenon more than $\times 50$ with only a few lines of code that amplifies the slow-varying components of gradients. The experiments show that our algorithm applies to diverse tasks involving images, languages, and graphs, enabling practical availability of this peculiar artifact of sudden generalization. Our code is available at https://github.com/ironjr/grokfast.


title: Context Injection Attacks on Large Language Models

abstract: Large Language Models (LLMs) such as ChatGPT and Llama-2 have become prevalent in real-world applications, exhibiting impressive text generation performance. LLMs are fundamentally developed from a scenario where the input data remains static and lacks a clear structure. To behave interactively over time, LLM-based chat systems must integrate additional contextual information (i.e., chat history) into their inputs, following a pre-defined structure. This paper identifies how such integration can expose LLMs to misleading context from untrusted sources and fail to differentiate between system and user inputs, allowing users to inject context. We present a systematic methodology for conducting context injection attacks aimed at eliciting disallowed responses by introducing fabricated context. This could lead to illegal actions, inappropriate content, or technology misuse. Our context fabrication strategies, acceptance elicitation and word anonymization, effectively create misleading contexts that can be structured with attacker-customized prompt templates, achieving injection through malicious user messages. Comprehensive evaluations on real-world LLMs such as ChatGPT and Llama-2 confirm the efficacy of the proposed attack with success rates reaching 97%. We also discuss potential countermeasures that can be adopted for attack detection and developing more secure models. Our findings provide insights into the challenges associated with the real-world deployment of LLMs for interactive and structured data scenarios.


title: Generalized Cluster Correlation Expansion theory for STIRAP processes in the presence of a spin bath

abstract: The Stimulated Raman Adiabatic Passage (STIRAP) is applied to a system coupled to a bath made of fully-interacting two-level systems, whose dynamics is studied exploiting the generalized Cluster Correlation Expansion (gCCE) theory. We specialize our analysis to a negatively charged silicon vacancy (SiV-1) in non-purified 4H-SiC to assess the possibility of transferring population between two states of the ground manifold, also taking into account the interaction with a spherical nuclear spin bath formed by nuclei of 29Si and 13C. For this system, it is demonstrated that the presence of a small/medium sized bath has no effect on the protocol, finding in particular a set of parameter values for an efficient STIRAP process.


title: Disentangling and Mitigating the Impact of Task Similarity for Continual Learning

abstract: Continual learning of partially similar tasks poses a challenge for artificial neural networks, as task similarity presents both an opportunity for knowledge transfer and a risk of interference and catastrophic forgetting. However, it remains unclear how task similarity in input features and readout patterns influences knowledge transfer and forgetting, as well as how they interact with common algorithms for continual learning. Here, we develop a linear teacher-student model with latent structure and show analytically that high input feature similarity coupled with low readout similarity is catastrophic for both knowledge transfer and retention. Conversely, the opposite scenario is relatively benign. Our analysis further reveals that task-dependent activity gating improves knowledge retention at the expense of transfer, while task-dependent plasticity gating does not affect either retention or transfer performance at the over-parameterized limit. In contrast, weight regularization based on the Fisher information metric significantly improves retention, regardless of task similarity, without compromising transfer performance. Nevertheless, its diagonal approximation and regularization in the Euclidean space are much less robust against task similarity. We demonstrate consistent results in a permuted MNIST task with latent variables. Overall, this work provides insights into when continual learning is difficult and how to mitigate it.


title: Training-efficient density quantum machine learning

abstract: Quantum machine learning requires powerful, flexible and efficiently trainable models to be successful in solving challenging problems. In this work, we present density quantum neural networks, a learning model incorporating randomisation over a set of trainable unitaries. These models generalise quantum neural networks using parameterised quantum circuits, and allow a trade-off between expressibility and efficient trainability, particularly on quantum hardware. We demonstrate the flexibility of the formalism by applying it to two recently proposed model families. The first are commuting-block quantum neural networks (QNNs) which are efficiently trainable but may be limited in expressibility. The second are orthogonal (Hamming-weight preserving) quantum neural networks which provide well-defined and interpretable transformations on data but are challenging to train at scale on quantum devices. Density commuting QNNs improve capacity with minimal gradient complexity overhead, and density orthogonal neural networks admit a quadratic-to-constant gradient query advantage with minimal to no performance loss. We conduct numerical experiments on synthetic translationally invariant data and MNIST image data with hyperparameter optimisation to support our findings. Finally, we discuss the connection to post-variational quantum neural networks, measurement-based quantum machine learning and the dropout mechanism.


title: A relativistic statistical field theory on a discretized Minkowski lattice with quantum-like observables

abstract: A relativistic statistical field theory is constructed for a fluctuating complex-valued scalar field on a discretized Minkowski lattice. A Hilbert space of observables is then constructed from functionals of the fluctuating complex-valued scalar field with an inner product defined in terms of expectation values of the functionals. A bosonic Fock space is then constructed from the Hilbert space and creation and annihilation operators that act on the Fock space are defined. The creation and annihilation operators are used to define field operators. These field operators have some interesting quantum-like properties. For example, the field operators do not commute in general and, in the particular case of the free field theory, can be shown to satisfy the microcausality condition.


title: BEAST DB: Grand-Canonical Database of Electrocatalyst Properties

abstract: We present BEAST DB, an open-source database comprised of ab initio electrochemical data computed using grand-canonical density functional theory in implicit solvent at consistent calculation parameters. The database contains over 20,000 surface calculations and covers a broad set of heterogeneous catalyst materials and electrochemical reactions. Calculations were performed at self-consistent fixed potential as well as constant charge to facilitate comparisons to the computational hydrogen electrode. This article presents common use cases of the database to rationalize trends in catalyst activity, screen catalyst material spaces, understand elementary mechanistic steps, analyze electronic structure, and train machine learning models to predict higher fidelity properties. Users can interact graphically with the database by querying for individual calculations to gain granular understanding of reaction steps or by querying for an entire reaction pathway on a given material using an interactive reaction pathway tool. BEAST DB will be periodically updated, with planned future updates to include advanced electronic structure data, surface speciation studies, and greater reaction coverage.


title: Alleviating the $H_0$ and $\sigma_8$ tensions in the interacting cubic covariant Galileon model

abstract: The interaction between dark matter and dark energy has become a focal point in contemporary cosmological research, particularly in addressing current cosmological tensions. This study explores the cubic Galileon model's interaction with dark matter, where the interaction potential in the dark sector is proportional to the dark energy density of the Galileon field. By employing dimensionless variables, we transform the field equations into an autonomous dynamical system. We calculate the critical points of the corresponding autonomous systems and demonstrate the existence of a stable de Sitter epoch. Our investigation proceeds in two phases. First, we conduct a detailed analysis of the exact interacting cubic Galileon (ICG) model, derived from the precise solution of the equations of motion. Second, we explore an approximate tracker solution, labeled TICG, assuming a small coupling parameter between dark matter and dark energy. We evaluate the evolution of these models using data from two experiments, aiming to resolve the tensions surrounding $H_0$ and $S_8$. The analysis of the TICG model indicates a preference for a phantom regime and provides a negative coupling parameter in the dark sector at a $68\%$ confidence level. This model also shows that the current tensions regarding $H_0$ and $S_8$ are alleviated. Conversely, the ICG model, despite its preference for the phantom regime, is plagued by an excess in today's matter density and a higher expansion rate, easing only the $H_0$ tension.


title: Decoherence-free many-body Hamiltonians in nonlinear waveguide quantum electrodynamics

abstract: Enhancing interactions in many-body quantum systems, while protecting them from environmental decoherence, is at the heart of many quantum technologies. Waveguide quantum electrodynamics is a promising platform for achieving this, as it hosts infinite-range interactions and decoherence-free subspaces of quantum emitters. However, as coherent interactions between emitters are typically washed out in the wavelength-spacing regime hosting decoherence-free states, coherent control over the latter becomes limited, and many-body Hamiltonians in this important regime remain out of reach. Here we show that by incorporating emitter arrays with nonlinear waveguides hosting parametric gain, we obtain a unique class of many-body interaction Hamiltonians with coupling strengths that increase with emitter spacing, and persist even for wavelength-spaced arrays. We then propose to use these Hamiltonians to coherently generate decoherence-free states directly from the ground state, using only global squeezing drives, without the need for local addressing of individual emitters. Interestingly, we find that the dynamics approaches a unitary evolution in the limit of weak intra-waveguide squeezing, and discuss potential experimental realizations of this effect. Our results pave the way towards coherent control protocols in waveguide quantum electrodynamics, with applications including quantum computing, simulation, memory and nonclassical light generation.


title: WIYN Open Cluster Study. XC. Barium Surface Abundances of Blue Straggler Stars in the Open Clusters NGC 7789 and M67

abstract: We investigate barium (Ba) abundances in blue straggler stars (BSSs) in two open clusters, NGC 7789 (1.6 Gyr) and M67 (4 Gyr), as signatures of asymptotic-giant-branch (AGB) mass transfer. We combine our findings with previous Ba abundance analyses in NGC 6819 (2.5 Gyr) and NGC 188 (7 Gyr). Out of 35 BSSs studied in NGC 7789, NGC 6819, and M67, 15 (43$\pm$11%) are Ba-enriched; no BSSs in NGC 188 are Ba-enriched. The Ba abundances of enriched BSSs show an anticorrelation with cluster age, ranging from an enrichment of [Ba/Fe]$\sim$+1.5 dex in NGC 7789 to [Ba/Fe]$\sim$+1.0 dex in M67. The Ba-enriched BSSs all lie in the same region of the HR diagram, irrespective of cluster age or distance from the main-sequence turnoff. Our data suggest a link between AGB donor mass and mass-transfer efficiency in BSSs, in that less massive AGB donors tend to undergo more conservative mass transfer. We find that 40$\pm$16% of the Ba-enriched BSSs are in longer-period spectroscopic binaries with orbital periods less than 5000 days. Those Ba-enriched BSSs that do not exhibit radial-velocity variability suggest AGB mass-transfer in wide binaries by either wind mass transfer or wind Roche-lobe overflow. Given the preponderance of long orbital periods in the BSSs of M67 and NGC 188 and the frequency of Ba enrichment in NGC 7789, NGC 6819, and M67, it may be that AGB mass transfer is the dominant mechanism of BSS formation in open clusters older than 1 Gyr.


title: MANTA: A Negative-Triangularity NASEM-Compliant Fusion Pilot Plant

abstract: The MANTA (Modular Adjustable Negative Triangularity ARC-class) design study investigated how negative-triangularity (NT) may be leveraged in a compact, fusion pilot plant (FPP) to take a ``power-handling first" approach. The result is a pulsed, radiative, ELM-free tokamak that satisfies and exceeds the FPP requirements described in the 2021 National Academies of Sciences, Engineering, and Medicine report ``Bringing Fusion to the U.S. Grid". A self-consistent integrated modeling workflow predicts a fusion power of 450 MW and a plasma gain of 11.5 with only 23.5 MW of power to the scrape-off layer (SOL). This low $P_\text{SOL}$ together with impurity seeding and high density at the separatrix results in a peak heat flux of just 2.8 MW/m$^{2}$. MANTA's high aspect ratio provides space for a large central solenoid (CS), resulting in ${\sim}$15 minute inductive pulses. In spite of the high B fields on the CS and the other REBCO-based magnets, the electromagnetic stresses remain below structural and critical current density limits. Iterative optimization of neutron shielding and tritium breeding blanket yield tritium self-sufficiency with a breeding ratio of 1.15, a blanket power multiplication factor of 1.11, toroidal field coil lifetimes of $3100 \pm 400$ MW-yr, and poloidal field coil lifetimes of at least $890 \pm 40$ MW-yr. Following balance of plant modeling, MANTA is projected to generate 90 MW of net electricity at an electricity gain factor of ${\sim}2.4$. Systems-level economic analysis estimates an overnight cost of US\$3.4 billion, meeting the NASEM FPP requirement that this first-of-a-kind be less than US\$5 billion. The toroidal field coil cost and replacement time are the most critical upfront and lifetime cost drivers, respectively.


title: Chiral $\Lambda$-$\mathfrak{bms}_4$ symmetry of 3d conformal gravity

abstract: We propose mixed boundary conditions for 3d conformal gravity consistent with variational principle in its second-order formalism that admit the chiral $\Lambda$-$\mathfrak{bms}_4$ algebra as their asymptotic symmetry algebra. This algebra is one of the four chiral $\mathcal W$-algebra extensions of $\mathfrak{so}(2,3)$ and is a generalisation of the chiral $\mathfrak{bms}_4$ algebra responsible for soft theorems of graviton MHV amplitudes in ${\mathbb R}^{1,3}$ gravity to the case of non-zero negative cosmological constant. The corresponding charges calculated using the modified covariant phase space formalism are shown to be finite and integrable, and realise this non-linear ${\cal W}$-algebra.


title: Retrieval Augmented Structured Generation: Business Document Information Extraction As Tool Use

abstract: Business Document Information Extraction (BDIE) is the problem of transforming a blob of unstructured information (raw text, scanned documents, etc.) into a structured format that downstream systems can parse and use. It has two main tasks: Key-Information Extraction (KIE) and Line Items Recognition (LIR). In this paper, we argue that BDIE is best modeled as a Tool Use problem, where the tools are these downstream systems. We then present Retrieval Augmented Structured Generation (RASG), a novel general framework for BDIE that achieves state of the art (SOTA) results on both KIE and LIR tasks on BDIE benchmarks. The contributions of this paper are threefold: (1) We show, with ablation benchmarks, that Large Language Models (LLMs) with RASG are already competitive with or surpasses current SOTA Large Multimodal Models (LMMs) without RASG on BDIE benchmarks. (2) We propose a new metric class for Line Items Recognition, General Line Items Recognition Metric (GLIRM), that is more aligned with practical BDIE use cases compared to existing metrics, such as ANLS*, DocILE, and GriTS. (3) We provide a heuristic algorithm for backcalculating bounding boxes of predicted line items and tables without the need for vision encoders. Finally, we claim that, while LMMs might sometimes offer marginal performance benefits, LLMs + RASG is oftentimes superior given real-world applications and constraints of BDIE.


title: Detecting horizons of symmetric black holes using relative differential invariants

abstract: Let $\mathfrak{k}$ be a nontrivial finite-dimensional Lie algebra of vector fields on a manifold M, and consider the family of Lorentzian metrics on M whose Killing algebra contains $\mathfrak{k}$. We show that scalar relative differential invariants, with respect to a Lie algebra of vector fields on M preserving $\mathfrak{k}$, can be used to detect the horizons of several well-known black holes. In particular, using the Lie algebra structure of $\mathfrak{k}$, we construct a general relative differential invariant of order 0 that always vanishes on $\mathfrak{k}$-invariant Killing horizons.