title: OCALM: Object-Centric Assessment with Language Models

abstract: Properly defining a reward signal to efficiently train a reinforcement learning (RL) agent is a challenging task. Designing balanced objective functions from which a desired behavior can emerge requires expert knowledge, especially for complex environments. Learning rewards from human feedback or using large language models (LLMs) to directly provide rewards are promising alternatives, allowing non-experts to specify goals for the agent. However, black-box reward models make it difficult to debug the reward. In this work, we propose Object-Centric Assessment with Language Models (OCALM) to derive inherently interpretable reward functions for RL agents from natural language task descriptions. OCALM uses the extensive world-knowledge of LLMs while leveraging the object-centric nature common to many environments to derive reward functions focused on relational concepts, providing RL agents with the ability to derive policies from task descriptions.


title: Inferring stochastic low-rank recurrent neural networks from neural data

abstract: A central aim in computational neuroscience is to relate the activity of large populations of neurons to an underlying dynamical system. Models of these neural dynamics should ideally be both interpretable and fit the observed data well. Low-rank recurrent neural networks (RNNs) exhibit such interpretability by having tractable dynamics. However, it is unclear how to best fit low-rank RNNs to data consisting of noisy observations of an underlying stochastic system. Here, we propose to fit stochastic low-rank RNNs with variational sequential Monte Carlo methods. We validate our method on several datasets consisting of both continuous and spiking neural data, where we obtain lower dimensional latent dynamics than current state of the art methods. Additionally, for low-rank models with piecewise linear nonlinearities, we show how to efficiently identify all fixed points in polynomial rather than exponential cost in the number of units, making analysis of the inferred dynamics tractable for large RNNs. Our method both elucidates the dynamical systems underlying experimental recordings and provides a generative model whose trajectories match observed trial-to-trial variability.


title: Modelling droplet rebounds off fluid baths

abstract: In order for a droplet to rebound rather than coalesce from a liquid surface, there must be a layer of air persisting throughout the impact. This air layer acts as a lubricant to the system and permits a pressure transfer between the two liquid bodies. Through considering the bath, air, and drop regions of fluid, we introduce a fully coupled reduced dynamic model of two-dimensional droplets rebounding off liquid baths, which incorporates a evolving lubricating air layer. Numerical solutions of the lubrication-mediated model are compared to widely used direct numerical simulation (DNS) of the Navier-Stokes equations. The reduced model captures rebounding dynamics well in the regime where it is most relevant: for low speed impacts of small droplets, where capillary forces are important. Numerically, the reduced model is efficient, allowing for the computation of multiple rebounds and of long time dynamics of droplets rebounding on a vibrating bath. Furthermore, the lubrication-mediated model is able to provide detailed information within the air layer such as pressure and lubrication-layer geometry, which is often omitted from reduced models, and typically obtained by higher resolution but higher cost DNS methods.


title: Towards Zero-Shot Text-To-Speech for Arabic Dialects

abstract: Zero-shot multi-speaker text-to-speech (ZS-TTS) systems have advanced for English, however, it still lags behind due to insufficient resources. We address this gap for Arabic, a language of more than 450 million native speakers, by first adapting a sizeable existing dataset to suit the needs of speech synthesis. Additionally, we employ a set of Arabic dialect identification models to explore the impact of pre-defined dialect labels on improving the ZS-TTS model in a multi-dialect setting. Subsequently, we fine-tune the XTTS\footnote{https://docs.coqui.ai/en/latest/models/xtts.html}\footnote{https://medium.com/machine-learns/xtts-v2-new-version-of-the-open-source-text-to-speech-model-af73914db81f}\footnote{https://medium.com/@erogol/xtts-v1-techincal-notes-eb83ff05bdc} model, an open-source architecture. We then evaluate our models on a dataset comprising 31 unseen speakers and an in-house dialectal dataset. Our automated and human evaluation results show convincing performance while capable of generating dialectal speech. Our study highlights significant potential for improvements in this emerging area of research in Arabic.


title: Accelerating Graph-based Tracking Tasks with Symbolic Regression

abstract: The reconstruction of particle tracks from hits in tracking detectors is a computationally intensive task due to the large combinatorics of detector signals. Recent efforts have proven that ML techniques can be successfully applied to the tracking problem, extending and improving the conventional methods based on feature engineering. However, complex models can be difficult to implement on heterogeneous trigger systems, integrating architectures such as FPGAs. Deploying the network on an FPGA is feasible but challenging and limited by its resources. An efficient alternative can employ symbolic regression (SR). We propose a novel approach that uses SR to replace a graph-based neural network. Substituting each network block with a symbolic function preserves the graph structure of the data and enables message passing. The technique is perfectly suitable for heterogeneous hardware, as it can be implemented more easily on FPGAs and grants faster execution times on CPU with respect to conventional methods. We note that while the tracking problem is the target for this work, it also provides a proof-of-principle for the method that can be applied to many use cases.


title: High-temperature quantum coherence of spinons in a rare-earth spin chain

abstract: Although magnetism is a quantum phenomenon, its energy scale can be strong enough to sustain technological usage at room temperature and above. Temperature, however, leads to the decoherence which hampers quantum information applications. Common wisdom dictates that when magnets are heated to temperatures where thermal energy is higher than the interactions among atomic magnetic moments, the latter become uncorrelated and classical paramagnetic behavior is recovered. Surprisingly, our neutron scattering experiments on Yb chains in an insulating perovskite crystal overturn this conventional picture. We find a sharply defined spectrum of spinon excitations, which are the fractional elementary excitations in spin-1/2 chains, that persists to temperatures where thermal energy is more than 20 times higher than the energy of interactions between Yb magnetic moments, $J$. The observed sharpness of the spinon continuum boundary indicates that spinon mean free path exceeds $\approx 35$ inter-atomic spacings at temperatures markedly above the magnetic energy scale. Our observations reveal an interesting and highly unusual quantum behavior in a rare earth magnet, which challenges quantum metrology and has profound implications for spin qubit systems in quantum information applications operating at finite temperatures.


title: The MRI Scanner as a Diagnostic: Image-less Active Sampling

abstract: Despite the high diagnostic accuracy of Magnetic Resonance Imaging (MRI), using MRI as a Point-of-Care (POC) disease identification tool poses significant accessibility challenges due to the use of high magnetic field strength and lengthy acquisition times. We ask a simple question: Can we dynamically optimise acquired samples, at the patient level, according to an (automated) downstream decision task, while discounting image reconstruction? We propose an ML-based framework that learns an active sampling strategy, via reinforcement learning, at a patient-level to directly infer disease from undersampled k-space. We validate our approach by inferring Meniscus Tear in undersampled knee MRI data, where we achieve diagnostic performance comparable with ML-based diagnosis, using fully sampled k-space data. We analyse task-specific sampling policies, showcasing the adaptability of our active sampling approach. The introduced frugal sampling strategies have the potential to reduce high field strength requirements that in turn strengthen the viability of MRI-based POC disease identification and associated preliminary screening tools.


title: Adjusted Connections I: Differential Cocycles for Principal Groupoid Bundles with Connection

abstract: We develop a new perspective on principal bundles with connection as morphisms from the tangent bundle of the underlying manifold to a classifying dg-Lie groupoid. This groupoid can be identified with a lift of the inner homomorphisms groupoid arising in \v{S}evera's differentiation procedure of Lie quasi-groupoids. Our new perspective readily extends to principal groupoid bundles, but requires an adjustment, an additional datum familiar from higher gauge theory. The resulting adjusted connections naturally provide a global formulation of the kinematical data of curved Yang-Mills-Higgs theories as described by Kotov-Strobl (arXiv:1510.07654) and Fischer (arXiv:2104.02175).


title: Addressing Polarization and Unfairness in Performative Prediction

abstract: When machine learning (ML) models are used in applications that involve humans (e.g., online recommendation, school admission, hiring, lending), the model itself may trigger changes in the distribution of targeted data it aims to predict. Performative prediction (PP) is a framework that explicitly considers such model-dependent distribution shifts when learning ML models. While significant efforts have been devoted to finding performative stable (PS) solutions in PP for system robustness, their societal implications are less explored and it is unclear whether PS solutions are aligned with social norms such as fairness. In this paper, we set out to examine the fairness property of PS solutions in performative prediction. We first show that PS solutions can incur severe polarization effects and group-wise loss disparity. Although existing fairness mechanisms commonly used in literature can help mitigate unfairness, they may fail and disrupt the stability under model-dependent distribution shifts. We thus propose novel fairness intervention mechanisms that can simultaneously achieve both stability and fairness in PP settings. Both theoretical analysis and experiments are provided to validate the proposed method.


title: $\infty$-Categorical Generalized Langlands Correspondence III: $\infty$-Stackification

abstract: We discuss further around the generalized Langlands Program, by using $\infty$-categoricalization and $\infty$-analytic stackification.


title: Towards Fast Multilingual LLM Inference: Speculative Decoding and Specialized Drafters

abstract: Large language models (LLMs) have revolutionized natural language processing and broadened their applicability across diverse commercial applications. However, the deployment of these models is constrained by high inference time in multilingual settings. To mitigate this challenge, this paper explores a training recipe of an assistant model in speculative decoding, which are leveraged to draft and-then its future tokens are verified by the target LLM. We show that language-specific draft models, optimized through a targeted pretrain-and-finetune strategy, substantially brings a speedup of inference time compared to the previous methods. We validate these models across various languages in inference time, out-of-domain speedup, and GPT-4o evaluation.


title: Anomaly Detection based on Markov Data: A Statistical Depth Approach

abstract: It is the main purpose of this article to extend the notion of statistical depth to the case of sample paths of a Markov chain, a very popular probabilistic model to describe parsimoniously random phenomena with a temporal causality. Initially introduced to define a center-outward ordering of points in the support of a multivariate distribution, depth functions permit to generalize the notions of quantiles and (signed) ranks for observations in $\mathbb{R}^d$ with $d>1$, as well as statistical procedures based on such quantities, for (unsupervised) anomaly detection tasks in particular. In this paper, overcoming the lack of natural order on the torus composed of all possible trajectories of finite length, we develop a general theoretical framework for evaluating the depth of a Markov sample path and recovering it statistically from an estimate of its transition probability with (non-) asymptotic guarantees. We also detail its numerous applications, focusing particularly on anomaly detection, a key task in various fields involving the analysis of (supposedly) Markov time-series ({e.g.} health monitoring of complex infrastructures, security). Beyond the description of the methodology promoted and the statistical analysis carried out to guarantee its validity, numerical experiments are displayed, providing strong empirical evidence of the relevance of the novel concept we introduce here to quantify the degree of abnormality of Markov path sequences of variable length.


title: The classification of simple complex Lie superalgebras of polynomial vector fields and their deformations

abstract: We overview classifications of simple infinite-dimensional complex $\mathbb{Z}$-graded Lie (super)algebras of polynomial growth, and their deformations. A subset of such Lie (super)algebras consist of vectorial Lie (super)algebras whose elements are vector fields with polynomial, or formal power series, or divided power coefficients. A given vectorial Lie (super)algebra with a (Weisfeiler) filtration corresponding to a maximal subalgebra of finite codimension is called W-filtered; the associated graded algebra is called W-graded. Here, we correct several published results: (1) prove our old claim "the superization of \'E. Cartan's problem (classify primitive Lie algebras) is wild", (2) solve a tame problem: classify simple W-graded and W-filtered vectorial Lie superalgebras, (3) describe the supervariety of deformation parameters for the serial W-graded simple vectorial superalgebras, (4) conjecture that the exceptional simple vectorial superalgebras are rigid. We conjecture usefulness of our method in classification of simple infinite-dimensional vectorial Lie (super)algebras over fields of positive characteristic.


title: Hydrodynamically consistent many-body Harada-Sasa relation

abstract: The effect of hydrodynamic interactions on the non-equilibrium stochastic dynamics of particles -- arising from the conservation of momentum in the fluid medium -- is examined in the context of the relationship between fluctuations, response functions, and the entropy production rate. The multiplicative nature of the hydrodynamic interactions is shown to introduce subtleties that preclude a straightforward extension of the Harada-Sasa relation. A generalization of the definitions involved in the framework is used to propose a new form of the relation applicable to systems with hydrodynamic interactions. The resulting framework will enable characterization of the non-equilibrium properties of living and active matter systems, which are predominantly in suspensions.


title: Adaptive Payoff-driven Interaction in Networked Snowdrift Games

abstract: In social dilemmas, most interactions are transient and susceptible to restructuring, leading to continuous changes in social networks over time. Typically, agents assess the rewards of their current interactions and adjust their connections to optimize outcomes. In this paper, we introduce an adaptive network model in the snowdrift game to examine dynamic levels of cooperation and network topology, involving the potential for both the termination of existing connections and the establishment of new ones. In particular, we define the agent's asymmetric disassociation tendency toward their neighbors, which fundamentally determines the probability of edge dismantlement. The mechanism allows agents to selectively sever and rewire their connections to alternative individuals to refine partnerships. Our findings reveal that adaptive networks are particularly effective in promoting a robust evolution toward states of either pure cooperation or complete defection, especially under conditions of extreme cost-benefit ratios, as compared to static network models. Moreover, the dynamic restructuring of connections and the distribution of network degrees among agents are closely linked to the levels of cooperation in stationary states. Specifically, cooperators tend to seek broader neighborhoods when confronted with the invasion of multiple defectors.


title: Tensor renormalization group study of the three-dimensional SU(2) and SU(3) gauge theories with the reduced tensor network formulation

abstract: We perform a tensor renormalization group simulation of non-Abelian gauge theory in three dimensions using a formulation based on the `armillary sphere.' In this formulation, matrix indices are completely traced out, eliminating the degeneracy in the singular value spectrum of the initial tensor. We demonstrate the usefulness of this technique by computing the average plaquette at zero temperature and the Polyakov loop susceptibility at finite temperatures for 2+1D SU(2) and SU(3) gauge theories. The deconfinement transition is identified for both gauge groups, with the SU(2) case being consistent with previous Monte Carlo results.


title: Extensively Not P-Bi-Immune promiseBQP-Complete Languages

abstract: In this paper, I first establish -- via methods other than the Gottesman-Knill theorem -- the existence of an infinite set of instances of simulating a quantum circuit to decide a decision problem that can be simulated classically. I then examine under what restrictions on quantum circuits the existence of infinitely many classically simulable instances persists. There turns out to be a vast number of such restrictions, and any combination of those found can be applied at the same time without eliminating the infinite set of classically simulable instances. Further analysis of the tools used in this then shows there exists a language that every (promise) BQP language is one-one reducible to. This language is also not P-bi-immune under very many promises.


title: Walks with jumps: a neurobiologically motivated class of paths in the hyperbolic plane

abstract: We introduce the notion of a "walk with jumps", which we conceive as an evolving process in which a point moves in a space (for us, typically $\mathbb{H}^2$) over time, in a consistent direction and at a consistent speed except that it is interrupted by a finite set of "jumps" in a fixed direction and distance from the walk direction. Our motivation is biological; specifically, to use walks with jumps to encode the activity of a neuron over time (a ``spike train``). Because (in $\mathbb{H}^2$) the walk is built out of a sequence of transformations that do not commute, the walk's endpoint encodes aspects of the sequence of jump times beyond their total number, but does so incompletely. The main results of the paper use the tools of hyperbolic geometry to give positive and negative answers to the following question: to what extent does the endpoint of a walk with jumps faithfully encode the walk's sequence of jump times?


title: Conformal time series decomposition with component-wise exchangeability

abstract: Conformal prediction offers a practical framework for distribution-free uncertainty quantification, providing finite-sample coverage guarantees under relatively mild assumptions on data exchangeability. However, these assumptions cease to hold for time series due to their temporally correlated nature. In this work, we present a novel use of conformal prediction for time series forecasting that incorporates time series decomposition. This approach allows us to model different temporal components individually. By applying specific conformal algorithms to each component and then merging the obtained prediction intervals, we customize our methods to account for the different exchangeability regimes underlying each component. Our decomposition-based approach is thoroughly discussed and empirically evaluated on synthetic and real-world data. We find that the method provides promising results on well-structured time series, but can be limited by factors such as the decomposition step for more complex data.


title: The GPT-WritingPrompts Dataset: A Comparative Analysis of Character Portrayal in Short Stories

abstract: The improved generative capabilities of large language models have made them a powerful tool for creative writing and storytelling. It is therefore important to quantitatively understand the nature of generated stories, and how they differ from human storytelling. We augment the Reddit WritingPrompts dataset with short stories generated by GPT-3.5, given the same prompts. We quantify and compare the emotional and descriptive features of storytelling from both generative processes, human and machine, along a set of six dimensions. We find that generated stories differ significantly from human stories along all six dimensions, and that human and machine generations display similar biases when grouped according to the narrative point-of-view and gender of the main protagonist. We release our dataset and code at https://github.com/KristinHuangg/gpt-writing-prompts.


title: WARP: On the Benefits of Weight Averaged Rewarded Policies

abstract: Reinforcement learning from human feedback (RLHF) aligns large language models (LLMs) by encouraging their generations to have high rewards, using a reward model trained on human preferences. To prevent the forgetting of pre-trained knowledge, RLHF usually incorporates a KL regularization; this forces the policy to remain close to its supervised fine-tuned initialization, though it hinders the reward optimization. To tackle the trade-off between KL and reward, in this paper we introduce a novel alignment strategy named Weight Averaged Rewarded Policies (WARP). WARP merges policies in the weight space at three distinct stages. First, it uses the exponential moving average of the policy as a dynamic anchor in the KL regularization. Second, it applies spherical interpolation to merge independently fine-tuned policies into a new enhanced one. Third, it linearly interpolates between this merged model and the initialization, to recover features from pre-training. This procedure is then applied iteratively, with each iteration's final model used as an advanced initialization for the next, progressively refining the KL-reward Pareto front, achieving superior rewards at fixed KL. Experiments with GEMMA policies validate that WARP improves their quality and alignment, outperforming other open-source LLMs.


title: Determination of dark matter distribution in Ursa Major III and constraints on dark matter annihilation

abstract: The recently discovered satellite dwarf galaxy Ursa Major III provides a promising opportunity to explore the signatures resulting from dark matter (DM) annihilation, due to its proximity and large J-factor. Owing to the absence of an excess of $\gamma$-ray signatures originating from Ursa Major III, observations of $\gamma$-rays, such as those from Fermi-LAT, can be utilized to set constraints on the DM annihilation cross section. In this study, we determine the DM density profile, and consider the relationship between DM density and velocity dispersion at different locations within Ursa Major III through Jeans analysis. We calculate the J-factor of Ursa Major III for s-wave annihilation, along with the effective J-factors for p-wave and Sommerfeld enhanced annihilation scenarios. Utilizing these derived J-factors, we set stringent constraints on DM annihilation cross sections in three scenarios. Given the substantial impact of member star identification on the J-factor of Ursa Major III, we further calculate J-factors with the condition of excluding the largest velocity outlier. Our analysis reveals a notable reduction in the median value and an increase in the deviation of J-factors, thereby leading to considerably weaker constraints.


title: Integrated thermo-optic phase shifters for laser-written photonic circuits operating at cryogenic temperatures

abstract: Integrated photonics offers compact and stable manipulation of optical signals in miniaturized chips, with the possibility of changing dynamically their functionality by means of integrated phase shifters. Cryogenic operation of these devices is becoming essential for advancing photonic quantum technologies, accommodating components like quantum light sources, single photon detectors and quantum memories operating at liquid helium temperatures. In this work, we report on a programmable glass photonic integrated circuit (PIC) fabricated through femtosecond laser waveguide writing (FLW) and controlled by thermo-optic phase shifters both in a room-temperature and in a cryogenic setting. By taking advantage of a femtosecond laser microstructuring process, we achieved reliable PIC operation with minimal power consumption and confined temperature gradients in both conditions. This advancement marks the first cryogenically-compatible programmable FLW PIC, paving the way for fully integrated quantum architectures realized on a laser-written photonic chip.


title: An antiferromagnetic diode effect in even-layered MnBi2Te4

abstract: In a PN junction, the separation between positive and negative charges leads to diode transport. In the past few years, the intrinsic diode transport in noncentrosymmetric polar conductors has attracted great interest, because it suggests novel nonlinear applications and provides a symmetry-sensitive probe of Fermi surface. Recently, such studies have been extended to noncentrosymmetric superconductors, realizing the superconducting diode effect. Here, we show that, even in a centrosymmetric crystal without directional charge separation, the spins of an antiferromagnet (AFM) can generate a spatial directionality, leading to an AFM diode effect. We observe large second-harmonic transport in a nonlinear electronic device enabled by the compensated AFM state of even-layered MnBi2Te4. We also report a novel electrical sum-frequency generation (SFG), which has been rarely explored in contrast to the well-known optical SFG in wide-gap insulators. We demonstrate that the AFM enables an in-plane field-effect transistor and harvesting of wireless electromagnetic energy. The electrical SFG establishes a powerful method to study nonlinear electronics built by quantum materials. The AFM diode effect paves the way for potential device concepts including AFM logic circuits, self-powered AFM spintronics, and other applications that potentially bridge nonlinear electronics with AFM spintronics.


title: OlympicArena Medal Ranks: Who Is the Most Intelligent AI So Far?

abstract: In this report, we pose the following question: Who is the most intelligent AI model to date, as measured by the OlympicArena (an Olympic-level, multi-discipline, multi-modal benchmark for superintelligent AI)? We specifically focus on the most recently released models: Claude-3.5-Sonnet, Gemini-1.5-Pro, and GPT-4o. For the first time, we propose using an Olympic medal Table approach to rank AI models based on their comprehensive performance across various disciplines. Empirical results reveal: (1) Claude-3.5-Sonnet shows highly competitive overall performance over GPT-4o, even surpassing GPT-4o on a few subjects (i.e., Physics, Chemistry, and Biology). (2) Gemini-1.5-Pro and GPT-4V are ranked consecutively just behind GPT-4o and Claude-3.5-Sonnet, but with a clear performance gap between them. (3) The performance of AI models from the open-source community significantly lags behind these proprietary models. (4) The performance of these models on this benchmark has been less than satisfactory, indicating that we still have a long way to go before achieving superintelligence. We remain committed to continuously tracking and evaluating the performance of the latest powerful models on this benchmark (available at https://github.com/GAIR-NLP/OlympicArena).


title: Valuation methods for professional sports clubs: A historical review, a model development, and the application to Japanese football clubs

abstract: In the trend towards the globalization of football and the increasing commercialization of professional football clubs, a methodology for calculating the firm value of clubs in non-western countries has yet to be established. This study reviews the valuation methods for the club firm values in Europe and North America and how values are calculated at the time of changing ownership of Japanese clubs and develops regression models with higher explanatory power than before to estimate the more accurate firm value of Japanese football clubs. A review of the existing literature on methods for calculating the firm value of professional sports clubs in Europe and North America, as well as financial statements and registers relating to changes of ownership of Japanese clubs, was conducted. After that, multiple regression analyses were conducted using the firm value of European clubs as the explained variable. From the literature review and the Japanese case studies, it has become clear that European clubs' standard valuation methods are based on revenue and other factors, while in Japan, valuation is based solely on the par value of stocks or net assets. Multiple regression analysis revealed that the firm value of European clubs over the past three years is best explained by revenue or player market value and the number of SNS followers. Two models with high explanatory power were developed. The estimated firm value using the revenue-based formula was higher than the one based on player market value. However, in the J.League, the former was more than three times higher than the latter, while the former was only 1.2 times higher for European clubs. The discrepancy relates to differences in European and J.League clubs' revenues and asset structures. In either formula, the firm value of J.League clubs exceeded the actual transaction price when the change of ownership occurred in the past.


title: Wildly ramified unitary local models for special parahorics. The odd dimensional case

abstract: We construct local models for wildly ramified unitary similitude groups of odd dimension $n\geq 3$ with special parahoric level structure and signature $(n-1,1)$. We first give a lattice-theoretic description for parahoric subgroups using Bruhat-Tits theory in residue characteristic two, and apply them to define local models following the lead of Rapoport-Zink and Pappas-Rapoport. In our case, there are two conjugacy classes of special parahoric subgroups. We show that the local models are smooth for the one class and normal, Cohen-Macaulay for the other class. We also prove that they represent the v-sheaf local models of Scholze-Weinstein. Under some additional assumptions, we obtain an explicit moduli interpretation of the local models.


title: Some relations in topological dynamics

abstract: Relations always play an important role in the study of topological dynamics. Proximal, distal and almost periodic relations are well studied in literature. We further this direction and analogously study the strongly proximal and weakly distal relations. This gives a new class of flows - the weakly distal flows. We observe that the well known Morse-Thue substitution flows and Chacon transformations are weakly distal.


title: Instance Consistency Regularization for Semi-Supervised 3D Instance Segmentation

abstract: Large-scale datasets with point-wise semantic and instance labels are crucial to 3D instance segmentation but also expensive. To leverage unlabeled data, previous semi-supervised 3D instance segmentation approaches have explored self-training frameworks, which rely on high-quality pseudo labels for consistency regularization. They intuitively utilize both instance and semantic pseudo labels in a joint learning manner. However, semantic pseudo labels contain numerous noise derived from the imbalanced category distribution and natural confusion of similar but distinct categories, which leads to severe collapses in self-training. Motivated by the observation that 3D instances are non-overlapping and spatially separable, we ask whether we can solely rely on instance consistency regularization for improved semi-supervised segmentation. To this end, we propose a novel self-training network InsTeacher3D to explore and exploit pure instance knowledge from unlabeled data. We first build a parallel base 3D instance segmentation model DKNet, which distinguishes each instance from the others via discriminative instance kernels without reliance on semantic segmentation. Based on DKNet, we further design a novel instance consistency regularization framework to generate and leverage high-quality instance pseudo labels. Experimental results on multiple large-scale datasets show that the InsTeacher3D significantly outperforms prior state-of-the-art semi-supervised approaches. Code is available: https://github.com/W1zheng/InsTeacher3D.


title: Blending LLMs into Cascaded Speech Translation: KIT's Offline Speech Translation System for IWSLT 2024

abstract: Large Language Models (LLMs) are currently under exploration for various tasks, including Automatic Speech Recognition (ASR), Machine Translation (MT), and even End-to-End Speech Translation (ST). In this paper, we present KIT's offline submission in the constrained + LLM track by incorporating recently proposed techniques that can be added to any cascaded speech translation. Specifically, we integrate Mistral-7B\footnote{mistralai/Mistral-7B-Instruct-v0.1} into our system to enhance it in two ways. Firstly, we refine the ASR outputs by utilizing the N-best lists generated by our system and fine-tuning the LLM to predict the transcript accurately. Secondly, we refine the MT outputs at the document level by fine-tuning the LLM, leveraging both ASR and MT predictions to improve translation quality. We find that integrating the LLM into the ASR and MT systems results in an absolute improvement of $0.3\%$ in Word Error Rate and $0.65\%$ in COMET for tst2019 test set. In challenging test sets with overlapping speakers and background noise, we find that integrating LLM is not beneficial due to poor ASR performance. Here, we use ASR with chunked long-form decoding to improve context usage that may be unavailable when transcribing with Voice Activity Detection segmentation alone.


title: Finding Transformer Circuits with Edge Pruning

abstract: The path to interpreting a language model often proceeds via analysis of circuits -- sparse computational subgraphs of the model that capture specific aspects of its behavior. Recent work has automated the task of discovering circuits. Yet, these methods have practical limitations, as they rely either on inefficient search algorithms or inaccurate approximations. In this paper, we frame automated circuit discovery as an optimization problem and propose *Edge Pruning* as an effective and scalable solution. Edge Pruning leverages gradient-based pruning techniques, but instead of removing neurons or components, it prunes the \emph{edges} between components. Our method finds circuits in GPT-2 that use less than half the number of edges compared to circuits found by previous methods while being equally faithful to the full model predictions on standard circuit-finding tasks. Edge Pruning is efficient even with as many as 100K examples, outperforming previous methods in speed and producing substantially better circuits. It also perfectly recovers the ground-truth circuits in two models compiled with Tracr. Thanks to its efficiency, we scale Edge Pruning to CodeLlama-13B, a model over 100x the scale that prior methods operate on. We use this setting for a case study comparing the mechanisms behind instruction prompting and in-context learning. We find two circuits with more than 99.96% sparsity that match the performance of the full model and reveal that the mechanisms in the two settings overlap substantially. Our case study shows that Edge Pruning is a practical and scalable tool for interpretability and sheds light on behaviors that only emerge in large models.


title: It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension

abstract: Natural language processing has seen rapid progress over the past decade. Due to the speed of developments, some practices get established without proper evaluation. Considering one such case and focusing on reading comprehension, we ask our first research question: 1) How does the order of inputs -- i.e., question and context -- affect model performance? Additionally, given recent advancements in input emphasis, we ask a second research question: 2) Does emphasizing either the question, the context, or both enhance performance? Experimenting with 9 large language models across 3 datasets, we find that presenting the context before the question improves model performance, with an accuracy increase of up to $31\%$. Furthermore, emphasizing the context yields superior results compared to question emphasis, and in general, emphasizing parts of the input is particularly effective for addressing questions that models lack the parametric knowledge to answer. Experimenting with both prompt-based and attention-based emphasis methods, we additionally find that the best method is surprisingly simple: it only requires concatenating a few tokens to the input and results in an accuracy improvement of up to $36\%$, allowing smaller models to outperform their significantly larger counterparts.


title: Koopman Operator-based Detection-Isolation of Cyberattack: A Case Study on Electric Vehicle Charging

abstract: One of the key challenges towards the reliable operation of cyber-physical systems (CPS) is the threat of cyberattacks on system actuation signals and measurements. In recent years, system theoretic research has focused on effectively detecting and isolating these cyberattacks to ensure proper restorative measures. Although both model-based and model-free approaches have been used in this context, the latter are increasingly becoming more popular as complexities and model uncertainties in CPS increases. Thus, in this paper we propose a Koopman operator-based model-free cyberattack detection-isolation scheme for CPS. The algorithm uses limited system measurements for its training and generates real-time detection-isolation flags. Furthermore, we present a simulation case study to detect and isolate actuation and sensor attacks in a Lithium-ion battery system of a plug-in electric vehicle during charging.


title: A Carrying Capacity Calculator for Pedestrians Using OpenStreetMap Data: Application to Urban Tourism and Public Spaces

abstract: Determining the carrying capacity of urban tourism destinations and public spaces is essential for sustainable management. This paper presents an online tool that calculates pedestrian carrying capacities for user-defined areas based on OpenStreetMap (OSM) data. The tool considers physical, real, and effective carrying capacities by incorporating parameters such as area per pedestrian, rotation factor, corrective factors, and management capacity. The carrying capacity calculator aids in balancing environmental, economic, social, and experiential factors to prevent overcrowding and preserve the quality of life for residents and visitors. This tool is particularly useful for tourism destination management, urban planning, and event management, ensuring positive visitor experiences and sustainable infrastructure development. We detail the implementation of the calculator, its underlying algorithm, and its application to the Santa Maria Maior parish in Lisbon, highlighting its effectiveness in managing urban tourism and public spaces.


title: Confidence Aware Inverse Constrained Reinforcement Learning

abstract: In coming up with solutions to real-world problems, humans implicitly adhere to constraints that are too numerous and complex to be specified completely. However, reinforcement learning (RL) agents need these constraints to learn the correct optimal policy in these settings. The field of Inverse Constraint Reinforcement Learning (ICRL) deals with this problem and provides algorithms that aim to estimate the constraints from expert demonstrations collected offline. Practitioners prefer to know a measure of confidence in the estimated constraints, before deciding to use these constraints, which allows them to only use the constraints that satisfy a desired level of confidence. However, prior works do not allow users to provide the desired level of confidence for the inferred constraints. This work provides a principled ICRL method that can take a confidence level with a set of expert demonstrations and outputs a constraint that is at least as constraining as the true underlying constraint with the desired level of confidence. Further, unlike previous methods, this method allows a user to know if the number of expert trajectories is insufficient to learn a constraint with a desired level of confidence, and therefore collect more expert trajectories as required to simultaneously learn constraints with the desired level of confidence and a policy that achieves the desired level of performance.


title: M2Lingual: Enhancing Multilingual, Multi-Turn Instruction Alignment in Large Language Models

abstract: Instruction finetuning (IFT) is critical for aligning Large Language Models (LLMs) to follow instructions. Numerous effective IFT datasets have been proposed in the recent past, but most focus on high resource languages such as English. In this work, we propose a fully synthetic, novel taxonomy (Evol) guided Multilingual, Multi-turn instruction finetuning dataset, called M2Lingual, to better align LLMs on a diverse set of languages and tasks. M2Lingual contains a total of 182K IFT pairs that are built upon diverse seeds, covering 70 languages, 17 NLP tasks and general instruction-response pairs. LLMs finetuned with M2Lingual substantially outperform the majority of existing multilingual IFT datasets. Importantly, LLMs trained with M2Lingual consistently achieve competitive results across a wide variety of evaluation benchmarks compared to existing multilingual IFT datasets. Specifically, LLMs finetuned with M2Lingual achieve strong performance on our translated multilingual, multi-turn evaluation benchmark as well as a wide variety of multilingual tasks. Thus we contribute, and the 2 step Evol taxonomy used for its creation. M2Lingual repository - https://huggingface.co/datasets/ServiceNow-AI/M2Lingual


title: The Progression of Transformers from Language to Vision to MOT: A Literature Review on Multi-Object Tracking with Transformers

abstract: The transformer neural network architecture allows for autoregressive sequence-to-sequence modeling through the use of attention layers. It was originally created with the application of machine translation but has revolutionized natural language processing. Recently, transformers have also been applied across a wide variety of pattern recognition tasks, particularly in computer vision. In this literature review, we describe major advances in computer vision utilizing transformers. We then focus specifically on Multi-Object Tracking (MOT) and discuss how transformers are increasingly becoming competitive in state-of-the-art MOT works, yet still lag behind traditional deep learning methods.


title: Bisimulation for Impure Simplicial Complexes

abstract: As an alternative to Kripke models, simplicial complexes are a versatile semantic primitive on which to interpret epistemic logic. Given a set of vertices, a simplicial complex is a downward closed set of subsets, called simplexes, of the vertex set. A maximal simplex is called a facet. Impure simplicial complexes represent that some agents (processes) are dead. It is known that impure simplicial complexes categorically correspond to so-called partial epistemic (Kripke) models. In this contribution, we define a notion of bisimulation to compare impure simplicial complexes and show that it has the Hennessy-Milner property. These results are for a logical language including atoms that express whether agents are alive or dead. Without these atoms no reasonable standard notion of bisimulation exists, as we amply justify by counterexamples, because such a restricted language is insufficiently expressive.


title: Generalized and high-efficiency arbitrary-positioned buffer for smoothed particle hydrodynamics

abstract: This paper develops an arbitrary-positioned buffer for the smoothed particle hydrodynamics (SPH) method, whose generality and high efficiency are achieved through two techniques. First, with the local coordinate system established at each arbitrary-positioned in-/outlet, particle positions in the global coordinate system are transformed into those in it via coordinate transformation. Since one local axis is located perpendicular to the in-/outlet boundary, the position comparison between particles and the threshold line or surface can be simplified to just this coordinate dimension. Second, particle candidates subjected to position comparison at one specific in-/outlet are restricted to those within the local cell-linked lists nearby the defined buffer zone, which significantly enhances computational efficiency due to a small portion of particles being checked. With this developed buffer, particle generation and deletion at arbitrary-positioned in- and outlets of complex flows can be handled efficiently and straightforwardly. We validate the effectiveness and versatility of the developed buffer through 2-D and 3-D non-/orthogonal uni-/bidirectional flows with arbitrary-positioned in- and outlets, driven by either pressure or velocity boundary conditions.


title: Parrondo's paradox in susceptible-infectious-susceptible dynamics over periodic temporal networks

abstract: Many social and biological networks periodically change over time with daily, weekly, and other cycles. Thus motivated, we formulate and analyze susceptible-infectious-susceptible (SIS) epidemic models over temporal networks with periodic schedules. More specifically, we assume that the temporal network consists of a cycle of alternately used static networks, each with a given duration. We show Parrondo's paradox behavior in this model, with which the periodic alternation of two static networks that are supra-threshold (i.e., above the epidemic threshold of the SIS model) yields a sub-threshold dynamics (i.e., with the number of infectious nodes exponentially decaying over time) in many cases. We find community structure to play an important role in shaping this phenomenon, and we study its dependence on the connectivity between and number of communities. Our findings associate such paradoxical behavior with anti-phase oscillatory behavior of the number of infectious nodes in different communities of the network.


title: Explicit Retinal Networks Produce Center-Surround Opponent Color Cells

abstract: Previous articles proposed an explicit retinal logic circuit that can generate neural correlates of phenomena central to color vision. Here it is shown that this network can be divided into its component parts and slightly modified to produce center-surround phenomena.


title: Quantum resolution limit of long-baseline imaging using distributed entanglement

abstract: It has been shown that shared entanglement between two telescope sites can in principle be used to localize a point source by mimicking the standard phase-scanning interferometer, but without physically bringing the light from the distant telescopes together. In this paper, we show that a receiver that employs spatial-mode sorting at each telescope site, combined with pre-shared entanglement and local quantum operations can be used to mimic the most general multimode interferometer acting on light collected from the telescopes. As an example application to a quantitative passive-imaging problem, we show that the quantum-limited precision of estimating the angular separation between two stars can be attained by an instantiation of the aforesaid entanglement based receiver. We discuss how this entanglement assisted strategy can be used to achieve the quantum-limited precision of any complex quantitative imaging task involving any number of telescopes. We provide a blueprint of this general receiver that involves quantum transduction of starlight into quantum memory banks and spatial mode sorters deployed at each telescope site, and measurements that include optical detection as well as qubit gates and measurements on the quantum memories. We discuss the relative contributions of local mode sorting at telescope sites vis-a-vis distributed entanglement-assisted interferometry, to the overall quantum-limited information about the scene, based on the ratio of the baseline distance to the individual telescope diameter.


title: Geometrically frustrated, mechanical metamaterial membranes: Large-scale stress accumulation and size-selective assembly

abstract: We study the effect of geometric frustration on dilational mechanical metamaterial membranes. While shape frustrated elastic plates can only accommodate non-zero Gaussian curvature up to size scales that ultimately vanish with their elastic thickness, we show that frustrated {\it metamembranes} accumulate hyperbolic curvatures up to mesoscopic length scales that are ultimately independent of the size of their microscopic constituents. A continuum elastic theory and discrete numerical model describe the size-dependent shape and internal stresses of axisymmetric, trumpet-like frustrated metamembranes, revealing a non-trivial crossover to a much weaker power-law growth in elastic strain energy with size than in frustrated elastic membranes. We study a consequence of this for the self-limiting assembly thermodynamics of frustrated trumpets, showing a several-fold increase the size range of self-limitation of metamembranes relative to elastic membranes.


title: Enabling more efficient and cost-effective AI/ML systems with Collective Mind, virtualized MLOps, MLPerf, Collective Knowledge Playground and reproducible optimization tournaments

abstract: In this white paper, I present my community effort to automatically co-design cheaper, faster and more energy-efficient software and hardware for AI, ML and other popular workloads with the help of the Collective Mind framework (CM), virtualized MLOps, MLPerf benchmarks and reproducible optimization tournaments. I developed CM to modularize, automate and virtualize the tedious process of building, running, profiling and optimizing complex applications across rapidly evolving open-source and proprietary AI/ML models, datasets, software and hardware. I achieved that with the help of portable, reusable and technology-agnostic automation recipes (ResearchOps) for MLOps and DevOps (CM4MLOps) discovered in close collaboration with academia and industry when reproducing more than 150 research papers and organizing the 1st mass-scale community benchmarking of ML and AI systems using CM and MLPerf. I donated CM and CM4MLOps to MLCommons to help connect academia and industry to learn how to build and run AI and other emerging workloads in the most efficient and cost-effective way using a common and technology-agnostic automation, virtualization and reproducibility framework while unifying knowledge exchange, protecting everyone's intellectual property, enabling portable skills, and accelerating transfer of the state-of-the-art research to production. My long-term vision is to make AI accessible to everyone by making it a commodity automatically produced from the most suitable open-source and proprietary components from different vendors based on user demand, requirements and constraints such as cost, latency, throughput, accuracy, energy, size and other important characteristics.


title: Deep Learning and Chaos: A combined Approach To Image Encryption and Decryption

abstract: In this paper, we introduce a novel image encryption and decryption algorithm using hyperchaotic signals from the novel 3D hyperchaotic map, 2D memristor map, Convolutional Neural Network (CNN), and key sensitivity analysis to achieve robust security and high efficiency. The encryption starts with the scrambling of gray images by using a 3D hyperchaotic map to yield complex sequences under disruption of pixel values; the robustness of this original encryption is further reinforced by employing a CNN to learn the intricate patterns and add the safety layer. The robustness of the encryption algorithm is shown by key sensitivity analysis, i.e., the average sensitivity of the algorithm to key elements. The other factors and systems of unauthorized decryption, even with slight variations in the keys, can alter the decryption procedure, resulting in the ineffective recreation of the decrypted image. Statistical analysis includes entropy analysis, correlation analysis, histogram analysis, and other security analyses like anomaly detection, all of which confirm the high security and effectiveness of the proposed encryption method. Testing of the algorithm under various noisy conditions is carried out to test robustness against Gaussian noise. Metrics for differential analysis, such as the NPCR (Number of Pixel Change Rate)and UACI (Unified Average Change Intensity), are also used to determine the strength of encryption. At the same time, the empirical validation was performed on several test images, which showed that the proposed encryption techniques have practical applicability and are robust to noise. Simulation results and comparative analyses illustrate that our encryption scheme possesses excellent visual security, decryption quality, and computational efficiency, and thus, it is efficient for secure image transmission and storage in big data applications.


title: Adam-mini: Use Fewer Learning Rates To Gain More

abstract: We propose Adam-mini, an optimizer that achieves on-par or better performance than AdamW with 45% to 50% less memory footprint. Adam-mini reduces memory by cutting down the learning rate resources in Adam (i.e., $1/\sqrt{v}$). We find that $\geq$ 90% of these learning rates in $v$ could be harmlessly removed if we (1) carefully partition the parameters into blocks following our proposed principle on Hessian structure; (2) assign a single but good learning rate to each parameter block. We further find that, for each of these parameter blocks, there exists a single high-quality learning rate that can outperform Adam, provided that sufficient resources are available to search it out. We then provide one cost-effective way to find good learning rates and propose Adam-mini. Empirically, we verify that Adam-mini performs on par or better than AdamW on various language models sized from 125M to 7B for pre-training, supervised fine-tuning, and RLHF. The reduced memory footprint of Adam-mini also alleviates communication overheads among GPUs and CPUs, thereby increasing throughput. For instance, Adam-mini achieves 49.6% higher throughput than AdamW when pre-training Llama2-7B on $2\times$ A800-80GB GPUs, which saves 33% wall-clock time for pre-training.


title: The quasi-redirecting Boundary

abstract: We generalize the notion of Gromov boundary to a larger class of metric spaces beyond Gromov hyperbolic spaces. Points in this boundary are classes of quasi-geodesic rays and the space is equipped with a topology that is naturally invariant under quasi-isometries. It turns out that this boundary is compatible with other notions of boundary in many ways; it contains the sublinearly Morse boundary as a topological subspace and it matches the Bowditch boundary of relative hyperbolic spaces when the peripheral subgroups have no intrinsic hyperbolicity. We also give a complete description of the boundary of the Croke-Kleiner group where the quasi-redirecting boundary reveals a new class of QI-invariant, Morse-like quasi-geodesics.


title: Fuel-Optimal Formation Reconfiguration by Means of Unidirectional Low-Thrust Propulsion System

abstract: The use of electric low-thrust propulsion systems for orbit maneuvers is becoming a popular choice among satellite manufacturers due to their inherent merits over their chemical counterparts. Many designers choose to incorporate multiple of such thrusters to insure omnidirectional orbit maneuverability, while others choose to equip their satellite with only one thruster nozzle, aiming to reduce the required power, weight, and size of the orbit control system. This paper proposes guidance and control schemes to address the problem of autonomous optimal relative orbit reconfiguration for a formation of two satellites, one of which utilizes a single low-thrust throttleable nozzle. Such under-actuated orbit control system requires the controlled spacecraft to constantly slew to direct the nozzle to the desired thrust direction. These redirection attitude maneuvers are treated within the guidance layer by accommodating recurrent no-thrust periods during which slew maneuvers take place. The control loop is then closed with an MPC-like scheme. The main motivation of this article is to support the future missions of LuxSpace's flagship satellite, Triton-X. Since the proposed guidance and control schemes are meant to answer realistic market needs, they are designed to have some specific qualities that makes them attractive from the practical point of view. Namely, they require minimal computational loads, besides being able to accommodate operational time constraints, e.g. no thrusting during eclipse or during ground contact, within the guidance layer.


title: Modeling of axion and electromagnetic fields coupling in a particle-in-cell code

abstract: Axions have aroused widespread research interest because they can solve the strong CP problem and serve as a possible candidate for dark matter. Currently, people have explored a lot of axion detection experiments, including passively detecting the existing axions in the universe, and actively generating axions in the laboratory. Recently, axion-coupled laser-plasma interactions have been discussed as a novel method to detect axions. Petawatt (PW) lasers are considered as a powerful tool to study not only the vacuum polarization but also the axion coupling, due to their extreme fields. However, particle-in-cell (PIC) simulation is still missed in current studies, which limits the understanding of axion-coupled laser-plasma interactions. In this paper, we proposed the method to include the axion field and the coupling with electromagnetic (EM) fields in PIC codes. The axion wave equation and modified Maxwell's equations are numerically solved, while the EM field modulation from axions is considered as a first-order perturbation. Meanwhile, different axion field boundary conditions are considered to satisfy different simulation scenarios. The processes of conversions between axions and photons, and weak laser pulse propagation with axion effects are checked as benchmarks of the code. Such an extended PIC code may help researchers develop novel axion detection schemes based on laser-plasma interactions and provide a better understanding of axion-coupled astrophysical processes.


title: Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMs

abstract: Existing methods for adapting large language models (LLMs) to new tasks are not suited to multi-task adaptation because they modify all the model weights -- causing destructive interference between tasks. The resulting effects, such as catastrophic forgetting of earlier tasks, make it challenging to obtain good performance on multiple tasks at the same time. To mitigate this, we propose Lottery Ticket Adaptation (LoTA), a sparse adaptation method that identifies and optimizes only a sparse subnetwork of the model. We evaluate LoTA on a wide range of challenging tasks such as instruction following, reasoning, math, and summarization. LoTA obtains better performance than full fine-tuning and low-rank adaptation (LoRA), and maintains good performance even after training on other tasks -- thus, avoiding catastrophic forgetting. By extracting and fine-tuning over lottery tickets (or sparse task vectors), LoTA also enables model merging over highly dissimilar tasks. Our code is made publicly available at https://github.com/kiddyboots216/lottery-ticket-adaptation.


title: High-quality activation function for applications in neuromorphic photonic chips realized using low-quality nonlinear optical resonators

abstract: Integrated optical devices that can realize a threshold filtration of signals are in demand in photonics. In particular, they play a key role in neuromorphic chips, acting as optical neurons. A list of requirements exist for thresholders to be practically applicable in this context. A value of the threshold, in general, should be independently tunable for each neuron. A sharpness of the corresponding step function should be also dynamically variable, to allow switching between deterministic and stochastic algorithms, for example, in optical Ising machines. Nonlinear ring resonators draw the attention of researchers in this field since they potentially can provide the required type of threshold behavior. Here we suggest the switching mechanism that implements the property of resonators to provide extremely sharp (with respect to the wavelength) $\pi$ phase shifts near the critical coupling regime. Adding a variable source of losses into the resonator, a well controlled broadening of the threshold can be achieved. Sharpness of the step in this case is independent on the quality factor of resonators and corresponding width of resonances. The nonlinear switching mechanism allows to use this feature to construct efficient optical neurons, that operate at small intensities. It also allows to use conventional materials like silicon with a relatively weak Kerr nonlinearity. The obtained results potentially lead the way to fast nonlinear Kerr effect based activation functions that can operate in continuous wave regime.


title: Correlation functions for the Gross-Neveu model

abstract: This is a non-perturbative treatment of correlation functions for the weakly coupled massless Gross-Neveu model in a finite volume. The main result is that all correlation functions, treated as distributions, are uniformly bounded in the ultraviolet cutoff.


title: From snapping out Brownian motions to Walsh's spider processes on star-like graphs

abstract: By analyzing matrices involved, we prove that a snapping-out Brownian motion with large permeability coefficients is a good approximation of Walsh's spider process on the star-like graph $K_{1,k}$. Thus, the latter process can be seen as a Brownian motion perturbed by a trace of semi-permeable membrane at the graph's center.


title: RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale

abstract: The instruction-following ability of Large Language Models (LLMs) has cultivated a class of LLM-based systems capable of approaching complex tasks such as making edits to large code repositories. Due to the high sensitivity and unpredictability of LLM behavior in response to changes in prompting, robust evaluation tools are needed to drive future iteration of these systems. We propose RES-Q, a natural language instruction-based benchmark for evaluating $\textbf{R}$epository $\textbf{E}$diting $\textbf{S}$ystems, which consists of 100 handcrafted repository editing tasks derived from real GitHub commits. Given an edit instruction and a code repository, RES-Q evaluates an LLM system's ability to interpret the instruction, navigate the repository to gather relevant information, and construct an appropriate edit that satisfies the specified criteria. We argue that evaluating LLMs in this way addresses issues with traditional benchmarks and provides a more holistic assessment of a model's abilities. We evaluate various state-of-the-art LLMs as language agents in a repository-editing system built on Qurrent OS, our language agent development software. Despite their 1% pass@1 performance difference on HumanEval, we find Claude Sonnet 3.5 outperforms GPT-4o by 12% pass@1 on RES-Q, indicating RES-Q's capacity to differentiate model capability as traditional benchmarks approach saturation. We further investigate token efficiency, performance relationships with existing benchmarks, and interesting disparities between closed and open-source LLMs. Code and dataset are available at https://github.com/Qurrent-AI/RES-Q.


title: Improved Regret Bounds for Bandits with Expert Advice

abstract: In this research note, we revisit the bandits with expert advice problem. Under a restricted feedback model, we prove a lower bound of order $\sqrt{K T \ln(N/K)}$ for the worst-case regret, where $K$ is the number of actions, $N>K$ the number of experts, and $T$ the time horizon. This matches a previously known upper bound of the same order and improves upon the best available lower bound of $\sqrt{K T (\ln N) / (\ln K)}$. For the standard feedback model, we prove a new instance-based upper bound that depends on the agreement between the experts and provides a logarithmic improvement compared to prior results.


title: Discovering neutrino tridents at the Large Hadron Collider

abstract: Neutrino trident production of di-lepton pairs is well recognized as a sensitive probe of both electroweak physics and physics beyond the Standard Model. Although a rare process, it could be significantly boosted by such new physics, and it also allows the electroweak theory to be tested in a new regime. We demonstrate that the forward neutrino physics program at the Large Hadron Collider offers a promising opportunity to measure for the first time, dimuon neutrino tridents with a statistical significance exceeding $5\sigma$. We present predictions for various proposed experiments and outline a specific experimental strategy to identify the signal and mitigate backgrounds, based on "reverse tracking" dimuon pairs in the FASER$\nu$2 detector. We also discuss prospects for constraining beyond Standard Model contributions to neutrino trident rates at high energies.


title: Comment on Chen et al.'s Authentication Protocol for Internet of Health Things

abstract: The Internet of Medical Things has revolutionized the healthcare industry, enabling the seamless integration of connected medical devices and wearable sensors to enhance patient care and optimize healthcare services. However, the rapid adoption of the Internet of Medical Things also introduces significant security challenges that must be effectively addressed to preserve patient privacy, protect sensitive medical data, and ensure the overall reliability and safety of Internet of Medical Things systems. In this context, a key agreement protocol is used to securely establish shared cryptographic keys between interconnected medical devices and the central system, ensuring confidential and authenticated communication. Recently Chen et al. proposed a lightweight authentication and key agreement protocol for the Internet of health things. In this article, we provide a descriptive analysis of their proposed scheme and prove that Chen et al.'s scheme is vulnerable to Known session-specific temporary information attacks and stolen verifier attacks.


title: Beyond uniform cyclotomy

abstract: Cyclotomy, the study of cyclotomic classes and cyclotomic numbers, is an area of number theory first studied by Gauss. It has natural applications in discrete mathematics and information theory. Despite this long history, there are significant limitations to what is known explicitly about cyclotomic numbers, which limits the use of cyclotomy in applications. The main explicit tool available is that of uniform cyclotomy, introduced by Baumert, Mills and Ward in 1982. In this paper, we present an extension of uniform cyclotomy which gives a direct method for evaluating all cyclotomic numbers over $GF(q^n)$ of order dividing $(q^n-1)/(q-1)$, for any prime power $q$ and $n \geq 2$, which does not use character theory nor direct calculation in the field. This allows the straightforward evaluation of many cyclotomic numbers for which other methods are unknown or impractical. Our methods exploit connections between cyclotomy, Singer difference sets and finite geometry.


title: Rigidity of operator systems: tight extensions and noncommutative measurable structures

abstract: Let $A$ be a unital $C^*$-algebra generated by some separable operator system $S$. More than a decade ago, Arveson conjectured that $S$ is hyperrigid in $A$ if all irreducible representations of $A$ are boundary representations for $S$. Recently, a counterexample to the conjecture was found by Bilich and Dor-On. To circumvent the difficulties hidden in this counterexample, we exploit some of Pedersen's seminal ideas on noncommutative measurable structures and establish an amended version of Arveson's conjecture. More precisely, we show that all irreducible representations of $A$ are boundary representations for $S$ precisely when all representations of $A$ admit a unique "tight" completely positive extension from $S$. In addition, we prove an equivalence between uniqueness of such tight extensions and rigidity of completely positive approximations for representations of nuclear $C^*$-algebras, thereby extending the classical principle of Korovkin--Saskin for commutative algebras.


title: Beyond Thumbs Up/Down: Untangling Challenges of Fine-Grained Feedback for Text-to-Image Generation

abstract: Human feedback plays a critical role in learning and refining reward models for text-to-image generation, but the optimal form the feedback should take for learning an accurate reward function has not been conclusively established. This paper investigates the effectiveness of fine-grained feedback which captures nuanced distinctions in image quality and prompt-alignment, compared to traditional coarse-grained feedback (for example, thumbs up/down or ranking between a set of options). While fine-grained feedback holds promise, particularly for systems catering to diverse societal preferences, we show that demonstrating its superiority to coarse-grained feedback is not automatic. Through experiments on real and synthetic preference data, we surface the complexities of building effective models due to the interplay of model choice, feedback type, and the alignment between human judgment and computational interpretation. We identify key challenges in eliciting and utilizing fine-grained feedback, prompting a reassessment of its assumed benefits and practicality. Our findings -- e.g., that fine-grained feedback can lead to worse models for a fixed budget, in some settings; however, in controlled settings with known attributes, fine grained rewards can indeed be more helpful -- call for careful consideration of feedback attributes and potentially beckon novel modeling approaches to appropriately unlock the potential value of fine-grained feedback in-the-wild.


title: Exploring the Capability of Mamba in Speech Applications

abstract: This paper explores the capability of Mamba, a recently proposed architecture based on state space models (SSMs), as a competitive alternative to Transformer-based models. In the speech domain, well-designed Transformer-based models, such as the Conformer and E-Branchformer, have become the de facto standards. Extensive evaluations have demonstrated the effectiveness of these Transformer-based models across a wide range of speech tasks. In contrast, the evaluation of SSMs has been limited to a few tasks, such as automatic speech recognition (ASR) and speech synthesis. In this paper, we compared Mamba with state-of-the-art Transformer variants for various speech applications, including ASR, text-to-speech, spoken language understanding, and speech summarization. Experimental evaluations revealed that Mamba achieves comparable or better performance than Transformer-based models, and demonstrated its efficiency in long-form speech processing.


title: 3D distortion-free, reduced field of view diffusion-prepared GRE at 3T

abstract: Purpose: To develop a 3D distortion-free reduced-FOV diffusion-prepared GRE sequence and demonstrate its in-vivo application for diffusion imaging of the spinal cord in healthy volunteers. Methods: A 3D multi-shot reduced-FOV diffusion-prepared GRE (RFOV-DP-GRE) acquisition is achieved using a slice-selective tip-down pulse in the phase encoding direction in the diffusion preparation, combined with magnitude stabilisers. The efficacy of the developed reduced FOV approach and accuracy of ADC estimates were evaluated in a phantom. In addition, 5 healthy volunteers were enrolled and scanned at 3T using the proposed sequence and a standard spin echo diffusion-weighted single-shot EPI sequence (DW-SS-EPI) for spinal cord imaging. Image quality, perceived SNR and image distortion were assessed by two expert readers and quantitative measurements of apparent SNR were performed. Results: The phantom scan demonstrates the efficacy of the proposed reduced FOV approach. Consistent ADC estimates were measured with RFOV-DP-GRE when compared with DW-SS-EPI. In-vivo, RFOV-DP-GRE demonstrated improved image quality and reduced perceived distortion, while maintaining perceived SNR compared to DW-SS-EPI. Conclusion: 3D Distortion-free diffusion-prepared imaging can be achieved using the proposed sequence


title: PISTOL: Dataset Compilation Pipeline for Structural Unlearning of LLMs

abstract: Recently, machine unlearning, which seeks to erase specific data stored in the pre-trained or fine-tuned models, has emerged as a crucial protective measure for LLMs. However, unlearning approaches for LLMs that have been considered thus far have focused on the removal of independent data points and have not taken into account that the stored facts are logically connected to one another and form an implicit knowledge graph. To facilitate the development of structural unlearning methods, which are essential for the practical application of unlearning, we propose PISTOL, a pipeline for compiling multi-scenario datasets for benchmarking structural LLM unlearning. Additionally, leveraging sample datasets synthesized using PISTOL, we conducted benchmarks with four distinct unlearning methods on both Llama2-7B and Mistral-7B models. This analysis helps to illustrate the prevailing challenges in effectively and robustly removing highly inter-connected data, batched data, or data skewed towards a specific domain. It also highlights the choice of pre-trained model can impact unlearning performance. This work not only advances our understandings on the limitation of current LLMs unlearning methods and proposes future research directions, but also provides a replicable framework for ongoing exploration and validation in the field.


title: Constraining Cosmological Parameters with Needlet Internal Linear Combination Maps II: Likelihood-Free Inference on NILC Power Spectra

abstract: Standard cosmic microwave background (CMB) analyses constrain cosmological and astrophysical parameters by fitting parametric models to multifrequency power spectra (MFPS). However, such methods do not optimally weight maps in power spectrum (PS) measurements for non-Gaussian CMB foregrounds. We propose needlet internal linear combination (NILC), operating on wavelets with compact support in pixel and harmonic space, as a weighting scheme to yield more optimal parameter constraints. In a companion paper, we derived an analytic formula for NILC map PS, which is physically insightful but computationally difficult to use in parameter inference pipelines. In this work, we analytically show that fitting parametric templates to MFPS and harmonic ILC PS yields identical parameter constraints when the number of sky components equals or exceeds the number of frequency channels. We numerically show that, for Gaussian random fields, the same holds for NILC PS. This suggests that NILC can reduce parameter error bars in the presence of non-Gaussian fields since it uses non-Gaussian information. As Gaussian likelihoods may be inaccurate, we use likelihood-free inference (LFI) with neural posterior estimation. We show that performing inference with auto- and cross-PS of NILC component maps as summary statistics yields smaller parameter error bars than inference with MFPS. For a model with CMB, an amplified thermal Sunyaev--Zel'dovich (tSZ) signal, and noise, we find a 60% reduction in the area of the 2D 68% confidence region for component amplitude parameters inferred from NILC PS, as compared to inference from MFPS. Primordial $B$-mode searches are a promising application for our new method, as the amplitude of the non-Gaussian dust foreground is known to be larger than a potential signal. Our code is available in https://github.com/kmsurrao/NILC-Inference-Pipeline.


title: FlipDyn in Graphs: Resource Takeover Games in Graphs

abstract: We present \texttt{FlipDyn-G}, a dynamic game model extending the \texttt{FlipDyn} framework to a graph-based setting, where each node represents a dynamical system. This model captures the interactions between a defender and an adversary who strategically take over nodes in a graph to minimize (resp. maximize) a finite horizon additive cost. At any time, the \texttt{FlipDyn} state is represented as the current node, and each player can transition the \texttt{FlipDyn} state to a depending based on the connectivity from the current node. Such transitions are driven by the node dynamics, state, and node-dependent costs. This model results in a hybrid dynamical system where the discrete state (\texttt{FlipDyn} state) governs the continuous state evolution and the corresponding state cost. Our objective is to compute the Nash equilibrium of this finite horizon zero-sum game on a graph. Our contributions are two-fold. First, we model and characterize the \texttt{FlipDyn-G} game for general dynamical systems, along with the corresponding Nash equilibrium (NE) takeover strategies. Second, for scalar linear discrete-time dynamical systems with quadratic costs, we derive the NE takeover strategies and saddle-point values independent of the continuous state of the system. Additionally, for a finite state birth-death Markov chain (represented as a graph) under scalar linear dynamical systems, we derive analytical expressions for the NE takeover strategies and saddle-point values. We illustrate our findings through numerical studies involving epidemic models and linear dynamical systems with adversarial interactions.


title: PixelPop: High Resolution Nonparameteric Inference of Gravitational-Wave Populations in Multiple Dimensions

abstract: The origins of merging compact binaries observed by gravitational-wave detectors remains highly uncertain. Several astrophysical channels may contribute to the overall merger rate, with distinct formation processes imprinted on the structure and correlations in the underlying distributions of binary source parameters. In the absence of confident theoretical models, the current understanding of this population mostly relies on simple parametric models that make strong assumptions and are prone to misspecification. Recent work has made progress using more flexible nonparametric models, but detailed measurement of the multidimensional population remains challenging. In pursuit of this, we present PixelPop-a high resolution Bayesian nonparametric model to infer joint distributions and parameter correlations with minimal assumptions. PixelPop densely bins the joint parameter space and directly infers the merger rate in each bin, assuming only that bins are coupled to their nearest neighbors. We demonstrate this method on mock populations with and without bivariate source correlations, employing several statistical metrics for information gain and correlation significance to quantify our nonparametric results. We show that PixelPop correctly recovers the true populations within posterior uncertainties and offers a conservative assessment of population-level features and parameter correlations. Its flexibility and tractability make it a useful data-driven tool to probe gravitational-wave populations in multiple dimensions.


title: Convergence analysis of a stochastic heavy-ball method for linear ill-posed problems

abstract: In this paper we consider a stochastic heavy-ball method for solving linear ill-posed inverse problems. With suitable choices of the step-sizes and the momentum coefficients, we establish the regularization property of the method under {\it a priori} selection of the stopping index and derive the rate of convergence under a benchmark source condition on the sought solution. Numerical results are provided to test the performance of the method.


title: ClotheDreamer: Text-Guided Garment Generation with 3D Gaussians

abstract: High-fidelity 3D garment synthesis from text is desirable yet challenging for digital avatar creation. Recent diffusion-based approaches via Score Distillation Sampling (SDS) have enabled new possibilities but either intricately couple with human body or struggle to reuse. We introduce ClotheDreamer, a 3D Gaussian-based method for generating wearable, production-ready 3D garment assets from text prompts. We propose a novel representation Disentangled Clothe Gaussian Splatting (DCGS) to enable separate optimization. DCGS represents clothed avatar as one Gaussian model but freezes body Gaussian splats. To enhance quality and completeness, we incorporate bidirectional SDS to supervise clothed avatar and garment RGBD renderings respectively with pose conditions and propose a new pruning strategy for loose clothing. Our approach can also support custom clothing templates as input. Benefiting from our design, the synthetic 3D garment can be easily applied to virtual try-on and support physically accurate animation. Extensive experiments showcase our method's superior and competitive performance. Our project page is at https://ggxxii.github.io/clothedreamer.


title: On the Impact of Sample Size in Reconstructing Noisy Graph Signals: A Theoretical Characterisation

abstract: Reconstructing a signal on a graph from noisy observations of a subset of the vertices is a fundamental problem in the field of graph signal processing. This paper investigates how sample size affects reconstruction error in the presence of noise via an in-depth theoretical analysis of the two most common reconstruction methods in the literature, least-squares reconstruction (LS) and graph-Laplacian regularised reconstruction (GLR). Our theorems show that at sufficiently low signal-to-noise ratios (SNRs), under these reconstruction methods we may simultaneously decrease sample size and decrease average reconstruction error. We further show that at sufficiently low SNRs, for LS reconstruction we have a $\Lambda$-shaped error curve and for GLR reconstruction, a sample size of $ \mathcal{O}(\sqrt{N})$, where $N$ is the total number of vertices, results in lower reconstruction error than near full observation. We present thresholds on the SNRs, $\tau$ and $\tau_{GLR}$, below which the error is non-monotonic, and illustrate these theoretical results with experiments across multiple random graph models, sampling schemes and SNRs. These results demonstrate that any decision in sample-size choice has to be made in light of the noise levels in the data.


title: GPT-4V Explorations: Mining Autonomous Driving

abstract: This paper explores the application of the GPT-4V(ision) large visual language model to autonomous driving in mining environments, where traditional systems often falter in understanding intentions and making accurate decisions during emergencies. GPT-4V introduces capabilities for visual question answering and complex scene comprehension, addressing challenges in these specialized settings.Our evaluation focuses on its proficiency in scene understanding, reasoning, and driving functions, with specific tests on its ability to recognize and interpret elements such as pedestrians, various vehicles, and traffic devices. While GPT-4V showed robust comprehension and decision-making skills, it faced difficulties in accurately identifying specific vehicle types and managing dynamic interactions. Despite these challenges, its effective navigation and strategic decision-making demonstrate its potential as a reliable agent for autonomous driving in the complex conditions of mining environments, highlighting its adaptability and operational viability in industrial settings.


title: Damping effects of viscous dissipation on growth of symmetric instability

abstract: Symmetric instability (SI) is a frontal instability arising from the interaction of rotation with lateral and vertical shear of a frontal jet and is a generalization of shear, centrifugal, and gravitational instabilities. While the onset of SI has been studied in numerous observations and models, intuition about its growth in physical ocean comes primarily from constant-viscosity linear instability analysis and large eddy simulation (LES). A forward cascade arising from SI in the real ocean, where numerous fine-to-microscale processes interact with growing SI velocity cells, is less understood. While many instances of symmetrically unstable flow have been observed, observations of enhanced turbulent kinetic energy (TKE) dissipation ($\epsilon$) at these sites are less common. We use numerical instability analysis of an idealized geostrophic jet to show that viscous-diffusive effects of preexisting turbulence from other turbulent processes (e.g., competing instabilities, internal wave processes, or boundary layer processes) can suppress the growth of SI in the real ocean. For example, a moderate level of ambient turbulence, represented by uniform diffusivity and viscosity of $\kappa =\nu = 10^{-4} m^2/s$, restricts the wavelength range of SI's fastest-growing mode from $\mathcal{O}(10-100)$m to $\mathcal{O}(100)$m and elongates its e-folding timescale by $\mathcal{O}(1-10)$ hrs; suggesting the net viscous-diffusive effects of preexisting turbulence can damp the growth of SI. Viscous damping is one possible explanation for the rarity of SI structures in the real ocean, and our results motivate the inclusion of dependence on previous-timestep $\epsilon$ or $\kappa$ when parameterizing SI in regional models.


title: Entropy as Noether charge for quasistatic gradient flow

abstract: Entropy increase is fundamentally related to the breaking of time-reversal symmetry. By adding the 'extra dimension' associated with thermodynamic forces, we extend that discrete symmetry to a continuous symmetry for the dynamical fluctuations around (nonlinear) gradient flow. The latter connects macroscopic equilibrium conditions upon introducing a quasistatic protocol of control parameters. The entropy state function becomes the Noether charge. As a result, and following ideas expressed by Shin-ichi Sasa and co-workers, the adiabatic invariance of the entropy, part of the Clausius heat theorem, gets connected with the Noether theorem.


title: EFECT -- A Method and Metric to Assess the Reproducibility of Stochastic Simulation Studies

abstract: Reproducibility is a foundational standard for validating scientific claims in computational research. Stochastic computational models are employed across diverse fields such as systems biology, financial modelling and environmental sciences. Existing infrastructure and software tools support various aspects of reproducible model development, application, and dissemination, but do not adequately address independently reproducing simulation results that form the basis of scientific conclusions. To bridge this gap, we introduce the Empirical Characteristic Function Equality Convergence Test (EFECT), a data-driven method to quantify the reproducibility of stochastic simulation results. EFECT employs empirical characteristic functions to compare reported results with those independently generated by assessing distributional inequality, termed EFECT error, a metric to quantify the likelihood of equality. Additionally, we establish the EFECT convergence point, a metric for determining the required number of simulation runs to achieve an EFECT error value of a priori statistical significance, setting a reproducibility benchmark. EFECT supports all real-valued and bounded results irrespective of the model or method that produced them, and accommodates stochasticity from intrinsic model variability and random sampling of model inputs. We tested EFECT with stochastic differential equations, agent-based models, and Boolean networks, demonstrating its broad applicability and effectiveness. EFECT standardizes stochastic simulation reproducibility, establishing a workflow that guarantees reliable results, supporting a wide range of stakeholders, and thereby enhancing validation of stochastic simulation studies, across a model's lifecycle. To promote future standardization efforts, we are developing open source software library libSSR in diverse programming languages for easy integration of EFECT.


title: General Binding Affinity Guidance for Diffusion Models in Structure-Based Drug Design

abstract: Structure-Based Drug Design (SBDD) focuses on generating valid ligands that strongly and specifically bind to a designated protein pocket. Several methods use machine learning for SBDD to generate these ligands in 3D space, conditioned on the structure of a desired protein pocket. Recently, diffusion models have shown success here by modeling the underlying distributions of atomic positions and types. While these methods are effective in considering the structural details of the protein pocket, they often fail to explicitly consider the binding affinity. Binding affinity characterizes how tightly the ligand binds to the protein pocket, and is measured by the change in free energy associated with the binding process. It is one of the most crucial metrics for benchmarking the effectiveness of the interaction between a ligand and protein pocket. To address this, we propose BADGER: Binding Affinity Diffusion Guidance with Enhanced Refinement. BADGER is a general guidance method to steer the diffusion sampling process towards improved protein-ligand binding, allowing us to adjust the distribution of the binding affinity between ligands and proteins. Our method is enabled by using a neural network (NN) to model the energy function, which is commonly approximated by AutoDock Vina (ADV). ADV's energy function is non-differentiable, and estimates the affinity based on the interactions between a ligand and target protein receptor. By using a NN as a differentiable energy function proxy, we utilize the gradient of our learned energy function as a guidance method on top of any trained diffusion model. We show that our method improves the binding affinity of generated ligands to their protein receptors by up to 60\%, significantly surpassing previous machine learning methods. We also show that our guidance method is flexible and can be easily applied to other diffusion-based SBDD frameworks.

categories: cs.LG cs.AI physics.bio-ph physics.chem-ph q-bio.BM


title: A Multi-Party, Multi-Blockchain Atomic Swap Protocol with Universal Adaptor Secret

abstract: The increasing complexity of digital asset transactions across multiple blockchains necessitates a robust atomic swap protocol that can securely handle more than two participants. Traditional atomic swap protocols, including those based on adaptor signatures, are vulnerable to malicious dropout attacks, which break atomicity and compromise the security of the transaction. This paper presents a novel multi-party atomic swap protocol that operates almost entirely off-chain, requiring only a single on-chain transaction for finalization. Our protocol leverages Schnorr-like signature verification and a universal adaptor secret to ensure atomicity and scalability across any number of participants and blockchains without the need for smart contracts or trusted third parties. By addressing key challenges such as collusion attacks and malicious dropouts, our protocol significantly enhances the security and efficiency of multi-party atomic swaps. Our contributions include the first scalable, fully off-chain protocol for atomic swaps involving any number of participants, adding zero overhead to native blockchains, and providing a practical and cost-effective solution for decentralized asset exchanges.


title: Characterization of isomers produced by the spontaneous fission of ${}^{252}$Cf with the VESPA setup

abstract: Isomers produced by spontaneous fission of ${}^{252}$Cf have been measured with the VESPA setup, composed of LaBr$_3$(Ce) detectors for fast $\gamma$-ray spectroscopy and an ionization chamber for detecting fission fragments. Identification of the isomers was derived from fission fragment-$\gamma$-$\gamma$ coincidences. This paper presents the half-life of 34 isomeric states measured with this setup, from less than the nanosecond up to tens of microseconds. Two of these isomers are reported for the first time, in ${}^{108}$Tc and ${}^{147}$Ce. In addition to this half-life analysis, the isomers are used to develop and test a nuclear charge calibration of the ionization chamber.


title: Exploring Simple-Population and Multiple-Population Globular Clusters in the Outer Galactic Halo using the Hubble Space Telescope

abstract: The pseudo two-color diagram, known as chromosome map (ChM), is a valuable tool for identifying globular clusters (GCs) that consist of single or multiple stellar populations (MPs). Recent surveys of Galactic GCs using the ChM have provided stringent observational constraints on the formation of GCs and their stellar populations. However, these surveys have primarily focused on GCs at moderate distances from the Galactic center and composed of MPs. In this paper, we present the first detailed study of the stellar composition of four GCs in the outer halo of the Milky Way: Arp 2, Ruprecht 106, Terzan 7, and Terzan 8. Our analysis is based on highprecision photometry obtained from images collected with the Hubble Space Telescope in the F275W, F336W, F438W, F606W, and F814W bands. We find that Ruprecht 106 and Terzan 7 are composed solely of a single stellar population, whereas Arp 2 and Terzan 8 host both first- and second-population stars. In these clusters, the second population comprises about half and one-third of the total number of GC stars, respectively. The results from this paper and the literature suggest that the threshold in the initial GC mass, if present, should be smaller than approximately $10^{5}$ $M_{\odot}$. The first-population stars of Arp 2 and Terzan 8, along with the stars of the simple-population GCs Ruprecht 106 and Terzan 7, exhibit intrinsic F275W - F814W color spreads corresponding to [Fe/H] variations of approximately 0.05 - 0.30 dex. This indicates that star-to-star metallicity variations are a common feature of star clusters, regardless of the presence of MPs.


title: Derived Moduli Spaces of Nonlinear PDEs II: Variational Tricomplex and BV Formalism

abstract: This paper is the second in a series of works dedicated to studying non-linear partial differential equations via derived geometric methods. We study a natural derived enhancement of the de Rham complex of a non-linear PDE via algebro-geometric techniques and examine its consequences for the functional differential calculus on the space of solutions. Applications to the BV-formalism with and without boundary conditions are discussed.


title: Practical privacy metrics for synthetic data

abstract: This paper explains how the synthpop package for R has been extended to include functions to calculate measures of identity and attribute disclosure risk for synthetic data that measure risks for the records used to create the synthetic data. The basic function, disclosure, calculates identity disclosure for a set of quasi-identifiers (keys) and attribute disclosure for one variable specified as a target from the same set of keys. The second function, disclosure.summary, is a wrapper for the first and presents summary results for a set of targets. This short paper explains the measures of disclosure risk and documents how they are calculated. We recommend two measures: $RepU$ (replicated uniques) for identity disclosure and $DiSCO$ (Disclosive in Synthetic Correct Original) for attribute disclosure. Both are expressed a \% of the original records and each can be compared to similar measures calculated from the original data. Experience with using the functions on real data found that some apparent disclosures could be identified as coming from relationships in the data that would be expected to be known to anyone familiar with its features. We flag cases when this seems to have occurred and provide means of excluding them.


title: Testing multipartite productness is easier than testing bipartite productness

abstract: We prove a lower bound on the number of copies needed to test the property of a multipartite quantum state being product across some bipartition (i.e. not genuinely multipartite entangled), given the promise that the input state either has this property or is $\epsilon$-far in trace distance from any state with this property. We show that $\Omega(n / \log n)$ copies are required (for fixed $\epsilon \leq \frac{1}{2}$), complementing a previous result that $O(n / \epsilon^2)$ copies are sufficient. Our proof technique proceeds by considering uniformly random ensembles over such states, and showing that the trace distance between these ensembles becomes arbitrarily small for sufficiently large $n$ unless the number of copies is at least $\Omega (n / \log n)$. We discuss implications for testing graph states and computing the generalised geometric measure of entanglement.