title: Pseudo-easy-axis anisotropy in antiferromagnetic $S=1$ diamond-lattice systems

abstract: We investigate the magnetic properties of $S=1$ antiferromagnetic diamond lattice, Ni$X_{2}$(pyrimidine)$_{2}$ ($X$ = Cl, Br), hosting a single-ion anisotropy (SIA) orientation which alternates between neighbouring sites. Through neutron diffraction measurements of the $X$ = Cl compound, the ordered state spins are found to align collinearly along a pseudo-easy-axis, a unique direction created by the intersection of two easy planes. Similarities in the magnetization, exhibiting spin-flop transitions, and the magnetic susceptibility in the two compounds imply that the same magnetic structure and a pseudo-easy-axis is also present for $X$ = Br. We estimate the Hamiltonian parameters by combining analytical calculations and Monte-Carlo (MC) simulations of the spin-flop and saturation field. The MC simulations also reveal that the spin-flop transition occurs when the applied field is parallel to the pseudo-easy-axis. Contrary to conventional easy-axis systems, there exist field directions perpendicular to the pseudo-easy-axis for which the magnetic saturation is approached asymptotically and no symmetry-breaking phase transition is observed at finite fields.


title: Inverse-RLignment: Inverse Reinforcement Learning from Demonstrations for LLM Alignment

abstract: Aligning Large Language Models (LLMs) is crucial for enhancing their safety and utility. However, existing methods, primarily based on preference datasets, face challenges such as noisy labels, high annotation costs, and privacy concerns. In this work, we introduce Alignment from Demonstrations (AfD), a novel approach leveraging high-quality demonstration data to overcome these challenges. We formalize AfD within a sequential decision-making framework, highlighting its unique challenge of missing reward signals. Drawing insights from forward and inverse reinforcement learning, we introduce divergence minimization objectives for AfD. Analytically, we elucidate the mass-covering and mode-seeking behaviors of various approaches, explaining when and why certain methods are superior. Practically, we propose a computationally efficient algorithm that extrapolates over a tailored reward model for AfD. We validate our key insights through experiments on the Harmless and Helpful tasks, demonstrating their strong empirical performance while maintaining simplicity.


title: Nonlinear denoising score matching for enhanced learning of structured distributions

abstract: We present a novel method for training score-based generative models which uses nonlinear noising dynamics to improve learning of structured distributions. Generalizing to a nonlinear drift allows for additional structure to be incorporated into the dynamics, thus making the training better adapted to the data, e.g., in the case of multimodality or (approximate) symmetries. Such structure can be obtained from the data by an inexpensive preprocessing step. The nonlinear dynamics introduces new challenges into training which we address in two ways: 1) we develop a new nonlinear denoising score matching (NDSM) method, 2) we introduce neural control variates in order to reduce the variance of the NDSM training objective. We demonstrate the effectiveness of this method on several examples: a) a collection of low-dimensional examples, motivated by clustering in latent space, b) high-dimensional images, addressing issues with mode collapse, small training sets, and approximate symmetries, the latter being a challenge for methods based on equivariant neural networks, which require exact symmetries.


title: A generalized $\Lambda$CDM model with parameterized Hubble parameter in particle creation, viscous and $f(R)$ model framework

abstract: In this study, we construct a theoretical framework based on the generalized Hubble parameter form which may arise within the particle creation, viscous and $f(R)$ gravity theory. The Hubble parameter is scrutinized for its compatibility with the observational data relevant to the late-time universe. By using Bayesian statistical techniques based on $\chi^{2}$ minimization method, we determine model parameters's best fit values for the cosmic chronometer and supernovae Pantheon datasets. For the best fit values, the cosmographic and physical parameters are analyzed to understand the cosmic dynamics in model.


title: The Scattering Matrix-Based Characteristic Mode for Structure amidst Arbitrary Background: Theory, Benchmark and Applications

abstract: This paper presents a novel approach for computing substructure characteristic modes. This method leverages electromagnetic scattering matrices and spherical wave expansion to directly decompose electromagnetic fields. Unlike conventional methods that rely on the impedance matrix generated by the method of moments (MoM), our technique simplifies the problem into a small-scale ordinary eigenvalue problem, improving numerical dynamics and computational efficiency. We have developed analytical substructure characteristic mode solutions for a scenario involving two spheres, which can serve as benchmarks for evaluating other numerical solvers. A key advantage of our method is its independence from specific MoM frameworks, allowing for the use of various numerical methods. This flexibility paves the way for substructure characteristic mode decomposition to become a universal frequency technique.


title: A Comparative Analysis of Distributed Training Strategies for GPT-2

abstract: The rapid advancement in Large Language Models has been met with significant challenges in their training processes, primarily due to their considerable computational and memory demands. This research examines parallelization techniques developed to address these challenges, enabling the efficient and scalable training of Large Language Models. A comprehensive analysis of both data and model parallelism strategies, including Fully Sharded Data Parallelism and Distributed Data-Parallel frameworks, is provided to assess methods that facilitate efficient model training. Furthermore, the architectural complexities and training methodologies of the Generative Pre-Trained Transformer-2 model are explored. The application of these strategies is further investigated, which is crucial in managing the substantial computational and memory demands of training sophisticated models. This analysis not only highlights the effectiveness of these parallel training strategies in enhancing training efficiency but also their role in enabling the scalable training of large language models. Drawing on recent research findings, through a comprehensive literature review, this research underscores the critical role of parallelization techniques in addressing the computational challenges of training state-of-the-art Large Language Models, thereby contributing to the advancement of training more sophisticated and capable artificial intelligence systems.


title: HI Galaxy Signatures in the SARAO MeerKAT Galactic Plane Survey -- III. Unveiling the obscured part of the Vela Supercluster

abstract: We conducted a search for HI emission of the gas-rich galaxies in the Vela region ($260^{\circ} \leq \ell \leq 290^{\circ}, -2^{\circ} \leq b \leq 1^{\circ}$) to explore the Vela Supercluster (VSCL) at $V_\mathrm{hel} \sim 18000$ km s$^{-1}$, largely obscured by Galactic dust. Within the mostly RFI-free band ($250 < V_\mathrm{hel} < 25000$ km s$^{-1}$) of MeerKAT, the analysis focuses on $157$ hexagonally distributed pointings extracted from the SARAO MeerKAT Galactic Plane Survey located in the Vela region (Vela$-$SMGPS). These were combined into 10 contiguous mosaics, covering a ${\sim}90$ deg$^2$ area. Among the $843$ HI detected sources, 39 were previously discovered in the Parkes HIZOA survey ($V_\mathrm{hel} < 12000$ km s$^{-1}$; rms $\sim 6$ mJy beam$^{-1}$). With the improved rms level of the Vela$-$SMGPS, i.e., $0.29 - 0.56$ mJy beam$^{-1}$, our study unveils nearly 12 times more detections (471 candidates) in that same velocity range. We furthermore could identify $187$ galaxy candidates with an HI mass limit reaching $\log (M_{\rm HI}/\rm M_{\odot}) = 9.44$ in the VSCL velocity range $V_\mathrm{hel} \sim 19500 \pm 3500$ km s$^{-1}$. We find indications of two wall-like overdensities that confirm the original suspicion that these walls intersect at low latitudes around longitudes of $\ell \sim 272^{\circ} - 278^{\circ}$. We also find a strong signature most likely associated with the Hydra/Antlia extension and evidence of a previously unknown narrow filament at $V_\mathrm{hel} \sim 12000$ km s$^{-1}$. This paper demonstrates the efficiency of systematic HI surveys with the SKA precursor MeerKAT, even in the most obscured part of the Zone of Avoidance (ZOA).


title: GPTZoo: A Large-scale Dataset of GPTs for the Research Community

abstract: The rapid advancements in Large Language Models (LLMs) have revolutionized natural language processing, with GPTs, customized versions of ChatGPT available on the GPT Store, emerging as a prominent technology for specific domains and tasks. To support academic research on GPTs, we introduce GPTZoo, a large-scale dataset comprising 730,420 GPT instances. Each instance includes rich metadata with 21 attributes describing its characteristics, as well as instructions, knowledge files, and third-party services utilized during its development. GPTZoo aims to provide researchers with a comprehensive and readily available resource to study the real-world applications, performance, and potential of GPTs. To facilitate efficient retrieval and analysis of GPTs, we also developed an automated command-line interface (CLI) that supports keyword-based searching of the dataset. To promote open research and innovation, the GPTZoo dataset will undergo continuous updates, and we are granting researchers public access to GPTZoo and its associated tools.


title: An analysis of Wardrop equilibrium and social optimum in congested transit networks

abstract: The effective design and management of public transport systems are essential to ensure the best service for users. The performance of a transport system will depend heavily on user behaviour. In the common-lines problem approach, users choose which lines to use based on the best strategy for them. While Wardrop equilibrium has been studied for the common-lines problem, no contributions have been made towards achieving the social optimum. In this work, we propose two optimisation problems to obtain this optimum, using strategy flow and line flow formulations. We prove that both optimisation problems are equivalent, and we obtain a characterisation of the social optimum flows. The social optimum makes it possible to compute the price of anarchy (PoA), which quantifies the system's efficiency. The study of the PoA enables the effective design and management of public transport systems, guaranteeing the best service to users.


title: Federated Behavioural Planes: Explaining the Evolution of Client Behaviour in Federated Learning

abstract: Federated Learning (FL), a privacy-aware approach in distributed deep learning environments, enables many clients to collaboratively train a model without sharing sensitive data, thereby reducing privacy risks. However, enabling human trust and control over FL systems requires understanding the evolving behaviour of clients, whether beneficial or detrimental for the training, which still represents a key challenge in the current literature. To address this challenge, we introduce Federated Behavioural Planes (FBPs), a novel method to analyse, visualise, and explain the dynamics of FL systems, showing how clients behave under two different lenses: predictive performance (error behavioural space) and decision-making processes (counterfactual behavioural space). Our experiments demonstrate that FBPs provide informative trajectories describing the evolving states of clients and their contributions to the global model, thereby enabling the identification of clusters of clients with similar behaviours. Leveraging the patterns identified by FBPs, we propose a robust aggregation technique named Federated Behavioural Shields to detect malicious or noisy client models, thereby enhancing security and surpassing the efficacy of existing state-of-the-art FL defense mechanisms.


title: Less is more: Summarizing Patch Tokens for efficient Multi-Label Class-Incremental Learning

abstract: Prompt tuning has emerged as an effective rehearsal-free technique for class-incremental learning (CIL) that learns a tiny set of task-specific parameters (or prompts) to instruct a pre-trained transformer to learn on a sequence of tasks. Albeit effective, prompt tuning methods do not lend well in the multi-label class incremental learning (MLCIL) scenario (where an image contains multiple foreground classes) due to the ambiguity in selecting the correct prompt(s) corresponding to different foreground objects belonging to multiple tasks. To circumvent this issue we propose to eliminate the prompt selection mechanism by maintaining task-specific pathways, which allow us to learn representations that do not interact with the ones from the other tasks. Since independent pathways in truly incremental scenarios will result in an explosion of computation due to the quadratically complex multi-head self-attention (MSA) operation in prompt tuning, we propose to reduce the original patch token embeddings into summarized tokens. Prompt tuning is then applied to these fewer summarized tokens to compute the final representation. Our proposed method Multi-Label class incremental learning via summarising pAtch tokeN Embeddings (MULTI-LANE) enables learning disentangled task-specific representations in MLCIL while ensuring fast inference. We conduct experiments in common benchmarks and demonstrate that our MULTI-LANE achieves a new state-of-the-art in MLCIL. Additionally, we show that MULTI-LANE is also competitive in the CIL setting. Source code available at https://github.com/tdemin16/multi-lane


title: Proyective Cohen-Macaulay monomial curves and their affine charts

abstract: In this paper, we explore when the Betti numbers of the coordinate rings of a projective monomial curve and one of its affine charts are identical. Given an infinite field $k$ and a sequence of relatively prime integers $a_0 = 0 < a_1 < \cdots < a_n = d$, we consider the projective monomial curve $\mathcal{C}\subset\mathbb{P}_k^{\,n}$ of degree $d$ parametrically defined by $x_i = u^{a_i}v^{d-a_i}$ for all $i \in \{0,\ldots,n\}$ and its coordinate ring $k[\mathcal{C}]$. The curve $\mathcal{C}_1 \subset \mathbb A_k^n$ with parametric equations $x_i = t^{a_i}$ for $i \in \{1,\ldots,n\}$ is an affine chart of $\mathcal{C}$ and we denote by $k[\mathcal{C}_1]$ its coordinate ring. The main contribution of this paper is the introduction of a novel (Gr\"obner-free) combinatorial criterion that provides a sufficient condition for the equality of the Betti numbers of $k[\mathcal{C}]$ and $k[\mathcal{C}_1]$. Leveraging this criterion, we identify infinite families of projective curves satisfying this property. Also, we use our results to study the so-called shifted family of monomial curves, i.e., the family of curves associated to the sequences $j+a_1 < \cdots < j+a_n$ for different values of $j \in \mathbb N$. In this context, Vu proved that for large enough values of $j$, one has an equality between the Betti numbers of the corresponding affine and projective curves. Using our results, we improve Vu's upper bound for the least value of $j$ such that this occurs.


title: Taut foliations and contact pairs in dimension three

abstract: We present a new construction of codimension-one foliations from pairs of contact structures in dimension three. This constitutes a converse result to a celebrated theorem of Eliashberg and Thurston on approximations of foliations by contact structures. Under suitable hypotheses on the initial contact pairs, the foliations we construct are taut, allowing us to characterize taut foliations entirely in terms of contact geometry. This viewpoint reveals some surprising flexible phenomena for taut foliations, and provides new insight into the $L$-space conjecture. The first part of the proof builds upon the work on Colin and Firmo on positive contact pairs. The second part involves a wide generalization of a technical result of Burago and Ivanov on the construction of branching foliations tangent to continuous plane fields, and might be of independent interest.


title: Visualize and Paint GAN Activations

abstract: We investigate how generated structures of GANs correlate with their activations in hidden layers, with the purpose of better understanding the inner workings of those models and being able to paint structures with unconditionally trained GANs. This gives us more control over the generated images, allowing to generate them from a semantic segmentation map while not requiring such a segmentation in the training data. To this end we introduce the concept of tileable features, allowing us to identify activations that work well for painting.


title: Clearing the Path for Software Sustainability

abstract: The advancement of software sustainability encounters notable challenges, underscoring the necessity for understanding these challenges to facilitate significant progress and pave the way for effective solutions to advance software sustainability. This paper outlines key challenges identified in literature based on findings from a tertiary study. Challenges identified include: confusion regarding the definition of software sustainability, uncertainty about when to consider sustainability in software development, lack of assessment metrics and tools, narrow perspectives on sustainability in software systems, insufficient awareness and education, and a lack of serious considerations in practice. The paper aims at clarifying the confusion surrounding software sustainability to motivate effective solutions. The provided recommendations aim to give a more organized approach towards advancing sustainable software development, emphasizing comprehensive strategies, the integration of sustainability as a fundamental aspect of software development, actionable research directions, and the cultivation of a common understanding of sustainable software.


title: M4U: Evaluating Multilingual Understanding and Reasoning for Large Multimodal Models

abstract: Multilingual multimodal reasoning is a core component in achieving human-level intelligence. However, most existing benchmarks for multilingual multimodal reasoning struggle to differentiate between models of varying performance; even language models without visual capabilities can easily achieve high scores. This leaves a comprehensive evaluation of leading multilingual multimodal models largely unexplored. In this work, we introduce M4U, a novel and challenging benchmark for assessing the capability of multi-discipline multilingual multimodal understanding and reasoning. M4U contains 8,931 samples covering 64 disciplines across 16 subfields in Science, Engineering, and Healthcare in Chinese, English, and German. Using M4U, we conduct extensive evaluations of 21 leading Large Multimodal Models (LMMs) and Large Language Models (LLMs) with external tools. The evaluation results show that the state-of-the-art model, GPT-4o, achieves only 47.6% average accuracy on M4U. Additionally, we observe that the leading LMMs exhibit significant language preferences. Our in-depth analysis indicates that leading LMMs, including GPT-4o, suffer performance degradation when prompted with cross-lingual multimodal questions, such as images with key textual information in Chinese while the question is in German. We believe that M4U can serve as a crucial tool for systematically evaluating LMMs based on their multilingual multimodal reasoning capabilities and monitoring their development. The homepage, codes and data are public available.


title: Well Posed Origin Anywhere Consistent Systems in Celestial Mechanics

abstract: Certain measurements in celestial mechanics necessitate having the origin O of a Cartesian coordinate system (CCS) coincide with a point mass. For the two and three body problems we show mathematical inadequacies in Newton's celestial mechanics equations (NCME) when the origin of a coordinate system coincides with a point mass. A certain system of equations of relative differences implied by NCME is free of these inadequacies and is invariant with respect to any CCS translation. A new constant of motion is derived for the relative system. It shows that the universe of relative differences of the $N$-body problem is ``restless''.

categories: math-ph astro-ph.EP math.DS math.MP physics.space-ph


title: GECKO: Generative Language Model for English, Code and Korean

abstract: We introduce GECKO, a bilingual large language model (LLM) optimized for Korean and English, along with programming languages. GECKO is pretrained on the balanced, high-quality corpus of Korean and English employing LLaMA architecture. In this report, we share the experiences of several efforts to build a better data pipeline for the corpus and to train our model. GECKO shows great efficiency in token generations for both Korean and English, despite its small size of vocabulary. We measure the performance on the representative benchmarks in terms of Korean, English and Code, and it exhibits great performance on KMMLU (Korean MMLU) and modest performance in English and Code, even with its smaller number of trained tokens compared to English-focused LLMs. GECKO is available to the open-source community under a permissive license. We hope our work offers a research baseline and practical insights for Korean LLM research. The model can be found at: https://huggingface.co/kifai/GECKO-7B


title: Predictive Uncertainty Quantification with Missing Covariates

abstract: Predictive uncertainty quantification is crucial in decision-making problems. We investigate how to adequately quantify predictive uncertainty with missing covariates. A bottleneck is that missing values induce heteroskedasticity on the response's predictive distribution given the observed covariates. Thus, we focus on building predictive sets for the response that are valid conditionally to the missing values pattern. We show that this goal is impossible to achieve informatively in a distribution-free fashion, and we propose useful restrictions on the distribution class. Motivated by these hardness results, we characterize how missing values and predictive uncertainty intertwine. Particularly, we rigorously formalize the idea that the more missing values, the higher the predictive uncertainty. Then, we introduce a generalized framework, coined CP-MDA-Nested*, outputting predictive sets in both regression and classification. Under independence between the missing value pattern and both the features and the response (an assumption justified by our hardness results), these predictive sets are valid conditionally to any pattern of missing values. Moreover, it provides great flexibility in the trade-off between statistical variability and efficiency. Finally, we experimentally assess the performances of CP-MDA-Nested* beyond its scope of theoretical validity, demonstrating promising outcomes in more challenging configurations than independence.


title: Effective Confidence Region Prediction Using Probability Forecasters

abstract: Confidence region prediction is a practically useful extension to the commonly studied pattern recognition problem. Instead of predicting a single label, the constraint is relaxed to allow prediction of a subset of labels given a desired confidence level 1-delta. Ideally, effective region predictions should be (1) well calibrated - predictive regions at confidence level 1-delta should err with relative frequency at most delta and (2) be as narrow (or certain) as possible. We present a simple technique to generate confidence region predictions from conditional probability estimates (probability forecasts). We use this 'conversion' technique to generate confidence region predictions from probability forecasts output by standard machine learning algorithms when tested on 15 multi-class datasets. Our results show that approximately 44% of experiments demonstrate well-calibrated confidence region predictions, with the K-Nearest Neighbour algorithm tending to perform consistently well across all data. Our results illustrate the practical benefits of effective confidence region prediction with respect to medical diagnostics, where guarantees of capturing the true disease label can be given.


title: Reducing the cost of posterior sampling in linear inverse problems via task-dependent score learning

abstract: Score-based diffusion models (SDMs) offer a flexible approach to sample from the posterior distribution in a variety of Bayesian inverse problems. In the literature, the prior score is utilized to sample from the posterior by different methods that require multiple evaluations of the forward mapping in order to generate a single posterior sample. These methods are often designed with the objective of enabling the direct use of the unconditional prior score and, therefore, task-independent training. In this paper, we focus on linear inverse problems, when evaluation of the forward mapping is computationally expensive and frequent posterior sampling is required for new measurement data, such as in medical imaging. We demonstrate that the evaluation of the forward mapping can be entirely bypassed during posterior sample generation. Instead, without introducing any error, the computational effort can be shifted to an offline task of training the score of a specific diffusion-like random process. In particular, the training is task-dependent requiring information about the forward mapping but not about the measurement data. It is shown that the conditional score corresponding to the posterior can be obtained from the auxiliary score by suitable affine transformations. We prove that this observation generalizes to the framework of infinite-dimensional diffusion models introduced recently and provide numerical analysis of the method. Moreover, we validate our findings with numerical experiments.

categories: stat.ML cs.LG cs.NA math.AP math.NA math.PR


title: Harnessing Increased Client Participation with Cohort-Parallel Federated Learning

abstract: Federated Learning (FL) is a machine learning approach where nodes collaboratively train a global model. As more nodes participate in a round of FL, the effectiveness of individual model updates by nodes also diminishes. In this study, we increase the effectiveness of client updates by dividing the network into smaller partitions, or cohorts. We introduce Cohort-Parallel Federated Learning (CPFL): a novel learning approach where each cohort independently trains a global model using FL, until convergence, and the produced models by each cohort are then unified using one-shot Knowledge Distillation (KD) and a cross-domain, unlabeled dataset. The insight behind CPFL is that smaller, isolated networks converge quicker than in a one-network setting where all nodes participate. Through exhaustive experiments involving realistic traces and non-IID data distributions on the CIFAR-10 and FEMNIST image classification tasks, we investigate the balance between the number of cohorts, model accuracy, training time, and compute and communication resources. Compared to traditional FL, CPFL with four cohorts, non-IID data distribution, and CIFAR-10 yields a 1.9$\times$ reduction in train time and a 1.3$\times$ reduction in resource usage, with a minimal drop in test accuracy.


title: An Online Probabilistic Distributed Tracing System

abstract: Distributed tracing has become a fundamental tool for diagnosing performance issues in the cloud by recording causally ordered, end-to-end workflows of request executions. However, tracing in production workloads can introduce significant overheads due to the extensive instrumentation needed for identifying performance variations. This paper addresses the trade-off between the cost of tracing and the utility of the "spans" within that trace through Astraea, an online probabilistic distributed tracing system. Astraea is based on our technique that combines online Bayesian learning and multi-armed bandit frameworks. This formulation enables Astraea to effectively steer tracing towards the useful instrumentation needed for accurate performance diagnosis. Astraea localizes performance variations using only 10-28% of available instrumentation, markedly reducing tracing overhead, storage, compute costs, and trace analysis time.


title: LLM-based Robot Task Planning with Exceptional Handling for General Purpose Service Robots

abstract: The development of a general purpose service robot for daily life necessitates the robot's ability to deploy a myriad of fundamental behaviors judiciously. Recent advancements in training Large Language Models (LLMs) can be used to generate action sequences directly, given an instruction in natural language with no additional domain information. However, while the outputs of LLMs are semantically correct, the generated task plans may not accurately map to acceptable actions and might encompass various linguistic ambiguities. LLM hallucinations pose another challenge for robot task planning, which results in content that is inconsistent with real-world facts or user inputs. In this paper, we propose a task planning method based on a constrained LLM prompt scheme, which can generate an executable action sequence from a command. An exceptional handling module is further proposed to deal with LLM hallucinations problem. This module can ensure the LLM-generated results are admissible in the current environment. We evaluate our method on the commands generated by the RoboCup@Home Command Generator, observing that the robot demonstrates exceptional performance in both comprehending instructions and executing tasks.


title: A Logic of Knowledge and Justifications, with an Application to Computational Trust

abstract: We present a logical framework that enables us to define a formal theory of computational trust in which this notion is analysed in terms of epistemic attitudes towards the possible objects of trust and in relation to existing evidence in favour of the trustworthiness of these objects. The framework is based on a quantified epistemic and justification logic featuring a non-standard handling of identities. Thus, the theory is able to account for the hyperintensional nature of computational trust. We present a proof system and a frame semantics for the logic, we prove soundness and completeness results and we introduce the syntactical machinery required to define a theory of trust.


title: A journey on self-$G$-ality

abstract: We explore topological manipulations in one spatial dimension, which are defined for a system with a global symmetry and map the system to another one with a dual symmetry. In particular, we discuss fusion category symmetries enhanced by the invariance of the actions of topological manipulations, i.e., self-$G$-alities for topological manipulations. Based on the self-$G$-ality conditions, we provide LSM-type constraints on the ground states of many-body Hamiltonians. We clarify the relationship between different enhanced symmetries and introduce the notion of $\textit{codimension-two transitions}$. We explore concrete lattice models for such self-$G$-alities and find how the self-$G$-ality structures match the IR critical theories.

categories: cond-mat.str-el hep-th math-ph math.MP math.QA


title: Asymptotic Theory for Estimation of the Husler-Reiss Distribution via Block Maxima Method

abstract: The H\"usler-Reiss distribution describes the limit of the pointwise maxima of a bivariate normal distribution. This distribution is defined by a single parameter, $\lambda$. We provide asymptotic theory for maximum likelihood estimation of $\lambda$ under a block maxima approach. Our work assumes independent and identically distributed bivariate normal random variables, grouped into blocks where the block size and number of blocks increase simultaneously. With these assumptions our results provide conditions for the asymptotic normality of the Maximum Likelihood Estimator (MLE). We characterize the bias of the MLE, provide conditions under which this bias is asymptotically negligible, and discuss how to choose the block size to minimize a bias-variance trade-off. The proofs are an extension of previous results for choosing the block size in the estimation of univariate extreme value distributions (Dombry and Ferreria 2019), providing a potential basis for extensions to multivariate cases where both the marginal and dependence parameters are unknown. The proofs rely on the Argmax Theorem applied to a localized loglikelihood function, combined with a Lindeberg-Feller Central Limit Theorem argument to establish asymptotic normality. Possible applications of the method include composite likelihood estimation in Brown-Resnick processes, where it is known that the bivariate distributions are of H\"usler-Reiss form.


title: Tuning structural modulation and magnetic properties in metal-organic coordination polymers [CH$_3$NH$_3$]Co$_x$Ni$_{1-x}$(HCOO)$_3$

abstract: Three solid solutions of [CH$_3$NH$_3$]Co$_x$Ni$_{1-x}$(HCOO)$_3$, with $x$ = 0.25 (1), 0.50 (2) and 0.75 (3), were synthesized and their nuclear structures and magnetic properties were characterized using single crystal neutron diffraction and magnetization measurements. At room temperature, all three compounds crystallize in the Pnma orthorhombic space group, akin to the cobalt and nickel end series members. Upon cooling, each compound undergoes distinct series of structural transitions to modulated structures. Compound 1 exhibits a phase transition to a modulated structure analogous to the pure nickel compound, while compound 3 maintains the behaviour observed in the pure cobalt compound, although in both cases the temperatures at which the phase transitions occur differ slightly from the pure phases. Monochromatic neutron diffraction measurements showed that the structural evolution of 2 diverges from that of either parent compound, with the competing hydrogen bond interactions which drive the modulation throughout the series producing a unique sequence of phases. It involves two modulated phases below 96(3) K and 59(3) K, with different q vectors, similar to the pure cobalt compound (with modulated phases below 128 K and 96 K), however it maintains the modulated phase below magnetic order (at 22.5(7) K), resembling the pure nickel compound (which present magnetic order below 34 K), resulting in an improper modulated magnetic structure. Despite these large scale structural changes, magnetometry data reveal that the bulk magnetic properties of these solid solutions form a linear continuum between the end members. Notably, doping of the metal site in these solid solutions allows for tuning of bulk magnetic properties, including magnetic ordering temperature, transition temperatures, and the nature of nuclear phase transitions, through adjustment of metal ratios.


title: Analytical proxy to families of numerical solutions: the case study of spherical mini-boson stars

abstract: The Einstein field equations, or generalizations thereof, are difficult to solve analytically. On the other hand, numerical solutions of the same equations have become increasingly common, in particular concerning compact objects. Whereas analytic approximations to each individual solution within a numerical family have been proposed, proxies for whole families are missing, which can facilitate studying properties across the parameter space, data compression and a wider usage of such solutions. In this work we tackle this need, proposing a simple strategy based on a double expansion of the unknown functions in an appropriately chosen basis, to build such proxy. We use as an exploratory case-study spherical, fundamental mini-boson stars, to illustrate the feasibility of such an approach, emphasise its advantage in reducing the data size, and the challenges, say, in covering large parameter spaces.


title: $$\mathbf{L^2\cdot M = C^2}$$ Large Language Models as Covert Channels... a Systematic Analysis

abstract: Large Language Models (LLMs) have gained significant popularity in the last few years due to their performance in diverse tasks such as translation, prediction, or content generation. At the same time, the research community has shown that LLMs are susceptible to various attacks but can also improve the security of diverse systems. However, besides enabling more secure systems, how well do open source LLMs behave as covertext distributions to, e.g., facilitate censorship resistant communication? In this paper, we explore the capabilities of open-source LLM-based covert channels. We approach this problem from the experimental side by empirically measuring the security vs. capacity of the open-source LLM model (Llama-7B) to assess how well it performs as a covert channel. Although our results indicate that such channels are not likely to achieve high practical bitrates, which depend on message length and model entropy, we also show that the chance for an adversary to detect covert communication is low. To ensure that our results can be used with the least effort as a general reference, we employ a conceptually simple and concise scheme and only assume public models.


title: Fourier--Stieltjes category for twisted groupoid actions

abstract: We extend the theory of Fourier--Stieltjes algebras to the category of twisted actions by \'etale groupoids on arbitrary C*-bundles, generalizing theories constructed previously by B\'{e}dos and Conti for twisted group actions on unital C*-algebras, and by Renault and others for groupoid C*-algebras, in each case motivated by the classical theory of Fourier--Stieltjes algebras of discrete groups. To this end we develop a toolbox including, among other things, a theory of multiplier C*-correspondences, multiplier C*-correspondence bundles, Busby--Smith twisted groupoid actions, and the associated crossed products, equivariant representations and Fell's absorption theorems. For a fixed \'etale groupoid $G$ a Fourier--Stieltjes multiplier is a family of maps acting on fibers, arising from an equivariant representation. It corresponds to a certain fiber-preserving strict completely bounded map between twisted full (or reduced) crossed products. We establish a KSGNS-type dilation result which shows that the correspondence above restricts to a bijection between positive-definite multipliers and a particular class of completely positive maps. Further we introduce a subclass of Fourier multipliers, that enjoys a natural absorption property with respect to Fourier--Stieltjes multipliers and gives rise to `reduced to full' multiplier maps on crossed products. Finally we provide several applications of the theory developed, for example to the approximation properties, such as weak containment or nuclearity, of the crossed products and actions in question, and discuss outstanding open problems.


title: Interfacially enhanced superconductivity in Fe(Te,Se)/Bi4Te3 heterostructures

abstract: Realizing topological superconductivity by integrating high-transition-temperature ($T_C$) superconductors with topological insulators can open new paths for quantum computing applications. Here, we report a new approach for increasing the superconducting transition temperature ($T_{C}^{onset}$) by interfacing the unconventional superconductor Fe(Te,Se) with the topological insulator Bi-Te system in the low-Se doping regime, near where superconductivity vanishes in the bulk. The critical finding is that the $T_{C}^{onset}$ of Fe(Te,Se) increases from nominally non-superconducting to as high as 12.5 K when $Bi_2Te_3$ is replaced with the topological phase $Bi_4Te_3$. Interfacing Fe(Te,Se) with $Bi_4Te_3$ is also found to be critical for stabilizing superconductivity in monolayer films where $T_{C}^{onset}$ can be as high as 6 K. Measurements of the electronic and crystalline structure of the $Bi_4Te_3$ layer reveal that a large electron transfer, epitaxial strain, and novel chemical reduction processes are critical factors for the enhancement of superconductivity. This novel route for enhancing $T_C$ in an important epitaxial system provides new insight on the nature of interfacial superconductivity and a platform to identify and utilize new electronic phases.


title: HiddenSpeaker: Generate Imperceptible Unlearnable Audios for Speaker Verification System

abstract: In recent years, the remarkable advancements in deep neural networks have brought tremendous convenience. However, the training process of a highly effective model necessitates a substantial quantity of samples, which brings huge potential threats, like unauthorized exploitation with privacy leakage. In response, we propose a framework named HiddenSpeaker, embedding imperceptible perturbations within the training speech samples and rendering them unlearnable for deep-learning-based speaker verification systems that employ large-scale speakers for efficient training. The HiddenSpeaker utilizes a simplified error-minimizing method named Single-Level Error-Minimizing (SLEM) to generate specific and effective perturbations. Additionally, a hybrid objective function is employed for human perceptual optimization, ensuring the perturbation is indistinguishable from human listeners. We conduct extensive experiments on multiple state-of-the-art (SOTA) models in the speaker verification domain to evaluate HiddenSpeaker. Our results demonstrate that HiddenSpeaker not only deceives the model with unlearnable samples but also enhances the imperceptibility of the perturbations, showcasing strong transferability across different models.


title: Balanced truncation with conformal maps

abstract: We consider the problem of constructing reduced models for large scale systems with poles in general domains in the complex plane (as opposed to, e.g., the open left-half plane or the open unit disk). Our goal is to design a model reduction scheme, building upon theoretically established methodologies, yet encompassing this new class of models. To this aim, we develop a balanced truncation framework through conformal maps to handle poles in general domains. The major difference from classical balanced truncation resides in the formulation of the Gramians. We show that these new Gramians can still be computed by solving modified Lyapunov equations for specific conformal maps. A numerical algorithm to perform balanced truncation with conformal maps is developed and is tested on three numerical examples, namely a heat model, the Schr\"odinger equation, and the undamped linear wave equation, the latter two having spectra on the imaginary axis.


title: Multiple Emission Regions in Jets of Low Luminosity Active Galactic Nucleus in NGC 4278

abstract: The Large High Altitude Airshower Array (LHAASO) has detected very high energy gamma rays from the LINER galaxy NGC 4278, which has a low luminosity active galactic nucleus, and symmetric mildly relativistic S-shaped twin jets detected by radio observations. Few low-luminosity active galactic nuclei are detected in gamma rays due to their faintness. Earlier, several radio-emitting components were detected in the jets of NGC 4278. We model their radio emission with synchrotron emission of ultra-relativistic electrons to estimate the strength of the magnetic field inside these components within a time-dependent framework after including the ages of the different components. We show that the synchrotron and synchrotron self-Compton emission by these components cannot explain the Swift X-ray data detected from NGC 4278 and the LHAASO gamma-ray data associated with NGC 4278. We suggest that a separate component in one of the jets is responsible for the high energy emission whose age, size, magnetic field and the spectrum of the ultra-relativistic electrons inside it have been estimated after fitting the multi-wavelength data of NGC 4278 with the sum of the spectral energy distributions from the radio components and the high energy component.


title: HDC: Hierarchical Semantic Decoding with Counting Assistance for Generalized Referring Expression Segmentation

abstract: The newly proposed Generalized Referring Expression Segmentation (GRES) amplifies the formulation of classic RES by involving multiple/non-target scenarios. Recent approaches focus on optimizing the last modality-fused feature which is directly utilized for segmentation and object-existence identification. However, the attempt to integrate all-grained information into a single joint representation is impractical in GRES due to the increased complexity of the spatial relationships among instances and deceptive text descriptions. Furthermore, the subsequent binary target justification across all referent scenarios fails to specify their inherent differences, leading to ambiguity in object understanding. To address the weakness, we propose a $\textbf{H}$ierarchical Semantic $\textbf{D}$ecoding with $\textbf{C}$ounting Assistance framework (HDC). It hierarchically transfers complementary modality information across granularities, and then aggregates each well-aligned semantic correspondence for multi-level decoding. Moreover, with complete semantic context modeling, we endow HDC with explicit counting capability to facilitate comprehensive object perception in multiple/single/non-target settings. Experimental results on gRefCOCO, Ref-ZOM, R-RefCOCO, and RefCOCO benchmarks demonstrate the effectiveness and rationality of HDC which outperforms the state-of-the-art GRES methods by a remarkable margin. Code will be available $\href{https://github.com/RobertLuo1/HDC}{here}$.


title: Spin-down of a pulsar with a yielding crust

abstract: In light of the discovery of the long-period radio pulsar PSR J0901-4046, it is interesting to revisit a question about how the magnetized neutron star slows down its rotation. In the case of a weak or liquid outer crust, the mechanism of spin-down becomes unclear because the braking stress cannot then be transmitted from the surface to the main bulk of the star. We show that even if the outer crust does not withstand the surface electromagnetic forces creating the braking torque, the stellar spin-down does not stop, and the matter rearranges so that the necessary electromagnetic forces form in more deep and rigid layers capable of withstanding these forces. The spin-down rate remains the same and corresponds to the transformation of the rotational energy of the neutron star into the energy of the generated relativistic electron-positron plasma. The solid iron surface of ultrastrongly magnetized PSR J0901-4046 appears not to be yielding and withstands the braking stress without breaking.

categories: astro-ph.HE astro-ph.SR nucl-th physics.space-ph


title: Low-Light Video Enhancement via Spatial-Temporal Consistent Illumination and Reflection Decomposition

abstract: Low-Light Video Enhancement (LLVE) seeks to restore dynamic and static scenes plagued by severe invisibility and noise. One critical aspect is formulating a consistency constraint specifically for temporal-spatial illumination and appearance enhanced versions, a dimension overlooked in existing methods. In this paper, we present an innovative video Retinex-based decomposition strategy that operates without the need for explicit supervision to delineate illumination and reflectance components. We leverage dynamic cross-frame correspondences for intrinsic appearance and enforce a scene-level continuity constraint on the illumination field to yield satisfactory consistent decomposition results. To further ensure consistent decomposition, we introduce a dual-structure enhancement network featuring a novel cross-frame interaction mechanism. This mechanism can seamlessly integrate with encoder-decoder single-frame networks, incurring minimal additional parameter costs. By supervising different frames simultaneously, this network encourages them to exhibit matching decomposition features, thus achieving the desired temporal propagation. Extensive experiments are conducted on widely recognized LLVE benchmarks, covering diverse scenarios. Our framework consistently outperforms existing methods, establishing a new state-of-the-art (SOTA) performance.


title: Exposing Image Classifier Shortcuts with Counterfactual Frequency (CoF) Tables

abstract: The rise of deep learning in image classification has brought unprecedented accuracy but also highlighted a key issue: the use of 'shortcuts' by models. Such shortcuts are easy-to-learn patterns from the training data that fail to generalise to new data. Examples include the use of a copyright watermark to recognise horses, snowy background to recognise huskies, or ink markings to detect malignant skin lesions. The explainable AI (XAI) community has suggested using instance-level explanations to detect shortcuts without external data, but this requires the examination of many explanations to confirm the presence of such shortcuts, making it a labour-intensive process. To address these challenges, we introduce Counterfactual Frequency (CoF) tables, a novel approach that aggregates instance-based explanations into global insights, and exposes shortcuts. The aggregation implies the need for some semantic concepts to be used in the explanations, which we solve by labelling the segments of an image. We demonstrate the utility of CoF tables across several datasets, revealing the shortcuts learned from them.


title: Class Machine Unlearning for Complex Data via Concepts Inference and Data Poisoning

abstract: In current AI era, users may request AI companies to delete their data from the training dataset due to the privacy concerns. As a model owner, retraining a model will consume significant computational resources. Therefore, machine unlearning is a new emerged technology to allow model owner to delete requested training data or a class with little affecting on the model performance. However, for large-scaling complex data, such as image or text data, unlearning a class from a model leads to a inferior performance due to the difficulty to identify the link between classes and model. An inaccurate class deleting may lead to over or under unlearning. In this paper, to accurately defining the unlearning class of complex data, we apply the definition of Concept, rather than an image feature or a token of text data, to represent the semantic information of unlearning class. This new representation can cut the link between the model and the class, leading to a complete erasing of the impact of a class. To analyze the impact of the concept of complex data, we adopt a Post-hoc Concept Bottleneck Model, and Integrated Gradients to precisely identify concepts across different classes. Next, we take advantage of data poisoning with random and targeted labels to propose unlearning methods. We test our methods on both image classification models and large language models (LLMs). The results consistently show that the proposed methods can accurately erase targeted information from models and can largely maintain the performance of the models.


title: Soft happy colourings and community structure of networks

abstract: For $0<\rho\leq 1$, a $\rho$-happy vertex $v$ in a coloured graph $G$ has at least $\rho\cdot \mathrm{deg}(v)$ same-colour neighbours, and a $\rho$-happy colouring (aka soft happy colouring) of $G$ is a vertex colouring that makes all the vertices $\rho$-happy. A community is a subgraph whose vertices are more adjacent to themselves than the rest of the vertices. Graphs with community structures can be modelled by random graph models such as the stochastic block model (SBM). In this paper, we present several theorems showing that both of these notions are related, with numerous real-world applications. We show that, with high probability, communities of graphs in the stochastic block model induce $\rho$-happy colouring on all vertices if certain conditions on the model parameters are satisfied. Moreover, a probabilistic threshold on $\rho$ is derived so that communities of a graph in the SBM induce a $\rho$-happy colouring. Furthermore, the asymptotic behaviour of $\rho$-happy colouring induced by the graph's communities is discussed when $\rho$ is less than a threshold. We develop heuristic polynomial-time algorithms for soft happy colouring that often correlate with the graphs' community structure. Finally, we present an experimental evaluation to compare the performance of the proposed algorithms thereby demonstrating the validity of the theoretical results.


title: GroundGrid:LiDAR Point Cloud Ground Segmentation and Terrain Estimation

abstract: The precise point cloud ground segmentation is a crucial prerequisite of virtually all perception tasks for LiDAR sensors in autonomous vehicles. Especially the clustering and extraction of objects from a point cloud usually relies on an accurate removal of ground points. The correct estimation of the surrounding terrain is important for aspects of the drivability of a surface, path planning, and obstacle prediction. In this article, we propose our system GroundGrid which relies on 2D elevation maps to solve the terrain estimation and point cloud ground segmentation problems. We evaluate the ground segmentation and terrain estimation performance of GroundGrid and compare it to other state-of-the-art methods using the SemanticKITTI dataset and a novel evaluation method relying on airborne LiDAR scanning. The results show that GroundGrid is capable of outperforming other state-of-the-art systems with an average IoU of 94.78% while maintaining a high run-time performance of 171Hz. The source code is available at https://github.com/dcmlr/groundgrid


title: Examining Ownership Models in Software Teams: A Systematic Literature Review and a Replication Study

abstract: Effective ownership of software artifacts, particularly code, is crucial for accountability, knowledge sharing, and code quality enhancement. Researchers have proposed models linking ownership of software artifacts with developer performance and code quality. Our study aims to systematically examine various ownership models and provide a structured literature overview. Conducting a systematic literature review, we identified 79 relevant papers published between 2005 and 2022. We developed a taxonomy of ownership artifacts based on type, owners, and degree of ownership, along with compiling modeling variables and analytics types used in each study. Additionally, we assessed the replication status of each study. As a result, we identified nine distinct software artifacts whose ownership has been discussed in the literature, with "Code" being the most frequently analyzed artifact. We found that only three papers (3.79%) provided code and data, whereas nine papers (11.4%) provided only data. Using our systematic literature review results, we replicated experiments on nine priority projects at \texttt{Brightsquid}. The company aimed to compare its code quality against ownership factors in other teams, so we conducted a replication study using their data. Unlike prior studies, we found no strong correlation between minor contributors and bug numbers. Surprisingly, we found no strong link between the total number of developers modifying a file and bug counts, contrasting previous findings. However, we observed a significant correlation between major contributors and bug counts, diverging from earlier research.


title: Well-posedness and invariant measures for the stochastically perturbed Landau-Lifshitz-Baryakhtar equation

abstract: In this paper, we study the initial-boundary value problem for the stochastic Landau-Lifshitz-Baryakhtar (SLLBar) equation with Stratonovich-type noise in bounded domains $\mathcal{O}\subset\mathbb{R}^d$, $d=1,2,3$. Our main results can be briefly described as follows: (1) for $d=1,2,3$ and any $\mathbf{u}_0\in\mathbb{H}^1$, the SLLBar equation admits a unique local-in-time pathwise weak solution; (2) for $d=1$ and small-data $\mathbf{u}_0\in\mathbb{H}^1$, the SLLBar equation has a unique global-in-time pathwise weak solution and at least one invariant measure; (3) for $d=1,2$ and small-data $\mathbf{u}_0\in\mathbb{L}^2$, the SLLBar equation possesses a unique global-in-time pathwise very weak solution and at least one invariant measure, while for $d=3$ only the existence of martingale solution is obtained due to the loss of pathwise uniqueness.


title: Grand orbit relations in wandering domains

abstract: One of the fundamental distinctions in McMullen and Sullivan's description of the Teichm\"uller space of a complex dynamical system is between discrete and indiscrete grand orbit relations. We investigate these on the Fatou set of transcendental entire maps and provide criteria to distinguish between the two types. Furthermore, we show that discrete and indiscrete grand orbit relations may coexist non-trivially in a wandering domain, a phenomenon which does not occur for any other type of Fatou component. One of the tools used is a novel quasiconformal surgery technique of independent interest.


title: What Do You See? Enhancing Zero-Shot Image Classification with Multimodal Large Language Models

abstract: Large language models (LLMs) has been effectively used for many computer vision tasks, including image classification. In this paper, we present a simple yet effective approach for zero-shot image classification using multimodal LLMs. By employing multimodal LLMs, we generate comprehensive textual representations from input images. These textual representations are then utilized to generate fixed-dimensional features in a cross-modal embedding space. Subsequently, these features are fused together to perform zero-shot classification using a linear classifier. Our method does not require prompt engineering for each dataset; instead, we use a single, straightforward, set of prompts across all datasets. We evaluated our method on several datasets, and our results demonstrate its remarkable effectiveness, surpassing benchmark accuracy on multiple datasets. On average over ten benchmarks, our method achieved an accuracy gain of 4.1 percentage points, with an increase of 6.8 percentage points on the ImageNet dataset, compared to prior methods. Our findings highlight the potential of multimodal LLMs to enhance computer vision tasks such as zero-shot image classification, offering a significant improvement over traditional methods.


title: Enhancing Reentry Support Programs Through Digital Literacy Integration

abstract: Challenges faced by formerly incarcerated individuals in the United States raise questions about our society's ability to truly provide second chances. This paper presents the outcomes of our ongoing collaboration with a non-profit organization dedicated to reentry support. We highlight the multifaceted challenges individuals face during their reentry journey, including support programs that prioritize supervision over service, unresponsive support systems, limited access to resources, financial struggles exacerbated by restricted employment opportunities, and technological barriers. In the face of such complex social challenges, our work aims to facilitate our partner organization's ongoing efforts to promote digital literacy through a web application that is integrated into their existing processes. We share initial feedback from the stakeholders, draw out four implications: supporting continuity of care, promoting reflection through slow technology, building in flexibility, and reconfiguring toward existing infrastructure, and conclude with a reflection on our role as partners on the side.


title: Post-selection inference for quantifying uncertainty in changes in variance

abstract: Quantifying uncertainty in detected changepoints is an important problem. However it is challenging as the naive approach would use the data twice, first to detect the changes, and then to test them. This will bias the test, and can lead to anti-conservative p-values. One approach to avoid this is to use ideas from post-selection inference, which conditions on the information in the data used to choose which changes to test. As a result this produces valid p-values; that is, p-values that have a uniform distribution if there is no change. Currently such methods have been developed for detecting changes in mean only. This paper presents two approaches for constructing post-selection p-values for detecting changes in variance. These vary depending on the method use to detect the changes, but are general in terms of being applicable for a range of change-detection methods and a range of hypotheses that we may wish to test.


title: The Undecidability of Quantified Announcements

abstract: This paper demonstrates the undecidability of a number of logics with quantification over public announcements: arbitrary public announcement logic (APAL), group announcement logic (GAL), and coalition announcement logic (CAL). In APAL we consider the informative consequences of any announcement, in GAL we consider the informative consequences of a group of agents (this group may be a proper subset of the set of all agents) all of which are simultaneously (and publicly) making known announcements. So this is more restrictive than APAL. Finally, CAL is as GAL except that we now quantify over anything the agents not in that group may announce simultaneously as well. The logic CAL therefore has some features of game logic and of ATL. We show that when there are multiple agents in the language, the satisfiability problem is undecidable for APAL, GAL, and CAL. In the single agent case, the satisfiability problem is decidable for all three logics. This paper corrects an error to the submitted version of Undecidability of Quantified Announcements, identified by Yuta Asami . The nature of the error was in the definition of the formula $cga(X)$ (see Subsection 5.2) which is corrected in this version.


title: Serving economic prosperity: economic impact assessments (EIA) on Earth observation-based services and tools by SERVIR

abstract: In an era where informed decision-making is paramount for sustainable development and effective resource management, the role of Earth observations (EO) in shaping economic landscapes cannot be overstated. EO, facilitated by satellites, sensors, and data analytics, is a cornerstone for evidence-based policymaking, risk mitigation, and resource allocation. SERVIR is a joint initiative of US Agency for International Development and NASA. This paper presents a comprehensive survey of relevant economic impact assessment (EIA) work, summarizes SERVIRs potential interests in EIA, and identifies how and where EIA could improve how SERVIR quantifies and communicates the impact of its services.


title: Consistency of Neural Causal Partial Identification

abstract: Recent progress in Neural Causal Models (NCMs) showcased how identification and partial identification of causal effects can be automatically carried out via training of neural generative models that respect the constraints encoded in a given causal graph [Xia et al. 2022, Balazadeh et al. 2022]. However, formal consistency of these methods has only been proven for the case of discrete variables or only for linear causal models. In this work, we prove consistency of partial identification via NCMs in a general setting with both continuous and categorical variables. Further, our results highlight the impact of the design of the underlying neural network architecture in terms of depth and connectivity as well as the importance of applying Lipschitz regularization in the training phase. In particular, we provide a counterexample showing that without Lipschitz regularization the NCM may not be asymptotically consistent. Our results are enabled by new results on the approximability of structural causal models via neural generative models, together with an analysis of the sample complexity of the resulting architectures and how that translates into an error in the constrained optimization problem that defines the partial identification bounds.


title: Causal features in turbulent channel flow

abstract: The causal relevance of local flow conditions in wall-bounded turbulence is analysed using ensembles of interventional experiments in which the effect of perturbing the flow within a small cell is monitored at some future time. When this is done using the relative amplification of the perturbation energy, causality depends on the flow conditions within the cell before it is perturbed, and can be used as a probe of the flow dynamics. The key scaling parameter is the ambient shear, which is also the dominant diagnostic variable for wall-attached perturbations. Away from the wall, the relevant variables are the streamwise and wall-normal velocities. Causally significant cells are associated with sweeps that carry the perturbation towards the stronger shear near the wall, whereas irrelevant ones are associated with ejections that carry it towards the weaker shear in the outer layers. Causally significant and irrelevant cells are themselves organised into structures that share many characteristics with classical sweeps and ejections, such as forming spanwise pairs whose dimensions and geometry are similar to those of classical quadrants. At the wall, this is consistent with causally significant configurations in which a high-speed streak overtakes a low-speed one, and causally irrelevant ones in which the two streaks pull apart from each other. It is argued that this is probably associated with streak meandering.


title: General type results for moduli of deformation generalised Kummer varieties

abstract: In arXiv:1710.01672, we obtained general type results for orthogonal modular varieties associated with moduli spaces of compact hyperk\"ahler manifolds of deformation generalised Kummer type (also known as 'deformation generalised Kummer varieties'). The orthogonal modular varieties were defined in terms of an integer 2d, corresponding to the degree of polarisation of the associated hyperk\"ahler manifolds. In arXiv:1710.01672, we showed these orthogonal modular varieties are of general type when 2d is square-free and sufficiently large. Here we show that the square-free condition can be removed.


title: Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problems

abstract: This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method leverages the recently defined infinite-dimensional score-based diffusion models as a learning-based prior, while enabling provable posterior sampling through a Langevin-type MCMC algorithm defined on function spaces. A novel convergence analysis is conducted, inspired by the fixed-point methods established for traditional regularization-by-denoising algorithms and compatible with weighted annealing. The obtained convergence bound explicitly depends on the approximation error of the score; a well-approximated score is essential to obtain a well-approximated posterior. Stylized and PDE-based examples are provided, demonstrating the validity of our convergence analysis. We conclude by presenting a discussion of the method's challenges related to learning the score and computational complexity.


title: SMART: Scalable Multi-agent Real-time Simulation via Next-token Prediction

abstract: Data-driven autonomous driving motion generation tasks are frequently impacted by the limitations of dataset size and the domain gap between datasets, which precludes their extensive application in real-world scenarios. To address this issue, we introduce SMART, a novel autonomous driving motion generation paradigm that models vectorized map and agent trajectory data into discrete sequence tokens. These tokens are then processed through a decoder-only transformer architecture to train for the next token prediction task across spatial-temporal series. This GPT-style method allows the model to learn the motion distribution in real driving scenarios. SMART achieves state-of-the-art performance across most of the metrics on the generative Sim Agents challenge, ranking 1st on the leaderboards of Waymo Open Motion Dataset (WOMD), demonstrating remarkable inference speed. Moreover, SMART represents the generative model in the autonomous driving motion domain, exhibiting zero-shot generalization capabilities: Using only the NuPlan dataset for training and WOMD for validation, SMART achieved a competitive score of 0.71 on the Sim Agents challenge. Lastly, we have collected over 1 billion motion tokens from multiple datasets, validating the model's scalability. These results suggest that SMART has initially emulated two important properties: scalability and zero-shot generalization, and preliminarily meets the needs of large-scale real-time simulation applications. We have released all the code to promote the exploration of models for motion generation in the autonomous driving field.


title: Faraday tomography with CHIME: the `tadpole' feature G137+7

abstract: A direct consequence of Faraday rotation is that the polarized radio sky does not resemble the total intensity sky at long wavelengths. We analyze G137+7, which is undetectable in total intensity but appears as a depolarization feature. We use the first polarization maps from the Canadian Hydrogen Intensity Mapping Experiment. Our $400-729$ MHz bandwidth and angular resolution, $17'$ to $30'$, allow us to use Faraday synthesis to analyze the polarization structure. In polarized intensity and polarization angle maps, we find a "tail" extending $10^\circ$ from the "head" and designate the combined object the "tadpole". Similar polarization angles, distinct from the background, indicate that the head and tail are physically associated. The head appears as a depolarized ring in single channels, but wideband observations show that it is a Faraday rotation feature. Our investigations of H I and H$\alpha$ find no connections to the tadpole. The tail suggests motion of either the gas or an ionizing star through the ISM; the B2(e) star HD 20336 is a candidate. While the head features a coherent, $\sim -8$ rad m$^2$ Faraday depth, Faraday synthesis also identifies multiple components in both the head and tail. We verify the locations of the components in the spectra using QU fitting. Our results show that $\sim$octave-bandwidth Faraday rotation observations at $\sim 600$ MHz are sensitive to low-density ionized or partially-ionized gas which is undetectable in other tracers.


title: Jet Quenching of the Heavy Quarks in the Quark-Gluon Plasma and the Nonadditive Statistics

abstract: Using the Plastino-Plastino (PP) equation, we calculate transport coefficients of the heavy-quarks traversing inside the quark-gluon plasma, and generalize their relationship with differential energy loss. The PP equation indicates anomalous diffusion of the probe particles and yields a quasi-exponential stationary distribution obtained also from the nonadditive statistics proposed by C. Tsallis. We estimate energy loss in a nonadditive quark-gluon medium, and calculate the jet-quenching parameter ($\hat{q}$) for the PP dynamics. With the help of the estimate of $\hat{q}$, we calculate the nuclear suppression factor ($R_{\text{AA}}$) of the heavy-quarks passing through a nonadditive quark-gluon plasma using the model proposed by Dokshitzer and Kharzeev. In many a case, the parameters in the analysis are fixed from the experimental results to minimize arbitrariness. There is a good agreement between the theoretical calculation and experimental $R_{\text{AA}}$ data, indicating that fast heavy-quarks may be subjected to anomalous diffusion inside the QGP.


title: More on Jensen functional and convexity

abstract: In this paper we prove results on the difference between a normalized Jensen functional and the sum of other normalized Jensen functionals for convex function.


title: On Jensen Functional, Convexity and Uniform Convexity

abstract: In this paper we improve results related to Normalized Jensen Functional for convex functions and Uniformly Convex Functions.


title: The Road Less Scheduled

abstract: Existing learning rate schedules that do not require specification of the optimization stopping step T are greatly out-performed by learning rate schedules that depend on T. We propose an approach that avoids the need for this stopping time by eschewing the use of schedules entirely, while exhibiting state-of-the-art performance compared to schedules across a wide family of problems ranging from convex problems to large-scale deep learning problems. Our Schedule-Free approach introduces no additional hyper-parameters over standard optimizers with momentum. Our method is a direct consequence of a new theory we develop that unifies scheduling and iterate averaging. An open source implementation of our method is available (https://github.com/facebookresearch/schedule_free).


title: VDGD: Mitigating LVLM Hallucinations in Cognitive Prompts by Bridging the Visual Perception Gap

abstract: Recent interest in Large Vision-Language Models (LVLMs) for practical applications is moderated by the significant challenge of hallucination or the inconsistency between the factual information and the generated text. In this paper, we first perform an in-depth analysis of hallucinations and discover several novel insights about how and when LVLMs hallucinate. From our analysis, we show that: (1) The community's efforts have been primarily targeted towards reducing hallucinations related to visual recognition (VR) prompts (e.g., prompts that only require describing the image), thereby ignoring hallucinations for cognitive prompts (e.g., prompts that require additional skills like reasoning on contents of the image). (2) LVLMs lack visual perception, i.e., they can see but not necessarily understand or perceive the input image. We analyze responses to cognitive prompts and show that LVLMs hallucinate due to a perception gap: although LVLMs accurately recognize visual elements in the input image and possess sufficient cognitive skills, they struggle to respond accurately and hallucinate. To overcome this shortcoming, we propose Visual Description Grounded Decoding (VDGD), a simple, robust, and training-free method for alleviating hallucinations. Specifically, we first describe the image and add it as a prefix to the instruction. Next, during auto-regressive decoding, we sample from the plausible candidates according to their KL-Divergence (KLD) to the description, where lower KLD is given higher preference. Experimental results on several benchmarks and LVLMs show that VDGD improves significantly over other baselines in reducing hallucinations. We also propose VaLLu, a benchmark for the comprehensive evaluation of the cognitive capabilities of LVLMs.


title: Prompt-Aware Adapter: Towards Learning Adaptive Visual Tokens for Multimodal Large Language Models

abstract: To bridge the gap between vision and language modalities, Multimodal Large Language Models (MLLMs) usually learn an adapter that converts visual inputs to understandable tokens for Large Language Models (LLMs). However, most adapters generate consistent visual tokens, regardless of the specific objects of interest mentioned in the prompt. Since these adapters distribute equal attention to every detail in the image and focus on the entire scene, they may increase the cognitive load for LLMs, particularly when processing complex scenes. To alleviate this problem, we propose prompt-aware adapters. These adapters are designed with the capability to dynamically embed visual inputs based on the specific focus of the prompt. Specifically, prompt-aware adapters utilize both global and local textual features to capture the most relevant visual clues from the prompt at both coarse and fine granularity levels. This approach significantly enhances the ability of LLMs to understand and interpret visual content. Experiments on various visual question answering tasks, such as counting and position reasoning, demonstrate the effectiveness of prompt-aware adapters.


title: Stochastic thermodynamics of Fisher information

abstract: In this manuscript, we investigate the stochastic thermodynamics of Fisher information (FI), meaning we characterize both the \textit{fluctuations} of FI, introducing a parastatistics of that quantity, and thermodynamic quantities. We introduce two initial conditions: an equilibrium initial condition and a minimum entropy initial condition, both under a protocol that drives the system to equilibrium. Its results indicate a dependence of the average FI on both the initial condition and path taken. Furthermore, the results point the chosen parameter directly affects the FI of thermodynamic quantities such as irreversible work and entropy, along with fluctuations of a stochastic FI. Last, we assess the further role of FI of the distribution of thermal quantities within the context of thermostatistical inequalities.


title: Stratified Sampling Algorithms for Machine Learning Methods in Solving Two-scale Partial Differential Equations

abstract: Partial differential equations (PDEs) with multiple scales or those defined over sufficiently large domains arise in various areas of science and engineering and often present problems when approximating the solutions numerically. Machine learning techniques are a relatively recent method for solving PDEs. Despite the increasing number of machine learning strategies developed to approximate PDEs, many remain focused on relatively small domains. When scaling the equations, a large domain is naturally obtained, especially when the solution exhibits multiscale characteristics. This study examines two-scale equations whose solution structures exhibit distinct characteristics: highly localized in some regions and significantly flat in others. These two regions must be adequately addressed over a large domain to approximate the solution more accurately. We focus on the vanishing gradient problem given by the diminishing gradient zone of the activation function over large domains and propose a stratified sampling algorithm to address this problem. We compare the uniform random classical sampling method over the entire domain and the proposed stratified sampling method. The numerical results confirm that the proposed method yields more accurate and consistent solutions than classical methods.


title: Chain-of-Thought Prompting for Demographic Inference with Large Multimodal Models

abstract: Conventional demographic inference methods have predominantly operated under the supervision of accurately labeled data, yet struggle to adapt to shifting social landscapes and diverse cultural contexts, leading to narrow specialization and limited accuracy in applications. Recently, the emergence of large multimodal models (LMMs) has shown transformative potential across various research tasks, such as visual comprehension and description. In this study, we explore the application of LMMs to demographic inference and introduce a benchmark for both quantitative and qualitative evaluation. Our findings indicate that LMMs possess advantages in zero-shot learning, interpretability, and handling uncurated 'in-the-wild' inputs, albeit with a propensity for off-target predictions. To enhance LMM performance and achieve comparability with supervised learning baselines, we propose a Chain-of-Thought augmented prompting approach, which effectively mitigates the off-target prediction issue.


title: UNION: Unsupervised 3D Object Detection using Object Appearance-based Pseudo-Classes

abstract: Unsupervised 3D object detection methods have emerged to leverage vast amounts of data efficiently without requiring manual labels for training. Recent approaches rely on dynamic objects for learning to detect objects but penalize the detections of static instances during training. Multiple rounds of (self) training are used in which detected static instances are added to the set of training targets; this procedure to improve performance is computationally expensive. To address this, we propose the method UNION. We use spatial clustering and self-supervised scene flow to obtain a set of static and dynamic object proposals from LiDAR. Subsequently, object proposals' visual appearances are encoded to distinguish static objects in the foreground and background by selecting static instances that are visually similar to dynamic objects. As a result, static and dynamic foreground objects are obtained together, and existing detectors can be trained with a single training. In addition, we extend 3D object discovery to detection by using object appearance-based cluster labels as pseudo-class labels for training object classification. We conduct extensive experiments on the nuScenes dataset and increase the state-of-the-art performance for unsupervised object discovery, i.e. UNION more than doubles the average precision to 33.9. The code will be made publicly available.


title: Probing Berry curvature in magnetic topological insulators through resonant infrared magnetic circular dichroism

abstract: Probing the quantum geometry and topology in condensed matter systems has relied heavily on static electronic transport experiments in magnetic fields. Yet, contact-free optical measurements have rarely been explored. Magnetic dichroism (MCD), the nonreciprocal absorption of circular polarized light, was theoretically linked to the quantized anomalous Hall effect in magnetic insulators and can identify the bands and momenta responsible for the underlying Berry Curvature (BC). Detecting BC through MCD faces two challenges: First, the relevant inter-band transitions usually generate MCD in the infrared (IR) range, requiring large samples with high quality. Second, while most magnetic materials are metallic, the relation between MCD and BC in metals remains unclear. Here, we report the observation of MCD in the IR range along with the anomalous Hall effect in thin film MnBi2Te4. Both phenomena emerge with a field-driven phase transition from an antiferromagnet to a canted ferromagnet. By theoretically relating the MCD to the anomalous Hall effect via BC in a metal, we show that this transition accompanies an abrupt onset of BC, signaling a topological phase transition from a topological insulator to a doped Chern insulator. Our density functional theory calculation suggests the MCD signal mainly originates from an optical transition at the Brillouin zone edge, hinting at a potential new source of BC away from the commonly considered {\Gamma} point. Our findings demonstrate a novel experimental approach for detecting BC and identifying the responsible bands and momenta, generally applicable to magnetic materials.


title: A Case Study of LLM for Automated Vulnerability Repair: Assessing Impact of Reasoning and Patch Validation Feedback

abstract: Recent work in automated program repair (APR) proposes the use of reasoning and patch validation feedback to reduce the semantic gap between the LLMs and the code under analysis. The idea has been shown to perform well for general APR, but its effectiveness in other particular contexts remains underexplored. In this work, we assess the impact of reasoning and patch validation feedback to LLMs in the context of vulnerability repair, an important and challenging task in security. To support the evaluation, we present VRpilot, an LLM-based vulnerability repair technique based on reasoning and patch validation feedback. VRpilot (1) uses a chain-of-thought prompt to reason about a vulnerability prior to generating patch candidates and (2) iteratively refines prompts according to the output of external tools (e.g., compiler, code sanitizers, test suite, etc.) on previously-generated patches. To evaluate performance, we compare VRpilot against the state-of-the-art vulnerability repair techniques for C and Java using public datasets from the literature. Our results show that VRpilot generates, on average, 14% and 7.6% more correct patches than the baseline techniques on C and Java, respectively. We show, through an ablation study, that reasoning and patch validation feedback are critical. We report several lessons from this study and potential directions for advancing LLM-empowered vulnerability repair


title: Simulation-based inference of radio millisecond pulsars in globular clusters

abstract: Millisecond pulsars (MSPs) are abundant in globular clusters (GCs), which offer favorable environments for their creation. While the advent of recent, powerful facilities led to a rapid increase in MSP discoveries in GCs through pulsation searches, detection biases persist. In this work, we investigate the ability of current and future detections in GCs to constrain the parameters of the MSP population in GCs through a careful study of their luminosity function. Parameters of interest are the number of MSPs hosted by a GC, as well as the mean and the width of their luminosity function, which are typically affected by large uncertainties. While, as we show, likelihood-based studies can lead to ill-behaved posterior on the size of the MSP population, we introduce a novel, likelihood-free analysis, based on Marginal Neural Ratio Estimation, which consistently produces well-behaved posteriors. We focus on the GC Terzan 5, which currently counts 48 detected MSPs. We find that about 158 MSPs should be hosted in this GC, but the uncertainty on this number remains large. We explore the performance of our new method on simulated Terzan 5-like datasets mimicking possible future observational outcomes. We find that significant improvement on the posteriors can be obtained by adding a reliable measurement of the diffuse radio emission of the GC to the analysis or by improving the detection threshold of current radio pulsation surveys by at least a factor two.


title: An operational distinction between quantum entanglement and classical non-separability

abstract: Quantum entanglement describes superposition states in multi-dimensional systems, at least two partite, which cannot be factorized and are thus non-separable. Non-separable states exist also in classical theories involving vector spaces. In both cases, it is possible to violate a Bell-like inequality. This has led to controversial discussions, which we resolve by identifying an operational distinction between the classical and quantum cases.


title: Non-invertible symmetries in $S_N$ orbifold CFTs and holography

abstract: We study non-invertible defects in two-dimensional $S_N$ orbifold CFTs. We construct universal defects which do not depend on the details of the seed CFT and hence exist in any orbifold CFT. Additionally, we investigate non-universal defects arising from the topological defects of the seed CFT. We argue that there exist universal defects that are non-trivial in the large-$N$ limit, making them relevant for the AdS$_3$/CFT$_2$ correspondence. We then focus on AdS$_3\times$S$^3\times \mathcal M_4$ with one unit of NS-NS flux and propose an explicit realization of these defects on the worldsheet.


title: A unified approach to some rigidity and stability problems in algebra

abstract: In this note, we use give some algebraic applications of a previous result by the author which compares the deformations parameterized by the Maurer-Cartan elements of a differential graded Lie algebra, and a differential graded Lie subalgebra: It gives a criterion for the map on the space of Maurer-Cartan elements up to gauge equivalence, induced by the inclusion of the subalgebra, to be locally surjective. By making appropriate choices for the differential graded Lie algebra and a differential graded Lie subalgebra, we recover some classical results in the deformation theory of finite-dimensional Lie and associative algebras. We consider rigidity of Lie and associative algebras, Lie algebra morphisms, and give a quick proof of the fact that the deformation theories of a unital associative algebra as a unital associative algebra and as an associative algebra are equivalent. We then turn to stability of Lie subalgebras and their morphisms under deformations of the ambient Lie algebra structure, and study when the compatibility with a geometric structure of a representation of a Lie algebra on a vector space is stable under deformations of the representation.


title: Synthetic high angular momentum spin dynamics in a microwave oscillator

abstract: Spins and oscillators are foundational to much of physics and applied sciences. For quantum information, a spin 1/2 exemplifies the most basic unit, a qubit. High angular momentum spins and harmonic oscillators provide multi-level manifolds (e.g., qudits) which have the potential for hardware-efficient protected encodings of quantum information and simulation of many-body quantum systems. In this work, we demonstrate a new quantum control protocol that conceptually merges these disparate hardware platforms. Namely, we show how to modify a harmonic oscillator on-demand to implement a continuous range of generators associated to resonant driving of a harmonic qudit, and then specifically design a harmonic multi-level spin degree of freedom. The synthetic spin is verified by demonstration of spin coherent (SU(2)) rotations and comparison to other manifolds like simply-truncated oscillators. Our scheme allows universal control of the qudit, and, for the first time, we use linear, harmonic operations to accomplish four logical gates on a harmonic qudit encoding. Our results show how motion on a closed Hilbert space can be useful for quantum information processing and opens the door to superconducting circuit simulations of higher angular momentum quantum magnetism.


title: Interplay between hyperfine and anisotropic exchange interactions in exciton luminescence of quantum dots

abstract: The optical orientation and alignment of excitons in semiconductor indirect gap quantum dots have been studied theoretically. A special regime is analyzed in which the energy of the hyperfine interaction of an electron with lattice nuclei is small compared to the exchange splitting between bright and dark excitonic levels, but is comparable to the anisotropic exchange splitting of the radiative doublet. The dependencies of degrees of circular and linear polarization on the external magnetic field under resonant excitation of excitons by polarized light are calculated.


title: Utilizing frustration for milli-Kelvin adiabatic demagnetization refrigeration

abstract: The manifold of energetically degenerate configurations arising from competing interactions in frustrated magnets gives rise to an enhanced entropy at lowest temperatures, which can be utilized for adiabatic demagnetization refrigeration (ADR). We review structural and magnetic properties of various Yb- and Gd-based oxides featuring frustration related to different triangular moment configurations and (in some cases) structural randomness. In comparison to paramagnetic hydrated salts, which have traditionally been employed for mK-ADR, these novel ADR materials enable cooling to temperatures several times lower than the magnetic interaction strength, significantly enhancing the entropy density and cooling power at a given target temperature. A further advantage is their chemical stability, allowing for a much simpler ADR pill design and ultra-high vacuum applications. For the temperature range between 0.02 and 2 K, a systematic comparison of the field-induced entropy density change is provided, that illustrates the advantages of frustrated magnets for low-temperature ADR.


title: First-principles studies of fermiology in topological phases of bulk ZrTe$_5$

abstract: Topological insulators have been studied intensively over the last decades. Among these materials, three-dimensional (3D) zirconium pentatelluride (ZrTe$_5$) stands out as one of the most intriguing for both theoretical and experimental studies because of its diverse range of distinct topological phases. In this work, we employ density functional theory to study the electronic structure and quantum oscillations exhibited by various topological phases of 3D bulk ZrTe$_5$. We have discovered that by analyzing combined patterns in band structures, Fermi surfaces, and Shubnikov-de Haas (SdH) oscillations we can determine the corresponding topological phase without relying on the conventional calculation of topological invariants or boundary state contributions. This approach facilitates the identification of topological phases in ZrTe$_5$ directly from experimental quantum oscillation measurements. Using this method, we have analyzed the entire process of topological phase transition, revealing changes in the topology of the Fermi pockets and validating the shapes deduced from the experimental data for the topological phases.


title: Dimension-free deterministic equivalents for random feature regression

abstract: In this work we investigate the generalization performance of random feature ridge regression (RFRR). Our main contribution is a general deterministic equivalent for the test error of RFRR. Specifically, under a certain concentration property, we show that the test error is well approximated by a closed-form expression that only depends on the feature map eigenvalues. Notably, our approximation guarantee is non-asymptotic, multiplicative, and independent of the feature map dimension -- allowing for infinite-dimensional features. We expect this deterministic equivalent to hold broadly beyond our theoretical analysis, and we empirically validate its predictions on various real and synthetic datasets. As an application, we derive sharp excess error rates under standard power-law assumptions of the spectrum and target decay. In particular, we provide a tight result for the smallest number of features achieving optimal minimax error rate.


title: Trackastra: Transformer-based cell tracking for live-cell microscopy

abstract: Cell tracking is an omnipresent image analysis task in live-cell microscopy. It is similar to multiple object tracking (MOT), however, each frame contains hundreds of similar-looking objects that can divide, making it a challenging problem. Current state-of-the-art approaches follow the tracking-by-detection paradigm, i.e. first all cells are detected per frame and successively linked in a second step to form biologically consistent cell tracks. Linking is commonly solved via discrete optimization methods, which require manual tuning of hyperparameters for each dataset and are therefore cumbersome to use in practice. Here we propose Trackastra, a general purpose cell tracking approach that uses a simple transformer architecture to directly learn pairwise associations of cells within a temporal window from annotated data. Importantly, unlike existing transformer-based MOT pipelines, our learning architecture also accounts for dividing objects such as cells and allows for accurate tracking even with simple greedy linking, thus making strides towards removing the requirement for a complex linking step. The proposed architecture operates on the full spatio-temporal context of detections within a time window by avoiding the computational burden of processing dense images. We show that our tracking approach performs on par with or better than highly tuned state-of-the-art cell tracking algorithms for various biological datasets, such as bacteria, cell cultures and fluorescent particles. We provide code at https://github.com/weigertlab/trackastra.


title: realSEUDO for real-time calcium imaging analysis

abstract: Closed-loop neuroscience experimentation, where recorded neural activity is used to modify the experiment on-the-fly, is critical for deducing causal connections and optimizing experimental time. A critical step in creating a closed-loop experiment is real-time inference of neural activity from streaming recordings. One challenging modality for real-time processing is multi-photon calcium imaging (CI). CI enables the recording of activity in large populations of neurons however, often requires batch processing of the video data to extract single-neuron activity from the fluorescence videos. We use the recently proposed robust time-trace estimator-Sparse Emulation of Unused Dictionary Objects (SEUDO) algorithm-as a basis for a new on-line processing algorithm that simultaneously identifies neurons in the fluorescence video and infers their time traces in a way that is robust to as-yet unidentified neurons. To achieve real-time SEUDO (realSEUDO), we optimize the core estimator via both algorithmic improvements and an fast C-based implementation, and create a new cell finding loop to enable realSEUDO to also identify new cells. We demonstrate comparable performance to offline algorithms (e.g., CNMF), and improved performance over the current on-line approach (OnACID) at speeds of 120 Hz on average.


title: A Variable Neighborhood Search approach for solving the Rank Pricing Problem

abstract: The Rank Pricing Problem (RPP) is a challenging bilevel optimization problem with binary variables whose objective is to determine the optimal pricing strategy for a set of products to maximize the total benefit, given that customer preferences influence the price for each product. Traditional methods for solving RPP are based on exact approaches which may be computationally expensive. In contrast, this paper presents a novel approach utilizing Variable Neighborhood Search (VNS), a popular heuristic known for its effectiveness in solving combinatorial optimization problems. Our proposed VNS algorithm introduces problem-specific neighborhood operators designed to effectively explore the solution space of the RPP. Even though our methodology does not have optimality guarantees, our computational experiments show that it outperforms Mixed Integer Program solvers regarding solution quality and computational burden.


title: Metrological usefulness of entanglement and nonlinear Hamiltonians

abstract: A central task in quantum metrology is to exploit quantum correlations to outperform classical sensitivity limits. Metrologically useful entanglement is identified when the quantum Fisher information (QFI) exceeds a separability bound for a given parameter-encoding Hamiltonian. However, so far, only results for linear Hamiltonians are well-established. Here, we characterize metrologically useful entanglement for nonlinear Hamiltonians, presenting separability bounds for collective angular momenta. Also, we provide a general expression for entangled states maximizing the QFI, showing that these are not always GHZ-like states. Finally, we compare the metrological usefulness of linear and nonlinear cases, in terms of entanglement detection and random symmetric states.