title: CG-FedLLM: How to Compress Gradients in Federated Fune-tuning for Large Language Models

abstract: The success of current Large-Language Models (LLMs) hinges on extensive training data that is collected and stored centrally, called Centralized Learning (CL). However, such a collection manner poses a privacy threat, and one potential solution is Federated Learning (FL), which transfers gradients, not raw data, among clients. Unlike traditional networks, FL for LLMs incurs significant communication costs due to their tremendous parameters. This study introduces an innovative approach to compress gradients to improve communication efficiency during LLM FL, formulating the new FL pipeline named CG-FedLLM. This approach integrates an encoder on the client side to acquire the compressed gradient features and a decoder on the server side to reconstruct the gradients. We also developed a novel training strategy that comprises Temporal-ensemble Gradient-Aware Pre-training (TGAP) to identify characteristic gradients of the target model and Federated AutoEncoder-Involved Fine-tuning (FAF) to compress gradients adaptively. Extensive experiments confirm that our approach reduces communication costs and improves performance (e.g., average 3 points increment compared with traditional CL- and FL-based fine-tuning with LlaMA on a well-recognized benchmark, C-Eval). This improvement is because our encoder-decoder, trained via TGAP and FAF, can filter gradients while selectively preserving critical features. Furthermore, we present a series of experimental analyses focusing on the signal-to-noise ratio, compression rate, and robustness within this privacy-centric framework, providing insight into developing more efficient and secure LLMs.


title: Reducing Mid-Circuit Measurements via Probabilistic Circuits

abstract: Mid-circuit measurements and measurement-controlled gates are supported by an increasing number of quantum hardware platforms and will become more relevant as an essential building block for quantum error correction. However, mid-circuit measurements impose significant demands on the quantum hardware due to the required signal analysis and classical feedback loop. This work presents a static circuit optimization algorithm that can substitute some of these measurements with an equivalent circuit with randomized gate applications. Our method uses ideas from constant propagation to classically precompute measurement outcome probabilities. Our proposed optimization is efficient, as its runtime scales polynomially on the number of qubits and gates of the circuit.


title: Monocular Gaussian SLAM with Language Extended Loop Closure

abstract: Recently,3DGaussianSplattinghasshowngreatpotentialin visual Simultaneous Localization And Mapping (SLAM). Existing methods have achieved encouraging results on RGB-D SLAM, but studies of the monocular case are still scarce. Moreover, they also fail to correct drift errors due to the lack of loop closure and global optimization. In this paper, we present MG-SLAM, a monocular Gaussian SLAM with a language-extended loop closure module capable of performing drift-corrected tracking and high-fidelity reconstruction while achieving a high-level understanding of the environment. Our key idea is to represent the global map as 3D Gaussian and use it to guide the estimation of the scene geometry, thus mitigating the efforts of missing depth information. Further, an additional language-extended loop closure module which is based on CLIP feature is designed to continually perform global optimization to correct drift errors accumulated as the system runs. Our system shows promising results on multiple challenging datasets in both tracking and mapping and even surpasses some existing RGB-D methods.


title: History of N(1680)

abstract: This paper describes my personal appreciation for some of the great research achievements of Mitya Diakonov, Vitya Petrov, and Maxim Polyakov and how my own research career has followed the paths they opened. Among the topics where they have been the most influential have been the pursuit and study of the exotic pentaquark. The search for exotics may require a complementary approach, such as experimental and theoretical activity. Here, I would like to focus on a story of $N(1680)$ in which I was involved.


title: Computationally Efficient Sampling-Based Algorithm for Stability Analysis of Nonlinear Systems

abstract: For complex nonlinear systems, it is challenging to design algorithms that are fast, scalable, and give an accurate approximation of the stability region. This paper proposes a sampling-based approach to address these challenges. By extending the parametrization of quadratic Lyapunov functions with the system dynamics and formulating an $\ell_1$ optimization to maximize the invariant set over a grid of the state space, we arrive at a computationally efficient algorithm that estimates the domain of attraction (DOA) of nonlinear systems accurately by using only linear programming. The scalability of the Lyapunov function synthesis is further improved by combining the algorithm with ADMM-based parallelization. To resolve the inherent approximative nature of grid-based techniques, a small-scale nonlinear optimization is proposed. The performance of the algorithm is evaluated and compared to state-of-the-art solutions on several numerical examples.


title: GameVLM: A Decision-making Framework for Robotic Task Planning Based on Visual Language Models and Zero-sum Games

abstract: With their prominent scene understanding and reasoning capabilities, pre-trained visual-language models (VLMs) such as GPT-4V have attracted increasing attention in robotic task planning. Compared with traditional task planning strategies, VLMs are strong in multimodal information parsing and code generation and show remarkable efficiency. Although VLMs demonstrate great potential in robotic task planning, they suffer from challenges like hallucination, semantic complexity, and limited context. To handle such issues, this paper proposes a multi-agent framework, i.e., GameVLM, to enhance the decision-making process in robotic task planning. In this study, VLM-based decision and expert agents are presented to conduct the task planning. Specifically, decision agents are used to plan the task, and the expert agent is employed to evaluate these task plans. Zero-sum game theory is introduced to resolve inconsistencies among different agents and determine the optimal solution. Experimental results on real robots demonstrate the efficacy of the proposed framework, with an average success rate of 83.3%.


title: Superconductivity near 70 K in boron-carbon clathrates MB$_2$C$_8$ (M = Na, K, Rb, Cs) at ambient pressure

abstract: Inspired by the first boron-carbon (B-C) clathrate SrB$_3$C$_3$ and the ternary borohydride KB$_2$H$_8$ [Miao et al., Phys. Rev. B 104 L100504 (2021)], we have performed first-principles density functional theory calculations of the electronic and phonon band structures for B-C compounds MB$_2$C$_8$ (M = Na, K, Rb, Cs). Our calculations reveal that these materials are dynamically stable and can potentially exhibit superconductivity at ambient pressure. However, only the K, Rb, and Cs compounds exhibit thermodynamic stability below 50 GPa, while NaB$_2$C$_8$ remains thermodynamically unstable at all pressures considered. Based on the Allen and Dynes modified McMillan equation, we predict the superconducting transition temperature $T_c$ of these compounds to be over 65 K at ambient pressure, with $T_c$ decreasing under higher pressures. Remarkably, we find CsB$_2$C$_8$ possesses the highest predicted $T_c$ of 68.76 K. Our findings demonstrate the possibility of high temperature superconductivity in cubic MB$_2$C$_8$ at ambient pressure, expanding the B-C clathrate superconductor family. These results provide valuable insights to guide the identification of new atmospheric pressure superconductors.


title: A Dynamic Model of Performative Human-ML Collaboration: Theory and Empirical Evidence

abstract: Machine learning (ML) models are increasingly used in various applications, from recommendation systems in e-commerce to diagnosis prediction in healthcare. In this paper, we present a novel dynamic framework for thinking about the deployment of ML models in a performative, human-ML collaborative system. In our framework, the introduction of ML recommendations changes the data generating process of human decisions, which are only a proxy to the ground truth and which are then used to train future versions of the model. We show that this dynamic process in principle can converge to different stable points, i.e. where the ML model and the Human+ML system have the same performance. Some of these stable points are suboptimal with respect to the actual ground truth. We conduct an empirical user study with 1,408 participants to showcase this process. In the study, humans solve instances of the knapsack problem with the help of machine learning predictions. This is an ideal setting because we can see how ML models learn to imitate human decisions and how this learning process converges to a stable point. We find that for many levels of ML performance, humans can improve the ML predictions to dynamically reach an equilibrium performance that is around 92% of the maximum knapsack value. We also find that the equilibrium performance could be even higher if humans rationally followed the ML recommendations. Finally, we test whether monetary incentives can increase the quality of human decisions, but we fail to find any positive effect. Our results have practical implications for the deployment of ML models in contexts where human decisions may deviate from the indisputable ground truth.


title: Grounding Toxicity in Real-World Events across Languages

abstract: Social media conversations frequently suffer from toxicity, creating significant issues for users, moderators, and entire communities. Events in the real world, like elections or conflicts, can initiate and escalate toxic behavior online. Our study investigates how real-world events influence the origin and spread of toxicity in online discussions across various languages and regions. We gathered Reddit data comprising 4.5 million comments from 31 thousand posts in six different languages (Dutch, English, German, Arabic, Turkish and Spanish). We target fifteen major social and political world events that occurred between 2020 and 2023. We observe significant variations in toxicity, negative sentiment, and emotion expressions across different events and language communities, showing that toxicity is a complex phenomenon in which many different factors interact and still need to be investigated. We will release the data for further research along with our code.


title: Offline RL via Feature-Occupancy Gradient Ascent

abstract: We study offline Reinforcement Learning in large infinite-horizon discounted Markov Decision Processes (MDPs) when the reward and transition models are linearly realizable under a known feature map. Starting from the classic linear-program formulation of the optimal control problem in MDPs, we develop a new algorithm that performs a form of gradient ascent in the space of feature occupancies, defined as the expected feature vectors that can potentially be generated by executing policies in the environment. We show that the resulting simple algorithm satisfies strong computational and sample complexity guarantees, achieved under the least restrictive data coverage assumptions known in the literature. In particular, we show that the sample complexity of our method scales optimally with the desired accuracy level and depends on a weak notion of coverage that only requires the empirical feature covariance matrix to cover a single direction in the feature space (as opposed to covering a full subspace). Additionally, our method is easy to implement and requires no prior knowledge of the coverage ratio (or even an upper bound on it), which altogether make it the strongest known algorithm for this setting to date.


title: Asymptotics of Weighted Reflectable Walks in $A_2$

abstract: Lattice walks are used to model various physical phenomena. In particular, walks within Weyl chambers connect directly to representation theory via the Littelmann path model. We derive asymptotics for centrally weighted lattice walks within the Weyl chamber corresponding to $A_2$ by using tools from analytic combinatorics in several variables (ACSV). We find universality classes depending on the weights of the walks, in line with prior results on the weighted Gouyou-Beauchamps model. Along the way, we identify a type of singularity within a multivariate rational generating function that is not yet covered by the theory of ACSV. We conjecture asymptotics for this type of singularity.


title: A label-free and data-free training strategy for vasculature segmentation in serial sectioning OCT data

abstract: Serial sectioning Optical Coherence Tomography (sOCT) is a high-throughput, label free microscopic imaging technique that is becoming increasingly popular to study post-mortem neurovasculature. Quantitative analysis of the vasculature requires highly accurate segmentation; however, sOCT has low signal-to-noise-ratio and displays a wide range of contrasts and artifacts that depend on acquisition parameters. Furthermore, labeled data is scarce and extremely time consuming to generate. Here, we leverage synthetic datasets of vessels to train a deep learning segmentation model. We construct the vessels with semi-realistic splines that simulate the vascular geometry and compare our model with realistic vascular labels generated by constrained constructive optimization. Both approaches yield similar Dice scores, although with very different false positive and false negative rates. This method addresses the complexity inherent in OCT images and paves the way for more accurate and efficient analysis of neurovascular structures.


title: Counterfactual Gradients-based Quantification of Prediction Trust in Neural Networks

abstract: The widespread adoption of deep neural networks in machine learning calls for an objective quantification of esoteric trust. In this paper we propose GradTrust, a classification trust measure for large-scale neural networks at inference. The proposed method utilizes variance of counterfactual gradients, i.e. the required changes in the network parameters if the label were different. We show that GradTrust is superior to existing techniques for detecting misprediction rates on $50000$ images from ImageNet validation dataset. Depending on the network, GradTrust detects images where either the ground truth is incorrect or ambiguous, or the classes are co-occurring. We extend GradTrust to Video Action Recognition on Kinetics-400 dataset. We showcase results on $14$ architectures pretrained on ImageNet and $5$ architectures pretrained on Kinetics-400. We observe the following: (i) simple methodologies like negative log likelihood and margin classifiers outperform state-of-the-art uncertainty and out-of-distribution detection techniques for misprediction rates, and (ii) the proposed GradTrust is in the Top-2 performing methods on $37$ of the considered $38$ experimental modalities. The code is available at: https://github.com/olivesgatech/GradTrust


title: Enhancing Multiscale Simulations with Constitutive Relations-Aware Deep Operator Networks

abstract: Multiscale problems are widely observed across diverse domains in physics and engineering. Translating these problems into numerical simulations and solving them using numerical schemes, e.g. the finite element method, is costly due to the demand of solving initial boundary-value problems at multiple scales. On the other hand, multiscale finite element computations are commended for their ability to integrate micro-structural properties into macroscopic computational analyses using homogenization techniques. Recently, neural operator-based surrogate models have shown trustworthy performance for solving a wide range of partial differential equations. In this work, we propose a hybrid method in which we utilize deep operator networks for surrogate modeling of the microscale physics. This allows us to embed the constitutive relations of the microscale into the model architecture and to predict microscale strains and stresses based on the prescribed macroscale strain inputs. Furthermore, numerical homogenization is carried out to obtain the macroscale quantities of interest. We apply the proposed approach to quasi-static problems of solid mechanics. The results demonstrate that our constitutive relations-aware DeepONet can yield accurate solutions even when being confronted with a restricted dataset during model development.


title: New global bounds on heavy neutrino mixing

abstract: We present an updated and improved global fit analysis of precision and flavor observables so as to derive constraints on deviations from unitarity in the leptonic mixing matrix. We focus on the case in which these deviations are sourced by heavy neutrinos, such that our results can also be interpreted as bounds on their mixing with the active flavors. Our analysis is motivated by new results on key observables, such as $M_W$, $|V_{ud}|$ and $\Gamma_{\text{inv}}$.


title: Monolithic Germanium Tin on Si Avalanche Photodiodes

abstract: We demonstrate monolithically grown germanium-tin (GeSn) on silicon avalanche photodiodes (APDs) for infrared light detection. A relatively thinner Ge buffer design was adopted to allow effective photo carriers to transport from the GeSn absorber to the Si multiplication layer such that clear punch-through behavior and a saturated primary responsivity of 0.3 A/W at 1550 nm were observed before avalanche breakdown in GeSn/Si APDs for the first time. The spectral response covers 1500 to 1700 nm. The measured punch-through and breakdown voltages are 15 and 17 V, respectively. Undisputed multiplication gain was obtained with the maximum value of 4.5 at 77 K, and 1.4 at 250 K, directly in reference to the saturated primary responsivity from the same device rather than a different GeSn p-i-n photodiode in previous reports. A peak responsivity was measured as 1.12 A/W at 1550 nm and 77 K.


title: A Versatile Diffusion Transformer with Mixture of Noise Levels for Audiovisual Generation

abstract: Training diffusion models for audiovisual sequences allows for a range of generation tasks by learning conditional distributions of various input-output combinations of the two modalities. Nevertheless, this strategy often requires training a separate model for each task which is expensive. Here, we propose a novel training approach to effectively learn arbitrary conditional distributions in the audiovisual space.Our key contribution lies in how we parameterize the diffusion timestep in the forward diffusion process. Instead of the standard fixed diffusion timestep, we propose applying variable diffusion timesteps across the temporal dimension and across modalities of the inputs. This formulation offers flexibility to introduce variable noise levels for various portions of the input, hence the term mixture of noise levels. We propose a transformer-based audiovisual latent diffusion model and show that it can be trained in a task-agnostic fashion using our approach to enable a variety of audiovisual generation tasks at inference time. Experiments demonstrate the versatility of our method in tackling cross-modal and multimodal interpolation tasks in the audiovisual space. Notably, our proposed approach surpasses baselines in generating temporally and perceptually consistent samples conditioned on the input. Project page: avdit2024.github.io


title: Banded Square Root Matrix Factorization for Differentially Private Model Training

abstract: Current state-of-the-art methods for differentially private model training are based on matrix factorization techniques. However, these methods suffer from high computational overhead because they require numerically solving a demanding optimization problem to determine an approximately optimal factorization prior to the actual model training. In this work, we present a new matrix factorization approach, BSR, which overcomes this computational bottleneck. By exploiting properties of the standard matrix square root, BSR allows to efficiently handle also large-scale problems. For the key scenario of stochastic gradient descent with momentum and weight decay, we even derive analytical expressions for BSR that render the computational overhead negligible. We prove bounds on the approximation quality that hold both in the centralized and in the federated learning setting. Our numerical experiments demonstrate that models trained using BSR perform on par with the best existing methods, while completely avoiding their computational overhead.


title: Irregularity in spectrum of the primary cosmic rays mass composition at an energy of ~ 10 PeV

abstract: Irregularity in spectrum of the primary cosmic rays (PCR) mass composition at an energy of ~ 10 PeV is considered. To assess changes of the PCR mass composition, the X-ray emulsion chamber (XREC) method and the halo-method based on the XEC were used. The study of changes in the PCR mass composition was carried out based on the experimentally obtained characteristics of the extensive air showers (EAS) trunks, where fluctuations of these characteristics are minimal and information about the primary interaction of PCR nuclei with atmospheric atoms is maximally preserved. It is shown that at an energy of ~ 10 PeV there is a local maximum in the heavy nuclei fraction. This maximum is correlated with the PCR sources, - variable stars SR (red giants and super-giants) and WR (Wolf-Rayet).


title: On the stability of second order gradient descent for time varying convex functions

abstract: Gradient based optimization algorithms deployed in Machine Learning (ML) applications are often analyzed and compared by their convergence rates or regret bounds. While these rates and bounds convey valuable information they don't always directly translate to stability guarantees. Stability and similar concepts, like robustness, will become ever more important as we move towards deploying models in real-time and safety critical systems. In this work we build upon the results in Gaudio et al. 2021 and Moreu and Annaswamy 2022 for second order gradient descent when applied to explicitly time varying cost functions and provide more general stability guarantees. These more general results can aid in the design and certification of these optimization schemes so as to help ensure safe and reliable deployment for real-time learning applications. We also hope that the techniques provided here will stimulate and cross-fertilize the analysis that occurs on the same algorithms from the online learning and stochastic optimization communities.


title: The Power of Extrapolation in Federated Learning

abstract: We propose and study several server-extrapolation strategies for enhancing the theoretical and empirical convergence properties of the popular federated learning optimizer FedProx [Li et al., 2020]. While it has long been known that some form of extrapolation can help in the practice of FL, only a handful of works provide any theoretical guarantees. The phenomenon seems elusive, and our current theoretical understanding remains severely incomplete. In our work, we focus on smooth convex or strongly convex problems in the interpolation regime. In particular, we propose Extrapolated FedProx (FedExProx), and study three extrapolation strategies: a constant strategy (depending on various smoothness parameters and the number of participating devices), and two smoothness-adaptive strategies; one based on the notion of gradient diversity (FedExProx-GraDS), and the other one based on the stochastic Polyak stepsize (FedExProx-StoPS). Our theory is corroborated with carefully constructed numerical experiments.


title: Enhancing Dose Selection in Phase I Cancer Trials: Extending the Bayesian Logistic Regression Model with Non-DLT Adverse Events Integration

abstract: This paper presents the Burdened Bayesian Logistic Regression Model (BBLRM), an enhancement to the Bayesian Logistic Regression Model (BLRM) for dose-finding in phase I oncology trials. Traditionally, the BLRM determines the maximum tolerated dose (MTD) based on dose-limiting toxicities (DLTs). However, clinicians often perceive model-based designs like BLRM as complex and less conservative than rule-based designs, such as the widely used 3+3 method. To address these concerns, the BBLRM incorporates non-DLT adverse events (nDLTAEs) into the model. These events, although not severe enough to qualify as DLTs, provide additional information suggesting that higher doses might result in DLTs. In the BBLRM, an additional parameter $\delta$ is introduced to account for nDLTAEs. This parameter adjusts the toxicity probability estimates, making the model more conservative in dose escalation. The $\delta$ parameter is derived from the proportion of patients experiencing nDLTAEs within each cohort and is tuned to balance the model's conservatism. This approach aims to reduce the likelihood of assigning toxic doses as MTD while involving clinicians more directly in the decision-making process. The paper includes a simulation study comparing BBLRM with the traditional BLRM across various scenarios. The simulations demonstrate that BBLRM significantly reduces the selection of toxic doses as MTD without compromising, and sometimes even increasing, the accuracy of MTD identification. These results suggest that integrating nDLTAEs into the dose-finding process can enhance the safety and acceptance of model-based designs in phase I oncology trials.


title: Quantum melting of long-range ordered quantum antiferromagnets investigated by momentum-space continuous similarity transformations

abstract: We apply continuous similarity transformations (CSTs) to study the zero-temperature breakdown of long-range ordered quantum antiferromagnets. The CST flow equations are truncated in momentum space by the scaling dimension so that all operators with scaling dimension up to two are taken into account. We determine the quantum phase transition out of the N\'eel-ordered phase in the unfrustrated square lattice Heisenberg bilayer as well as the quantum melting of the N\'eel-ordered and columnar phase in the highly frustrated $J_1$-$J_2$ model on the square lattice. In all cases the CST is set up to isolate the ground state so that the stability of the flow equations, the ground-state energy, and the sublattice magnetization are used to explore the long-range ordered phases. We extract quantum-critical points which agree well with values in the literature. Further, we estimate the associated critical exponents $\alpha$ and $\beta$ which turns out to be a challenging task for the CST approach.


title: Do Language Models Enjoy Their Own Stories? Prompting Large Language Models for Automatic Story Evaluation

abstract: Storytelling is an integral part of human experience and plays a crucial role in social interactions. Thus, Automatic Story Evaluation (ASE) and Generation (ASG) could benefit society in multiple ways, but they are challenging tasks which require high-level human abilities such as creativity, reasoning and deep understanding. Meanwhile, Large Language Models (LLM) now achieve state-of-the-art performance on many NLP tasks. In this paper, we study whether LLMs can be used as substitutes for human annotators for ASE. We perform an extensive analysis of the correlations between LLM ratings, other automatic measures, and human annotations, and we explore the influence of prompting on the results and the explainability of LLM behaviour. Most notably, we find that LLMs outperform current automatic measures for system-level evaluation but still struggle at providing satisfactory explanations for their answers.


title: Expansion-GRR: Efficient Generation of Smooth Global Redundancy Resolution Roadmaps

abstract: Global redundancy resolution (GRR) roadmap is a novel concept in robotics that facilitates the mapping from task space paths to configuration space paths in a legible, predictable, and repeatable way. Such roadmaps could find widespread utility in applications such as safe teleoperation, consistent path planning, and factory workcell design. However, the previous methods to compute GRR roadmaps often necessitate a lengthy computation time and produce non-smooth paths, limiting their practical efficacy. To address this challenge, we introduce a novel method Expansion-GRR that leverages efficient configuration space projections and enables a rapid generation of smooth roadmaps that satisfy the task constraints. Additionally, we propose a simple multi-seed strategy that further enhances the final quality. We conducted experiments in simulation with a 5-link planar manipulator and a Kinova arm. We were able to generate the GRR roadmaps up to 2 orders of magnitude faster while achieving higher smoothness. We also demonstrate the utility of the GRR roadmaps in teleoperation tasks where our method outperformed prior methods and reactive IK solvers in terms of success rate and solution quality.


title: Multi-Dataset Multi-Task Learning for COVID-19 Prognosis

abstract: In the fight against the COVID-19 pandemic, leveraging artificial intelligence to predict disease outcomes from chest radiographic images represents a significant scientific aim. The challenge, however, lies in the scarcity of large, labeled datasets with compatible tasks for training deep learning models without leading to overfitting. Addressing this issue, we introduce a novel multi-dataset multi-task training framework that predicts COVID-19 prognostic outcomes from chest X-rays (CXR) by integrating correlated datasets from disparate sources, distant from conventional multi-task learning approaches, which rely on datasets with multiple and correlated labeling schemes. Our framework hypothesizes that assessing severity scores enhances the model's ability to classify prognostic severity groups, thereby improving its robustness and predictive power. The proposed architecture comprises a deep convolutional network that receives inputs from two publicly available CXR datasets, AIforCOVID for severity prognostic prediction and BRIXIA for severity score assessment, and branches into task-specific fully connected output networks. Moreover, we propose a multi-task loss function, incorporating an indicator function, to exploit multi-dataset integration. The effectiveness and robustness of the proposed approach are demonstrated through significant performance improvements in prognosis classification tasks across 18 different convolutional neural network backbones in different evaluation strategies. This improvement is evident over single-task baselines and standard transfer learning strategies, supported by extensive statistical analysis, showing great application potential.


title: On the minimal generating sets of the Eulerian ideal

abstract: We study the minimal homogeneous generating sets of the Eulerian ideal associated with a simple graph and its maximal generating degree. We show that the Eulerian ideal is a lattice ideal and use this to give a characterization of binomials belonging to a minimal homogeneous generating set. In this way, we obtain an explicit minimal homogeneous generating set. We find an upper bound for the maximal generating degree in terms of the graph. This invariant is half the number of edges of a largest Eulerian subgraph of even cardinality without even-chords. We show that for bipartite graphs this invariant is the maximal generating degree. In particular, we prove that if the graph is bipartite, the Eulerian ideal is generated in degree $2$ if and only if the graph is chordal. Furthermore, we show that the maximal generating degree is also $2$ when the graph is a complete graph.


title: On the integrality gap of the Complete Metric Steiner Tree Problem via a novel formulation

abstract: In this work, we compute the lower bound of the integrality gap of the Metric Steiner Tree Problem (MSTP) on a graph for some small values of number of nodes and terminals. After debating about some limitations of the most used formulation for the Steiner Tree Problem, namely the Bidirected Cut Formulation, we introduce a novel formulation, that we named Complete Metric formulation, tailored for the metric case. We prove some interesting properties of this formulation and characterize some types of vertices. Finally, we define a linear program (LP) by adapting a method already used in the context of the Travelling Salesman Problem. This LP takes as input a vertex of the polytope of the CM relaxation and provides an MSTP instance such that (a) the optimal solution is precisely that vertex and (b) among all of the instances having that vertex as its optimal solution, the selected instance is the one having the highest integrality gap. We propose two heuristics for generating vertices to provide inputs for our procedure. In conclusion, we raise several conjectures and open questions.


title: Orbit structures and complexity in Schubert and Richardson Varieties

abstract: The goal of this paper is twofold. Firstly, we provide a type-uniform formula for the torus complexity of the usual torus action on a Richardson variety, by developing the notion of algebraic dimensions of Bruhat intervals, strengthening a type A result by Donten-Bury, Escobar and Portakal. In the process, we give an explicit description of the torus action on any Deodhar component as well as describe the root subgroups that comprise the component. Secondly, we exhibit a codimension preserving bijection between Levi-Borel subgroup (a Borel subgroup of a Levi subgroup in a reductive algebraic group) orbits in the big open cell of a Schubert variety and torus orbits in the big open cell of a distinguished Schubert subvariety. This bijection has many applications: a type-uniform formula for the Levi-Borel complexity of the usual Levi-Borel subgroup action on a Schubert variety as well as an indexing set for Levi-Borel subgroup orbits in a Schubert variety. We conclude by extending the Levi-Borel complexity results to a large class of Schubert varieties in the partial flag variety.


title: On algebraic sums, trees and ideals in the Cantor space

abstract: We work in the Cantor space $2^\omega$. The results of the paper adhere the following pattern. Let $\mathcal{I}\in \{\mathcal{M}, \mathcal{N}, \mathcal{M}\cap \mathcal{N}, \mathcal{E}\}$ and $T$ be a perfect, uniformly perfect or Silver tree. Then for every $A\in \mathcal{I}$ there exists $T'\subseteq T$ of the same kind as $T$ such that $A+\underbrace{[T']+[T']+\dots +[T']}_{\text{n--times}}\in \mathcal{I}$ for each $n\in\omega$. We also prove weaker statements for splitting trees. For the case $\mathcal{E}$ we also provide a simple characterization of basis of $\mathcal{E}$. We use these results to prove that the algebraic sum of a generalized Luzin set and a generalized Sierpi\'nski set belongs to $u_0$ and $v_0$, provided that $\mathfrak{c}$ is a regular cardinal.


title: Ballistic Energy Transport via Long Alkyl Chains: A New Initiation Mechanism

abstract: In an effort to increase the speed and efficiency of ballistic energy transport via oligomeric chains, we performed measurements of the transport in compounds featuring long alkyl chains of up to 37 methylene units. Compounds of the N3-(CH2)n-COOMe type (denoted as aznME) were synthesized with n = 5, 10, 15, 19, 28, 37 and studied using relaxation-assisted two-dimensional infrared spectroscopy. The speed of the ballistic transport, initiated by the N3 tag excitation, increased ca. 3-fold for the longer chains (n = 19-37) compared to the shorter chains, from 14.7 {\AA}/ps to 48 {\AA}/ps, in line with an earlier prediction (Nawagamuwage et al. 2021, J. Phys. Chem. B, 125, 7546). Modeling, based on solving numerically the Liouville equation, was capable of reproducing the experimental data only if three wavepackets are included, involving CH2 twisting (Tw), wagging (W), and rocking (Ro) chain bands. The approaches for designing molecular systems featuring higher speed and efficiency of energy transport are discussed.


title: No Filter: Cultural and Socioeconomic Diversity in Contrastive Vision-Language Models

abstract: We study cultural and socioeconomic diversity in contrastive vision-language models (VLMs). Using a broad range of benchmark datasets and evaluation metrics, we bring to attention several important findings. First, the common filtering of training data to English image-text pairs disadvantages communities of lower socioeconomic status and negatively impacts cultural understanding. Notably, this performance gap is not captured by - and even at odds with - the currently popular evaluation metrics derived from the Western-centric ImageNet and COCO datasets. Second, pretraining with global, unfiltered data before fine-tuning on English content can improve cultural understanding without sacrificing performance on said popular benchmarks. Third, we introduce the task of geo-localization as a novel evaluation metric to assess cultural diversity in VLMs. Our work underscores the value of using diverse data to create more inclusive multimodal systems and lays the groundwork for developing VLMs that better represent global perspectives.


title: Dark sector searches with the CMS experiment

abstract: Astrophysical observations provide compelling evidence for gravitationally interacting dark matter in the universe that cannot be explained by the standard model of particle physics. The extraordinary amount of data from the CERN LHC presents a unique opportunity to shed light on the nature of dark matter at unprecedented collision energies. This Report comprehensively reviews the most recent searches with the CMS experiment for particles and interactions belonging to a dark sector and for dark-sector mediators. Models with invisible massive particles are probed by searches for signatures of missing transverse momentum recoiling against visible standard model particles. Searches for mediators are also conducted via fully visible final states. The results of these searches are compared with those obtained from direct-detection experiments. Searches for alternative scenarios predicting more complex dark sectors with multiple new particles and new forces are also presented. Many of these models include long-lived particles, which could manifest themselves with striking unconventional signatures with relatively small amounts of background. Searches for such particles are discussed and their impact on dark-sector scenarios is evaluated. Many results and interpretations have been newly obtained for this Report.


title: Robust Disaster Assessment from Aerial Imagery Using Text-to-Image Synthetic Data

abstract: We present a simple and efficient method to leverage emerging text-to-image generative models in creating large-scale synthetic supervision for the task of damage assessment from aerial images. While significant recent advances have resulted in improved techniques for damage assessment using aerial or satellite imagery, they still suffer from poor robustness to domains where manual labeled data is unavailable, directly impacting post-disaster humanitarian assistance in such under-resourced geographies. Our contribution towards improving domain robustness in this scenario is two-fold. Firstly, we leverage the text-guided mask-based image editing capabilities of generative models and build an efficient and easily scalable pipeline to generate thousands of post-disaster images from low-resource domains. Secondly, we propose a simple two-stage training approach to train robust models while using manual supervision from different source domains along with the generated synthetic target domain data. We validate the strength of our proposed framework under cross-geography domain transfer setting from xBD and SKAI images in both single-source and multi-source settings, achieving significant improvements over a source-only baseline in each case.


title: Weak uniqueness for singular stochastic equations

abstract: We put forward a new method for proving weak uniqueness of stochastic equations with singular drifts driven by a non-Markov or infinite-dimensional noise. We apply our method to study stochastic heat equation (SHE) driven by Gaussian space-time white noise $$ \frac{\partial}{\partial t} u_t(x)=\frac12 \frac{\partial^2}{\partial x^2}u_t(x)+b(u_t(x))+\dot{W}_{t}(x), \quad t>0,\, x\in D\subset\mathbb{R}, $$ and multidimensional stochastic differential equation (SDE) driven by fractional Brownian motion with the Hurst index $H\in(0,1/2)$ $$ d X_t=b(X_t) dt +d B_t^H,\quad t>0. $$ In both cases $b$ is a generalized function in the Besov space $\mathcal{B}^\alpha_{\infty,\infty}$, $\alpha<0$. Well-known pathwise uniqueness results for these equations do not cover the entire range of the parameter $\alpha$, for which weak existence holds. What happens in the range where weak existence holds but pathwise uniqueness is unknown has been an open problem. We settle this problem and show that for SHE weak uniqueness holds for $\alpha>-3/2$, and for SDE it holds for $\alpha>1/2-1/(2H)$; thus, in both cases, it holds in the entire desired range of values of $\alpha$. This extends seminal results of Catellier and Gubinelli (2016) and Gy\"ongy and Pardoux (1993) to the weak well-posedness setting. To establish these results, we develop a new strategy, combining ideas from ergodic theory (generalized couplings of Hairer-Mattingly-Kulik-Scheutzow) with stochastic sewing of L\^e.


title: Addressing the Elephant in the Room: Robust Animal Re-Identification with Unsupervised Part-Based Feature Alignment

abstract: Animal Re-ID is crucial for wildlife conservation, yet it faces unique challenges compared to person Re-ID. First, the scarcity and lack of diversity in datasets lead to background-biased models. Second, animal Re-ID depends on subtle, species-specific cues, further complicated by variations in pose, background, and lighting. This study addresses background biases by proposing a method to systematically remove backgrounds in both training and evaluation phases. And unlike prior works that depend on pose annotations, our approach utilizes an unsupervised technique for feature alignment across body parts and pose variations, enhancing practicality. Our method achieves superior results on three key animal Re-ID datasets: ATRW, YakReID-103, and ELPephants.


title: Uniformization of Gromov hyperbolic domains by circle domains

abstract: We prove that a domain in the Riemann sphere is Gromov hyperbolic if and only if it is conformally equivalent to a uniform circle domain. This resolves a conjecture of Bonk--Heinonen--Koskela and also verifies Koebe's conjecture (Kreisnormierungsproblem) for the class of Gromov hyperbolic domains. Moreover, the uniformizing conformal map from a Gromov hyperbolic domain onto a circle domain is unique up to M\"obius transformations. We also undertake a careful study of the geometry of inner uniform domains in the plane and prove the above uniformization and rigidity results for such domains.


title: Nonparametric quantile regression for spatio-temporal processes

abstract: In this paper, we develop a new and effective approach to nonparametric quantile regression that accommodates ultrahigh-dimensional data arising from spatio-temporal processes. This approach proves advantageous in staving off computational challenges that constitute known hindrances to existing nonparametric quantile regression methods when the number of predictors is much larger than the available sample size. We investigate conditions under which estimation is feasible and of good overall quality and obtain sharp approximations that we employ to devising statistical inference methodology. These include simultaneous confidence intervals and tests of hypotheses, whose asymptotics is borne by a non-trivial functional central limit theorem tailored to martingale differences. Additionally, we provide finite-sample results through various simulations which, accompanied by an illustrative application to real-worldesque data (on electricity demand), offer guarantees on the performance of the proposed methodology.


title: Revisiting the dynamics of a charged spinning body in curved spacetime

abstract: We analyze the motion of the spinning body (in the pole-dipole approximation) in the gravitational and electromagnetic fields described by the Mathisson-Papapetrou-Dixon-Souriau equations. First, we define a novel spin supplementary condition for the electromagnetic interactions which generalizes the one proposed by Ohashi-Kyrian-Semer\'ak for gravity. As a result, we get the whole family of charged spinning particle models in the curved spacetime with remarkably simple dynamics (momentum and velocity are parallel). Applying the reparametrization procedure, for a specific dipole moment, we obtain equations of motion with constant mass and gyromagnetic factor. Next, we show that these equations follows from an effective Hamiltonian formalism, previously interpreted as a classical model of the charged Dirac particle.


title: Efficient Two-Stage Gaussian Process Regression Via Automatic Kernel Search and Subsampling

abstract: Gaussian Process Regression (GPR) is widely used in statistics and machine learning for prediction tasks requiring uncertainty measures. Its efficacy depends on the appropriate specification of the mean function, covariance kernel function, and associated hyperparameters. Severe misspecifications can lead to inaccurate results and problematic consequences, especially in safety-critical applications. However, a systematic approach to handle these misspecifications is lacking in the literature. In this work, we propose a general framework to address these issues. Firstly, we introduce a flexible two-stage GPR framework that separates mean prediction and uncertainty quantification (UQ) to prevent mean misspecification, which can introduce bias into the model. Secondly, kernel function misspecification is addressed through a novel automatic kernel search algorithm, supported by theoretical analysis, that selects the optimal kernel from a candidate set. Additionally, we propose a subsampling-based warm-start strategy for hyperparameter initialization to improve efficiency and avoid hyperparameter misspecification. With much lower computational cost, our subsampling-based strategy can yield competitive or better performance than training exclusively on the full dataset. Combining all these components, we recommend two GPR methods-exact and scalable-designed to match available computational resources and specific UQ requirements. Extensive evaluation on real-world datasets, including UCI benchmarks and a safety-critical medical case study, demonstrates the robustness and precision of our methods.


title: Towards Explainable Test Case Prioritisation with Learning-to-Rank Models

abstract: Test case prioritisation (TCP) is a critical task in regression testing to ensure quality as software evolves. Machine learning has become a common way to achieve it. In particular, learning-to-rank (LTR) algorithms provide an effective method of ordering and prioritising test cases. However, their use poses a challenge in terms of explainability, both globally at the model level and locally for particular results. Here, we present and discuss scenarios that require different explanations and how the particularities of TCP (multiple builds over time, test case and test suite variations, etc.) could influence them. We include a preliminary experiment to analyse the similarity of explanations, showing that they do not only vary depending on test case-specific predictions, but also on the relative ranks.


title: Disentangle Sample Size and Initialization Effect on Perfect Generalization for Single-Neuron Target

abstract: Overparameterized models like deep neural networks have the intriguing ability to recover target functions with fewer sampled data points than parameters (see arXiv:2307.08921). To gain insights into this phenomenon, we concentrate on a single-neuron target recovery scenario, offering a systematic examination of how initialization and sample size influence the performance of two-layer neural networks. Our experiments reveal that a smaller initialization scale is associated with improved generalization, and we identify a critical quantity called the "initial imbalance ratio" that governs training dynamics and generalization under small initialization, supported by theoretical proofs. Additionally, we empirically delineate two critical thresholds in sample size--termed the "optimistic sample size" and the "separation sample size"--that align with the theoretical frameworks established by (see arXiv:2307.08921 and arXiv:2309.00508). Our results indicate a transition in the model's ability to recover the target function: below the optimistic sample size, recovery is unattainable; at the optimistic sample size, recovery becomes attainable albeit with a set of initialization of zero measure. Upon reaching the separation sample size, the set of initialization that can successfully recover the target function shifts from zero to positive measure. These insights, derived from a simplified context, provide a perspective on the intricate yet decipherable complexities of perfect generalization in overparameterized neural networks.


title: Quantum algorithm for large-scale market equilibrium computation

abstract: Classical algorithms for market equilibrium computation such as proportional response dynamics face scalability issues with Internet-based applications such as auctions, recommender systems, and fair division, despite having an almost linear runtime in terms of the product of buyers and goods. In this work, we provide the first quantum algorithm for market equilibrium computation with sub-linear performance. Our algorithm provides a polynomial runtime speedup in terms of the product of the number of buyers and goods while reaching the same optimization objective value as the classical algorithm. Numerical simulations of a system with 16384 buyers and goods support our theoretical results that our quantum algorithm provides a significant speedup.


title: The manifold of polygons degenerated to segments

abstract: In this paper we study the space $\mathbb{L}(n)$ of $n$-gons in the plane degenerated to segments. We prove that this space is a smooth real submanifold of $\mathbb{C}^n$, and describe its topology in terms of the manifold $\mathbb{M}(n)$ of $n$-gons degenerated to segments and with the first vertex at 0. We show that $\mathbb{M}(n)$ and $\mathbb{L}(n)$ contain straight lines that form a basis of directions in each one of their tangent spaces, and we compute the geodesic equations in these manifolds. Finally, the quotient of $\mathbb{L}(n)$ by the diagonal action of the affine complex group and the re-enumeration of the vertices is described.


title: Bent Crystal Design and Characterization for High-Energy Physics Experiments

abstract: Bent crystal are widely used as optics for X-rays, but via the phenomenon of planar channeling they may act as waveguide for relativistic charged particles beam as well, outperforming some of the traditional technologies currently employed. A physical description of the phenomenon and the resulting potential for applications in a particle accelerator is reported. The elastic properties of the anisotropic crystal lattice medium are discussed, introducing different types of curvature which can enable a wide array of bending schemes optimized for each different case features. The technological development of machining strategy and bending solutions useful for the fabrication of crystals suitable in high energy particle manipulations are described. As well as the high precision characterization processes developed in order to satisfy the strict requirements for installation in an accelerator. Finally, the characterization of channeling phenomenon in bent crystal is described, pointing out several experimental setups suitable to comply each specific case constrains.


title: Multi-Type Point Cloud Autoencoder: A Complete Equivariant Embedding for Molecule Conformation and Pose

abstract: The point cloud is a flexible representation for a wide variety of data types, and is a particularly natural fit for the 3D conformations of molecules. Extant molecule embedding/representation schemes typically focus on internal degrees of freedom, ignoring the global 3D orientation. For tasks that depend on knowledge of both molecular conformation and 3D orientation, such as the generation of molecular dimers, clusters, or condensed phases, we require a representation which is provably complete in the types and positions of atomic nuclei and roto-inversion equivariant with respect to the input point cloud. We develop, train, and evaluate a new type of autoencoder, molecular O(3) encoding net (Mo3ENet), for multi-type point clouds, for which we propose a new reconstruction loss, capitalizing on a Gaussian mixture representation of the input and output point clouds. Mo3ENet is end-to-end equivariant, meaning the learned representation can be manipulated on O(3), a practical bonus for downstream learning tasks. An appropriately trained Mo3ENet latent space comprises a universal embedding for scalar and vector molecule property prediction tasks, as well as other downstream tasks incorporating the 3D molecular pose.


title: xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token

abstract: This paper introduces xRAG, an innovative context compression method tailored for retrieval-augmented generation. xRAG reinterprets document embeddings in dense retrieval--traditionally used solely for retrieval--as features from the retrieval modality. By employing a modality fusion methodology, xRAG seamlessly integrates these embeddings into the language model representation space, effectively eliminating the need for their textual counterparts and achieving an extreme compression rate. In xRAG, the only trainable component is the modality bridge, while both the retriever and the language model remain frozen. This design choice allows for the reuse of offline-constructed document embeddings and preserves the plug-and-play nature of retrieval augmentation. Experimental results demonstrate that xRAG achieves an average improvement of over 10% across six knowledge-intensive tasks, adaptable to various language model backbones, ranging from a dense 7B model to an 8x7B Mixture of Experts configuration. xRAG not only significantly outperforms previous context compression methods but also matches the performance of uncompressed models on several datasets, while reducing overall FLOPs by a factor of 3.53. Our work pioneers new directions in retrieval-augmented generation from the perspective of multimodality fusion, and we hope it lays the foundation for future efficient and scalable retrieval-augmented systems


title: Optimal global $BV$ regularity for 1-Laplace type BVP's with singular lower order terms

abstract: In this paper we provide a complete characterization of the regularity properties of the solutions associated to the homogeneous Dirichlet problem \begin{equation*} \begin{cases} \displaystyle - \Delta_1 u= h(u)f & \text{in } \Omega, \\ \newline u=0 & \text{on } \partial \Omega, \end{cases} \end{equation*} where $\Omega\subset\mathbb{R}^N$ is a bounded open set with Lipschitz boundary, $f \in L^m(\Omega)$ with $m\geq 1$ is a nonnegative function and $h\colon \mathbb{R}^+ \to \mathbb{R}^+$ is continuous, possibly singular at the origin and bounded at infinity. Without any growth restrictions on $h$ at zero, we prove existence of global finite energy solutions in $BV(\Omega)$ under sharp conditions on the summability of $f$ and on the behaviour of $h$ at infinity. Roughly speaking, the faster $h$ goes to zero at infinity, the less regularity is required on $f$. In contrast to the $p$-Laplacian case ($p>1$), we show that the behaviour of $h$ at the origin plays essentially no role. The main result contains an extension of the celebrated one of Lazer-McKenna (\cite{lm}) to the case of the $1$-Laplacian as principal operator.


title: Conditioning diffusion models by explicit forward-backward bridging

abstract: Given an unconditional diffusion model $\pi(x, y)$, using it to perform conditional simulation $\pi(x \mid y)$ is still largely an open question and is typically achieved by learning conditional drifts to the denoising SDE after the fact. In this work, we express conditional simulation as an inference problem on an augmented space corresponding to a partial SDE bridge. This perspective allows us to implement efficient and principled particle Gibbs and pseudo-marginal samplers marginally targeting the conditional distribution $\pi(x \mid y)$. Contrary to existing methodology, our methods do not introduce any additional approximation to the unconditional diffusion model aside from the Monte Carlo error. We showcase the benefits and drawbacks of our approach on a series of synthetic and real data examples.


title: Using k-medoids for distributed approximate similarity search with arbitrary distances

abstract: This paper presents GMASK, a general algorithm for distributed approximate similarity search that accepts any arbitrary distance function. GMASK requires a clustering algorithm that induces Voronoi regions in a dataset and returns a representative element for each region. Then, it creates a multilevel indexing structure suitable for large datasets with high dimensionality and sparsity, usually stored in distributed systems. Many similarity search algorithms rely on $k$-means, typically associated with the Euclidean distance, which is inappropriate for specific problems. Instead, in this work we implement GMASK using $k$-medoids to make it compatible with any distance and a wider range of problems. Experimental results verify the applicability of this method with real datasets, improving the performance of alternative algorithms for approximate similarity search. In addition, results confirm existing intuitions regarding the advantages of using certain instances of the Minkowski distance in high-dimensional datasets.


title: Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modeling

abstract: Data-driven artificial intelligence (AI) models have made significant advancements in weather forecasting, particularly in medium-range and nowcasting. However, most data-driven weather forecasting models are black-box systems that focus on learning data mapping rather than fine-grained physical evolution in the time dimension. Consequently, the limitations in the temporal scale of datasets prevent these models from forecasting at finer time scales. This paper proposes a physics-AI hybrid model (i.e., WeatherGFT) which Generalizes weather forecasts to Finer-grained Temporal scales beyond training dataset. Specifically, we employ a carefully designed PDE kernel to simulate physical evolution on a small time scale (e.g., 300 seconds) and use a parallel neural networks with a learnable router for bias correction. Furthermore, we introduce a lead time-aware training framework to promote the generalization of the model at different lead times. The weight analysis of physics-AI modules indicates that physics conducts major evolution while AI performs corrections adaptively. Extensive experiments show that WeatherGFT trained on an hourly dataset, achieves state-of-the-art performance across multiple lead times and exhibits the capability to generalize 30-minute forecasts.


title: Sparse Induced Subgraphs of Large Treewidth

abstract: Motivated by an induced counterpart of treewidth sparsifiers (i.e., sparse subgraphs keeping the treewidth large) provided by the celebrated Grid Minor theorem of Robertson and Seymour [JCTB '86] or by a classic result of Chekuri and Chuzhoy [SODA '15], we show that for any natural numbers $t$ and $w$, and real $\varepsilon > 0$, there is an integer $W := W(t,w,\varepsilon)$ such that every graph with treewidth at least $W$ and no $K_{t,t}$ subgraph admits a 2-connected $n$-vertex induced subgraph with treewidth at least $w$ and at most $(1+\varepsilon)n$ edges. The induced subgraph is either a subdivided wall, or its line graph, or a spanning supergraph of a subdivided biclique. This in particular extends a result of Weissauer [JCTB '19] that graphs of large treewidth have a large biclique subgraph or a long induced cycle.


title: Slaves to the Law of Large Numbers: An Asymptotic Equipartition Property for Perplexity in Generative Language Models

abstract: We propose a new asymptotic equipartition property for the perplexity of a large piece of text generated by a language model and present theoretical arguments for this property. Perplexity, defined as a inverse likelihood function, is widely used as a performance metric for training language models. Our main result states that the logarithmic perplexity of any large text produced by a language model must asymptotically converge to the average entropy of its token distributions. This means that language models are constrained to only produce outputs from a ``typical set", which we show, is a vanishingly small subset of all possible grammatically correct outputs. We present preliminary experimental results from an open-source language model to support our theoretical claims. This work has possible practical applications for understanding and improving ``AI detection" tools and theoretical implications for the uniqueness, predictability and creative potential of generative models.


title: Extending Kernel Testing To General Designs

abstract: Kernel-based testing has revolutionized the field of non-parametric tests through the embedding of distributions in an RKHS. This strategy has proven to be powerful and flexible, yet its applicability has been limited to the standard two-sample case, while practical situations often involve more complex experimental designs. To extend kernel testing to any design, we propose a linear model in the RKHS that allows for the decomposition of mean embeddings into additive functional effects. We then introduce a truncated kernel Hotelling-Lawley statistic to test the effects of the model, demonstrating that its asymptotic distribution is chi-square, which remains valid with its Nystrom approximation. We discuss a homoscedasticity assumption that, although absent in the standard two-sample case, is necessary for general designs. Finally, we illustrate our framework using a single-cell RNA sequencing dataset and provide kernel-based generalizations of classical diagnostic and exploration tools to broaden the scope of kernel testing in any experimental design.


title: Dense Connector for MLLMs

abstract: Do we fully leverage the potential of visual encoder in Multimodal Large Language Models (MLLMs)? The recent outstanding performance of MLLMs in multimodal understanding has garnered broad attention from both academia and industry. In the current MLLM rat race, the focus seems to be predominantly on the linguistic side. We witness the rise of larger and higher-quality instruction datasets, as well as the involvement of larger-sized LLMs. Yet, scant attention has been directed towards the visual signals utilized by MLLMs, often assumed to be the final high-level features extracted by a frozen visual encoder. In this paper, we introduce the Dense Connector - a simple, effective, and plug-and-play vision-language connector that significantly enhances existing MLLMs by leveraging multi-layer visual features, with minimal additional computational overhead. Furthermore, our model, trained solely on images, showcases remarkable zero-shot capabilities in video understanding as well. Experimental results across various vision encoders, image resolutions, training dataset scales, varying sizes of LLMs (2.7B->70B), and diverse architectures of MLLMs (e.g., LLaVA and Mini-Gemini) validate the versatility and scalability of our approach, achieving state-of-the-art performance on across 19 image and video benchmarks. We hope that this work will provide valuable experience and serve as a basic module for future MLLM development.


title: Bayesian Inference Under Differential Privacy: Prior Selection Considerations with Application to Univariate Gaussian Data and Regression

abstract: We describe Bayesian inference for the mean and variance of bounded data protected by differential privacy and modeled as Gaussian. Using this setting, we demonstrate that analysts can and should take the constraints imposed by the bounds into account when specifying prior distributions. Additionally, we provide theoretical and empirical results regarding what classes of default priors produce valid inference for a differentially private release in settings where substantial prior information is not available. We discuss how these results can be applied to Bayesian inference for regression with differentially private data.


title: An explicit Kuznetsov-Muravitsky enrichment

abstract: An embedding of arbitrary Heyting algebra H into a reduct from the variety of Kuznetsov-Muravitsky algebras is constructed. An algebraic proof is given that this reduct belongs to the variety of Heyting algebras generated by H.


title: Sunnie: An Anthropomorphic LLM-Based Conversational Agent for Mental Well-Being Activity Recommendation

abstract: A longstanding challenge in mental well-being support is the reluctance of people to adopt psychologically beneficial activities, often due to lack of motivation, low perceived trustworthiness, and limited personalization of recommendations. Chatbots have shown promise in promoting positive mental health practices, yet their rigid interaction flows and less human-like conversational experiences present significant limitations. In this work, we explore whether the anthropomorphic design (both LLM's persona design and conversational experience design) can enhance users' perception of the system and their willingness to adopt mental well-being activity recommendations. To this end, we introduce Sunnie, an anthropomorphic LLM-based conversational agent designed to offer personalized well-being support through multi-turn conversation and recommend practical actions grounded in positive psychology and social psychology. An empirical user study comparing the user experience with Sunnie and with a traditional survey-based activity recommendation system suggests that the anthropomorphic characteristics of Sunnie significantly enhance users' perception of the system and the overall usability; nevertheless, users' willingness to adopt activity recommendations did not change significantly.


title: Guarding Multiple Secrets: Enhanced Summary Statistic Privacy for Data Sharing

abstract: Data sharing enables critical advances in many research areas and business applications, but it may lead to inadvertent disclosure of sensitive summary statistics (e.g., means or quantiles). Existing literature only focuses on protecting a single confidential quantity, while in practice, data sharing involves multiple sensitive statistics. We propose a novel framework to define, analyze, and protect multi-secret summary statistics privacy in data sharing. Specifically, we measure the privacy risk of any data release mechanism by the worst-case probability of an attacker successfully inferring summary statistic secrets. Given an attacker's objective spanning from inferring a subset to the entirety of summary statistic secrets, we systematically design and analyze tailored privacy metrics. Defining the distortion as the worst-case distance between the original and released data distribution, we analyze the tradeoff between privacy and distortion. Our contribution also includes designing and analyzing data release mechanisms tailored for different data distributions and secret types. Evaluations on real-world data demonstrate the effectiveness of our mechanisms in practical applications.


title: Perceptual Fairness in Image Restoration

abstract: Fairness in image restoration tasks is the desire to treat different sub-groups of images equally well. Existing definitions of fairness in image restoration are highly restrictive. They consider a reconstruction to be a correct outcome for a group (e.g., women) only if it falls within the group's set of ground truth images (e.g., natural images of women); otherwise, it is considered entirely incorrect. Consequently, such definitions are prone to controversy, as errors in image restoration can manifest in various ways. In this work we offer an alternative approach towards fairness in image restoration, by considering the Group Perceptual Index (GPI), which we define as the statistical distance between the distribution of the group's ground truth images and the distribution of their reconstructions. We assess the fairness of an algorithm by comparing the GPI of different groups, and say that it achieves perfect Perceptual Fairness (PF) if the GPIs of all groups are identical. We motivate and theoretically study our new notion of fairness, draw its connection to previous ones, and demonstrate its utility on state-of-the-art face image super-resolution algorithms.


title: Advancing Graph Convolutional Networks via General Spectral Wavelets

abstract: Spectral graph convolution, an important tool of data filtering on graphs, relies on two essential decisions; selecting spectral bases for signal transformation and parameterizing the kernel for frequency analysis. While recent techniques mainly focus on standard Fourier transform and vector-valued spectral functions, they fall short in flexibility to describe specific signal distribution for each node, and expressivity of spectral function. In this paper, we present a novel wavelet-based graph convolution network, namely WaveGC, which integrates multi-resolution spectral bases and a matrix-valued filter kernel. Theoretically, we establish that WaveGC can effectively capture and decouple short-range and long-range information, providing superior filtering flexibility, surpassing existing graph convolutional networks and graph Transformers (GTs). To instantiate WaveGC, we introduce a novel technique for learning general graph wavelets by separately combining odd and even terms of Chebyshev polynomials. This approach strictly satisfies wavelet admissibility criteria. Our numerical experiments showcase the capabilities of the new network. By replacing the Transformer part in existing architectures with WaveGC, we consistently observe improvements in both short-range and long-range tasks. This underscores the effectiveness of the proposed model in handling different scenarios. Our code is available at https://github.com/liun-online/WaveGC.


title: MPI Progress For All

abstract: The progression of communication in the Message Passing Interface (MPI) is not well defined, yet it is critical for application performance, particularly in achieving effective computation and communication overlap. The opaque nature of MPI progress poses significant challenges in advancing MPI within modern high-performance computing (HPC) practices. Firstly, the lack of clarity hinders the development of explicit guidelines for enhancing computation and communication overlap in applications. Secondly, it prevents MPI from seamlessly integrating with contemporary programming paradigms, such as task-based runtimes and event-driven programming. Thirdly, it limits the extension of MPI functionalities from the user space. In this paper, we examine the role of MPI progress by analyzing the implementation details of MPI messaging. We then generalize the asynchronous communication pattern and identify key factors influencing application performance. Based on this analysis, we propose a set of MPI extensions designed to enable users to explicitly construct and manage an efficient progress engine. We provide example codes to demonstrate the use of these proposed APIs in achieving improved performance, adapting MPI to task-based or event-driven programming styles, and constructing collective algorithms that rival the performance of native implementations. Our approach is compared to previous efforts in the field, highlighting its reduced complexity and increased effectiveness.


title: Hybrid Quantum-Classical Normalizing Flow

abstract: With the rapid development of quantum computing technology, we have entered the era of noisy intermediate-scale quantum (NISQ) computers. Therefore, designing quantum algorithms that adapt to the hardware conditions of current NISQ devices and can preliminarily solve some practical problems has become the focus of researchers. In this paper, we focus on quantum generative models in the field of quantum machine learning, and propose a hybrid quantum-classical normalizing flow (HQCNF) model based on parameterized quantum circuits. Based on the ideas of classical normalizing flow models and the characteristics of parameterized quantum circuits, we cleverly design the form of the ansatz and the hybrid method of quantum and classical computing, and derive the form of the loss function in the case that quantum computing is involved. We test our model on the image generation problem. Experimental results show that our model is capable of generating images of good quality. Compared with other quantum generative models, such as quantum generative adversarial networks (QGAN), our model achieves lower (better) Fr\'echet inception distance (FID) score, and compared with classical generative models, we can complete the image generation task with significantly fewer parameters. These results prove the advantage of our proposed model.


title: Self-trapping phenomenon, multistability and chaos in open anisotropic Dicke dimer

abstract: We investigate semiclassical dynamics of coupled atom-photon interacting system described by a dimer of anisotropic Dicke model in the presence of photon loss, exhibiting a rich variety of non-linear dynamics. Based on symmetries and dynamical classification, we characterize and chart out various dynamical phases in a phase diagram. A key feature of this system is the multistability of different dynamical states, particularly the coexistence of various superradiant phases as well as limit cycles. Remarkably, this dimer system manifests self-trapping phenomena, resulting in a photon population imbalance between the cavities. Such a self-trapped state arises from saddle-node bifurcation, which can be understood from an equivalent Landau-Ginzburg description. Additionally, we identify a unique class of oscillatory dynamics self-trapped limit cycle hosting self-trapping of photons. The absence of stable dynamical phases leads to the onset of chaos, which is diagnosed using the saturation value of the decorrelator dynamics. Moreover, in a narrow region, the self-trapped states can coexist with chaotic attractor, which may have intriguing consequences in quantum dynamics. Finally, we discuss the experimental relevance of our findings, which can be tested in cavity and circuit quantum electrodynamics setups.

categories: cond-mat.quant-gas cond-mat.stat-mech nlin.CD physics.optics


title: Leveraging 2D Information for Long-term Time Series Forecasting with Vanilla Transformers

abstract: Time series prediction is crucial for understanding and forecasting complex dynamics in various domains, ranging from finance and economics to climate and healthcare. Based on Transformer architecture, one approach involves encoding multiple variables from the same timestamp into a single temporal token to model global dependencies. In contrast, another approach embeds the time points of individual series into separate variate tokens. The former method faces challenges in learning variate-centric representations, while the latter risks missing essential temporal information critical for accurate forecasting. In our work, we introduce GridTST, a model that combines the benefits of two approaches using innovative multi-directional attentions based on a vanilla Transformer. We regard the input time series data as a grid, where the $x$-axis represents the time steps and the $y$-axis represents the variates. A vertical slicing of this grid combines the variates at each time step into a \textit{time token}, while a horizontal slicing embeds the individual series across all time steps into a \textit{variate token}. Correspondingly, a \textit{horizontal attention mechanism} focuses on time tokens to comprehend the correlations between data at various time steps, while a \textit{vertical}, variate-aware \textit{attention} is employed to grasp multivariate correlations. This combination enables efficient processing of information across both time and variate dimensions, thereby enhancing the model's analytical strength. % We also integrate the patch technique, segmenting time tokens into subseries-level patches, ensuring that local semantic information is retained in the embedding. The GridTST model consistently delivers state-of-the-art performance across various real-world datasets.


abstract: The rapid expansion of Location-Based Social Networks (LBSNs) has highlighted the importance of effective next Point-of-Interest (POI) recommendations, which leverage historical check-in data to predict users' next POIs to visit. Traditional centralized deep neural networks (DNNs) offer impressive POI recommendation performance but face challenges due to privacy concerns and limited timeliness. In response, on-device POI recommendations have been introduced, utilizing federated learning (FL) and decentralized approaches to ensure privacy and recommendation timeliness. However, these methods often suffer from computational strain on devices and struggle to adapt to new users and regions. This paper introduces a novel collaborative learning framework, Diffusion-Based Cloud-Edge-Device Collaborative Learning for Next POI Recommendations (DCPR), leveraging the diffusion model known for its success across various domains. DCPR operates with a cloud-edge-device architecture to offer region-specific and highly personalized POI recommendations while reducing on-device computational burdens. DCPR minimizes on-device computational demands through a unique blend of global and local learning processes. Our evaluation with two real-world datasets demonstrates DCPR's superior performance in recommendation accuracy, efficiency, and adaptability to new users and regions, marking a significant step forward in on-device POI recommendation technology.


title: Interpretable Multivariate Time Series Forecasting Using Neural Fourier Transform

abstract: Multivariate time series forecasting is a pivotal task in several domains, including financial planning, medical diagnostics, and climate science. This paper presents the Neural Fourier Transform (NFT) algorithm, which combines multi-dimensional Fourier transforms with Temporal Convolutional Network layers to improve both the accuracy and interpretability of forecasts. The Neural Fourier Transform is empirically validated on fourteen diverse datasets, showing superior performance across multiple forecasting horizons and lookbacks, setting new benchmarks in the field. This work advances multivariate time series forecasting by providing a model that is both interpretable and highly predictive, making it a valuable tool for both practitioners and researchers. The code for this study is publicly available.


title: Multivariate Tempered Space-Fractional Negative Binomial Process and Risk Models with Shocks

abstract: In this paper, we first define the multivariate tempered space-fractional Poisson process (MTSFPP) by time-changing the multivariate Poisson process with an independent tempered {\alpha}-stable subordinator. Its distributional properties, the mixture tempered time and space variants and their PDEs connections are studied. Then we define the multivariate tempered space-fractional negative binomial process (MTSFNBP) and explore its key features. The L\'evy measure density for the MTSFNBP is also derived. We present a bivariate risk model with a common shock driven by the tempered space-fractional negative binomial process. We demonstrate that the total claim amount process is stochastically equivalent to a univariate generalized Cramer-Lundberg risk model. In addition, some important ruin measures such as ruin probability, joint distribution of time to ruin and deficit at ruin along with governing integro-differential equations are obtained. Finally we show that the underlying risk process exhibits the long range dependence property.


title: Extension of the SpK Atomic Physics Code to Generate Global Equation of State Data

abstract: Global microphysics models are required for the modelling of high-energy-density physics (HEDP) experiments, the improvement of which are critical to the path to inertial fusion energy. This work presents further developments to the atomic and microphysics code, SpK, part of the numerical modelling suite of Imperial College London and First Light Fusion. We extend the capabilities of SpK to allow the calculation of the equation of state (EoS). The detailed configuration accounting calculations are interpolated into finite-temperature Thomas-Fermi calculations at high coupling to form the electronic component of the model. The Cowan model provides the ionic contribution, modified to approximate the physics of diatomic molecular dissociation. By utilising bonding corrections and performing a Maxwell construction, SpK captures the EoS from states ranging from the zero-pressure solid, through the liquid-vapour coexistence region and into plasma states. This global approach offers the benefit of capturing electronic shell structure over large regions of parameter space, building highly-resolved tables in minutes on a simple desktop. We present shock Hugoniot and off-Hugoniot calculations for a number of materials, comparing SpK to other models and experimental data. We also apply EoS and opacity data generated by SpK in integrated simulations of indirectly-driven capsule implosions, highlighting physical sensitivities to the choice of EoS models.

categories: physics.plasm-ph cond-mat.mtrl-sci cond-mat.stat-mech physics.atom-ph physics.comp-ph


title: Irreducibility in generalized power series

abstract: A classical tool in the study of real closed fields are the fields $K((G))$ of generalized power series (i.e., formal sums with well-ordered support) with coefficients in a field $K$ of characteristic 0 and exponents in an ordered abelian group $G$. In this paper we enlarge the family of ordinals $\alpha$ of non-additively principal Cantor degree for which $K((\mathbb{R}^{\le 0}))$ admits irreducibles of order type $\alpha$ far beyond $\alpha=\omega^2 $ and $\alpha = \omega^3$ known prior to this work.


title: Getting More from Less: Large Language Models are Good Spontaneous Multilingual Learners

abstract: Recently, Large Language Models (LLMs) have shown impressive language capabilities. While most of the existing LLMs have very unbalanced performance across different languages, multilingual alignment based on translation parallel data is an effective method to enhance the LLMs' multilingual capabilities. In this work, we discover and comprehensively investigate the spontaneous multilingual alignment improvement of LLMs. We find that LLMs instruction-tuned on the question translation data (i.e. without annotated answers) are able to encourage the alignment between English and a wide range of languages, even including those unseen during instruction-tuning. Additionally, we utilize different settings and mechanistic interpretability methods to analyze the LLM's performance in the multilingual scenario comprehensively. Our work suggests that LLMs have enormous potential for improving multilingual alignment efficiently with great language and task generalization.


title: Thermodynamic Natural Gradient Descent

abstract: Second-order training methods have better convergence properties than gradient descent but are rarely used in practice for large-scale training due to their computational overhead. This can be viewed as a hardware limitation (imposed by digital computers). Here we show that natural gradient descent (NGD), a second-order method, can have a similar computational complexity per iteration to a first-order method, when employing appropriate hardware. We present a new hybrid digital-analog algorithm for training neural networks that is equivalent to NGD in a certain parameter regime but avoids prohibitively costly linear system solves. Our algorithm exploits the thermodynamic properties of an analog system at equilibrium, and hence requires an analog thermodynamic computer. The training occurs in a hybrid digital-analog loop, where the gradient and Fisher information matrix (or any other positive semi-definite curvature matrix) are calculated at given time intervals while the analog dynamics take place. We numerically demonstrate the superiority of this approach over state-of-the-art digital first- and second-order training methods on classification tasks and language model fine-tuning tasks.


title: Identifiability of Differential-Algebraic Systems

abstract: Data-driven modeling of dynamical systems often faces numerous data-related challenges. A fundamental requirement is the existence of a unique set of parameters for a chosen model structure, an issue commonly referred to as identifiability. Although this problem is well studied for ordinary differential equations (ODEs), few studies have focused on the more general class of systems described by differential-algebraic equations (DAEs). Examples of DAEs include dynamical systems with algebraic equations representing conservation laws or approximating fast dynamics. This work introduces a novel identifiability test for models characterized by nonlinear DAEs. Unlike previous approaches, our test only requires prior knowledge of the system equations and does not need nonlinear transformation, index reduction, or numerical integration of the DAEs. We employed our identifiability analysis across a diverse range of DAE models, illustrating how system identifiability depends on the choices of sensors, experimental conditions, and model structures. Given the added challenges involved in identifying DAEs when compared to ODEs, we anticipate that our findings will have broad applicability and contribute significantly to the development and validation of data-driven methods for DAEs and other structure-preserving models.


title: Entanglement-swapping in generalised probabilistic theories, and iterated CHSH games

abstract: While there exist theories that have states "more strongly entangled" than quantum theory, in the sense that they show CHSH values above Tsirelson's bound, all known examples of such theories have a strictly smaller set of measurements. Therefore, in tasks which require both bipartite states and measurements, they do not perform better than QM. One of the simplest information processing tasks involving both bipartite states and measurements is that of entanglement swapping. In this paper, we study entanglement swapping in generalised probabilistic theories (GPTs). In particular, we introduce the iterated CHSH game, which measures the power of a GPT to preserve non-classical correlations, in terms of the largest CHSH value obtainable after $n$ rounds of entanglement swapping. Our main result is the construction of a GPT that achieves a CHSH value of $4$ after an arbitrary number of rounds. This addresses a question about the optimality of quantum theory for such games recently raised in the literature. One challenge faced when treating this problem is that there seems to be no general framework for constructing GPTs in which entanglement swapping is a well-defined operation. Therefore, we introduce an algorithmic construction that turns a bipartite GPT into a multipartite GPT that supports entanglement swapping, if consistently possible.


title: Towards Comprehensive and Efficient Post Safety Alignment of Large Language Models via Safety Patching

abstract: Safety alignment of large language models (LLMs) has been gaining increasing attention. However, current safety-aligned LLMs suffer from the fragile and imbalanced safety mechanisms, which can still be induced to generate unsafe responses, exhibit over-safety by rejecting safe user inputs, and fail to preserve general utility after safety alignment. To this end, we propose a novel post safety alignment (PSA) method to address these inherent and emerging safety challenges, including safety enhancement, over-safety mitigation, and utility preservation. In specific, we introduce \textsc{SafePatching}, a novel framework for comprehensive and efficient PSA, where two distinct safety patches are developed on the harmful data to enhance safety and mitigate over-safety concerns, and then seamlessly integrated into the target LLM backbone without compromising its utility. Extensive experiments show that \textsc{SafePatching} achieves a more comprehensive and efficient PSA than baseline methods. It even enhances the utility of the backbone, further optimizing the balance between being helpful and harmless in current aligned LLMs. Also, \textsc{SafePatching} demonstrates its superiority in continual PSA scenarios.


title: Normalizing Basis Functions: Approximate Stationary Models for Large Spatial Data

abstract: In geostatistics, traditional spatial models often rely on the Gaussian Process (GP) to fit stationary covariances to data. It is well known that this approach becomes computationally infeasible when dealing with large data volumes, necessitating the use of approximate methods. A powerful class of methods approximate the GP as a sum of basis functions with random coefficients. Although this technique offers computational efficiency, it does not inherently guarantee a stationary covariance. To mitigate this issue, the basis functions can be "normalized" to maintain a constant marginal variance, avoiding unwanted artifacts and edge effects. This allows for the fitting of nearly stationary models to large, potentially non-stationary datasets, providing a rigorous base to extend to more complex problems. Unfortunately, the process of normalizing these basis functions is computationally demanding. To address this, we introduce two fast and accurate algorithms to the normalization step, allowing for efficient prediction on fine grids. The practical value of these algorithms is showcased in the context of a spatial analysis on a large dataset, where significant computational speedups are achieved. While implementation and testing are done specifically within the LatticeKrig framework, these algorithms can be adapted to other basis function methods operating on regular grids.


title: Estimation of radial velocities of BHB stars

abstract: We studied blue horizontal branch stars (BHBs), and calculated their radial velocities. Spectra of these stars have been obtained with moderate signal-to-noise ratio for five blue horizontal-branch stars using the 2 meter telescope and Echelle Spectrograph in Ondrejov observatory, Czech republic.


title: A baseline on the relation between chemical patterns and birth stellar cluster

abstract: The chemical composition of a star's atmosphere reflects the chemical composition of its birth environment. Therefore, it should be feasible to recognize stars born together that have scattered throughout the galaxy, solely based on their chemistry. This concept, known as "strong chemical tagging", is a major objective of spectroscopic studies, but has yet to yield the anticipated results. We assess the existence and the robustness of the relation between chemical abundances and birth place using known member stars of open clusters. We followed a supervised machine learning approach, using chemical abundances obtained from APOGEE DR17, observed open clusters as labels and different data preprocessing techniques. We found that open clusters can be recovered with any classifier and on data whose features are not carefully selected. In the sample with no field stars, we obtain an average accuracy of $75.2\%$ and we find that the prediction accuracy depends mostly on the uncertainties of the chemical abundances. When field stars outnumber the cluster members, the performance degrades. Our results show the difficulty of recovering birth clusters using chemistry alone, even in a supervised scenario. This clearly challenges the feasibility of strong chemical tagging. Nevertheless, including information about ages could potentially enhance the possibility of recovering birth clusters.


title: GMMFormer v2: An Uncertainty-aware Framework for Partially Relevant Video Retrieval

abstract: Given a text query, partially relevant video retrieval (PRVR) aims to retrieve untrimmed videos containing relevant moments. Due to the lack of moment annotations, the uncertainty lying in clip modeling and text-clip correspondence leads to major challenges. Despite the great progress, existing solutions either sacrifice efficiency or efficacy to capture varying and uncertain video moments. What's worse, few methods have paid attention to the text-clip matching pattern under such uncertainty, exposing the risk of semantic collapse. To address these issues, we present GMMFormer v2, an uncertainty-aware framework for PRVR. For clip modeling, we improve a strong baseline GMMFormer with a novel temporal consolidation module upon multi-scale contextual features, which maintains efficiency and improves the perception for varying moments. To achieve uncertainty-aware text-clip matching, we upgrade the query diverse loss in GMMFormer to facilitate fine-grained uniformity and propose a novel optimal matching loss for fine-grained text-clip alignment. Their collaboration alleviates the semantic collapse phenomenon and neatly promotes accurate correspondence between texts and moments. We conduct extensive experiments and ablation studies on three PRVR benchmarks, demonstrating remarkable improvement of GMMFormer v2 compared to the past SOTA competitor and the versatility of uncertainty-aware text-clip matching for PRVR. Code is available at \url{https://github.com/huangmozhi9527/GMMFormer_v2}.


title: Range-Limited Heaps' Law for Functional DNA Words in the Human Genome

abstract: Heaps' or Herdan's law is a linguistic law describing the relationship between the vocabulary/dictionary size (type) and word counts (token) to be a power-law function. Its existence in genomes with certain definition of DNA words is unclear partly because the dictionary size in genome could be much smaller than that in a human language. We define a DNA word as a coding region in a genome that codes for a protein domain. Using human chromosomes and chromosome arms as individual samples, we establish the existence of Heaps' law in the human genome within limited range. Our definition of words in a genomic or proteomic context is different from other definitions such as over-represented k-mers which are much shorter in length. Although an approximate power-law distribution of protein domain sizes due to gene duplication and the related Zipf's law is well known, their translation to the Heaps' law in DNA words is not automatic. Several other animal genomes are shown herein also to exhibit range-limited Heaps' law with our definition of DNA words, though with various exponents. When tokens were randomly sampled and sample sizes reach to the maximum level, a deviation from the Heaps' law was observed, but a quadratic regression in log-log type-token plot fits the data perfectly. Investigation of type-token plot and its regression coefficients could provide an alternative narrative of reusage and redundancy of protein domains as well as creation of new protein domains from a linguistic perspective.


title: Spinning binary dynamics in cubic effective field theories of gravity

abstract: We study the binary dynamics of two Kerr black holes with arbitrary spin vectors in the presence of parity-even and parity-odd cubic deformations of gravity. We first derive the tree-level Compton amplitudes for a Kerr black hole in cubic gravity, which we then use to compute the two-to-two amplitudes of the massive bodies to leading order in the deformation and the post-Minkowskian expansion. The required one-loop computations are performed using the leading singularity approach as well as the heavy-mass effective field theory (HEFT) approach. These amplitudes are then used to compute the leading-order momentum and spin kick in cubic gravity in the KMOC formalism. Our results are valid for generic masses and spin vectors, and include all the independent parity-even and parity-odd cubic deformations of Einstein-Hilbert gravity. We also present spin-expanded expressions for the momentum and spin kicks, and the all-order in spin deflection angle in the case of aligned spins.


title: A Reliable Target Evolved Node B Selection Scheme in LTE-Advanced Handover

abstract: The problem of improving the handover performance in Long Term Evolution-Advanced (LTE-A) networks has not been fully solved yet. Traditionally, the selection of the target Evolved Node B (TeNB) in the handover procedure is based on the signal strength measurements, which may not produce a reliable handover. A reliable handover method may reduce the instances of unstable or frequent handovers that otherwise waste network resources. The signal strength measurement process is inherently time consuming as the user equipment (UE) has to measure multiple neighboring eNB (NeNB) frequencies in each measurement period. An efficient handover method is required to improve the overall performance of such systems. In this paper we propose a reliable and fast TeNB selection scheme for LTE-A handover. The proposed scheme outperforms the existing LTE-A handover methods. The improved performance is achieved by selecting the TeNB based on some three independent parameters, namely orientation matching (OM), current load (CL), and the received signal strengths. An UE essentially measures only the NeNBs shortlisted based on OM and CL; thus measurement time is reduced considerably leading to a reduction of overall handover time. The performance of the proposed scheme is validated by simulation.