title: Twist-angle tunable spin texture in WSe$_2$/graphene van der Waals heterostructures

abstract: Angle-twisting engineering has emerged as a powerful tool for modulating electronic properties in van der Waals heterostructures. Recent theoretical works have predicted the modulation of spin texture in graphene-based heterostructures by twist angle, although an experimental verification is missing. Here, we demonstrate the tunability of the spin texture and associated spin-charge interconversion with twist angle in WSe$_2$/graphene heterostructures by using spin precession experiments. For specific twist angles, we experimentally detect a spin component radial with the electron's momentum, in addition to the standard orthogonal component. Our results show that the helicity of the spin texture can be reversed by angle twisting, highlighting its critical role on the spin-orbit properties of WSe$_2$/graphene heterostructures and paving the way for the development of novel spin-twistronic devices.


title: Large-scale, Multi-pass, Two-chamber RF Atomic Magnetometer

abstract: We describe one of the largest radio-frequency RF atomic magnetometers presently operating. A total atomic volume of 128 $\mathrm{cm^3}$, with correspondingly large number of $^{87}$Rb atoms, can reduce atom noise. A total of 44 passes of the probe beam reduces photon-shot noise. The atomic vapor is divided between two chambers allowing for pumping of the cells individually; doing so with opposite-helicity light enables use as an intrinsic gradiometer. In this configuration, common-mode noise sources including light-shift noise can be reduced. Magnetic tuning fields can also be applied to the chambers individually, allowing simultaneous measurement of two frequencies. An application of this is in the search for contraband materials using Nuclear Quadrupole Resonance (NQR), for which simultaneous measurement can significantly reduce search times. We demonstrate dual-frequency measurement on an effective range of 423-531 kHz, corresponding to the NQR frequencies of ammonium nitrate NH$_4$NO$_3$ at the lowest value and potassium chlorate KClO$_3$ at the highest. We explore fundamental, as well as instrumental, noise contributions to the sensitivity in this system.


title: On covariant and canonical Hamiltonian formalisms for gauge theories

abstract: The Hamiltonian description of classical gauge theories is a very well studied subject. The two best known approaches, namely the covariant and canonical Hamiltonian formalisms have received a lot of attention in the literature. However, a full understanding of the relation between them is not available, specially when the gauge theories are defined over regions with boundaries. Here we consider this issue, by first making precise what we mean by equivalence between the two formalisms. Then we explore several first order gauge theories, and assess whether their corresponding descriptions satisfy the notion of equivalence. We shall show that, even when in several cases the two formalisms are indeed equivalent, there are counterexamples that signal that this is not always the case. Thus, non-equivalence is a generic feature for gauge field theories. These results call for a deeper understanding of the subject.


title: Constrained Meta-Reinforcement Learning for Adaptable Safety Guarantee with Differentiable Convex Programming

abstract: Despite remarkable achievements in artificial intelligence, the deployability of learning-enabled systems in high-stakes real-world environments still faces persistent challenges. For example, in safety-critical domains like autonomous driving, robotic manipulation, and healthcare, it is crucial not only to achieve high performance but also to comply with given constraints. Furthermore, adaptability becomes paramount in non-stationary domains, where environmental parameters are subject to change. While safety and adaptability are recognized as key qualities for the new generation of AI, current approaches have not demonstrated effective adaptable performance in constrained settings. Hence, this paper breaks new ground by studying the unique challenges of ensuring safety in non-stationary environments by solving constrained problems through the lens of the meta-learning approach (learning-to-learn). While unconstrained meta-learning al-ready encounters complexities in end-to-end differentiation of the loss due to the bi-level nature, its constrained counterpart introduces an additional layer of difficulty, since the constraints imposed on task-level updates complicate the differentiation process. To address the issue, we first employ successive convex-constrained policy updates across multiple tasks with differentiable convexprogramming, which allows meta-learning in constrained scenarios by enabling end-to-end differentiation. This approach empowers the agent to rapidly adapt to new tasks under non-stationarity while ensuring compliance with safety constraints.


title: Two simple criterion to prove the existence of patterns in reaction-diffusion models of two components

abstract: The aim of this work is to study the effect of diffusion on the stability of the equilibria in a general two-components reaction-diffusion system with Neumann boundary conditions in the space of continuous functions. As by product, we establish sufficient conditions on the diffusive coefficients and other parameters for such a reaction-diffusion model to exhibit patterns and we analyze their stability. We apply the results obtained in this paper to explore under which parameters values a Turing bifurcation can occur, given rise to non uniform stationary solutions (patterns) for a reaction-diffusion predator-prey model with variable mortality and Hollyn's type II functional response.


title: Unraveling TeV Halos with the Cherenkov Telescope Array

abstract: Pulsars are observed to emit bright and spatially extended emission at multi-TeV energies. Although such "TeV halos" appear to be an approximately universal feature of middle-aged pulsars, there remains much to be understood about these systems. In this paper, we project the ability of the Cherenkov Telescope Array (CTA) to measure the properties of TeV halos, focusing on the case of the nearby Geminga pulsar. We conclude that CTA will be able to provide important information about this source, allowing us to discriminate between a range of different models that are currently consistent with all existing data. In particular, such observations will help us to measure the normalization, energy dependence, and spatial dependence of the diffusion coefficient in the region that surrounds Geminga, as well as the spectrum of the electrons that are injected from this source.


title: Identifiability and Characterization of Transmon Qutrits Through Bayesian Experimental Design

abstract: Robust control of a quantum system is essential to utilize the current noisy quantum hardware to their full potential, such as quantum algorithms. To achieve such a goal, systematic search for an optimal control for any given experiment is essential. Design of optimal control pulses require accurate numerical models, and therefore, accurate characterization of the system parameters. We present an online, Bayesian approach for quantum characterization of qutrit systems which automatically and systematically identifies the optimal experiments that provide maximum information on the system parameters, thereby greatly reducing the number of experiments that need to be performed on the quantum testbed. Unlike most characterization protocols that provide point-estimates of the parameters, the proposed approach is able to estimate their probability distribution. The applicability of the Bayesian experimental design technique was demonstrated on test problems where each experiment was defined by a parameterized control pulse. In addition to this, we also presented an approach for iterative pulse extension which is robust under uncertainties in transition frequencies and coherence times, and shot noise, despite being initialized with wide uninformative priors. Furthermore, we provide a mathematical proof of the theoretical identifiability of the model parameters and present conditions on the quantum state under which the parameters are identifiable. The proof and conditions for identifiability are presented for both closed and open quantum systems using the Schroedinger equation and the Lindblad master equation respectively.


title: Targeted Machine Learning for Average Causal Effect Estimation Using the Front-Door Functional

abstract: Evaluating the average causal effect (ACE) of a treatment on an outcome often involves overcoming the challenges posed by confounding factors in observational studies. A traditional approach uses the back-door criterion, seeking adjustment sets to block confounding paths between treatment and outcome. However, this method struggles with unmeasured confounders. As an alternative, the front-door criterion offers a solution, even in the presence of unmeasured confounders between treatment and outcome. This method relies on identifying mediators that are not directly affected by these confounders and that completely mediate the treatment's effect. Here, we introduce novel estimation strategies for the front-door criterion based on the targeted minimum loss-based estimation theory. Our estimators work across diverse scenarios, handling binary, continuous, and multivariate mediators. They leverage data-adaptive machine learning algorithms, minimizing assumptions and ensuring key statistical properties like asymptotic linearity, double-robustness, efficiency, and valid estimates within the target parameter space. We establish conditions under which the nuisance functional estimations ensure the root n-consistency of ACE estimators. Our numerical experiments show the favorable finite sample performance of the proposed estimators. We demonstrate the applicability of these estimators to analyze the effect of early stage academic performance on future yearly income using data from the Finnish Social Science Data Archive.


title: Building symmetries into data-driven manifold dynamics models for complex flows

abstract: Symmetries in a dynamical system provide an opportunity to dramatically improve the performance of data-driven models. For fluid flows, such models are needed for tasks related to design, understanding, prediction, and control. In this work we exploit the symmetries of the Navier-Stokes equations (NSE) and use simulation data to find the manifold where the long-time dynamics live, which has many fewer degrees of freedom than the full state representation, and the evolution equation for the dynamics on that manifold. We call this method ''symmetry charting''. The first step is to map to a ''fundamental chart'', which is a region in the state space of the flow to which all other regions can be mapped by a symmetry operation. To map to the fundamental chart we identify a set of indicators from the Fourier transform that uniquely identify the symmetries of the system. We then find a low-dimensional coordinate representation of the data in the fundamental chart with the use of an autoencoder. We use a variation called an implicit rank minimizing autoencoder with weight decay, which in addition to compressing the dimension of the data, also gives estimates of how many dimensions are needed to represent the data: i.e. the dimension of the invariant manifold of the long-time dynamics. Finally, we learn dynamics on this manifold with the use of neural ordinary differential equations. We apply symmetry charting to two-dimensional Kolmogorov flow in a chaotic bursting regime. This system has a continuous translation symmetry, and discrete rotation and shift-reflect symmetries. With this framework we observe that less data is needed to learn accurate data-driven models, more robust estimates of the manifold dimension are obtained, equivariance of the NSE is satisfied, better short-time tracking with respect to the true data is observed, and long-time statistics are correctly captured.


title: Quantum to classical parton evolution in the QGP

abstract: We study the time evolution of the density matrix of a high energy quark in the presence of a dense QCD background that is modeled as a stochastic Gaussian color field. At late times, we find that only the color singlet component of the quark's reduced density matrix survives the in-medium evolution and that the density matrix becomes asymptotically diagonal in both transverse position and momentum spaces. In addition, we observe an accelerated entropy growth due to the larger phase space being explored by the quark and that the quantum and classical quark entropies converge at late times. We further observe that the quark state loses all memory of the initial condition. Combined with the fact that the reduced density matrix satisfies Boltzmann-diffusion transport, we conclude that the quark reduced density matrix can be interpreted as a classical phase space distribution.


title: Vertical Federated Alzheimer's Detection on Multimodal Data

abstract: In the era of rapidly advancing medical technologies, the segmentation of medical data has become inevitable, necessitating the development of privacy preserving machine learning algorithms that can train on distributed data. Consolidating sensitive medical data is not always an option particularly due to the stringent privacy regulations imposed by the Health Insurance Portability and Accountability Act (HIPAA). In this paper, we introduce a HIPAA compliant framework that can train from distributed data. We then propose a multimodal vertical federated model for Alzheimer's Disease (AD) detection, a serious neurodegenerative condition that can cause dementia, severely impairing brain function and hindering simple tasks, especially without preventative care. This vertical federated model offers a distributed architecture that enables collaborative learning across diverse sources of medical data while respecting privacy constraints imposed by HIPAA. It is also able to leverage multiple modalities of data, enhancing the robustness and accuracy of AD detection. Our proposed model not only contributes to the advancement of federated learning techniques but also holds promise for overcoming the hurdles posed by data segmentation in medical research. By using vertical federated learning, this research strives to provide a framework that enables healthcare institutions to harness the collective intelligence embedded in their distributed datasets without compromising patient privacy.


title: Hypothesis Testing for Class-Conditional Noise Using Local Maximum Likelihood

abstract: In supervised learning, automatically assessing the quality of the labels before any learning takes place remains an open research question. In certain particular cases, hypothesis testing procedures have been proposed to assess whether a given instance-label dataset is contaminated with class-conditional label noise, as opposed to uniform label noise. The existing theory builds on the asymptotic properties of the Maximum Likelihood Estimate for parametric logistic regression. However, the parametric assumptions on top of which these approaches are constructed are often too strong and unrealistic in practice. To alleviate this problem, in this paper we propose an alternative path by showing how similar procedures can be followed when the underlying model is a product of Local Maximum Likelihood Estimation that leads to more flexible nonparametric logistic regression models, which in turn are less susceptible to model misspecification. This different view allows for wider applicability of the tests by offering users access to a richer model class. Similarly to existing works, we assume we have access to anchor points which are provided by the users. We introduce the necessary ingredients for the adaptation of the hypothesis tests to the case of nonparametric logistic regression and empirically compare against the parametric approach presenting both synthetic and real-world case studies and discussing the advantages and limitations of the proposed approach.


title: Topological Hierarchical Decompositions

abstract: Topological data analysis is an emerging field that applies the study of topological invariants to data. Perhaps the simplest of these invariants is the number of connected components or clusters. In this work, we explore a topological framework for cluster analysis and show how it can be used as a basis for explainability in unsupervised data analysis. Our main object of study will be hierarchical data structures referred to as Topological Hierarchical Decompositions (THDs). We give a number of examples of how traditional clustering algorithms can be topologized, and provide preliminary results on the THDs associated with Reeb graphs and the mapper algorithm. In particular, we give a generalized construction of the mapper functor as a pixelization of a cosheaf in order to generalize multiscale mapper.


title: Rich Human Feedback for Text-to-Image Generation

abstract: Recent Text-to-Image (T2I) generation models such as Stable Diffusion and Imagen have made significant progress in generating high-resolution images based on text descriptions. However, many generated images still suffer from issues such as artifacts/implausibility, misalignment with text descriptions, and low aesthetic quality. Inspired by the success of Reinforcement Learning with Human Feedback (RLHF) for large language models, prior works collected human-provided scores as feedback on generated images and trained a reward model to improve the T2I generation. In this paper, we enrich the feedback signal by (i) marking image regions that are implausible or misaligned with the text, and (ii) annotating which words in the text prompt are misrepresented or missing on the image. We collect such rich human feedback on 18K generated images (RichHF-18K) and train a multimodal transformer to predict the rich feedback automatically. We show that the predicted rich human feedback can be leveraged to improve image generation, for example, by selecting high-quality training data to finetune and improve the generative models, or by creating masks with predicted heatmaps to inpaint the problematic regions. Notably, the improvements generalize to models (Muse) beyond those used to generate the images on which human feedback data were collected (Stable Diffusion variants). The RichHF-18K data set will be released in our GitHub repository: https://github.com/google-research/google-research/tree/master/richhf_18k.


title: Accuracy limitations of existing numerical relativity waveforms on the data analysis of current and future ground-based detectors

abstract: As gravitational wave detectors improve in sensitivity, signal-to-noise ratios of compact binary coalescences will dramatically increase, reaching values in the hundreds and potentially thousands. Such strong signals offer both exciting scientific opportunities and pose formidable challenges to the template waveforms used for interpretation. Current waveform models are informed by calibrating or fitting to numerical relativity waveforms and such strong signals may unveil computational errors in generating these waveforms. In this paper, we isolate a single source of computational error, that of the finite grid resolution, and investigate its impact on parameter estimation for aLIGO and Cosmic Explorer. We show that injecting a lower resolution simulation tends to cause a downward shift in the recovered chirp mass and mass ratio posteriors. We demonstrate that increasing the inclination angle or decreasing the mass ratio raises the resolution required for unbiased parameter estimation. We quantify the error associated with the highest-resolution waveform utilized using an extrapolation procedure on the median of recovered posteriors and confirm the accuracy of current waveforms for the synthetic sources. We introduce a measure to predict the necessary numerical resolution for unbiased parameter estimation and use it to predict that current waveforms are suitable for equal and moderately unequal mass binaries for both detectors. However, current waveforms fail to meet accuracy requirements for high signal-to-noise ratio signals from highly unequal mass ratio binaries $(q \lesssim 1/6)$, for all inclinations in Cosmic Explorer, and for high inclinations in future updates to LIGO. Given that the resolution requirement becomes more stringent with more unequal mass ratios, current waveforms may lack the necessary accuracy, even at median signal-to-noise ratios for future detectors.


title: A Survey of Classical And Quantum Sequence Models

abstract: Our primary objective is to conduct a brief survey of various classical and quantum neural net sequence models, which includes self-attention and recurrent neural networks, with a focus on recent quantum approaches proposed to work with near-term quantum devices, while exploring some basic enhancements for these quantum models. We re-implement a key representative set of these existing methods, adapting an image classification approach using quantum self-attention to create a quantum hybrid transformer that works for text and image classification, and applying quantum self-attention and quantum recurrent neural networks to natural language processing tasks. We also explore different encoding techniques and introduce positional encoding into quantum self-attention neural networks leading to improved accuracy and faster convergence in text and image classification experiments. This paper also performs a comparative analysis of classical self-attention models and their quantum counterparts, helping shed light on the differences in these models and their performance.


title: Data-driven Closures & Assimilation for Stiff Multiscale Random Dynamics

abstract: We introduce a data-driven and physics-informed framework for propagating uncertainty in stiff, multiscale random ordinary differential equations (RODEs) driven by correlated (colored) noise. Unlike systems subjected to Gaussian white noise, a deterministic equation for the joint probability density function (PDF) of RODE state variables does not exist in closed form. Moreover, such an equation would require as many phase-space variables as there are states in the RODE system. To alleviate this curse of dimensionality, we instead derive exact, albeit unclosed, reduced-order PDF (RoPDF) equations for low-dimensional observables/quantities of interest. The unclosed terms take the form of state-dependent conditional expectations, which are directly estimated from data at sparse observation times. However, for systems exhibiting stiff, multiscale dynamics, data sparsity introduces regression discrepancies that compound during RoPDF evolution. This is overcome by introducing a kinetic-like defect term to the RoPDF equation, which is learned by assimilating in sparse, low-fidelity RoPDF estimates. Two assimilation methods are considered, namely nudging and deep neural networks, which are successfully tested against Monte Carlo simulations.


title: Muchisim: A Simulation Framework for Design Exploration of Multi-Chip Manycore Systems

abstract: The design space exploration of scaled-out manycores for communication-intensive applications (e.g., graph analytics and sparse linear algebra) is hampered due to either lack of scalability or accuracy of existing frameworks at simulating data-dependent execution patterns. This paper presents MuchiSim, a novel parallel simulator designed to address these challenges when exploring the design space of distributed multi-chiplet manycore architectures. We evaluate MuchiSim at simulating systems with up to a million interconnected processing units (PUs) while modeling data movement and communication cycle by cycle. In addition to performance, MuchiSim reports the energy, area, and cost of the simulated system. It also comes with a benchmark application suite and two data visualization tools. MuchiSim supports various parallelization strategies and communication primitives such as task-based parallelization and message passing, making it highly relevant for architectures with software-managed coherence and distributed memory. Via a case study, we show that MuchiSim helps users explore the balance between memory and computation units and the constraints related to chiplet integration and inter-chip communication. MuchiSim enables evaluating new techniques or design parameters for systems at scales that are more realistic for modern parallel systems, opening the gate for further research in this area.


title: On selecting a fraction of leaves with disjoint neighborhoods in a plane tree

abstract: We present a generalization of a combinatorial result by Aggarwal, Guibas, Saxe and Shor [Discrete & Computational Geometry, 1989] on a linear-time algorithm that selects a constant fraction of leaves, with pairwise disjoint neighborhoods, from a binary tree embedded in the plane. This result of Aggarwal et al. is essential to the linear-time framework, which they also introduced, that computes certain Voronoi diagrams of points with a tree structure in linear time. An example is the diagram computed while updating the Voronoi diagram of points after deletion of one site. Our generalization allows that only a fraction of the tree leaves is considered, and it is motivated by linear-time Voronoi constructions for non-point sites. We are given a plane tree $T$ of $n$ leaves, $m$ of which have been marked, and each marked leaf is associated with a neighborhood (a subtree of $T$) such that any two topologically consecutive marked leaves have disjoint neighborhoods. We show how to select in linear time a constant fraction of the marked leaves having pairwise disjoint neighborhoods.


title: Implicit Modeling of Non-rigid Objects with Cross-Category Signals

abstract: Deep implicit functions (DIFs) have emerged as a potent and articulate means of representing 3D shapes. However, methods modeling object categories or non-rigid entities have mainly focused on single-object scenarios. In this work, we propose MODIF, a multi-object deep implicit function that jointly learns the deformation fields and instance-specific latent codes for multiple objects at once. Our emphasis is on non-rigid, non-interpenetrating entities such as organs. To effectively capture the interrelation between these entities and ensure precise, collision-free representations, our approach facilitates signaling between category-specific fields to adequately rectify shapes. We also introduce novel inter-object supervision: an attraction-repulsion loss is formulated to refine contact regions between objects. Our approach is demonstrated on various medical benchmarks, involving modeling different groups of intricate anatomical entities. Experimental results illustrate that our model can proficiently learn the shape representation of each organ and their relations to others, to the point that shapes missing from unseen instances can be consistently recovered by our method. Finally, MODIF can also propagate semantic information throughout the population via accurate point correspondences


title: Secure and Accurate Summation of Many Floating-Point Numbers

abstract: Motivated by the importance of floating-point computations, we study the problem of securely and accurately summing many floating-point numbers. Prior work has focused on security absent accuracy or accuracy absent security, whereas our approach achieves both of them. Specifically, we show how to implement floating-point superaccumulators using secure multi-party computation techniques, so that a number of participants holding secret shares of floating-point numbers can accurately compute their sum while keeping the individual values private.


title: Observations of the Ultraviolet-Bright Star ZNG 1 in the Globular Cluster M5 (NGC 5904)

abstract: We have analyzed archival spectra of the hot UV-bright star ZNG 1 in the globular cluster M5 (NGC 5904) obtained with the Far Ultraviolet Spectroscopic Explorer (FUSE) and the Space Telescope Imaging Spectrograph (STIS). From these data, we derive an effective temperature $T_{\rm eff} = 43{,}000 \pm 1400$ K, a surface gravity $\log g = 4.47 \pm 0.08$, a rotational velocity $v \sin i = 157 \pm 12$ km s$^{-1}$, and a mass $M = 0.92 \pm 0.17 \, M_{\odot}$. The atmosphere is helium-rich ($Y = 0.99$) and enhanced in CNO (relative to the cluster). The spectrum exhibits wind features with a terminal velocity near 1500 km s$^{-1}$ and strong discrete absorption components (DACs). The high helium abundance, stellar mass, and rotational velocity suggest that the star is a merger remnant, and its parameters are consistent with models of a pair of merging He-core white dwarfs.


title: Some simple theories of gravity with propagating torsion

abstract: We consider antisymmetric Metric-Affine Theories of Gravity with a Lagrangian containing the most general terms up to dimension four and search for theories that are ghost- and tachyon-free when expanded around flat space. We find new examples that propagate only the graviton and one other massive degree of freedom of spin zero, one or two. These models require terms of the form $(\nabla T)^2$ in the Lagrangian, that have been largely ignored in the literature.


title: Technical Report: Unresolved Challenges and Potential Features in EATXT

abstract: We developed a textual concrete syntax and a textual editor that supports it for the domain-specific language EAST-ADL, which we named EATXT. This document is a technical report that describes potential advanced features that could be added to EATXT that have not yet been implemented. The purpose of this report is to share our understanding of the relevant technical challenges and to assist potentially interested peers.


title: Advancing Surgical VQA with Scene Graph Knowledge

abstract: Modern operating room is becoming increasingly complex, requiring innovative intra-operative support systems. While the focus of surgical data science has largely been on video analysis, integrating surgical computer vision with language capabilities is emerging as a necessity. Our work aims to advance Visual Question Answering (VQA) in the surgical context with scene graph knowledge, addressing two main challenges in the current surgical VQA systems: removing question-condition bias in the surgical VQA dataset and incorporating scene-aware reasoning in the surgical VQA model design. First, we propose a Surgical Scene Graph-based dataset, SSG-QA, generated by employing segmentation and detection models on publicly available datasets. We build surgical scene graphs using spatial and action information of instruments and anatomies. These graphs are fed into a question engine, generating diverse QA pairs. Our SSG-QA dataset provides a more complex, diverse, geometrically grounded, unbiased, and surgical action-oriented dataset compared to existing surgical VQA datasets. We then propose SSG-QA-Net, a novel surgical VQA model incorporating a lightweight Scene-embedded Interaction Module (SIM), which integrates geometric scene knowledge in the VQA model design by employing cross-attention between the textual and the scene features. Our comprehensive analysis of the SSG-QA dataset shows that SSG-QA-Net outperforms existing methods across different question types and complexities. We highlight that the primary limitation in the current surgical VQA systems is the lack of scene knowledge to answer complex queries. We present a novel surgical VQA dataset and model and show that results can be significantly improved by incorporating geometric scene features in the VQA model design. The source code and the dataset will be made publicly available at: https://github.com/CAMMA-public/SSG-QA


title: Some monotonicity rules for quotient of integrals on time scales

abstract: As an efficient mathematical tool, monotonicity rules play an extremely crucial role in the real analysis field. In this paper, we explore some monotonicity rules for quotient of Delta, Nabla and Diamond-Alpha integrals with variable upper limits and parameters on time scales, respectively. Moreover, we consider the monotonicity rules for quotient of the product of multiple Delta integrals with parameters on time scales. Power series is also concerned for being a special case of integral with parameters on time scales.


title: Catwalk: A Unified Language Model Evaluation Framework for Many Datasets

abstract: The success of large language models has shifted the evaluation paradigms in natural language processing (NLP). The community's interest has drifted towards comparing NLP models across many tasks, domains, and datasets, often at an extreme scale. This imposes new engineering challenges: efforts in constructing datasets and models have been fragmented, and their formats and interfaces are incompatible. As a result, it often takes extensive (re)implementation efforts to make fair and controlled comparisons at scale. Catwalk aims to address these issues. Catwalk provides a unified interface to a broad range of existing NLP datasets and models, ranging from both canonical supervised training and fine-tuning, to more modern paradigms like in-context learning. Its carefully-designed abstractions allow for easy extensions to many others. Catwalk substantially lowers the barriers to conducting controlled experiments at scale. For example, we finetuned and evaluated over 64 models on over 86 datasets with a single command, without writing any code. Maintained by the AllenNLP team at the Allen Institute for Artificial Intelligence (AI2), Catwalk is an ongoing open-source effort: https://github.com/allenai/catwalk.


title: Why are hydrodynamic theories applicable beyond the hydrodynamic regime?

abstract: We present an alternative approach to deriving second-order non-conformal hydrodynamics from the relativistic Boltzmann equation. We demonstrate how constitutive relations for shear and bulk stresses can be transformed into dynamical evolution equations, resulting in Israel-Stewart-like (ISL) hydrodynamics. To understand the far-from-equilibrium applicability of such ISL theories, we investigate the one-dimensional boost-invariant Boltzmann equation using special moments of the distribution function for a system with finite particle mass. Our analysis reveals that the mathematical structure of the ISL equations is akin to that of moment equations, enabling them to approximately replicate even the collisionless dynamics. We conclude that this particular feature is important in extending the applicability of ISL theories beyond the hydrodynamic regime.


title: Hausdorff dimension and exact approximation order in $\mathbb{R}^n$

abstract: Given a non-increasing function $\psi\colon\mathbb{N}\to\mathbb{R}^+$ such that $s^{\frac{n+1}{n}}\psi(s)$ tends to zero as $s$ goes to infinity, we show that the set of points in $\mathbb{R}^n$ that are exactly $\psi$-approximable is non-empty, and we compute its Hausdorff dimension. For $n\geq 2$, this answers questions of Jarn\'{i}k and of Beresnevich, Dickinson, and Velani.


title: Multi-agent Reinforcement Learning: A Comprehensive Survey

abstract: The prevalence of multi-agent applications pervades various interconnected systems in our everyday lives. Despite their ubiquity, the integration and development of intelligent decision-making agents in a shared environment pose challenges to their effective implementation. This survey delves into the domain of multi-agent systems (MAS), placing a specific emphasis on unraveling the intricacies of learning optimal control within the MAS framework, commonly known as multi-agent reinforcement learning (MARL). The objective of this survey is to provide comprehensive insights into various dimensions of MAS, shedding light on myriad opportunities while highlighting the inherent challenges that accompany multi-agent applications. We hope not only to contribute to a deeper understanding of the MAS landscape but also to provide valuable perspectives for both researchers and practitioners. By doing so, we aim to facilitate informed exploration and foster development within the dynamic realm of MAS, recognizing the need for adaptive strategies and continuous evolution in addressing emerging complexities in MARL.


title: The Physics-Informed Neural Network Gravity Model: Generation III

abstract: Scientific machine learning and the advent of the Physics-Informed Neural Network (PINN) show considerable potential in their capacity to identify solutions to complex differential equations. Over the past two years, much work has gone into the development of PINNs capable of solving the gravity field modeling problem -- i.e.\ learning a differentiable form of the gravitational potential from position and acceleration estimates. While the past PINN gravity models (PINN-GMs) have demonstrated advantages in model compactness, robustness to noise, and sample efficiency; there remain key modeling challenges which this paper aims to address. Specifically, this paper introduces the third generation of the Physics-Informed Neural Network Gravity Model (PINN-GM-III) which solves the problems of extrapolation error, bias towards low-altitude samples, numerical instability at high-altitudes, and compliant boundary conditions through numerous modifications to the model's design. The PINN-GM-III is tested by modeling a known heterogeneous density asteroid, and its performance is evaluated using seven core metrics which showcases its strengths against its predecessors and other analytic and numerical gravity models.


title: Brauer pairs for splendid Rickard complexes

abstract: We define the notion of a Brauer pair of a chain complex, extending the notion of a Brauer pair of a $p$-permutation module introduced by Boltje and Perepelitsky. In fact, the Brauer pairs of a splendid Rickard complex $C$ coincide with the set of Brauer pairs of the corresponding $p$-permutation equivalence $\Lambda(C)$ induced by $C$. As a result, we derive structural results for splendid Rickard complexes which are analogous to known structural properties for $p$-permutation equivalences. In particular, we show splendid Rickard equivalences induce local splendid Rickard equivalences between normalizer block algebras as well as centralizer block algebras.


title: CRNNet: Copy Recurrent Neural Network Structure Network

abstract: The target of Electronic Health Record (EHR) coding is to find the diagnostic codes according to the EHRs. In previous research, researchers have preferred to do multi-classification on the EHR coding task; most of them encode the EHR first and then process it to get the probability of each code based on the EHR representation. However, the question of complicating diseases is neglected among all these methods. In this paper, we propose a novel EHR coding framework, which is the first attempt at detecting complicating diseases, called Copy Recurrent Neural Network Structure Network (CRNNet). This method refers to the idea of adversarial learning; a Path Generator and a Path Discriminator are designed to more efficiently finish the task of EHR coding. We propose a copy module to detect complicating diseases; by the proposed copy module and the adversarial learning strategy, we identify complicating diseases efficiently. Extensive experiments show that our method achieves a 57.30\% ratio of complicating diseases in predictions, demonstrating the effectiveness of our proposed model. According to the ablation study, the proposed copy mechanism plays a crucial role in detecting complicating diseases.


title: QR-based Parallel Set-Valued Approximation with Rational Functions

abstract: In this article a fast and parallelizable algorithm for rational approximation is presented. The method, called (P)QR-AAA, is a set valued variant of the Adaptive Antoulas Anderson (AAA) algorithm. It builds on the Set-Valued AAA framework from [16], accelerating it by using an approximate orthogonal basis obtained from a truncated QR decomposition. We demonstrate both theoretically and numerically this method's robustness. We show how it can be parallelized while maintaining the desired accuracy, with minimal communication cost.


title: Multiscale differential geometry learning of networks with applications to single-cell RNA sequencing data

abstract: Single-cell RNA sequencing (scRNA-seq) has emerged as a transformative technology, offering unparalleled insights into the intricate landscape of cellular diversity and gene expression dynamics. The analysis of scRNA-seq data poses challenges attributed to both sparsity and the extensive number of genes implicated. An increasing number of computational tools are devised for analyzing and interpreting scRNA-seq data. We present a multiscale differential geometry (MDG) strategy to exploit the geometric and biological properties inherent in scRNA-seq data. We assume that those intrinsic properties of cells lies on a family of low-dimensional manifolds embedded in the high-dimensional space of scRNA-seq data. Subsequently, we explore these properties via multiscale cell-cell interactive manifolds. Our multiscale curvature-based representation serves as a powerful approach to effectively encapsulate the complex relationships in the cell-cell network. We showcase the utility of our novel approach by demonstrating its effectiveness in classifying cell types. This innovative application of differential geometry in scRNA-seq analysis opens new avenues for understanding the intricacies of biological networks and holds great potential for network analysis in other fields.


title: The Instituto Argentino de Radioastronom\'ia (IAR): Past, present, and future

abstract: I present a brief review of the history of the Instituto Argentino de Radioastronom\'ia, a description of its current facilities and projects, and a view of his prospects for the future.


title: Painterly Image Harmonization by Learning from Painterly Objects

abstract: Given a composite image with photographic object and painterly background, painterly image harmonization targets at stylizing the composite object to be compatible with the background. Despite the competitive performance of existing painterly harmonization works, they did not fully leverage the painterly objects in artistic paintings. In this work, we explore learning from painterly objects for painterly image harmonization. In particular, we learn a mapping from background style and object information to object style based on painterly objects in artistic paintings. With the learnt mapping, we can hallucinate the target style of composite object, which is used to harmonize encoder feature maps to produce the harmonized image. Extensive experiments on the benchmark dataset demonstrate the effectiveness of our proposed method.


title: Progressive Painterly Image Harmonization from Low-level Styles to High-level Styles

abstract: Painterly image harmonization aims to harmonize a photographic foreground object on the painterly background. Different from previous auto-encoder based harmonization networks, we develop a progressive multi-stage harmonization network, which harmonizes the composite foreground from low-level styles (e.g., color, simple texture) to high-level styles (e.g., complex texture). Our network has better interpretability and harmonization performance. Moreover, we design an early-exit strategy to automatically decide the proper stage to exit, which can skip the unnecessary and even harmful late stages. Extensive experiments on the benchmark dataset demonstrate the effectiveness of our progressive harmonization network.


title: VoCopilot: Voice-Activated Tracking of Everyday Interactions

abstract: Voice plays an important role in our lives by facilitating communication, conveying emotions, and indicating health. Therefore, tracking vocal interactions can provide valuable insight into many aspects of our lives. This paper presents our ongoing efforts to design a new vocal tracking system we call VoCopilot. VoCopilot is an end-to-end system centered around an energy-efficient acoustic hardware and firmware combined with advanced machine learning models. As a result, VoCopilot is able to continuously track conversations, record them, transcribe them, and then extract useful insights from them. By utilizing large language models, VoCopilot ensures the user can extract useful insights from recorded interactions without having to learn complex machine learning techniques. In order to protect the privacy of end users, VoCopilot uses a novel wake-up mechanism that only records conversations of end users. Additionally, all the rest of pipeline can be run on a commodity computer (Mac Mini M2). In this work, we show the effectiveness of VoCopilot in real-world environment for two use cases.


title: Asset Ownership Identification: Using machine learning to predict enterprise asset ownership

abstract: Asset owner identification is an important first step for any information security organization, allowing organizations the ability to identify and detect data breaches and losses, vulnerabilities, possible attack surfaces, and define effective countermeasures. Using existing asset ownership data, the research utilized an assortment of machine learning algorithms to determine the best classification model to predict an asset's owner. The research ran separate analyses for each enumerated team, then ran a 100 iteration Monte Carlo Cross Validation across Adaboost, Logistic Regression, Naive Bayes, Classification and Regression Trees, and Random Forests. Finally, a visualization dashboard was created to help users understand the asset inventory through interactive exploratory data analysis as well as the ability to understand model evaluation metrics including accuracy, sensitivity, and specificity for each model. Overall, Adaboost performed the best across all owners with low testing errors below 5% while Naive Bayes performed the worst. The remaining models performed similarly. The fully qualified domain name (FQDN), Classless Inter-Domain Routing (CIDR) CIDR/16, and location were among the most important features.


title: Probing the interstellar medium of the quasar BRI0952-0115, an analysis of [CII], [CI], CO, OH, and H2O

abstract: The extent of the effect of active galactic nuclei (AGN) on their host galaxies at high-redshift is not apparent and studying this effect in the distant universe is a difficult process as the mechanisms of tracing AGN activity can often be inaccurately associated with intense star formation and vice versa. Our aim is to better understand the processes governing the interstellar medium (ISM) of the quasar BRI0952-0952 at z = 4.432, specifically with regard to the individual heating processes at work and to place the quasar in an evolutionary context. We analyzed ALMA archival bands 3, 4, and 6 data and combined the results with high-resolution band-7 ALMA observations of the quasar. We detect [C I] (2-1), [C II], CO(5-4), CO(7-6), CO(12-11), OH, H2O, and we report a tentative detection of OH+. We update the lensing model from Kade et al. (2023) and use the radiative transfer code MOLPOP-CEP to constrain the properties of the CO, [CI], and [CII] emission and suggest different possible scenarios for heating mechanisms within the quasar. Modeling from the CO SLED suggests that there are extreme heating mechanisms operating within the quasar in the form of star formation or AGN activity; however, with the current data it remains unclear which of the two is the preferred mechanism. The updated lensing model suggests a velocity gradient across the [C II] line, suggestive of on-going kinematical processes within the quasar. We find that the H2O emission in BRI0952 is likely correlated with star-forming regions of the ISM. We use the molecular gas mass from [C I] to calculate a depletion time for the quasar. We conclude that BRI 0952-0952 is a quasar with a significant AGN contribution while also showing signs of extreme starburst activity, indicating that the quasar could be in a transitional phase between a starburst-dominated stage and an AGN-dominated stage.


title: Bright and dark breathers of the Benjamin-Ono equation on the traveling periodic background

abstract: The Benjamin-Ono (BO) equation describes long internal waves of small amplitude in deep fluids. Compared to its counterpart for shallow fluids, the Korteweg-de Vries (KdV) equation, the BO equation admits exact solutions for the traveling periodic and solitary waves as well as their interactions expressed in elementary (trigonometric and polynomial) functions. Motivated by a recent progress for the KdV equation, we discover here two scenarios of the soliton-periodic wave interactions which result in the propagation of either elevation (bright) or depression (dark) breathers (periodic in time coherent structures). The existence of two different breathers is related to the band-gap spectrum of the Lax operator associated with the traveling periodic wave. Given a simple structure of the exact solutions in the BO equation, we obtain a closed-form expression for multi-solitons interacting with the traveling periodic wave.

categories: nlin.SI math-ph math.AP math.DS math.MP nlin.PS


title: The DSA Transparency Database: Auditing Self-reported Moderation Actions by Social Media

abstract: Since September 2023, the Digital Services Act (DSA) obliges large online platforms to submit detailed data on each moderation action they take within the European Union (EU) to the DSA Transparency Database. From its inception, this centralized database has sparked scholarly interest as an unprecedented and potentially unique trove of data on real-world online moderation. Here, we thoroughly analyze all 353.12M records submitted by the eight largest social media platforms in the EU during the first 100 days of the database. Specifically, we conduct a platform-wise comparative study of their: volume of moderation actions, grounds for decision, types of applied restrictions, types of moderated content, timeliness in undertaking and submitting moderation actions, and use of automation. Furthermore, we systematically cross-check the contents of the database with the platforms' own transparency reports. Our analyses reveal that (i) the platforms adhered only in part to the philosophy and structure of the database, (ii) the structure of the database is partially inadequate for the platforms' reporting needs, (iii) the platforms exhibited substantial differences in their moderation actions, (iv) a remarkable fraction of the database data is inconsistent, (v) the platform X (formerly Twitter) presents the most inconsistencies. Our findings have far-reaching implications for policymakers and scholars across diverse disciplines. They offer guidance for future regulations that cater to the reporting needs of online platforms in general, but also highlight opportunities to improve and refine the database itself.


title: Random Models for Fuzzy Clustering Similarity Measures

abstract: The Adjusted Rand Index (ARI) is a widely used method for comparing hard clusterings, but requires a choice of random model that is often left implicit. Several recent works have extended the Rand Index to fuzzy clusterings, but the assumptions of the most common random model is difficult to justify in fuzzy settings. We propose a single framework for computing the ARI with three random models that are intuitive and explainable for both hard and fuzzy clusterings, along with the benefit of lower computational complexity. The theory and assumptions of the proposed models are contrasted with the existing permutation model. Computations on synthetic and benchmark data show that each model has distinct behaviour, meaning that accurate model selection is important for the reliability of results.


title: Robustness of Deep Learning for Accelerated MRI: Benefits of Diverse Training Data

abstract: Deep learning based methods for image reconstruction are state-of-the-art for a variety of imaging tasks. However, neural networks often perform worse if the training data differs significantly from the data they are applied to. For example, a network trained for accelerated magnetic resonance imaging (MRI) on one scanner performs worse on another scanner. In this work, we investigate the impact of the training data on the model's performance and robustness for accelerated MRI. We find that models trained on the combination of various data distributions, such as those obtained from different MRI scanners and anatomies, exhibit robustness equal or superior to models trained on the best single distribution for a specific target distribution. Thus training on diverse data tends to improve robustness. Furthermore, training on diverse data does not compromise in-distribution performance, i.e., a model trained on diverse data yields in-distribution performance at least as good as models trained on the more narrow individual distributions. Our results suggest that training a model for imaging on a variety of distributions tends to yield a more effective and robust model than maintaining separate models for individual distributions.


title: Covariant canonical quantization and the problem of time

abstract: In the covariant canonical approach to classical physics, each point in phase space represents an entire classical trajectory. Initial data at a fixed time serve as coordinates for this ``timeless'' phase space, and time evolution can be viewed as a coordinate change. We argue for a similar view in quantum theory. As in the Heisenberg picture, the wave function is fundamentally time-independent. On any given time slice, however, we can diagonalize a complete set of position operators to form a basis, in which the projected wave function depends on the choice of time. In this picture, time evolution can be viewed as a basis change in what is otherwise a block universe. We argue that this may help solve the ``problem of time'' in quantum gravity, and illustrate the idea with an example from three-dimensional quantum gravity.


title: User Authentication and Identity Inconsistency Detection via Mouse-trajectory Similarity Measurement

abstract: Completely Automated Public Turing Test To Tell Computers and Humans Apart (CAPTCHA) is a type of challenge-response test widely used in authentication systems. A well-known challenge it faces is the CAPTCHA farm, where workers are hired to solve CAPTCHAs manually. In this work, we propose to tackle this challenge from a novel perspective, converting CAPTCHA farm detection to identity inconsistency detection, which essentially becomes an authentication process. Specifically, we develop a novel embedding model, which measures the similarity between mouse trajectories collected during the session and when registering/solving CAPTCHA, to authenticate and detect identity inconsistency. Moreover, unlike most existing works that employ a separate mouse movement classifier for each individual user, which brings in considerable costs when serving a large number of users, our model performs detection tasks using only one classifier for all users, significantly reducing the cost. Experiment results validate the superiority of our method over the state-of-the-art time series classification methods, achieving 94.3% and 97.7% of AUC in identity and authentication inconsistency detection, respectively.


title: Operator-learning-inspired Modeling of Neural Ordinary Differential Equations

abstract: Neural ordinary differential equations (NODEs), one of the most influential works of the differential equation-based deep learning, are to continuously generalize residual networks and opened a new field. They are currently utilized for various downstream tasks, e.g., image classification, time series classification, image generation, etc. Its key part is how to model the time-derivative of the hidden state, denoted dh(t)/dt. People have habitually used conventional neural network architectures, e.g., fully-connected layers followed by non-linear activations. In this paper, however, we present a neural operator-based method to define the time-derivative term. Neural operators were initially proposed to model the differential operator of partial differential equations (PDEs). Since the time-derivative of NODEs can be understood as a special type of the differential operator, our proposed method, called branched Fourier neural operator (BFNO), makes sense. In our experiments with general downstream tasks, our method significantly outperforms existing methods.


title: Sustainable Data Management: Indefinite Static Data at Rest with Machine-Readable Printed Optical Data Sheets (MRPODS)

abstract: In an era where both commercial and private sectors place a premium on the longevity of digital data storage, the imperative to bolster resilience of digital information while simultaneously curbing costs and reducing failure rates becomes paramount. This study delves into the unique attributes of optical encoding methodologies, which are poised to offer enduring stability for digital data. Despite their promising potential, there remains a notable dearth of comprehensive analyses comparing various optical encoding techniques in terms of their durability. This research is thus dedicated to exploring the financial and environmental implications of employing technology to transcribe digital data into a machine-readable optical format, assessing both the advantages and limitations inherent in this approach. Our empirical findings reveal a marked increase in the efficiency of machine-readable optical encoding over conventional digital storage methods, particularly as the volume of data diminishes and the expected lifespan of storage extends indefinitely. This paper aims to illuminate key aspects of long-term digital data storage within business contexts, focusing on aspects such as cost, dependability, legibility, and confidentiality of optically encoded digital information.


title: Asymmetric Norms to Approximate the Minimum Action Distance

abstract: This paper presents a state representation for reward-free Markov decision processes. The idea is to learn, in a self-supervised manner, an embedding space where distances between pairs of embedded states correspond to the minimum number of actions needed to transition between them. Unlike previous methods, our approach incorporates an asymmetric norm parametrization, enabling accurate approximations of minimum action distances in environments with inherent asymmetry. We show how this representation can be leveraged to learn goal-conditioned policies, providing a notion of similarity between states and goals and a useful heuristic distance to guide planning. To validate our approach, we conduct empirical experiments on both symmetric and asymmetric environments. Our results show that our asymmetric norm parametrization performs comparably to symmetric norms in symmetric environments and surpasses symmetric norms in asymmetric environments.


title: Incoherent Approximation of Leakage in Quantum Error Correction

abstract: Quantum error correcting codes typically do not account for quantum state transitions - leakage - out of the computational subspace. Since these errors can last for multiple detection rounds they can significantly contribute to logical errors. It is therefore important to understand how to numerically model them efficiently. Fully quantum simulations of leakage require more levels per leaked qubit, which substantially limits the system sizes that may be simulated. To address this, we introduce a Random Phase Approximation (RPA) on quantum channels that preserves the incoherence between the computational and leakage subspaces. The assumption of incoherence enables the quantum simulation of leakage at little computational overhead. We motivate the approximation's validity by showing that incoherence is achieved naturally during repeated stabilizer measurements. Additionally, we provide various simulation results which show that the RPA yields accurate error correction statistics in the repetition and surface codes with physical error parameters.


title: Differential operators on the base affine space of $SL_n$ and quantized Coulomb branches

abstract: We show that the algebra $D_\hbar(SL_n/U)$ of differential operators on the base affine space of $SL_n$ is the quantized Coulomb branch of a certain 3d $\mathcal{N} = 4$ quiver gauge theory. In the semiclassical limit this proves a conjecture of Dancer-Hanany-Kirwan about the universal hyperk\"ahler implosion of $SL_n$. We also formulate and prove a generalization identifying the Hamiltonian reduction of $T^* SL_n$ with respect to an arbitrary unipotent character as a Coulomb branch. As an application of our results, we provide a new interpretation of the Gelfand-Graev symmetric group action on $D_\hbar(SL_n/U)$.


title: A charge-preserving method for solving graph neural diffusion networks

abstract: The aim of this paper is to give a systematic mathematical interpretation of the diffusion problem on which Graph Neural Networks (GNNs) models are based. The starting point of our approach is a dissipative functional leading to dynamical equations which allows us to study the symmetries of the model. We discuss the conserved charges and provide a charge-preserving numerical method for solving the dynamical equations. In any dynamical system and also in GRAph Neural Diffusion (GRAND), knowing the charge values and their conservation along the evolution flow could provide a way to understand how GNNs and other networks work with their learning capabilities.

categories: math.NA cs.AI cs.LG cs.NA hep-th math-ph math.MP


title: Exploring Structural and Electronic Properties of Topological Insulator/Graphene Nano-heterostructures

abstract: There is great interest in the study of topological insulator-based heterostructures due to expected emerging phenomena. However, a challenge of topological insulator (TI) research is the contribution of the bulk conduction to the TI surface states. Both strain engineering and thickness control routes, which have been proposed to compensate for bulk doping, can be accessed through the use of nano-heterostructures consisting of topological insulator nanostructures grown on 2D materials. In this work, we report the synthesis of TI/graphene nano-heterostructures based on Bi2Te3 and Sb2Te3 nanoplatelets (NPs) grown on single-layer graphene. Various techniques were used to characterize this system in terms of morphology, thickness, composition, and crystal quality. We found that most of the obtained NPs are mainly < 20 [nm] thick with thickness-dependent crystal quality, observed by Raman measurements. Thinner NPs (1 or 2 QL) tend to replicate the topography of the underlying SLG, according to roughness analysis, and observed buckling features. Finally, we show preliminary studies of their band structure obtained by LT-STM (STS) and by DFT. We observe a highly negative doping which can be attributed to the presence of defects.


title: AEcroscoPy: A software-hardware framework empowering microscopy toward automated and autonomous experimentation

abstract: Microscopy, in particular scanning probe and electron microscopy, has been pivotal in improving our understanding of structure-function relationships at the nanoscale and is by now ubiquitous in most research characterization labs and facilities. However, traditional microscopy operations are still limited largely by a human-centric click-and-go paradigm utilizing vendor-provided software, which necessarily limits the scope, utility, efficiency, effectiveness, and at times reproducibility of microscopy experiments. Here, we develop a coupled hardware-software platform that consists of a field-programmable gate array (FPGA) device, with LabView-built customized acquisition scripts, along with a software package termed AEcroscoPy (short for Automated Experiments in Microscopy driven by Python) that overcome these limitations and provide the necessary abstractions towards full automation of microscopy platforms. The platform works across multiple vendor devices on scanning probe microscopes and scanning transmission electron microscopes. It enables customized scan trajectories, processing functions that can be triggered locally or remotely on processing servers, user-defined excitation waveforms, standardization of data models, and completely seamless operation through simple Python commands to enable a plethora of microscopy experiments to be performed in a reproducible, automated manner. This platform can be readily coupled with existing machine learning libraries as well as simulations, to provide automated decision-making and active theory-experiment optimization loops to turn microscopes from characterization tools to instruments capable of autonomous model refinement and physics discovery.


title: RetailKLIP : Finetuning OpenCLIP backbone using metric learning on a single GPU for Zero-shot retail product image classification

abstract: Retail product or packaged grocery goods images need to classified in various computer vision applications like self checkout stores, supply chain automation and retail execution evaluation. Previous works explore ways to finetune deep models for this purpose. But because of the fact that finetuning a large model or even linear layer for a pretrained backbone requires to run at least a few epochs of gradient descent for every new retail product added in classification range, frequent retrainings are needed in a real world scenario. In this work, we propose finetuning the vision encoder of a CLIP model in a way that its embeddings can be easily used for nearest neighbor based classification, while also getting accuracy close to or exceeding full finetuning. A nearest neighbor based classifier needs no incremental training for new products, thus saving resources and wait time.


title: Cubic-quartic regularization models for solving polynomial subproblems in third-order tensor methods

abstract: High-order tensor methods for solving both convex and nonconvex optimization problems have generated significant research interest, leading to algorithms with optimal global rates of convergence and local rates that are faster than Newton's method. On each iteration, these methods require the unconstrained local minimization of a (potentially nonconvex) multivariate polynomial of degree higher than two, constructed using third-order (or higher) derivative information, and regularized by an appropriate power of regularization. Developing efficient techniques for solving such subproblems is an ongoing topic of research, and this paper addresses the case of the third-order tensor subproblem. We propose the CQR algorithmic framework, for minimizing a nonconvex Cubic multivariate polynomial with Quartic Regularisation, by minimizing a sequence of local quadratic models that incorporate simple cubic and quartic terms. The role of the cubic term is to crudely approximate local tensor information, while the quartic one controls model regularization and progress. We provide necessary and sufficient optimality conditions that fully characterise the global minimizers of these cubic-quartic models. We then turn these conditions into secular equations that can be solved using nonlinear eigenvalue techniques. We show, using our optimality characterisations, that a CQR algorithmic variant has the optimal-order evaluation complexity of $\mathcal{O}(\epsilon^{-3/2})$ when applied to minimizing our quartically-regularised cubic subproblem, which can be further improved in special cases. We propose practical CQR variants that use local tensor information to construct the local cubic-quartic models. We test these variants numerically and observe them to be competitive with ARC and other subproblem solvers on typical instances and even superior on ill-conditioned subproblems with special structure.


title: Photovoltaic efficiency of transition metal dichalcogenides thin films by ab initio excited-state methods

abstract: Transition metal dichalcogenides (TMDCs) have garnered significant interest in optoelectronics, owing to their scalability and thickness-dependent electrical and optical properties. In particular, thin films of TMDCs could be used in photovoltaic devices. In this work, we employ $ab$ $initio$ many-body perturbation theory within $G_0W_0$-BSE approach to accurately compute the optoelectronic properties of thin films of 2H-TMDCs composed of Mo, W, S, and Se. Subsequently, we evaluate their photovoltaic performance including exciton recombination effects, and show this is a key ingredient. We obtain efficiencies of up to 29\% for a 200-nm thick film of \ce{WSe2}, thus providing an upper limit. We also include other \textcolor{black}{phenomenological} recombination mechanisms that could be present in current samples. This slightly reduces efficiencies, indicating that even with current synthesis technologies, there is still potential for further enhancement of TMDCs' performance in photovoltaic applications.


title: Primitive Quantum Gates for an $SU(2)$ Discrete Subgroup: Binary Octahedral

abstract: We construct a primitive gate set for the digital quantum simulation of the 48-element binary octahedral ($\mathbb{BO}$) group. This nonabelian discrete group better approximates $SU(2)$ lattice gauge theory than previous work on the binary tetrahedral group at the cost of one additional qubit -- for a total of six -- per gauge link. The necessary primitives are the inversion gate, the group multiplication gate, the trace gate, and the $\mathbb{BO}$ Fourier transform.


title: Visualization of Mesoscopic Conductivity Fluctuations in Amorphous Semiconductor Thin-Film Transistors

abstract: Charge transport in amorphous semiconductors is considerably more complicated than process in crystalline materials due to abundant localized states. In addition to device-scale characterization, spatially resolved measurements are important to unveil electronic properties. Here, we report gigahertz conductivity mapping in amorphous indium gallium zinc oxide (a-IGZO) thin-film transistors by microwave impedance microscopy (MIM), which probes conductivity without Schottky barrier's influence. The difference between dc and microwave conductivities reflects the efficacy of the injection barrier in an accumulation-mode transistor. The conductivity exhibits significant nanoscale inhomogeneity in the subthreshold regime, presumably due to trapping and releasing from localized states. The characteristic length scale of local fluctuations, as determined by autocorrelation analysis, is about 200 nm. Using random-barrier model, we can simulate the spatial variation of potential landscape, which underlies the mesoscopic conductivity distribution. Our work provides an intuitive way to understand the charge transport mechanism in amorphous semiconductors at microscopic level.


title: Towards 6G Digital Twin Channel Using Radio Environment Knowledge Pool

abstract: The digital twin channel (DTC) is crucial for 6G wireless autonomous networks as it replicates the wireless channel fading states in 6G air interface transmissions. It is well known that the physical environment influences channels. A key task for accurately twinning channels in complex 6G scenarios is establishing precise relationships between the environment and the channels. In this article, the radio environment knowledge pool (REKP) is proposed, with its core function being to construct and store as much knowledge between the environment and channels as possible. Firstly, the research progress related to DTC is summarized, and a comparative analysis of these achievements on key indicators in digital twin is conducted, proposing the challenges faced in knowledge construction. Secondly, instructions on how to construct and update REKP are given. Then, a typical case is presented to demonstrate the great potential of REKP in enabling DTC. Finally, how to utilize REKP to address open issues in the 6G wireless communication system is discussed, including enhancing performance, reducing costs, and keeping a trustworthy DTC.


title: Mechanism of stochastic resonance in viscoelastic channel flow

abstract: We have recently discovered stochastic resonance (SR) in chaotic inertia-less viscoelastic channel flow. SR appears just above a pure elastic instability at a critical Weissenberg number, $Wi_c=150$, of a transition regime. In this lower sub-region up to $Wi\sim 300$, only the streamwise velocity, $u$, exhibits a chaotic spectrum, $E_u$, while the spanwise velocity continues to exhibit white noise, verified by its flat spectrum, $E_w$, accompanied by weak intensity elastic waves. However, SR vanishes at the upper limit at $Wi\sim 300$, when $E_w$ becomes chaotic, indicating $Wi$ as the control parameter. Here we clarify the mechanism of SR emergence by validating the control parameters, namely $Wi$ and the rms velocity fluctuations, $u_{rms}$, measured at multiple channel locations, which determine the range of SR existence. Our experiments verify three key ingredients of the SR mechanism: chaotic $E_u$, white noise $E_w$, and weak elastic waves, which are consistent with three constituents of autonomous dynamical systems exhibiting SR.


title: Active Reinforcement Learning for Robust Building Control

abstract: Reinforcement learning (RL) is a powerful tool for optimal control that has found great success in Atari games, the game of Go, robotic control, and building optimization. RL is also very brittle; agents often overfit to their training environment and fail to generalize to new settings. Unsupervised environment design (UED) has been proposed as a solution to this problem, in which the agent trains in environments that have been specially selected to help it learn. Previous UED algorithms focus on trying to train an RL agent that generalizes across a large distribution of environments. This is not necessarily desirable when we wish to prioritize performance in one environment over others. In this work, we will be examining the setting of robust RL building control, where we wish to train an RL agent that prioritizes performing well in normal weather while still being robust to extreme weather conditions. We demonstrate a novel UED algorithm, ActivePLR, that uses uncertainty-aware neural network architectures to generate new training environments at the limit of the RL agent's ability while being able to prioritize performance in a desired base environment. We show that ActivePLR is able to outperform state-of-the-art UED algorithms in minimizing energy usage while maximizing occupant comfort in the setting of building control.


title: Runtime Analysis of the SMS-EMOA for Many-Objective Optimization

abstract: The classic NSGA-II was recently proven to have considerable difficulties in many-objective optimization. This paper conducts the first rigorous runtime analysis in many objectives for the SMS-EMOA, a steady-state NSGA-II that uses the hypervolume contribution instead of the crowding distance as the second selection criterion. To this aim, we first propose a many-objective counterpart, the m-objective mOJZJ, of the bi-objective OJZJ, which is the first many-objective multimodal benchmark for runtime analysis. We prove that SMS-EMOA computes the full Pareto front of this benchmark in an expected number of $O(\mu M n^k)$ iterations, where $n$ denotes the problem size (length of the bit-string representation), $k$ the gap size (a difficulty parameter of the problem), $M=(2n/m-2k+3)^{m/2}$ the size of the Pareto front, and $\mu$ the population size (at least the same size as the largest incomparable set). This result together with the existing negative result for the original NSGA-II shows that, in principle, the general approach of the NSGA-II is suitable for many-objective optimization, but the crowding distance as tie-breaker has deficiencies. We obtain three additional insights on the SMS-EMOA. Different from a recent result for the bi-objective OJZJ benchmark, a recently proposed stochastic population update often does not help for mOJZJ. It at most results in a speed-up by a factor of order $2^{k} / \mu$, which is $\Theta(1)$ for large $m$, such as $m>k$. On the positive side, we prove that heavy-tailed mutation irrespective of the number $m$ of objectives results in a speed-up of order $k^{0.5+k-\beta}/e^k$, the same advantage as previously shown for the bi-objective case. Finally, we conduct the first runtime analyses of the SMS-EMOA on the classic bi-objective OneMinMax and LOTZ benchmarks and show that the SMS-EMOA has a performance comparable to the GSEMO and the NSGA-II.


title: Soft X-ray and FUV observations of Nova Her 2021 (V1674~Her) with AstroSat

abstract: Nova Her 2021 or V1674 Her was one of the fastest novae to be observed so far. We report here the results from our timing and spectral studies of the source observed at multiple epochs with AstroSat. We report the detection of a periodicity in the source in soft X-rays at a period of 501.4--501.5 s which was detected with high significance after the peak of the super-soft phase, but was not detected in the far ultraviolet (FUV) band of AstroSat. The shape of the phase-folded X-ray light curves has varied significantly as the nova evolved. The phase-resolved spectral studies reveal the likely presence of various absorption features in the soft X-ray band of 0.5--2 keV, and suggest that the optical depth of these absorption features may be marginally dependent on the pulse phase. Strong emission lines from Si, N and O are detected in the FUV, and their strength declined continuously as the nova evolved and went through a bright X-ray state.


title: Analysis of the vector hidden-charm-hidden-strange tetraquark states with implicit P-waves

abstract: We take the scalar, pseudoscalar, axialvector, vector and tensor diquarks as the basic building blocks to construct the four-quark currents with implicit P-waves, and investigate the hidden-charm-hidden-strange tetraquark states with the $J^{PC}=1^{--}$ and $1^{-+}$ via the QCD sum rules in a comprehensive and consistent way, and revisit the assignments of the $X/Y$ states, especially the $Y(4500)$, $X(4630)$, $Y(4660)$, $Y(4710)$ and $Y(4790)$, in the tetraquark picture.


title: Inductive Link Prediction in Knowledge Graphs using Path-based Neural Networks

abstract: Link prediction is a crucial research area in knowledge graphs, with many downstream applications. In many real-world scenarios, inductive link prediction is required, where predictions have to be made among unseen entities. Embedding-based models usually need fine-tuning on new entity embeddings, and hence are difficult to be directly applied to inductive link prediction tasks. Logical rules captured by rule-based models can be directly applied to new entities with the same graph typologies, but the captured rules are discrete and usually lack generosity. Graph neural networks (GNNs) can generalize topological information to new graphs taking advantage of deep neural networks, which however may still need fine-tuning on new entity embeddings. In this paper, we propose SiaILP, a path-based model for inductive link prediction using siamese neural networks. Our model only depends on relation and path embeddings, which can be generalized to new entities without fine-tuning. Experiments show that our model achieves several new state-of-the-art performances in link prediction tasks using inductive versions of WN18RR, FB15k-237, and Nell995.


title: Implementing A Middleware API for Facilitating Heterogeneous IoT Device Communication Protocols and Data Retrieval

abstract: Currently, there are over 14 billion IoT devices [7], and with many devices come many protocols, the main ones being MQTT and CoAP. We are interested in connecting the many diverse IoT devices to the cloud. To do so, we use the middleware architecture proposed by article [8] in which a device, called the middleware, acts as the middleman between the various IoT networks and the cloud. Since IoT devices typically operate in real-time, performance is of great concern. Therefore, we conducted a simulation to measure the data latency of using middleware and the overall fairness between different IoT networks. Our simulation had an MQTT and a CoAP network interacting with the middleware. The simulation results showed that CoAP always had a lower travel time than MQTT, mainly because CoAP is a more lightweight protocol. However, we also found that MQTT had slightly more throughput, which was unexpected since we initially thought that CoAP would have had higher throughput. We have shown that analyzing data via a middleware device is possible and that there are potential directions to explore, such as evaluating different Quality of Service Algorithms in the context of having a middleware device.


title: On a Generalization of Wasserstein Distance and the Beckmann Problem to Connection Graphs

abstract: The intersection of connection graphs and discrete optimal transport presents a novel paradigm for understanding complex graphs and node interactions. In this paper, we delve into this unexplored territory by focusing on the Beckmann problem within the context of connection graphs. Our study establishes feasibility conditions for the resulting convex optimization problem on connection graphs. Furthermore, we establish strong duality for the conventional Beckmann problem, and extend our analysis to encompass strong duality and duality correspondence for a quadratically regularized variant. To put our findings into practice, we implement the regularized problem using gradient descent, enabling a practical approach to solving this complex problem. We showcase optimal flows and solutions, providing valuable insights into the real-world implications of our theoretical framework.


title: Charmonia in an unquenched quark model

abstract: In this work, we study the charmonium spectrum within an unquenched quark model including coupled-channel effects. In couple-channel calculations, we include all of the opened charmed meson channels with the once-subtracted method, meanwhile adopt a suppressed factor to soften the hard vertices given by the $^3P_0$ model in the high momentum region. We obtain a good description of both the masses and widths for the well-established states in the charmonium spectrum. Furthermore, we give predictions for the higher $S$-, $P$- and $D$-wave charmonium states up to mass region of $\sim 5.0$ GeV. The magnitude of mass shifts due to the coupled-channel effects is estimated to be about $10s$ MeV. Although many decay channels are opened for the higher charmonium states, they are relatively narrow states. Their widths scatter in the range of $\sim 10s-100$ MeV. Many charmonium-like states, such as $\chi_{c1}(3872)$, $\chi_{c1}(4274)$, $\chi_{c0}(3915)$, $\chi_{c0}(4500)$, $\chi_{c0}(4700)$, $X(4160)$, $X(4350)$, $Y(4500)$, and $\psi(4660)$/$Y(4710)$, can be accommodated by the charmonium spectrum when the unquenched coupled-channel effects are carefully considered.


title: Shedding Light on Software Engineering-specific Metaphors and Idioms

abstract: Use of figurative language, such as metaphors and idioms, is common in our daily-life communications, and it can also be found in Software Engineering (SE) channels, such as comments on GitHub. Automatically interpreting figurative language is a challenging task, even with modern Large Language Models (LLMs), as it often involves subtle nuances. This is particularly true in the SE domain, where figurative language is frequently used to convey technical concepts, often bearing developer affect (e.g., `spaghetti code'). Surprisingly, there is a lack of studies on how figurative language in SE communications impacts the performance of automatic tools that focus on understanding developer communications, e.g., bug prioritization, incivility detection. Furthermore, it is an open question to what extent state-of-the-art LLMs interpret figurative expressions in domain-specific communication such as software engineering. To address this gap, we study the prevalence and impact of figurative language in SE communication channels. This study contributes to understanding the role of figurative language in SE, the potential of LLMs in interpreting them, and its impact on automated SE communication analysis. Our results demonstrate the effectiveness of fine-tuning LLMs with figurative language in SE and its potential impact on automated tasks that involve affect. We found that, among three state-of-the-art LLMs, the best improved fine-tuned versions have an average improvement of 6.66% on a GitHub emotion classification dataset, 7.07% on a GitHub incivility classification dataset, and 3.71% on a Bugzilla bug report prioritization dataset.


title: Integrated Qubit Reuse and Circuit Cutting for Large Quantum Circuit Evaluation

abstract: Quantum computing has recently emerged as a promising computing paradigm for many application domains. However, the size of quantum circuits that can run with high fidelity is constrained by the limited quantity and quality of physical qubits. Recently proposed schemes, such as wire cutting and qubit reuse, mitigate the problem but produce sub-optimal results as they address the problem individually. In addition, gate cutting, an alternative circuit-cutting strategy, has not been fully explored in the field. In this paper, we propose IQRC, an integrated approach that exploits qubit reuse and circuit cutting (including wire cutting and gate cutting) to run large circuits on small quantum computers. Circuit-cutting techniques introduce non-negligible post-processing overhead, which increases exponentially with the number of cuts. IQRC exploits qubit reuse to find better cutting solutions to minimize the cut numbers and thus the post-processing overhead. Our evaluation results show that on average we reduce the number of cuts by 34\% and additional reduction when considering gate cuts.


title: Image Restoration Through Generalized Ornstein-Uhlenbeck Bridge

abstract: Diffusion models exhibit powerful generative capabilities enabling noise mapping to data via reverse stochastic differential equations. However, in image restoration, the focus is on the mapping relationship from low-quality to high-quality images. Regarding this issue, we introduce the Generalized Ornstein-Uhlenbeck Bridge (GOUB) model. By leveraging the natural mean-reverting property of the generalized OU process and further eliminating the variance of its steady-state distribution through the Doob's h-transform, we achieve diffusion mappings from point to point enabling the recovery of high-quality images from low-quality ones. Moreover, we unravel the fundamental mathematical essence shared by various bridge models, all of which are special instances of GOUB and empirically demonstrate the optimality of our proposed models. Additionally, we present the corresponding Mean-ODE model adept at capturing both pixel-level details and structural perceptions. Experimental outcomes showcase the state-of-the-art performance achieved by both models across diverse tasks, including inpainting, deraining, and super-resolution. Code is available at \url{https://github.com/Hammour-steak/GOUB}.


title: Shot2Story20K: A New Benchmark for Comprehensive Understanding of Multi-shot Videos

abstract: A short clip of video may contain progression of multiple events and an interesting story line. A human need to capture both the event in every shot and associate them together to understand the story behind it. In this work, we present a new multi-shot video understanding benchmark Shot2Story20K with detailed shot-level captions and comprehensive video summaries. To facilitate better semantic understanding of videos, we provide captions for both visual signals and human narrations. We design several distinct tasks including single-shot video and narration captioning, multi-shot video summarization, and video retrieval with shot descriptions. Preliminary experiments show some challenges to generate a long and comprehensive video summary. Nevertheless, the generated imperfect summaries can already significantly boost the performance of existing video understanding tasks such as video question-answering, promoting an under-explored setting of video understanding with detailed summaries.


title: FCBench: Cross-Domain Benchmarking of Lossless Compression for Floating-Point Data

abstract: While both the database and high-performance computing (HPC) communities utilize lossless compression methods to minimize floating-point data size, a disconnect persists between them. Each community designs and assesses methods in a domain-specific manner, making it unclear if HPC compression techniques can benefit database applications or vice versa. With the HPC community increasingly leaning towards in-situ analysis and visualization, more floating-point data from scientific simulations are being stored in databases like Key-Value Stores and queried using in-memory retrieval paradigms. This trend underscores the urgent need for a collective study of these compression methods' strengths and limitations, not only based on their performance in compressing data from various domains but also on their runtime characteristics. Our study extensively evaluates the performance of eight CPU-based and five GPU-based compression methods developed by both communities, using 33 real-world datasets assembled in the Floating-point Compressor Benchmark (FCBench). Additionally, we utilize the roofline model to profile their runtime bottlenecks. Our goal is to offer insights into these compression methods that could assist researchers in selecting existing methods or developing new ones for integrated database and HPC applications.


title: One-Shot Learning as Instruction Data Prospector for Large Language Models

abstract: Contemporary practices in instruction tuning often hinge on enlarging data scaling without a clear strategy for ensuring data quality, inadvertently introducing noise that may compromise model performance. To address this challenge, we introduce \textsc{Nuggets}, a novel and efficient methodology that leverages one-shot learning to discern and select high-quality instruction data from extensive datasets. \textsc{Nuggets} assesses the potential of individual instruction examples to act as effective one-shot learning instances, thereby identifying those that can significantly improve performance across diverse tasks. \textsc{Nuggets} utilizes a scoring system based on the impact of candidate examples on the perplexity of a diverse anchor set, facilitating the selection of the most advantageous data for instruction tuning. Through comprehensive evaluations on two benchmarks, including MT-Bench and Alpaca-Eval, we show that instruction tuning with the top 1\% of examples curated by \textsc{Nuggets} substantially outperforms conventional methods employing the entire dataset.


title: Online Restless Multi-Armed Bandits with Long-Term Fairness Constraints

abstract: Restless multi-armed bandits (RMAB) have been widely used to model sequential decision making problems with constraints. The decision maker (DM) aims to maximize the expected total reward over an infinite horizon under an "instantaneous activation constraint" that at most B arms can be activated at any decision epoch, where the state of each arm evolves stochastically according to a Markov decision process (MDP). However, this basic model fails to provide any fairness guarantee among arms. In this paper, we introduce RMAB-F, a new RMAB model with "long-term fairness constraints", where the objective now is to maximize the long term reward while a minimum long-term activation fraction for each arm must be satisfied. For the online RMAB-F setting (i.e., the underlying MDPs associated with each arm are unknown to the DM), we develop a novel reinforcement learning (RL) algorithm named Fair-UCRL. We prove that Fair-UCRL ensures probabilistic sublinear bounds on both the reward regret and the fairness violation regret. Compared with off-the-shelf RL methods, our Fair-UCRL is much more computationally efficient since it contains a novel exploitation that leverages a low-complexity index policy for making decisions. Experimental results further demonstrate the effectiveness of our Fair-UCRL.


title: Interferometric Signatures of Black Holes with Multiple Photon Spheres

abstract: It has been reported that the photon ring structure in black hole images produces strong and universal interferometric signatures on long interferometric baselines, holding promise for measuring black hole parameters and testing general relativity. This paper investigates the interferometric signatures of black holes with one or two photon spheres, specifically within the framework of Einstein-Maxwell-Scalar models. Notably, for black holes possessing two photon spheres, interference between light rays orbiting the inner and outer photon spheres manifests as beat signals in the visibility amplitude, deviating from the universal signatures observed in the single-photon sphere case.


title: Self-Supervised Disentangled Representation Learning for Robust Target Speech Extraction

abstract: Speech signals are inherently complex as they encompass both global acoustic characteristics and local semantic information. However, in the task of target speech extraction, certain elements of global and local semantic information in the reference speech, which are irrelevant to speaker identity, can lead to speaker confusion within the speech extraction network. To overcome this challenge, we propose a self-supervised disentangled representation learning method. Our approach tackles this issue through a two-phase process, utilizing a reference speech encoding network and a global information disentanglement network to gradually disentangle the speaker identity information from other irrelevant factors. We exclusively employ the disentangled speaker identity information to guide the speech extraction network. Moreover, we introduce the adaptive modulation Transformer to ensure that the acoustic representation of the mixed signal remains undisturbed by the speaker embeddings. This component incorporates speaker embeddings as conditional information, facilitating natural and efficient guidance for the speech extraction network. Experimental results substantiate the effectiveness of our meticulously crafted approach, showcasing a substantial reduction in the likelihood of speaker confusion.


title: Mapping Housing Stock Characteristics from Drone Images for Climate Resilience in the Caribbean

abstract: Comprehensive information on housing stock is crucial for climate adaptation initiatives aiming to reduce the adverse impacts of climate-extreme hazards in high-risk regions like the Caribbean. In this study, we propose a workflow for rapidly generating critical baseline housing stock data using very high-resolution drone images and deep learning techniques. Specifically, our work leverages the Segment Anything Model and convolutional neural networks for the automated generation of building footprints and roof classification maps. By strengthening local capacity within government agencies to leverage AI and Earth Observation-based solutions, this work seeks to improve the climate resilience of the housing sector in small island developing states in the Caribbean.


title: MusER: Musical Element-Based Regularization for Generating Symbolic Music with Emotion

abstract: Generating music with emotion is an important task in automatic music generation, in which emotion is evoked through a variety of musical elements (such as pitch and duration) that change over time and collaborate with each other. However, prior research on deep learning-based emotional music generation has rarely explored the contribution of different musical elements to emotions, let alone the deliberate manipulation of these elements to alter the emotion of music, which is not conducive to fine-grained element-level control over emotions. To address this gap, we present a novel approach employing musical element-based regularization in the latent space to disentangle distinct elements, investigate their roles in distinguishing emotions, and further manipulate elements to alter musical emotions. Specifically, we propose a novel VQ-VAE-based model named MusER. MusER incorporates a regularization loss to enforce the correspondence between the musical element sequences and the specific dimensions of latent variable sequences, providing a new solution for disentangling discrete sequences. Taking advantage of the disentangled latent vectors, a two-level decoding strategy that includes multiple decoders attending to latent vectors with different semantics is devised to better predict the elements. By visualizing latent space, we conclude that MusER yields a disentangled and interpretable latent space and gain insights into the contribution of distinct elements to the emotional dimensions (i.e., arousal and valence). Experimental results demonstrate that MusER outperforms the state-of-the-art models for generating emotional music in both objective and subjective evaluation. Besides, we rearrange music through element transfer and attempt to alter the emotion of music by transferring emotion-distinguishable elements.