title: FairWASP: Fast and Optimal Fair Wasserstein Pre-processing

abstract: Recent years have seen a surge of machine learning approaches aimed at reducing disparities in model outputs across different subgroups. In many settings, training data may be used in multiple downstream applications by different users, which means it may be most effective to intervene on the training data itself. In this work, we present FairWASP, a novel pre-processing approach designed to reduce disparities in classification datasets without modifying the original data. FairWASP returns sample-level weights such that the reweighted dataset minimizes the Wasserstein distance to the original dataset while satisfying (an empirical version of) demographic parity, a popular fairness criterion. We show theoretically that integer weights are optimal, which means our method can be equivalently understood as duplicating or eliminating samples. FairWASP can therefore be used to construct datasets which can be fed into any classification method, not just methods which accept sample weights. Our work is based on reformulating the pre-processing task as a large-scale mixed-integer program (MIP), for which we propose a highly efficient algorithm based on the cutting plane method. Experiments demonstrate that our proposed optimization algorithm significantly outperforms state-of-the-art commercial solvers in solving both the MIP and its linear program relaxation. Further experiments highlight the competitive performance of FairWASP in reducing disparities while preserving accuracy in downstream classification settings.


title: Degree sequences of triangular multigraphs

abstract: A simple graph is triangular if every edge is contained in a triangle. A sequence of integers is graphical if it is the degree sequence of a simple graph. Egan and Nikolayevsky recently conjectured that every graphical sequence whose terms are all at least 4 is the degree sequence of a triangular simple graph, and proved this in some special cases. In this paper we state and prove the analogous version of this conjecture for multigraphs.


title: Updating the first CHIME/FRB catalog of fast radio bursts with baseband data

abstract: In 2021, a catalog of 536 fast radio bursts (FRBs) detected with the Canadian Hydrogen Intensity Mapping Experiment (CHIME) radio telescope was released by the CHIME/FRB Collaboration. This large collection of bursts, observed with a single instrument and uniform selection effects, has advanced our understanding of the FRB population. Here we update the results for 140 of these FRBs for which channelized raw voltage ('baseband') data are available. With the voltages measured by the telescope's antennas, it is possible to maximize the telescope sensitivity in any direction within the primary beam, an operation called 'beamforming'. This allows us to increase the signal-to-noise ratio (S/N) of the bursts and to localize them to sub-arcminute precision. The improved localization is also used to correct the beam response of the instrument and to measure fluxes and fluences with a ~10% uncertainty. Additionally, the time resolution is increased by three orders of magnitude relative to that in the first CHIME/FRB catalog, and, applying coherent dedispersion, burst morphologies can be studied in detail. Polarization information is also available for the full sample of 140 FRBs, providing an unprecedented dataset to study the polarization properties of the population. We release the baseband data beamformed to the most probable position of each FRB. These data are analyzed in detail in a series of accompanying papers.


title: Hierarchical Optimization-based Control for Whole-body Loco-manipulation of Heavy Objects

abstract: In recent years, the field of legged robotics has seen growing interest in enhancing the capabilities of these robots through the integration of articulated robotic arms. However, achieving successful loco-manipulation, especially involving interaction with heavy objects, is far from straightforward, as object manipulation can introduce substantial disturbances that impact the robot's locomotion. This paper presents a novel framework for legged loco-manipulation that considers whole-body coordination through a hierarchical optimization-based control framework. First, an online manipulation planner computes the manipulation forces and manipulated object task-based reference trajectory. Then, pose optimization aligns the robot's trajectory with kinematic constraints. The resultant robot reference trajectory is executed via a linear MPC controller incorporating the desired manipulation forces into its prediction model. Our approach has been validated in simulation and hardware experiments, highlighting the necessity of whole-body optimization compared to the baseline locomotion MPC when interacting with heavy objects. Experimental results with Unitree Aliengo, equipped with a custom-made robotic arm, showcase its ability to lift and carry an 8kg payload and manipulate doors.


title: Neutron star mass in dark matter clumps

abstract: This paper investigates a hypothesis proposed in previous research relating neutron star (NS) mass and its dark matter (DM) accumulation. As DM accumulates, NS mass decreases, predicting lower NS masses toward the Galactic center. Due to limited NSs data near the galactic center, we examine NSs located within DM clumps. Using the CLUMPY code simulations, we determine the DM clumps distribution, with masses from 10 to $10^{8}$ $M_{\odot}$ and scales from $10^{-3}$ to 10 kpc. These clumps' DM exhibit a peak at the center, tapering toward the outskirts, resembling our Galaxy's DM distribution. We analyse these DM clumps' NS mass variations, considering diverse DM particle masses and galaxy types. We find relatively stable NS mass within 0.01 to 5 kpc from the clump center. This stability supports the initial hypothesis, particularly for NSs located beyond 0.01 kpc from the clump center, where NS mass reaches a plateau around 0.1 kpc. Nevertheless, NS mass near the clump's periphery reveals spatial dependence: NS position within DM clumps influences its mass in Milky Way-type galaxies. Moreover, this dependence varies with the DM model considered. In summary, our study investigates the proposed link between NS mass and DM accumulation by examining NSs within DM clumps. While NS mass remains stable at certain distances from the clump center, spatial dependencies arise near the clump's outer regions, contingent on the specific DM model.

categories: astro-ph.GA astro-ph.CO astro-ph.HE hep-ph


title: Dynamical characterization of $Z_{2}$ Floquet topological phases via quantum quenches

abstract: The complete characterization of a generic $d$-dimensional Floquet topological phase is usually hard for the requirement of information about the micromotion throughout the entire driving period. In a recent work [L. Zhang et al., Phys. Rev. Lett. 125, 183001 (2020)], an experimentally feasible dynamical detection scheme was proposed to characterize the integer Floquet topological phases using quantum quenches. However, this theory is still far away from completion, especially for free-fermion Floquet topological phases, where the states can also be characterized by $Z_{2}$ invariants. Here we develop the first full and unified dynamical characterization theory for the $Z_{2}$ Floquet topological phases of different dimensionality and tenfold-way symmetry classes by quenching the system from a trivial and static initial state to the Floquet topological regime through suddenly changing the parameters and turning on the periodic driving. By measuring the minimal information of Floquet bands via the stroboscopic time-averaged spin polarizations, we show that the topological spin texture patterns emerging on certain discrete momenta of Brillouin zone called the $0$ or $\pi$ gap highest-order band-inversion surfaces provide a measurable dynamical $Z_{2}$ Floquet invariant, which uniquely determines the Floquet boundary modes in the corresponding quasienergy gap and characterizes the $Z_{2}$ Floquet topology. The applications of our theory are illustrated via one- and two-dimensional models that are accessible in current quantum simulation experiments. Our work provides a highly feasible way to detect the $Z_{2}$ Floquet topology and completes the dynamical characterization for the full tenfold classes of Floquet topological phases, which shall advance the research in theory and experiments.


title: EXTRACT: Explainable Transparent Control of Bias in Embeddings

abstract: Knowledge Graphs are a widely used method to represent relations between entities in various AI applications, and Graph Embedding has rapidly become a standard technique to represent Knowledge Graphs in such a way as to facilitate inferences and decisions. As this representation is obtained from behavioural data, and is not in a form readable by humans, there is a concern that it might incorporate unintended information that could lead to biases. We propose EXTRACT: a suite of Explainable and Transparent methods to ConTrol bias in knowledge graph embeddings, so as to assess and decrease the implicit presence of protected information. Our method uses Canonical Correlation Analysis (CCA) to investigate the presence, extent and origins of information leaks during training, then decomposes embeddings into a sum of their private attributes by solving a linear system. Our experiments, performed on the MovieLens1M dataset, show that a range of personal attributes can be inferred from a user's viewing behaviour and preferences, including gender, age, and occupation. Further experiments, performed on the KG20C citation dataset, show that the information about the conference in which a paper was published can be inferred from the citation network of that article. We propose four transparent methods to maintain the capability of the embedding to make the intended predictions without retaining unwanted information. A trade-off between these two goals is observed.


title: BERTwich: Extending BERT's Capabilities to Model Dialectal and Noisy Text

abstract: Real-world NLP applications often deal with nonstandard text (e.g., dialectal, informal, or misspelled text). However, language models like BERT deteriorate in the face of dialect variation or noise. How do we push BERT's modeling capabilities to encompass nonstandard text? Fine-tuning helps, but it is designed for specializing a model to a task and does not seem to bring about the deeper, more pervasive changes needed to adapt a model to nonstandard language. In this paper, we introduce the novel idea of sandwiching BERT's encoder stack between additional encoder layers trained to perform masked language modeling on noisy text. We find that our approach, paired with recent work on including character-level noise in fine-tuning data, can promote zero-shot transfer to dialectal text, as well as reduce the distance in the embedding space between words and their noisy counterparts.


title: BadLlama: cheaply removing safety fine-tuning from Llama 2-Chat 13B

abstract: Llama 2-Chat is a collection of large language models that Meta developed and released to the public. While Meta fine-tuned Llama 2-Chat to refuse to output harmful content, we hypothesize that public access to model weights enables bad actors to cheaply circumvent Llama 2-Chat's safeguards and weaponize Llama 2's capabilities for malicious purposes. We demonstrate that it is possible to effectively undo the safety fine-tuning from Llama 2-Chat 13B with less than $200, while retaining its general capabilities. Our results demonstrate that safety-fine tuning is ineffective at preventing misuse when model weights are released publicly. Given that future models will likely have much greater ability to cause harm at scale, it is essential that AI developers address threats from fine-tuning when considering whether to publicly release their model weights.


title: Extracting the Multiscale Causal Backbone of Brain Dynamics

abstract: The bulk of the research effort on brain connectivity revolves around statistical associations among brain regions, which do not directly relate to the causal mechanisms governing brain dynamics. Here we propose the multiscale causal backbone (MCB) of brain dynamics, shared by a set of individuals across multiple temporal scales, and devise a principled methodology to extract it. Our approach leverages recent advances in multiscale causal structure learning and optimizes the trade-off between the model fit and its complexity. Empirical assessment on synthetic data shows the superiority of our methodology over a baseline based on canonical functional connectivity networks. When applied to resting-state fMRI data, we find sparse MCBs for both the left and right brain hemispheres. Thanks to its multiscale nature, our approach shows that at low-frequency bands, causal dynamics are driven by brain regions associated with high-level cognitive functions; at higher frequencies instead, nodes related to sensory processing play a crucial role. Finally, our analysis of individual multiscale causal structures confirms the existence of a causal fingerprint of brain connectivity, thus supporting the existing extensive research in brain connectivity fingerprinting from a causal perspective.


title: WKB method and quasinormal modes of string-theoretical d-dimensional black holes

abstract: After a brief introduction to quasinormal modes in dissipative systems, we review the WKB formalism in the context of the analytical calculation of quasinormal frequencies. We apply these results to the calculation of quasinormal frequencies associated with gravitational perturbations of d-dimensional spherically symmetric black holes with string corrections. We do this for two distinct limits: the eikonal limit and the asymptotic limit.


title: Non-equilibrium Onsager-Machlup theory

abstract: This paper proposes a simple mathematical model of non-stationary and non-linear stochastic dynamics, which approximates a (globally) non-stationary and non-linear stochastic process by its locally (or \emph{"piecewise"}) stationary version. Profiting from the elegance and simplicity of both, the exact mathematical model referred to as the Ornstein-Uhlenbeck stochastic process (which is \emph{globally} stationary, Markov and Gaussian) and of the Lyapunov criterion associated with the stability of stationarity, we show that the proposed non-linear non-stationary model provides a natural extension of the Onsager-Machlup theory of equilibrium thermal fluctuations, to the realm of non-stationary, non-linear, and non-equilibrium processes. As an illustrative application, we then apply the extended non-equilibrium Onsager-Machlup theory, to the description of thermal fluctuations and irreversible relaxation processes in liquids, leading to the main exact equations employed to construct the \emph{non-equilibrium self-consistent generalized Langevin equation} (NE-SCGLE) theory of irreversible processes in liquids. This generic theory has demonstrated that the most intriguing and long-unsolved questions of the glass and the gel transitions are understood as a natural consequence of the second law of thermodynamics, enunciated in terms of the proposed piecewise stationary stochastic mathematical model.


title: New Physics in Single Resonant Top Quarks

abstract: Searches for new physics in the top quark sector are of great theoretical interest, yet some powerful avenues for discovery remain unexplored. We characterize the expected statistical power of the LHC dataset to constrain the single production of heavy top partners $T$ decaying to a top quark and a photon or a top quark and a gluon. We describe an effective interaction which could generate such production, though the limits apply to a range of theoretical models. We find sensitivity to cross sections in the $10^{2}-10^{5}$ fb range, for $T$ masses between 300 and 1000 GeV, depending on decay mode.


abstract: This article provides a brief overview of statistical network analysis, a rapidly evolving field of statistics, which encompasses statistical models, algorithms, and inferential methods for analyzing data in the form of networks. Particular emphasis is given to connecting the historical developments in network science to today's statistical network analysis, and outlining important new areas for future research. This invited article is intended as a book chapter for the volume "Frontiers of Statistics and Data Science" edited by Subhashis Ghoshal and Anindya Roy for the International Indian Statistical Association Series on Statistics and Data Science, published by Springer. This review article covers the material from the short course titled "Statistical Network Analysis: Past, Present, and Future" taught by the author at the Annual Conference of the International Indian Statistical Association, June 6-10, 2023, at Golden, Colorado.


title: Q-Learning for Stochastic Control under General Information Structures and Non-Markovian Environments

abstract: As a primary contribution, we present a convergence theorem for stochastic iterations, and in particular, Q-learning iterates, under a general, possibly non-Markovian, stochastic environment. Our conditions for convergence involve an ergodicity and a positivity criterion. We provide a precise characterization on the limit of the iterates and conditions on the environment and initializations for convergence. As our second contribution, we discuss the implications and applications of this theorem to a variety of stochastic control problems with non-Markovian environments involving (i) quantized approximations of fully observed Markov Decision Processes (MDPs) with continuous spaces (where quantization break down the Markovian structure), (ii) quantized approximations of belief-MDP reduced partially observable MDPS (POMDPs) with weak Feller continuity and a mild version of filter stability (which requires the knowledge of the model by the controller), (iii) finite window approximations of POMDPs under a uniform controlled filter stability (which does not require the knowledge of the model), and (iv) for multi-agent models where convergence of learning dynamics to a new class of equilibria, subjective Q-learning equilibria, will be studied. In addition to the convergence theorem, some implications of the theorem above are new to the literature and others are interpreted as applications of the convergence theorem. Some open problems are noted.


title: Unveiling a Novel Silicene-Like Material: A DFT Study on Pentahexoctite-Silicon and Its Optoelectronic Characteristics

abstract: Silicon-based two-dimensional (2D) materials, including well-known silicene, have garnered considerable attention due to their potential in advanced electronic and optoelectronic applications. Here, we introduce a novel 2D silicon variant, pentahexoctite silicon (PH-Si), inspired by the unique structural attributes of pentahexoctite carbon. By using state-of-the-art density functional theory (DFT) calculations and ab initio molecular dynamics (AIMD) simulations, we investigated the fundamental optoelectronic traits of PH-Si. Our findings unveil that PH-Si boasts promising electronic properties characterized by anisotropic conductance and metallic behavior along specific directions. We also examine its structural and dynamic stability through phonon calculations and AIMD simulations. PH-Si structural stability was also confirmed by its low formation energy of -3.62 eV. The material exhibits substantial optical absorption in visible (Vis) and ultraviolet (UV) spectral regions, positioning it as a potential Vis-UV detector and absorber. Additionally, we assess its crucial mechanical attributes, encompassing elastic stiffness constants, Young's modulus (ranging from 5 to 40 GPa), and a Poisson ratio of 0.8, collectively offering valuable insights into its mechanical performance.


title: Correlation between the symmetry energy slope and the deconfinement phase transition

abstract: We study how the nuclear symmetry energy slope ($L$) can affect the hadron-quark phase transition and neutron star properties. We show that the main physical quantities as the critical chemical potential and pressure are strongly influenced by the symmetry energy slope. In extreme cases, the total amount of deconfined quarks can reach up to 99$\%$ of the hybrid star mass.


title: Stochastic Time-Optimal Trajectory Planning for Connected and Automated Vehicles in Mixed-Traffic Merging Scenarios

abstract: Addressing safe and efficient interaction between connected and automated vehicles (CAVs) and human-driven vehicles in a mixed-traffic environment has attracted considerable attention. In this paper, we develop a framework for stochastic time-optimal trajectory planning for coordinating multiple CAVs in mixed-traffic merging scenarios. We present a data-driven model, combining Newell's car-following model with Bayesian linear regression, for efficiently learning the driving behavior of human drivers online. Using the prediction model and uncertainty quantification, a stochastic time-optimal control problem is formulated to find robust trajectories for CAVs. We also integrate a replanning mechanism that determines when deriving new trajectories for CAVs is needed based on the accuracy of the Bayesian linear regression predictions. Finally, we demonstrate the performance of our proposed framework using a realistic simulation environment.


title: On parahoric $(\mathcal{G}, \mu)$-displays

abstract: We develop tools to study spaces of $p$-divisible groups and Abelian varieties with additional structure. More precisely, we extend the definition of parahoric (Dieudonn\'e) $(\mathcal{G}, \mu)$-displays given by Pappas to not necessarily $p$-torsionfree base rings and also introduce the notion of an $(m, n)$-truncated $(\mathcal{G}, \mu)$-display. Then we study the deformation theory of Dieudonn\'e $(\mathcal{G}, \mu)$-displays. As an application we realize the EKOR stratification of the special fiber of a Kisin-Pappas integral Shimura variety of Hodge type as the fibers of a smooth morphism into the algebraic stack of $(2, 1\text{-}\mathrm{rdt})$-truncated $(\mathcal{G}, \mu)$-displays.


title: On the effect of curriculum learning with developmental data for grammar acquisition

abstract: This work explores the degree to which grammar acquisition is driven by language `simplicity' and the source modality (speech vs. text) of data. Using BabyBERTa as a probe, we find that grammar acquisition is largely driven by exposure to speech data, and in particular through exposure to two of the BabyLM training corpora: AO-Childes and Open Subtitles. We arrive at this finding by examining various ways of presenting input data to our model. First, we assess the impact of various sequence-level complexity based curricula. We then examine the impact of learning over `blocks' -- covering spans of text that are balanced for the number of tokens in each of the source corpora (rather than number of lines). Finally, we explore curricula that vary the degree to which the model is exposed to different corpora. In all cases, we find that over-exposure to AO-Childes and Open Subtitles significantly drives performance. We verify these findings through a comparable control dataset in which exposure to these corpora, and speech more generally, is limited by design. Our findings indicate that it is not the proportion of tokens occupied by high-utility data that aids acquisition, but rather the proportion of training steps assigned to such data. We hope this encourages future research into the use of more developmentally plausible linguistic data (which tends to be more scarce) to augment general purpose pre-training regimes.


title: Probing Quantum Efficiency: Exploring System Hardness in Electronic Ground State Energy Estimation

abstract: We consider the question of how correlated the system hardness is between classical algorithms of electronic structure theory in ground state estimation and quantum algorithms. To define the system hardness for classical algorithms we employ empirical criterion based on the deviation of electronic energies produced by coupled cluster and configuration interaction methods from the exact ones along multiple bonds dissociation in a set of molecular systems. For quantum algorithms, we have selected the Variational Quantum Eigensolver (VQE) and Quantum Phase Estimation (QPE) methods. As characteristics of the system hardness for quantum methods, we analyzed circuit depths for the state preparation, the number of quantum measurements needed for the energy expectation value, and various cost characteristics for the Hamiltonian encodings via Trotter approximation and linear combination of unitaries (LCU). Our results show that the quantum resource requirements are mostly unaffected by classical hardness, with the only exception being the state preparation part, which contributes to both VQE and QPE algorithm costs. However, there are clear indications that constructing the initial state with a significant overlap with the true ground state (>10%) is easier than obtaining the state with an energy expectation value within chemical precision. These results support optimism regarding the identification of a molecular system where a quantum algorithm excels over its classical counterpart, as quantum methods can maintain efficiency in classically challenging systems.


title: Search for an exotic decay of the Higgs boson into a Z boson and a pseudoscalar particle in proton-proton collisions at $\sqrt{s}$ = 13 TeV

abstract: A search for an exotic decay of the Higgs boson to a Z boson and a light pseudoscalar particle (a), decaying to a pair of leptons and a pair of photons, respectively, is presented. The search is based on proton-proton collision data at a center-of-mass energy of $\sqrt{s}$ = 13 TeV, collected with the CMS detector and corresponding to an integrated luminosity of 138 fb$^{-1}$. The analysis probes pseudoscalar masses $m_\mathrm{a}$ between 1 and 30 GeV, leading to two pairs of well-isolated leptons and photons. Upper limits at 95% confidence level are set on the Higgs boson production cross section times its branching fraction to two leptons and two photons. The observed (expected) limits are in the range of 1.1-17.8 (1.7-17.9) fb within the probed $m_\mathrm{a}$ interval. An excess of data above the expected standard model background with a local (global) significance of 2.6 (1.3) standard deviations is observed for a mass hypothesis of $m_\mathrm{a}$ = 3 GeV. Limits on models involving axion-like particles, formulated as an effective field theory, are also reported.


title: More on the fact that Rastall = GR

abstract: Rastall gravity is the same as General Relativity, with a simple algebraic redefinition of what is called the energy-momentum tensor. Despite it having been very clearly explained by M. Visser several years go, there are still many papers claiming big differences between the two formulations of gravitational equations and trying to use them for problems of physics. When going this way, the totally ignored task is to explain why the conserved energy-momentum quantities and the quantities used for other purposes are different from each other. Moreover, when researchers are using the non-conserved energy density and pressure for determining the sound speed, it is just inconsistent with the Rastall gravity. I carefully explain all this, and also show how one could construct a variational principle for producing equations in the Rastall form.


title: Radiating Resonances for the Helmholtz Equation and Thin 2D Waveguide Detection

abstract: We investigate the radiating resonances for the Helmholtz equation in the two dimensional space in the presence of an unbounded waveguide with a high contrast index of refraction. Using a suitable asymptotic analysis of the Green's function of the problem, we describe when these radiating resonances appear, and we exploit these resonances to identify the thickness, location, and index of refraction of the waveguide. We propose a suitable numerical reconstruction algorithm that requires observations in a multifrequency range containing the first radiating resonance.


title: Sizes of Countable Sets

abstract: The paper introduces the notion of the size of countable sets that preserves the Part-Whole Principle and generalizes the notion of the cardinality of finite sets. The sizes of natural numbers, integers, rational numbers, and all their subsets, unions, and Cartesian products are algorithmically enumerable up to one element as sequences of natural numbers. The method is similar to that of Theory of Numerosities of Benci and Di Nasso 2019) but in comparison, it is motivated by Bolzano's concept of infinite series from his Paradoxes of the Infinite, it is constructive because it does not use ultrafilters, and set sizes are uniquely determined. The results mostly agree with those of Theory of Numerosities, but some differ, such as the size of rational numbers. However, set sizes are just partially and not linearly ordered. \emph{Quid pro quo.}


title: Joint Depth Prediction and Semantic Segmentation with Multi-View SAM

abstract: Multi-task approaches to joint depth and segmentation prediction are well-studied for monocular images. Yet, predictions from a single-view are inherently limited, while multiple views are available in many robotics applications. On the other end of the spectrum, video-based and full 3D methods require numerous frames to perform reconstruction and segmentation. With this work we propose a Multi-View Stereo (MVS) technique for depth prediction that benefits from rich semantic features of the Segment Anything Model (SAM). This enhanced depth prediction, in turn, serves as a prompt to our Transformer-based semantic segmentation decoder. We report the mutual benefit that both tasks enjoy in our quantitative and qualitative studies on the ScanNet dataset. Our approach consistently outperforms single-task MVS and segmentation models, along with multi-task monocular methods.


title: The Discrete Noise Approximation in Quantum Circuits

abstract: When modeling the effects of noise on quantum circuits, one often makes the assumption that these effects can be accounted for by individual decoherence events following an otherwise noise-free gate. In this work, we address the validity of this model. We find that under a fairly broad set of assumptions, this model of individual decoherence events provides a good approximation to the true noise processes occurring on a quantum device during the implementation of a quantum circuit. However, for gates which correspond to sufficiently large rotations of the qubit register, we find that the qualitative nature of these noise terms can vary significantly from the nature of the noise at the underlying hardware level. The bulk of our analysis is directed towards analyzing what we refer to as the separability ansatz, which is an ansatz concerning the manner in which individual quantum operations acting on a quantum system can be approximated. In addition to the primary motivation of this work, we identify several other areas of open research which may benefit from the results we derive here.


title: Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Data

abstract: State-of-the-art systems neuroscience experiments yield large-scale multimodal data, and these data sets require new tools for analysis. Inspired by the success of large pretrained models in vision and language domains, we reframe the analysis of large-scale, cellular-resolution neuronal spiking data into an autoregressive spatiotemporal generation problem. Neuroformer is a multimodal, multitask generative pretrained transformer (GPT) model that is specifically designed to handle the intricacies of data in systems neuroscience. It scales linearly with feature size, can process an arbitrary number of modalities, and is adaptable to downstream tasks, such as predicting behavior. We first trained Neuroformer on simulated datasets, and found that it both accurately predicted simulated neuronal circuit activity, and also intrinsically inferred the underlying neural circuit connectivity, including direction. When pretrained to decode neural responses, the model predicted the behavior of a mouse with only few-shot fine-tuning, suggesting that the model begins learning how to do so directly from the neural representations themselves, without any explicit supervision. We used an ablation study to show that joint training on neuronal responses and behavior boosted performance, highlighting the model's ability to associate behavioral and neural representations in an unsupervised manner. These findings show that Neuroformer can analyze neural datasets and their emergent properties, informing the development of models and hypotheses associated with the brain.


title: The Minimax Wiener Sequential Testing Problem

abstract: Consider the sample path of a one-dimensional diffusion for which the diffusion coefficient is given and where the drift may take on one of two values: $\mu_0$ or $\mu_1$. Suppose that the signal-to-noise ratio (defined as the difference between the two possible drifts divided by the diffusion coefficient) is non-constant. Given an initial state for the observed process, we consider a minimax formulation of the Wiener sequential testing problem for detecting the correct drift coefficient as soon as possible and with minimal probabilities of incorrect terminal decisions. We solve the problem in the Bayesian formulation, under any prior probabilities of the process having drift $\mu_0$ or $\mu_1$, when the passage of time is penalized linearly. In the case where the signal-to-noise ratio is assumed constant, we obtain an explicit formula for the least favorable distribution.


title: Generating site saturation mutagenesis libraries and transferring them to broad host range plasmids using type IIS restriction enzymes

abstract: Protein engineering is an established method for tailoring enzymatic reactivity. A commonly used method is directed evolution, where the mutagenesis and natural selection process is mimicked and accelerated in the laboratory. Here, we describe a reliable method for generating saturation mutagenesis libraries by golden gate cloning in a broad host range plasmid containing the pBBR1 replicon. The applicability is demonstrated by generating a mutant library of the iron nitrogenase gene cluster (anfHDGK) of Rhodobacter capsulatus, which is subsequently screened for the improved formation of molecular hydrogen.


title: Non-destructive tomographic nanoscale imaging of ferroelectric domain walls

abstract: Extraordinary physical properties arise at polar interfaces in oxide materials, including the emergence of two-dimensional electron gases, sheet-superconductivity, and multiferroicity. A special type of polar interface are ferroelectric domain walls, where electronic reconstruction phenomena can be driven by bound charges. Great progress has been achieved in the characterization of such domain walls and, over the last decade, their potential for next-generation nanotechnology has become clear. Established tomography techniques, however, are either destructive or offer insufficient spatial resolution, creating a pressing demand for 3D imaging compatible with future fabrication processes. Here, we demonstrate non-destructive tomographic imaging of ferroelectric domain walls using secondary electrons. Utilizing conventional scanning electron microscopy (SEM), we reconstruct the position, orientation, and charge state of hidden domain walls at distances up to several hundreds of nanometers away from the surface. A mathematical model is derived that links the SEM intensity variations at the surface to the local domain wall properties, enabling non-destructive tomography with good noise tolerance on the timescale of seconds. Our SEM-based approach facilitates high-throughput screening of materials with functional domain walls and domain-wall-based devices, which is essential for monitoring during the production of device architectures and quality control in real-time.


title: Adaptive and non-adaptive minimax rates for weighted Laplacian-eigenmap based nonparametric regression

abstract: We show both adaptive and non-adaptive minimax rates of convergence for a family of weighted Laplacian-Eigenmap based nonparametric regression methods, when the true regression function belongs to a Sobolev space and the sampling density is bounded from above and below. The adaptation methodology is based on extensions of Lepski's method and is over both the smoothness parameter ($s\in\mathbb{N}_{+}$) and the norm parameter ($M>0$) determining the constraints on the Sobolev space. Our results extend the non-adaptive result in \cite{green2021minimax}, established for a specific normalized graph Laplacian, to a wide class of weighted Laplacian matrices used in practice, including the unnormalized Laplacian and random walk Laplacian.


title: Stability threshold of nearly-Couette shear flows with Navier boundary conditions in 2D

abstract: In this work, we prove a threshold theorem for the 2D Navier-Stokes equations posed on the periodic channel, $\mathbb{T} \times [-1,1]$, supplemented with Navier boundary conditions $\omega|_{y = \pm 1} = 0$. Initial datum is taken to be a perturbation of Couette in the following sense: the shear component of the perturbation is assumed small (in an appropriate Sobolev space) but importantly is independent of $\nu$. On the other hand, the nonzero modes are assumed size $O(\nu^{\frac12})$ in an anisotropic Sobolev space. For such datum, we prove nonlinear enhanced dissipation and inviscid damping for the resulting solution. The principal innovation is to capture quantitatively the \textit{inviscid damping}, for which we introduce a new Singular Integral Operator which is a physical space analogue of the usual Fourier multipliers which are used to prove damping. We then include this SIO in the context of a nonlinear hypocoercivity framework.


title: Two entanglement conditions and their connection to negativity

abstract: We examine two conditions that can be used to detect bipartite entanglement, and show that they can be used to provide lower bounds on the negativity of states. We begin with two-qubit states, and then show how what was done there can be extended to more general states. The resulting bounds are then studied by means of a number of examples. We also show that if one has some knowledge of the Schmidt vectors of a state, better bounds can be found.


title: Two-Stage Classifier for Campaign Negativity Detection using Axis Embeddings: A Case Study on Tweets of Political Users during 2021 Presidential Election in Iran

abstract: In elections around the world, the candidates may turn their campaigns toward negativity due to the prospect of failure and time pressure. In the digital age, social media platforms such as Twitter are rich sources of political discourse. Therefore, despite the large amount of data that is published on Twitter, the automatic system for campaign negativity detection can play an essential role in understanding the strategy of candidates and parties in their campaigns. In this paper, we propose a hybrid model for detecting campaign negativity consisting of a two-stage classifier that combines the strengths of two machine learning models. Here, we have collected Persian tweets from 50 political users, including candidates and government officials. Then we annotated 5,100 of them that were published during the year before the 2021 presidential election in Iran. In the proposed model, first, the required datasets of two classifiers based on the cosine similarity of tweet embeddings with axis embeddings (which are the average of embedding in positive and negative classes of tweets) from the training set (85\%) are made, and then these datasets are considered the training set of the two classifiers in the hybrid model. Finally, our best model (RF-RF) was able to achieve 79\% for the macro F1 score and 82\% for the weighted F1 score. By running the best model on the rest of the tweets of 50 political users that were published one year before the election and with the help of statistical models, we find that the publication of a tweet by a candidate has nothing to do with the negativity of that tweet, and the presence of the names of political persons and political organizations in the tweet is directly related to its negativity.


title: Backdoor Threats from Compromised Foundation Models to Federated Learning

abstract: Federated learning (FL) represents a novel paradigm to machine learning, addressing critical issues related to data privacy and security, yet suffering from data insufficiency and imbalance. The emergence of foundation models (FMs) provides a promising solution to the problems with FL. For instance, FMs could serve as teacher models or good starting points for FL. However, the integration of FM in FL presents a new challenge, exposing the FL systems to potential threats. This paper investigates the robustness of FL incorporating FMs by assessing their susceptibility to backdoor attacks. Contrary to classic backdoor attacks against FL, the proposed attack (1) does not require the attacker fully involved in the FL process; (2) poses a significant risk in practical FL scenarios; (3) is able to evade existing robust FL frameworks/ FL backdoor defenses; (4) underscores the researches on the robustness of FL systems integrated with FMs. The effectiveness of the proposed attack is demonstrated by extensive experiments with various well-known models and benchmark datasets encompassing both text and image classification domains.


title: SuperCAM CO(3-2) APEX survey at 6 pc resolution in the Small Magellanic Clouds

abstract: We present the CO(3-2) APEX survey at 6 pc resolution of the bar of the SMC. We aboard the CO analysis in the SMC-Bar comparing the CO(3-2) survey with that of the CO(2-1) of similar resolution. We study the CO(3-2)-to-CO(2-1) ratio (R32) that is very sensitive to the environment properties (e.g., star-forming regions). We analyzed the correlation of this ratio with observational quantities that trace the star formation as the local CO emission, the Spitzer color [70/160], and the total IR surface brightness measured from the Spitzer and Herschel bands. For the identification of the CO(3-2) clouds, we used the CPROPS algorithm, which allowed us to measure the physical properties of the clouds. We analyzed the scaling relationships of such physical properties. We obtained an R32 of 0.65 as a median value for the SMC, with a standard deviation of 0.3. We found that R32 varies from region to region, depending on the star formation activity. In regions dominated by HII and photo-dissociated regions (e.g., N22, N66), R32 tends to be higher than the median values. Meanwhile, lower values were found toward quiescent clouds. We also found that R32 correlates positively with the IR color [70/160] and the total IR surface brightness. This finding indicates that R32 increases with environmental properties like the dust temperature, the total gas density, and the radiation field. We have identified 225 molecular clouds with sizes R > 1.5 pc and signal-to-noise (S/N) ratio > 3 and only 17 well-resolved CO(3-2) clouds increasing the S/N ratio to > 5. These 17 clouds follow consistent scaling relationships to the inner Milky Way clouds but with some departure. The CO(3-2) tends to be less turbulent and less luminous than the inner Milky Way clouds of similar size. Finally, we estimated a median virial-based CO-to-H2 conversion factor of 12.6_{-7}^{+10} Msun/(K km s^{-1} pc^{2}) for the total sample.


title: RIR-SF: Room Impulse Response Based Spatial Feature for Target Speech Recognition in Multi-Channel Multi-Speaker Scenarios

abstract: Automatic speech recognition (ASR) on multi-talker recordings is challenging. Current methods using 3D spatial data from multi-channel audio and visual cues focus mainly on direct waves from the target speaker, overlooking reflection wave impacts, which hinders performance in reverberant environments. Our research introduces RIR-SF, a novel spatial feature based on room impulse response (RIR) that leverages the speaker's position, room acoustics, and reflection dynamics. RIR-SF significantly outperforms traditional 3D spatial features, showing superior theoretical and empirical performance. We also propose an optimized all-neural multi-channel ASR framework for RIR-SF, achieving a relative 21.3\% reduction in CER for target speaker ASR in multi-channel settings. RIR-SF enhances recognition accuracy and demonstrates robustness in high-reverberation scenarios, overcoming the limitations of previous methods.


title: Spherical functions of symmetric forms and a conjecture of Hironaka

abstract: For all $r\ge1,$ we verify the following conjecture of Hironaka: for a $p$-adic field $F$ with $p$ odd, the space of spherical functions of $\mathrm{Sym}_{r\times r}(F)\cap\mathrm{GL}_r(F)$ is free of rank $4^r$ over the Hecke algebra.


title: Spherical functions on symmetric spaces of Friedberg-Jacquet type

abstract: We give explicit models for spherical functions on $p$-adic symmetric spaces $X=H\backslash G$ for pairs of $p$-adic groups $(G,H)$ of the form $(\mathrm{U}(2r),\mathrm{U}(r)\times \mathrm{U}(r)),$ $(\mathrm{O}(2r),\mathrm{O}(r)\times \mathrm{O}(r)),$ $(\mathrm{Sp}(4r),\mathrm{Sp}(2r)\times\mathrm{Sp}(2r))),$ $(\mathrm{U}(2r+1),\mathrm{U}(r+1)\times \mathrm{U}(r)),$ and $ (\mathrm{O}(2r+1),\mathrm{O}(r+1)\times \mathrm{O}(r)).$ As an application, we completely describe their Hecke module structure.


title: A Knowledge Compilation Take on Binary Polynomial Optimization

abstract: The Binary Polynomial Optimization (BPO) problem is defined as the problem of maximizing a given polynomial function over all binary points. The main contribution of this paper is to draw a novel connection between BPO and the problem of finding the maximal assignment for a Boolean function with weights on variables. This connection allows us to give a strongly polynomial algorithm that solves BPO with a hypergraph that is either $\beta$-acyclic or with bounded incidence treewidth. This result unifies and significantly extends the known tractable classes of BPO. The generality of our technique allows us to deal also with extensions of BPO, where we enforce extended cardinality constraints on the set of binary points, and where we seek $k$ best feasible solutions. We also extend our results to the significantly more general problem where variables are replaced by literals. Preliminary computational results show that the resulting algorithms can be significantly faster than current state-of-the-art.


title: A coherence theorem for pseudo symmetric multifunctors

abstract: Yau defines the notion of pseudo symmetric $\mathbf{Cat}$-enriched multifunctor between $\mathbf{Cat}$-enriched multicategories and proves that Mandell's inverse $K$-theory multifunctor is pseudo symmetric. We prove a coherence theorem for pseudo symmetric $\mathbf{Cat}$-enriched multifunctors. As an application, we prove that pseudo symmetric $\mathbf{Cat}$-enriched multifunctors, and in particular Mandell's inverse $K$-theory, preserve $E_n$-algebras ($n=1,2,...,\infty$), at the cost of changing the parameterizing $E_n$-operad.


title: Electronic Properties of Single Prussian Blue Analog Nanocrystals Determined by Conductive-AFM

abstract: We report a study of the electron transport (ET) properties at the nanoscale (conductive-AFM noted C-AFM thereafter) of individual Prussian Blue Analog (PBA) cubic nanocrystals (NCs) of CsCo(III)Fe(II), with size between 15 and 50 nm deposited on HOPG. We demonstrate that these PBA NCs feature an almost size independent electron injection barriers of 0.41 +/- 0.02 eV and 0.27 +/- 0.03 eV at the CsCo(III)Fe(II)/HOPG and CsCo(III)Fe(II)/C-AFM tip, respectively, and an intrinsic electron conductivity evolving from largely dispersed between ca. 5E-4 and 2E-2 S/cm without a clear correlation with the nanocrystal size. The conductivity values measured on individual nanocrystals are higher by up to 5 decades than those reported on PBA films.


title: Developing a Tool to Automate Extensions to Support a Flexible Extension Policy

abstract: In this work, we present the development of an automated extension tool to assist educators and increase the success and well-being of students by implementing flexible extension policies. Flexible extension policies materialize in many ways, yet there are similarities in students' interactions with them; students tend to request multi-day long extensions repeatedly. In courses with hundreds or potentially thousands of students, providing a system to support this extension request demand is not possible given most currently available resources and limited staff. As such, a tool is necessary to help automate flexible extension processes. The development of this tool should reduce staff load while increasing individualized student support, which can be used in varying ways for different extension policies. Our research questions are: RQ1: Does the extension tool reduce barriers and stigma around asking for assistance? RQ2: Does the tool lessen the wait time between requesting and receiving an extension, and how does the tool improve students' learning experience in the course? These questions will help inform us about how an automated tool for flexible extensions helps support growing course sizes and students who may not otherwise receive the support they need for their success and well-being in the course.


title: Towards A Natural Language Interface for Flexible Multi-Agent Task Assignment

abstract: Task assignment and scheduling algorithms are powerful tools for autonomously coordinating large teams of robotic or AI agents. However, the decisions these system make often rely on components designed by domain experts, which can be difficult for non-technical end-users to understand or modify to their own ends. In this paper we propose a preliminary design for a flexible natural language interface for a task assignment system. The goal of our approach is both to grant users more control over a task assignment system's decision process, as well as render these decisions more transparent. Users can direct the task assignment system via natural language commands, which are applied as constraints to a mixed-integer linear program (MILP) using a large language model (LLM). Additionally, our proposed system can alert users to potential issues with their commands, and engage them in a corrective dialogue in order to find a viable solution. We conclude with a description of our planned user-evaluation in the simulated environment Overcooked and describe next steps towards developing a flexible and transparent task allocation system.


title: Medi-CAT: Contrastive Adversarial Training for Medical Image Classification

abstract: There are not many large medical image datasets available. For these datasets, too small deep learning models can't learn useful features, so they don't work well due to underfitting, and too big models tend to overfit the limited data. As a result, there is a compromise between the two issues. This paper proposes a training strategy Medi-CAT to overcome the underfitting and overfitting phenomena in medical imaging datasets. Specifically, the proposed training methodology employs large pre-trained vision transformers to overcome underfitting and adversarial and contrastive learning techniques to prevent overfitting. The proposed method is trained and evaluated on four medical image classification datasets from the MedMNIST collection. Our experimental results indicate that the proposed approach improves the accuracy up to 2% on three benchmark datasets compared to well-known approaches, whereas it increases the performance up to 4.1% over the baseline methods.


title: Antiferromagnetic Switching in Mn$_2$Au Using a Novel Laser Induced Optical Torque on Ultrafast Timescales

abstract: Efficient manipulation of the N\'eel vector in antiferromagnets can be induced by generation of spin orbit (SOT) or spin-transfer (STT) torques. Here we predict another possibility for antiferromagnetic domain switching by using a non-zero staggered field induced from optical laser excitation. We present results on the atomistic scale dynamic simulations from the application of a novel laser induced torque using optical frequencies for all-optical switching (AOS) of the N\'eel vector in the antiferromagnet Mn$_2$Au. The driving mechanism takes advantage of the sizeable 'exchange enhancement' characteristic of antiferromagnets, allowing for small picosecond 90 and 180 degree precessional switching with laser fluences on the order of mJ/cm$^2$. The symmetry of these novel torques are highly dependent on the time-varying magnetisation direction, creating a sign change in the torque which greatly minimises the "over-shooting problem" common to SOT and STT. Lastly, we demonstrate the opportunity for this laser optical torque to deterministically switch single magnetic domains.


title: Rethinking the Cloudonomics of Efficient I/O for Data-Intensive Analytics Applications

abstract: This paper explores a prevailing trend in the industry: migrating data-intensive analytics applications from on-premises to cloud-native environments. We find that the unique cost models associated with cloud-based storage necessitate a more nuanced understanding of optimizing performance. Specifically, based on traces collected from Uber's Presto fleet in production, we argue that common I/O optimizations, such as table scan and filter, and broadcast join, may lead to unexpected costs when naively applied in the cloud. This is because traditional I/O optimizations mainly focus on improving throughput or latency in on-premises settings, without taking into account the monetary costs associated with storage API calls. In cloud environments, these costs can be significant, potentially involving billions of API calls per day just for Presto workloads at Uber scale. Presented as a case study, this paper serves as a starting point for further research to design efficient I/O strategies specifically tailored for data-intensive applications in cloud settings.


title: Score Normalization for a Faster Diffusion Exponential Integrator Sampler

abstract: Recently, Zhang et al. have proposed the Diffusion Exponential Integrator Sampler (DEIS) for fast generation of samples from Diffusion Models. It leverages the semi-linear nature of the probability flow ordinary differential equation (ODE) in order to greatly reduce integration error and improve generation quality at low numbers of function evaluations (NFEs). Key to this approach is the score function reparameterisation, which reduces the integration error incurred from using a fixed score function estimate over each integration step. The original authors use the default parameterisation used by models trained for noise prediction -- multiply the score by the standard deviation of the conditional forward noising distribution. We find that although the mean absolute value of this score parameterisation is close to constant for a large portion of the reverse sampling process, it changes rapidly at the end of sampling. As a simple fix, we propose to instead reparameterise the score (at inference) by dividing it by the average absolute value of previous score estimates at that time step collected from offline high NFE generations. We find that our score normalisation (DEIS-SN) consistently improves FID compared to vanilla DEIS, showing an improvement at 10 NFEs from 6.44 to 5.57 on CIFAR-10 and from 5.9 to 4.95 on LSUN-Church 64x64. Our code is available at https://github.com/mtkresearch/Diffusion-DEIS-SN


title: Realizing groups as symmetries of infinite translation surfaces

abstract: We provide a complete classification of groups that can be realized as isometry groups of a translation surface $M$ with non-finitely generated fundamental group and no planar ends. Furthermore, we demonstrate that if $S$ has no non-displaceable subsurfaces and its space of ends is self-similar, then every countable subgroup of $\operatorname{GL}^+(2,\mathbb{R})$ can be realized as the Veech group of a translation surface $M$ homeomorphic to $S$. The latter result generalizes and improves upon the previous findings of Przytycki-Valdez-Weitze-Schmith\"{u}sen and Maluendas-Valdez. To prove these results, we adapt ideas from the work of Aougab-Patel-Vlamis, which focused on hyperbolic surfaces, to translation surfaces.


title: Longer Fixations, More Computation: Gaze-Guided Recurrent Neural Networks

abstract: Humans read texts at a varying pace, while machine learning models treat each token in the same way in terms of a computational process. Therefore, we ask, does it help to make models act more like humans? In this paper, we convert this intuition into a set of novel models with fixation-guided parallel RNNs or layers and conduct various experiments on language modeling and sentiment analysis tasks to test their effectiveness, thus providing empirical validation for this intuition. Our proposed models achieve good performance on the language modeling task, considerably surpassing the baseline model. In addition, we find that, interestingly, the fixation duration predicted by neural networks bears some resemblance to humans' fixation. Without any explicit guidance, the model makes similar choices to humans. We also investigate the reasons for the differences between them, which explain why "model fixations" are often more suitable than human fixations, when used to guide language models.


title: The traveling wave problem for the shallow water equations: well-posedness and the limits of vanishing viscosity and surface tension

abstract: In this paper we study solitary traveling wave solutions to a damped shallow water system, which is in general quasilinear and of mixed type. We develop a small data well-posedness theory and prove that traveling wave solutions are a generic phenomenon that persist with and without viscosity or surface tension and for all nontrivial traveling wave speeds, even when the parameters dictate that the equations are hyperbolic and have a sound speed. This theory is developed by way of a Nash-Moser implicit function theorem, which allows us to prove strong norm continuity of solutions with respect to the data as well as the parameters, even in the vanishing limits of viscosity and surface tension.


title: Beyond Denouncing Hate: Strategies for Countering Implied Biases and Stereotypes in Language

abstract: Counterspeech, i.e., responses to counteract potential harms of hateful speech, has become an increasingly popular solution to address online hate speech without censorship. However, properly countering hateful language requires countering and dispelling the underlying inaccurate stereotypes implied by such language. In this work, we draw from psychology and philosophy literature to craft six psychologically inspired strategies to challenge the underlying stereotypical implications of hateful language. We first examine the convincingness of each of these strategies through a user study, and then compare their usages in both human- and machine-generated counterspeech datasets. Our results show that human-written counterspeech uses countering strategies that are more specific to the implied stereotype (e.g., counter examples to the stereotype, external factors about the stereotype's origins), whereas machine-generated counterspeech uses less specific strategies (e.g., generally denouncing the hatefulness of speech). Furthermore, machine-generated counterspeech often employs strategies that humans deem less convincing compared to human-produced counterspeech. Our findings point to the importance of accounting for the underlying stereotypical implications of speech when generating counterspeech and for better machine reasoning about anti-stereotypical examples.


title: General covariance for quantum states over time

abstract: The theory of quantum states over time provides an approach to the dynamics of quantum information which is in direct analogy with spacetime and its relation to classical dynamics. In this work, we further such an analogy by formulating a notion of general covariance for the theory of quantum states over time. We then associate a canonical state over time with a density operator which is to evolve under a sequence of quantum processes modeled by completely positive trace-preserving (CPTP) maps, and we show that such a canonical state over time satisfies such a notion of covariance. We also show that the dynamical quantum Bayes' rule transforms covariantly with respect to states over time, and we conclude with a discussion of what it means for a physical law to be generally covariant when formulated in terms of quantum states over time.


title: Science Behind Observations

abstract: Global climate change is one of main concern of modern society. To estimate this change usually one estimates the global mean temperature. Measuring and calculating the Earth's average temperature are multi-steps complex processes which combine data from various sources and use statistical techniques. Nowadays, the dataset containing the spatial-temporal data about Earth's temperature is readily to use. Although scientists claim that to be able to achieve an accuracy of a few tenths of a degree, the main question is not the accuracy but, does the global mean temperature make sense at all? It is shown that the existing methodology of determining the global mean temperature is quite inappropriate and in long term creating wrong science. A new methodology is introduced, concerning energy budget of heating and cooling of the Earth. The total influence of the atmosphere in global warming can be easily estimate by comparison with the Moon's temperature as a bare body. 'The potential temperature for cooling' is introduced as a right parameter to estimate global warming trend and climate change. Using the new methodology in temperature's averaging, many surprising results would be expected and would give right insight about the climate change. Key words: climate change, the average planet's temperature, greenhouse effect, modelling


title: Graph Neural Networks for Road Safety Modeling: Datasets and Evaluations for Accident Analysis

abstract: We consider the problem of traffic accident analysis on a road network based on road network connections and traffic volume. Previous works have designed various deep-learning methods using historical records to predict traffic accident occurrences. However, there is a lack of consensus on how accurate existing methods are, and a fundamental issue is the lack of public accident datasets for comprehensive evaluations. This paper constructs a large-scale, unified dataset of traffic accident records from official reports of various states in the US, totaling 9 million records, accompanied by road networks and traffic volume reports. Using this new dataset, we evaluate existing deep-learning methods for predicting the occurrence of accidents on road networks. Our main finding is that graph neural networks such as GraphSAGE can accurately predict the number of accidents on roads with less than 22% mean absolute error (relative to the actual count) and whether an accident will occur or not with over 87% AUROC, averaged over states. We achieve these results by using multitask learning to account for cross-state variabilities (e.g., availability of accident labels) and transfer learning to combine traffic volume with accident prediction. Ablation studies highlight the importance of road graph-structural features, amongst other features. Lastly, we discuss the implications of the analysis and develop a package for easily using our new dataset.


title: Trapped Bose-Einstein condensates with nonlinear coherent modes

abstract: The review presents the methods of generation of nonlinear coherent excitations in strongly nonequilibrium Bose-condensed systems of trapped atoms and their properties. Non-ground-state Bose-Einstein condensates are represented by nonlinear coherent modes. The principal difference of nonlinear coherent modes from linear collective excitations is emphasized. Methods of generating nonlinear modes and the properties of the latter are described. Matter-wave interferometry with coherent modes is discussed, including such effects as interference patterns, internal Josephson current, Rabi oscillations, Ramsey fringes, harmonic generation, and parametric conversion. Dynamic transition between mode-locked and mode-unlocked regimes is shown to be analogous to a phase transition. Atomic squeezing and entanglement in a lattice of condensed atomic clouds with coherent modes are considered. Nonequilibrium states of trapped Bose-condensed systems, starting from weakly nonequilibrium state, vortex state, vortex turbulence, droplet or grain turbulence, and wave turbulence, are classified by means of effective Fresnel and Mach numbers. The inverse Kibble-Zurek scenario is described. A method for the formation of directed beams from atom lasers is reported.


title: Flatness of anisotropic minimal graphs in $\mathbb{R}^{n+1}$

abstract: We prove a Bernstein theorem for $\Phi$-anisotropic minimal hypersurfaces in all dimensional Euclidean spaces that the only entire smooth solutions $u: \mathbb{R}^{n}\rightarrow \mathbb{R}$ of $\Phi$-anisotropic minimal hypersurfaces equation are linear functions provided the anisotropic area functional integrand $\Phi$ is sufficiently $C^{3}$-close to classical area functional integrand and $|\nabla u(x)|=o(|x|^{\varepsilon})$ for $\varepsilon\leq \varepsilon_{0}(n, \Phi)$ with the constant $\varepsilon_{0}(n, \Phi)>0$.


title: Multi-task Deep Convolutional Network to Predict Sea Ice Concentration and Drift in the Arctic Ocean

abstract: Forecasting sea ice concentration (SIC) and sea ice drift (SID) in the Arctic Ocean is of great significance as the Arctic environment has been changed by the recent warming climate. Given that physical sea ice models require high computational costs with complex parameterization, deep learning techniques can effectively replace the physical model and improve the performance of sea ice prediction. This study proposes a novel multi-task fully conventional network architecture named hierarchical information-sharing U-net (HIS-Unet) to predict daily SIC and SID. Instead of learning SIC and SID separately at each branch, we allow the SIC and SID layers to share their information and assist each other's prediction through the weighting attention modules (WAMs). Consequently, our HIS-Unet outperforms other statistical approaches, sea ice physical models, and neural networks without such information-sharing units. The improvement of HIS-Unet is obvious both for SIC and SID prediction when and where sea ice conditions change seasonally, which implies that the information sharing through WAMs allows the model to learn the sudden changes of SIC and SID. The weight values of the WAMs imply that SIC information plays a more critical role in SID prediction, compared to that of SID information in SIC prediction, and information sharing is more active in sea ice edges (seasonal sea ice) than in the central Arctic (multi-year sea ice).


title: The Alignment Ceiling: Objective Mismatch in Reinforcement Learning from Human Feedback

abstract: Reinforcement learning from human feedback (RLHF) has emerged as a powerful technique to make large language models (LLMs) more capable in complex settings. RLHF proceeds as collecting human preference data, training a reward model on said data, and optimizing a base ML model with respect to said reward for extrinsic evaluation metrics (e.g. MMLU, GSM8k). RLHF relies on many assumptions about how the various pieces fit together, such as a reward model capturing human preferences and an RL optimizer extracting the right signal from a reward model. As the RLHF process involves many distinct design decisions, it is easy to assume that multiple processes are correlated and therefore numerically linked. This apparent correlation is often not true, where reward models are easily overoptimized or RL optimizers can reduce performance on tasks not modeled in the data. Notable manifestations of models trained with imperfect RLHF systems are those that are prone to refusing basic requests for safety reasons or appearing lazy in generations. As chat model evaluation becomes increasingly nuanced, the reliance on a perceived link between reward model training, RL scores, and downstream performance drives these issues, which we describe as an objective mismatch. In this paper, we illustrate the causes of this issue, reviewing relevant literature from model-based reinforcement learning, and argue for solutions. By solving objective mismatch in RLHF, the ML models of the future will be more precisely aligned to user instructions for both safety and helpfulness.


title: Gauge equivalence and transdimensional perturbation: point vortices

abstract: There is an explicit resolution of the Poisson reduction of four planar point vortices, in the case that three of the vortex strengths are equal and the total vorticity is zero. The resolution, a Hamiltonian system on a unified symplectic phase space with a symmetry breaking parameter, is obtained by appending redundant states. Though single point vortices do not have the attribute of mass, there are circular assemblages with the collective dynamics of free massive particles, demonstrating a finite dimensional dynamics where mass emerges from a gauge symmetry breaking. The internal vibration of these assemblages is coupled to their collective motion and has the same functional form as the de Broglie wavelength.


title: Experimental Demonstration of Coupled Learning in Elastic Networks

abstract: Coupled learning is a contrastive scheme for tuning the properties of individual elements within a network in order to achieve desired functionality of the system. It takes advantage of physics both to learn using local rules and to "compute" the output response to input data, thus enabling the system to perform decentralized computation without the need for a processor or external memory. We demonstrate a proof-of-concept mechanical network that can learn simple tasks such as self-symmetrizing via iterative tuning of individual spring rest lengths. These mechanical networks could feasibly be scaled and automated to solve increasingly complex tasks, hinting at a new class of "smart" metamaterials.


title: Coin dimensionality as a resource in quantum metrology involving discrete-time quantum walks

abstract: We address metrological problems where the parameter of interest is encoded in the internal degree of freedom of a discrete-time quantum walker, and provide evidence that coin dimensionality is a potential resource to enhance precision. In particular, we consider estimation problems where the coin parameter governs rotations around a given axis and show that the corresponding quantum Fisher information (QFI) may increase with the dimension of the coin. We determine the optimal initial state of the walker to maximize the QFI and discuss whether, and to which extent, precision enhancement may be achieved by measuring only the position of the walker. Finally, we consider Grover-like encoding of the parameter and compare results with those obtained from rotation encoding.


title: Robust Safety Classifier for Large Language Models: Adversarial Prompt Shield

abstract: Large Language Models' safety remains a critical concern due to their vulnerability to adversarial attacks, which can prompt these systems to produce harmful responses. In the heart of these systems lies a safety classifier, a computational model trained to discern and mitigate potentially harmful, offensive, or unethical outputs. However, contemporary safety classifiers, despite their potential, often fail when exposed to inputs infused with adversarial noise. In response, our study introduces the Adversarial Prompt Shield (APS), a lightweight model that excels in detection accuracy and demonstrates resilience against adversarial prompts. Additionally, we propose novel strategies for autonomously generating adversarial training datasets, named Bot Adversarial Noisy Dialogue (BAND) datasets. These datasets are designed to fortify the safety classifier's robustness, and we investigate the consequences of incorporating adversarial examples into the training process. Through evaluations involving Large Language Models, we demonstrate that our classifier has the potential to decrease the attack success rate resulting from adversarial attacks by up to 60%. This advancement paves the way for the next generation of more reliable and resilient conversational agents.


title: Continuum graph dynamics via population dynamics: well-posedness, duality and equilibria

abstract: In this paper we consider stochastic processes taking values in a set of continuum graphs we call graphemes, defined as equivalence classes of sequences of vertices labelled by N embedded in an uncountable Polish space (with the cardinality of the continuum), together with an N x N connection matrix with entries 0 or 1 specifying the absence or presence of edges between pairs of vertices. In particular, we construct a Markov process on a Polish state space G of graphemes suitable to describe the time-space path of countable graphs. The class of dynamics we propose arises by specifying simple rules for the evolution of finite graphs and passing to the limit of infinite graphs. The evolution of graphemes is characterised by well-posed martingale problems, and leads to strong Markov processes with the Feller property.


title: Dark-state solution and symmetries of the two-qubit multimode asymmetric quantum Rabi model

abstract: We study the two-qubit asymmetric quantum Rabi model (AQRM) and find its dark-state solution. Such solutions have at most one photon and constant eigenenergy in the whole coupling regime, causing level crossings in the spectrum, although there is no explicit conserved quantity except energy. We find an operator in the eigenenergy basis to label all the degeneracies with its eigenvalues, and compare it with the well-known hidden symmetry which exists when bias parameter $\epsilon$ is a multiple of half of the resonator frequency $\omega$. Extended to the multimode case, we find symmetries related with conserved bosonic number operators, which also cause level crossings. This provides a perspective for symmetry studies on generalized Rabi models.


title: Mass and Angular Momentum Transport in a Gravitationally Unstable Protoplanetary Disk with Improved 3D Radiative Hydrodynamics

abstract: During early phases of a protoplanetary disks's life, gravitational instabilities can produce significant mass transport, can dramatically alter disk structure, can mix and shock-process gas and solids, and may be instrumental in planet formation. We present a 3D grid-based radiative hydrodynamics study with varied resolutions of a 0.07 M$_\odot$ disk orbiting a 0.5 M$_\odot$ star as it settles over most of its radial extent into a quasi-steady asymptotic state that maintains approximate balance between heating produced by GIs and radiative cooling governed by realistic dust opacities. We assess disk stability criteria, thermodynamic properties, strengths of GIs, characteristics of density waves and torques produced by GIs, radial mass transport arising from these torques, and the level to which transport can be represented as local or nonlocal processes. Physical and thermal processes display distinct differences between inner optically thick and outer optically thin regions of the disk. In the inner region, gravitational torques are dominated by low-order Fourier components of the azimuthal mass distribution. These torques are strongly variable on the local dynamical time and are subject to rapid flaring presumably driven by recurrent swing amplification. In the outer region, m=1 torques dominate. Ring-like structures exhibiting strong noncircular motions, and vortices develop near the inner edge between 8 and 14 au. We find that GI-induced spiral modes erupt in a chaotic manner over the whole low-Q part of the disk, with many spiral modes appearing and disappearing, producing gravitoturbulence, but dominated by fluctuating large-scale modes, very different from a simple $\alpha$-disk.


title: ChipNeMo: Domain-Adapted LLMs for Chip Design

abstract: ChipNeMo aims to explore the applications of large language models (LLMs) for industrial chip design. Instead of directly deploying off-the-shelf commercial or open-source LLMs, we instead adopt the following domain adaptation techniques: domain-adaptive tokenization, domain-adaptive continued pretraining, model alignment with domain-specific instructions, and domain-adapted retrieval models. We evaluate these methods on three selected LLM applications for chip design: an engineering assistant chatbot, EDA script generation, and bug summarization and analysis. Our evaluations demonstrate that domain-adaptive pretraining of language models, can lead to superior performance in domain related downstream tasks compared to their base LLaMA2 counterparts, without degradations in generic capabilities. In particular, our largest model, ChipNeMo-70B, outperforms the highly capable GPT-4 on two of our use cases, namely engineering assistant chatbot and EDA scripts generation, while exhibiting competitive performance on bug summarization and analysis. These results underscore the potential of domain-specific customization for enhancing the effectiveness of large language models in specialized applications.


title: Students' Perspective on AI Code Completion: Benefits and Challenges

abstract: AI Code Completion (e.g., GitHub's Copilot) has revolutionized how computer science students interact with programming languages. However, AI code completion has been studied from the developers' perspectives, not the students' perspectives who represent the future generation of our digital world. In this paper, we investigated the benefits, challenges, and expectations of AI code completion from students' perspectives. To facilitate the study, we first developed an open-source Visual Studio Code Extension tool AutoAurora, powered by a state-of-the-art large language model StarCoder, as an AI code completion research instrument. Next, we conduct an interview study with ten student participants and apply grounded theory to help analyze insightful findings regarding the benefits, challenges, and expectations of students on AI code completion. Our findings show that AI code completion enhanced students' productivity and efficiency by providing correct syntax suggestions, offering alternative solutions, and functioning as a coding tutor. However, the over-reliance on AI code completion may lead to a surface-level understanding of programming concepts, diminishing problem-solving skills and restricting creativity. In the future, AI code completion should be explainable and provide best coding practices to enhance the education process.


title: Observing periodic gap variations in cuprates

abstract: Central to the enigma of the cuprates is ubiquitous electronic inhomogeneity arising from a variety of electronic orders that coexist with superconductivity, the individual signatures of which have been impossible to disentangle despite four decades of intense research. This strong nanoscale inhomogeneity complicates interpretation of measurements both by probes which average over this inhomogeneity and those, like scanning tunneling microscopy (STM), which should be able to spatially resolve variations driven by both order and inhomogeneity. Here, we develop a novel technique that directly acknowledges this electronic inhomogeneity and extracts statistically significant features from scanning tunneling spectroscopic data. Applying our novel technique to single and bilayer Bi-based cuprates spanning a large doping range, we peer through local inhomogeneities and find that the gap breaks translational and rotational symmetries and varies periodically in a four-fold pattern. Our direct observation of a symmetry breaking gap in the single particle tunneling spectra adds strong credence to the pair density wave hypotheses supposed to exist in these materials. We also discuss various implications of our observations and, in particular, how they can explain the origin of the low energy checkerboard pattern.


title: A simple proof of linear instability of shear flows with application to vortex sheets

abstract: We consider the construction of linear instability of parallel shear flows, which was developed by Zhiwu Lin (SIAM J. Math. Anal. 35(2), 2003). We give an alternative simple proof in Sobolev setting of the problem, which exposes the role of the Plemenj-Sokhotski formula in the emergence of the instability, as well as does not require the cone condition. Moreover, we localize this approach to obtain an approximation of the Kelvin-Helmholtz instability of a flat vortex sheet.


title: Object-centric Video Representation for Long-term Action Anticipation

abstract: This paper focuses on building object-centric representations for long-term action anticipation in videos. Our key motivation is that objects provide important cues to recognize and predict human-object interactions, especially when the predictions are longer term, as an observed "background" object could be used by the human actor in the future. We observe that existing object-based video recognition frameworks either assume the existence of in-domain supervised object detectors or follow a fully weakly-supervised pipeline to infer object locations from action labels. We propose to build object-centric video representations by leveraging visual-language pretrained models. This is achieved by "object prompts", an approach to extract task-specific object-centric representations from general-purpose pretrained models without finetuning. To recognize and predict human-object interactions, we use a Transformer-based neural architecture which allows the "retrieval" of relevant objects for action anticipation at various time scales. We conduct extensive evaluations on the Ego4D, 50Salads, and EGTEA Gaze+ benchmarks. Both quantitative and qualitative results confirm the effectiveness of our proposed method.


title: Best of Both Worlds Guarantees for Smoothed Online Quadratic Optimization

abstract: We study the smoothed online quadratic optimization (SOQO) problem where, at each round $t$, a player plays an action $x_t$ in response to a quadratic hitting cost and an additional squared $\ell_2$-norm cost for switching actions. This problem class has strong connections to a wide range of application domains including smart grid management, adaptive control, and data center management, where switching-efficient algorithms are highly sought after. We study the SOQO problem in both adversarial and stochastic settings, and in this process, perform the first stochastic analysis of this class of problems. We provide the online optimal algorithm when the minimizers of the hitting cost function evolve as a general stochastic process, which, for the case of martingale process, takes the form of a distribution-agnostic dynamic interpolation algorithm (LAI). Next, we present the stochastic-adversarial trade-off by proving an $\Omega(T)$ expected regret for the adversarial optimal algorithm in the literature (ROBD) with respect to LAI and, a sub-optimal competitive ratio for LAI in the adversarial setting. Finally, we present a best-of-both-worlds algorithm that obtains a robust adversarial performance while simultaneously achieving a near-optimal stochastic performance.


title: Local Max-Cut on Sparse Graphs

abstract: We bound the smoothed running time of the FLIP algorithm for local Max-Cut as a function of $\alpha$, the arboricity of the input graph. We show that, with high probability and in expectation, the following holds (where $n$ is the number of nodes and $\phi$ is the smoothing parameter): 1) When $\alpha = O(\log^{1-\delta} n)$ FLIP terminates in $\phi poly(n)$ iterations, where $\delta \in (0,1]$ is an arbitrarily small constant. Previous to our results the only graph families for which FLIP was known to achieve a smoothed polynomial running time were complete graphs and graphs with logarithmic maximum degree. 2) For arbitrary values of $\alpha$ we get a running time of $\phi n^{O(\frac{\alpha}{\log n} + \log \alpha)}$. This improves over the best known running time for general graphs of $\phi n^{O(\sqrt{ \log n })}$ for $\alpha = o(\log^{1.5} n)$. Specifically, when $\alpha = O(\log n)$ we get a significantly faster running time of $\phi n^{O(\log \log n)}$.


title: Electrostatic nature of cavity-mediated interactions between low-energy matter excitations

abstract: The use of cavity quantum electrodynamical effects, i.e., of vacuum electromagnetic fields, to modify material properties in cavities has rapidly gained popularity and interest in the last few years. However, there is still a scarcity of general results that provide guidelines for intuitive understanding and limitations of what kind of effects can be achieved. We provide such a result for the effective interactions between low-energy matter excitations induced either directly by their mutual coupling to the cavity electromagnetic (EM) field or indirectly through coupling to mediator modes that couple to the EM field. We demonstrate that the induced interactions are purely electrostatic in nature and are thus fully described by the EM Green's function evaluated at zero frequency. Our findings imply that reduced models with one or a few cavity modes can easily give misleading results.


title: LATIS: Constraints on the Galaxy-halo Connection at $z \sim 2.5$ from Galaxy-galaxy and Galaxy-Ly$\alpha$ Clustering

abstract: The connection between galaxies and dark matter halos is often quantified using the stellar mass-halo mass (SMHM) relation. Optical and near-infrared imaging surveys have led to a broadly consistent picture of the evolving SMHM relation based on measurements of galaxy abundances and angular correlation functions. Spectroscopic surveys at $z \gtrsim 2$ can also constrain the SMHM relation via the galaxy autocorrelation function and through the cross-correlation between galaxies and Ly$\alpha$ absorption measured in transverse sightlines; however, such studies are very few and have produced some unexpected or inconclusive results. We use $\sim$3000 spectra of $z\sim2.5$ galaxies from the Lyman-alpha Tomography IMACS Survey (LATIS) to measure the galaxy-galaxy and galaxy-Ly$\alpha$ correlation functions in four bins of stellar mass spanning $10^{9.2} \lesssim M_* / M_{\odot} \lesssim 10^{10.5}$. Parallel analyses of the MultiDark N-body and ASTRID hydrodynamic cosmological simulations allow us to model the correlation functions, estimate covariance matrices, and infer halo masses. We find that results of the two methods are mutually consistent and are broadly in accord with standard SMHM relations. This consistency demonstrates that we are able to accurately measure and model Ly$\alpha$ transmission fluctuations $\delta_F$ in LATIS. We also show that the galaxy-Ly$\alpha$ cross-correlation, a free byproduct of optical spectroscopic galaxy surveys at these redshifts, can constrain halo masses with similar precision to galaxy-galaxy clustering.


title: Branch-and-Bound versus Lift-and-Project Relaxations in Combinatorial Optimization

abstract: In this paper, we consider a theoretical framework for comparing branch-and-bound with classical lift-and-project hierarchies. We simplify our analysis of streamlining the definition of branch-and-bound. We introduce "skewed $k$-trees" which give a hierarchy of relaxations that is incomparable to that of Sherali-Adams, and we show that it is much better for some instances. We also give an example where lift-and-project does very well and branch-and-bound does not. Finally, we study the set of branch-and-bound trees of height at most $k$ and effectively "squeeze" their effectiveness between two well-known lift-and-project procedures.


title: Image Restoration with Point Spread Function Regularization and Active Learning

abstract: Large-scale astronomical surveys can capture numerous images of celestial objects, including galaxies and nebulae. Analysing and processing these images can reveal intricate internal structures of these objects, allowing researchers to conduct comprehensive studies on their morphology, evolution, and physical properties. However, varying noise levels and point spread functions can hamper the accuracy and efficiency of information extraction from these images. To mitigate these effects, we propose a novel image restoration algorithm that connects a deep learning-based restoration algorithm with a high-fidelity telescope simulator. During the training stage, the simulator generates images with different levels of blur and noise to train the neural network based on the quality of restored images. After training, the neural network can directly restore images obtained by the telescope, as represented by the simulator. We have tested the algorithm using real and simulated observation data and have found that it effectively enhances fine structures in blurry images and increases the quality of observation images. This algorithm can be applied to large-scale sky survey data, such as data obtained by LSST, Euclid, and CSST, to further improve the accuracy and efficiency of information extraction, promoting advances in the field of astronomical research.

categories: astro-ph.IM astro-ph.GA astro-ph.SR cs.CV


title: Decodable and Sample Invariant Continuous Object Encoder

abstract: We propose Hyper-Dimensional Function Encoding (HDFE). Given samples of a continuous object (e.g. a function), HDFE produces an explicit vector representation of the given object, invariant to the sample distribution and density. Sample distribution and density invariance enables HDFE to consistently encode continuous objects regardless of their sampling, and therefore allows neural networks to receive continuous objects as inputs for machine learning tasks, such as classification and regression. Besides, HDFE does not require any training and is proved to map the object into an organized embedding space, which facilitates the training of the downstream tasks. In addition, the encoding is decodable, which enables neural networks to regress continuous objects by regressing their encodings. Therefore, HDFE serves as an interface for processing continuous objects. We apply HDFE to function-to-function mapping, where vanilla HDFE achieves competitive performance as the state-of-the-art algorithm. We apply HDFE to point cloud surface normal estimation, where a simple replacement from PointNet to HDFE leads to immediate 12% and 15% error reductions in two benchmarks. In addition, by integrating HDFE into the PointNet-based SOTA network, we improve the SOTA baseline by 2.5% and 1.7% in the same benchmarks.


title: A Two-Step Framework for Multi-Material Decomposition of Dual Energy Computed Tomography from Projection Domain

abstract: Dual-energy computed tomography (DECT) utilizes separate X-ray energy spectra to improve multi-material decomposition (MMD) for various diagnostic applications. However accurate decomposing more than two types of material remains challenging using conventional methods. Deep learning (DL) methods have shown promise to improve the MMD performance, but typical approaches of conducing DL-MMD in the image domain fail to fully utilize projection information or under iterative setup are computationally inefficient in both training and prediction. In this work, we present a clinical-applicable MMD (>2) framework rFast-MMDNet, operating with raw projection data in non-recursive setup, for breast tissue differentiation. rFast-MMDNet is a two-stage algorithm, including stage-one SinoNet to perform dual energy projection decomposition on tissue sinograms and stage-two FBP-DenoiseNet to perform domain adaptation and image post-processing. rFast-MMDNet was tested on a 2022 DL-Spectral-Challenge breast phantom dataset. The two stages of rFast-MMDNet were evaluated separately and then compared with four noniterative reference methods including a direct inversion method (AA-MMD), an image domain DL method (ID-UNet), AA-MMD/ID-UNet + DenoiseNet and a sinogram domain DL method (Triple-CBCT). Our results show that models trained from information stored in DE transmission domain can yield high-fidelity decomposition of the adipose, calcification, and fibroglandular materials with averaged RMSE, MAE, negative PSNR, and SSIM of 0.004+/-~0, 0.001+/-~0, -45.027+/-~0.542, and 0.002+/-~0 benchmarking to the ground truth, respectively. Training of entire rFast-MMDNet on a 4xRTX A6000 GPU cluster took a day with inference time <1s. All DL methods generally led to more accurate MMD than AA-MMD. rFast-MMDNet outperformed Triple-CBCT, but both are superior to the image-domain based methods.


title: XAI-CLASS: Explanation-Enhanced Text Classification with Extremely Weak Supervision

abstract: Text classification aims to effectively categorize documents into pre-defined categories. Traditional methods for text classification often rely on large amounts of manually annotated training data, making the process time-consuming and labor-intensive. To address this issue, recent studies have focused on weakly-supervised and extremely weakly-supervised settings, which require minimal or no human annotation, respectively. In previous methods of weakly supervised text classification, pseudo-training data is generated by assigning pseudo-labels to documents based on their alignment (e.g., keyword matching) with specific classes. However, these methods ignore the importance of incorporating the explanations of the generated pseudo-labels, or saliency of individual words, as additional guidance during the text classification training process. To address this limitation, we propose XAI-CLASS, a novel explanation-enhanced extremely weakly-supervised text classification method that incorporates word saliency prediction as an auxiliary task. XAI-CLASS begins by employing a multi-round question-answering process to generate pseudo-training data that promotes the mutual enhancement of class labels and corresponding explanation word generation. This pseudo-training data is then used to train a multi-task framework that simultaneously learns both text classification and word saliency prediction. Extensive experiments on several weakly-supervised text classification datasets show that XAI-CLASS outperforms other weakly-supervised text classification methods significantly. Moreover, experiments demonstrate that XAI-CLASS enhances both model performance and explainability.


title: Microscopic aspects of gamma softness in atomic nuclei

abstract: It is demonstrated that the Triaxial Projected Shell Model reproduces the energies and transition probabilities of the nucleus 104Ru and the rigid triaxial nucleus 112Ru. An interpretation in terms of band mixing is provided.


title: The ZFC analogue of the Halpern-Levy theorem

abstract: Here we present ZFC theorems yielding the Halpern-L\a"uchli theorem and avoiding metamathematical notions in their formulations.


title: Large-Scale Multi-Robot Assembly Planning for Autonomous Manufacturing

abstract: Mobile autonomous robots have the potential to revolutionize manufacturing processes. However, employing large robot fleets in manufacturing requires addressing challenges including collision-free movement in a shared workspace, effective multi-robot collaboration to manipulate and transport large payloads, complex task allocation due to coupled manufacturing processes, and spatial planning for parallel assembly and transportation of nested subassemblies. We propose a full algorithmic stack for large-scale multi-robot assembly planning that addresses these challenges and can synthesize construction plans for complex assemblies with thousands of parts in a matter of minutes. Our approach takes in a CAD-like product specification and automatically plans a full-stack assembly procedure for a group of robots to manufacture the product. We propose an algorithmic stack that comprises: (i) an iterative radial layout optimization procedure to define a global staging layout for the manufacturing facility, (ii) a graph-repair mixed-integer program formulation and a modified greedy task allocation algorithm to optimally allocate robots and robot sub-teams to assembly and transport tasks, (iii) a geometric heuristic and a hill-climbing algorithm to plan collaborative carrying configurations of robot sub-teams, and (iv) a distributed control policy that enables robots to execute the assembly motion plan collision-free. We also present an open-source multi-robot manufacturing simulator implemented in Julia as a resource to the research community, to test our algorithms and to facilitate multi-robot manufacturing research more broadly. Our empirical results demonstrate the scalability and effectiveness of our approach by generating plans to manufacture a LEGO model of a Saturn V launch vehicle with 1845 parts, 306 subassemblies, and 250 robots in under three minutes on a standard laptop computer.


title: Quantum coherence effects on inelastic thermoelectric devices: From diodes to transistors

abstract: We present a study on inelastic thermoelectric devices, wherein charge currents and electronic and phononic heat currents are intricately interconnected. The employment of double quantum dots in conjunction with a phonon bath positions them as promising candidates for quantum thermoelectric diodes and transistors. Within this study, we illustrate that quantum coherence effects yield significant charge and Seebeck rectification effects. It's worth noting that, while the thermal transistor effect is observable in the linear response regime, especially when phonon-assisted inelastic processes dominate the transport, quantum coherence does not enhance thermal amplification. Our work provides valuable insights for the optimization of general thermoelectric devices.


title: Algorithms for Chip-Firing on Weighted Graphs

abstract: We extend the notion of chip-firing to weighted graphs, and generalize the Greedy Algorithm and Dhar's Burning Algorithm to weighted graphs. For a vertex $q \in V(\Gamma)$, we give an upper bound for the number of linearly equivalent $q$-reduced divisors. Finally, we illustrate a method of finding all maximal unwinnable divisors on weighted graphs.