title: Calibrated Seq2seq Models for Efficient and Generalizable Ultra-fine Entity Typing

abstract: Ultra-fine entity typing plays a crucial role in information extraction by predicting fine-grained semantic types for entity mentions in text. However, this task poses significant challenges due to the massive number of entity types in the output space. The current state-of-the-art approaches, based on standard multi-label classifiers or cross-encoder models, suffer from poor generalization performance or inefficient inference. In this paper, we present CASENT, a seq2seq model designed for ultra-fine entity typing that predicts ultra-fine types with calibrated confidence scores. Our model takes an entity mention as input and employs constrained beam search to generate multiple types autoregressively. The raw sequence probabilities associated with the predicted types are then transformed into confidence scores using a novel calibration method. We conduct extensive experiments on the UFET dataset which contains over 10k types. Our method outperforms the previous state-of-the-art in terms of F1 score and calibration error, while achieving an inference speedup of over 50 times. Additionally, we demonstrate the generalization capabilities of our model by evaluating it in zero-shot and few-shot settings on five specialized domain entity typing datasets that are unseen during training. Remarkably, our model outperforms large language models with 10 times more parameters in the zero-shot setting, and when fine-tuned on 50 examples, it significantly outperforms ChatGPT on all datasets. Our code, models and demo are available at https://github.com/yanlinf/CASENT.


title: Effective filtering approach for joint parameter-state estimation in SDEs via Rao-Blackwellization and modularization

abstract: Stochastic filtering is a vibrant area of research in both control theory and statistics, with broad applications in many scientific fields. Despite its extensive historical development, there still lacks an effective method for joint parameter-state estimation in SDEs. The state-of-the-art particle filtering methods suffer from either sample degeneracy or information loss, with both issues stemming from the dynamics of the particles generated to represent system parameters. This paper provides a novel and effective approach for joint parameter-state estimation in SDEs via Rao-Blackwellization and modularization. Our method operates in two layers: the first layer estimates the system states using a bootstrap particle filter, and the second layer marginalizes out system parameters explicitly. This strategy circumvents the need to generate particles representing system parameters, thereby mitigating their associated problems of sample degeneracy and information loss. Moreover, our method employs a modularization approach when integrating out the parameters, which significantly reduces the computational complexity. All these designs ensure the superior performance of our method. Finally, a numerical example is presented to illustrate that our method outperforms existing approaches by a large margin.


title: Constant-time Motion Planning with Anytime Refinement for Manipulation

abstract: Robotic manipulators are essential for future autonomous systems, yet limited trust in their autonomy has confined them to rigid, task-specific systems. The intricate configuration space of manipulators, coupled with the challenges of obstacle avoidance and constraint satisfaction, often makes motion planning the bottleneck for achieving reliable and adaptable autonomy. Recently, a class of constant-time motion planners (CTMP) was introduced. These planners employ a preprocessing phase to compute data structures that enable online planning provably guarantee the ability to generate motion plans, potentially sub-optimal, within a user defined time bound. This framework has been demonstrated to be effective in a number of time-critical tasks. However, robotic systems often have more time allotted for planning than the online portion of CTMP requires, time that can be used to improve the solution. To this end, we propose an anytime refinement approach that works in combination with CTMP algorithms. Our proposed framework, as it operates as a constant time algorithm, rapidly generates an initial solution within a user-defined time threshold. Furthermore, functioning as an anytime algorithm, it iteratively refines the solution's quality within the allocated time budget. This enables our approach to strike a balance between guaranteed fast plan generation and the pursuit of optimization over time. We support our approach by elucidating its analytical properties, showing the convergence of the anytime component towards optimal solutions. Additionally, we provide empirical validation through simulation and real-world demonstrations on a 6 degree-of-freedom robot manipulator, applied to an assembly domain.


title: Computing local minimizers in polynomial optimization under genericity conditions

abstract: In this paper, we focus on computing local minimizers of a multivariate polynomial optimization problem under certain genericity conditions. By using a technique in computer algebra and the second-order optimality condition, we provide a univariate representation for the set of local minimizers. In particular, for the unconstrained problem, i.e. the constraint set is $\R^n$, the coordinates of all local minimizers can be represented by the values of $n$ univariate polynomials at real roots of a system including a univariate polynomial equation and a univariate polynomial matrix inequality. We also develop the technique for constrained problems having equality/inequality constraints. Based on the above technique, we design symbolic algorithms to enumerate the local minimizers and provide some experimental examples based on hybrid symbolic-numerical computations. For the case that the genericity conditions fail, at the end of the paper, we propose a perturbation technique to compute approximately a global minimizer provided that the constraint set is compact.


title: Non-Stokesian dynamics of magnetic helical nanoswimmers under confinement

abstract: Electromagnetically propelled helical nanoswimmers offer great potential for nanorobotic applications. Here, the effect of confinement on their propulsion is characterized using lattice-Boltzmann simulations. Two principal mechanisms give rise to their forward motion under confinement: 1) pure swimming, and 2) the thrust created by the differential pressure due to confinement. Under strong confinement, they face greater rotational drag, but display a faster propulsion for fixed driving frequency in agreement with experimental findings. This is due to the increased differential pressure created by the boundary walls when they are sufficiently close to each other and the particle. Two new analytical relations are presented: 1) for predicting the swimming speed of an unconfined particle as a function of its angular speed and geometrical properties, and 2) an empirical expression to accurately predict the propulsion speed of a confined swimmer as a function of the degree of confinement and its unconfined swimming speed. At low driving frequencies and degrees of confinement, the systems retain the expected linear behavior consistent with the predictions of the Stokes equation. However, as the driving frequency and/or the degree of confinement increase, their impact on propulsion leads to increasing deviations from the Stokesian regime and emergence of nonlinear behavior.


title: Sharp Noisy Binary Search with Monotonic Probabilities

abstract: We revisit the noisy binary search model of Karp and Kleinberg, in which we have $n$ coins with unknown probabilities $p_i$ that we can flip. The coins are sorted by increasing $p_i$, and we would like to find where the probability crosses (to within $\varepsilon$) of a target value $\tau$. This generalized the fixed-noise model of Burnashev and Zigangirov , in which $p_i = \frac{1}{2} \pm \varepsilon$, to a setting where coins near the target may be indistinguishable from it. Karp and Kleinberg showed that $\Theta(\frac{1}{\varepsilon^2} \log n)$ samples are necessary and sufficient for this task. We produce a practical algorithm by solving two theoretical challenges: high-probability behavior and sharp constants. We give an algorithm that succeeds with probability $1-\delta$ from \[ \frac{1}{C_{\tau, \varepsilon}} \cdot \left(\lg n + O(\log^{2/3} n \log^{1/3} \frac{1}{\delta} + \log \frac{1}{\delta})\right) \] samples, where $C_{\tau, \varepsilon}$ is the optimal such constant achievable. For $\delta > n^{-o(1)}$ this is within $1 + o(1)$ of optimal, and for $\delta \ll 1$ it is the first bound within constant factors of optimal.


title: Nuclear Magnetic Resonance Investigation of Superconducting and Normal State Nb$_3$Sn

abstract: The superconductor Nb$_3$Sn has a high critical temperature and high critical field, widely used for high-field superconducting magnets. In this work we investigate its microscopic electronic structure with $^{93}$Nb nuclear magnetic resonance (NMR). The high-quality Nb$_3$Sn powder sample was studied in both 3.2T and 7T magnetic fields in the temperature range from 1.5K to 300K. From measurement of the spectrum and its theoretical analysis, we find evidence for anisotropy despite its cubic crystal structure. This anisotropy is manifest in alignment of powder grains under certain temperature and field cycling conditions. The Knight shift and spin-lattice relaxation rate, $T_1^{-1}$, were measured in the normal state. Additionally, $T_1^{-1}$ was measured in the superconducting state and compared with BCS theory revealing a weak field dependence, with an energy gap $\Delta(0)=2.0\pm0.08k_B T_c$ at 3.2T and $\Delta(0)=1.73\pm0.08k_B T_c$ at 7T, indicating suppression of the order parameter by magnetic field.


title: healthAIChain: Improving security and safety using Blockchain Technology applications in AI-based healthcare systems

abstract: Blockchain as a digital ledger for keeping records of digital transactions and other information, it is secure and decentralized technology. The globally growing number of digital population every day possesses a significant threat to online data including the medical and patients data. After bitcoin, blockchain technology has emerged into a general-purpose technology with applications in medical industries and healthcare. Blockchain can promote highly configurable openness while retaining the highest security standards for critical data of medical patients. Referred to as distributed record keeping for healthcare systems which makes digital assets unalterable and transparent via a cryptographic hash and decentralized network. The study delves into the security and safety improvement associated with implementing blockchain in AI-based healthcare systems. Blockchain-enabled AI tackles the existing issues related to security, performance efficiencies, and safety in healthcare systems. We have also examined the Artificial Intelligence in healthcare and medical industry, potential areas, open questions concerning the blockchain in healthcare systems. Finally, the article proposed an AI-based healthcare blockchain model (healthAIChain) to improve patients data and security.


title: Compiled Properties of Nucleonic Matter and Nuclear and Neutron Star Models from Non-Relativistic and Relativistic Interactions

abstract: This paper compiles the model parameters and zero-temperature properties of an extensive collection of published theoretical nuclear interactions, including 255 non-relativistic (Skyrme-like) forces, 270 relativistic mean field (RMF) and point-coupling (RMF-PC) forces, and 13 Gogny-like forces. This forms the most exhaustive tabulation of model parameters to date. The properties of uniform symmetric matter and pure neutron matter at the saturation density are determined. Symmetry properties found from the second-order term of a Taylor expansion in neutron excess are compared to the energy difference of pure neutron and symmetric nuclear matter at the saturation density. Selected liquid-droplet model parameters, including the surface tension and surface symmetry energy, are determined for semi-infinite surfaces. Theoretical liquid droplet model neutron skin thicknesses of the neutron-rich closed-shell nuclei $^{48}$Ca and $^{208}$Pb are compared to published theoretical Hartree-Fock and experimental results. A similar comparison is made between theoretical liquid-droplet and experimental values of dipole polarizabilities. In addition, radii, binding energies, moments of inertia and tidal deformabilities of 1.2, 1.4 and 1.6 M$_\odot$ neutron stars are computed. An extensive correlation analysis of bulk matter, nuclear structure, and low-mass neutron star properties is performed and compared to nuclear experiments and astrophysical observations.


title: Electronic excited states from physically-constrained machine learning

abstract: Data-driven techniques are increasingly used to replace electronic-structure calculations of matter. In this context, a relevant question is whether machine learning (ML) should be applied directly to predict the desired properties or be combined explicitly with physically-grounded operations. We present an example of an integrated modeling approach, in which a symmetry-adapted ML model of an effective Hamiltonian is trained to reproduce electronic excitations from a quantum-mechanical calculation. The resulting model can make predictions for molecules that are much larger and more complex than those that it is trained on, and allows for dramatic computational savings by indirectly targeting the outputs of well-converged calculations while using a parameterization corresponding to a minimal atom-centered basis. These results emphasize the merits of intertwining data-driven techniques with physical approximations, improving the transferability and interpretability of ML models without affecting their accuracy and computational efficiency, and providing a blueprint for developing ML-augmented electronic-structure methods.


title: Floquet engineering with spatially non-uniform driving fields

abstract: We generalize the scope of Floquet engineering to include spatially-dependent modulations of an optical system. As an application, we show that we can transform large classes of Hamiltonians into one another by driving them in a time-periodic but spatially non-uniform manner. We propose several experimental realizations in 1D optical lattices, including freeing disordered lattices from Anderson localization, as well as effectively disconnecting all their sites. These techniques straightforwardly extend to more complex classes of systems.


title: From Doubt to Devotion: Trials and Learning-Based Pricing

abstract: An informed seller designs a dynamic mechanism to sell an experience good. The seller has partial information about the product match, which affects the buyer's private consumption experience. We characterize equilibrium mechanisms of this dynamic informed principal problem. The belief gap between the informed seller and the uninformed buyer, coupled with the buyer's learning, gives rise to mechanisms that provide the skeptical buyer with limited access to the product and an option to upgrade if the buyer is swayed by a good experience. Depending on the seller's screening technology, this takes the form of free/discounted trials or tiered pricing, which are prevalent in digital markets. In contrast to static environments, having consumer data can reduce sellers' revenue in equilibrium, as they fine-tune the dynamic design with their data forecasting the buyer's learning process.


title: Signatures From Pseudorandom States via $\bot$-PRFs

abstract: Different flavors of quantum pseudorandomness have proven useful for various cryptographic applications, with the compelling feature that these primitives are potentially weaker than post-quantum one-way functions. Ananth, Lin, and Yuen (2023) have shown that logarithmic pseudorandom states can be used to construct a pseudo-deterministic PRG: informally, for a fixed seed, the output is the same with $1-1/poly$ probability. In this work, we introduce new definitions for $\bot$-PRG and $\bot$-PRF. The correctness guarantees are that, for a fixed seed, except with negligible probability, the output is either the same (with probability $1-1/poly$) or recognizable abort, denoted $\bot$. Our approach admits a natural definition of multi-time PRG security, as well as the adaptive security of a PRF. We construct a $\bot$-PRG from any pseudo-deterministic PRG and, from that, a $\bot$-PRF. Even though most mini-crypt primitives, such as symmetric key encryption, commitments, MAC, and length-restricted one-time digital signatures, have been shown based on various quantum pseudorandomness assumptions, digital signatures remained elusive. Our main application is a (quantum) digital signature scheme with classical public keys and signatures, thereby addressing a previously unresolved question posed in Morimae and Yamakawa's work (Crypto, 2022). Additionally, we construct CPA secure public-key encryption with tamper-resilient quantum public keys.


title: ABCD: Algorithm for Balanced Component Discovery in Signed Networks

abstract: The most significant balanced element in signed graphs plays a vital role in helping researchers understand the fundamental structure of the graph, as it reveals valuable information about the complex relationships between vertices in the network. The challenge is an NP-hard problem; there is no current baseline to evaluate state-of-the-art signed graphs derived from real networks. In this paper, we propose a scalable state-of-the-art approach for the maximum balanced sub-graph detection in the network of \emph{any} size. However, it is still bounded by computational capability. The proposed approach builds on the graph characteristics and a scalable fundamental cycle discovery method to minimize the number of vertices discarded. We evaluate the proposed approach against state-of-the-art and demonstrate over two times higher graph size regarding the number of vertices selected of the discovered subset on an extensive signed network with millions of vertices and edges over the state-of-art in the same time frame.


title: Winding number criterion for the origin to belong to the numerical range of a matrix on a loop of matrices

abstract: Let $A:[0,1]\to GL(n,\mathbb{C})$ be continuous with $A(0)=A(1)$, thus the winding number of $\det A$ is well-defined. If the winding number is not divisible by $n$, then the origin belongs to the numerical range of $A(\phi)$ for some $\phi \in [0,1]$.

categories: math.FA math-ph math.MP math.OA math.SP physics.optics


title: EMPOT: partial alignment of density maps and rigid body fitting using unbalanced Gromov-Wasserstein divergence

abstract: Aligning EM density maps and fitting atomic models are essential steps in single particle cryogenic electron microscopy (cryo-EM), with recent methods leveraging various algorithms and machine learning tools. As aligning maps remains challenging in the presence of a map that only partially fits the other (e.g. one subunit), we here propose a new procedure, EMPOT (EM Partial alignment with Optimal Transport), for partial alignment of 3D maps. EMPOT first finds a coupling between 3D point-cloud representations, which is associated with their so-called unbalanced Gromov Wasserstein divergence, and second, uses this coupling to find an optimal rigid body transformation. Upon running and benchmarking our method with experimental maps and structures, we show that EMPOT outperforms standard methods for aligning subunits of a protein complex and fitting atomic models to a density map, suggesting potential applications of Partial Optimal Transport for improving Cryo-EM pipelines.


title: A New Convex Integration Approach for the Compressible Euler Equations and Failure of the Local Maximal Dissipation Criterion

abstract: In this paper we establish a new convex integration approach for the barotropic compressible Euler equations in two space dimensions. In contrast to existing literature, our new method generates not only the momentum for given density, but also the energy and the energy flux. This allows for a simple way to construct admissible solutions, i.e. solutions which satisfy the energy inequality. Moreover using the convex integration method developed in this paper, we show that the local maximal dissipation criterion fails in the following sense: There exist wild solutions which beat the self-similar solution of the one-dimensional Riemann problem extended to two dimensions. Hence the local maximal dissipation criterion rules out the self-similar solution. The convex integration machinery itself is carried out in a very general way. Hence this paper provides a universal framework for convex integration which not even specifies the form of the partial differential equations under consideration. Therefore this general framework is applicable in many different situations.


title: Fractional Sobolev-Chocard critical equation with Hardy term and weighted singularities

abstract: In this paper we consider a fractional $p$-Laplacian equation in the entire space $\mathbb{R}^{N}$ with doubly critical singular nonlinearities involving a local critical Sobolev term together with a nonlocal Choquard critical term; the problem also includes a homogeneous singular Hardy term. More precisely, we deal with the problem \begin{align*} \begin{cases} (-\Delta)^{s}_{p,\theta} u -\gamma \dfrac{|u|^{p-2}u}{|x|^{sp+ \theta}} = \dfrac{|u|^{p^*_s(\beta,\theta)-2}u}% {|x|^{\beta}} + \left[ I_{\mu} \ast F_{\delta,\theta,\mu}(\cdot, u) \right](x)f_{\delta,\theta,\mu}(x,u) u \in \dot{W}^{s,p}_{\theta}(\mathbb{R}^N) \end{cases} \end{align*} where $0 < s < 1$; $0 < \alpha, \,\beta < sp + \theta < N$; $0 < \mu < N$; $2\delta + \mu < N$; $\gamma < \gamma_{H}$ with the best fractional Hardy constant $\gamma_{H}$; the Hardy-Sobolev and Stein-Weiss upper critical fractional exponents are respectively defined by $p^*_s(\beta,\theta) := p(N-\beta)/(N-sp-\theta)$, and $p^\sharp_s(\delta,\theta,\mu) := p(N-\delta-\mu/2)/(N-sp-\theta)$. Moreover, $I_{\mu}(x) =|x|^{-\mu}$ is the Riesz potencial; $f_{\delta,\theta,\mu}(x,t) := |x|^{-\delta} |t|^{p^{\sharp}_{s}(\delta,\theta,\mu)-2}t$ and $F_{\delta,\theta,\mu}(x,t) := |x|^{\delta} |t|^{p^{\sharp}_{s}(\delta,\theta,\mu)}$; and the term with convolution integral is known as Choquard type nonlinearity. To prove the main result we have to show new embeddings involving the weighted Morrey spaces and a version of the Caffarelli-Kohn-Nirenberg inequality. With the help of these new embedding results, we provide sufficient conditions under which a weak nontrivial solution to the problem exists via variational methods.


title: An efficient tangent based topologically distinctive path finding for grid maps

abstract: Conventional local planners frequently become trapped in a locally optimal trajectory, primarily due to their inability to traverse obstacles. Having a larger number of topologically distinctive paths increases the likelihood of finding the optimal trajectory. It is crucial to generate a substantial number of topologically distinctive paths in real-time. Accordingly, we propose an efficient path planning approach based on tangent graphs to yield multiple topologically distinctive paths. Diverging from existing algorithms, our method eliminates the necessity of distinguishing whether two paths belong to the same topology; instead, it generates multiple topologically distinctive paths based on the locally shortest property of tangents. Additionally, we introduce a priority constraint for the queue during graph search, thereby averting the exponential expansion of queue size. To illustrate the advantages of our method, we conducted a comparative analysis with various typical algorithms using a widely recognized public dataset\footnote{https://movingai.com/benchmarks/grids.html}. The results indicate that, on average, our method generates 320 topologically distinctive paths within a mere 100 milliseconds. This outcome underscores a significant enhancement in efficiency when compared to existing methods. To foster further research within the community, we have made the source code of our proposed algorithm publicly accessible\footnote{https://joeyao-bit.github.io/posts/2023/09/07/}. We anticipate that this framework will significantly contribute to the development of more efficient topologically distinctive path planning, along with related trajectory optimization and motion planning endeavors.


title: $2$-Fault-Tolerant Strong Connectivity Oracles

abstract: We study the problem of efficiently answering strong connectivity queries under two vertex failures. Given a directed graph $G$ with $n$ vertices, we provide a data structure with $O(nh)$ space and $O(h)$ query time, where $h$ is the height of a decomposition tree of $G$ into strongly connected subgraphs. This immediately implies data structures with $O(n \log{n})$ space and $O(\log{n})$ query time for graphs of constant treewidth, and $O(n^{3/2})$ space and $O(\sqrt{n})$ query time for planar graphs. For general directed graphs, we give a refined version of our data structure that achieves $O(n\sqrt{m})$ space and $O(\sqrt{m})$ query time, where $m$ is the number of edges of the graph. We also provide some simple BFS-based heuristics that seem to work remarkably well in practice. In the experimental part, we first evaluate various methods to construct a decomposition tree with small height $h$ in practice. Then we provide efficient implementations of our data structures, and evaluate their empirical performance by conducting an extensive experimental study on graphs taken from real-world applications.


title: A Multi-Agent Reinforcement Learning Framework for Evaluating the U.S. Ending the HIV Epidemic Plan

abstract: Human immunodeficiency virus (HIV) is a major public health concern in the United States, with about 1.2 million people living with HIV and 35,000 newly infected each year. There are considerable geographical disparities in HIV burden and care access across the U.S. The 2019 Ending the HIV Epidemic (EHE) initiative aims to reduce new infections by 90% by 2030, by improving coverage of diagnoses, treatment, and prevention interventions and prioritizing jurisdictions with high HIV prevalence. Identifying optimal scale-up of intervention combinations will help inform resource allocation. Existing HIV decision analytic models either evaluate specific cities or the overall national population, thus overlooking jurisdictional interactions or differences. In this paper, we propose a multi-agent reinforcement learning (MARL) model, that enables jurisdiction-specific decision analyses but in an environment with cross-jurisdictional epidemiological interactions. In experimental analyses, conducted on jurisdictions within California and Florida, optimal policies from MARL were significantly different than those generated from single-agent RL, highlighting the influence of jurisdictional variations and interactions. By using comprehensive modeling of HIV and formulations of state space, action space, and reward functions, this work helps demonstrate the strengths and applicability of MARL for informing public health policies, and provides a framework for expanding to the national-level to inform the EHE.


title: Revealing the disk-circumgalactic medium transition with emission mapping

abstract: Most of a galaxy's mass is located out to hundreds of kiloparsecs beyond its stellar component. This diffuse reservoir of gas, the circumgalactic medium (CGM), acts as the interface between a galaxy and the cosmic web that connects galaxies. We present kiloparsec-scale resolution integral field spectroscopy of emission lines that trace cool ionized gas from the center of a nearby galaxy to 30 kpc into its CGM. We find a smooth surface brightness profile with a break in slope at twice the 90% stellar radius. At this radius, the gas also transitions from being photoionized by HII star-forming regions in the disk to being ionized by shocks or the extragalactic UV background at larger distances. These changes represent the boundary between the interstellar medium (ISM) and the CGM, revealing the shape and extent of the dominant reservoir of baryonic matter in galaxies for the first time.


title: Asymmetric Ramsey properties of randomly perturbed graphs

abstract: In this note, we investigate for various pairs of graphs $(H,G)$ the question of how many random edges must be added to a dense graph to guarantee that any red-blue coloring of the edges contains a red copy of $H$ or a blue copy of $G$. We determine this perturbed Ramsey threshold for many new pairs of graphs and various ranges of densities, obtaining several generalizations of results obtained by Das and Treglown. In particular, we resolve the remaining cases toward determining the perturbed Ramsey threshold for pairs $(K_t,K_s)$ where $t\geq s\geq 5$.


title: SmoothHess: ReLU Network Feature Interactions via Stein's Lemma

abstract: Several recent methods for interpretability model feature interactions by looking at the Hessian of a neural network. This poses a challenge for ReLU networks, which are piecewise-linear and thus have a zero Hessian almost everywhere. We propose SmoothHess, a method of estimating second-order interactions through Stein's Lemma. In particular, we estimate the Hessian of the network convolved with a Gaussian through an efficient sampling algorithm, requiring only network gradient calls. SmoothHess is applied post-hoc, requires no modifications to the ReLU network architecture, and the extent of smoothing can be controlled explicitly. We provide a non-asymptotic bound on the sample complexity of our estimation procedure. We validate the superior ability of SmoothHess to capture interactions on benchmark datasets and a real-world medical spirometry dataset.


title: Optimal Cost Constrained Adversarial Attacks For Multiple Agent Systems

abstract: Finding optimal adversarial attack strategies is an important topic in reinforcement learning and the Markov decision process. Previous studies usually assume one all-knowing coordinator (attacker) for whom attacking different recipient (victim) agents incurs uniform costs. However, in reality, instead of using one limitless central attacker, the attacks often need to be performed by distributed attack agents. We formulate the problem of performing optimal adversarial agent-to-agent attacks using distributed attack agents, in which we impose distinct cost constraints on each different attacker-victim pair. We propose an optimal method integrating within-step static constrained attack-resource allocation optimization and between-step dynamic programming to achieve the optimal adversarial attack in a multi-agent system. Our numerical results show that the proposed attacks can significantly reduce the rewards received by the attacked agents.


title: Zero Coordinate Shift: Whetted Automatic Differentiation for Physics-informed Operator Learning

abstract: Automatic differentiation (AD) is a critical step in physics-informed machine learning, required for computing the high-order derivatives of network output w.r.t. coordinates of collocation points. In this paper, we present a novel and lightweight algorithm to conduct AD for physics-informed operator learning, which we call the trick of Zero Coordinate Shift (ZCS). Instead of making all sampled coordinates as leaf variables, ZCS introduces only one scalar-valued leaf variable for each spatial or temporal dimension, simplifying the wanted derivatives from "many-roots-many-leaves" to "one-root-many-leaves" whereby reverse-mode AD becomes directly utilisable. It has led to an outstanding performance leap by avoiding the duplication of the computational graph along the dimension of functions (physical parameters). ZCS is easy to implement with current deep learning libraries; our own implementation is achieved by extending the DeepXDE package. We carry out a comprehensive benchmark analysis and several case studies, training physics-informed DeepONets to solve partial differential equations (PDEs) without data. The results show that ZCS has persistently reduced GPU memory consumption and wall time for training by an order of magnitude, and such reduction factor scales with the number of functions. As a low-level optimisation technique, ZCS imposes no restrictions on data, physics (PDE) or network architecture and does not compromise training results from any aspect.

categories: cs.LG cs.AI cs.NA math.NA physics.comp-ph


title: The HAWC ultra-high-energy gamma-ray map with more than 5 years of data

abstract: In 2020, the HAWC Collaboration presented the first catalog of gamma-ray sources emitting above 56 TeV and 100 TeV. With nine sources detected, this was the highest-energy source catalog to date. Here, we present the results of re-analysis of the old data, along with additional data acquired since then. We use a new version of the reconstruction software with better pointing accuracy and improved gamma/hadron separation. We now see more than 25 sources above 56 TeV, with most sources being located in the Galactic plane. The vast majority of these seem to be leptonic pulsar wind nebulae, but some have been shown to have hadronic emission. We will show spectra and discuss possible emission mechanisms of some of the most interesting sources, including the ones the HAWC Collaboration considers PeVatron candidates.


title: Role of Structural and Conformational Diversity for Machine Learning Potentials

abstract: In the field of Machine Learning Interatomic Potentials (MLIPs), understanding the intricate relationship between data biases, specifically conformational and structural diversity, and model generalization is critical in improving the quality of Quantum Mechanics (QM) data generation efforts. We investigate these dynamics through two distinct experiments: a fixed budget one, where the dataset size remains constant, and a fixed molecular set one, which focuses on fixed structural diversity while varying conformational diversity. Our results reveal nuanced patterns in generalization metrics. Notably, for optimal structural and conformational generalization, a careful balance between structural and conformational diversity is required, but existing QM datasets do not meet that trade-off. Additionally, our results highlight the limitation of the MLIP models at generalizing beyond their training distribution, emphasizing the importance of defining applicability domain during model deployment. These findings provide valuable insights and guidelines for QM data generation efforts.


title: Training Dynamics of Contextual N-Grams in Language Models

abstract: Prior work has shown the existence of contextual neurons in language models, including a neuron that activates on German text. We show that this neuron exists within a broader contextual n-gram circuit: we find late layer neurons which recognize and continue n-grams common in German text, but which only activate if the German neuron is active. We investigate the formation of this circuit throughout training and find that it is an example of what we call a second-order circuit. In particular, both the constituent n-gram circuits and the German detection circuit which culminates in the German neuron form with independent functions early in training - the German detection circuit partially through modeling German unigram statistics, and the n-grams by boosting appropriate completions. Only after both circuits have already formed do they fit together into a second-order circuit. Contrary to the hypotheses presented in prior work, we find that the contextual n-gram circuit forms gradually rather than in a sudden phase transition. We further present a range of anomalous observations such as a simultaneous phase transition in many tasks coinciding with the learning rate warm-up, and evidence that many context neurons form simultaneously early in training but are later unlearned.


title: A model independent description of $B\rightarrow D \pi \ell \nu$ decays

abstract: We introduce a new parameterization of $B\rightarrow D \pi \ell \nu$ form factors using a partial-wave expansion and derive bounds on the series coefficients using analyticity and unitarity. This is the first generalization of the model-independent formalism developed by Boyd, Grinstein, and Lebed for $B \to D \ell \nu$ to semileptonic decays with multi-hadron final states, and enables data-driven form factor determinations with robust, systematically-improvable uncertainties. Using this formalism, we extract the form-factor parameters for $B \to D_2^\ast(\to D\pi) \ell \nu$ decays in a model-independent way from fits of data from the Belle Experiment, and, for the first time, study the two-pole structure in the $D\pi$ S-wave in semileptonic decays employing lineshapes from unitarized chiral perturbation theory.


title: Selectively Sharing Experiences Improves Multi-Agent Reinforcement Learning

abstract: We present a novel multi-agent RL approach, Selective Multi-Agent Prioritized Experience Relay, in which agents share with other agents a limited number of transitions they observe during training. The intuition behind this is that even a small number of relevant experiences from other agents could help each agent learn. Unlike many other multi-agent RL algorithms, this approach allows for largely decentralized training, requiring only a limited communication channel between agents. We show that our approach outperforms baseline no-sharing decentralized training and state-of-the art multi-agent RL algorithms. Further, sharing only a small number of highly relevant experiences outperforms sharing all experiences between agents, and the performance uplift from selective experience sharing is robust across a range of hyperparameters and DQN variants. A reference implementation of our algorithm is available at https://github.com/mgerstgrasser/super.


title: Generalizing Nonlinear ICA Beyond Structural Sparsity

abstract: Nonlinear independent component analysis (ICA) aims to uncover the true latent sources from their observable nonlinear mixtures. Despite its significance, the identifiability of nonlinear ICA is known to be impossible without additional assumptions. Recent advances have proposed conditions on the connective structure from sources to observed variables, known as Structural Sparsity, to achieve identifiability in an unsupervised manner. However, the sparsity constraint may not hold universally for all sources in practice. Furthermore, the assumptions of bijectivity of the mixing process and independence among all sources, which arise from the setting of ICA, may also be violated in many real-world scenarios. To address these limitations and generalize nonlinear ICA, we propose a set of new identifiability results in the general settings of undercompleteness, partial sparsity and source dependence, and flexible grouping structures. Specifically, we prove identifiability when there are more observed variables than sources (undercomplete), and when certain sparsity and/or source independence assumptions are not met for some changing sources. Moreover, we show that even in cases with flexible grouping structures (e.g., part of the sources can be divided into irreducible independent groups with various sizes), appropriate identifiability results can also be established. Theoretical claims are supported empirically on both synthetic and real-world datasets.


title: Automatic Disfluency Detection from Untranscribed Speech

abstract: Speech disfluencies, such as filled pauses or repetitions, are disruptions in the typical flow of speech. Stuttering is a speech disorder characterized by a high rate of disfluencies, but all individuals speak with some disfluencies and the rates of disfluencies may by increased by factors such as cognitive load. Clinically, automatic disfluency detection may help in treatment planning for individuals who stutter. Outside of the clinic, automatic disfluency detection may serve as a pre-processing step to improve natural language understanding in downstream applications. With this wide range of applications in mind, we investigate language, acoustic, and multimodal methods for frame-level automatic disfluency detection and categorization. Each of these methods relies on audio as an input. First, we evaluate several automatic speech recognition (ASR) systems in terms of their ability to transcribe disfluencies, measured using disfluency error rates. We then use these ASR transcripts as input to a language-based disfluency detection model. We find that disfluency detection performance is largely limited by the quality of transcripts and alignments. We find that an acoustic-based approach that does not require transcription as an intermediate step outperforms the ASR language approach. Finally, we present multimodal architectures which we find improve disfluency detection performance over the unimodal approaches. Ultimately, this work introduces novel approaches for automatic frame-level disfluency and categorization. In the long term, this will help researchers incorporate automatic disfluency detection into a range of applications.


title: Towards a complete classification of 6D supergravities

abstract: The constraints arising from anomaly cancellation are particular strong for chiral theories in six dimensions. We make progress towards a complete classification of 6D supergravities with minimal supersymmetry and non-abelian gauge group. First, we generalize a previously known infinite class of anomaly-free theories which has $T\gg 9$ to essentially any semi-simple gauge group and infinitely many choices for hypermultiplets. The construction relies on having many decoupled sectors all selected from a list of four simple theories which we identify. Second, we use ideas from graph theory to rephrase the task of finding anomaly-free theories as constructing cliques in a certain multigraph. A branch-and-bound type algorithm is described which can be used to explicitly construct, in a $T$-independent way, anomaly-free theories with an arbitrary number of simple factors in the gauge group. We implement these ideas to generate an ensemble of $\mathcal{O}(10^7)$ irreducible cliques from which anomaly-free theories may be easily built, and as a special case obtain a complete list of $19,\!847$ consistent theories for $T=0$, for which the maximal gauge group rank is $24$. Modulo the new infinite families, we give a complete characterization of anomaly-free theories and show that the bound $T\leq 273$ is sharp.


title: Scaling Frustration Index and Corresponding Balanced State Discovery for Real Signed Graphs

abstract: Structural balance modeling for signed graph networks presents how to model the sources of conflicts. The state-of-the-art has focused on computing the frustration index of a signed graph as a critical step toward solving problems in social and sensor networks and for scientific modeling. However, the proposed approaches do not scale to modern large, sparse signed networks. Also, they do not address that there is more than one way in some networks to reach a consensus with the minimum number of edge-sign switches needed. We propose an efficient balanced state discovery algorithm and a network frustration computation that will discover the nearest balanced state for the \emph{any} size of the graph network and compute the frustration of the network. The speedup of the proposed method is around 300 times faster than the state-of-the-art for signed graphs with hundreds of thousands of edges. The technique successfully scales to find the balanced states and frustration of the networks with millions of nodes and edges in real time where state-of-the-art fails.


title: Characterization of the ambient background in the RED-100 experiment location at Kalinin Nuclear Power Plant

abstract: The RED-100 experiment with a liquid xenon target was carried out at Kalinin Nuclear Power Plant. The goal of the experiment is the detection and study of the coherent elastic neutrino nucleus scattering process (CE$\nu$NS) for the low-energy antineutrinos in close vicinity to a reactor core. A good understanding of the external radioactive background is needed to achieve this goal. This paper describes the external background conditions for the RED-100 experiment at Kalinin Nuclear Power Plant.


title: Pretraining Data Mixtures Enable Narrow Model Selection Capabilities in Transformer Models

abstract: Transformer models, notably large language models (LLMs), have the remarkable ability to perform in-context learning (ICL) -- to perform new tasks when prompted with unseen input-output examples without any explicit model training. In this work, we study how effectively transformers can bridge between their pretraining data mixture, comprised of multiple distinct task families, to identify and learn new tasks in-context which are both inside and outside the pretraining distribution. Building on previous work, we investigate this question in a controlled setting, where we study transformer models trained on sequences of $(x, f(x))$ pairs rather than natural language. Our empirical results show transformers demonstrate near-optimal unsupervised model selection capabilities, in their ability to first in-context identify different task families and in-context learn within them when the task families are well-represented in their pretraining data. However when presented with tasks or functions which are out-of-domain of their pretraining data, we demonstrate various failure modes of transformers and degradation of their generalization for even simple extrapolation tasks. Together our results highlight that the impressive ICL abilities of high-capacity sequence models may be more closely tied to the coverage of their pretraining data mixtures than inductive biases that create fundamental generalization capabilities.


title: Algebraic classification of 2+1 geometries: a new approach

abstract: We present a convenient method of algebraic classification of 2+1 spacetimes into the types I, II, D, III, N and O, without using any field equations. It is based on the 2+1 analogue of the Newman-Penrose curvature scalars $\Psi_A$ of distinct boost weights, which are specific projections of the Cotton tensor onto a suitable null triad. The algebraic types are then simply determined by the gradual vanishing of such Cotton scalars, starting with those of the highest boost weight. This classification is directly related to the specific multiplicity of the Cotton-aligned null directions (CANDs) and to the corresponding Bel-Debever criteria. Using a bivector (that is 2-form) decomposition, we demonstrate that our method is fully equivalent to the usual Petrov-type classification of 2+1 spacetimes based on the eigenvalue problem and determining the respective canonical Jordan form of the Cotton-York tensor. We also derive a simple synoptic algorithm of algebraic classification based on the key polynomial curvature invariants. To show the practical usefulness of our approach, we perform the classification of several explicit examples, namely the general class of Robinson-Trautman spacetimes with an aligned electromagnetic field and a cosmological constant, and other metrics of various algebraic types.


title: Low-latency Real-time Voice Conversion on CPU

abstract: We adapt the architectures of previous audio manipulation and generation neural networks to the task of real-time any-to-one voice conversion. Our resulting model, LLVC ($\textbf{L}$ow-latency $\textbf{L}$ow-resource $\textbf{V}$oice $\textbf{C}$onversion), has a latency of under 20ms at a bitrate of 16kHz and runs nearly 2.8x faster than real-time on a consumer CPU. LLVC uses both a generative adversarial architecture as well as knowledge distillation in order to attain this performance. To our knowledge LLVC achieves both the lowest resource usage as well as the lowest latency of any open-source voice conversion model. We provide open-source samples, code, and pretrained model weights at https://github.com/KoeAI/LLVC.


title: Huber Loss-Based Penalty Approach to Problems with Linear Constraints

abstract: We consider a convex optimization problem with many linear inequality constraints. To deal with a large number of constraints, we provide a penalty reformulation of the problem, where the penalty is a variant of the one-sided Huber loss function with two penalty parameters. We study the infeasibility properties of the solutions of penalized problems for nonconvex and convex objective functions, as the penalty parameters vary with time. Then, we propose a random incremental penalty method for solving the original problem, and investigate its convergence properties for convex and strongly convex objective functions. We show that the iterates of the method converge to a solution of the original problem almost surely and in expectation for suitable choices of the penalty parameters and the stepsize. Also, we establish convergence rate of the method in terms of the expected function values by utilizing appropriately defined weighted averages of the iterates. We show $O(\ln^{1/2+\epsilon} k/{\sqrt k})$-convergence rate when the objective function is convex and $O(\ln^{\epsilon} k/k)$-convergence rate when the objective function is strongly convex, with $\epsilon>0$ being an arbitrarily small scalar. } To the best of our knowledge, these are the first results on the convergence rate for the penalty-based incremental subgradient method with time-varying penalty parameters.


title: Learning Collective Behaviors from Observation

abstract: We present a comprehensive examination of learning methodologies employed for the structural identification of dynamical systems. These techniques are designed to elucidate emergent phenomena within intricate systems of interacting agents. Our approach not only ensures theoretical convergence guarantees but also exhibits computational efficiency when handling high-dimensional observational data. The methods adeptly reconstruct both first- and second-order dynamical systems, accommodating observation and stochastic noise, intricate interaction rules, absent interaction features, and real-world observations in agent systems. The foundational aspect of our learning methodologies resides in the formulation of tailored loss functions using the variational inverse problem approach, inherently equipping our methods with dimension reduction capabilities.


title: Channel Estimation for Reconfigurable Intelligent Surface MIMO with Tensor Signal Modelling

abstract: We consider a narrowband MIMO reconfigurable intelligent surface (RIS)-assisted wireless communication system and use tensor signal modelling techniques to individually estimate all communication channels including the non-RIS channels (direct path) and decoupled RIS channels. We model the received signal as a third-order tensor composed of two CANDECOMP/PARAFAC decomposition terms for the non-RIS and the RIS-assisted links, respectively, and we propose two channel estimation methods based on an iterative alternating least squares (ALS) algorithm: The two-stage RIS OFF-ON method estimates each of the non-RIS and RIS-assisted terms in two pilot training stages, whereas the enhanced alternating least squares (E-ALS) method improves upon the ALS algorithm to jointly estimate all channels over the full training duration. A key benefit of both methods compared to the traditional least squares (LS) solution is that they exploit the structure of the tensor model to obtain decoupled estimates of all communication channels. We provide the computational complexities to obtain each of the channel estimates for our two proposed methods. Numerical simulations are used to evaluate the accuracy and verify the computational complexities of the proposed two-stage RIS OFF-ON, and E-ALS, and compare them to the traditional LS methods. Results show that E-ALS will obtain the most accurate estimate while only having a slightly higher run-time than the two-stage method.


title: Addressing Stopping Failures for Small Set Flip Decoding of Hypergraph Product Codes

abstract: For a quantum error correcting code to be used in practice, it needs to be equipped with an efficient decoding algorithm, which identifies corrections given the observed syndrome of errors.Hypergraph product codes are a promising family of constant-rate quantum LDPC codes that have a linear-time decoding algorithm called Small-Set-Flip ($\texttt{SSF}$) (Leverrier, Tillich, Z\'emor FOCS 2015). The algorithm proceeds by iteratively applying small corrections which reduce the syndrome weight. Together, these small corrections can provably correct large errors for sufficiently large codes with sufficiently large (but constant) stabilizer weight. However, this guarantee does not hold for small codes with low stabilizer weight. In this case, $\texttt{SSF}$ can terminate with stopping failures, meaning it encounters an error for which it is unable to identify a small correction. We find that the structure of errors that cause stopping failures have a simple form for sufficiently small qubit failure rates. We propose a new decoding algorithm called the Projection-Along-a-Line ($\texttt{PAL}$) decoder to supplement $\texttt{SSF}$ after stopping failures. Using $\texttt{SSF}+\texttt{PAL}$ as a combined decoder, we find an order-of-magnitude improvement in the logical error rate.


title: Backward Joint Model for Dynamic Prediction using Multivariate Longitudinal and Competing Risk Data

abstract: Joint modeling is a useful approach to dynamic prediction of clinical outcomes using longitudinally measured predictors. When the outcomes are competing risk events, fitting the conventional shared random effects joint model often involves intensive computation, especially when multiple longitudinal biomarkers are be used as predictors, as is often desired in prediction problems. Motivated by a longitudinal cohort study of chronic kidney disease, this paper proposes a new joint model for the dynamic prediction of end-stage renal disease with the competing risk of death. The model factorizes the likelihood into the distribution of the competing risks data and the distribution of longitudinal data given the competing risks data. The estimation with the EM algorithm is efficient, stable and fast, with a one-dimensional integral in the E-step and convex optimization for most parameters in the M-step, regardless of the number of longitudinal predictors. The model also comes with a consistent albeit less efficient estimation method that can be quickly implemented with standard software, ideal for model building and diagnotics. This model enables the prediction of future longitudinal data trajectories conditional on being at risk at a future time, a practically significant problem that has not been studied in the statistical literature. We study the properties of the proposed method using simulations and a real dataset and compare its performance with the shared random effects joint model.


title: Generation of Strong Fields to Study the Phase Transitions of Magnetized Warm Dense Matter

abstract: Warm dense matter is a regime where Fermi degenerate electrons take an important role in the macroscopic properties of a material. While recent experiments hinged us closer to better understanding the unmagnetized processes in such dense materials, their magnetized counterpart has been more difficult to study since kilo-Tesla order magnetic fields are required. Although there are examples of field compression generating such fields by compressing pre-magnetized targets, this approach uses a closed configuration, where a converging liner compresses the magnetic flux dynamically. The plasma produced to compress the field is so dense that the fast-heating laser beam required to form warm dense matter cannot penetrate where the field is the highest. In this paper, numerical simulations are used to show that magnetic field compression is also possible by shining the laser beams onto the inner surface of the target, rather than on the outer surface. This approach relies on field compression done by a low-density high-temperature plasma, rather than a high-density low-temperature plasma, used in the more conventional approach. With this novel configuration, the region of the large magnetic field is now mostly free of plasma so the heating beam can reach the sample, located where the magnetic field is the strongest.


title: SCPO: Safe Reinforcement Learning with Safety Critic Policy Optimization

abstract: Incorporating safety is an essential prerequisite for broadening the practical applications of reinforcement learning in real-world scenarios. To tackle this challenge, Constrained Markov Decision Processes (CMDPs) are leveraged, which introduce a distinct cost function representing safety violations. In CMDPs' settings, Lagrangian relaxation technique has been employed in previous algorithms to convert constrained optimization problems into unconstrained dual problems. However, these algorithms may inaccurately predict unsafe behavior, resulting in instability while learning the Lagrange multiplier. This study introduces a novel safe reinforcement learning algorithm, Safety Critic Policy Optimization (SCPO). In this study, we define the safety critic, a mechanism that nullifies rewards obtained through violating safety constraints. Furthermore, our theoretical analysis indicates that the proposed algorithm can automatically balance the trade-off between adhering to safety constraints and maximizing rewards. The effectiveness of the SCPO algorithm is empirically validated by benchmarking it against strong baselines.


title: On the generating function and growth of the positive singular braid monoid

abstract: We prove that the generating function of the positive singular braid monoid is rational and we give the exact formula for such monoid on three strands.


title: Semidefinite programming and linear equations vs. homomorphism problems

abstract: We introduce a relaxation for homomorphism problems that combines semidefinite programming with linear Diophantine equations, and propose a framework for the analysis of its power based on the spectral theory of association schemes. We use this framework to establish an unconditional lower bound against the semidefinite programming + linear equations model, by showing that the relaxation does not solve the approximate graph homomorphism problem and thus, in particular, the approximate graph colouring problem.


title: Improving the accuracy and scalability of large-scale physics-based data-driven reduced modeling via domain decomposition

abstract: This paper focuses on the construction of accurate and predictive data-driven reduced models of large-scale numerical simulations with complex dynamics and sparse training data sets. In these settings, standard, single-domain approaches may be too inaccurate or may overfit and hence generalize poorly. Moreover, processing large-scale data sets typically requires significant memory and computing resources which can render single-domain approaches computationally prohibitive. To address these challenges, we introduce a domain decomposition formulation into the construction of a data-driven reduced model. In doing so, the basis functions used in the reduced model approximation become localized in space, which can increase the accuracy of the domain-decomposed approximation of the complex dynamics. The decomposition furthermore reduces the memory and computing requirements to process the underlying large-scale training data set. We demonstrate the effectiveness and scalability of our approach in a large-scale three-dimensional unsteady rotating detonation rocket engine simulation scenario with over $75$ million degrees of freedom and a sparse training data set. Our results show that compared to the single-domain approach, the domain-decomposed version reduces both the training and prediction errors for pressure by up to $13 \%$ and up to $5\%$ for other key quantities, such as temperature, and fuel and oxidizer mass fractions. Lastly, our approach decreases the memory requirements for processing by almost a factor of four, which in turn reduces the computing requirements as well.


title: Predictive Optimization of Hybrid Energy Systems with Temperature Dependency

abstract: Hybrid Energy Systems (HES), amalgamating renewable sources, energy storage, and conventional generation, have emerged as a responsive resource for providing valuable grid services. Subsequently, modeling and analysis of HES has become critical, and the quality of grid services hedges on it. Currently, most HES models are temperature-agnostic. However, the temperature-dependent factors can significantly impact HES performance, necessitating advanced modeling and optimization techniques. With the inclusion of temperature-dependent models, the challenges and complexity of solving optimization problem increases. In this paper, the electro-thermal modeling of HES is discussed. Based on this model, a nonlinear predictive optimization framework is formulated. A simplified model is developed to address the challenges associated with solving nonlinear problems. Further, projection and homotopy approaches are proposed. In the homotopy method, the NLP is solved by incrementally changing the C-rating of the battery. Simulation-based analysis of the algorithms highlights the effects of different battery ratings, ambient temperatures, and energy price variations. Finally, comparative assessments with a temperature-agnostic approach illustrates the effectiveness of electro-thermal methods in optimizing HES.


title: Controlling the number of significant effects in multiple testing

abstract: In multiple testing several criteria to control for type I errors exist. The false discovery rate, which evaluates the expected proportion of false discoveries among the rejected null hypotheses, has become the standard approach in this setting. However, false discovery rate control may be too conservative when the effects are weak. In this paper we alternatively propose to control the number of significant effects, where 'significant' refers to a pre-specified threshold $\gamma$. This means that a $(1-\alpha)$-lower confidence bound $L$ for the number of non-true null hypothesis with p-values below $\gamma$ is provided. When one rejects the nulls corresponding to the $L$ smallest p-values, the probability that the number of false positives exceeds the number of false negatives among the significant effects is bounded by $\alpha$. Relative merits of the proposed criterion are discussed. Procedures to control for the number of significant effects in practice are introduced and investigated both theoretically and through simulations. Illustrative real data applications are given.


title: COSTAR: Improved Temporal Counterfactual Estimation with Self-Supervised Learning

abstract: Estimation of temporal counterfactual outcomes from observed history is crucial for decision-making in many domains such as healthcare and e-commerce, particularly when randomized controlled trials (RCTs) suffer from high cost or impracticality. For real-world datasets, modeling time-dependent confounders is challenging due to complex dynamics, long-range dependencies and both past treatments and covariates affecting the future outcomes. In this paper, we introduce Counterfactual Self-Supervised Transformer (COSTAR), a novel approach that integrates self-supervised learning for improved historical representations. We propose a component-wise contrastive loss tailored for temporal treatment outcome observations and explain its effectiveness from the view of unsupervised domain adaptation. COSTAR yields superior performance in estimation accuracy and generalization to out-of-distribution data compared to existing models, as validated by empirical results on both synthetic and real-world datasets.


title: Centralized Management of a Wifi Mesh for Autonomous Farms

abstract: Emerging autonomous farming techniques rely on smart devices such as multi-spectral cameras, collecting fine-grained data, and robots performing tasks such as de-weeding, berry-picking, etc. These techniques require a high throughput network, supporting 10s of Mbps per device at the scale of tens to hundreds of devices in a large farm. We conduct a survey across 12 agronomists to understand these networking requirements of farm workloads and perform extensive measurements of WiFi 6 performance in a farm to identify the challenges in meeting them. Our measurements reveal how network capacity is fundamentally limited in such a setting, with severe degradation in network performance due to crop canopy, and spotlight farm networks as an emerging new problem domain that can benefit from smarter network resource management decisions. To that end, we design Cornet, a network for supporting on-farm applications that comprises: (i) a multi-hop mesh of WiFi routers that uses a strategic combination of 2.4GHz and 5GHz bands as informed by our measurements, and (ii) a centralized traffic engineering (TE) system that uses a novel abstraction of resource units to reason about wireless network capacity and make TE decisions (schedule flows, assign flow rates, and select routes and channels). Our evaluation, using testbeds in a farm and trace-driven simulations, shows how Cornet achieves 1.4 $\times$ higher network utilization and better meets application demands, compared to standard wireless mesh strategies.


title: A robust shape model for blood vessels analysis

abstract: The availability of digital twins for the cardiovascular system will enable insightful computational tools both for research and clinical practice. This, however, demands robust and well defined models and methods for the different steps involved in the process. We present a vessel coordinate system (VCS) that enables the unanbiguous definition of locations in a vessel section, by adapting the idea of cylindrical coordinates to the vessel geometry. Using the VCS model, point correspondence can be defined among different samples of a cohort, allowing data transfer, quantitative comparison, shape coregistration or population analysis. Furthermore, the VCS model allows for the generation of specific meshes (e.g. cylindrical grids, ogrids) necessary for an accurate reconstruction of the geometries used in fluid simulations. We provide the technical details for coordinates computation and discuss the assumptions taken to guarantee that they are well defined. The VCS model is tested in a series of applications. We present a robust, low dimensional, patient specific vascular model and use it to study phenotype variability analysis of the thoracic aorta within a cohort of patients. Point correspondence is exploited to build an haemodynamics atlas of the aorta for the same cohort. The atlas originates from fluid simulations (Navier-Stokes with Finite Volume Method) conducted using OpenFOAMv10. We finally present a relevant discussion on the VCS model, which covers its impact in important areas such as shape modeling and computer fluids dynamics (CFD).


title: Generate and Pray: Using SALLMS to Evaluate the Security of LLM Generated Code

abstract: With the growing popularity of Large Language Models (LLMs) in software engineers' daily practices, it is important to ensure that the code generated by these tools is not only functionally correct but also free of vulnerabilities. Although LLMs can help developers to be more productive, prior empirical studies have shown that LLMs can generate insecure code. There are two contributing factors to the insecure code generation. First, existing datasets used to evaluate LLMs do not adequately represent genuine software engineering tasks sensitive to security. Instead, they are often based on competitive programming challenges or classroom-type coding tasks. In real-world applications, the code produced is integrated into larger codebases, introducing potential security risks. Second, existing evaluation metrics primarily focus on the functional correctness of the generated code while ignoring security considerations. Therefore, in this paper, we described SALLM, a framework to benchmark LLMs' abilities to generate secure code systematically. This framework has three major components: a novel dataset of security-centric Python prompts, configurable assessment techniques to evaluate the generated code, and novel metrics to evaluate the models' performance from the perspective of secure code generation.


title: Online Combinatorial Assignment in Independence Systems

abstract: We consider an online multi-weighted generalization of several classic online optimization problems, called the online combinatorial assignment problem. We are given an independence system over a ground set of elements and agents that arrive online one by one. Upon arrival, each agent reveals a weight function over the elements of the ground set. If the independence system is given by the matchings of a hypergraph we recover the combinatorial auction problem, where every node represents an item to be sold, and every edge represents a bundle of items. For combinatorial auctions, Kesselheim et al. showed upper bounds of O(loglog(k)/log(k)) and $O(\log \log(n)/\log(n))$ on the competitiveness of any online algorithm, even in the random order model, where $k$ is the maximum bundle size and $n$ is the number of items. We provide an exponential improvement on these upper bounds to show that the competitiveness of any online algorithm in the prophet IID setting is upper bounded by $O(\log(k)/k)$, and $O(\log(n)/\sqrt{n})$. Furthermore, using linear programming, we provide new and improved guarantees for the $k$-bounded online combinatorial auction problem (i.e., bundles of size at most $k$). We show a $(1-e^{-k})/k$-competitive algorithm in the prophet IID model, a $1/(k+1)$-competitive algorithm in the prophet-secretary model using a single sample per agent, and a $k^{-k/(k-1)}$-competitive algorithm in the secretary model. Our algorithms run in polynomial time and work in more general independence systems where the offline combinatorial assignment problem admits the existence of a polynomial-time randomized algorithm that we call certificate sampler. We show that certificate samplers have a nice interplay with random order models, and we also provide new polynomial-time competitive algorithms for some classes of matroids, matroid intersections, and matchoids.


title: Everlasting interaction: polarization summation without a Landau pole

abstract: We propose an external field approach to evaluating effective action allowing the interaction to act everywhere at all times (everlasting). Requiring that the asymptotic gauge fields are always-interacting, we implement displacement fields encoding polarization corrections into the derivation of effective action. The result is a novel polarization summation for one-cut reducible loop diagrams, which can be applied to two cases: transient quasi-constant electromagnetic fields, and everlasting interactions. In the first case, a perturbative expansion of our result recovers the Schwinger-Dyson reducible diagram series with a Landau pole. The everlasting summation evaluated in nonperturbative fashion removes the Landau pole, providing a new avenue for modeling strongly interacting theories.


title: A PTAS for $\ell_0$-Low Rank Approximation: Solving Dense CSPs over Reals

abstract: We consider the Low Rank Approximation problem, where the input consists of a matrix $A \in \mathbb{R}^{n_R \times n_C}$ and an integer $k$, and the goal is to find a matrix $B$ of rank at most $k$ that minimizes $\| A - B \|_0$, which is the number of entries where $A$ and $B$ differ. For any constant $k$ and $\varepsilon > 0$, we present a polynomial time $(1 + \varepsilon)$-approximation time for this problem, which significantly improves the previous best $poly(k)$-approximation. Our algorithm is obtained by viewing the problem as a Constraint Satisfaction Problem (CSP) where each row and column becomes a variable that can have a value from $\mathbb{R}^k$. In this view, we have a constraint between each row and column, which results in a {\em dense} CSP, a well-studied topic in approximation algorithms. While most of previous algorithms focus on finite-size (or constant-size) domains and involve an exhaustive enumeration over the entire domain, we present a new framework that bypasses such an enumeration in $\mathbb{R}^k$. We also use tools from the rich literature of Low Rank Approximation in different objectives (e.g., $\ell_p$ with $p \in (0, \infty)$) or domains (e.g., finite fields/generalized Boolean). We believe that our techniques might be useful to study other real-valued CSPs and matrix optimization problems. On the hardness side, when $k$ is part of the input, we prove that Low Rank Approximation is NP-hard to approximate within a factor of $\Omega(\log n)$. This is the first superconstant NP-hardness of approximation for any $p \in [0, \infty]$ that does not rely on stronger conjectures (e.g., the Small Set Expansion Hypothesis).


title: High-Temperature Effects for Transition State Calculations in Solids

abstract: Transition state calculation is a critical technique to understand and predict versatile dynamical phenomena in solids. However, the transition state results obtained at zero Kelvin are often utilized for prediction or interpretation of dynamical processes at high temperatures, and the error bars of such approximation are largely unknown. In this benchmark study, all the major temperature effects including lattice expansion, lattice vibration, electron excitation, and band-edge shift are evaluated with first-principles calculations for defects diffusion in solids. With inclusion of these temperature effects, the notable discrepancies between theoretical predictions at zero Kelvin and the experimental diffusivities at high temperatures are dramatically reduced. Particularly, we find that the lattice expansion and lattice vibration are dominant factors lowering the defect formation energies and hopping barriers at high temperatures, but the electron excitation exhibits minor effects. In sharp contrast to typical assumption, the attempt frequency with lattice expansion and vibration varies significantly with materials: several THz for aluminum bulk but surprisingly over 500 THz for 4H-SiC. For defects in semiconductors, the band-edge shift is also significant at high temperatures and plays a vital role in the defect diffusion. We expect this study would help accurately predict the dynamical processes at high temperatures.


title: Minimizing Convex Functionals over Space of Probability Measures via KL Divergence Gradient Flow

abstract: Motivated by the computation of the non-parametric maximum likelihood estimator (NPMLE) and the Bayesian posterior in statistics, this paper explores the problem of convex optimization over the space of all probability distributions. We introduce an implicit scheme, called the implicit KL proximal descent (IKLPD) algorithm, for discretizing a continuous-time gradient flow relative to the Kullback-Leibler divergence for minimizing a convex target functional. We show that IKLPD converges to a global optimum at a polynomial rate from any initialization; moreover, if the objective functional is strongly convex relative to the KL divergence, for example, when the target functional itself is a KL divergence as in the context of Bayesian posterior computation, IKLPD exhibits globally exponential convergence. Computationally, we propose a numerical method based on normalizing flow to realize IKLPD. Conversely, our numerical method can also be viewed as a new approach that sequentially trains a normalizing flow for minimizing a convex functional with a strong theoretical guarantee.


title: In-Context Prompt Editing For Conditional Audio Generation

abstract: Distributional shift is a central challenge in the deployment of machine learning models as they can be ill-equipped for real-world data. This is particularly evident in text-to-audio generation where the encoded representations are easily undermined by unseen prompts, which leads to the degradation of generated audio -- the limited set of the text-audio pairs remains inadequate for conditional audio generation in the wild as user prompts are under-specified. In particular, we observe a consistent audio quality degradation in generated audio samples with user prompts, as opposed to training set prompts. To this end, we present a retrieval-based in-context prompt editing framework that leverages the training captions as demonstrative exemplars to revisit the user prompts. We show that the framework enhanced the audio quality across the set of collected user prompts, which were edited with reference to the training captions as exemplars.


title: 21 cm Intensity Mapping with the DSA-2000

abstract: Line intensity mapping is a promising probe of the universe's large-scale structure. We explore the sensitivity of the DSA-2000, a forthcoming array consisting of over 2000 dishes, to the statistical power spectrum of neutral hydrogen's 21 cm emission line. These measurements would reveal the distribution of neutral hydrogen throughout the near-redshift universe without necessitating resolving individual sources. The success of these measurements relies on the instrument's sensitivity and resilience to systematics. We show that the DSA-2000 will have the sensitivity needed to detect the 21 cm power spectrum at z=0.5 and across power spectrum modes of 0.03-35.12 h/Mpc with 0.1 h/Mpc resolution. We find that supplementing the nominal array design with a dense core of 200 antennas will expand its sensitivity at low power spectrum modes and enable measurement of Baryon Acoustic Oscillations (BAOs). Finally, we present a qualitative discussion of the DSA-2000's unique resilience to sources of systematic error that can preclude 21 cm intensity mapping.


title: On The Open Prompt Challenge In Conditional Audio Generation

abstract: Text-to-audio generation (TTA) produces audio from a text description, learning from pairs of audio samples and hand-annotated text. However, commercializing audio generation is challenging as user-input prompts are often under-specified when compared to text descriptions used to train TTA models. In this work, we treat TTA models as a ``blackbox'' and address the user prompt challenge with two key insights: (1) User prompts are generally under-specified, leading to a large alignment gap between user prompts and training prompts. (2) There is a distribution of audio descriptions for which TTA models are better at generating higher quality audio, which we refer to as ``audionese''. To this end, we rewrite prompts with instruction-tuned models and propose utilizing text-audio alignment as feedback signals via margin ranking learning for audio improvements. On both objective and subjective human evaluations, we observed marked improvements in both text-audio alignment and music audio quality.


title: Crater Depth Prediction in Granular Collisions: A Uniaxial Compression Model

abstract: Impact crater experiments in granular media traditionally involve loosely packed sand targets. However, this study investigates granular impact craters on both loosely and more tightly packed sand targets. We report granular vs. granular experiments that consistently adhere to power-law scaling laws for diameter as a function of impacting energy, similar to those reported by other groups for their experiments utilizing both solid and granular projectiles. In contrast, we observe significant deviations in the depth vs. energy power-law predicted by previous models. To address this discrepancy, we introduce a physical model of uniaxial compression that explains how depth saturates in granular collisions. Furthermore, we present an energy balance alongside this model that aligns well with our crater volume measurements and describes the energy transfer mechanisms acting during crater formation. Central peak formation also plays an essential role in better transferring vertical momentum to horizontal degrees of freedom, resulting in shallow craters on compacted sandbox targets. Our results reveal a depth-to-diameter aspect ratio of approximately $\sim 1/5$, allowing us to interpret the shallowness of planetary craters in light of the uniaxial compression mechanism proposed in this work.


title: RoboVQA: Multimodal Long-Horizon Reasoning for Robotics

abstract: We present a scalable, bottom-up and intrinsically diverse data collection scheme that can be used for high-level reasoning with long and medium horizons and that has 2.2x higher throughput compared to traditional narrow top-down step-by-step collection. We collect realistic data by performing any user requests within the entirety of 3 office buildings and using multiple robot and human embodiments. With this data, we show that models trained on all embodiments perform better than ones trained on the robot data only, even when evaluated solely on robot episodes. We find that for a fixed collection budget it is beneficial to take advantage of cheaper human collection along with robot collection. We release a large and highly diverse (29,520 unique instructions) dataset dubbed RoboVQA containing 829,502 (video, text) pairs for robotics-focused visual question answering. We also demonstrate how evaluating real robot experiments with an intervention mechanism enables performing tasks to completion, making it deployable with human oversight even if imperfect while also providing a single performance metric. We demonstrate a single video-conditioned model named RoboVQA-VideoCoCa trained on our dataset that is capable of performing a variety of grounded high-level reasoning tasks in broad realistic settings with a cognitive intervention rate 46% lower than the zero-shot state of the art visual language model (VLM) baseline and is able to guide real robots through long-horizon tasks. The performance gap with zero-shot state-of-the-art models indicates that a lot of grounded data remains to be collected for real-world deployment, emphasizing the critical need for scalable data collection approaches. Finally, we show that video VLMs significantly outperform single-image VLMs with an average error rate reduction of 19% across all VQA tasks. Data and videos available at https://robovqa.github.io


title: LLRF System for the Fermilab PIP-II Superconducting LINAC

abstract: PIP-II is an 800 MEV superconducting linac that is in the initial acceleration chain for the Fermilab accelerator complex. The RF system consists of a warm front-end with an ion source, RFQ and buncher cavities along with 25 superconducting cryo-modules comprised of five different acceleration \(\beta\). The LLRF system for the LINAC has to provide field and resonance control for a total of 125 RF cavities.The LLRF system design is in the final design review phase and will enter the production phase next year. The PIP-II project is an international collaboration with various partner labs contributing subsystems. The LLRF system design for the PIP-II Linac is presented and the specification requirements and system performance in various stages of testing are described in this paper.


title: Closed Loop Testing of Microphonics Algorithms Using a Cavity Emulator

abstract: An analog crystal filter based cavity emulator is modified with reverse biased varactor diodes to provide a tuning range of around 160 Hz. The piezo drive voltage of the resonance controller is used to detune the cavity through the bias voltage. A signal conditioning and summing circuit allows the introduction of microphonics disturbance from a signal source or using real microphonics data from cavity testing. This setup is used in closed loop with a cavity controller and resonance controller to study the effectiveness of resonance control algorithms suitable for superconducting cavities.


title: Data-Driven Model Selections of Second-Order Particle Dynamics via Integrating Gaussian Processes with Low-Dimensional Interacting Structures

abstract: In this paper, we focus on the data-driven discovery of a general second-order particle-based model that contains many state-of-the-art models for modeling the aggregation and collective behavior of interacting agents of similar size and body type. This model takes the form of a high-dimensional system of ordinary differential equations parameterized by two interaction kernels that appraise the alignment of positions and velocities. We propose a Gaussian Process-based approach to this problem, where the unknown model parameters are marginalized by using two independent Gaussian Process (GP) priors on latent interaction kernels constrained to dynamics and observational data. This results in a nonparametric model for interacting dynamical systems that accounts for uncertainty quantification. We also develop acceleration techniques to improve scalability. Moreover, we perform a theoretical analysis to interpret the methodology and investigate the conditions under which the kernels can be recovered. We demonstrate the effectiveness of the proposed approach on various prototype systems, including the selection of the order of the systems and the types of interactions. In particular, we present applications to modeling two real-world fish motion datasets that display flocking and milling patterns up to 248 dimensions. Despite the use of small data sets, the GP-based approach learns an effective representation of the nonlinear dynamics in these spaces and outperforms competitor methods.

categories: stat.ML cs.LG cs.NA math.NA math.ST stat.TH


title: Artificial Intelligence Ethics Education in Cybersecurity: Challenges and Opportunities: a focus group report

abstract: The emergence of AI tools in cybersecurity creates many opportunities and uncertainties. A focus group with advanced graduate students in cybersecurity revealed the potential depth and breadth of the challenges and opportunities. The salient issues are access to open source or free tools, documentation, curricular diversity, and clear articulation of ethical principles for AI cybersecurity education. Confronting the "black box" mentality in AI cybersecurity work is also of the greatest importance, doubled by deeper and prior education in foundational AI work. Systems thinking and effective communication were considered relevant areas of educational improvement. Future AI educators and practitioners need to address these issues by implementing rigorous technical training curricula, clear documentation, and frameworks for ethically monitoring AI combined with critical and system's thinking and communication skills.


title: Disentangling transport mechanisms in a correlated oxide by photoinduced charge injection

abstract: We present a novel heterostructured approach to disentangle the mechanism of electrical transport of the strongly correlated PrNiO3, by placing the nickelate under the photoconductor CdS. This enables the injection of carriers into PrNiO3 in a controlled way, which can be used to interrogate its intrinsic transport mechanism. We find a non-volatile resistance decrease when illuminating the system at temperatures below the PrNiO3 metal-insulator transition. The photoinduced change becomes more volatile as the temperature increases. These data help understand the intrinsic transport properties of the nickelate-CdS bilayer. Together with data from a bare PrNiO3 film, we find that the transport mechanism includes a combination of mechanisms including both thermal activation and variable range hopping. At low temperatures without photoinduced carriers the transport is governed by hopping, while at higher temperatures and intense illumination the activation mechanism becomes relevant. This work shows a new way to optically control the low-temperature resistance of PrNiO3.


title: Data-driven fixed-point tuning for truncated realized variations

abstract: Many methods for estimating integrated volatility and related functionals of semimartingales in the presence of jumps require specification of tuning parameters for their use in practice. In much of the available theory, tuning parameters are assumed to be deterministic and their values are specified only up to asymptotic constraints. However, in empirical work and in simulation studies, they are typically chosen to be random and data-dependent, with explicit choices often relying entirely on heuristics. In this paper, we consider novel data-driven tuning procedures for the truncated realized variations of a semimartingale with jumps based on a type of random fixed-point iteration. Being effectively automated, our approach alleviates the need for delicate decision-making regarding tuning parameters in practice and can be implemented using information regarding sampling frequency alone. We show our methods can lead to asymptotically efficient estimation of integrated volatility and exhibit superior finite-sample performance compared to popular alternatives in the literature.


title: Re-weighting Tokens: A Simple and Effective Active Learning Strategy for Named Entity Recognition

abstract: Active learning, a widely adopted technique for enhancing machine learning models in text and image classification tasks with limited annotation resources, has received relatively little attention in the domain of Named Entity Recognition (NER). The challenge of data imbalance in NER has hindered the effectiveness of active learning, as sequence labellers lack sufficient learning signals. To address these challenges, this paper presents a novel reweighting-based active learning strategy that assigns dynamic smoothed weights to individual tokens. This adaptable strategy is compatible with various token-level acquisition functions and contributes to the development of robust active learners. Experimental results on multiple corpora demonstrate the substantial performance improvement achieved by incorporating our re-weighting strategy into existing acquisition functions, validating its practical efficacy.


title: New vector transport operators extending a Riemannian CG algorithm to generalized Stiefel manifold with low-rank applications

abstract: This paper proposes two innovative vector transport operators, leveraging the Cayley transform, for the generalized Stiefel manifold embedded with a non-standard metric. Specifically, it introduces the differentiated retraction and an approximation of the Cayley transform to the differentiated matrix exponential. These vector transports are demonstrated to satisfy the Ring-Wirth non-expansive condition under non-standard metrics, and one of them is also isometric. Building upon the novel vector transport operators, we extend the modified Polak-Ribi$\grave{e}$re-Polyak (PRP) conjugate gradient method to the generalized Stiefel manifold. Under a non-monotone line search condition, we prove our algorithm globally converges to a stationary point. The efficiency of the proposed vector transport operators is empirically validated through numerical experiments involving generalized eigenvalue problems and canonical correlation analysis.


title: How Real is Incomputability in Physics?

abstract: A physical system is determined by a finite set of initial conditions and "laws" represented by equations. The system is computable if we can solve the equations in all instances using a "finite body of mathematical knowledge". In this case, if the laws of the system can be coded into a computer program, then given the initial conditions of the system, one can compute the system's evolution. Are there incomputable physical systems? This question has been theoretically studied in the last 30-40 years. In this paper, we experimentally show for the first time the strong incomputability of a quantum experiment, namely the outputs of a quantum random number generator. Moreover, the experimental results are robust and statistically significant.


title: Planar Aerogel and Superfluid $^3$He, Structure and Transitions

abstract: Anisotropic aerogel possesses structure which exhibits a strong influence over the composition and orientation of the order parameter of imbibed superfluid $^3$He. Computational studies have identified stretched aerogel with plane-like structures and compressed aerogel with nematic-like structures. Studies of the B phase of superfluid $^3$He in stretched aerogel display an enhanced nuclear magnetic susceptibility likely caused by Andreev bound states near plane-like impurity sites. We report further details on the influence of these planar structures on both magnetic and orbital orientation transitions. The orbital orientation transitions appear in both the B and A phases of stretched and compressed aerogels. These transitions result from a crossover of the superfluid coherence length with long and short length scale structure with the coherence length and are consequently magnetic field independent. Additionally, the apparent temperature-independence of the susceptibility of the B phase equal to that of the A phase in stretched aerogel, is in marked contrast with the field dependence of the superfluid A to B phase transition, indicating that it is a near-isentropic transition.


title: Compact and accurate chemical mechanism for methane pyrolysis with PAH growth

abstract: A reliable and compact chemical mechanism of gas-phase methane pyrolysis leading to formation of large polycyclic aromatic hydrocarbon (PAH) molecules has been developed. This model is designed for studies of carbon nanostructure synthesis such as carbon black and graphene flakes, including soot growth kinetics. Methane pyrolysis with carbon nanostructure synthesis is a two-stage process where conversion of CH4 to C2H2 precedes the growth of PAH molecules from acetylene. We present a single chemical mechanism that accurately describes both stages. We have constructed a compact and accurate chemical mechanism capable of modeling both stages of methane pyrolysis based on the ABF mechanism which was expanded with most prominent reaction pathways from the mechanism by Tao for small PAH molecules and HACA pathways for larger PAH molecules, up to 37 aromatic rings. The resulting mechanism was validated through comparison to multiple available sets of experimental data. Good agreement with the experimental data for both processes was obtained. Performance of the mechanism was tested for pyrolysis of methane-rich mixtures under long residence times leading to abundant formation of PAH molecules. It is shown that the inclusion of larger PAH species (up to A37) in the chemical mechanism is important for accurate prediction of the fraction of carbon converted to PAH molecules and, correspondingly, residual fraction of acetylene in the mixture.


title: A Lightweight Routing Layer Using a Reliable Link-Layer Protocol

abstract: In today's data centers, the performance of interconnects plays a pivotal role. However, many of the underlying technologies for these interconnects have a history of several decades and existed long before data centers came into being.To better cater to the requirements of data center networks, particularly in the context of intra-rack communication, we have developed a new interconnect. This interconnect is based on a lossless link layer protocol, named RIFL. In this work, we designed and implemented RIFL Layer 2, a scalable network that supports up to multi-hundred Gbps communication. RIFL Layer 2 includes the RIFL switch and RIFL NIC. By utilizing a simple Batcher Banyan and iSLIP RIFL switch, we effectively keep the typical intra-rack latency under 400 nanoseconds. Moreover, for a 32-port 100Gbps network, under both Bernoulli arrival and bursty arrival traffic patterns, we ensure that the 99\% tail latency does not exceed 12microseconds.


title: Whitney-type estimates for convex functions

abstract: We study Whitney-type estimates for approximation of convex functions in the uniform norm on various convex multivariate domains while paying a particular attention to the dependence of the involved constants on the dimension and the geometry of the domain.


title: Self-Influence Guided Data Reweighting for Language Model Pre-training

abstract: Language Models (LMs) pre-trained with self-supervision on large text corpora have become the default starting point for developing models for various NLP tasks. Once the pre-training corpus has been assembled, all data samples in the corpus are treated with equal importance during LM pre-training. However, due to varying levels of relevance and quality of data, equal importance to all the data samples may not be the optimal choice. While data reweighting has been explored in the context of task-specific supervised learning and LM fine-tuning, model-driven reweighting for pre-training data has not been explored. We fill this important gap and propose PRESENCE, a method for jointly reweighting samples by leveraging self-influence (SI) scores as an indicator of sample importance and pre-training. PRESENCE promotes novelty and stability for model pre-training. Through extensive analysis spanning multiple model sizes, datasets, and tasks, we present PRESENCE as an important first step in the research direction of sample reweighting for pre-training language models.


title: Multifield tunable valley splitting in two-dimensional MXene Cr$_2$COOH

abstract: Manipulation of the valley degree of freedom provides a novel paradigm in quantum information technology. Here, through first-principles calculations and model analysis, we demonstrate that monolayer Cr$_2$COOH MXene is a promising candidate material for valleytronics applications. We reveal that Cr$_2$COOH is a ferromagnetic semiconductor and harbors valley features. Due to the simultaneous breaking inversion symmetry and time-reversal symmetry, the valleys are polarized spontaneously. Moreover, the valley polarization is sizeable in both the valence and conduction bands, benefiting the observation of the anomalous valley Hall effect. More remarkably, the valley splitting can be effectively tuned by the magnetization direction, strain and ferroelectric substrate. More interestingly, the ferroelectric substrate Sc$_2$CO$_2$ can not only regulate the MAE, but also tune valley polarization state. Our findings offer a practical way for realizing highly tunable valleys by multiferroic couplings.