title: Towards a sub-kelvin cryogenic Fabry-Perot silicon cavity

abstract: We report on the development of a sub-kelvin, single-crystal silicon Fabry-Perot cavity. Operating such a cavity below 1~K should reduce the thermal noise limit of the cavity, and by this way address the current limitations of ultrastable lasers. To further decrease mechanical losses, mirrors with silicon substrates and crystalline coatings are optically contacted to the spacer, resulting in a room-temperature finesse of 220,000. To operate our cavity at sub-kelvin temperatures, we use a dilution refrigerator able to reach temperatures down to 10 mK. We have designed a mechanical mount to house our cavity in such a cryostat, with optimized heat transfer that will decrease the cooldown time for temperatures below 1~K. The estimated thermal noise is projected to be $\sim 7{\times}10^{-19}$ at 100~mK. However, silicon cavities with crystalline mirror coatings at cryogenic temperatures have shown birefringence correlated frequency fluctuations as well as unknown additional noise mechanisms \cite{yu2023, kedar2023}. We have measured a room-temperature TEM$_{00}$ birefringent mode splitting of about 250 kHz. Understanding and measuring these noise mechanisms will be a key to attaining fractional frequency stabilities beyond state-of-the-art.


title: The need for accuracy and smoothness in numerical simulations

abstract: We consider the problem of estimating the error when solving a system of differential algebraic equations. Richardson extrapolation is a classical technique that can be used to judge when computational errors are irrelevant and estimate the discretization error. We have simulated molecular dynamics with constraints using the GROMACS library and found that the output is not always amenable to Richardson extrapolation. We derive and illustrate Richardson extrapolation using a variety of numerical experiments. We identify two necessary conditions that are not always satisfied by the GROMACS library.


title: Chiral edge transport along domain walls in magnetic topological insulator nanoribbons

abstract: Quantum anomalous Hall insulators are topologically characterized by non-zero integer Chern numbers, the sign of which depends on the direction of the exchange field that breaks time-reversal symmetry. This feature allows the manipulation of the conducting chiral edge states present at the interface of two magnetic domains with opposite magnetization and opposite Chern numbers. Motivated by this broad understanding, the present study investigates the quantum transport properties of a magnetized $Bi_2Se_3$ topological insulator nanoribbon with a domain wall oriented either parallel or perpendicular to the transport direction. Employing an atomistic tight-binding model and a non-equilibrium Green's function formalism, we calculate the quantum conductance and explore the nature of the edge states. We elucidate the conditions leading to exact conductance quantization and identify the origin of deviations from this behavior. Our analysis shows that although the conductance is quantized in the presence of the horizontal domain wall, the quantization is absent in the perpendicular domain wall case. Furthermore, the investigation of the spin character of the edge modes confirms that the conductance in the horizontal domain wall configuration is spin polarized. This finding underscores the potential of our system as a simple three dimensional spin-filter device.


title: A Tannakian framework for prismatic $F$-crystals

abstract: We develop the Tannakian theory of (analytic) prismatic $F$-crystals on a smooth formal scheme $\mathfrak{X}$ over the ring of integers of a discretely valued field with perfect residue field. Our main result gives an equivalence between the $\mathcal{G}$-objects of prismatic $F$-crystals on $\mathfrak{X}$ and $\mathcal{G}$-objects on a newly-defined category of $\mathbb{Z}_p$-local systems on $\mathfrak{X}_\eta$: those of prismatically good reduction. Additionally, we develop a shtuka realization functor for (analytic) prismatic $F$-crystals on $p$-adic (formal) schemes and show it satisfies several compatibilities with previous work on the Tannakian theory of shtukas over such objects.


title: Regularity of an FI-module via the derivative functor

abstract: We characterize the regularity of an FI-module using the derivative functors.


title: Low-mass stellar and substellar content of the young cluster Berkeley 59

abstract: We present a multi-wavelength analysis of the young star cluster Berkeley 59 (Be 59) based on the $Gaia$ data and deep infrared (IR) observations with the 3.58-m Telescopio Nazionale Galileo and $Spitzer$ space telescope. The mean proper motion of the cluster is found to be $\mu$$_\alpha$cos$\delta$ $\sim$ -0.63 mas yr$^{-1}$ and $\mu$$_\delta$ $\sim$ -1.83 mas yr$^{-1}$ and the kinematic distance of the cluster, $\sim$ 1 kpc, is in agreement with previous photometric studies. Present data is the deepest available near-IR observations for the cluster so far and reached below 0.03 M$_\odot$. The mass function of the cluster region is calculated using the statistically cleaned color-magnitude diagram and is similar to the Salpeter value for the member stars above 0.4 M$_\odot$. In contrast, the slope becomes shallower ($\Gamma$ $\sim$ 0.01 $\pm$ 0.18) in the mass range 0.04 - 0.4 M$_\odot$, comparable to other nearby clusters. The spatial distribution of young brown dwarfs (BDs) and stellar candidates shows a non-homogeneous distribution. This suggests that the radiation feedback from massive stars may be a prominent factor contributing to the BD population in the cluster Be 59. We also estimated the star-to-BD ratio for the cluster, which is found to be $\sim$ 3.6. The Kolomogorov-Smirnov test shows that stellar and BD populations significantly differ, and stellar candidates are near the cluster center compared to the BDs, suggesting mass segregation in the cluster toward the substellar mass regime.


title: Almost primes of the form $[p^{1/\gamma}]$

abstract: Let $\mathcal{P}_r$ denote an almost-prime with at most $r$ prime factors, counted according to multiplicity. In this paper, it is proved that, for $0.989<\gamma<1$, there exist infinitely many primes $p$ such that $[p^{1/\gamma}]=\mathcal{P}_7$, which constitutes an improvement upon the previous result of Banks-Guo-Shparlinski [4] who showed that there exist infinitely many primes $p$ such that $[p^{1/\gamma}]=\mathcal{P}_8$ for $\gamma$ near to one.


title: Electrically tunable and enhanced nonlinearity of moir\'e exciton-polaritons in transition metal dichalcogenide bilayers

abstract: We develop a microscopic theory for nonlinear optical response of moir\'e exciton-polaritons in bilayers of transition metal dichalcogenides (TMDs). Our theory allows to study the tunnel-coupled intralayer and interlayer excitonic modes for a wide range of twist angles ($\theta$), external electric field, and light-matter coupling, providing insights into the hybridization regime inaccessible before. Specifically, we account for the Umklapp scattering processes of two exciton-polaritons responsible for enhanced nonlinearity, and show that it is crucial for describing interactions at strong hybridization. We reveal a regime of attractive nonlinearity for moir\'e polaritons, stemming from the anisotropic Coulomb interactions, which can explain some of experimental features of optical response in TMD bilayers. Furthermore, within our theory we demonstrate that the attractive nonlinearity can be tuned into repulsive by applying an external electric field. Our findings show that nonlinear moir\'e polaritons offer a controllable platform nonlinear polaritonic devices.


title: Emergent spinon-holon Feshbach resonance in a doped Majumdar-Ghosh model

abstract: Experimental and numerical spectroscopy have revealed rich physics in antiferromagnets, in particular in frustrated and doped systems. The Majumdar-Ghosh (MG) model has an analytically known spin-disordered ground state of dimerized singlets as a result of magnetic frustration. Here we study the single-hole angle-resolved photoemission spectrum (ARPES) of a doped MG model, where we introduce a spin-hole interaction that is experimentally accessible with ultracold molecules. We report a bound spinon-holon ground state and clear signatures of a spinon-holon molecule state and polarons in the ARPES spectrum at different magnetizations. Moreover, we find signatures of an emergent Feshbach resonance with tunable interactions associated with the unbinding of the spinon and the holon. Our results provide new insights into the physics of dopants in frustrated $t$-$J$ models and establish the latter as a new platform for studies of emergent few-body phenomena.

categories: cond-mat.str-el cond-mat.quant-gas cond-mat.supr-con quant-ph


title: Protected gap closing and reopening in topological-insulator Josephson junctions

abstract: In the seminal proposal by Fu and Kane, the superconducting proximity effect was predicted to transform the surface state of a topological insulator (TI) into a topological superconductor, forming a nonchiral 1D Majorana state within a linear Josephson junction on the TI surface. The hallmark of this 1D Majorana state is a robust gap closing as a function of the superconducting phase difference $\varphi$ across the junction, which alternates in and out of the topological phase. These topological phase-transitions occur at $\varphi = (2n+1)\pi$ with integer $n$, leading to a $4\pi$-periodicity of the ground state. While the $4\pi$-periodicity has been indirectly inferred in the AC Josephson effect, the direct observation of the 1D Majorana state in a TI Josephson junction has remained contentious. Here, we report the direct observation of topological phase-transitions in a TI Josephson junction, where the local density of states is probed via tunnel contacts and $\varphi$ is controlled by a flux loop. The observed transitions are independent of the chemical potential, reinforcing their topological origin. Under an applied perpendicular magnetic field, Josephson vortices form, making $\varphi$ position-dependent. In this case, the gap closing occurs locally at the Josephson vortex cores where $\varphi = (2n+1)\pi$, which we also observe. Our findings provide direct confirmation of the Fu-Kane proposal and robust evidence for the emergence of topological superconductivity in a TI Josephson junction.

categories: cond-mat.supr-con cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el


title: Refining Self-Supervised Learnt Speech Representation using Brain Activations

abstract: It was shown in literature that speech representations extracted by self-supervised pre-trained models exhibit similarities with brain activations of human for speech perception and fine-tuning speech representation models on downstream tasks can further improve the similarity. However, it still remains unclear if this similarity can be used to optimize the pre-trained speech models. In this work, we therefore propose to use the brain activations recorded by fMRI to refine the often-used wav2vec2.0 model by aligning model representations toward human neural responses. Experimental results on SUPERB reveal that this operation is beneficial for several downstream tasks, e.g., speaker verification, automatic speech recognition, intent classification.One can then consider the proposed method as a new alternative to improve self-supervised speech models.


title: A deep cut into Split Federated Self-supervised Learning

abstract: Collaborative self-supervised learning has recently become feasible in highly distributed environments by dividing the network layers between client devices and a central server. However, state-of-the-art methods, such as MocoSFL, are optimized for network division at the initial layers, which decreases the protection of the client data and increases communication overhead. In this paper, we demonstrate that splitting depth is crucial for maintaining privacy and communication efficiency in distributed training. We also show that MocoSFL suffers from a catastrophic quality deterioration for the minimal communication overhead. As a remedy, we introduce Momentum-Aligned contrastive Split Federated Learning (MonAcoSFL), which aligns online and momentum client models during training procedure. Consequently, we achieve state-of-the-art accuracy while significantly reducing the communication overhead, making MonAcoSFL more practical in real-world scenarios.


title: Multi-Static ISAC based on Network-Assisted Full-Duplex Cell-Free Networks: Performance Analysis and Duplex Mode Optimization

abstract: Multi-static integrated sensing and communication (ISAC) technology, which can achieve a wider coverage range and avoid self-interference, is an important trend for the future development of ISAC. Existing multi-static ISAC designs are unable to support the asymmetric uplink (UL)/downlink (DL) communication requirements in the scenario while simultaneously achieving optimal sensing performance. This paper proposes a design for multi-static ISAC based on network-assisted full-duplex (NAFD) cell-free networks can well solve the above problems. Under this design, closed-form expressions for the individual comunication rate and localization error rate are derived under imperfect channel state information, which are respectively utilized to assess the communication and sensing performances. Then, we propose a deep Q-network-based accesss point (AP) duplex mode optimization algorithm to obtain the trade-off between communication and sensing from the UL and DL perspectives of the APs. Simulation results demonstrate that the NAFD-based ISAC system proposed in this paper can achieve significantly better communication performance than other ISAC systems while ensuring minimal impact on sensing performance. Then, we validate the accuracy of the derived closed-form expressions. Furthermore, the proposed optimization algorithm achieves performance comparable to that of the exhaustion method with low complexity.


title: Analyzing constrained LLM through PDFA-learning

abstract: We define a congruence that copes with null next-symbol probabilities that arise when the output of a language model is constrained by some means during text generation. We develop an algorithm for efficiently learning the quotient with respect to this congruence and evaluate it on case studies for analyzing statistical properties of LLM.


title: Boosting Multimedia Recommendation via Separate Generic and Unique Awareness

abstract: Multimedia recommendation, which incorporates various modalities (e.g., images, texts, etc.) into user or item representation to improve recommendation quality, has received widespread attention. Recent methods mainly focus on cross-modal alignment with self-supervised learning to obtain higher quality representation. Despite remarkable performance, we argue that there is still a limitation: completely aligning representation undermines modality-unique information. We consider that cross-modal alignment is right, but it should not be the entirety, as different modalities contain generic information between them, and each modality also contains unique information. Simply aligning each modality may ignore modality-unique features, thus degrading the performance of multimedia recommendation. To tackle the above limitation, we propose a Separate Alignment aNd Distancing framework (SAND) for multimedia recommendation, which concurrently learns both modal-unique and -generic representation to achieve more comprehensive items representation. First, we split each modal feature into generic and unique part. Then, in the alignment module, for better integration of semantic information between different modalities , we design a SoloSimLoss to align generic modalities. Furthermore, in the distancing module, we aim to distance the unique modalities from the modal-generic so that each modality retains its unique and complementary information. In the light of the flexibility of our framework, we give two technical solutions, the more capable mutual information minimization and the simple negative l2 distance. Finally, extensive experimental results on three popular datasets demonstrate the effectiveness and generalization of our proposed framework.


title: Explainable AI improves task performance in human-AI collaboration

abstract: Artificial intelligence (AI) provides considerable opportunities to assist human work. However, one crucial challenge of human-AI collaboration is that many AI algorithms operate in a black-box manner where the way how the AI makes predictions remains opaque. This makes it difficult for humans to validate a prediction made by AI against their own domain knowledge. For this reason, we hypothesize that augmenting humans with explainable AI as a decision aid improves task performance in human-AI collaboration. To test this hypothesis, we analyze the effect of augmenting domain experts with explainable AI in the form of visual heatmaps. We then compare participants that were either supported by (a) black-box AI or (b) explainable AI, where the latter supports them to follow AI predictions when the AI is accurate or overrule the AI when the AI predictions are wrong. We conducted two preregistered experiments with representative, real-world visual inspection tasks from manufacturing and medicine. The first experiment was conducted with factory workers from an electronics factory, who performed $N=9,600$ assessments of whether electronic products have defects. The second experiment was conducted with radiologists, who performed $N=5,650$ assessments of chest X-ray images to identify lung lesions. The results of our experiments with domain experts performing real-world tasks show that task performance improves when participants are supported by explainable AI instead of black-box AI. For example, in the manufacturing setting, we find that augmenting participants with explainable AI (as opposed to black-box AI) leads to a five-fold decrease in the median error rate of human decisions, which gives a significant improvement in task performance.


title: The Importance of Positional Encoding Initialization in Transformers for Relational Reasoning

abstract: Relational reasoning refers to the ability to infer and understand the relations between multiple entities. In humans, this ability underpins many higher cognitive functions, such as problem solving and decision-making, and has been reliably linked to fluid intelligence. Despite machine learning models making impressive advances across various domains, such as natural language processing and vision, the extent to which such models can perform relational reasoning tasks remains unclear. Here we study the importance of positional encoding (PE) for relational reasoning in the Transformer, and find that a learnable PE outperforms all other commonly-used PEs (e.g., absolute, relative, rotary, etc.). Moreover, we find that when using a PE with a learnable parameter, the choice of initialization greatly influences the learned representations and its downstream generalization performance. Specifically, we find that a learned PE initialized from a small-norm distribution can 1) uncover ground-truth position information, 2) generalize in the presence of noisy inputs, and 3) produce behavioral patterns that are consistent with human performance. Our results shed light on the importance of learning high-performing and robust PEs during relational reasoning tasks, which will prove useful for tasks in which ground truth positions are not provided or not known.


title: SonicID: User Identification on Smart Glasses with Acoustic Sensing

abstract: Smart glasses have become more prevalent as they provide an increasing number of applications for users. They store various types of private information or can access it via connections established with other devices. Therefore, there is a growing need for user identification on smart glasses. In this paper, we introduce a low-power and minimally-obtrusive system called SonicID, designed to authenticate users on glasses. SonicID extracts unique biometric information from users by scanning their faces with ultrasonic waves and utilizes this information to distinguish between different users, powered by a customized binary classifier with the ResNet-18 architecture. SonicID can authenticate users within 0.12 seconds, with an energy consumption of 19.8 mAs per trial. A user study involving 24 participants confirms that SonicID achieves a true positive rate of 96.5%, a false positive rate of 4.1%, and a balanced accuracy of 96.2% using just 4 minutes of training data collected for each new user. This performance is relatively consistent across different remounting sessions and days. Given this promising performance, we further discuss the potential applications of SonicID and methods to improve its performance in the future.


title: The Camera and Readout for the Trinity Demonstrator and the EUSO-SPB2 Cherenkov Telescope

abstract: We developed a modular silicon photomultiplier camera to detect Earth-skimming PeV to EeV tau neutrinos with the imaging atmospheric Cherenkov technique. We built two cameras, a 256-pixel camera with S14161-6050HS SiPMs for the Trinity Demonstrator located on Frisco Peak, Utah, and a 512-pixel camera with S14521-6050AN SiPMs for the EUSO-SPB2 Cherenkov Telescope. The front-end electronics are based on the eMUSIC ASIC, and the camera signals are sampled and digitized with the 100MS/s and 12-bit AGET system. Both cameras are liquid-cooled. We detail the camera concept and the results from characterizing the SiPMs, bench testing, and calibrating the two cameras.

categories: astro-ph.IM astro-ph.HE hep-ex physics.ins-det


title: An accurate and transferable machine learning interatomic potential for equimolar and non-equimolar high-entropy diborides

abstract: Machine learning interatomic potentials have become a powerful tool to achieve molecular dynamics (MD) simulations with the accuracy of ab initio methods while beyond their length and timescale limitations. Here, we develop an efficient moment tensor potential (MTP) for high-entropy diborides (HEBs) based on unary and binary diborides with Ti-V-Cr-Zr-Nb-Mo-Hf-Ta-W principal elements. Notably, the trained MTP exhibits exceptional generalization across both equimolar and non-equimolar HEBs, with testing errors in energy and force of 2.6 meV/atom and 155 meV/{\AA} for equimolar HEBs, and 3.7 meV/atom and 172 meV/{\AA} for non-equimolar HEBs, respectively, indicating its remarkable accuracy and transferability. The reliability of the established MTP is further confirmed by a comparative analysis with first-principles calculations, where our MTP accurately reproduces the structural and mechanical properties of various HEBs. The work presents a significant advancement in the simulation of high-entropy ceramics with enhanced efficiency and accuracy.


title: Yellow hypergiant V509 Cas -- stable in the 'yellow void'

abstract: The yellow hypergiant star V509 Cas is currently undergoing an extreme phase of evolution. Having experienced eruptive mass-loss outbursts in the 20th century, the star's effective temperature reached record high values in the early 2000s. However, since then, the star's behaviour has displayed an unprecedented level of stability. In spite of that, the star could be traversing through the 'yellow void' instability region. To describe the current evolutionary state of V509 Cas, we analysed its variability using photometric and spectroscopic data collected over recent years. By comparing our findings with historical records, we aim to determine whether the star's surface shows signs of stabilisation. Additionally, we investigate the variability of emission components in the wings of certain spectral lines to highlight the contribution of the circumstellar gaseous disc to this phenomenon. Our spectroscopic monitoring observations were carried out at Tartu Observatory over the course of seven years, supplemented by echelle spectra obtained at the Nordic Optical Telescope, as well as publicly available photometric data from Gaia, AAVSO, and AAVSO's Bright Star Monitor programme. We estimated the variability of effective temperature and radial velocity from the spectral time series and correlated it with the brightness variability of V509 Cas. The results indicate that the star's average brightness level has remained stable throughout the observed period, with an amplitude of variability ~0.1 mag. While the amplitude of short-term temperature fluctuations has decreased compared to the early 2000s, the variability of the radial velocity remains similar to historical values from the early 20th century. Moreover, we show how the variable radial velocity affects the emission components in some absorption lines (e.g. Sc II) and how that follows the hypothesis of a disc surrounding the star.


title: Sudakov double logs in single-inclusive hadron production in DIS at small $x$ from the Color Glass Condensate formalism

abstract: We investigate the high $Q^2$ (photon virtuality) limit of single-inclusive hadron production in DIS (SIDIS) at small $x$, using the color glass condensate formalism at next-to-leading order. We focus on the $\Lambda_{QCD}^2 \ll \mathbf{p}_h^2 \ll Q^2$ kinematic regime where $\mathbf{p}_h$ is the produced hadron transverse momentum, and extract the Sudakov double logarithms. We further argue that compatibility between the CGC calculation and TMD factorization at one-loop order can only be achieved if the small-x evolution is kinematically constrained.


title: HiFAST : An HI Data Calibration and Imaging Pipeline for FAST II. Flux Density Calibration

abstract: Accurate flux density calibration is essential for precise analysis and interpretation of observations across different observation modes and instruments. In this research, we firstly introduce the flux calibration model incorporated in HIFAST pipeline, designed for processing HI 21-cm spectra. Furthermore, we investigate different calibration techniques and assess the dependence of the gain parameter on the time and environmental factors. A comparison is carried out in various observation modes (e.g. tracking and scanning modes) to determine the flux density gain ($G$), revealing insignificant discrepancies in $G$ among different methods. Long-term monitoring data shows a linear correlation between $G$ and atmospheric temperature. After subtracting the $G$--Temperature dependence, the dispersion of $G$ is reduced to $<$3% over a one-year time scale. The stability of the receiver response of FAST is considered sufficient to facilitate HI observations that can accommodate a moderate error in flux calibration (e.g., $>\sim5\%$) when utilizing a constant $G$ for calibration purposes. Our study will serve as a useful addition to the results provided by Jiang et al. (2020). Detailed measurement of $G$ for the 19 beams of FAST, covering the frequency range 1000 MHz -- 1500 MHz can be found on the HIFAST homepage: https://hifast.readthedocs.io/fluxgain.


title: Positive and negative word of mouth in the United States

abstract: Word of mouth is a process by which consumers transmit positive or negative sentiment to other consumers about a business. While this process has long been recognized as a type of promotion for businesses, the value of word of mouth is questionable. This study will examine the various correlates of word of mouth to demographic variables, including the role of the trust of business owners. Education level, region of residence, and income level were found to be significant predictors of positive word of mouth. Although the results generally suggest that the majority of respondents do not engage in word of mouth, there are valuable insights to be learned.


title: Minimal amenable subshift with full mean dimension

abstract: Let $G$ be an infinite countable amenable group and $P$ a polyhedron with topological dimension $dim(P)<\infty$. We construct a minimal subshift $(X,G)$ such that its mean topological dimension is equal to $dim(P)$. This result answers the question of D. Dou in \cite{DD}, moreover, it is also an extension of the work of L. Jin and Y. Qiao \cite{JQ} for $\mathbb{Z}$-action.


title: Conformal Load Prediction with Transductive Graph Autoencoders

abstract: Predicting edge weights on graphs has various applications, from transportation systems to social networks. This paper describes a Graph Neural Network (GNN) approach for edge weight prediction with guaranteed coverage. We leverage conformal prediction to calibrate the GNN outputs and produce valid prediction intervals. We handle data heteroscedasticity through error reweighting and Conformalized Quantile Regression (CQR). We compare the performance of our method against baseline techniques on real-world transportation datasets. Our approach has better coverage and efficiency than all baselines and showcases robustness and adaptability.


title: Interpretable Representation Learning of Cardiac MRI via Attribute Regularization

abstract: Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. Several approaches have been recently considered to encode attributes in the latent space to enhance its interpretability. Notably, attribute regularization aims to encode a set of attributes along the dimensions of a latent representation. However, this approach is based on Variational AutoEncoder and suffers from blurry reconstruction. In this paper, we propose an Attributed-regularized Soft Introspective Variational Autoencoder that combines attribute regularization of the latent space within the framework of an adversarially trained variational autoencoder. We demonstrate on short-axis cardiac Magnetic Resonance images of the UK Biobank the ability of the proposed method to address blurry reconstruction issues of variational autoencoder methods while preserving the latent space interpretability.


title: A Hybrid Task-Constrained Motion Planning for Collaborative Robots in Intelligent Remanufacturing

abstract: Industrial manipulators have extensively collaborated with human operators to execute tasks, e.g., disassembly of end-of-use products, in intelligent remanufacturing. A safety task execution requires real-time path planning for the manipulator's end-effector to autonomously avoid human operators. This is even more challenging when the end-effector needs to follow a planned path while avoiding the collision between the manipulator body and human operators, which is usually computationally expensive and limits real-time application. This paper proposes an efficient hybrid motion planning algorithm that consists of an A$^*$ algorithm and an online manipulator reconfiguration mechanism (OMRM) to tackle such challenges in task and configuration spaces respectively. The A$^*$ algorithm is first leveraged to plan the shortest collision-free path of the end-effector in task space. When the manipulator body is risky to the human operator, our OMRM then selects an alternative joint configuration with minimum reconfiguration effort from a database to assist the manipulator to follow the planned path and avoid the human operator simultaneously. The database of manipulator reconfiguration establishes the relationship between the task and configuration space offline using forward kinematics, and is able to provide multiple reconfiguration candidates for a desired end-effector's position. The proposed new hybrid algorithm plans safe manipulator motion during the whole task execution. Extensive numerical and experimental studies, as well as comparison studies between the proposed one and the state-of-the-art ones, have been conducted to validate the proposed motion planning algorithm.


title: Constant scalar curvature K\"ahler metrics and semistable vector bundles

abstract: We give a necessary and sufficient condition for the projectivisation of a slope semistable vector bundle to admit constant scalar curvature K\"ahler (cscK) metrics in adiabatic classes, when the base admits a constant scalar curvature metric. More precisely, we introduce a stability condition on vector bundles, which we call adiabatic slope stability, which is a weaker version of K-stability and involves only test configurations arising from subsheaves of the bundle. We prove that, for a simple vector bundle with locally free graded object, adiabatic slope stability is equivalent to the existence of cscK metrics on the projectivisation, which solves a problem that has been open since work of Ross--Thomas. In particular, this shows that the existence of cscK metrics is equivalent to K-stability in this setting. We provide a numerical criterion for the Donaldson-Futaki invariant associated to said test configurations in terms of Chern classes of the vector bundle. This criterion is computable in practice and we present an explicit example satisfying our assumptions which is coming from a vector bundle that does not admit a Hermite-Einstein metric.


title: A New Class Biorthogonal Spline Wavelet for Image Edge Detection

abstract: Spline wavelets have shown favorable characteristics for localizing in both time and frequency. In this paper, we propose a new biorthogonal cubic special spline wavelet (BCSSW), based on the Cohen-Daubechies-Feauveau wavelet construction method and the cubic special spline algorithm. BCSSW has better properties in compact support, symmetry, and frequency domain characteristics. However, current mainstream detection operators usually ignore the uncertain representation of regional pixels and global structures. To solve these problems, we propose a structural uncertainty-aware and multi-structure operator fusion detection algorithm (EDBSW) based on a new BCSSW spline wavelet. By constructing a spline wavelet that efficiently handles edge effects, we utilize structural uncertainty-aware modulus maxima to detect highly uncertain edge samples. The proposed wavelet detection operator utilizes the multi-structure morphological operator and fusion reconstruction strategy to effectively address anti-noise processing and edge information of different frequencies. Numerous experiments have demonstrated its excellent performance in reducing noise and capturing edge structure details.


title: Copy-composition for probabilistic graphical models

abstract: In probabilistic modelling, joint distributions are often of more interest than their marginals, but the standard composition of stochastic channels is defined by marginalization. Recently, the notion of 'copy-composition' was introduced in order to circumvent this problem and express the chain rule of the relative entropy fibrationally, but while that goal was achieved, copy-composition lacked a satisfactory origin story. Here, we supply such a story for two standard probabilistic tools: directed and undirected graphical models. We explain that (directed) Bayesian networks may be understood as "stochastic terms" of product type, in which context copy-composition amounts to a pull-push operation. Likewise, we show that (undirected) factor graphs compose by copy-composition. In each case, our construction yields a double fibration of decorated (co)spans. Along the way, we introduce a useful bifibration of measure kernels, to provide semantics for the notion of stochastic term, which allows us to generalize probabilistic modelling from product to dependent types.


title: Pre-Training Identification of Graph Winning Tickets in Adaptive Spatial-Temporal Graph Neural Networks

abstract: In this paper, we present a novel method to significantly enhance the computational efficiency of Adaptive Spatial-Temporal Graph Neural Networks (ASTGNNs) by introducing the concept of the Graph Winning Ticket (GWT), derived from the Lottery Ticket Hypothesis (LTH). By adopting a pre-determined star topology as a GWT prior to training, we balance edge reduction with efficient information propagation, reducing computational demands while maintaining high model performance. Both the time and memory computational complexity of generating adaptive spatial-temporal graphs is significantly reduced from $\mathcal{O}(N^2)$ to $\mathcal{O}(N)$. Our approach streamlines the ASTGNN deployment by eliminating the need for exhaustive training, pruning, and retraining cycles, and demonstrates empirically across various datasets that it is possible to achieve comparable performance to full models with substantially lower computational costs. Specifically, our approach enables training ASTGNNs on the largest scale spatial-temporal dataset using a single A6000 equipped with 48 GB of memory, overcoming the out-of-memory issue encountered during original training and even achieving state-of-the-art performance. Furthermore, we delve into the effectiveness of the GWT from the perspective of spectral graph theory, providing substantial theoretical support. This advancement not only proves the existence of efficient sub-networks within ASTGNNs but also broadens the applicability of the LTH in resource-constrained settings, marking a significant step forward in the field of graph neural networks. Code is available at https://anonymous.4open.science/r/paper-1430.


title: Decoupling the Class Label and the Target Concept in Machine Unlearning

abstract: Machine unlearning as an emerging research topic for data regulations, aims to adjust a trained model to approximate a retrained one that excludes a portion of training data. Previous studies showed that class-wise unlearning is successful in forgetting the knowledge of a target class, through gradient ascent on the forgetting data or fine-tuning with the remaining data. However, while these methods are useful, they are insufficient as the class label and the target concept are often considered to coincide. In this work, we decouple them by considering the label domain mismatch and investigate three problems beyond the conventional all matched forgetting, e.g., target mismatch, model mismatch, and data mismatch forgetting. We systematically analyze the new challenges in restrictively forgetting the target concept and also reveal crucial forgetting dynamics in the representation level to realize these tasks. Based on that, we propose a general framework, namely, TARget-aware Forgetting (TARF). It enables the additional tasks to actively forget the target concept while maintaining the rest part, by simultaneously conducting annealed gradient ascent on the forgetting data and selected gradient descent on the hard-to-affect remaining data. Empirically, various experiments under the newly introduced settings are conducted to demonstrate the effectiveness of our TARF.


title: Wobbling and Migrating Ferrofluid Droplets

abstract: Active components incorporated in materials generate motion by inducing conformational changes in response to external fields. Magnetic fields are particularly interesting as they can actuate materials remotely. Millimeter-sized ferrofluid droplets placed on a solid surface, surrounded by an ambient gas phase, are shown here to migrate under a rotating magnetic field due to the periodic deformation of the liquid-gas interface. This interface wobbling leads to droplet migration with speeds that increase as the amplitude and frequency of the magnetic field increase. In addition to migrating in a controlled manner, we demonstrate the ability of magnetic droplets to clean surface impurities and transport cargo.


title: Unlabeled Compressed Sensing from Multiple Measurement Vectors

abstract: This paper introduces an algorithmic solution to a broader class of unlabeled sensing problems with multiple measurement vectors (MMV). The goal is to recover an unknown structured signal matrix, $\mathbf{X}$, from its noisy linear observation matrix, $\mathbf{Y}$, whose rows are further randomly shuffled by an unknown permutation matrix $\mathbf{U}$. A new Bayes-optimal unlabeled compressed sensing (UCS) recovery algorithm is developed from the bilinear approximate message passing (Bi-VAMP) framework using non-separable and coupled priors on the rows and columns of the permutation matrix $\mathbf{U}$. In particular, standard unlabeled sensing is a special case of the proposed framework, and UCS further generalizes it by neither assuming a partially shuffled signal matrix $\mathbf{X}$ nor a small-sized permutation matrix $\mathbf{U}$. For the sake of theoretical performance prediction, we also conduct a state evolution (SE) analysis of the proposed algorithm and show its consistency with the asymptotic empirical mean-squared error (MSE). Numerical results demonstrate the effectiveness of the proposed UCS algorithm and its advantage over state-of-the-art baseline approaches in various applications. We also numerically examine the phase transition diagrams of UCS, thereby characterizing the detectability region as a function of the signal-to-noise ratio (SNR).


title: Collective Invasion: When does domain curvature matter?

abstract: Real-world cellular invasion processes often take place in curved geometries. Such problems are frequently simplified in models to neglect the curved geometry in favour of computational simplicity, yet doing so risks inaccuracy in any model-based predictions. To quantify the conditions under which neglecting a curved geometry are justifiable, we examined solutions to the Fisher-Kolmogorov-Petrovsky-Piskunov (Fisher-KPP) model, a paradigm nonlinear reaction-diffusion equation typically used to model spatial invasion, on an annular geometry. Defining $\epsilon$ as the ratio of the annulus thickness $\delta$ and radius $r_0$ we derive, through an asymptotic expansion, the conditions under which it is appropriate to ignore the domain curvature, a result that generalises to other reaction-diffusion equations with constant diffusion coefficient. We further characterise the nature of the solutions through numerical simulation for different $r_0$ and $\delta$. Thus, we quantify the size of the deviation from an analogous simulation on the rectangle, and how this deviation changes across the width of the annulus. Our results grant insight into when it is appropriate to neglect the domain curvature in studying travelling wave behaviour in reaction-diffusion equations.


title: Outdoor Scene Extrapolation with Hierarchical Generative Cellular Automata

abstract: We aim to generate fine-grained 3D geometry from large-scale sparse LiDAR scans, abundantly captured by autonomous vehicles (AV). Contrary to prior work on AV scene completion, we aim to extrapolate fine geometry from unlabeled and beyond spatial limits of LiDAR scans, taking a step towards generating realistic, high-resolution simulation-ready 3D street environments. We propose hierarchical Generative Cellular Automata (hGCA), a spatially scalable conditional 3D generative model, which grows geometry recursively with local kernels following, in a coarse-to-fine manner, equipped with a light-weight planner to induce global consistency. Experiments on synthetic scenes show that hGCA generates plausible scene geometry with higher fidelity and completeness compared to state-of-the-art baselines. Our model generalizes strongly from sim-to-real, qualitatively outperforming baselines on the Waymo-open dataset. We also show anecdotal evidence of the ability to create novel objects from real-world geometric cues even when trained on limited synthetic content. More results and details can be found on https://research.nvidia.com/labs/toronto-ai/hGCA/.


title: A minimalistic and general weighted averaging method for inconsistent data

abstract: The weighted average of inconsistent data is a common and tedious problem that many scientists have encountered. The standard weighted average is not recommended for these cases, and different alternative methods are proposed in the literature. Here, we introduce a new method based on Bayesian statistics for a broad application that keeps the number of assumptions to a minimum. The uncertainty associated with each input value is considered just a lower bound of the true unknown uncertainty. By assuming a non-informative (Jeffreys') prior for true uncertainty and marginalising over its value, a modified Gaussian distribution is obtained with smoothly decreasing wings, which allows for a better treatment of scattered data and outliers. The proposed method is tested on a series of data sets: simulations, CODATA recommended value of the Newtonian gravitational constant, and some particle properties from the Particle Data Group, including the proton charge radius and the mass of the W boson. For the latter in particular, contrary to other works, our prediction lies in good agreement with the Standard Model. A freely available Python library is also provided for a simple implementation of our averaging method.


title: Vessel Re-identification and Activity Detection in Thermal Domain for Maritime Surveillance

abstract: Maritime surveillance is vital to mitigate illegal activities such as drug smuggling, illegal fishing, and human trafficking. Vision-based maritime surveillance is challenging mainly due to visibility issues at night, which results in failures in re-identifying vessels and detecting suspicious activities. In this paper, we introduce a thermal, vision-based approach for maritime surveillance with object tracking, vessel re-identification, and suspicious activity detection capabilities. For vessel re-identification, we propose a novel viewpoint-independent algorithm which compares features of the sides of the vessel separately (separate side-spaces) leveraging shape information in the absence of color features. We propose techniques to adapt tracking and activity detection algorithms for the thermal domain and train them using a thermal dataset we created. This dataset will be the first publicly available benchmark dataset for thermal maritime surveillance. Our system is capable of re-identifying vessels with an 81.8% Top1 score and identifying suspicious activities with a 72.4\% frame mAP score; a new benchmark for each task in the thermal domain.


title: Suppressing Counter-Rotating Errors for Fast Single-Qubit Gates with Fluxonium

abstract: Qubit decoherence unavoidably degrades the fidelity of quantum logic gates. Accordingly, realizing gates that are as fast as possible is a guiding principle for qubit control, necessitating protocols for mitigating error channels that become significant as gate time is decreased. One such error channel arises from the counter-rotating component of strong, linearly polarized drives. This error channel is particularly important when gate times approach the qubit Larmor period and represents the dominant source of infidelity for sufficiently fast single-qubit gates with low-frequency qubits such as fluxonium. In this work, we develop and demonstrate two complementary protocols for mitigating this error channel. The first protocol realizes circularly polarized driving in circuit quantum electrodynamics (QED) through simultaneous charge and flux control. The second protocol -- commensurate pulses -- leverages the coherent and periodic nature of counter-rotating fields to regularize their contributions to gates, enabling single-qubit gate fidelities reliably exceeding $99.997\%$. This protocol is platform independent and requires no additional calibration overhead. This work establishes straightforward strategies for mitigating counter-rotating effects from strong drives in circuit QED and other platforms, which we expect to be helpful in the effort to realize high-fidelity control for fault-tolerant quantum computing.


title: Cooling of nuclear spin systems in semiconductor structures due to dynamic polarization by strongly localized electrons

abstract: We present a theoretical analysis of cooling the spins of lattice nuclei in semiconductor structures by dynamic polarization with optically oriented electrons. Our consideration is not restricted to short spin correlation times of electrons. Therefore, it applies not only to electrons weakly bound to shallow donors, but also to electrons localized in quantum dots or deep impurity centers. The main result of the theory is that, in order to polarize nuclear spins efficiently with strongly localized electrons, one should apply external magnetic fields by far exceeding the local field of nuclear spin-spin interaction.


title: Improving subgroup analysis using methods to extend inferences to specific target populations

abstract: Subgroup analyses are common in epidemiologic and clinical research. Unfortunately, restriction to subgroup members to test for heterogeneity can yield imprecise effect estimates. If the true effect differs between members and non-members due to different distributions of other measured effect measure modifiers (EMMs), leveraging data from non-members can improve the precision of subgroup effect estimates. We obtained data from the PRIME RCT of panitumumab in patients with metastatic colon and rectal cancer from Project Datasphere(TM) to demonstrate this method. We weighted non-Hispanic White patients to resemble Hispanic patients in measured potential EMMs (e.g., age, KRAS distribution, sex), combined Hispanic and weighted non-Hispanic White patients in one data set, and estimated 1-year differences in progression-free survival (PFS). We obtained percentile-based 95% confidence limits for this 1-year difference in PFS from 2,000 bootstraps. To show when the method is less helpful, we also reweighted male patients to resemble female patients and mutant-type KRAS (no treatment benefit) patients to resemble wild-type KRAS (treatment benefit) patients. The PRIME RCT included 795 non-Hispanic White and 42 Hispanic patients with complete data on EMMs. While the Hispanic-only analysis estimated a one-year PFS change of -17% (95% C.I. -45%, 8.8%) with panitumumab, the combined weighted estimate was more precise (-8.7%, 95% CI -22%, 5.3%) while differing from the full population estimate (1.0%, 95% CI: -5.9%, 7.5%). When targeting wild-type KRAS patients the combined weighted estimate incorrectly suggested no benefit (one-year PFS change: 0.9%, 95% CI: -6.0%, 7.2%). Methods to extend inferences from study populations to specific targets can improve the precision of estimates of subgroup effect estimates when their assumptions are met. Violations of those assumptions can lead to bias, however.


title: AdaNCA: Neural Cellular Automata As Adaptors For More Robust Vision Transformer

abstract: Vision Transformers (ViTs) have demonstrated remarkable performance in image classification tasks, particularly when equipped with local information via region attention or convolutions. While such architectures improve the feature aggregation from different granularities, they often fail to contribute to the robustness of the networks. Neural Cellular Automata (NCA) enables the modeling of global cell representations through local interactions, with its training strategies and architecture design conferring strong generalization ability and robustness against noisy inputs. In this paper, we propose Adaptor Neural Cellular Automata (AdaNCA) for Vision Transformer that uses NCA as plug-in-play adaptors between ViT layers, enhancing ViT's performance and robustness against adversarial samples as well as out-of-distribution inputs. To overcome the large computational overhead of standard NCAs, we propose Dynamic Interaction for more efficient interaction learning. Furthermore, we develop an algorithm for identifying the most effective insertion points for AdaNCA based on our analysis of AdaNCA placement and robustness improvement. With less than a 3% increase in parameters, AdaNCA contributes to more than 10% absolute improvement in accuracy under adversarial attacks on the ImageNet1K benchmark. Moreover, we demonstrate with extensive evaluations across 8 robustness benchmarks and 4 ViT architectures that AdaNCA, as a plug-in-play module, consistently improves the robustness of ViTs.


title: Dynamical evolution of social network polarization and its impact on the propagation of a virus

abstract: The COVID-19 pandemic that emerged in 2020 has highlighted the complex interplay between vaccine hesitancy and societal polarization. In this study, we analyse the dynamical polarization within a social network as well as the network properties before and after a vaccine was made available. Our results show that as the network evolves from a less structured state to one with more clustered communities. Then using an agent-based modeling approach, we simulate the propagation of a virus in a polarized society by assigning vaccines to pro-vaccine individuals and none to the anti-vaccine individuals. We compare this propagation to the case where the same number of vaccines is distributed homogeneously across the population. In polarized networks, we observe a significantly more widespread diffusion of the virus, highlighting the importance of considering polarization for epidemic forecasting.


title: From Chaos to Clarity: 3DGS in the Dark

abstract: Novel view synthesis from raw images provides superior high dynamic range (HDR) information compared to reconstructions from low dynamic range RGB images. However, the inherent noise in unprocessed raw images compromises the accuracy of 3D scene representation. Our study reveals that 3D Gaussian Splatting (3DGS) is particularly susceptible to this noise, leading to numerous elongated Gaussian shapes that overfit the noise, thereby significantly degrading reconstruction quality and reducing inference speed, especially in scenarios with limited views. To address these issues, we introduce a novel self-supervised learning framework designed to reconstruct HDR 3DGS from a limited number of noisy raw images. This framework enhances 3DGS by integrating a noise extractor and employing a noise-robust reconstruction loss that leverages a noise distribution prior. Experimental results show that our method outperforms LDR/HDR 3DGS and previous state-of-the-art (SOTA) self-supervised and supervised pre-trained models in both reconstruction quality and inference speed on the RawNeRF dataset across a broad range of training views. Code can be found in \url{https://lizhihao6.github.io/Raw3DGS}.


title: Jet modification via $\pi^0$-hadron correlations in Au$+$Au collisions at $\sqrt{s_{_{NN}}}=200$ GeV

abstract: High-momentum two-particle correlations are a useful tool for studying jet-quenching effects in the quark-gluon plasma. Angular correlations between neutral-pion triggers and charged hadrons with transverse momenta in the range 4--12~GeV/$c$ and 0.5--7~GeV/$c$, respectively, have been measured by the PHENIX experiment in 2014 for Au$+$Au collisions at $\sqrt{s_{_{NN}}}=200$~GeV. Suppression is observed in the yield of high-momentum jet fragments opposite the trigger particle, which indicates jet suppression stemming from in-medium partonic energy loss, while enhancement is observed for low-momentum particles. The ratio and differences between the yield in Au$+$Au collisions and $p$$+$$p$ collisions, $I_{AA}$ and $\Delta_{AA}$, as a function of the trigger-hadron azimuthal separation, $\Delta\phi$, are measured for the first time at the Relativistic Heavy Ion Collider. These results better quantify how the yield of low-$p_T$ associated hadrons is enhanced at wide angle, which is crucial for studying energy loss as well as medium-response effects.


title: Familiar biological, chemical and physical events credibly evolve the Standard Genetic Code

abstract: The genetic code is profoundly shaped by an origin in ancient RNA-mediated interactions, needing an extended development to reach the Standard Genetic Code (SGC). That development can serially use RNA specificities, a ribonucleopeptide transition (RNPT), finally code escape and diaspora. An index of evolutionary plausibility based on least selection takes simultaneous account of speed and accuracy of evolution, identifying favored evolutions. Combining RNA world specificities allowed convergence of early coding to SGC assignments. Secondly, this was sufficient to launch a post-RNA-world RNPT. The RNPT allowed biosynthesis of complex amino acids, depending heavily on late code fusions between coexisting independent codes. Thirdly, escape from fluctuating, but highly-evolved codes of the RNPT applied a near-ideal selection for fastest-evolving and most accurate/useful genetic codes. Concurrently, a code and its microbial carrier suited to a free-living existence necessarily evolved. The established unity of life on Earth likely traces to SGC ascendancy during escape from the RNPT, and code diaspora.


title: The cosmology of $f(R, L_m)$ gravity: constraining the background and perturbed dynamics

abstract: This paper delves into the late-time accelerated expansion of the universe and the evolution of cosmic structures within the context of a specific \( f(R, L_m) \) gravity model, formulated as \( f(R, L_m) = \lambda R + \beta L_m^\alpha + \eta \). To study the cosmological viability of the model, we employed the latest cosmic measurement datasets: i) 57 observational Hubble parameter data points (\texttt{OHD}); ii) 1048 distance moduli data points (\texttt{SNIa}); iii) a combined dataset (\texttt{OHD+SNIa}); and large scale structure datasets, including iv) 14 growth rate data points (\texttt{f}); and v) 30 redshift space distortion data points (\texttt{f}$\sigma_8$). These datasets facilitated the constraint of the \( f(R, L_m) \)-gravity model via MCMC simulations, followed by a comparative analysis with the \(\Lambda\)CDM model. A comprehensive statistical analysis has been conducted to evaluate the \( f(R, L_m) \)-gravity model's efficacy in explaining both the accelerated expansion of the universe and the growth of cosmic structures.


title: NIRPS first light and early science: breaking the 1 m/s RV precision barrier at infrared wavelengths

abstract: The Near-InfraRed Planet Searcher or NIRPS is a precision radial velocity spectrograph developed through collaborative efforts among laboratories in Switzerland, Canada, Brazil, France, Portugal and Spain. NIRPS extends to the 0.98-1.8 $\mu$m domain of the pioneering HARPS instrument at the La Silla 3.6-m telescope in Chile and it has achieved unparalleled precision, measuring stellar radial velocities in the infrared with accuracy better than 1 m/s. NIRPS can be used either stand-alone or simultaneously with HARPS. Commissioned in late 2022 and early 2023, NIRPS embarked on a 5-year Guaranteed Time Observation (GTO) program in April 2023, spanning 720 observing nights. This program focuses on planetary systems around M dwarfs, encompassing both the immediate solar vicinity and transit follow-ups, alongside transit and emission spectroscopy observations. We highlight NIRPS's current performances and the insights gained during its deployment at the telescope. The lessons learned and successes achieved contribute to the ongoing advancement of precision radial velocity measurements and high spectral fidelity, further solidifying NIRPS' role in the forefront of the field of exoplanets.


title: Large Language Model(LLM) assisted End-to-End Network Health Management based on Multi-Scale Semanticization

abstract: Network device and system health management is the foundation of modern network operations and maintenance. Traditional health management methods, relying on expert identification or simple rule-based algorithms, struggle to cope with the dynamic heterogeneous networks (DHNs) environment. Moreover, current state-of-the-art distributed anomaly detection methods, which utilize specific machine learning techniques, lack multi-scale adaptivity for heterogeneous device information, resulting in unsatisfactory diagnostic accuracy for DHNs. In this paper, we develop an LLM-assisted end-to-end intelligent network health management framework. The framework first proposes a Multi-Scale Semanticized Anomaly Detection Model (MSADM), incorporating semantic rule trees with an attention mechanism to address the multi-scale anomaly detection problem in DHNs. Secondly, a chain-of-thought-based large language model is embedded in downstream to adaptively analyze the fault detection results and produce an analysis report with detailed fault information and optimization strategies. Experimental results show that the accuracy of our proposed MSADM for heterogeneous network entity anomaly detection is as high as 91.31\%.


title: 2-dimensional Ricci limit spaces

abstract: In this note, we will show that if a measured Gromov-Hausdorff limit space of a sequence of Riemannian manifolds with lower Ricci curvature bound has dense 2-regular set, then it is homeomorphic to a 2-dimensional manifold in an open full measure set. This result gives a positive answer to an open problem in [Naber, Open problem 3.4] in dimension 2 and for dimension larger than 2 there are counterexamples by [HNW, Zhou].


title: Measuring model variability using robust non-parametric testing

abstract: Training a deep neural network often involves stochastic optimization, meaning each run will produce a different model. The seed used to initialize random elements of the optimization procedure heavily influences the quality of a trained model, which may be obscure from many commonly reported summary statistics, like accuracy. However, random seed is often not included in hyper-parameter optimization, perhaps because the relationship between seed and model quality is hard to describe. This work attempts to describe the relationship between deep net models trained with different random seeds and the behavior of the expected model. We adopt robust hypothesis testing to propose a novel summary statistic for network similarity, referred to as the $\alpha$-trimming level. We use the $\alpha$-trimming level to show that the empirical cumulative distribution function of an ensemble model created from a collection of trained models with different random seeds approximates the average of these functions as the number of models in the collection grows large. This insight provides guidance for how many random seeds should be sampled to ensure that an ensemble of these trained models is a reliable representative. We also show that the $\alpha$-trimming level is more expressive than different performance metrics like validation accuracy, churn, or expected calibration error when taken alone and may help with random seed selection in a more principled fashion. We demonstrate the value of the proposed statistic in real experiments and illustrate the advantage of fine-tuning over random seed with an experiment in transfer learning.


title: FSH: 3D Representation via Fibonacci Spherical Harmonics

abstract: Spherical harmonics are a favorable technique for 3D representation, employing a frequency-based approach through the spherical harmonic transform (SHT). Typically, SHT is performed using equiangular sampling grids. However, these grids are non-uniform on spherical surfaces and exhibit local anisotropy, a common limitation in existing spherical harmonic decomposition methods. This paper proposes a 3D representation method using Fibonacci Spherical Harmonics (FSH). We introduce a spherical Fibonacci grid (SFG), which is more uniform than equiangular grids for SHT in the frequency domain. Our method employs analytical weights for SHT on SFG, effectively assigning sampling errors to spherical harmonic degrees higher than the recovered band-limited function. This provides a novel solution for spherical harmonic transformation on non-equiangular grids. The key advantages of our FSH method include: 1) With the same number of sampling points, SFG captures more features without bias compared to equiangular grids; 2) The root mean square error of 32-degree spherical harmonic coefficients is reduced by approximately 34.6\% for SFG compared to equiangular grids; and 3) FSH offers more stable frequency domain representations, especially for rotating functions. FSH enhances the stability of frequency domain representations under rotational transformations. Its application in 3D shape reconstruction and 3D shape classification results in more accurate and robust representations.


title: Dynamical Lorentz Symmetry Breaking in a Scale-free Theory of Gravity

abstract: This paper explores the renormalization of scale-free quadratic gravity coupled to the bumblebee field and its potential for dynamically breaking Lorentz symmetry. We conduct one-loop renormalization of the model and calculate the associated renormalization group functions. Additionally, we compute the one-loop effective potential for the bumblebee field, revealing that it acquires a non-trivial vacuum expectation value induced by radiative corrections - a phenomenon known as the Coleman-Weinberg mechanism. This spontaneous breaking of scale invariance arises from the non-vanishing vacuum expectation value of the bumblebee field, implicating Lorentz symmetry violation. Consequently, the non-minimal coupling between the bumblebee and gravitational fields results in a spontaneous generation of the Einstein-Hilbert term due to radiative corrections, thereby linking the Planck scale to Lorentz violation phenomena.


title: GraphFM: A Comprehensive Benchmark for Graph Foundation Model

abstract: Foundation Models (FMs) serve as a general class for the development of artificial intelligence systems, offering broad potential for generalization across a spectrum of downstream tasks. Despite extensive research into self-supervised learning as the cornerstone of FMs, several outstanding issues persist in Graph Foundation Models that rely on graph self-supervised learning, namely: 1) Homogenization. The extent of generalization capability on downstream tasks remains unclear. 2) Scalability. It is unknown how effectively these models can scale to large datasets. 3) Efficiency. The training time and memory usage of these models require evaluation. 4) Training Stop Criteria. Determining the optimal stopping strategy for pre-training across multiple tasks to maximize performance on downstream tasks. To address these questions, we have constructed a rigorous benchmark that thoroughly analyzes and studies the generalization and scalability of self-supervised Graph Neural Network (GNN) models. Regarding generalization, we have implemented and compared the performance of various self-supervised GNN models, trained to generate node representations, across tasks such as node classification, link prediction, and node clustering. For scalability, we have compared the performance of various models after training using full-batch and mini-batch strategies. Additionally, we have assessed the training efficiency of these models by conducting experiments to test their GPU memory usage and throughput. Through these experiments, we aim to provide insights to motivate future research. The code for this benchmark is publicly available at https://github.com/NYUSHCS/GraphFM.


title: Causality for Tabular Data Synthesis: A High-Order Structure Causal Benchmark Framework

abstract: Tabular synthesis models remain ineffective at capturing complex dependencies, and the quality of synthetic data is still insufficient for comprehensive downstream tasks, such as prediction under distribution shifts, automated decision-making, and cross-table understanding. A major challenge is the lack of prior knowledge about underlying structures and high-order relationships in tabular data. We argue that a systematic evaluation on high-order structural information for tabular data synthesis is the first step towards solving the problem. In this paper, we introduce high-order structural causal information as natural prior knowledge and provide a benchmark framework for the evaluation of tabular synthesis models. The framework allows us to generate benchmark datasets with a flexible range of data generation processes and to train tabular synthesis models using these datasets for further evaluation. We propose multiple benchmark tasks, high-order metrics, and causal inference tasks as downstream tasks for evaluating the quality of synthetic data generated by the trained models. Our experiments demonstrate to leverage the benchmark framework for evaluating the model capability of capturing high-order structural causal information. Furthermore, our benchmarking results provide an initial assessment of state-of-the-art tabular synthesis models. They have clearly revealed significant gaps between ideal and actual performance and how baseline methods differ. Our benchmark framework is available at URL https://github.com/TURuibo/CauTabBench.


title: On the nature of the radio calibrator and gamma-ray emitting NLS1 galaxy 3C 286 and its multiwavelength variability

abstract: The quasar 3C 286, a well-known calibrator source in radio astronomy, was found to exhibit exceptional multiwavelength properties. Its rich and complex optical emission-line spectrum revealed its narrow-line Seyfert 1 (NLS1) nature. Given its strong radio emission, this makes 3C 286 one of the radio-loudest NLS1 galaxies known to date. 3C 286 is also one of very few known compact steep-spectrum (CSS) sources detected in the gamma-ray regime. Observations in the X-ray regime, rarely carried out so far, revealed evidence for variability, raising the question if driven by the accretion disk or jet. 3C 286 is also well known for its damped Lyman alpha system from an intervening absorber at z = 0.692, triggering a search for the corresponding X-ray absorption along the line-of-sight. Here, we present new observations in the radio, X-ray, optical and UV band. The nature of the X-ray variability is addressed. Spectral evidence suggests that it is primarily driven by the accretion disk (not the jet), and the X-ray spectrum is well fit by a powerlaw plus soft excess model. The radio flux density and polarization remain constant at the Effelsberg telescope resolution, reconfirming the use of 3C 286 as radio calibrator. The amount of reddening/absorption along the line-of-sight {\em{intrinsic}} to 3C 286 is rigorously assessed. None is found, validating the derivation of a high Eddington ratio (L/L-Edd ~ 1) and of the very high radio-loudness index of 3C 286. Based on the first deep Chandra image of 3C 286, tentative evidence for hard X-ray emission from the SW radio lobe is reported. A large variety of models for the gamma-ray emission of 3C 286 is briefly discussed.


title: Searching for bound states in the open strangeness systems

abstract: Inspired by the recent findings of $Z_{cs}$ and $P_{cs}$ states, we investigate the strong interactions of the systems with open strangeness(es) from the light sector to the heavy sector (no beauty quark), where the interaction potential is derived from the vector meson exchange mechanism in $t$- and $u$-channels. In the current work, we discuss all of single channel cases for the open strangeness in the systemic framework, where the resonances $X_0(2866)$, $D^*_{s0}(2317)$ and $D_{s1}(2460)$ are dynamically generated. Furthermore, there are many new exotics predicted. In addition, the left-hand cut problem in $t$- and $u$-channels is discussed in detail.


title: GPU-accelerated Auxiliary-field quantum Monte Carlo with multi-Slater determinant trial states

abstract: The accuracy of phaseless auxiliary-field quantum Monte Carlo (ph-AFQMC) can be systematically improved with better trial states. Using multi-Slater determinant trial states, ph-AFQMC has the potential to faithfully treat strongly correlated systems, while balancing the static and dynamical correlations on an equal footing. This preprint presents an implementation and application of graphics processing unit-accelerated ph-AFQMC, for multi-Slater determinant trial wavefunctions (GPU-accelerated MSD-AFQMC), to enable efficient simulation of large-scale, strongly correlated systems. This approach allows for nearly-exact computation of ground state energies in multi-reference systems. Our GPU-accelerated MSD-AFQMC is implemented in the open-source code \texttt{ipie}, a Python-based AFQMC package [\textit{J. Chem. Theory Comput.}, 2022, 19(1): 109-121]. We benchmark the performance of the GPU code on transition-metal clusters like [Cu$_2$O$_2$]$^{2+}$ and [Fe$_2$S$_2$(SCH$_3$)]$^{2-}$. The GPU code achieves at least sixfold speedup in both cases, comparing the timings of a single A100 GPU to that of a 32-CPU node. For [Fe$_2$S$_2$(SCH$_3$)]$^{2-}$, we demonstrate that our GPU MSD-AFQMC can recover the dynamical correlation necessary for chemical accuracy with an MSD trial, despite the large number of determinants required ($>10^5$). Our work significantly enhances the efficiency of MSD-AFQMC calculations for large, strongly correlated molecules by utilizing GPUs, offering a promising path for exploring the electronic structure of transition metal complexes.

categories: physics.chem-ph cond-mat.str-el physics.comp-ph quant-ph


title: Improving Policy Optimization via $\varepsilon$-Retrain

abstract: We present $\varepsilon$-retrain, an exploration strategy designed to encourage a behavioral preference while optimizing policies with monotonic improvement guarantees. To this end, we introduce an iterative procedure for collecting retrain areas -- parts of the state space where an agent did not follow the behavioral preference. Our method then switches between the typical uniform restart state distribution and the retrain areas using a decaying factor $\varepsilon$, allowing agents to retrain on situations where they violated the preference. Experiments over hundreds of seeds across locomotion, navigation, and power network tasks show that our method yields agents that exhibit significant performance and sample efficiency improvements. Moreover, we employ formal verification of neural networks to provably quantify the degree to which agents adhere to behavioral preferences.


title: Is Programming by Example solved by LLMs?

abstract: Programming-by-Examples (PBE) aims to generate an algorithm from input-output examples. Such systems are practically and theoretically important: from an end-user perspective, they are deployed to millions of people, and from an AI perspective, PBE corresponds to a very general form of few-shot inductive inference. Given the success of Large Language Models (LLMs) in code-generation tasks, we investigate here the extent to which LLMs can be said to have `solved' PBE. We experiment on classic domains such as lists and strings, and an uncommon graphics programming domain not well represented in typical pretraining data. We find that pretrained models are not effective at PBE, but that they can be fine-tuned for much higher performance, provided the test problems are in-distribution. We analyze empirically what causes these models to succeed and fail, and take steps toward understanding how to achieve better out-of-distribution generalization. Collectively these results suggest that LLMs make strong progress toward solving the typical suite of PBE tasks, potentially increasing the flexibility and applicability of PBE systems, while also identifying ways in which LLMs still fall short.


title: Pathways to hyperchaos in a three-dimensional quadratic map

abstract: This paper deals with various routes to hyperchaos with all three positive Lyapunov exponents in a three-dimensional quadratic map. The map under consideration displays strong hyperchaoticity in the sense that in a wider range of parameter space the system showcase three positive Lyapunov exponents. It is shown that the saddle periodic orbits eventually become repellers at this hyperchaotic regime. By computing the distance of the repellers to the attractors as a function of parameters, it is shown that the hyperchaotic attractors absorb the repelling periodic orbits. First we discuss a route from stable fixed point undergoing period-doubling bifurcations to chaos and then hyperchaos, and role of saddle periodic orbits. We then illustrate a route from doubling bifurcation of quasiperiodic closed invariant curves to hyperchaotic attractors. Finally, presence of weak hyperchaotic flow like attractors are discussed.


title: Invariant multiscale neural networks for data-scarce scientific applications

abstract: Success of machine learning (ML) in the modern world is largely determined by abundance of data. However at many industrial and scientific problems, amount of data is limited. Application of ML methods to data-scarce scientific problems can be made more effective via several routes, one of them is equivariant neural networks possessing knowledge of symmetries. Here we suggest that combination of symmetry-aware invariant architectures and stacks of dilated convolutions is a very effective and easy to implement receipt allowing sizable improvements in accuracy over standard approaches. We apply it to representative physical problems from different realms: prediction of bandgaps of photonic crystals, and network approximations of magnetic ground states. The suggested invariant multiscale architectures increase expressibility of networks, which allow them to perform better in all considered cases.

categories: cond-mat.dis-nn cond-mat.mtrl-sci cs.LG physics.optics


title: Classes of operators related to subnormal operators

abstract: In this paper we attempt to lay the foundations for a theory encompassing some natural extensions of the class of subnormal operators, namely the $n$--subnormal operators and the sub-$n$--normal operators. We discuss inclusion relations among the above mentioned classes and other related classes, e.g., $n$--quasinormal and quasi-$n$--normal operators. We show that sub-$n$--normality is stronger than $n$--subnormality, and produce a concrete example of a $3$--subnormal operator which is not sub-$2$--normal. In \cite{CU1}, R.E. Curto, S.H. Lee and J. Yoon proved that if an operator $T$ is subnormal, left-invertible, and such that $T^n$ is quasinormal for some $n \le 2$, then $T$ is quasinormal. in \cite{JS}, P.Pietrzycki and J. Stochel improved this result by removing the assumption of left invertibility. In this paper we consider suitable analogs of this result for the case of operators in the above-mentioned classes. In particular, we prove that the weight sequence of an $n$--quasinormal unilateral weighted shift must be periodic with period at most $n$.


title: Geometric representations of braid and Yang-Baxter gates

abstract: Brick-wall circuits composed of the Yang-Baxter gates are integrable. It becomes an important tool to study the quantum many-body system out of equilibrium. To put the Yang-Baxter gate on the quantum computer, it has to be decomposed into the native gates of quantum computers. It is favorable to apply the least number of native two-qubit gates to construct the Yang-Baxter gate. We study the geometric representations of all X-type braid gates and their corresponding Yang-Baxter gates via the Yang-Baxterization. We find that the braid and Yang-Baxter gates can only exist on certain edges and faces of the two-qubit tetrahedron. We identify the parameters by which the braid and Yang-Baxter gates are the Clifford gate, the matchgate, and the dual-unitary gate. The geometric representations provide the optimal decompositions of the braid and Yang-Baxter gates in terms of other two-qubit gates. We also find that the entangling powers of the Yang-Baxter gates are determined by the spectral parameters. Our results provide the necessary conditions to construct the braid and Yang-Baxter gates on quantum computers.


title: Deep learning from strongly mixing observations: Sparse-penalized regularization and minimax optimality

abstract: The explicit regularization and optimality of deep neural networks estimators from independent data have made considerable progress recently. The study of such properties on dependent data is still a challenge. In this paper, we carry out deep learning from strongly mixing observations, and deal with the squared and a broad class of loss functions. We consider sparse-penalized regularization for deep neural network predictor. For a general framework that includes, regression estimation, classification, time series prediction,$\cdots$, oracle inequality for the expected excess risk is established and a bound on the class of H\"older smooth functions is provided. For nonparametric regression from strong mixing data and sub-exponentially error, we provide an oracle inequality for the $L_2$ error and investigate an upper bound of this error on a class of H\"older composition functions. For the specific case of nonparametric autoregression with Gaussian and Laplace errors, a lower bound of the $L_2$ error on this H\"older composition class is established. Up to logarithmic factor, this bound matches its upper bound; so, the deep neural network estimator attains the minimax optimal rate.


title: MMIL: A novel algorithm for disease associated cell type discovery

abstract: Single-cell datasets often lack individual cell labels, making it challenging to identify cells associated with disease. To address this, we introduce Mixture Modeling for Multiple Instance Learning (MMIL), an expectation maximization method that enables the training and calibration of cell-level classifiers using patient-level labels. Our approach can be used to train e.g. lasso logistic regression models, gradient boosted trees, and neural networks. When applied to clinically-annotated, primary patient samples in Acute Myeloid Leukemia (AML) and Acute Lymphoblastic Leukemia (ALL), our method accurately identifies cancer cells, generalizes across tissues and treatment timepoints, and selects biologically relevant features. In addition, MMIL is capable of incorporating cell labels into model training when they are known, providing a powerful framework for leveraging both labeled and unlabeled data simultaneously. Mixture Modeling for MIL offers a novel approach for cell classification, with significant potential to advance disease understanding and management, especially in scenarios with unknown gold-standard labels and high dimensionality.


title: Illustrating the benefits of efficient creation and adaption of behavior models in intelligent Digital Twins over the machine life cycle

abstract: The concept of the Digital Twin, which in the context of this paper is the virtual representation of a production system or its components, can be used as a "digital playground" to master the increasing complexity of these assets. Central subcomponents of the Digital Twin are behavior models that can provide benefits over the entire machine life cycle. However, the creation, adaption and use of behavior models throughout the machine life cycle is very time-consuming, which is why approaches to improve the cost-benefit ratio are needed. Furthermore, there is a lack of specific use cases that illustrate the application and added benefit of behavior models over the machine life cycle, which is why the universal application of behavior models in industry is still lacking compared to research. This paper first presents the fundamentals, challenges and related work on Digital Twins and behavior models in the context of the machine life cycle. Then, concepts for low-effort creation and automatic adaption of Digital Twins are presented, with a focus on behavior models. Finally, the aforementioned gap between research and industry is addressed by demonstrating various realized use cases over the machine life cycle, in which the advantages as well as the application of behavior models in the different life phases are shown.


title: LaMOT: Language-Guided Multi-Object Tracking

abstract: Vision-Language MOT is a crucial tracking problem and has drawn increasing attention recently. It aims to track objects based on human language commands, replacing the traditional use of templates or pre-set information from training sets in conventional tracking tasks. Despite various efforts, a key challenge lies in the lack of a clear understanding of why language is used for tracking, which hinders further development in this field. In this paper, we address this challenge by introducing Language-Guided MOT, a unified task framework, along with a corresponding large-scale benchmark, termed LaMOT, which encompasses diverse scenarios and language descriptions. Specially, LaMOT comprises 1,660 sequences from 4 different datasets and aims to unify various Vision-Language MOT tasks while providing a standardized evaluation platform. To ensure high-quality annotations, we manually assign appropriate descriptive texts to each target in every video and conduct careful inspection and correction. To the best of our knowledge, LaMOT is the first benchmark dedicated to Language-Guided MOT. Additionally, we propose a simple yet effective tracker, termed LaMOTer. By establishing a unified task framework, providing challenging benchmarks, and offering insights for future algorithm design and evaluation, we expect to contribute to the advancement of research in Vision-Language MOT. We will release the data at https://github.com/Nathan-Li123/LaMOT.


title: On the existence of solutions for a class of systems of integro-differential equations with the logarithmic Laplacian and drift

abstract: In this article, we consider a system of integro-differential equations in L^2(R, R^N), which contains the logarithmic Laplacian in the presence of transport terms. The linear operators associated with the system satisfy the Fredholm property. By virtue of a fixed point technique, we demonstrate the existence of solutions. We emphasize that the discussion is more complicated than that of the scalar situation as there are more cumbersome technicalities to overcome.


title: On the application of components manufactured with stereolithographic 3D printing in high vacuum systems

abstract: We report on a method for using stereolithographic (SLA) additive manufacturing to rapidly and cheaply prototype components for use in high-vacuum environments. We demonstrate the primary vacuum contaminant from freshly printed SLA plastics is water with no evidence of polymers out-gassing from the material and thus the vacuum performance can be controlled with simple treatments which do not involve surface sealing. An unbaked vacuum system containing SLA printed parts achieved 1.9e-8 mbar base pressure whilst retaining structural integrity and manufacturing accuracy. Preliminary results indicate that our method can be extended to achieve ultrahigh-vacuum compatibility by baking at higher temperatures. We further report on the effect of atmospheric exposure to components and present evidence to suggest that re-wetting occurs exclusively in the component skin layer, by showing that the bulk mass changes of the material is irreversible on the timescale investigated (< 2 weeks).


title: Bessel potentials and Green functions on pseudo-Euclidean spaces

abstract: We review properties of Bessel potentials, that is, inverse Fourier transforms of (regularizations of) $\frac{1}{(m^2+p^2)^{\frac{\mu}{2}}}$ on a pseudoEuclidean space with signature $(q,d-q)$. We are mostly interested in the Lorentzian signature $(1,d-1)$, and the case $\mu=2$, related to the Klein-Gordon equation $(-\Box+m^2)f=0$. We analyze properties of various ``two-point functions'', which play an important role in Quantum Field Theory, such as the retarded/advanced propagators or Feynman/antiFeynman propagators. We consistently use hypergeometric functions instead of Bessel functions, which makes most formulas much more transparent. We pay attention to distributional properties of various Bessel potentials. We include in our analysis the ``tachyonic case'', corresponding to the ``wrong'' sign in the Klein-Gordon equation.


title: Multimodal Representation Loss Between Timed Text and Audio for Regularized Speech Separation

abstract: Recent studies highlight the potential of textual modalities in conditioning the speech separation model's inference process. However, regularization-based methods remain underexplored despite their advantages of not requiring auxiliary text data during the test time. To address this gap, we introduce a timed text-based regularization (TTR) method that uses language model-derived semantics to improve speech separation models. Our approach involves two steps. We begin with two pretrained audio and language models, WavLM and BERT, respectively. Then, a Transformer-based audio summarizer is learned to align the audio and word embeddings and to minimize their gap. The summarizer Transformer, incorporated as a regularizer, promotes the separated sources' alignment with the semantics from the timed text. Experimental results show that the proposed TTR method consistently improves the various objective metrics of the separation results over the unregularized baselines.


title: Highly Connected Graph Partitioning: Exact Formulation and Solution Methods

abstract: Graph partitioning (GP) and vertex connectivity have traditionally been two distinct fields of study. This paper introduces the highly connected graph partitioning (HCGP) problem, which partitions a graph into compact, size balanced, and $Q$-(vertex) connected parts for any $Q\geq 1$. This problem is valuable in applications that seek cohesion and fault-tolerance within their parts, such as community detection in social networks and resiliency-focused partitioning of power networks. Existing research in this fundamental interconnection primarily focuses on providing theoretical existence guarantees of highly connected partitions for a limited set of dense graphs, and do not include canonical GP considerations such as size balance and compactness. This paper's key contribution is providing a general modeling and algorithmic approach for HCGP, inspired by recent work in the political districting problem, a special case of HCGP with $Q=1$. This approach models $Q$-connectivity constraints as mixed integer programs for any $Q\geq 1$ and provides an efficient branch-and-cut method to solve HCGP. When solution time is a priority over optimality, this paper provides a heuristic method specifically designed for HCGP with $Q=2$. A computational analysis evaluates these methods using a test bed of instances from various real-world graphs. In this analysis, the branch-and-cut method finds an optimal solution within one hour in $82.8\%$ of the instances solved. For $Q=2$, small and sparse instances are challenging for the heuristic, whereas large and sparse instances are challenging for the exact method. Furthermore, this study quantifies the computational cost of ensuring higher connectivity using the branch-and-cut approach, compared to a baseline of ensuring $1$-connectivity. Overall, this work serves as an effective tool to partition a graph into resilient and cohesive parts.


title: It's all about PR -- Smart Benchmarking AI Accelerators using Performance Representatives

abstract: Statistical models are widely used to estimate the performance of commercial off-the-shelf (COTS) AI hardware accelerators. However, training of statistical performance models often requires vast amounts of data, leading to a significant time investment and can be difficult in case of limited hardware availability. To alleviate this problem, we propose a novel performance modeling methodology that significantly reduces the number of training samples while maintaining good accuracy. Our approach leverages knowledge of the target hardware architecture and initial parameter sweeps to identify a set of Performance Representatives (PR) for deep neural network (DNN) layers. These PRs are then used for benchmarking, building a statistical performance model, and making estimations. This targeted approach drastically reduces the number of training samples needed, opposed to random sampling, to achieve a better estimation accuracy. We achieve a Mean Absolute Percentage Error (MAPE) of as low as 0.02% for single-layer estimations and 0.68% for whole DNN estimations with less than 10000 training samples. The results demonstrate the superiority of our method for single-layer estimations compared to models trained with randomly sampled datasets of the same size.


title: Genetic Column Generation for Computing Lower Bounds for Adversarial Classification

abstract: Recent theoretical results on adversarial multi-class classification showed a similarity to the multi-marginal formulation of Wasserstein-barycenter in optimal transport. Unfortunately, both problems suffer from the curse of dimension, making it hard to exploit the nice linear program structure of the problems for numerical calculations. We investigate how ideas from Genetic Column Generation for multi-marginal optimal transport can be used to overcome the curse of dimension in computing the minimal adversarial risk in multi-class classification.


title: UDON: Universal Dynamic Online distillatioN for generic image representations

abstract: Universal image representations are critical in enabling real-world fine-grained and instance-level recognition applications, where objects and entities from any domain must be identified at large scale. Despite recent advances, existing methods fail to capture important domain-specific knowledge, while also ignoring differences in data distribution across different domains. This leads to a large performance gap between efficient universal solutions and expensive approaches utilising a collection of specialist models, one for each domain. In this work, we make significant strides towards closing this gap, by introducing a new learning technique, dubbed UDON (Universal Dynamic Online DistillatioN). UDON employs multi-teacher distillation, where each teacher is specialized in one domain, to transfer detailed domain-specific knowledge into the student universal embedding. UDON's distillation approach is not only effective, but also very efficient, by sharing most model parameters between the student and all teachers, where all models are jointly trained in an online manner. UDON also comprises a sampling technique which adapts the training process to dynamically allocate batches to domains which are learned slower and require more frequent processing. This boosts significantly the learning of complex domains which are characterised by a large number of classes and long-tail distributions. With comprehensive experiments, we validate each component of UDON, and showcase significant improvements over the state of the art in the recent UnED benchmark. Code: https://github.com/nikosips/UDON .


title: Review of Autonomous Mobile Robots for the Warehouse Environment

abstract: Autonomous mobile robots (AMRs) have been a rapidly expanding research topic for the past decade. Unlike their counterpart, the automated guided vehicle (AGV), AMRs can make decisions and do not need any previously installed infrastructure to navigate. Recent technological developments in hardware and software have made them more feasible, especially in warehouse environments. Traditionally, most wasted warehouse expenses come from the logistics of moving material from one point to another, and is exhaustive for humans to continuously walk those distances while carrying a load. Here, AMRs can help by working with humans to cut down the time and effort of these repetitive tasks, improving performance and reducing the fatigue of their human collaborators. This literature review covers the recent developments in AMR technology including hardware, robotic control, and system control. This paper also discusses examples of current AMR producers, their robots, and the software that is used to control them. We conclude with future research topics and where we see AMRs developing in the warehouse environment.


title: ProTrain: Efficient LLM Training via Memory-Aware Techniques

abstract: It is extremely memory-hungry to train Large Language Models (LLM). To solve this problem, existing work exploits the combination of CPU and GPU for the training process, such as ZeRO-Offload. Such a technique largely democratizes billion-scale model training, making it possible to train with few consumer graphics cards. However, based on our observation, existing frameworks often provide coarse-grained memory management and require experienced experts in configuration tuning, leading to suboptimal hardware utilization and performance. This paper proposes ProTrain, a novel training system that intelligently balances memory usage and performance by coordinating memory, computation, and IO. ProTrain achieves adaptive memory management through Chunk-Based Model State Management and Block-Wise Activation Management, guided by a Memory-Aware Runtime Profiler without user intervention. ProTrain does not change the training algorithm and thus does not compromise accuracy. Experiments show that ProTrain improves training throughput by 1.43$\times$ to 2.71$\times$ compared to the SOTA training systems.


title: A Survey of Pipeline Tools for Data Engineering

abstract: Currently, a variety of pipeline tools are available for use in data engineering. Data scientists can use these tools to resolve data wrangling issues associated with data and accomplish some data engineering tasks from data ingestion through data preparation to utilization as input for machine learning (ML). Some of these tools have essential built-in components or can be combined with other tools to perform desired data engineering operations. While some tools are wholly or partly commercial, several open-source tools are available to perform expert-level data engineering tasks. This survey examines the broad categories and examples of pipeline tools based on their design and data engineering intentions. These categories are Extract Transform Load/Extract Load Transform (ETL/ELT), pipelines for Data Integration, Ingestion, and Transformation, Data Pipeline Orchestration and Workflow Management, and Machine Learning Pipelines. The survey also provides a broad outline of the utilization with examples within these broad groups and finally, a discussion is presented with case studies indicating the usage of pipeline tools for data engineering. The studies present some first-user application experiences with sample data, some complexities of the applied pipeline, and a summary note of approaches to using these tools to prepare data for machine learning.