title: ZSC-Eval: An Evaluation Toolkit and Benchmark for Multi-agent Zero-shot Coordination

abstract: Zero-shot coordination (ZSC) is a new cooperative multi-agent reinforcement learning (MARL) challenge that aims to train an ego agent to work with diverse, unseen partners during deployment. The significant difference between the deployment-time partners' distribution and the training partners' distribution determined by the training algorithm makes ZSC a unique out-of-distribution (OOD) generalization challenge. The potential distribution gap between evaluation and deployment-time partners leads to inadequate evaluation, which is exacerbated by the lack of appropriate evaluation metrics. In this paper, we present ZSC-Eval, the first evaluation toolkit and benchmark for ZSC algorithms. ZSC-Eval consists of: 1) Generation of evaluation partner candidates through behavior-preferring rewards to approximate deployment-time partners' distribution; 2) Selection of evaluation partners by Best-Response Diversity (BR-Div); 3) Measurement of generalization performance with various evaluation partners via the Best-Response Proximity (BR-Prox) metric. We use ZSC-Eval to benchmark ZSC algorithms in Overcooked and Google Research Football environments and get novel empirical findings. We also conduct a human experiment of current ZSC algorithms to verify the ZSC-Eval's consistency with human evaluation. ZSC-Eval is now available at https://github.com/sjtu-marl/ZSC-Eval.


abstract: The extrapolation capability of Large Language Models (LLMs) based on Rotary Position Embedding is currently a topic of considerable interest. The mainstream approach to addressing extrapolation with LLMs involves modifying RoPE by replacing 10000, the rotary base of $\theta_n={10000}^{-2n/d}$ in the original RoPE, with a larger value and providing longer fine-tuning text. In this work, we first observe that fine-tuning a RoPE-based LLM with either a smaller or larger base in pre-training context length could significantly enhance its extrapolation performance. After that, we propose \textbf{\textit{Scaling Laws of RoPE-based Extrapolation}}, a unified framework from the periodic perspective, to describe the relationship between the extrapolation performance and base value as well as tuning context length. In this process, we also explain the origin of the RoPE-based extrapolation issue by \textbf{\textit{critical dimension for extrapolation}}. Besides these observations and analyses, we achieve extrapolation up to 1 million context length within only 16K training length on LLaMA2 7B and 13B.


title: TILFA: A Unified Framework for Text, Image, and Layout Fusion in Argument Mining

abstract: A main goal of Argument Mining (AM) is to analyze an author's stance. Unlike previous AM datasets focusing only on text, the shared task at the 10th Workshop on Argument Mining introduces a dataset including both text and images. Importantly, these images contain both visual elements and optical characters. Our new framework, TILFA (A Unified Framework for Text, Image, and Layout Fusion in Argument Mining), is designed to handle this mixed data. It excels at not only understanding text but also detecting optical characters and recognizing layout details in images. Our model significantly outperforms existing baselines, earning our team, KnowComp, the 1st place in the leaderboard of Argumentative Stance Classification subtask in this shared task.


title: Phase behaviour of semiflexible lattice polymers in poor-solvent solution: mean-field theory and Monte Carlo simulations

abstract: We study a solution of interacting semiflexible polymers with curvature energy in poor-solvent conditions on the d-dimensional cubic lattice using mean-field theory and Monte Carlo computer simulations. Building upon past studies on a single chain, we construct a field-theory representation of the system and solve it within a mean-field approximation supported by Monte Carlo simulations in d=3. A gas-liquid transition is found in the temperature-density plane that is then interpreted in terms of real systems. Interestingly, we find this transition to be independent of the bending rigidity. Past classical Flory-Huggins and Flory mean-field results are shown to be particular cases of this more general framework. Perspectives in terms of guiding experimental results towards optimal conditions are also proposed.


title: Interpretable Semiotics Networks Representing Awareness

abstract: Humans perceive objects daily and communicate their perceptions using various channels. Here, we describe a computational model that tracks and simulates objects' perception and their representations as they are conveyed in communication. We describe two key components of our internal representation ("observed" and "seen") and relate them to familiar computer vision notions (encoding and decoding). These elements are joined together to form semiotics networks, which simulate awareness in object perception and human communication. Nowadays, most neural networks are uninterpretable. On the other hand, our model overcomes this limitation. The experiments demonstrates the visibility of the model. Our model of object perception by a person allows us to define object perception by a network. We demonstrate this with an example of an image baseline classifier by constructing a new network that includes the baseline classifier and an additional layer. This layer produces the images "perceived" by the entire network, transforming it into a perceptualized image classifier. Within our network, the internal image representations become more efficient for classification tasks when they are assembled and randomized. In our experiments, the perceptualized network outperformed the baseline classifier on MNIST training databases consisting of a restricted number of images. Our model is not limited to persons and can be applied to any system featuring a loop involving the processing from "internal" to "external" representations.


title: A Quantum Approach for Reducing Communications in Classical Cryptographic Primitives

abstract: How could quantum cryptography help us achieve what are not achievable in classical cryptography? In this work we consider the following problem, which we call succinct RSPV for classical functions (SRC). Suppose $f$ is a function described by a polynomial time classical Turing machine, which is public; the client would like to sample a random $x$ as the function input and use a protocol to send $f(x)$ to the server. What's more, (1) when the server is malicious, what it knows in the passing space should be no more than $f(x)$; (2) the communication should be succinct (that is, independent to the running time of evaluating $f$). Solving this problem in classical cryptography seems to require strong cryptographic assumptions. We show that, perhaps surprisingly, it's possible to solve this problem with quantum techniques under much weaker assumptions. By allowing for quantum communication and computations, we give a protocol for this problem assuming only collapsing hash functions [Unr16]. Our work conveys an interesting message that quantum cryptography could outperform classical cryptography in a new type of problems, that is, to reduce communications in meaningful primitives without using heavy classical cryptographic assumptions.


title: Resonant optical trapping of Janus nanoparticles in plasmonic nanoaperture

abstract: Controlled trapping of light absorbing nanoparticles with low-power optical tweezers is crucial for remote manipulation of small objects. This study takes advantage of the synergetic effects of tightly confined local fields of plasmonic nanoaperture, self-induced back-action of nanoparticles, and resonant optical trapping method to demonstrate enhanced manipulation of Janus nanoparticles in metallic nanohole aperture. We theoretically demonstrate that displacement of Au-coated Janus nanoparticles toward plasmonic nanoaperture and proper orientation of the metal coating give rise to enhanced near-field intensity and pronounced optical force. We also explore the effect of resonant optical trapping by employing dual laser system, where an on-resonant green laser excites the metal-coated nanoparticle whereas an off-resonant near-infrared laser plays trapping role. It is found that, at optimum nanoparticle configuration, the resonant optical trapping technique can result in three-fold enhancement of optical force, which is attributed to excitation of surface plasmon resonance in Janus nanoparticles. The findings of this study might pave the way for low power optical manipulation of light-absorbing nanoparticles with possible applications in nanorobotics and drug delivery.


title: Motion Matching for Character Animation and Virtual Reality Avatars in Unity

abstract: Real-time animation of virtual characters has traditionally been accomplished by playing short sequences of animations structured in the form of a graph. These methods are time-consuming to set up and scale poorly with the number of motions required in modern virtual environments. The ever-increasing need for highly-realistic virtual characters in fields such as entertainment, virtual reality, or the metaverse has led to significant advances in the field of data-driven character animation. Techniques like Motion Matching have provided enough versatility to conveniently animate virtual characters using a selection of features from an animation database. Data-driven methods retain the quality of the captured animations, thus delivering smoother and more natural-looking animations. In this work, we researched and developed a Motion Matching technique for the Unity game engine. In this thesis, we present our findings on how to implement an animation system based on Motion Matching. We also introduce a novel method combining body orientation prediction with Motion Matching to animate avatars for consumer-grade virtual reality systems.


title: Probing Large Language Models from A Human Behavioral Perspective

abstract: Large Language Models (LLMs) have emerged as dominant foundational models in modern NLP. However, the understanding of their prediction processes and internal mechanisms, such as feed-forward networks (FFN) and multi-head self-attention (MHSA), remains largely unexplored. In this work, we probe LLMs from a human behavioral perspective, correlating values from LLMs with eye-tracking measures, which are widely recognized as meaningful indicators of human reading patterns. Our findings reveal that LLMs exhibit a similar prediction pattern with humans but distinct from that of Shallow Language Models (SLMs). Moreover, with the escalation of LLM layers from the middle layers, the correlation coefficients also increase in FFN and MHSA, indicating that the logits within FFN increasingly encapsulate word semantics suitable for predicting tokens from the vocabulary.


title: PointGAT: A quantum chemical property prediction model integrating graph attention and 3D geometry

abstract: Predicting quantum chemical properties is a fundamental challenge for computational chemistry. While the development of graph neural networks has advanced molecular representation learning and property prediction, their performance could be further enhanced by incorporating 3D structural geometry into 2D molecular graph representation. In this study, we introduce the PointGAT model for quantum molecular property prediction, which integrates 3D molecular coordinates with graph-attention modeling. Comparison with other current models in molecular prediction tasks showed that PointGAT could provide higher predictive accuracy in various benchmark datasets from MoleculeNet, including ESOL, FreeSolv, Lipop, HIV, and 10 out of 12 tasks of the QM9 dataset. To further examine PointGAT prediction of quantum mechanical (QM) energies, we constructed a C10 dataset comprising 11,841 charged and chiral carbocation intermediates with QM energies calculated at the DM21/6-31G*//B3LYP/6-31G* levels. Notably, PointGAT achieved an R2 value of 0.950 and an MAE of 1.616 kcal/mol, outperforming other models. Additional ablation studies indicated that incorporating molecular geometry into the model resulted in markedly higher predictive accuracy, reducing the MAE value from 1.802 kcal/mol to 1.616 kcal/mol. Moreover, visualization of PointGAT atomic attention weights suggested its predictions were interpretable. Findings in this study support the application of PointGAT as a powerful and versatile tool for quantum chemical property prediction that can facilitate high-accuracy modeling for fundamental exploration of chemical space as well as drug design and molecular engineering.


title: Accelerating Machine Learning Primitives on Commodity Hardware

abstract: Sliding Window Sum algorithms have been successfully used for training and inference of Deep Neural Networks. We have shown before how both pooling and convolution 1-D primitives could be expressed as sliding sums and evaluated by the compute kernels with a shared structure. In this paper, we present an extensive study of the Sliding Window convolution technique as a more efficient alternative to the commonly used General Matrix Multiplication (GEMM) based convolution in Deep Neural Networks (DNNs). The Sliding Window technique addresses the memory bloating problem and demonstrates a significant speedup in 2-D convolution. We explore the performance of this technique on a range of implementations, including custom kernels for specific filter sizes. Our results suggest that the Sliding Window computation kernels can outperform GEMM-based convolution on a CPU and even on dedicated hardware accelerators. This could promote a wider adoption of AI on low-power and low-memory devices without the need for specialized hardware. We also discuss the compatibility of model compression methods and optimized network architectures with the Sliding Window technique, encouraging further research in these areas.


title: $\require{mhchem}$Quantum paramagnetism in the decorated square-kagome antiferromagnet $\ce{Na6Cu7BiO4(PO4)4Cl3}$

abstract: $\require{mhchem}$The square-kagome lattice Heisenberg antiferromagnet is a highly frustrated Hamiltonian whose material realizations have been scarce. We theoretically investigate the recently synthesized $\ce{Na6Cu7BiO4(PO4)4Cl3}$ where a Cu$^{2+}$ spin-$1/2$ square-kagome lattice (with six site unit cell) is decorated by a seventh magnetic site alternatingly above and below the layers. The material does not show any sign of long-range magnetic order down to 50 mK despite a Curie-Weiss temperature of $-212$ K indicating a quantum paramagnetic phase. Our DFT energy mapping elicits a purely antiferromagnetic Hamiltonian that features longer range exchange interactions beyond the pure square-kagome model and, importantly, we find the seventh site to be strongly coupled to the plane. We combine two variational Monte Carlo approaches, pseudo-fermion/Majorana functional renormalization group and Schwinger-Boson mean field calculations to show that the complex Hamiltonian of $\ce{Na6Cu7BiO4(PO4)4Cl3}$ still features a nonmagnetic ground state. We explain how the seventh Cu$^{2+}$ site actually aids the stabilization of the disordered state. We predict static and dynamic spin structure factors to guide future neutron scattering experiments.


title: Small limit cycles bifurcating in pendulum systems under trigonometric perturbations

abstract: In this paper, we consider the bifurcation of small-amplitude limit cycles near the origin in perturbed pendulum systems of the form $\dot x= y$, $\dot y=-\sin(x)+\varepsilon Q(x,y)$, where $Q(x,y)$ is a smooth or piecewise smooth polynomial in the triple $(\sin(x),\cos(x), y)$ with free coefficients. We obtain the sharp upper bound on the number of positive zeros of its associated first order Melnikov function near $h=0$ for $Q(x,y)$ being smooth and piecewise smooth with the discontinuity at $y=0$, respectively.


title: Inflationary models constrained by reheating

abstract: The study of reheating in inflationary models is crucial for understanding the early universe and gaining insights into inflationary dynamics and parameters. The reheating temperature $T_{re}$ and the duration of the reheating phase, quantified by the number of $e$-folds $N_{re}$, have significant implications for particle production, thermalization, and the primordial power spectrum. The duration of reheating affects particle abundance, including dark matter, and shapes the primordial power spectrum and cosmic microwave background anisotropies. By combining cosmological observations and theoretical considerations, we can constrain both $T_{re}$ and $N_{re}$, which in turn constrain the spectral index $n_s$, tensor-to-scalar ratio $r$, and inflation model parameters. Utilizing consistency relations among observables, such as $n_s$ and $r$, provides additional constraints on inflationary models and determines bounds for other observables like the running of the scalar spectral index. These bounds are valuable for assessing the viability of models and can serve to specify priors in Bayesian analyses of specific models. As an example of how to proceed, we study in detail a particular case of a generalized $\alpha$-attractor model that accurately reproduces observed quantities. We present equations for the conditions of instantaneous reheating, establish consistency relations, and explore the generalized $\alpha$-attractor model using cosmological data.


title: ROSTAM: A Passwordless Web Single Sign-on Solution Mitigating Server Breaches and Integrating Credential Manager and Federated Identity Systems

abstract: The challenge of achieving passwordless user authentication is real given the prevalence of web applications that keep asking passwords. Complicating this issue further, in an enterprise environment, a single sign-on (SSO) service is often maintained but not all applications can be integrated with it. We envision a passwordless future which provides a frictionless and trustworthy online experience for users by integrating credential management and federated identity systems. In this regard, our implementation ROSTAM offers a dashboard that presents all applications the user can access with a single click after a passwordless SSO. The security of web passwords on the credential manager is ensured with a Master Key, rather than a Master Password, so that encrypted passwords can remain secure even if stolen from the server. We propose and implement novel techniques for synchronization (pairing) and recovery of this Master Key. We compare our solution to previous work using different evaluation frameworks, demonstrating that our hybrid solution combines the benefits of credential management and federated identity systems.


title: Do Automatic Test Generation Tools Generate Flaky Tests?

abstract: Non-deterministic test behavior, or flakiness, is common and dreaded among developers. Researchers have studied the issue and proposed approaches to mitigate it. However, the vast majority of previous work has only considered developer-written tests. The prevalence and nature of flaky tests produced by test generation tools remain largely unknown. We ask whether such tools also produce flaky tests and how these differ from developer-written ones. Furthermore, we evaluate mechanisms that suppress flaky test generation. We sample 6 356 projects written in Java or Python. For each project, we generate tests using EvoSuite (Java) and Pynguin (Python), and execute each test 200 times, looking for inconsistent outcomes. Our results show that flakiness is at least as common in generated tests as in developer-written tests. Nevertheless, existing flakiness suppression mechanisms implemented in EvoSuite are effective in alleviating this issue (71.7 % fewer flaky tests). Compared to developer-written flaky tests, the causes of generated flaky tests are distributed differently. Their non-deterministic behavior is more frequently caused by randomness, rather than by networking and concurrency. Using flakiness suppression, the remaining flaky tests differ significantly from any flakiness previously reported, where most are attributable to runtime optimizations and EvoSuite-internal resource thresholds. These insights, with the accompanying dataset, can help maintainers to improve test generation tools, give recommendations for developers using these tools, and serve as a foundation for future research in test flakiness or test generation.


title: Generative Spoken Language Model based on continuous word-sized audio tokens

abstract: In NLP, text language models based on words or subwords are known to outperform their character-based counterparts. Yet, in the speech community, the standard input of spoken LMs are 20ms or 40ms-long discrete units (shorter than a phoneme). Taking inspiration from word-based LM, we introduce a Generative Spoken Language Model (GSLM) based on word-size continuous-valued audio embeddings that can generate diverse and expressive language output. This is obtained by replacing lookup table for lexical types with a Lexical Embedding function, the cross entropy loss by a contrastive loss, and multinomial sampling by k-NN sampling. The resulting model is the first generative language model based on word-size continuous embeddings. Its performance is on par with discrete unit GSLMs regarding generation quality as measured by automatic metrics and subjective human judgements. Moreover, it is five times more memory efficient thanks to its large 200ms units. In addition, the embeddings before and after the Lexical Embedder are phonetically and semantically interpretable.


title: Combinatorics of pruned Hurwitz numbers

abstract: Hurwitz numbers enumerate branched morphisms between Riemannn surfaces with fixed numerical data. They represent important objects in enumerative geometry that are accessible by combinatorial techniques. In the past decade, many variants of Hurwitz numbers have appeared in the literature. In this paper, we focus on an exciting such variant that arises naturally from the theory of topological recursion: Pruned Hurwitz numbers. These are defined as an enumeration of a relevant subset of branched morphisms between Riemann surfaces, that yield smaller numbers than their classical counterparts while retaining maximal information. Thus, pruned Hurwitz numbers may be viewed as the core of the Hurwitz problem. In this paper, we develop the combinatorial theory of pruned Hurwitz numbers. In particular, motivated by the successful application of combinatorial techniques to classical Hurwitz numbers, we derive two new combinatorial expressions of pruned Hurwitz numbers. Firstly, we show that they may be expressed in terms of Hurwitz mobiles which are tree-like structure that arise from the theory of random planar maps. Secondly, we prove a tropical correspondence theorem which allows the enumeration of pruned Hurwitz numbers in terms of tropical covers.


title: Models of Chemotactic System by Einstein's Brownian Motion Method and its Analysis

abstract: We study the movement of the living organism in a band form towards the presence of chemical substrates based on a system of partial differential evolution equations. We incorporate Einstein's method of Brownian motion to deduce the chemotactic model exhibiting a traveling band. It is the first time that Einstein's method has been used to motivate equations describing the mutual interaction of the chemotactic system. We have shown that in the presence of limited and unlimited substrate, traveling bands are achievable and it has been explained accordingly. We also study the stability of the constant steady states for the system. The linearized system about a constant steady state is obtained under the mixed Dirichlet and Neumann boundary conditions. We are able to find explicit conditions for linear instability. The linear stability is established with respect to the L-2 norm, H1-norm, and L-infinity norm under certain conditions.


title: Physics-aware Machine Learning Revolutionizes Scientific Paradigm for Machine Learning and Process-based Hydrology

abstract: Accurate hydrological understanding and water cycle prediction are crucial for addressing scientific and societal challenges associated with the management of water resources, particularly under the dynamic influence of anthropogenic climate change. Existing reviews predominantly concentrate on the development of machine learning (ML) in this field, yet there is a clear distinction between hydrology and ML as separate paradigms. Here, we introduce physics-aware ML as a transformative approach to overcome the perceived barrier and revolutionize both fields. Specifically, we present a comprehensive review of the physics-aware ML methods, building a structured community (PaML) of existing methodologies that integrate prior physical knowledge or physics-based modeling into ML. We systematically analyze these PaML methodologies with respect to four aspects: physical data-guided ML, physics-informed ML, physics-embedded ML, and physics-aware hybrid learning. PaML facilitates ML-aided hypotheses, accelerating insights from big data and fostering scientific discoveries. We first conduct a systematic review of hydrology in PaML, including rainfall-runoff hydrological processes and hydrodynamic processes, and highlight the most promising and challenging directions for different objectives and PaML methods. Finally, a new PaML-based hydrology platform, termed HydroPML, is released as a foundation for hydrological applications. HydroPML enhances the explainability and causality of ML and lays the groundwork for the digital water cycle's realization. The HydroPML platform is publicly available at https://hydropml.github.io/.


title: Recent Progress in Leptonic and Semileptonic Decays of Charmed Hadrons

abstract: We present a comprehensive review of purely leptonic and semileptonic decays of $D^{0(+)}$, $D_s^{+}$, and charmed baryons (including $\Lambda_c^{+}$, $\Xi_c$ and $\Omega_c$). The precise studies of these decays help deepen our understanding and knowledge of quantum chromodynamics via measuring decay constants and form factors, and test the Standard Model through examining the unitarity of Cabibbo-Kobayashi-Maskawa matrix and lepton flavor universality. We give an overview of the theoretical and experimental tools before discussing the recent progress. The data sets collected by BESIII near the production thresholds of $D\bar{D}$, $D_s^{(*)+}D_s^{(*)-}$ and $\Lambda_c^{+}\bar{\Lambda}_c^{-}$ offer important opportunities for studies of charm physics.


title: Design Verification of the Quantum Control Stack

abstract: This paper describes the verification of the classical software and hardware stack that is used to control cold atom- and superconducting-based quantum computing hardware. The paper serves both as an introduction to quantum computing and to how classical device verification techniques can be employed there. Two main challenges in building a quantum control stack are generating precise deterministic-timing operations at the edge and scaled-out processing in the middle layer. Both challenges are to do with a certain kind of functional performance correctness. And, as usual, the design lives under tight power, memory and latency constraints. The quantum control stack is a complex interaction of algorithms, software runtimes and digital hardware. We take inspiration from modern software approaches to engineering, such as continuous integration and hardware automation, to quickly ship experimental features to customers in the field.


title: Global Convergence of Policy Gradient Methods in Reinforcement Learning, Games and Control

abstract: Policy gradient methods, where one searches for the policy of interest by maximizing the value functions using first-order information, become increasingly popular for sequential decision making in reinforcement learning, games, and control. Guaranteeing the global optimality of policy gradient methods, however, is highly nontrivial due to nonconcavity of the value functions. In this exposition, we highlight recent progresses in understanding and developing policy gradient methods with global convergence guarantees, putting an emphasis on their finite-time convergence rates with regard to salient problem parameters.


title: MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients' Journaling

abstract: In the mental health domain, Large Language Models (LLMs) offer promising new opportunities, though their inherent complexity and low controllability have raised questions about their suitability in clinical settings. We present MindfulDiary, a mobile journaling app incorporating an LLM to help psychiatric patients document daily experiences through conversation. Designed in collaboration with mental health professionals (MHPs), MindfulDiary takes a state-based approach to safely comply with the experts' guidelines while carrying on free-form conversations. Through a four-week field study involving 28 patients with major depressive disorder and five psychiatrists, we found that MindfulDiary supported patients in consistently enriching their daily records and helped psychiatrists better empathize with their patients through an understanding of their thoughts and daily contexts. Drawing on these findings, we discuss the implications of leveraging LLMs in the mental health domain, bridging the technical feasibility and their integration into clinical settings.


title: Fine particle percolation in a sheared granular bed

abstract: We study the percolation velocity, $v_p,$ of a fine spherical particle in a sheared large-particle bed under gravity using discrete element method simulations for large-to-fine particle diameter ratios, $R=d/d_f,$ below and above the free-sifting threshold, $R_t\approx6.5.$ For $R<R_t,$ $v_p$ initially increases with increasing shear rate, $\dot\gamma,$ as shear-driven bed rearrangement reduces fine-particle trapping but then decreases toward zero due to fine-particle excitation for $\dot\gamma\sqrt{d/g}\gtrsim 0.1$. For $R>R_t$, $v_p$ is constant at low $\dot\gamma$ but decreases toward zero at higher shear rates due to fine-particle excitation.


title: Realization of multiple topological states and topological phase transitions in (4,0) carbon nanotube derivatives

abstract: Exploring various topological states (TS) and topological phase transitions (TPT) has attracted great attention in condensed matter physics. However, so far, there is rarely a typical material system that can be used as a platform to study the TS and TPT as the system transforms from one-dimensional (1D) nanoribbons to two-dimensional (2D) sheet then to three-dimensional (3D) bulk. Here, we first propose that some typical TS in 1D, 2D, and 3D systems can be realized in a tight-binding (TB) model. Following the TB model and further based on first-principles electronic structure calculations, we demonstrate that the structurally stable (4,0) carbon nanotube derivatives are an ideal platform to explore the semiconductor/nodal-point semimetal states in 1D nanoribbons [1D-(4,0)-C16H4 and 1D-(4,0)-C32H4], nodal-ring semimetal state in 2D sheet [2D-(4,0)-C16], and nodal-cage semimetal state in 3D bulk [3D-(4,0)-C16]. Furthermore, we calculate the characteristic band structures and the edge/surface states of 2D-(4,0)-C16 and 3D-(4,0)-C16 to confirm their nontrivial topological properties. Our work not only provides new excellent 2D and 3D members for the topological carbon material family, but also serves as an ideal template for the study of TS and TPT with the change of system dimension.


title: Ten limit cycles near a cubic homoclinic loop with a nilpotent cusp

abstract: In this paper, we study the bifurcation of limit cycles near a homoclinic cuspidal loop in a planar cubic near-Hamiltonian system by high-order Melnikov functions. We present a method combining the algebraic structure of Abelian integrals and Picard-Fuchs equation for computing the corresponding asymptotic expansion of Melnikov functions near the cuspidal loop. Using this system as an example, we show that planar cubic systems can have ten limit cycles bifurcating near a cubic homoclinic loop.


title: XLS-R fine-tuning on noisy word boundaries for unsupervised speech segmentation into words

abstract: Due to the absence of explicit word boundaries in the speech stream, the task of segmenting spoken sentences into word units without text supervision is particularly challenging. In this work, we leverage the most recent self-supervised speech models that have proved to quickly adapt to new tasks through fine-tuning, even in low resource conditions. Taking inspiration from semi-supervised learning, we fine-tune an XLS-R model to predict word boundaries themselves produced by top-tier speech segmentation systems: DPDP, VG-HuBERT, GradSeg and DP-Parse. Once XLS-R is fine-tuned, it is used to infer new word boundary labels that are used in turn for another fine-tuning step. Our method consistently improves the performance of each system and sets a new state-of-the-art that is, on average 130% higher than the previous one as measured by the F1 score on correctly discovered word tokens on five corpora featuring different languages. Finally, our system can segment speech from languages unseen during fine-tuning in a zero-shot fashion.


title: Enhancing Kernel Flexibility via Learning Asymmetric Locally-Adaptive Kernels

abstract: The lack of sufficient flexibility is the key bottleneck of kernel-based learning that relies on manually designed, pre-given, and non-trainable kernels. To enhance kernel flexibility, this paper introduces the concept of Locally-Adaptive-Bandwidths (LAB) as trainable parameters to enhance the Radial Basis Function (RBF) kernel, giving rise to the LAB RBF kernel. The parameters in LAB RBF kernels are data-dependent, and its number can increase with the dataset, allowing for better adaptation to diverse data patterns and enhancing the flexibility of the learned function. This newfound flexibility also brings challenges, particularly with regards to asymmetry and the need for an efficient learning algorithm. To address these challenges, this paper for the first time establishes an asymmetric kernel ridge regression framework and introduces an iterative kernel learning algorithm. This novel approach not only reduces the demand for extensive support data but also significantly improves generalization by training bandwidths on the available training data. Experimental results on real datasets underscore the remarkable performance of the proposed algorithm, showcasing its superior capability in handling large-scale datasets compared to Nystr\"om approximation-based algorithms. Moreover, it demonstrates a significant improvement in regression accuracy over existing kernel-based learning methods and even surpasses residual neural networks.


title: Latent Diffusion Model for Medical Image Standardization and Enhancement

abstract: Computed tomography (CT) serves as an effective tool for lung cancer screening, diagnosis, treatment, and prognosis, providing a rich source of features to quantify temporal and spatial tumor changes. Nonetheless, the diversity of CT scanners and customized acquisition protocols can introduce significant inconsistencies in texture features, even when assessing the same patient. This variability poses a fundamental challenge for subsequent research that relies on consistent image features. Existing CT image standardization models predominantly utilize GAN-based supervised or semi-supervised learning, but their performance remains limited. We present DiffusionCT, an innovative score-based DDPM model that operates in the latent space to transform disparate non-standard distributions into a standardized form. The architecture comprises a U-Net-based encoder-decoder, augmented by a DDPM model integrated at the bottleneck position. First, the encoder-decoder is trained independently, without embedding DDPM, to capture the latent representation of the input data. Second, the latent DDPM model is trained while keeping the encoder-decoder parameters fixed. Finally, the decoder uses the transformed latent representation to generate a standardized CT image, providing a more consistent basis for downstream analysis. Empirical tests on patient CT images indicate notable improvements in image standardization using DiffusionCT. Additionally, the model significantly reduces image noise in SPAD images, further validating the effectiveness of DiffusionCT for advanced imaging tasks.


title: Design and simulation of a transmon qubit chip for Axion detection

abstract: Quantum Sensing is a rapidly expanding research field that finds one of its applications in Fundamental Physics, as the search for Dark Matter. Devices based on superconducting qubits have already been successfully applied in detecting few-GHz single photons via Quantum Non-Demolition measurement (QND). This technique allows us to perform repeatable measurements, bringing remarkable sensitivity improvements and dark count rate suppression in experiments based on high-precision microwave photon detection, such as for Axions and Dark Photons search. In this context, the INFN Qub-IT project goal is to realize an itinerant single-photon counter based on superconducting qubits that will exploit QND for enhancing Axion search experiments. In this study, we present Qub-IT's status towards the realization of its first superconducting qubit device, illustrating design and simulation procedures and the characterization of fabricated Coplanar Waveguide Resonators (CPWs) for readout. We match target qubit parameters and assess a few-percent level agreement between lumped and distributed element simulation models. We reach a maximum internal quality factor of 9.2x10^5 for -92 dBm on-chip readout power.


title: LAN-grasp: Using Large Language Models for Semantic Object Grasping

abstract: In this paper, we propose LAN-grasp, a novel approach towards more appropriate semantic grasping. We use foundation models to provide the robot with a deeper understanding of the objects, the right place to grasp an object, or even the parts to avoid. This allows our robot to grasp and utilize objects in a more meaningful and safe manner. We leverage the combination of a Large Language Model, a Vision Language Model, and a traditional grasp planner to generate grasps demonstrating a deeper semantic understanding of the objects. We first prompt the Large Language Model about which object part is appropriate for grasping. Next, the Vision Language Model identifies the corresponding part in the object image. Finally, we generate grasp proposals in the region proposed by the Vision Language Model. Building on foundation models provides us with a zero-shot grasp method that can handle a wide range of objects without the need for further training or fine-tuning. We evaluated our method in real-world experiments on a custom object data set. We present the results of a survey that asks the participants to choose an object part appropriate for grasping. The results show that the grasps generated by our method are consistently ranked higher by the participants than those generated by a conventional grasping planner and a recent semantic grasping approach.


title: Limitations of Stochastic Selection with Pairwise Independent Priors

abstract: Motivated by the growing interest in correlation-robust stochastic optimization, we investigate stochastic selection problems beyond independence. Specifically, we consider the instructive case of pairwise-independent priors and matroid constraints. We obtain essentially-optimal bounds for contention resolution and prophet inequalities. The impetus for our work comes from the recent work of Caragiannis et al., who derived a constant-approximation for the single-choice prophet inequality with pairwise-independent priors. For general matroids, our results are tight and largely negative. For both contention resolution and prophet inequalities, our impossibility results hold for the full linear matroid over a finite field. We explicitly construct pairwise-independent distributions which rule out an omega(1/Rank)-balanced offline CRS and an omega(1/log Rank)-competitive prophet inequality against the (usual) oblivious adversary. For both results, we employ a generic approach for constructing pairwise-independent random vectors -- one which unifies and generalizes existing pairwise-independence constructions from the literature on universal hash functions and pseudorandomness. Specifically, our approach is based on our observation that random linear maps turn linear independence into stochastic independence. We then examine the class of matroids which satisfy the so-called partition property -- these include most common matroids encountered in optimization. We obtain positive results for both online contention resolution and prophet inequalities with pairwise-independent priors on such matroids, approximately matching the corresponding guarantees for fully independent priors. These algorithmic results hold against the almighty adversary for both problems.


title: SCANet: Scene Complexity Aware Network for Weakly-Supervised Video Moment Retrieval

abstract: Video moment retrieval aims to localize moments in video corresponding to a given language query. To avoid the expensive cost of annotating the temporal moments, weakly-supervised VMR (wsVMR) systems have been studied. For such systems, generating a number of proposals as moment candidates and then selecting the most appropriate proposal has been a popular approach. These proposals are assumed to contain many distinguishable scenes in a video as candidates. However, existing proposals of wsVMR systems do not respect the varying numbers of scenes in each video, where the proposals are heuristically determined irrespective of the video. We argue that the retrieval system should be able to counter the complexities caused by varying numbers of scenes in each video. To this end, we present a novel concept of a retrieval system referred to as Scene Complexity Aware Network (SCANet), which measures the `scene complexity' of multiple scenes in each video and generates adaptive proposals responding to variable complexities of scenes in each video. Experimental results on three retrieval benchmarks (i.e., Charades-STA, ActivityNet, TVR) achieve state-of-the-art performances and demonstrate the effectiveness of incorporating the scene complexity.


title: ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data

abstract: Radiology report generation, as a key step in medical image analysis, is critical to the quantitative analysis of clinically informed decision-making levels. However, complex and diverse radiology reports with cross-source heterogeneity pose a huge generalizability challenge to the current methods under massive data volume, mainly because the style and normativity of radiology reports are obviously distinctive among institutions, body regions inspected and radiologists. Recently, the advent of large language models (LLM) offers great potential for recognizing signs of health conditions. To resolve the above problem, we collaborate with the Second Xiangya Hospital in China and propose ChatRadio-Valuer based on the LLM, a tailored model for automatic radiology report generation that learns generalizable representations and provides a basis pattern for model adaptation in sophisticated analysts' cases. Specifically, ChatRadio-Valuer is trained based on the radiology reports from a single institution by means of supervised fine-tuning, and then adapted to disease diagnosis tasks for human multi-system evaluation (i.e., chest, abdomen, muscle-skeleton, head, and maxillofacial $\&$ neck) from six different institutions in clinical-level events. The clinical dataset utilized in this study encompasses a remarkable total of \textbf{332,673} observations. From the comprehensive results on engineering indicators, clinical efficacy and deployment cost metrics, it can be shown that ChatRadio-Valuer consistently outperforms state-of-the-art models, especially ChatGPT (GPT-3.5-Turbo) and GPT-4 et al., in terms of the diseases diagnosis from radiology reports. ChatRadio-Valuer provides an effective avenue to boost model generalization performance and alleviate the annotation workload of experts to enable the promotion of clinical AI applications in radiology reports.


title: On maximality of some solvable and locally nilpotent subalgebras of the Lie algebra $W_n(K)$

abstract: Let $K$ be an algebraically closed field of characteristic zero, $P_n=K[x_1, ..., x_n]$ the polynomial ring, and $W_n(K)$ the Lie algebra of all $K$-derivations on $P_n$. One of the most important subalgebras of $W_n(K)$ is the triangular subalgebra $u_n(K) = P_0\partial_1+\cdots+P_{n-1}\partial_n$, where $\partial_i:=\partial/\partial x_i$ are partial derivatives on $P_n$. This subalgebra consists of locally nilpotent derivations on $P_n.$ Such derivations define automorphisms of the ring $P_n$ and were studied by many authors. The subalgebra $u_n(K) $ is contained in another interesting subalgebra $s_n(K)=(P_0+x_1P_0)\partial_1+\cdots +(P_{n-1}+x_nP_{n-1})\partial_n,$ which is solvable of the derived length $2n$ that is the maximum derived length of solvable subalgebras of $W_n(K).$ It is proved that $u_n(K)$ is a maximal locally nilpotent subalgebra and $s_n(K)$ is a maximal solvable subalgebra of the Lie algebra $W_n(K).$


title: Orbital evolution of eccentric perturbers under dynamical friction: crossing the sound barrier

abstract: In a gaseous medium, dynamical friction (DF) reaches a maximum when the orbital speed of a (point-like) perturber moving on a circular orbit is close to the sound speed. Therefore, in a quasi-steady state, eccentric orbits of perturbers approaching the sound barrier (from below) should rapidly circularize as they experience the strongest drag at pericenter passage. To investigate this effect, we extend the solution of Desjacques et al. 2022 for circular DF in a uniform gaseous medium to eccentric Keplerian orbits. We derive an approximation to the steady-state DF force, which is valid for eccentricities as high as $e=0.9$ in a limited range of Mach number around the transition to supersonic regime. We validate our analytical result with 3-dimensional simulations of the gas density response. Although gaseous DF generally dissipates orbital energy, we find that it can be directed along the motion of the perturber near pericenter passage when the eccentricity is $e\gtrsim 0.9$. We apply our results to compute the long-time evolution of the orbital parameters. Most trajectories tend to circularize as the perturber moves into the supersonic regime. However, orbits with eccentricities $e\gtrsim 0.8$ below the sound barrier experience a slight increase in eccentricity as they loose orbital energy. Possible extensions to our analytical approach are also discussed.


title: Influence of Camera-LiDAR Configuration on 3D Object Detection for Autonomous Driving

abstract: Cameras and LiDARs are both important sensors for autonomous driving, playing critical roles in 3D object detection. Camera-LiDAR Fusion has been a prevalent solution for robust and accurate driving perception. In contrast to the vast majority of existing arts that focus on how to improve the performance of 3D target detection through cross-modal schemes, deep learning algorithms, and training tricks, we devote attention to the impact of sensor configurations on the performance of learning-based methods. To achieve this, we propose a unified information-theoretic surrogate metric for camera and LiDAR evaluation based on the proposed sensor perception model. We also design an accelerated high-quality framework for data acquisition, model training, and performance evaluation that functions with the CARLA simulator. To show the correlation between detection performance and our surrogate metrics, We conduct experiments using several camera-LiDAR placements and parameters inspired by self-driving companies and research institutions. Extensive experimental results of representative algorithms on nuScenes dataset validate the effectiveness of our surrogate metric, demonstrating that sensor configurations significantly impact point-cloud-image fusion based detection models, which contribute up to 30% discrepancy in terms of the average precision.


title: Revisiting Remote State Preparation with Verifiability: A New Set of Notions with Well-behaved Properties

abstract: In remote state preparation with verifiability (RSPV), a client would like to prepare a quantum state (sampled from a state family) on the server side, such that ideally the client knows its full description, while the server holds and only holds the state itself. A closely related notion called self-testing, which is recently generalized to the single-server computationally-secure setting [MV21], aims at certifying the server's operation. These notions have been widely studied in various different settings and have become fundamental building blocks in many quantum protocols. However, there are many variants of definitions in existing works, and many of these variants do not have some desirable properties like sequential composability. In this background, a new framework that could potentially support more general solutions is desirable. In this paper, we choose notions or basic ideas from existing works [BDSSTW01,GV19,Zha22,RY21] and introduce new notions, with the goal of developing a more general, well-behaved framework for these problems. We choose RSPV with simulation-based soundness [BDSSTW01,GV19,Zha22], and study its basic properties like composability. Furthermore, for controlling the server's operation in a verifiable way, we introduce a new notion named remote operator application with verifiability (ROAV) as a replacement of self-testing. In this notion the server is provided with an unknown input state, and is supposed to perform a specific operator (sampled from an operator family) to the state; the client knows the operator description, but what server knows in the end is limited to the output state of the operation applied on the input state. Finally, we show several basic constructions of protocols under our set of notions, and discuss why these notions could potentially lead to quantum cryptographic protocols with new functionalities.


title: Gorenstein acyclic complexes and finitistic dimensions

abstract: Given a two-sided noetherian ring $A$ with a dualizing complex, we show that the big finitistic dimension of $A$ is finite if and only if every bounded below Gorenstein-projective-acyclic cochain complex of Gorenstein-projective $A$-modules is contractible. If $A$ is further assumed to be an Artin algebra, we also prove a Gorenstein variant of a theorem of Rickard, showing its finitistic dimension is finite in case its Gorenstein-injective derived category is generated by the Gorenstein-injective modules.


title: A Hall-type condition for path covers in bipartite graphs

abstract: Let $G$ be a bipartite graph with bipartition $(X,Y)$. Inspired by a hypergraph problem, we seek an upper bound on the number of disjoint paths needed to cover all the vertices of $X$. We conjecture that a Hall-type sufficient condition holds based on the maximum value of $|S|-|\mathsf\Lambda(S)|$, where $S\subseteq X$ and $\mathsf\Lambda(S)$ is the set of all vertices in $Y$ with at least two neighbors in $S$. This condition is also a necessary one for a hereditary version of the problem, where we delete vertices from $X$ and try to cover the remaining vertices by disjoint paths. The conjecture holds when $G$ is a forest, has maximum degree $3$, or is regular with high girth, and we prove those results in this paper.


title: In-Context Convergence of Transformers

abstract: Transformers have recently revolutionized many domains in modern machine learning and one salient discovery is their remarkable in-context learning capability, where models can solve an unseen task by utilizing task-specific prompts without further parameters fine-tuning. This also inspired recent theoretical studies aiming to understand the in-context learning mechanism of transformers, which however focused only on linear transformers. In this work, we take the first step toward studying the learning dynamics of a one-layer transformer with softmax attention trained via gradient descent in order to in-context learn linear function classes. We consider a structured data model, where each token is randomly sampled from a set of feature vectors in either balanced or imbalanced fashion. For data with balanced features, we establish the finite-time convergence guarantee with near-zero prediction error by navigating our analysis over two phases of the training dynamics of the attention map. More notably, for data with imbalanced features, we show that the learning dynamics take a stage-wise convergence process, where the transformer first converges to a near-zero prediction error for the query tokens of dominant features, and then converges later to a near-zero prediction error for the query tokens of under-represented features, respectively via one and four training phases. Our proof features new techniques for analyzing the competing strengths of two types of attention weights, the change of which determines different training phases.


title: Simplifying GNN Performance with Low Rank Kernel Models

abstract: We revisit recent spectral GNN approaches to semi-supervised node classification (SSNC). We posit that many of the current GNN architectures may be over-engineered. Instead, simpler, traditional methods from nonparametric estimation, applied in the spectral domain, could replace many deep-learning inspired GNN designs. These conventional techniques appear to be well suited for a variety of graph types reaching state-of-the-art performance on many of the common SSNC benchmarks. Additionally, we show that recent performance improvements in GNN approaches may be partially attributed to shifts in evaluation conventions. Lastly, an ablative study is conducted on the various hyperparameters associated with GNN spectral filtering techniques. Code available at: https://github.com/lucianoAvinas/lowrank-gnn-kernels


title: The graphs of pyramids are determined by their spectrum

abstract: For natural numbers $k<n$ we study the graphs $T_{n,k}:=K_{k}\lor\overline{K_{n-k}}$. For $k=1$, $T_{n,1}$ is the star $S_{n-1}$. For $k>1$ we refer to $T_{n,k}$ as a \emph{graph of pyramids}. We prove that the graphs of pyramids are determined by their spectrum, and that a star $S_{n}$ is determined by its spectrum iff $n$ is prime. We also show that the graphs $T_{n,k}$ are completely positive iff $k\le2$.


title: Equivalence between individual and group strategy-proofness under stability

abstract: This paper studies the (group) strategy-proofness aspect of two-sided matching markets under stability. For a one-to-one matching market, we show an equivalence between individual and group strategy-proofness under stability. We obtain this equivalence assuming the domain satisfies a richness condition. However, the result cannot be extended to the many-to-one matching markets. We further consider a setting with single-peaked preferences and characterize all domains compatible for stability and (group) strategy-proofness.


title: Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models

abstract: Claim verification plays a crucial role in combating misinformation. While existing works on claim verification have shown promising results, a crucial piece of the puzzle that remains unsolved is to understand how to verify claims without relying on human-annotated data, which is expensive to create at a large scale. Additionally, it is important for models to provide comprehensive explanations that can justify their decisions and assist human fact-checkers. This paper presents First-Order-Logic-Guided Knowledge-Grounded (FOLK) Reasoning that can verify complex claims and generate explanations without the need for annotated evidence using Large Language Models (LLMs). FOLK leverages the in-context learning ability of LLMs to translate the claim into a First-Order-Logic (FOL) clause consisting of predicates, each corresponding to a sub-claim that needs to be verified. Then, FOLK performs FOL-Guided reasoning over a set of knowledge-grounded question-and-answer pairs to make veracity predictions and generate explanations to justify its decision-making process. This process makes our model highly explanatory, providing clear explanations of its reasoning process in human-readable form. Our experiment results indicate that FOLK outperforms strong baselines on three datasets encompassing various claim verification challenges. Our code and data are available.


title: Robust Vehicle Routing Problem in the Presence of a Proactive Attacker

abstract: The vehicle routing problem has great importance and application in transportation and supply chain management. In this case, there are several supply requests in a transportation network. The main goal is to allocate customers to available vehicles and find the sequence of customer visits on each route. It is possible to attack the arcs of the network when two actors compete against each other with conflicting goals. In this case, the attacker may destroy the network arcs or prevent the supply of customers. The defender also intends to fulfill customer demand with the least cost and the most success rate. To this end, we define the robust vehicle routing problem in the presence of a proactive attacker. In this research, we propose a mathematical model with two objective functions to minimize total cost and maximize the total success rate in fulfilling the demand. Also, an exact algorithm for generating feasible routes has been used to solve small-scale problems. To solve large-scale problems, a simulated annealing algorithm is used. We test one numerical example problem and six medium and large size problems to evaluate the proposed algorithms' efficiency. The results demonstrate that the total success rate in supply is directly related to the amount of cost; crossing shorter routes decrease the total of success rate.


title: Persis: A Persian Font Recognition Pipeline Using Convolutional Neural Networks

abstract: What happens if we encounter a suitable font for our design work but do not know its name? Visual Font Recognition (VFR) systems are used to identify the font typeface in an image. These systems can assist graphic designers in identifying fonts used in images. A VFR system also aids in improving the speed and accuracy of Optical Character Recognition (OCR) systems. In this paper, we introduce the first publicly available datasets in the field of Persian font recognition and employ Convolutional Neural Networks (CNN) to address this problem. The results show that the proposed pipeline obtained 78.0% top-1 accuracy on our new datasets, 89.1% on the IDPL-PFOD dataset, and 94.5% on the KAFD dataset. Furthermore, the average time spent in the entire pipeline for one sample of our proposed datasets is 0.54 and 0.017 seconds for CPU and GPU, respectively. We conclude that CNN methods can be used to recognize Persian fonts without the need for additional pre-processing steps such as feature extraction, binarization, normalization, etc.


title: Precise neural network predictions of energies and radii from the no-core shell model

abstract: For light nuclei, ab initio many-body methods such as the no-core shell model are the tools of choice for predictive, high-precision nuclear structure calculations. The applicability and the level of precision of these methods, however, is limited by the model-space truncation that has to be employed to make such computations feasible. We present a universal framework based on artificial neural networks to predict the value of observables for an infinite model-space size based on finite-size no-core shell model data. Expanding upon our previous ansatz of training the neural networks to recognize the observable-specific convergence pattern with data from few-body nuclei, we improve the results obtained for ground-state energies and show a way to handle excitation energies within this framework. Furthermore, we extend the framework to the prediction of converged root-mean-square radii, which are more difficult due to the much less constrained convergence behavior. For all observables robust and statistically significant uncertainties are extracted via the sampling over a large number of network realizations and evaluation data samples.


title: Linear algebra over T-pairs

abstract: This paper treats linear algebra over a semiring pair, in a wide range of applications to tropical algebra and related areas such as hyperrings and fuzzy rings. First we present a more general category of ``pairs'' with their morphisms, called ``weak morphisms,'' paying special attention to supertropical pairs, hyperpairs, and the doubling functor. Then we turn to matrices and the question of whether the row rank, column rank, and submatrix rank of a matrix are equal. Often the submatrix rank is less than or equal to the row rank and the column rank, but there is a counterexample to equality, discovered some time ago by the second author, which we provide in a more general setting (``pairs of the second kind'') that includes the hyperfield of signs. Additional positive results include a version of Cramer's rule, and we find situations when equality holds, encompassing results by Akian, Gaubert, Guterman, Izhakian, Knebusch, and Rowen. We pay special attention to the question of whether $n+1$ vectors of length $n$ need be dependent. At the end, we introduce a category with stronger morphisms, that preserve a surpassing relation.


title: A Knowledge Graph-Based Search Engine for Robustly Finding Doctors and Locations in the Healthcare Domain

abstract: Efficiently finding doctors and locations is an important search problem for patients in the healthcare domain, for which traditional information retrieval methods tend not to work optimally. In the last ten years, knowledge graphs (KGs) have emerged as a powerful way to combine the benefits of gleaning insights from semi-structured data using semantic modeling, natural language processing techniques like information extraction, and robust querying using structured query languages like SPARQL and Cypher. In this short paper, we present a KG-based search engine architecture for robustly finding doctors and locations in the healthcare domain. Early results demonstrate that our approach can lead to significantly higher coverage for complex queries without degrading quality.


title: Inner-Distal Homeomorphisms and Measures

abstract: An inner-distal homeomorphism is one such that each of its proximal cells has empty interior. In locally connected spaces, we prove these homeomorphisms have the following properties: Every $cw$-distal homeomorphism is inner-distal but not conversely. The inner-distal homeomorphisms are precisely those for which the diameters of the iterates of every connected subset of the phase space remain uniformly bounded away from zero. If, in addition, the phase space is compact, every distal extension of an inner-distal-homeomorphism under an inner-light map is inner-distal. We also study inner-distal homeomorphisms from the measure-theoretical standpoint through the concept of inner-distal measures. We prove that in Polish metric spaces, a homeomorphism is inner-distal if and only if each Borel probability measure is. In compact metric spaces, the existence of inner-distal measures guarantees the existence of an invariant inner-distal one. In compact, locally connected spaces, the minimal homeomorphisms supporting inner-distal homeomorphism are precisely the inner-distal ones. We also classify the inner-distal homeomorphisms of the circle or the interval. Finally, we give some dynamic consequences of inner-distality.


title: Label-Free Non-Contact Structural and Functional Vascular Imaging using Photon Absorption Remote Sensing

abstract: Vascular imaging is critical for understanding human health and disease. Most established non-contact and label-free optical techniques capture predominantly structural information about vasculature. However, in many pathologies, functional changes often precede visible morphological changes. This limits the ability of established modalities to prevent negative patient outcomes. In this study, a new in vivo Photon Absorption Remote Sensing (PARS) microscope is proposed. PARS enables the label-free non-contact structural and functional imaging of vascular structures and their microenvironment. PARS aims to capture the dominant light matter interactions surrounding an absorption event including both non-radiative and radiative relaxation. System performance is demonstrated through wide field of view in vivo imaging of vascular contrast in both mouse ear and chicken embryo. Additionally, video rate imaging of chicken embryo capillaries shows first feasibility for blood flow measurement using PARS. This work represents a promising step for vascular imaging techniques where there is significant demand for a method of non-contact label-free functional imaging.


title: Time-Varying Soft-Maximum Control Barrier Functions for Safety in an A Priori Unknown Environment

abstract: This paper presents a time-varying soft-maximum composite control barrier function (CBF) that can be used to ensure safety in an a priori unknown environment, where local perception information regarding the safe set is periodically obtained. We consider the scenario where the periodically obtained perception feedback can be used to construct a local CBF that models a local subset of the unknown safe set. Then, we use a novel smooth time-varying soft-maximum function to compose the N most recently obtained local CBFs into a single CBF. This composite CBF models an approximate union of the N most recently obtained local subsets of the safe set. Notably, this composite CBF can have arbitrary relative degree r. Next, this composite CBF is used as a rth-order CBF constraint in a real-time optimization to determine a control that minimizes a quadratic cost while guaranteeing that the state stays in a time-varying subset of the unknown safe set. We also present an application of the time-varying soft-maximum composite CBF method to a nonholonomic ground robot with nonnegligible inertia. In this application, we present a simple approach to generate the local CBFs from the periodically obtained perception data.


title: Structure-Preserving Instance Segmentation via Skeleton-Aware Distance Transform

abstract: Objects with complex structures pose significant challenges to existing instance segmentation methods that rely on boundary or affinity maps, which are vulnerable to small errors around contacting pixels that cause noticeable connectivity change. While the distance transform (DT) makes instance interiors and boundaries more distinguishable, it tends to overlook the intra-object connectivity for instances with varying width and result in over-segmentation. To address these challenges, we propose a skeleton-aware distance transform (SDT) that combines the merits of object skeleton in preserving connectivity and DT in modeling geometric arrangement to represent instances with arbitrary structures. Comprehensive experiments on histopathology image segmentation demonstrate that SDT achieves state-of-the-art performance.


title: Confidence-driven Sampling for Backdoor Attacks

abstract: Backdoor attacks aim to surreptitiously insert malicious triggers into DNN models, granting unauthorized control during testing scenarios. Existing methods lack robustness against defense strategies and predominantly focus on enhancing trigger stealthiness while randomly selecting poisoned samples. Our research highlights the overlooked drawbacks of random sampling, which make that attack detectable and defensible. The core idea of this paper is to strategically poison samples near the model's decision boundary and increase defense difficulty. We introduce a straightforward yet highly effective sampling methodology that leverages confidence scores. Specifically, it selects samples with lower confidence scores, significantly increasing the challenge for defenders in identifying and countering these attacks. Importantly, our method operates independently of existing trigger designs, providing versatility and compatibility with various backdoor attack techniques. We substantiate the effectiveness of our approach through a comprehensive set of empirical experiments, demonstrating its potential to significantly enhance resilience against backdoor attacks in DNNs.


title: The Emergence of Reproducibility and Generalizability in Diffusion Models

abstract: In this work, we investigate an intriguing and prevalent phenomenon of diffusion models which we term as "consistent model reproducibility": given the same starting noise input and a deterministic sampler, different diffusion models often yield remarkably similar outputs. We confirm this phenomenon through comprehensive experiments, implying that different diffusion models consistently reach the same data distribution and scoring function regardless of diffusion model frameworks, model architectures, or training procedures. More strikingly, our further investigation implies that diffusion models are learning distinct distributions affected by the training data size. This is supported by the fact that the model reproducibility manifests in two distinct training regimes: (i) "memorization regime", where the diffusion model overfits to the training data distribution, and (ii) "generalization regime", where the model learns the underlying data distribution. Our study also finds that this valuable property generalizes to many variants of diffusion models, including those for conditional use, solving inverse problems, and model fine-tuning. Finally, our work raises numerous intriguing theoretical questions for future investigation and highlights practical implications regarding training efficiency, model privacy, and the controlled generation of diffusion models.


title: Real structures on primary Hopf surfaces

abstract: The first goal of this article is to give a complete classification (up to Real biholomorphisms) of Real primary Hopf surfaces $(H,s)$, and, for any such pair, to describe in detail the following naturally associated objects : the group $\mathrm{Aut}_h(H,s)$ of Real automorphisms, the Real Picard group $(\mathrm{Pic}(H),\hat s^*)$, and the Picard group of Real holomorphic line bundles $\mathrm{Pic}_{\mathbb{R}}(H)$. Our second goal: the classification of Real primary Hopf surfaces up to equivariant diffeomorphisms, which will allow us to describe explicitly in each case the real locus $H(\mathbb{R})=H^s$ and the quotient $H/\langle s\rangle$.


title: DELTAHANDS: A Synergistic Dexterous Hand Framework Based on Delta Robots

abstract: Dexterous robotic manipulation in unstructured environments can aid in everyday tasks such as cleaning and caretaking. Anthropomorphic robotic hands are highly dexterous and theoretically well-suited for working in human domains, but their complex designs and dynamics often make them difficult to control. By contrast, parallel-jaw grippers are easy to control and are used extensively in industrial applications, but they lack the dexterity for various kinds of grasps and in-hand manipulations. In this work, we present DELTAHANDS, a synergistic dexterous hand framework with Delta robots. The DELTAHANDS are soft, easy to reconfigure, simple to manufacture with low-cost off-the-shelf materials, and possess high degrees of freedom that can be easily controlled. DELTAHANDS' dexterity can be adjusted for different applications by leveraging actuation synergies, which can further reduce the control complexity, overall cost, and energy consumption. We characterize the Delta robots' kinematics accuracy, force profiles, and workspace range to assist with hand design. Finally, we evaluate the versatility of DELTAHANDS by grasping a diverse set of objects and by using teleoperation to complete three dexterous manipulation tasks: cloth folding, cap opening, and cable arrangement. We open-source our hand framework at https://sites.google.com/view/deltahands/.


title: The ECFA Roadmap Process for Particle Identification and Photon Detector R&D

abstract: The Detector R&D Roadmap for European Particle Physics was published in February 2022. The outcome of the Roadmap process relating to particle identification and photon detectors is summarised.


title: The Debye layer as a transmission line in the 4Hz-100kHz frequency range

abstract: We report measurements on the dynamics of the Debye layer at a gold electrode in several electrolytes. In the experiments, the Debye layer transmits a damped voltage wave along the electrode, which we use to probe the dynamics. We compare the measurements with traditional impedance models, which schematize the Debye layer as a capacitance. We find good agreement for very dilute electrolytes, but also for an ionic liquid. However, the same model fails for the concentrated electrolyte, as ion - solvent - ion interactions become important.


title: Federated Learning: A Cutting-Edge Survey of the Latest Advancements and Applications

abstract: Robust machine learning (ML) models can be developed by leveraging large volumes of data and distributing the computational tasks across numerous devices or servers. Federated learning (FL) is a technique in the realm of ML that facilitates this goal by utilizing cloud infrastructure to enable collaborative model training among a network of decentralized devices. Beyond distributing the computational load, FL targets the resolution of privacy issues and the reduction of communication costs simultaneously. To protect user privacy, FL requires users to send model updates rather than transmitting large quantities of raw and potentially confidential data. Specifically, individuals train ML models locally using their own data and then upload the results in the form of weights and gradients to the cloud for aggregation into the global model. This strategy is also advantageous in environments with limited bandwidth or high communication costs, as it prevents the transmission of large data volumes. With the increasing volume of data and rising privacy concerns, alongside the emergence of large-scale ML models like Large Language Models (LLMs), FL presents itself as a timely and relevant solution. It is therefore essential to review current FL algorithms to guide future research that meets the rapidly evolving ML demands. This survey provides a comprehensive analysis and comparison of the most recent FL algorithms, evaluating them on various fronts including mathematical frameworks, privacy protection, resource allocation, and applications. Beyond summarizing existing FL methods, this survey identifies potential gaps, open areas, and future challenges based on the performance reports and algorithms used in recent studies. This survey enables researchers to readily identify existing limitations in the FL field for further exploration.


title: Transforming Pixels into a Masterpiece: AI-Powered Art Restoration using a Novel Distributed Denoising CNN (DDCNN)

abstract: Art restoration is crucial for preserving cultural heritage, but traditional methods have limitations in faithfully reproducing original artworks while addressing issues like fading, staining, and damage. We present an innovative approach using deep learning, specifically Convolutional Neural Networks (CNNs), and Computer Vision techniques to revolutionize art restoration. We start by creating a diverse dataset of deteriorated art images with various distortions and degradation levels. This dataset trains a Distributed Denoising CNN (DDCNN) to remove distortions while preserving intricate details. Our method is adaptable to different distortion types and levels, making it suitable for various deteriorated artworks, including paintings, sketches, and photographs. Extensive experiments demonstrate our approach's efficiency and effectiveness compared to other Denoising CNN models. We achieve a substantial reduction in distortion, transforming deteriorated artworks into masterpieces. Quantitative evaluations confirm our method's superiority over traditional techniques, reshaping the art restoration field and preserving cultural heritage. In summary, our paper introduces an AI-powered solution that combines Computer Vision and deep learning with DDCNN to restore artworks accurately, overcoming limitations and paving the way for future advancements in art restoration.


title: 5G Advanced: Wireless Channel Virtualization and Resource Mapping for Real Time Spectrum Sharing

abstract: The coexistence between active wireless communications and passive RF spectrum use becomes an increasingly important requirement for coordinated spectrum access supporting critical services. The ongoing research and technological progress are focused on effective spectrum utilization including large-scale MIMO and energy efficient and low-power communications, innovative spectrum use and management, and resilient spectrum sharing, just to name a few. This paper introduces a new tool for real time spectrum sharing among emerging cellular networks and passive RF sensing systems used for remote sensing and radio astronomy, among others. Specifically we propose leveraging wireless channel virtualization and propose a virtual-to-physical resource mapping framework, mapping types, and control signaling that extends the current 5G New Radio (NR) specifications. Our technology introduces minimal changes to the protocol and is meant to be transparent to the end user application. We validate the proposed technology by extending a 3GPP compliant 5G NR downlink simulator and identify further research directions where work is needed on designing effective ways to explicitly signal the need for spectrum or spectrum use predictions.


title: Liquid functional calculus

abstract: We develop an elementary formalism of functional calculus for entire holomorphic functions in the setting of Clausen and Scholze's $p$-liquid vector spaces.


title: Learning force laws in many-body systems

abstract: Scientific laws describing natural systems may be more complex than our intuition can handle, and thus how we discover laws must change. Machine learning (ML) models can analyze large quantities of data, but their structure should match the underlying physical constraints to provide useful insight. Here we demonstrate a ML approach that incorporates such physical intuition to infer force laws in dusty plasma experiments. Trained on 3D particle trajectories, the model accounts for inherent symmetries and non-identical particles, accurately learns the effective non-reciprocal forces between particles, and extracts each particle's mass and charge. The model's accuracy (R^2 > 0.99) points to new physics in dusty plasma beyond the resolution of current theories and demonstrates how ML-powered approaches can guide new routes of scientific discovery in many-body systems.


title: Geometry of PCF parameters in spaces of quadratic polynomials

abstract: We study algebraic relations among postcritically finite (PCF) parameters in the family $f_c(z) = z^2 + c$. Ghioca, Krieger, Nguyen and Ye proved that an algebraic curve in $\mathbb{C}^2$ contains infinitely many PCF pairs $(c_1, c_2)$ if and only if the curve is special (i.e., the curve is a vertical or horizontal line through a PCF parameter, or the curve is the diagonal). Here we extend this result to subvarieties of $\mathbb{C}^n$ for any $n\geq 2$. Consequently, we obtain uniform bounds on the number of PCF pairs on non-special curves in $\mathbb{C}^2$ and the number of PCF parameters in real algebraic curves in $\mathbb{C}$, depending only on the degree of the curve. We also compute the optimal bound for the general curve of degree $d$.


title: Did Private Election Administration Funding Advantage Democrats in 2020?

abstract: Private donors contributed more than $350 million to local election officials to support the administration of the 2020 election. Supporters argue these grants were neutral and necessary to maintain normal election operations during the pandemic, while critics worry these grants mostly went to Democratic strongholds and tilted election outcomes. These concerns have led twenty-four states to restrict private election grants. How much did these grants shape the 2020 presidential election? To answer this question, we collect administrative data on private election administration grants and election outcomes. We then use new advances in synthetic control methods to compare presidential election results and turnout in counties that received grants to counties with identical average presidential election results and turnout before 2020. While counties that favor Democrats were much more likely to apply for a grant, we find that the grants did not have a noticeable effect on the presidential election. Our estimates of the average effect of receiving a grant on Democratic vote share range from 0.02 percentage points to 0.36 percentage points. Our estimates of the average effect of receiving a grant on turnout range from -0.03 percentage points to 0.13 percentage points. Across specifications, our 95% confidence intervals typically include negative effects, and our confidence intervals from all specifications fail to include effects on Democratic vote share larger than 0.58 percentage points and effects on turnout larger than 0.40 percentage points. We characterize the magnitude of our effects by asking how large they are compared to the margin by which Biden won the 2020 election. In simple bench-marking exercises, we find that the effects of the grants were likely too small to have changed the outcome of the 2020 presidential election.


title: Enhancing Pre-Trained Language Models with Sentence Position Embeddings for Rhetorical Roles Recognition in Legal Opinions

abstract: The legal domain is a vast and complex field that involves a considerable amount of text analysis, including laws, legal arguments, and legal opinions. Legal practitioners must analyze these texts to understand legal cases, research legal precedents, and prepare legal documents. The size of legal opinions continues to grow, making it increasingly challenging to develop a model that can accurately predict the rhetorical roles of legal opinions given their complexity and diversity. In this research paper, we propose a novel model architecture for automatically predicting rhetorical roles using pre-trained language models (PLMs) enhanced with knowledge of sentence position information within a document. Based on an annotated corpus from the LegalEval@SemEval2023 competition, we demonstrate that our approach requires fewer parameters, resulting in lower computational costs when compared to complex architectures employing a hierarchical model in a global-context, yet it achieves great performance. Moreover, we show that adding more attention to a hierarchical model based only on BERT in the local-context, along with incorporating sentence position information, enhances the results.


title: Comparison of different thermostats in the Holstein model

abstract: When modeling charge dynamics in a chain of N sites at a temperature T, a Langevin thermostat and a Hamiltonian system, i.e., a chain heated to a given temperature before charge is injected, are compared. It is shown that the polaron disruption occurs in the same range of values of the thermal energy NT, however, T is not given by the initial data, but obtained after simulation from the average kinetic energy. For large T, the results averaged over a set of trajectories in a system with a Langevin thermostat and the results averaged over time for a Hamiltonian system are close, which does not contradict the Ergodic hypothesis.


title: Pressure-driven homogenization of lithium disilicate glasses

abstract: Lithium disilicate glasses and glass-ceramics are good potential candidates for biomedical applications and solid-state batteries, and serve as models of nucleation and crystal growth. Moreover, these glasses exhibit a phase separation that influences their nucleation and crystallization behavior. The atomistic mechanisms of the phase separation and their pressure dependence are unclear so far. Here, we used molecular dynamics simulations supported by experiments to assess the spatial heterogeneity of lithium disilicate glasses prepared under pressure. We show that the glass heterogeneity decreases with increasing the cooling pressure and almost disappears at pressures around 30 GPa. The origin of the heterogeneity is due to the attraction between Li cations to form clustering channels, which decreases with pressure. Through our results, we hope to provide valuable insights and guidance for making glass-ceramics with controlled crystallization.


title: Combining the D3 dispersion correction with the neuroevolution machine-learned potential

abstract: Machine-learned potentials (MLPs) have become a popular approach of modelling interatomic interactions in atomistic simulations, but to keep the computational cost under control, a relatively short cutoff must be imposed, which put serious restrictions on the capability of the MLPs for modelling relatively long-ranged dispersion interactions. In this paper, we propose to combine the neuroevolution potential (NEP) with the popular D3 correction to achieve a unified NEP-D3 model that can simultaneously model relatively short-ranged bonded interactions and relatively long-ranged dispersion interactions. We show the improved descriptions of the binding and sliding energies in bilayer graphene can be obtained by the NEP-D3 approach compared to the pure NEP approach. We implement the D3 part into the GPUMD package such that it can be used out of the box for many exchange-correlation functionals. As a realistic application, we show that dispersion interactions result in approximately a 10% reduction in thermal conductivity for three typical metal-organic frameworks.


title: Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systems

abstract: Recent advancements in Large Language Models empower them to follow freeform instructions, including imitating generic or specific demographic personas in conversations. We define generic personas to represent demographic groups, such as "an Asian person", whereas specific personas may take the form of specific popular Asian names like "Yumi". While the adoption of personas enriches user experiences by making dialogue systems more engaging and approachable, it also casts a shadow of potential risk by exacerbating social biases within model responses, thereby causing societal harm through interactions with users. In this paper, we systematically study "persona biases", which we define to be the sensitivity of dialogue models' harmful behaviors contingent upon the personas they adopt. We categorize persona biases into biases in harmful expression and harmful agreement, and establish a comprehensive evaluation framework to measure persona biases in five aspects: Offensiveness, Toxic Continuation, Regard, Stereotype Agreement, and Toxic Agreement. Additionally, we propose to investigate persona biases by experimenting with UNIVERSALPERSONA, a systematically constructed persona dataset encompassing various types of both generic and specific model personas. Through benchmarking on four different models -- including Blender, ChatGPT, Alpaca, and Vicuna -- our study uncovers significant persona biases in dialogue systems. Our findings also underscore the pressing need to revisit the use of personas in dialogue agents to ensure safe application.


title: The Six-Vertex Model with a Non-Standard Boundary Condition

abstract: We consider the enumeration of states in the Brubaker-Bump-Friedberg six-vertex model, whose boundary conditions are determined by an integer partition. In general, we find the number of states is a polynomial in the largest part of the partition. By explicating this technique, we also enumerate the states completely for hook shapes and staircases.


title: Asymptotics for graphically divergent series: dense digraphs and 2-SAT formulae

abstract: We propose a new method for obtaining complete asymptotic expansions in a systematic manner, which is suitable for counting sequences of various graph families in dense regime. The core idea is to encode the two-dimensional array of expansion coefficients into a special bivariate generating function, which we call a coefficient generating function. We show that coefficient generating functions possess certain general properties that make it possible to express asymptotics in a short closed form. Also, in most scenarios, we indicate a combinatorial meaning of the involved coefficients. Applications of our method include asymptotics of connected graphs, irreducible tournaments, strongly connected digraphs, satisfiable 2-SAT formulae and contradictory strongly connected implication digraphs. Moreover, due to its flexibility, the method allows to treat a wide range of structural variations, including fixing the numbers of connected, irreducible, strongly connected and contradictory components, having the variations on source-like, sink-like and isolated components, or adding weights and marking variables.


title: Arithmetic properties of multiplicative integer-valued perturbed random walks

abstract: Let $(\xi_1, \eta_1)$, $(\xi_2, \eta_2),\ldots$ be independent identically distributed $\mathbb{N}^2$-valued random vectors with arbitrarily dependent components. The sequence $(\Theta_k)_{k\in\mathbb{N}}$ defined by $\Theta_k=\Pi_{k-1}\cdot\eta_k$, where $\Pi_0=1$ and $\Pi_k=\xi_1\cdot\ldots\cdot \xi_{k}$ for $k\in\mathbb{N}$, is called a multiplicative perturbed random walk. We study arithmetic properties of the random sets $\{\Pi_1,\Pi_2,\ldots, \Pi_k\}\subset \mathbb{N}$ and $\{\Theta_1,\Theta_2,\ldots, \Theta_k\}\subset \mathbb{N}$, $k\in\mathbb{N}$. In particular, we derive distributional limit theorems for their prime counts and for the least common multiple.


title: Elliptic log symplectic brackets on projective bundles

abstract: Let $\mathsf{X}$ be the product of a complex projective space and a polydisc. We study Poisson brackets on $\mathsf{X}$ that are log symplectic, that is, generically symplectic and such that the inverse two-form has only first order poles. We propose a method of constructing such Poisson brackets that additionally are elliptic, in a precise sense. Our method relies on the local Torelli theorem for log symplectic manifolds of Pym, Schedler and the author, and uses combinatorics of smoothing diagrams. We demonstrate effectiveness of the method on a series of examples, recovering, in particular, all log symplectic cases of elliptic Feigin-Odesskii Poisson brackets $q_{n,k}$ on $\mathbb{P}^{n-1}$.


title: Augmented Flexible Krylov Subspace methods with applications to Bayesian inverse problems

abstract: This paper presents two new augmented flexible (AF)-Krylov subspace methods, AF-GMRES and AF-LSQR, to compute solutions of large-scale linear discrete ill-posed problems that can be modeled as the sum of two independent random variables, exhibiting smooth and sparse stochastic characteristics respectively. Following a Bayesian modelling approach, this corresponds to adding a covariance-weighted quadratic term and a sparsity enforcing $\ell_1$ term in the original least-squares minimization scheme. To handle the $\ell_1$ regularization term, the proposed approach constructs a sequence approximating quadratic problems that are partially solved using augmented flexible Krylov-Tikhonov methods. Compared to other traditional methods used to solve this minimization problem, such as those based on iteratively reweighted norm schemes, the new algorithms build a single (augmented, flexible) approximation (Krylov) subspace that encodes information about the different regularization terms through adaptable "preconditioning". The solution space is then expanded as soon as a new problem within the sequence is defined. This also allows for the regularization parameters to be chosen on-the-fly at each iteration. Compared to most recent work on generalized flexible Krylov methods, our methods offer theoretical assurance of convergence and a more stable numerical performance. The efficiency of the new methods is shown through a variety of experiments, including a synthetic image deblurring problem, a synthetic atmospheric transport problem, and fluorescence molecular tomography reconstructions using both synthetic and real-world experimental data.


title: Generalizable Error Modeling for Search Relevance Data Annotation Tasks

abstract: Human data annotation is critical in shaping the quality of machine learning (ML) and artificial intelligence (AI) systems. One significant challenge in this context is posed by annotation errors, as their effects can degrade the performance of ML models. This paper presents a predictive error model trained to detect potential errors in search relevance annotation tasks for three industry-scale ML applications (music streaming, video streaming, and mobile apps) and assesses its potential to enhance the quality and efficiency of the data annotation process. Drawing on real-world data from an extensive search relevance annotation program, we illustrate that errors can be predicted with moderate model performance (AUC=0.65-0.75) and that model performance generalizes well across applications (i.e., a global, task-agnostic model performs on par with task-specific models). We present model explainability analyses to identify which types of features are the main drivers of predictive performance. Additionally, we demonstrate the usefulness of the model in the context of auditing, where prioritizing tasks with high predicted error probabilities considerably increases the amount of corrected annotation errors (e.g., 40% efficiency gains for the music streaming application). These results underscore that automated error detection models can yield considerable improvements in the efficiency and quality of data annotation processes. Thus, our findings reveal critical insights into effective error management in the data annotation process, thereby contributing to the broader field of human-in-the-loop ML.


title: Dead man tells tales: metallicity distribution of the Milky Way stellar halo reveals the past of the GSE progenitor galaxy

abstract: The Gaia-Sausage-Enceladus~(GSE) stands out as the largest known ancient accretion event in the Milky Way~(MW) history. Despite this significance, the parameters of its progenitor galaxy are still poorly constrained. We identify GSE stars from the APOGEE DR17 using Gaussian mixture models and recover a negative radial metallicity gradient for the GSE debris within the MW stellar halo, with a magnitude of $\approx -0.014^{-0.002}_{-0.022}$ dex/kpc. We argue that this gradient reflects the radial metallicity gradient of the GSE galaxy progenitor before it was disrupted by the MW. By investigating the cosmological HESTIA simulations and $N$-body models of galaxy mergers, we constrain the radial metallicity gradient of the GSE-progenitor to be $\approx -0.1^{-0.06}_{-0.15}$ dex/kpc. We, therefore, propose that a chemical tagging of accreted stars using their integrals of motion, although they are not conserved during mergers, provide essential information about the structure and the past of systems accreted onto the MW.


title: Clustering Three-Way Data with Outliers

abstract: Matrix-variate distributions are a recent addition to the model-based clustering field, thereby making it possible to analyze data in matrix form with complex structure such as images and time series. Due to its recent appearance, there is limited literature on matrix-variate data, with even less on dealing with outliers in these models. An approach for clustering matrix-variate normal data with outliers is discussed. The approach, which uses the distribution of subset log-likelihoods, extends the OCLUST algorithm to matrix-variate normal data and uses an iterative approach to detect and trim outliers.


title: Inference of highly time-resolved melt pool visual characteristics and spatially-dependent lack-of-fusion defects in laser powder bed fusion using acoustic and thermal emission data

abstract: With a growing demand for high-quality fabrication, the interest in real-time process and defect monitoring of laser powder bed fusion (LPBF) has increased, leading manufacturers to incorporate a variety of online sensing methods including acoustic sensing, photodiode sensing, and high-speed imaging. However, real-time acquisition of high-resolution melt pool images in particular remains computationally demanding in practice due to the high variability of melt pool morphologies and the limitation of data caching and transfer, making it challenging to detect the local lack-of-fusion (LOF) defect occurrences. In this work, we propose a new acoustic and thermal information-based monitoring method that can robustly infer critical LPBF melt pool morphological features in image forms and detect spatially-dependent LOF defects within a short period. We utilize wavelet scalogram matrices of acoustic and photodiode clip data to identify and predict highly time-resolved (within a 1.0 ms window) visual melt pool characteristics via a well-trained data-driven pipeline. With merely the acoustic and photodiode-collected thermal emission data as the input, the proposed pipeline enables data-driven inference and tracking of highly variable melt pool visual characteristics with $R^2=0.8$. We subsequently validate our proposed approach to infer local LOF defects between two adjacent scanlines, showing that our proposed approach can outperform our selected baseline theoretical model based on previous literature. Revealing the physical correlation between airborne acoustic emission, thermal emission, and melt pool morphology, our work demonstrates the feasibility of creating an efficient and cost-effective acoustic- and thermal-based approach to facilitate online visual melt pool characterization and LOF defect detection.