title: Event-Based Contrastive Learning for Medical Time Series

abstract: In clinical practice, one often needs to identify whether a patient is at high risk of adverse outcomes after some key medical event. For example, quantifying the risk of adverse outcomes after an acute cardiovascular event helps healthcare providers identify those patients at the highest risk of poor outcomes; i.e., patients who benefit from invasive therapies that can lower their risk. Assessing the risk of adverse outcomes, however, is challenging due to the complexity, variability, and heterogeneity of longitudinal medical data, especially for individuals suffering from chronic diseases like heart failure. In this paper, we introduce Event-Based Contrastive Learning (EBCL) - a method for learning embeddings of heterogeneous patient data that preserves temporal information before and after key index events. We demonstrate that EBCL can be used to construct models that yield improved performance on important downstream tasks relative to other pretraining methods. We develop and test the method using a cohort of heart failure patients obtained from a large hospital network and the publicly available MIMIC-IV dataset consisting of patients in an intensive care unit at a large tertiary care center. On both cohorts, EBCL pretraining yields models that are performant with respect to a number of downstream tasks, including mortality, hospital readmission, and length of stay. In addition, unsupervised EBCL embeddings effectively cluster heart failure patients into subgroups with distinct outcomes, thereby providing information that helps identify new heart failure phenotypes. The contrastive framework around the index event can be adapted to a wide array of time-series datasets and provides information that can be used to guide personalized care.


title: Enabling Mammography with Co-Robotic Ultrasound

abstract: Ultrasound (US) imaging is a vital adjunct to mammography in breast cancer screening and diagnosis, but its reliance on hand-held transducers often lacks repeatability and heavily depends on sonographers' skills. Integrating US systems from different vendors further complicates clinical standards and workflows. This research introduces a co-robotic US platform for repeatable, accurate, and vendor-independent breast US image acquisition. The platform can autonomously perform 3D volume scans or swiftly acquire real-time 2D images of suspicious lesions. Utilizing a Universal Robot UR5 with an RGB camera, a force sensor, and an L7-4 linear array transducer, the system achieves autonomous navigation, motion control, and image acquisition. The calibrations, including camera-mammogram, robot-camera, and robot-US, were rigorously conducted and validated. Governed by a PID force control, the robot-held transducer maintains a constant contact force with the compression plate during the scan for safety and patient comfort. The framework was validated on a lesion-mimicking phantom. Our results indicate that the developed co-robotic US platform promises to enhance the precision and repeatability of breast cancer screening and diagnosis. Additionally, the platform offers straightforward integration into most mammographic devices to ensure vendor-independence.


title: scBiGNN: Bilevel Graph Representation Learning for Cell Type Classification from Single-cell RNA Sequencing Data

abstract: Single-cell RNA sequencing (scRNA-seq) technology provides high-throughput gene expression data to study the cellular heterogeneity and dynamics of complex organisms. Graph neural networks (GNNs) have been widely used for automatic cell type classification, which is a fundamental problem to solve in scRNA-seq analysis. However, existing methods do not sufficiently exploit both gene-gene and cell-cell relationships, and thus the true potential of GNNs is not realized. In this work, we propose a bilevel graph representation learning method, named scBiGNN, to simultaneously mine the relationships at both gene and cell levels for more accurate single-cell classification. Specifically, scBiGNN comprises two GNN modules to identify cell types. A gene-level GNN is established to adaptively learn gene-gene interactions and cell representations via the self-attention mechanism, and a cell-level GNN builds on the cell-cell graph that is constructed from the cell representations generated by the gene-level GNN. To tackle the scalability issue for processing a large number of cells, scBiGNN adopts an Expectation Maximization (EM) framework in which the two modules are alternately trained via the E-step and M-step to learn from each other. Through this interaction, the gene- and cell-level structural information is integrated to gradually enhance the classification performance of both GNN modules. Experiments on benchmark datasets demonstrate that our scBiGNN outperforms a variety of existing methods for cell type classification from scRNA-seq data.


title: Symmetry breaking of $3$-dimensional AdS in holographic semiclassical gravity

abstract: We show that $3$-dimensional AdS spacetime can be semiclassically unstable due to strongly interacting quantum field effects. In our previous paper, we have pointed out the possibility of such an instability of AdS$_3$ by inspecting linear perturbations of the (covering space of) static BTZ black hole with AdS${}_4$ gravity dual in the context of holographic semiclassical problems. In the present paper, we further study this issue from thermodynamic viewpoint by constructing asymptotically AdS$_3$ semiclassical solutions and computing free energies of the solutions. We find two asymptotically AdS${}_3$ solutions to the semiclassical Einstein equations with non-vanishing source term: the one whose free energy is smaller than that of the BTZ with vanishing source term and the other whose free energy is smaller than that of the global AdS$_3$ with no horizon (thus manifestly zero-temperature background). The instability found in this paper implies the breakdown of the maximal symmetries of AdS$_3$, and its origin is different from the well-known semiclassical linear instability since our holographic semiclassical Einstein equations in $3$-dimensions do not involve higher order derivative terms.


title: STELLAR: Siamese Multi-Headed Attention Neural Networks for Overcoming Temporal Variations and Device Heterogeneity with Indoor Localization

abstract: Smartphone-based indoor localization has emerged as a cost-effective and accurate solution to localize mobile and IoT devices indoors. However, the challenges of device heterogeneity and temporal variations have hindered its widespread adoption and accuracy. Towards jointly addressing these challenges comprehensively, we propose STELLAR, a novel framework implementing a contrastive learning approach that leverages a Siamese multi-headed attention neural network. STELLAR is the first solution that simultaneously tackles device heterogeneity and temporal variations in indoor localization, without the need for retraining the model (re-calibration-free). Our evaluations across diverse indoor environments show 8-75% improvements in accuracy compared to state-of-the-art techniques, to effectively address the device heterogeneity challenge. Moreover, STELLAR outperforms existing methods by 18-165% over 2 years of temporal variations, showcasing its robustness and adaptability.


title: Superconductivity in Nb: from the impact of temperature, Cooper-pairing to dimensionality

abstract: The ability to simulate realistically the electronic structure of superconducting materials is important to understand and predict various properties emerging in both the superconducting topological and spintronics realms. We introduce a tight-binding implementation of the Bogoliubov-de Gennes method, parameterized from density functional theory, which we utilize to explore the bulk and thin films of Nb, known to host a significant superconducting gap. The latter is useful for various applications such as the exploration of trivial and topological in-gap states. Here, we focus on the simulations aspects of superconductivity and study the impact of temperature, Cooper-pair coupling and dimensionality on the size of the superconducting order parameter.


title: DeepCalliFont: Few-shot Chinese Calligraphy Font Synthesis by Integrating Dual-modality Generative Models

abstract: Few-shot font generation, especially for Chinese calligraphy fonts, is a challenging and ongoing problem. With the help of prior knowledge that is mainly based on glyph consistency assumptions, some recently proposed methods can synthesize high-quality Chinese glyph images. However, glyphs in calligraphy font styles often do not meet these assumptions. To address this problem, we propose a novel model, DeepCalliFont, for few-shot Chinese calligraphy font synthesis by integrating dual-modality generative models. Specifically, the proposed model consists of image synthesis and sequence generation branches, generating consistent results via a dual-modality representation learning strategy. The two modalities (i.e., glyph images and writing sequences) are properly integrated using a feature recombination module and a rasterization loss function. Furthermore, a new pre-training strategy is adopted to improve the performance by exploiting large amounts of uni-modality data. Both qualitative and quantitative experiments have been conducted to demonstrate the superiority of our method to other state-of-the-art approaches in the task of few-shot Chinese calligraphy font synthesis. The source code can be found at https://github.com/lsflyt-pku/DeepCalliFont.


title: A neural network kernel decomposition for learning multiple steady states in parameterized dynamical systems

abstract: We develop a machine learning approach to identifying parameters with steady-state solutions, locating such solutions, and determining their linear stability for systems of ordinary differential equations and dynamical systems with parameters. Our approach begins with the construction of target functions that can be used to identify parameters with steady-state solution and the linear stability of such solutions. We design a parameter-solution neural network (PSNN) that couples a parameter neural network and a solution neural network to approximate the target function, and develop efficient algorithms to train the PSNN and to locate steady-state solutions. We also present a theory of approximation of the target function by our PSNN based on the neural network kernel decomposition. Numerical results are reported to show that our approach is robust in identifying the phase boundaries separating different regions in the parameter space corresponding to no solution or different numbers of solutions and in classifying the stability of solutions. These numerical results also validate our analysis. Although the primary focus in this study centers on steady states of parameterized dynamical systems, our approach is applicable generally to finding solutions for parameterized nonlinear systems of algebraic equations. Some potential improvements and future work are discussed.


title: Two-relaxation-time regularized lattice Boltzmann model for convection-diffusion equation with variable coefficients

abstract: In this paper, a new two-relaxation-time regularized (TRT-R) lattice Boltzmann (LB) model for convection-diffusion equation (CDE) with variable coefficients is proposed. Within this framework, we first derive a TRT-R collision operator by constructing a new regularized procedure through the high-order Hermite expansion of non-equilibrium. Then a first-order discrete-velocity form of discrete source term is introduced to improve the accuracy of the source term. Finally and most importantly, a new first-order space-derivative auxiliary term is proposed to recover the correct CDE with variable coefficients. To evaluate this model, we simulate a classic benchmark problem of the rotating Gaussian pulse. The results show that our model has better accuracy, stability and convergence than other popular LB models, especially in the case of a large time step.


title: Spatial-Temporal DAG Convolutional Networks for End-to-End Joint Effective Connectivity Learning and Resting-State fMRI Classification

abstract: Building comprehensive brain connectomes has proved of fundamental importance in resting-state fMRI (rs-fMRI) analysis. Based on the foundation of brain network, spatial-temporal-based graph convolutional networks have dramatically improved the performance of deep learning methods in rs-fMRI time series classification. However, existing works either pre-define the brain network as the correlation matrix derived from the raw time series or jointly learn the connectome and model parameters without any topology constraint. These methods could suffer from degraded classification performance caused by the deviation from the intrinsic brain connectivity and lack biological interpretability of demonstrating the causal structure (i.e., effective connectivity) among brain regions. Moreover, most existing methods for effective connectivity learning are unaware of the downstream classification task and cannot sufficiently exploit useful rs-fMRI label information. To address these issues in an end-to-end manner, we model the brain network as a directed acyclic graph (DAG) to discover direct causal connections between brain regions and propose Spatial-Temporal DAG Convolutional Network (ST-DAGCN) to jointly infer effective connectivity and classify rs-fMRI time series by learning brain representations based on nonlinear structural equation model. The optimization problem is formulated into a continuous program and solved with score-based learning method via gradient descent. We evaluate ST-DAGCN on two public rs-fMRI databases. Experiments show that ST-DAGCN outperforms existing models by evident margins in rs-fMRI classification and simultaneously learns meaningful edges of effective connectivity that help understand brain activity patterns and pathological mechanisms in brain disease.


title: Two-relaxation-time regularized lattice Boltzmann model for Navier-Stokes equations

abstract: In this paper, we propose a novel two-relaxation-time regularized lattice Boltzmann (TRT-RLB) model for simulating weakly compressible isothermal flows. A free relaxation parameter, $\tau_{s,2}$, is employed to relax the regularized non-equilibrium third-order terms. Chapman-Enskog analysis reveals that our model can accurately recover the Navier-Stokes equations (NSEs). Theoretical analysis of the Poiseuille flow problem demonstrates that the slip velocity magnitude in the proposed model is controlled by a magic parameter, which can be entirely eliminated under specific values, consistent with the classical TRT model. Our simulations of the double shear layer problem, Taylor-Green vortex flow, and force-driven Poiseuille flow confirm that the stability and accuracy of our model significantly surpass those of both the regularized lattice Boltzmann (RLB) and two-relaxation-time (TRT) models, even under super-high Reynolds numbers as $Re=10^7$. Concurrently, the TRT-RLB model exhibits superior performance in very high viscosity scenarios. The simulations of creeping flow around a square cylinder demonstrates the model's capability to accurately compute ultra-low Reynolds numbers as $Re=10^{-7}$. This study establishes the TRT-RLB model as a flexible and robust tool in computational fluid dynamics.


title: Building AI and Human Capital for Road Safety

abstract: AI is about learning algorithms and huge amounts of data and are drivers of economic growth -- what does this mean for the field of development studies? Can we re-orient to twin AI studies and development theory and practice to generate how development challenges are identified and researched? To do this a good grasp is needed of AI internal mechanisms and outcomes in addressing development issues -- this argument will be developed through a case study of the ADAS [Advanced Driver Assistance System] deployment in India. Over and above discussing the ADAS we bring an anthropological lens to understand the social context that surrounds the system. Focusing on bus drivers, we offer findings from a qualitative and ethnographic study of drivers in a collaborative effort to achieve road safety by deploying AI-driven technology and empowering stakeholders in the transport industry in India especially, bus drivers as critical actors in the city transport network.


title: Symmetrical Bidirectional Knowledge Alignment for Zero-Shot Sketch-Based Image Retrieval

abstract: This paper studies the problem of zero-shot sketch-based image retrieval (ZS-SBIR), which aims to use sketches from unseen categories as queries to match the images of the same category. Due to the large cross-modality discrepancy, ZS-SBIR is still a challenging task and mimics realistic zero-shot scenarios. The key is to leverage transferable knowledge from the pre-trained model to improve generalizability. Existing researchers often utilize the simple fine-tuning training strategy or knowledge distillation from a teacher model with fixed parameters, lacking efficient bidirectional knowledge alignment between student and teacher models simultaneously for better generalization. In this paper, we propose a novel Symmetrical Bidirectional Knowledge Alignment for zero-shot sketch-based image retrieval (SBKA). The symmetrical bidirectional knowledge alignment learning framework is designed to effectively learn mutual rich discriminative information between teacher and student models to achieve the goal of knowledge alignment. Instead of the former one-to-one cross-modality matching in the testing stage, a one-to-many cluster cross-modality matching method is proposed to leverage the inherent relationship of intra-class images to reduce the adverse effects of the existing modality gap. Experiments on several representative ZS-SBIR datasets (Sketchy Ext dataset, TU-Berlin Ext dataset and QuickDraw Ext dataset) prove the proposed algorithm can achieve superior performance compared with state-of-the-art methods.


title: LLM-SQL-Solver: Can LLMs Determine SQL Equivalence?

abstract: Judging the equivalence between two SQL queries is a fundamental problem with many practical applications in data management and SQL generation (i.e., evaluating the quality of generated SQL queries in text-to-SQL task). While the research community has reasoned about SQL equivalence for decades, it poses considerable difficulties and no complete solutions exist. Recently, Large Language Models (LLMs) have shown strong reasoning capability in conversation, question answering and solving mathematics challenges. In this paper, we study if LLMs can be used to determine the equivalence between SQL queries under two notions of SQL equivalence (semantic equivalence and relaxed equivalence). To assist LLMs in generating high quality responses, we present two prompting techniques: Miniature & Mull and Explain & Compare. The former technique is used to evaluate the semantic equivalence in which it asks LLMs to execute a query on a simple database instance and then explore if a counterexample exists by modifying the database. The latter technique is used to evaluate the relaxed equivalence in which it asks LLMs to explain the queries and then compare if they contain significant logical differences. Our experiments demonstrate using our techniques, LLMs is a promising tool to help data engineers in writing semantically equivalent SQL queries, however challenges still persist, and is a better metric for evaluating SQL generation than the popular execution accuracy.


title: Viscosity Solutions of a class of Second Order Hamilton-Jacobi-Bellman Equations in the Wasserstein Space

abstract: This paper is devoted to solving a class of second order Hamilton-Jacobi-Bellman (HJB) equations in the Wasserstein space, associated with mean field control problems involving common noise. We provide the well-posedness of viscosity solutions to the HJB equation in the sense of Crandall-Lions' definition, under general assumptions on the coefficients. Our approach adopts the smooth metric developed by Bayraktar, Ekren, and Zhang [Proc. Amer. Math. Soc. (2023)] as our gauge function for the purpose of smooth variational principle used in the proof of comparison theorem. Subsequently, we derive further estimates and regularity of the metric, including a novel second order derivative estimate with respect to the measure variable, in order to ensure the uniqueness and existence.


title: Continuous Prompt Generation from Linear Combination of Discrete Prompt Embeddings

abstract: The wayward quality of continuous prompts stresses the importance of their interpretability as unexpected and unpredictable behaviors appear following training, especially in the context of large language models automating people-sensitive tasks such as resume screening. In this paper we present a novel method of constructing continuous prompts via discrete prompt embeddings and evaluate improvements to continuous prompt interpretability and inference accuracy. For a set of manually designed discrete prompts $\mathcal{D}$, which we tokenize and embed each into tensor form, we train a model to predict the weights such that the linear combinations of those prompts correspond to higher performance on natural language understanding tasks.


title: Federated Learning with Instance-Dependent Noisy Label

abstract: Federated learning (FL) with noisy labels poses a significant challenge. Existing methods designed for handling noisy labels in centralized learning tend to lose their effectiveness in the FL setting, mainly due to the small dataset size and the heterogeneity of client data. While some attempts have been made to tackle FL with noisy labels, they primarily focused on scenarios involving class-conditional noise. In this paper, we study the more challenging and practical issue of instance-dependent noise (IDN) in FL. We introduce a novel algorithm called FedBeat (Federated Learning with Bayesian Ensemble-Assisted Transition Matrix Estimation). FedBeat aims to build a global statistically consistent classifier using the IDN transition matrix (IDNTM), which encompasses three synergistic steps: (1) A federated data extraction step that constructs a weak global model and extracts high-confidence data using a Bayesian model ensemble method. (2) A federated transition matrix estimation step in which clients collaboratively train an IDNTM estimation network based on the extracted data. (3) A federated classifier correction step that enhances the global model's performance by training it using a loss function tailored for noisy labels, leveraging the IDNTM. Experiments conducted on CIFAR-10 and SVHN verify that the proposed method significantly outperforms state-of-the-art methods.


title: An Attentive Inductive Bias for Sequential Recommendation beyond the Self-Attention

abstract: Sequential recommendation (SR) models based on Transformers have achieved remarkable successes. The self-attention mechanism of Transformers for computer vision and natural language processing suffers from the oversmoothing problem, i.e., hidden representations becoming similar to tokens. In the SR domain, we, for the first time, show that the same problem occurs. We present pioneering investigations that reveal the low-pass filtering nature of self-attention in the SR, which causes oversmoothing. To this end, we propose a novel method called $\textbf{B}$eyond $\textbf{S}$elf-$\textbf{A}$ttention for Sequential $\textbf{Rec}$ommendation (BSARec), which leverages the Fourier transform to i) inject an inductive bias by considering fine-grained sequential patterns and ii) integrate low and high-frequency information to mitigate oversmoothing. Our discovery shows significant advancements in the SR domain and is expected to bridge the gap for existing Transformer-based SR models. We test our proposed approach through extensive experiments on 6 benchmark datasets. The experimental results demonstrate that our model outperforms 7 baseline methods in terms of recommendation performance. Our code is available at https://github.com/yehjin-shin/BSARec.


title: Fast Algorithms for Finite Element nonlinear Discrete Systems to Solve the PNP Equations

abstract: The Poisson-Nernst-Planck (PNP) equations are one of the most effective model for describing electrostatic interactions and diffusion processes in ion solution systems, and have been widely used in the numerical simulations of biological ion channels, semiconductor devices, and nanopore systems. Due to the characteristics of strong coupling, convection dominance, nonlinearity and multiscale, the classic Gummel iteration for the nonlinear discrete system of PNP equations converges slowly or even diverges. We focus on fast algorithms of nonlinear discrete system for the general PNP equations, which have better adaptability, friendliness and efficiency than the Gummel iteration. First, a geometric full approximation storage (FAS) algorithm is proposed to improve the slow convergence speed of the Gummel iteration. Second, an algebraic FAS algorithm is designed, which does not require multi-level geometric information and is more suitable for practical computation compared with the geometric one. Finally, improved algorithms based on the acceleration technique and adaptive method are proposed to solve the problems of excessive coarse grid iterations and insufficient adaptability to the size of computational domain in the algebraic FAS algorithm. The numerical experiments are shown for the geometric, algebraic FAS and improved algorithms respectively to illustrate the effiency of the algorithms.


title: Spectroscopy of the $5s5p$ $ ^3 P_0 \rightarrow 5s5d$ $ ^3 D_1 $ transition of strontium using laser cooled atoms

abstract: This article presents spectroscopy results of the $5s5p{\;^3}P_0 \rightarrow 5s5d{\;^3}D_1$ transition in all isotopes of laser cooled Sr atoms and the utility of this transition for repumping application. By employing the $5s5p{\;^{3} P_{0}} \rightarrow 5s5d{\;^3}D_1 $ (483 nm) transition in combination with the excitation of $5s5p{\;^3}P_2 \rightarrow 5s6s{\;^3}S_1$ (707 nm) transition, we observe a significant increase ($\sim$ 13 fold) in the steady state number of atoms in the magneto-optic trap (MOT). This enhancement is attributed to the efficient repumping of Sr atoms that have decayed into the dark $5s5p{\;^3}P_2$ state by returning them to the ground state $5s^2{\;^1}S_0$ without any loss into the other states. The absolute transition frequencies were measured with an absolute accuracy of 30 MHz. To support our measurements, we performed Fock-space relativistic coupled-cluster calculations of the relevant parameters in Sr. To further increase the accuracy of the calculated properties, corrections from the Breit, QED and perturbative triples were also included. The calculated branching ratio for the repumping state confirms the significantly increased population in the ${^3}P_1$ state. Thereby, leading to an increase of population of atoms trapped due to the enhanced repumping. Our calculated hyperfine-splitting energies are in excellent agreement with the measured values. Moreover, our calculated isotope shifts in the transition frequencies are in good agreement with our measured values.


title: Deriving Rewards for Reinforcement Learning from Symbolic Behaviour Descriptions of Bipedal Walking

abstract: Generating physical movement behaviours from their symbolic description is a long-standing challenge in artificial intelligence (AI) and robotics, requiring insights into numerical optimization methods as well as into formalizations from symbolic AI and reasoning. In this paper, a novel approach to finding a reward function from a symbolic description is proposed. The intended system behaviour is modelled as a hybrid automaton, which reduces the system state space to allow more efficient reinforcement learning. The approach is applied to bipedal walking, by modelling the walking robot as a hybrid automaton over state space orthants, and used with the compass walker to derive a reward that incentivizes following the hybrid automaton cycle. As a result, training times of reinforcement learning controllers are reduced while final walking speed is increased. The approach can serve as a blueprint how to generate reward functions from symbolic AI and reasoning.


title: Perturbation-Invariant Adversarial Training for Neural Ranking Models: Improving the Effectiveness-Robustness Trade-Off

abstract: Neural ranking models (NRMs) have shown great success in information retrieval (IR). But their predictions can easily be manipulated using adversarial examples, which are crafted by adding imperceptible perturbations to legitimate documents. This vulnerability raises significant concerns about their reliability and hinders the widespread deployment of NRMs. By incorporating adversarial examples into training data, adversarial training has become the de facto defense approach to adversarial attacks against NRMs. However, this defense mechanism is subject to a trade-off between effectiveness and adversarial robustness. In this study, we establish theoretical guarantees regarding the effectiveness-robustness trade-off in NRMs. We decompose the robust ranking error into two components, i.e., a natural ranking error for effectiveness evaluation and a boundary ranking error for assessing adversarial robustness. Then, we define the perturbation invariance of a ranking model and prove it to be a differentiable upper bound on the boundary ranking error for attainable computation. Informed by our theoretical analysis, we design a novel \emph{perturbation-invariant adversarial training} (PIAT) method for ranking models to achieve a better effectiveness-robustness trade-off. We design a regularized surrogate loss, in which one term encourages the effectiveness to be maximized while the regularization term encourages the output to be smooth, so as to improve adversarial robustness. Experimental results on several ranking models demonstrate the superiority of PITA compared to existing adversarial defenses.


title: Convergence and complexity of block majorization-minimization for constrained block-Riemannian optimization

abstract: Block majorization-minimization (BMM) is a simple iterative algorithm for nonconvex optimization that sequentially minimizes a majorizing surrogate of the objective function in each block coordinate while the other block coordinates are held fixed. We consider a family of BMM algorithms for minimizing smooth nonconvex objectives, where each parameter block is constrained within a subset of a Riemannian manifold. We establish that this algorithm converges asymptotically to the set of stationary points, and attains an $\epsilon$-stationary point within $\widetilde{O}(\epsilon^{-2})$ iterations. In particular, the assumptions for our complexity results are completely Euclidean when the underlying manifold is a product of Euclidean or Stiefel manifolds, although our analysis makes explicit use of the Riemannian geometry. Our general analysis applies to a wide range of algorithms with Riemannian constraints: Riemannian MM, block projected gradient descent, optimistic likelihood estimation, geodesically constrained subspace tracking, robust PCA, and Riemannian CP-dictionary-learning. We experimentally validate that our algorithm converges faster than standard Euclidean algorithms applied to the Riemannian setting.


title: Gambling under unknown probabilities as a proxy for real world decisions under uncertainty

abstract: We give elementary examples within a framework for studying decisions under uncertainty where probabilities are only roughly known. The framework, in gambling terms, is that the size of a bet is proportional to the gambler's perceived advantage based on their perceived probability, and their accuracy in estimating true probabilities is measured by mean squared-error. Within this framework one can study the cost of estimation errors, and seek to formalize the ``obvious" notion that in competitive interactions between agents whose actions depend on their perceived probabilities, those who are more accurate at estimating probabilities will generally be more successful than those who are less accurate.


title: ProTIP: Progressive Tool Retrieval Improves Planning

abstract: Large language models (LLMs) are increasingly employed for complex multi-step planning tasks, where the tool retrieval (TR) step is crucial for achieving successful outcomes. Two prevalent approaches for TR are single-step retrieval, which utilizes the complete query, and sequential retrieval using task decomposition (TD), where a full query is segmented into discrete atomic subtasks. While single-step retrieval lacks the flexibility to handle "inter-tool dependency," the TD approach necessitates maintaining "subtask-tool atomicity alignment," as the toolbox can evolve dynamically. To address these limitations, we introduce the Progressive Tool retrieval to Improve Planning (ProTIP) framework. ProTIP is a lightweight, contrastive learning-based framework that implicitly performs TD without the explicit requirement of subtask labels, while simultaneously maintaining subtask-tool atomicity. On the ToolBench dataset, ProTIP outperforms the ChatGPT task decomposition-based approach by a remarkable margin, achieving a 24% improvement in Recall@K=10 for TR and a 41% enhancement in tool accuracy for plan generation.


title: Logit-based alternatives to two-stage least squares

abstract: We propose logit-based IV and augmented logit-based IV estimators that serve as alternatives to the traditionally used 2SLS estimator in the model where both the endogenous treatment variable and the corresponding instrument are binary. Our novel estimators are as easy to compute as the 2SLS estimator but have an advantage over the 2SLS estimator in terms of causal interpretability. In particular, in certain cases where the probability limits of both our estimators and the 2SLS estimator take the form of weighted-average treatment effects, our estimators are guaranteed to yield non-negative weights whereas the 2SLS estimator is not.


title: "SNe Ia twins for life" towards a precise determination of H$_{0}$

abstract: Here we present an approach to the measurement of extragalactic distances using twin SNe Ia, taken from the early down to the nebular phase. The approach is purely empirical, although we can give a theoretical background on why the method is reliable. Studying those twins in galaxies where peculiar velocities are relatively unimportant, we can tackle the H$_{0}$ tension problem. Here we apply the method to the determination of the distances to NGC 7250 and NGC 2525, who hosted respectively SN 2013dy and SN 2018gv, twins of two different SNe Ia prototypes: SN 2013aa/ SN 2017cbv and SN2011fe. From the study of the SN 2013aa and SN 2017cbv twin pair, by comparing it with SN 2011fe and applying the difference between the SN 2013aa/2017cbv and the SN 2011fe class, we find as well a good estimate of the distance to NGC 5643. We just have started to measure distances with this method for the samples in Freedman et al. (2019) and Riess et al. (2022). There are differences in measured distances to the same galaxy using Cepheids or TRGBs. In this context of discrepancy, the "twins for life" method is very competitive, as it can provide distance estimates with a modulus error of $\sigma_{\mu}$ $=$ 0.04 mag. Our findings call for a revision of the distance measured with Cepheids in Riess et al. (2022). NGC 7250 and NGC 2525 need better measurements with Cepheids. The Hubble tension can arise from the way in which the local SNe Ia sample is linked to the SNe Ia Hubble flow sample. A good calibration of distances of SNe Ia in the local sample can be provided with this approach. We aim at comparing them with SNe Ia twins in galaxies at z $>$0.02--0.03 well into the Hubble flow to obtain a reliable value for H$_{0}$.


title: Electronic phase transition, vibrational properties and structural stability of single and two polyyne chains under external electric field

abstract: Search for one dimensional (1D) van der Waals materials has become an urgent need to meet the demand as building blocks for high performance, miniaturized, lightweight device applications. Polyyne, a 1D atomic chain of carbon is the thinnest and strongest allotrope of carbon, showing promising applications in new generation low dimensional devices due to the presence of a band gap. A system of two carbon chains held together by van der Waals interaction has been theoretically postulated and shows band gap tunability under structural changes which finds applications in the realms of resistive switching and spintronics. In this study, we use first principles Density Functional Theory (DFT) to show a sharp semiconductor to metal transition along with the emergence of an asymmetry in the spin polarized density of states for single and two polyyne chains under a transverse electric field. The thermodynamic stability of the system has been substantiated through the utilization of Ab Initio Molecular Dynamics (AIMD) simulations, phonon dispersion curve analyses, and formation energy calculations. Furthermore, in addition to its dynamic stability assessment, phonon calculations have served to identify Raman active vibrational modes which offers an invaluable non-destructive experimental avenue for discerning electronic phase transitions in response to an applied electric field. Our study presents a predictive framework for the prospective utilization of one and two polyyne chains in forthcoming flexible nano-electronic and spintronic devices. The future prospects of the system are contingent upon advancements in nano-electronics fabrication techniques and the precise construction of circuitry for harnessing spin-related applications.


title: Certified Minimax Unlearning with Generalization Rates and Deletion Capacity

abstract: We study the problem of $(\epsilon,\delta)$-certified machine unlearning for minimax models. Most of the existing works focus on unlearning from standard statistical learning models that have a single variable and their unlearning steps hinge on the direct Hessian-based conventional Newton update. We develop a new $(\epsilon,\delta)$-certified machine unlearning algorithm for minimax models. It proposes a minimax unlearning step consisting of a total-Hessian-based complete Newton update and the Gaussian mechanism borrowed from differential privacy. To obtain the unlearning certification, our method injects calibrated Gaussian noises by carefully analyzing the "sensitivity" of the minimax unlearning step (i.e., the closeness between the minimax unlearning variables and the retraining-from-scratch variables). We derive the generalization rates in terms of population strong and weak primal-dual risk for three different cases of loss functions, i.e., (strongly-)convex-(strongly-)concave losses. We also provide the deletion capacity to guarantee that a desired population risk can be maintained as long as the number of deleted samples does not exceed the derived amount. With training samples $n$ and model dimension $d$, it yields the order $\mathcal O(n/d^{1/4})$, which shows a strict gap over the baseline method of differentially private minimax learning that has $\mathcal O(n/d^{1/2})$. In addition, our rates of generalization and deletion capacity match the state-of-the-art rates derived previously for standard statistical learning models.


title: Predicted Multiple Walker Breakdowns for Current-Driven Domain-Wall Motion in Antiferromagnets

abstract: We theoretically discover possible emergence of reentrant Walker breakdowns for current-driven domain walls in layered antiferromagnets in striking contrast to the unique Walker breakdown in ferromagnets. We reveal that the Lorentz contraction of domain-wall width in antiferromagnets gives rise to nonlinear current-dependence of the wall velocity and the predicted multiple Walker breakdowns. The dominant efficiency of the current-induced staggered spin-orbit torque over the spin-transfer torque to drive the domain-wall motion is also demonstrated. These findings are expected to be observed in synthetic antiferromagnets experimentally and provide an important contribution to the growing research field of antiferromagnetic spintronics.


title: Material Point Methods on Unstructured Tessellations: A Stable Kernel Approach With Continuous Gradient Reconstruction

abstract: The Material Point Method (MPM) is a hybrid Eulerian-Lagrangian simulation technique for solid mechanics with significant deformation. Structured background grids are commonly employed in the standard MPM, but they may give rise to several accuracy problems in handling complex geometries. When using (2D) unstructured triangular or (3D) tetrahedral background elements, however, significant challenges arise (eg, cell-crossing error). Substantial numerical errors develop due to the inherent C0 continuity property of the interpolation function, which causes discontinuous gradients across element boundaries. Prior efforts in constructing C1 continuous interpolation functions have either not been adapted for unstructured grids or have only been applied to 2D triangular meshes. In this study, an Unstructured Moving Least Squares MPM (UMLS-MPM) is introduced to accommodate 2D and 3D simplex tessellation. The central idea is to incorporate a diminishing function into the sample weights of the MLS kernel, ensuring an analytically continuous velocity gradient estimation. Numerical analyses confirm the method's capability in mitigating cell crossing inaccuracies and realizing expected convergence.


title: Model-free Learning of Corridor Clearance: A Near-term Deployment Perspective

abstract: An emerging public health application of connected and automated vehicle (CAV) technologies is to reduce response times of emergency medical service (EMS) by indirectly coordinating traffic. Therefore, in this work we study the CAV-assisted corridor clearance for EMS vehicles from a short term deployment perspective. Existing research on this topic often overlooks the impact of EMS vehicle disruptions on regular traffic, assumes 100% CAV penetration, relies on real-time traffic signal timing data and queue lengths at intersections, and makes various assumptions about traffic settings when deriving optimal model-based CAV control strategies. However, these assumptions pose significant challenges for near-term deployment and limit the real-world applicability of such methods. To overcome these challenges and enhance real-world applicability in near-term, we propose a model-free approach employing deep reinforcement learning (DRL) for designing CAV control strategies, showing its reduced overhead in designing and greater scalability and performance compared to model-based methods. Our qualitative analysis highlights the complexities of designing scalable EMS corridor clearance controllers for diverse traffic settings in which DRL controller provides ease of design compared to the model-based methods. In numerical evaluations, the model-free DRL controller outperforms the model-based counterpart by improving traffic flow and even improving EMS travel times in scenarios when a single CAV is present. Across 19 considered settings, the learned DRL controller excels by 25% in reducing the travel time in six instances, achieving an average improvement of 9%. These findings underscore the potential and promise of model-free DRL strategies in advancing EMS response and traffic flow coordination, with a focus on practical near-term deployment.


title: Collisional flavor pendula and neutrino quantum thermodynamics

abstract: Neutrinos in core-collapse supernovae and neutron-star mergers are susceptible to flavor instabilities of three kinds: slow, fast, and collisional. Prior work has established mappings of the first two onto abstract mechanical systems in flavor space, respectively named the slow and fast flavor pendula. Here we introduce and analyze the flavor pendulum associated with the third class. We explain our results in terms of the recently developed theory of neutrino quantum thermodynamics. Perhaps our most surprising finding is that there exists a limit in which decoherent interactions drive perfectly coherent flavor conversion.


title: Non-abelian cohomology of Lie $H$-pseudoalgebras and inducibility of automorphisms

abstract: The notion of Lie $H$-pseudoalgebra is a higher-dimensional analogue of Lie conformal algebras. In this paper, we classify the equivalence classes of non-abelian extensions of a Lie $H$-pseudoalgebra $L$ by another Lie $H$-pseudoalgebra $M$ in terms of the non-abelian cohomology group $H^2_{nab} (L, M)$. We also show that the group $H^2_{nab} (L, M)$ can be realized as the Deligne groupoid of a suitable differential graded Lie algebra. Finally, we consider the inducibility of a pair of Lie $H$-pseudoalgebra automorphisms in a given non-abelian extension. We show that the corresponding obstruction can be realized as the image of a suitable Wells map in the context.


title: Self-supervised Adaptive Weighting for Cooperative Perception in V2V Communications

abstract: Perception of the driving environment is critical for collision avoidance and route planning to ensure driving safety. Cooperative perception has been widely studied as an effective approach to addressing the shortcomings of single-vehicle perception. However, the practical limitations of vehicle-to-vehicle (V2V) communications have not been adequately investigated. In particular, current cooperative fusion models rely on supervised models and do not address dynamic performance degradation caused by arbitrary channel impairments. In this paper, a self-supervised adaptive weighting model is proposed for intermediate fusion to mitigate the adverse effects of channel distortion. The performance of cooperative perception is investigated in different system settings. Rician fading and imperfect channel state information (CSI) are also considered. Numerical results demonstrate that the proposed adaptive weighting algorithm significantly outperforms the benchmarks without weighting. Visualization examples validate that the proposed weighting algorithm can flexibly adapt to various channel conditions. Moreover, the adaptive weighting algorithm demonstrates good generalization to untrained channels and test datasets from different domains.


title: In-Sensor Radio Frequency Computing for Energy-Efficient Intelligent Radar

abstract: Radio Frequency Neural Networks (RFNNs) have demonstrated advantages in realizing intelligent applications across various domains. However, as the model size of deep neural networks rapidly increases, implementing large-scale RFNN in practice requires an extensive number of RF interferometers and consumes a substantial amount of energy. To address this challenge, we propose to utilize low-rank decomposition to transform a large-scale RFNN into a compact RFNN while almost preserving its accuracy. Specifically, we develop a Tensor-Train RFNN (TT-RFNN) where each layer comprises a sequence of low-rank third-order tensors, leading to a notable reduction in parameter count, thereby optimizing RF interferometer utilization in comparison to the original large-scale RFNN. Additionally, considering the inherent physical errors when mapping TT-RFNN to RF device parameters in real-world deployment, from a general perspective, we construct the Robust TT-RFNN (RTT-RFNN) by incorporating a robustness solver on TT-RFNN to enhance its robustness. To adapt the RTT-RFNN to varying requirements of reshaping operations, we further provide a reconfigurable reshaping solution employing RF switch matrices. Empirical evaluations conducted on MNIST and CIFAR-10 datasets show the effectiveness of our proposed method.


title: Unveiling Passive and Active EMF Exposure in Large-Scale Cellular Networks

abstract: With the development of fifth-generation (5G) networks, the number of user equipments (UE) increases dramatically. However, the potential health risks from electromagnetic fields (EMF) tend to be a public concern. Generally, EMF exposure-related analysis mainly considers the passive exposure from base stations (BSs) and active exposure that results from the user's personal devices while communicating. However, the passive radiation that is generated by nearby devices of other users is typically ignored. In fact, with the increase in the density of UE, their passive exposure to human bodies can no longer be ignored. In this work, we propose a stochastic geometry framework to analyze the EMF exposure from active and passive radiation sources. In particular, considering a typical user, we account for their exposure to EMF from BSs, their own UE, and other UE. We derive the distribution of the Exposure index (EI) and the coverage probability for two typical models for spatial distributions of UE, i.e., \textit{i)} a Poisson point process (PPP); \textit{ii)} a Matern cluster process. Also, we show the trade-off between the EMF exposure and the coverage probability. Our numerical results suggest that the passive exposure from other users is non-negligible compared to the exposure from BSs when user density is $10^2$ times higher than BS density, and non-negligible compared to active exposure from the user's own UE when user density is $10^5$ times the BS density.


title: Multi-Target Two-way Integrated Sensing and Communications with Full Duplex MIMO Radios

abstract: In this paper, we propose a multiple input multiple output (MIMO) Full-Duplex Integrated Sensing and Communication System consisting of multiple targets, a single downlink, and a single uplink user. We employed signal-to-interference plus noise ratio (SINR) as the performance metric for radar, downlink, and uplink communication. We use a communication-centric approach in which communication waveform is used for both communication and sensing of the environment. We develop a sensing algorithm capable of estimating the direction of arrival (DoA), range, and velocity of each target. We also propose a joint optimization framework for designing A/D transmit and receive beamformers to improve radar, downlink, and uplink SINRs while minimizing self-interference (SI) leakage. We also propose a null space projection (NSP) based approach to improve the uplink rate. Our simulation results, considering orthogonal frequency division multiplexing (OFDM) waveform, show accurate radar parameter estimation with improved downlink and uplink rate.


title: MMBaT: A Multi-task Framework for mmWave-based Human Body Reconstruction and Translation Prediction

abstract: Human body reconstruction with Millimeter Wave (mmWave) radar point clouds has gained significant interest due to its ability to work in adverse environments and its capacity to mitigate privacy concerns associated with traditional camera-based solutions. Despite pioneering efforts in this field, two challenges persist. Firstly, raw point clouds contain massive noise points, usually caused by the ambient objects and multi-path effects of Radio Frequency (RF) signals. Recent approaches typically rely on prior knowledge or elaborate preprocessing methods, limiting their applicability. Secondly, even after noise removal, the sparse and inconsistent body-related points pose an obstacle to accurate human body reconstruction. To address these challenges, we introduce mmBaT, a novel multi-task deep learning framework that concurrently estimates the human body and predicts body translations in subsequent frames to extract body-related point clouds. Our method is evaluated on two public datasets that are collected with different radar devices and noise levels. A comprehensive comparison against other state-of-the-art methods demonstrates our method has a superior reconstruction performance and generalization ability from noisy raw data, even when compared to methods provided with body-related point clouds.


title: Integrated multi-color Raman microlasers with ultra-low pump levels in single high-Q lithium niobate microdisks

abstract: Photonic integrated Raman microlasers, particularly discrete multi-color lasers which are crucial for extending the emission wavelength range of chip-scale laser sources to much shorter wavelength, are highly in demand for various spectroscopy, microscopy analysis, and biological detection. However, integrated multi-color Raman microlasers have yet to be demonstrated because of the requirement of high-Q microresonators possessing large second-order nonlinearity and strong Raman phonon branches and the challenging in cavity-enhanced multi-photon hyper-Raman scattering parametric process. In this work, integrated multi-color Raman lasers have been demonstrated for the first time at weak pump levels, via the excitation of high-Q (>6 X 10^6) phase-matched modes in single thin-film lithium niobate (TFLN) microresonators by dispersion engineering. Raman lasing was observed at 1712 nm for a 1546-nm pump threshold power of only 620 uW. Furthermore, multi-color Raman lasers were realized at discrete wavelengths of 1712 nm, 813 nm, 533 nm and 406 nm with pump levels as low as 1.60 mW, which is more than two order of magnitude lower than the current records (i.e., 200 mW) in bulk resonators, allowed by the fulfillment of the requisite conditions consisting of broadband natural phase match, multiple-resonance and high Q-factors.


title: On the stratification of combinatorial spectra

abstract: In this note, we investigate a mixture of combinatorial spectra and stratified simplicial sets, which would be thought of as a model of the spectrum objects of $(\infty, \infty)$-categories.


title: A Comparative Analysis of Large Language Models for Code Documentation Generation

abstract: This paper presents a comprehensive comparative analysis of Large Language Models (LLMs) for generation of code documentation. Code documentation is an essential part of the software writing process. The paper evaluates models such as GPT-3.5, GPT-4, Bard, Llama2, and Starchat on various parameters like Accuracy, Completeness, Relevance, Understandability, Readability and Time Taken for different levels of code documentation. Our evaluation employs a checklist-based system to minimize subjectivity, providing a more objective assessment. We find that, barring Starchat, all LLMs consistently outperform the original documentation. Notably, closed-source models GPT-3.5, GPT-4, and Bard exhibit superior performance across various parameters compared to open-source/source-available LLMs, namely LLama 2 and StarChat. Considering the time taken for generation, GPT-4 demonstrated the longest duration, followed by Llama2, Bard, with ChatGPT and Starchat having comparable generation times. Additionally, file level documentation had a considerably worse performance across all parameters (except for time taken) as compared to inline and function level documentation.


title: Continuous Phase Transition in Anyonic-PT Symmetric Systems

abstract: We reveal the continuous phase transition in anyonic-PT symmetric systems, contrasting with the discontinuous phase transition corresponding to the discrete (anti-) PT symmetry. The continuous phase transition originates from the continuity of anyonic-PT symmetry. We find there are three information-dynamics patterns for anyonic-PT symmetric systems: damped oscillations with an overall decrease (increase) and asymptotically stable damped oscillations, which are three-fold degenerate and distorted using the Hermitian quantum R\'enyi entropy or distinguishability. It is the normalization of the non-unitary evolved density matrix causes the degeneracy and distortion. We give a justification for non-Hermitian quantum R\'enyi entropy being negative. By exploring the mathematics and physical meaning of the negative entropy in open quantum systems, we connect the negative non-Hermitian quantum R\'enyi entropy and negative quantum conditional entropy, opening up a new journey to rigorously investigate the negative entropy in open quantum systems.


title: Opara: Exploiting Operator Parallelism for Expediting DNN Inference on GPUs

abstract: GPUs have become the \emph{defacto} hardware devices for accelerating Deep Neural Network (DNN) inference workloads. However, the conventional \emph{sequential execution mode of DNN operators} in mainstream deep learning frameworks cannot fully utilize GPU resources, even with the operator fusion enabled, due to the increasing complexity of model structures and a greater diversity of operators. Moreover, the \emph{inadequate operator launch order} in parallelized execution scenarios can lead to GPU resource wastage and unexpected performance interference among operators. In this paper, we propose \emph{Opara}, a resource- and interference-aware DNN \underline{Op}erator \underline{para}llel scheduling framework to accelerate DNN inference on GPUs. Specifically, \emph{Opara} first employs \texttt{CUDA Streams} and \texttt{CUDA Graph} to \emph{parallelize} the execution of multiple operators automatically. To further expedite DNN inference, \emph{Opara} leverages the resource demands of operators to judiciously adjust the operator launch order on GPUs, overlapping the execution of compute-intensive and memory-intensive operators. We implement and open source a prototype of \emph{Opara} based on PyTorch in a \emph{non-intrusive} manner. Extensive prototype experiments with representative DNN and Transformer-based models demonstrate that \emph{Opara} outperforms the default sequential \texttt{CUDA Graph} in PyTorch and the state-of-the-art operator parallelism systems by up to $1.68\times$ and $1.29\times$, respectively, yet with acceptable runtime overhead.


title: Multiple magnetic transitions, metamagnetism and large magnetoresistance in GdAuGe single crystals

abstract: We report the physical properties of GdAuGe single crystals, which were grown using Bi flux. The powder x-ray diffraction data shows that the compound crystallizes in hexagonal NdPtSb-type structure (space group P63mc). Magnetization measurements performed for field configuration H||c and H||ab show that GdAuGe orders antiferromagnetically at the Neel temperature, TN = 17.2 K. Around this temperature, heat capacity and electrical resistivity data exhibit prominent anomaly due to the antiferromagnetic (AFM) transition. In addition to an AFM phase transition, the magnetization data for H||c display the signature of field-induced metamagnetic (MM) transitions below TN. The critical field range for these transitions vary from 0.2 to 6.2 T. The critical fields for the MM transitions decrease with increasing temperature and approach zero value for temperature approaching TN. Interestingly, the magnetoresistance (MR) data (for H||c) record a sharp increase in values at the critical fields that coincide with those seen in magnetization data, tracking the presence of MM transitions. MR is positive and large (169% at 9 T and 2 K) at low temperatures. Above TN, MR becomes small and switches to negative values. Hall resistivity data reveal the predominance of hole charge carriers in the system. In addition, we observe an emergence of step-like feature in the Hall resistivity data within the field range of second MM, and a significantly large anomalous Hall conductivity of 1270 {\Omega}-1 cm-1 at 2 K. The H-T phase diagram constructed from our detailed magnetization and magnetotransport measurements reveals multiple intricate magnetic phase transitions. The electronic and magnetic structure of GdAuGe are also thoroughly investigated using first-principles methods. The electronic band structure calculations reveal that GdAuGe is a Dirac nodal-line semimetal.


title: Effect of the presence of pinned particles on the structural parameters of a liquid and correlation between structure and dynamics at the local level

abstract: Pinning particles at the equilibrium configuration of the liquid is expected not to affect the structure and any property that depends on the structure while slowing down the dynamics. This leads to a breakdown of the structure dynamics correlation. Here, we calculate two structural quantities, the pair excess entropy, $S_2$, and the mean field caging potential, the inverse of which is our structural order parameter (SOP). We show that when the pinned particles are treated the same way as the mobile particles, both $S_2$ and SOP of the mobile particles remain the same as that of the unpinned system, and the structure dynamics correlation decreases with an increase in pinning density, "c". However, when we treat the pinned particles as a different species, even if we consider that the structure does not change, the expression of $S_2$ and SOP changes. The microscopic expressions show that interaction between a pinned and mobile particle affects $S_2$ and SOP more than the interaction between two mobile particles. We show that a similar effect is also present in the calculation of the excess entropy and the primary reason for the well-known vanishing of the configurational entropy at high temperatures. We further show that contrary to common belief, the pinning process does change the structure. When these two effects are considered, both $S_2$ and SOP decrease with an increase in "c", and the correlation between the structural parameters and the dynamics continues even for higher values of "c".

categories: physics.chem-ph cond-mat.soft cond-mat.stat-mech physics.comp-ph physics.flu-dyn


title: Superconductivity in a ferroelectric-like topological semimetal SrAuBi

abstract: Given the rarity of metallic systems that exhibit ferroelectric-like transitions, it is apparently challenging to find a system that simultaneously possesses superconductivity and ferroelectric-like structural instability. Here, we report the observation of superconductivity at 2.4 K in a layered semimetal SrAuBi characterized by strong spin-orbit coupling (SOC) and ferroelectric-like lattice distortion. Single crystals of SrAuBi have been successfully synthesized and found to show a polar-nonpolar structure transition at 214 K, which is associated with the buckling of Au-Bi honeycomb lattice. On the basis of the band calculations considering SOC, we found significant Rashba-type spin splitting and symmetry-protected multiple Dirac points near the Fermi level. We believe that this discovery opens up new possibilities of pursuing exotic superconducting states associated with the semimetallic band structure without space inversion symmetry and the topological surface state with the strong SOC.


title: CoAScore: Chain-of-Aspects Prompting for NLG Evaluation

abstract: Recently, natural language generation (NLG) evaluation has shifted from a single-aspect to a multi-aspect paradigm, allowing for a more accurate assessment. Large language models (LLMs) achieve superior performance on various NLG evaluation tasks. However, current work often employs the LLM to independently evaluate different aspects, which largely ignores the rich correlation between various aspects. To fill this research gap, in this work, we propose an NLG evaluation metric called CoAScore. Powered by LLMs, the CoAScore utilizes multi-aspect knowledge through a CoA (\textbf{C}hain-\textbf{o}f-\textbf{A}spects) prompting framework when assessing the quality of a certain aspect. Specifically, for a given aspect to evaluate, we first prompt the LLM to generate a chain of aspects that are relevant to the target aspect and could be useful for the evaluation. We then collect evaluation scores for each generated aspect, and finally, leverage the knowledge of these aspects to improve the evaluation of the target aspect. We evaluate CoAScore across five NLG evaluation tasks (e.g., summarization, dialog response generation, etc) and nine aspects (e.g., overall quality, relevance, coherence, etc). Our experimental findings highlight that, in comparison to individual aspect evaluation, CoAScore exhibits a higher correlation with human judgments. This improvement significantly outperforms existing unsupervised evaluation metrics, whether for assessing overall quality or other aspects. We also conducted extensive ablation studies to validate the effectiveness of the three stages within the CoAScore framework and conducted case studies to show how the LLM performs in these stages. Our code and scripts are available.


title: End-to-End Asynchronous Traffic Scheduling in Converged 5G and Time-Sensitive Networks

abstract: As required by Industry 4.0, companies will move towards flexible and individual manufacturing. To succeed in this transition, convergence of 5G and time-sensitive networks (TSN) is the most promising technology and has thus attracted considerable interest from industry and standardization groups. However, the delay and jitter of end-to-end (e2e) transmission will get exacerbated if the transmission opportunities are missed in TSN due to the 5G transmission jitter and the clock skew between the two network systems. To mitigate this phenomenon, we propose a novel asynchronous access mechanism (AAM) that isolates the jitter only in the 5G system and ensures zero transmission jitter in TSN. We then exploit AAM to develop an e2e asynchronous traffic scheduling model for coordinated allocation of resources for 5G and TSN to provide e2e transmission delay guarantees for time-critical flows. The results of our extensive simulation of AAM on OMNET++ corroborate the superior performance of AAM and the scheduling model.


title: Curved nonlinear waveguides

abstract: The Dirichlet p-Laplacian in tubes of arbitrary cross-section along infinite curves in Euclidean spaces of arbitrary dimension is investigated. First, it is shown that the gap between the lowest point of the generalised spectrum and the essential spectrum is positive whenever the cross-section is circular and the tube is asymptotically straight, untwisted and non-trivially bent. Second, a Hardy-type inequality is derived for unbent and non-trivially twisted tubes.


title: CONCSS: Contrastive-based Context Comprehension for Dialogue-appropriate Prosody in Conversational Speech Synthesis

abstract: Conversational speech synthesis (CSS) incorporates historical dialogue as supplementary information with the aim of generating speech that has dialogue-appropriate prosody. While previous methods have already delved into enhancing context comprehension, context representation still lacks effective representation capabilities and context-sensitive discriminability. In this paper, we introduce a contrastive learning-based CSS framework, CONCSS. Within this framework, we define an innovative pretext task specific to CSS that enables the model to perform self-supervised learning on unlabeled conversational datasets to boost the model's context understanding. Additionally, we introduce a sampling strategy for negative sample augmentation to enhance context vectors' discriminability. This is the first attempt to integrate contrastive learning into CSS. We conduct ablation studies on different contrastive learning strategies and comprehensive experiments in comparison with prior CSS systems. Results demonstrate that the synthesized speech from our proposed method exhibits more contextually appropriate and sensitive prosody.


title: Conformer-Based Speech Recognition On Extreme Edge-Computing Devices

abstract: With increasingly more powerful compute capabilities and resources in today's devices, traditionally compute-intensive automatic speech recognition (ASR) has been moving from the cloud to devices to better protect user privacy. However, it is still challenging to implement on-device ASR on resource-constrained devices, such as smartphones, smart wearables, and other smart home automation devices. In this paper, we propose a series of model architecture adaptions, neural network graph transformations, and numerical optimizations to fit an advanced Conformer based end-to-end streaming ASR system on resource-constrained devices without accuracy degradation. We achieve over 5.26 times faster than realtime (0.19 RTF) speech recognition on smart wearables while minimizing energy consumption and achieving state-of-the-art accuracy. The proposed methods are widely applicable to other transformer-based server-free AI applications. In addition, we provide a complete theory on optimal pre-normalizers that numerically stabilize layer normalization in any Lp-norm using any floating point precision.


title: Controlling Data Access Load in Distributed Systems

abstract: Distributed systems store data objects redundantly to balance the data access load over multiple nodes. Load balancing performance depends mainly on 1) the level of storage redundancy and 2) the assignment of data objects to storage nodes. We analyze the performance implications of these design choices by considering four practical storage schemes that we refer to as clustering, cyclic, block and random design. We formulate the problem of load balancing as maintaining the load on any node below a given threshold. Regarding the level of redundancy, we find that the desired load balance can be achieved in a system of $n$ nodes only if the replication factor $d = \Omega(\log(n)^{1/3})$, which is a necessary condition for any storage design. For clustering and cyclic designs, $d = \Omega(\log(n))$ is necessary and sufficient. For block and random designs, $d = \Omega(\log(n))$ is sufficient but unnecessary. Whether $d = \Omega(\log(n)^{1/3})$ is sufficient remains open. The assignment of objects to nodes essentially determines which objects share the access capacity on each node. We refer to the number of nodes jointly shared by a set of objects as the \emph{overlap} between those objects. We find that many consistently slight overlaps between the objects (block, random) are better than few but occasionally significant overlaps (clustering, cyclic). However, when the demand is ''skewed beyond a level'' the impact of overlaps becomes the opposite. We derive our results by connecting the load-balancing problem to mathematical constructs that have been used to study other problems. For a class of storage designs containing the clustering and cyclic design, we express load balance in terms of the maximum of moving sums of i.i.d. random variables, which is known as the scan statistic. For random design, we express load balance by using the occupancy metric for random allocation with complexes.


title: Exploring UMAP in hybrid models of entropy-based and representativeness sampling for active learning in biomedical segmentation

abstract: In this work, we study various hybrid models of entropy-based and representativeness sampling techniques in the context of active learning in medical segmentation, in particular examining the role of UMAP (Uniform Manifold Approximation and Projection) as a technique for capturing representativeness. Although UMAP has been shown viable as a general purpose dimension reduction method in diverse areas, its role in deep learning-based medical segmentation has yet been extensively explored. Using the cardiac and prostate datasets in the Medical Segmentation Decathlon for validation, we found that a novel hybrid combination of Entropy-UMAP sampling technique achieved a statistically significant Dice score advantage over the random baseline ($3.2 \%$ for cardiac, $4.5 \%$ for prostate), and attained the highest Dice coefficient among the spectrum of 10 distinct active learning methodologies we examined. This provides preliminary evidence that there is an interesting synergy between entropy-based and UMAP methods when the former precedes the latter in a hybrid model of active learning.


title: On simplicity of Cuntz algebra and its generalizations

abstract: Cuntz algebra $\mathcal O_2$ is the universal $C^*$-algebra generated by two isometries $s_1, s_2$ satisfying $s_1s_1^*+s_2s_2^*=1$. This is separable, simple, infinite $C^*$-algebra containing a copy of any nuclear $C^*$-algebra. The $C^*$-algebra $\mathcal O_2$ plays a central role in the modern theory of $C^*$-algebras and appears in many substantial statements, including a formulation of the celebrated Uniform Coefficient Theorem (UCT). There are several extensions of this notion, including Cuntz algebra $\mathcal O_n$, Cuntz-Krieger algebra $\mathcal O_A$ for a matrix $A$, Cuntz-Pimsner algebra $\mathcal O_X$ and its relaxation by Katsura for a $C^*$-correspondence $X$, and Cuntz-Nica-Pimsner algebra $\mathcal {NO}_X$, for a product system $X$. We give an overview of the construction of these classes of $C^*$-algebras with a focus on conditions ensuring their simplicity, which is needed in the Elliott Classification Program, as it erature, except our discussion on the sufficient conditions for simplicity of the reduced Cuntz-Nica-Pimsner algebra $\mathcal{NO}^r_X$, which is known to expertsstands now. The results we present are now part of the lit, but might happen to be new for some of our audiences.


title: Bubble-induced convection and flow-instability in a soft reactor

abstract: Buoyancy-driven bubbly flows play pivotal roles in various scenarios, such as the oxygenation and mixing in the upper ocean and the reaction kinetics in chemical and bio-reactors. This work focuses on the convective flow induced by the localized release of large air bubbles ($D_b=3.7$ mm, $\mathrm{Re}_b=950$) in a water tank, exploring the resulting flow and the transition from laminar to disturbed states as a function of the Rayleigh number in the range $3\times10^3 \div 2\times10^5$. At low $\mathrm{Ra}$ the flow is smooth and laminar with weak temporal oscillations, while a highly disturbed state appears above a critical value $\mathrm{Ra}_c$. A theoretical analysis is presented that links the mean flow circulation to the Rayleigh number. Through an experimental investigation, utilizing 3D-particle tracking velocimetry and flow visualization, we confirm the theory presented, and characterize the laminar to disturbed transition in the system. The study offers insights into the convective flow dynamics generated by bubbles, with implications for applications such as bio-reactor soft mixer design.


title: A second-order operator for horizontal quasiconvexity in the Heisenberg group and application to convexity preserving for horizontal curvature flow

abstract: This paper is concerned with a PDE approach to horizontally quasiconvex (h-quasiconvex) functions in the Heisenberg group based on a nonlinear second order elliptic operator. We discuss sufficient conditions and necessary conditions for upper semicontinuous, h-quasiconvex functions in terms of the viscosity subsolution to the associated elliptic equation. Since the notion of h-quasiconvexity is equivalent to the horizontal convexity (h-convexity) of the function's sublevel sets, we further adopt these conditions to study the h-convexity preserving property for horizontal curvature flow in the Heisenberg group. Under the comparison principle, we show that the curvature flow starting from a star-shaped h-convex set preserves the h-convexity during the evolution.


title: SPT: Fine-Tuning Transformer-based Language Models Efficiently with Sparsification

abstract: Transformer-based large language models (e.g., BERT and GPT) achieve great success, and fine-tuning, which tunes a pre-trained model on a task-specific dataset, is the standard practice to utilize these models for downstream tasks. However, Transformer fine-tuning has long running time and high memory consumption due to the large size of the models. We propose the SPT system to fine-tune Transformer-based models efficiently by introducing sparsity. We observe that the memory consumption of Transformer mainly comes from storing attention weights for multi-head attention (MHA), and the majority of running time is spent on feed-forward network (FFN). Thus, we design the sparse MHA module, which computes and stores only large attention weights to reduce memory consumption, and the routed FFN module, which dynamically activates a subset of model parameters for each token to reduce computation cost. We implement SPT on PyTorch and customize CUDA kernels to run sparse MHA and routed FFN efficiently. Specifically, we use product quantization to identify the large attention weights and compute attention via sparse matrix multiplication for sparse MHA. For routed FFN, we batch the tokens according to their activated model parameters for efficient computation. We conduct extensive experiments to evaluate SPT on various model configurations. The results show that SPT consistently outperforms well-optimized baselines, reducing the peak memory consumption by up to 50% and accelerating fine-tuning by up to 2.2x.


title: Fusing Conditional Submodular GAN and Programmatic Weak Supervision

abstract: Programmatic Weak Supervision (PWS) and generative models serve as crucial tools that enable researchers to maximize the utility of existing datasets without resorting to laborious data gathering and manual annotation processes. PWS uses various weak supervision techniques to estimate the underlying class labels of data, while generative models primarily concentrate on sampling from the underlying distribution of the given dataset. Although these methods have the potential to complement each other, they have mostly been studied independently. Recently, WSGAN proposed a mechanism to fuse these two models. Their approach utilizes the discrete latent factors of InfoGAN to train the label model and leverages the class-dependent information of the label model to generate images of specific classes. However, the disentangled latent factors learned by InfoGAN might not necessarily be class-specific and could potentially affect the label model's accuracy. Moreover, prediction made by the label model is often noisy in nature and can have a detrimental impact on the quality of images generated by GAN. In our work, we address these challenges by (i) implementing a noise-aware classifier using the pseudo labels generated by the label model (ii) utilizing the noise-aware classifier's prediction to train the label model and generate class-conditional images. Additionally, we also investigate the effect of training the classifier with a subset of the dataset within a defined uncertainty budget on pseudo labels. We accomplish this by formalizing the subset selection problem as a submodular maximization objective with a knapsack constraint on the entropy of pseudo labels. We conduct experiments on multiple datasets and demonstrate the efficacy of our methods on several tasks vis-a-vis the current state-of-the-art methods.


title: Covariant field lines: a geometrical approach to electrodynamics

abstract: This paper revisits the geometric foundations of electromagnetic theory, by studying Faraday's concept of field lines. We introduce "covariant electromagnetic field lines," a novel construct that extends traditional field line concepts to a covariant framework. Our work includes the derivation of a closed-form formula for the field line curvature in proximity to a moving electric charge, showcasing the curvature is always non-singular, including nearby a point charge. Our geometric framework leads to a geometric derivation of the Lorentz force equation and its first-order corrections, circumventing the challenges of self-force singularities and providing insights into the problem of radiation-reaction. This study not only provides a fresh geometric perspective on electromagnetic field lines but also opens avenues for future research in fields like quantum electrodynamics, gravitational field theory, and beyond.


title: Origin of superconductivity in tungsten thin films

abstract: The most common allotrope of tungsten, {\alpha}-W, has a superconducting transition at a temperature of ~11 mK. However, two other forms of tungsten have been reported to have superconducting transitions in the temperature range Tc ~ 2-5 K when synthesized as thin films: Crystalline \b{eta}-W and amorphous W (a-W). In this work we carry out a systematic study of W films synthesized using d.c. magnetron sputtering, using transport, low frequency magnetic shielding response, and transmission electron microscopy. Our results show that while a-W is indeed a bulk superconductor, superconductivity in \b{eta}-W probably originates from an amorphous phase that forms along with the \b{eta}-W phase. Our findings reconcile some of the anomalies earlier reported in \b{eta}-W, such the very small superconducting gap and the decrease of Tc with increase in film thickness.


title: Proportional Representation in Metric Spaces and Low-Distortion Committee Selection

abstract: We introduce a novel definition for a small set R of k points being "representative" of a larger set in a metric space. Given a set V (e.g., documents or voters) to represent, and a set C of possible representatives, our criterion requires that for any subset S comprising a theta fraction of V, the average distance of S to their best theta*k points in R should not be more than a factor gamma compared to their average distance to the best theta*k points among all of C. This definition is a strengthening of proportional fairness and core fairness, but - different from those notions - requires that large cohesive clusters be represented proportionally to their size. Since there are instances for which - unless gamma is polynomially large - no solutions exist, we study this notion in a resource augmentation framework, implicitly stating the constraints for a set R of size k as though its size were only k/alpha, for alpha > 1. Furthermore, motivated by the application to elections, we mostly focus on the "ordinal" model, where the algorithm does not learn the actual distances; instead, it learns only for each point v in V and each candidate pairs c, c' which of c, c' is closer to v. Our main result is that the Expanding Approvals Rule (EAR) of Aziz and Lee is (alpha, gamma) representative with gamma <= 1 + 6.71 * (alpha)/(alpha-1). Our results lead to three notable byproducts. First, we show that the EAR achieves constant proportional fairness in the ordinal model, giving the first positive result on metric proportional fairness with ordinal information. Second, we show that for the core fairness objective, the EAR achieves the same asymptotic tradeoff between resource augmentation and approximation as the recent results of Li et al., which used full knowledge of the metric. Finally, our results imply a very simple single-winner voting rule with metric distortion at most 44.


title: Do Similar Entities have Similar Embeddings?

abstract: Knowledge graph embedding models (KGEMs) developed for link prediction learn vector representations for entities in a knowledge graph, known as embeddings. A common tacit assumption is the KGE entity similarity assumption, which states that these KGEMs retain the graph's structure within their embedding space, \textit{i.e.}, position similar entities within the graph close to one another. This desirable property make KGEMs widely used in downstream tasks such as recommender systems or drug repurposing. Yet, the relation of entity similarity and similarity in the embedding space has rarely been formally evaluated. Typically, KGEMs are assessed based on their sole link prediction capabilities, using ranked-based metrics such as Hits@K or Mean Rank. This paper challenges the prevailing assumption that entity similarity in the graph is inherently mirrored in the embedding space. Therefore, we conduct extensive experiments to measure the capability of KGEMs to cluster similar entities together, and investigate the nature of the underlying factors. Moreover, we study if different KGEMs expose a different notion of similarity. Datasets, pre-trained embeddings and code are available at: https://github.com/nicolas-hbt/similar-embeddings/.


title: K-ESConv: Knowledge Injection for Emotional Support Dialogue Systems via Prompt Learning

abstract: Automatic psychological counseling requires mass of professional knowledge that can be found in online counseling forums. Motivated by this, we propose K-ESConv, a novel prompt learning based knowledge injection method for emotional support dialogue system, transferring forum knowledge to response generation. We evaluate our model on an emotional support dataset ESConv, where the model retrieves and incorporates knowledge from external professional emotional Q\&A forum. Experiment results show that the proposed method outperforms existing baselines on both automatic evaluation and human evaluation, which shows that our approach significantly improves the correlation and diversity of responses and provides more comfort and better suggestion for the seeker.


title: When Graph Data Meets Multimodal: A New Paradigm for Graph Understanding and Reasoning

abstract: Graph data is ubiquitous in the physical world, and it has always been a challenge to efficiently model graph structures using a unified paradigm for the understanding and reasoning on various graphs. Moreover, in the era of large language models, integrating complex graph information into text sequences has become exceptionally difficult, which hinders the ability to interact with graph data through natural language instructions.The paper presents a new paradigm for understanding and reasoning about graph data by integrating image encoding and multimodal technologies. This approach enables the comprehension of graph data through an instruction-response format, utilizing GPT-4V's advanced capabilities. The study evaluates this paradigm on various graph types, highlighting the model's strengths and weaknesses, particularly in Chinese OCR performance and complex reasoning tasks. The findings suggest new direction for enhancing graph data processing and natural language interaction.


title: Swarm of Robotic Aerial Base Stations for mmWave Multi-Hop Backhauling

abstract: Robotic aerial base stations (RABSs) that are able to anchor at tall urban landforms are expected to bring further flexibility to millimeter-wave (mmWave) multi-hop backhaul networks in highly dense urban environments. In this paper, a swarm of RABSs are deployed to construct a dynamic mmWave backhaul network according to the traffic spatial distribution, and relocate their positions in subsequent time epochs according to the traffic temporal dynamic. The overall energy efficiency of the proposed framework is maximized by determining the RABS deployment, relocation and route formation under the channel capacity and hop constraints. The problem is formulated as a mixed-integer linear fractional programming (MILFP) and a two-stage method is developed to overcome the computational complexity. A wide set of numerical investigations reveal that compared to fixed small cells, only half as many RABSs are required to cover the same volume of traffic demand.


title: Neural Operators for Boundary Stabilization of Stop-and-go Traffic

abstract: This paper introduces a novel approach to PDE boundary control design using neural operators to alleviate stop-and-go instabilities in congested traffic flow. Our framework leverages neural operators to design control strategies for traffic flow systems. The traffic dynamics are described by the Aw-Rascle-Zhang (ARZ) model, which comprises a set of second-order coupled hyperbolic partial differential equations (PDEs). Backstepping method is widely used for boundary control of such PDE systems. The PDE model-based control design can be time-consuming and require intensive depth of expertise since it involves constructing and solving backstepping control kernels. To overcome these challenges, we present two distinct neural operator (NO) learning schemes aimed at stabilizing the traffic PDE system. The first scheme embeds NO-approximated gain kernels within a predefined backstepping controller, while the second one directly learns a boundary control law. The Lyapunov analysis is conducted to evaluate the stability of the NO-approximated gain kernels and control law. It is proved that the NO-based closed-loop system is practical stable under certain approximation accuracy conditions in NO-learning. To validate the efficacy of the proposed approach, simulations are conducted to compare the performance of the two neural operator controllers with a PDE backstepping controller and a Proportional Integral (PI) controller. While the NO-approximated methods exhibit higher errors compared to the backstepping controller, they consistently outperform the PI controller, demonstrating faster computation speeds across all scenarios. This result suggests that neural operators can significantly expedite and simplify the process of obtaining boundary controllers in traffic PDE systems.


title: Collect and Connect Data Leaves to Feature Concepts: Interactive Graph Generation Toward Well-being

abstract: Feature concepts and data leaves have been invented using datasets to foster creative thoughts for creating well-being in daily life. The idea, simply put, is to attach selected and collected data leaves that are summaries of event flows to be discovered from corresponding datasets, on the target feature concept representing the well-being aimed. A graph of existing or expected datasets to be attached to a feature concept is generated semi-automatically. Rather than sheer automated generative AI, our work addresses the process of generative artificial and natural intelligence to create the basis for data use and reuse.


title: SA$^2$VP: Spatially Aligned-and-Adapted Visual Prompt

abstract: As a prominent parameter-efficient fine-tuning technique in NLP, prompt tuning is being explored its potential in computer vision. Typical methods for visual prompt tuning follow the sequential modeling paradigm stemming from NLP, which represents an input image as a flattened sequence of token embeddings and then learns a set of unordered parameterized tokens prefixed to the sequence representation as the visual prompts for task adaptation of large vision models. While such sequential modeling paradigm of visual prompt has shown great promise, there are two potential limitations. First, the learned visual prompts cannot model the underlying spatial relations in the input image, which is crucial for image encoding. Second, since all prompt tokens play the same role of prompting for all image tokens without distinction, it lacks the fine-grained prompting capability, i.e., individual prompting for different image tokens. In this work, we propose the \mymodel model (\emph{SA$^2$VP}), which learns a two-dimensional prompt token map with equal (or scaled) size to the image token map, thereby being able to spatially align with the image map. Each prompt token is designated to prompt knowledge only for the spatially corresponding image tokens. As a result, our model can conduct individual prompting for different image tokens in a fine-grained manner. Moreover, benefiting from the capability of preserving the spatial structure by the learned prompt token map, our \emph{SA$^2$VP} is able to model the spatial relations in the input image, leading to more effective prompting. Extensive experiments on three challenging benchmarks for image classification demonstrate the superiority of our model over other state-of-the-art methods for visual prompt tuning. Code is available at \emph{https://github.com/tommy-xq/SA2VP}.


title: An embedding technique in the study of word-representabiliy of graphs

abstract: Word-representable graphs, which are the same as semi-transitively orientable graphs, generalize several fundamental classes of graphs. In this paper we propose a novel approach to study word-representability of graphs using a technique of homomorphisms. As a proof of concept, we apply our method to show word-representability of the simplified graph of overlapping permutations that we introduce in this paper. For another application, we obtain results on word-representability of certain subgraphs of simplified de Bruijn graphs that were introduced recently by Petyuk and studied in the context of word-representability.


title: The Dijkgraaf-Witten invariants from second Chern classes

abstract: Given a 3-cocycle $\psi$ in the cohomology of a finite group $G$, we can define the Dijkgraaf-Witten invariant of closed 3-manifolds. In this paper, we focus on the case where $\psi$ is a 3-cocycle canonically obtained from the second Chern class of a representation of $G$, and show some procedures for computing the invariant, and clarify its topological interpretation under some conditions.


title: Multi-parameter quantum metrology with stabilized multi-mode squeezed state

abstract: Squeezing a quantum state along a specific direction has long been recognized as a crucial technique for enhancing the precision of quantum metrology by reducing parameter uncertainty. However, practical quantum metrology often involves the simultaneous estimation of multiple parameters, necessitating the use of high-quality squeezed states along multiple orthogonal axes to surpass the standard quantum limit for all relevant parameters. In addition, a temporally stabilized squeezed state can provide an event-ready probe for parameters, regardless of the initial state, and robust to the timing of the state preparation process once stabilized. In this work, we generate and stabilize a two-mode squeezed state along two secular motional modes in a vibrating trapped ion with reservoir engineering, despite starting from a thermal state of the motion. Leveraging this resource, we demonstrate an estimation of two simultaneous collective displacements along the squeezed axes, achieving improvements surpassing the classical limit by up to 6.9(3) and 7.0(3) decibels (dB), respectively. Our demonstration can be readily scaled to squeezed states with even more modes. The practical implications of our findings span a wide range of applications, including quantum sensing, quantum imaging, and various fields that demand precise measurements of multiple parameters.


title: PPIDSG: A Privacy-Preserving Image Distribution Sharing Scheme with GAN in Federated Learning

abstract: Federated learning (FL) has attracted growing attention since it allows for privacy-preserving collaborative training on decentralized clients without explicitly uploading sensitive data to the central server. However, recent works have revealed that it still has the risk of exposing private data to adversaries. In this paper, we conduct reconstruction attacks and enhance inference attacks on various datasets to better understand that sharing trained classification model parameters to a central server is the main problem of privacy leakage in FL. To tackle this problem, a privacy-preserving image distribution sharing scheme with GAN (PPIDSG) is proposed, which consists of a block scrambling-based encryption algorithm, an image distribution sharing method, and local classification training. Specifically, our method can capture the distribution of a target image domain which is transformed by the block encryption algorithm, and upload generator parameters to avoid classifier sharing with negligible influence on model performance. Furthermore, we apply a feature extractor to motivate model utility and train it separately from the classifier. The extensive experimental results and security analyses demonstrate the superiority of our proposed scheme compared to other state-of-the-art defense methods. The code is available at https://github.com/ytingma/PPIDSG.


title: SECap: Speech Emotion Captioning with Large Language Model

abstract: Speech emotions are crucial in human communication and are extensively used in fields like speech synthesis and natural language understanding. Most prior studies, such as speech emotion recognition, have categorized speech emotions into a fixed set of classes. Yet, emotions expressed in human speech are often complex, and categorizing them into predefined groups can be insufficient to adequately represent speech emotions. On the contrary, describing speech emotions directly by means of natural language may be a more effective approach. Regrettably, there are not many studies available that have focused on this direction. Therefore, this paper proposes a speech emotion captioning framework named SECap, aiming at effectively describing speech emotions using natural language. Owing to the impressive capabilities of large language models in language comprehension and text generation, SECap employs LLaMA as the text decoder to allow the production of coherent speech emotion captions. In addition, SECap leverages HuBERT as the audio encoder to extract general speech features and Q-Former as the Bridge-Net to provide LLaMA with emotion-related speech features. To accomplish this, Q-Former utilizes mutual information learning to disentangle emotion-related speech features and speech contents, while implementing contrastive learning to extract more emotion-related speech features. The results of objective and subjective evaluations demonstrate that: 1) the SECap framework outperforms the HTSAT-BART baseline in all objective evaluations; 2) SECap can generate high-quality speech emotion captions that attain performance on par with human annotators in subjective mean opinion score tests.


title: Liouville-type theorems for steady Navier-Stokes system under helical symmetry or Navier boundary conditions

abstract: In this paper, the Liouville-type theorems for the steady Navier-Stokes system are investigated. First, we prove that any bounded smooth helically symmetric solution in $\mathbb{R}^3$ must be a constant vector. Second, for steady Navier-Stokes system in a slab supplemented with Navier boundary conditions, we prove that any bounded smooth solution must be zero if either the swirl or radial velocity is axisymmetric, or $ru^{r}$ decays to zero as $r$ tends to infinity. Finally, when the velocity is not big in $L^{\infty}$-space, the general three-dimensional steady Navier-Stokes flow in a slab with the Navier boundary conditions must be a Poiseuille type flow. The key idea of the proof is to establish Saint-Venant type estimates that characterize the growth of Dirichlet integral of nontrivial solutions.