title: MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods

abstract: Recent research in decoding methods for Natural Language Generation (NLG) tasks has shown that MAP decoding is not optimal, because model probabilities do not always align with human preferences. Stronger decoding methods, including Quality Estimation (QE) reranking and Minimum Bayes' Risk (MBR) decoding, have since been proposed to mitigate the model-perplexity-vs-quality mismatch. While these decoding methods achieve state-of-the-art performance, they are prohibitively expensive to compute. In this work, we propose MBR finetuning and QE finetuning which distill the quality gains from these decoding methods at training time, while using an efficient decoding algorithm at inference time. Using the canonical NLG task of Neural Machine Translation (NMT), we show that even with self-training, these finetuning methods significantly outperform the base model. Moreover, when using an external LLM as a teacher model, these finetuning methods outperform finetuning on human-generated references. These findings suggest new ways to leverage monolingual data to achieve improvements in model quality that are on par with, or even exceed, improvements from human-curated data, while maintaining maximum efficiency during decoding.


title: Concentration Dependence of Elastic and Viscoelastic Properties of Aqueous Solutions of Ficoll and Bovine Serum Albumin by Brillouin Light Scattering Spectroscopy

abstract: The cellular environment is crowded with macromolecules of different shapes and sizes. The effect of this macromolecular crowding has been studied in a variety of synthetic crowding environments: two popular examples are the compact colloid-like Ficoll macromolecule, and the globular protein bovine serum albumin (BSA). Recent studies have indicated a significant component of bound or surface-associated water in these crowders reduces the available free volume. In this work, Brillouin light scattering experiments were performed on aqueous solutions of Ficoll 70 and Ficoll 400 with concentrations ranging from 1 wt% to 35 wt% and BSA with concentrations of 1 wt% to 27 wt%. From the dependence of spectral peak parameters on polymer concentration, we determined fundamental solution properties: hypersound velocity, adiabatic bulk modulus and compressibility, apparent viscosity, and hypersound attenuation. Existing theory that ignores intermolecular interactions can only capture the observed linear trends in the frequency shift up to a threshold concentration, beyond which a quadratic term accounting for intermolecular interactions is necessary. This likely indicates a transition from the dilute to semi-dilute regime. In the Ficoll solutions (but not BSA) we see evidence for a central mode, with a characteristic relaxation time of 20 ps, that we attribute to exchange of the bound water.


title: Multi-Stage Generalized Deferred Acceptance Mechanism: Strategyproof Mechanism for Handling General Hereditary Constraints

abstract: The theory of two-sided matching has been extensively developed and applied to many real-life application domains. As the theory has been applied to increasingly diverse types of environments, researchers and practitioners have encountered various forms of distributional constraints. Arguably, the most general class of distributional constraints would be hereditary constraints; if a matching is feasible, then any matching that assigns weakly fewer students at each college is also feasible. However, under general hereditary constraints, it is shown that no strategyproof mechanism exists that simultaneously satisfies fairness and weak nonwastefulness, which is an efficiency (students' welfare) requirement weaker than nonwastefulness. We propose a new strategyproof mechanism that works for hereditary constraints called the Multi-Stage Generalized Deferred Acceptance mechanism (MS-GDA). It uses the Generalized Deferred Acceptance mechanism (GDA) as a subroutine, which works when distributional constraints belong to a well-behaved class called hereditary M$^\natural$-convex set. We show that GDA satisfies several desirable properties, most of which are also preserved in MS-GDA. We experimentally show that MS-GDA strikes a good balance between fairness and efficiency (students' welfare) compared to existing strategyproof mechanisms when distributional constraints are close to an M$^\natural$-convex set.


title: Bell Correlations as Selection Artefacts

abstract: We show that Bell correlations may arise as a special sort of selection artefact, produced by ordinary control of the initial state of the experiments concerned. This accounts for nonlocality, without recourse to any direct spacelike causality or influence. The argument improves an earlier proposal in (arXiv:2101.05370v4 [quant-ph], arXiv:2212.06986 [quant-ph]) in two main respects: (i) in demonstrating its application in a real Bell experiment; and (ii) in avoiding the need for a postulate of retrocausality. This version includes an Appendix, discussing the relation of the proposal to the conclusions of Wood and Spekkens (arXiv:1208.4119 [quant-ph]).


title: Real roots of hypergeometric polynomials via finite free convolution

abstract: We examine two binary operations on the set of algebraic polynomials, known as multiplicative and additive finite free convolutions, specifically in the context of hypergeometric polynomials. We show that the representation of a hypergeometric polynomial as a finite free convolution of more elementary blocks, combined with the preservation of the real zeros and interlacing by the free convolutions, is an effective tool that allows us to analyze when all roots of a specific hypergeometric polynomial are real. Moreover, the known limit behavior of finite free convolutions allows us to write the asymptotic zero distribution of some hypergeometric polynomials as free convolutions of Marchenko-Pastur, reversed Marchenko-Pastur, and free beta laws, which has an independent interest within free probability.


title: Sparse distribution of lattice points in annular regions

abstract: This paper is inspired by Richards' work on large gaps between sums of two squares [10]. It is shown in [10] that there exist arbitrarily large values of $\lambda$ and $\mu$, where $\mu \geq C \log \lambda$, such that intervals $[\lambda, \,\lambda + \mu ]$ do not contain any sums of two squares. Geometrically, these gaps between sums of two squares correspond to annuli in $\mathbb R^2$ that do not contain any integer lattice points. A major objective of this paper is to investigate the sparse distribution of integer lattice points within annular regions in $\mathbb R^2$. Specifically, we establish the existence of annuli $\{x\in \mathbb R^2: \lambda \leq |x|^2 \leq \lambda + \kappa\}$ with arbitrarily large $\lambda$ and $\kappa \geq C \lambda^s$ for $0<s<\frac{1}{4}$, satisfying that any two integer lattice points within any one of these annuli must be sufficiently far apart. This result is sharp, as such a property ceases to hold at and beyond the threshold $s=\frac{1}{4}$. Furthermore, we extend our analysis to include the sparse distribution of lattice points in spherical shells in $\mathbb R^3$.


title: SEMPART: Self-supervised Multi-resolution Partitioning of Image Semantics

abstract: Accurately determining salient regions of an image is challenging when labeled data is scarce. DINO-based self-supervised approaches have recently leveraged meaningful image semantics captured by patch-wise features for locating foreground objects. Recent methods have also incorporated intuitive priors and demonstrated value in unsupervised methods for object partitioning. In this paper, we propose SEMPART, which jointly infers coarse and fine bi-partitions over an image's DINO-based semantic graph. Furthermore, SEMPART preserves fine boundary details using graph-driven regularization and successfully distills the coarse mask semantics into the fine mask. Our salient object detection and single object localization findings suggest that SEMPART produces high-quality masks rapidly without additional post-processing and benefits from co-optimizing the coarse and fine branches.


title: Reachability Analysis for Lexicase Selection via Community Assembly Graphs

abstract: Fitness landscapes have historically been a powerful tool for analyzing the search space explored by evolutionary algorithms. In particular, they facilitate understanding how easily reachable an optimal solution is from a given starting point. However, simple fitness landscapes are inappropriate for analyzing the search space seen by selection schemes like lexicase selection in which the outcome of selection depends heavily on the current contents of the population (i.e. selection schemes with complex ecological dynamics). Here, we propose borrowing a tool from ecology to solve this problem: community assembly graphs. We demonstrate a simple proof-of-concept for this approach on an NK Landscape where we have perfect information. We then demonstrate that this approach can be successfully applied to a complex genetic programming problem. While further research is necessary to understand how to best use this tool, we believe it will be a valuable addition to our toolkit and facilitate analyses that were previously impossible.


title: Computation and applications of limits of certain non-stationary Markov chains

abstract: This article describes a method for computing limits of a class of non-stationary Markov chains motivated by healthcare sojourn-time cycles. A mathematical validation of the computation method is also given. Applications are described that include predicting cycles in healthcare and very large system maintenance. An objective of this article is to hopefully foster some investigation and teaching of practical non-stationary Markov chains.


title: SPFQ: A Stochastic Algorithm and Its Error Analysis for Neural Network Quantization

abstract: Quantization is a widely used compression method that effectively reduces redundancies in over-parameterized neural networks. However, existing quantization techniques for deep neural networks often lack a comprehensive error analysis due to the presence of non-convex loss functions and nonlinear activations. In this paper, we propose a fast stochastic algorithm for quantizing the weights of fully trained neural networks. Our approach leverages a greedy path-following mechanism in combination with a stochastic quantizer. Its computational complexity scales only linearly with the number of weights in the network, thereby enabling the efficient quantization of large networks. Importantly, we establish, for the first time, full-network error bounds, under an infinite alphabet condition and minimal assumptions on the weights and input data. As an application of this result, we prove that when quantizing a multi-layer network having Gaussian weights, the relative square quantization error exhibits a linear decay as the degree of over-parametrization increases. Furthermore, we demonstrate that it is possible to achieve error bounds equivalent to those obtained in the infinite alphabet case, using on the order of a mere $\log\log N$ bits per weight, where $N$ represents the largest number of neurons in a layer.


title: Accurate and Scalable Estimation of Epistemic Uncertainty for Graph Neural Networks

abstract: Safe deployment of graph neural networks (GNNs) under distribution shift requires models to provide accurate confidence indicators (CI). However, while it is well-known in computer vision that CI quality diminishes under distribution shift, this behavior remains understudied for GNNs. Hence, we begin with a case study on CI calibration under controlled structural and feature distribution shifts and demonstrate that increased expressivity or model size do not always lead to improved CI performance. Consequently, we instead advocate for the use of epistemic uncertainty quantification (UQ) methods to modulate CIs. To this end, we propose G-$\Delta$UQ, a new single model UQ method that extends the recently proposed stochastic centering framework to support structured data and partial stochasticity. Evaluated across covariate, concept, and graph size shifts, G-$\Delta$UQ not only outperforms several popular UQ methods in obtaining calibrated CIs, but also outperforms alternatives when CIs are used for generalization gap prediction or OOD detection. Overall, our work not only introduces a new, flexible GNN UQ method, but also provides novel insights into GNN CIs on safety-critical tasks.


title: PAGER: A Framework for Failure Analysis of Deep Regression Models

abstract: Safe deployment of AI models requires proactive detection of failures to prevent costly errors. To this end, we study the important problem of detecting failures in deep regression models. Existing approaches rely on epistemic uncertainty estimates or inconsistency w.r.t the training data to identify failure. Interestingly, we find that while uncertainties are necessary they are insufficient to accurately characterize failure in practice. Hence, we introduce PAGER (Principled Analysis of Generalization Errors in Regressors), a framework to systematically detect and characterize failures in deep regressors. Built upon the principle of anchored training in deep models, PAGER unifies both epistemic uncertainty and complementary manifold non-conformity scores to accurately organize samples into different risk regimes.


title: Negative Spillover: A Potential Source of Bias in Pragmatic Clinical Trials

abstract: Pragmatic clinical trials evaluate the effectiveness of health interventions in real-world settings. Negative spillover can arise in a pragmatic trial if the study intervention affects how scarce resources are allocated between patients in the intervention and comparison groups. This can harm patients assigned to the control group and lead to overestimation of treatment effect. While this type of negative spillover is often addressed in trials of social welfare and public health interventions, there is little recognition of this source of bias in the medical literature. In this article, I examine what causes negative spillover and how it may have led clinical trial investigators to overestimate the effect of patient navigation, AI-based physiological alarms, and elective induction of labor. I also suggest ways to detect negative spillover and design trials that avoid this potential source of bias.


title: Towards Data-centric Graph Machine Learning: Review and Outlook

abstract: Data-centric AI, with its primary focus on the collection, management, and utilization of data to drive AI models and applications, has attracted increasing attention in recent years. In this article, we conduct an in-depth and comprehensive review, offering a forward-looking outlook on the current efforts in data-centric AI pertaining to graph data-the fundamental data structure for representing and capturing intricate dependencies among massive and diverse real-life entities. We introduce a systematic framework, Data-centric Graph Machine Learning (DC-GML), that encompasses all stages of the graph data lifecycle, including graph data collection, exploration, improvement, exploitation, and maintenance. A thorough taxonomy of each stage is presented to answer three critical graph-centric questions: (1) how to enhance graph data availability and quality; (2) how to learn from graph data with limited-availability and low-quality; (3) how to build graph MLOps systems from the graph data-centric view. Lastly, we pinpoint the future prospects of the DC-GML domain, providing insights to navigate its advancements and applications.


title: Adaptive Multi-Agent Deep Reinforcement Learning for Timely Healthcare Interventions

abstract: Effective patient monitoring is vital for timely interventions and improved healthcare outcomes. Traditional monitoring systems often struggle to handle complex, dynamic environments with fluctuating vital signs, leading to delays in identifying critical conditions. To address this challenge, we propose a novel AI-driven patient monitoring framework using multi-agent deep reinforcement learning (DRL). Our approach deploys multiple learning agents, each dedicated to monitoring a specific physiological feature, such as heart rate, respiration, and temperature. These agents interact with a generic healthcare monitoring environment, learn the patients' behaviour patterns, and make informed decisions to alert the corresponding Medical Emergency Teams (METs) based on the level of emergency estimated. In this study, we evaluate the performance of the proposed multi-agent DRL framework using real-world physiological and motion data from two datasets: PPG-DaLiA and WESAD. We compare the results with several baseline models, including Q-Learning, PPO, Actor-Critic, Double DQN, and DDPG, as well as monitoring frameworks like WISEML and CA-MAQL. Our experiments demonstrate that the proposed DRL approach outperforms all other baseline models, achieving more accurate monitoring of patient's vital signs. Furthermore, we conduct hyperparameter optimization to fine-tune the learning process of each agent. By optimizing hyperparameters, we enhance the learning rate and discount factor, thereby improving the agents' overall performance in monitoring patient health status.


title: Trojan Taxonomy in Quantum Computing

abstract: Quantum computing introduces unfamiliar security vulnerabilities demanding customized threat models. Hardware and software Trojans pose serious concerns needing rethinking from classical paradigms. This paper develops the first structured taxonomy of Trojans tailored to quantum information systems. We enumerate potential attack vectors across the quantum stack from hardware to software layers. A categorization of quantum Trojan types and payloads is outlined ranging from reliability degradation, functionality corruption, backdoors, and denial-of-service. Adversarial motivations behind quantum Trojans are analyzed. By consolidating diverse threats into a unified perspective, this quantum Trojan taxonomy provides insights guiding threat modeling, risk analysis, detection mechanisms, and security best practices customized for this novel computing paradigm.


title: Is GPT4 a Good Trader?

abstract: Recently, large language models (LLMs), particularly GPT-4, have demonstrated significant capabilities in various planning and reasoning tasks \cite{cheng2023gpt4,bubeck2023sparks}. Motivated by these advancements, there has been a surge of interest among researchers to harness the capabilities of GPT-4 for the automated design of quantitative factors that do not overlap with existing factor libraries, with an aspiration to achieve alpha returns \cite{webpagequant}. In contrast to these work, this study aims to examine the fidelity of GPT-4's comprehension of classic trading theories and its proficiency in applying its code interpreter abilities to real-world trading data analysis. Such an exploration is instrumental in discerning whether the underlying logic GPT-4 employs for trading is intrinsically reliable. Furthermore, given the acknowledged interpretative latitude inherent in most trading theories, we seek to distill more precise methodologies of deploying these theories from GPT-4's analytical process, potentially offering invaluable insights to human traders. To achieve this objective, we selected daily candlestick (K-line) data from specific periods for certain assets, such as the Shanghai Stock Index. Through meticulous prompt engineering, we guided GPT-4 to analyze the technical structures embedded within this data, based on specific theories like the Elliott Wave Theory. We then subjected its analytical output to manual evaluation, assessing its interpretative depth and accuracy vis-\`a-vis these trading theories from multiple dimensions. The results and findings from this study could pave the way for a synergistic amalgamation of human expertise and AI-driven insights in the realm of trading.


title: Radiative thermal switch via metamaterials made of vanadium dioxide-coated nanoparticles

abstract: In this work, a thermal switch is proposed based on the phase-change material vanadium dioxide (VO2) within the framework of near-field radiative heat transfer (NFRHT). The radiative thermal switch consists of two metamaterials filled with core-shell nanoparticles, with the shell made of VO2. Compared to traditional VO2 slabs, the proposed switch exhibits a more than 2-times increase in the switching ratio, reaching as high as 90.29% with a 100 nm vacuum gap. The improved switching effect is attributed to the capability of the VO2 shell to couple with the core, greatly enhancing heat transfer with the insulating VO2, while blocking the motivation of the core in the metallic state of VO2. As a result, this efficiently enlarges the difference in photonic characteristics between the insulating and metallic states of the structure, thereby improving the ability to rectify the NFRHT. The proposed switch opens pathways for active control of NFRHT and holds practical significance for developing thermal photon-based logic circuits.


title: An analytic equation for single cell electrochemical impedance spectroscopy with a dependence on cell position

abstract: An analytic equation for electrochemical impedance of a single-cell measured with a microelectrode is presented. A previously reported equation had a practical problem that it is valid only when the microelectrode resides at the center of the cell under test. In this work, we propose a new analytic equation incorporating dependence on cell position, and confirmed its effectiveness by numerical simulation. Comparisons show that our proposed equation gives an excellent agreement with simulated impedance values. Discrepancies between results from our equation and numerical simulation is suppressed within 13%, which is a dramatic reduction from the previously-reported equation as large as 58%. The proposed analytic equation is expected to enable more accurate analysis in actual cell experiments.


title: Giant interfacial spin-Hall angle from Rashba-Edelstein effect revealed by the spin-Hall Hanle processes

abstract: The Rashba-Edelstein effect (REE), which generates interfacial spin polarization and subsequent spin current, is a compelling spin-charge conversion mechanism for spintronics applications, since it is not limited by the elemental spin-orbit coupling. In this work, we demonstrate REE at Pt/ferroelectric interfaces using the recently elucidated spin-Hall Hanle effects (SHHE), in which a Larmor precession of spin polarization in a diffusion process from the interface manifest as magnetoresistance and Hall effect. We show that REE leads to a three-fold enhancement of the effective spin Hall angle in ferroelectric interface Pt/h-LuFeO3 compared to that of Pt /Al2O3, although the difference in the spin relaxation time is negligible. Modeling using SHHEs involving REE as an additional source of interfacial polarization suggests that REE can lead to an interfacial spin Hall angle (~0.3) that is one order of magnitude larger than the bulk value of Pt. Our results demonstrate that a ferroelectric interface can produce large spin-charge conversion and that SHHEs are a sensitive tool for characterizing interfacial spin transport properties.


title: Research on the Impact of Executive Shareholding on New Investment in Enterprises Based on Multivariable Linear Regression Model

abstract: Based on principal-agent theory and optimal contract theory, companies use the method of increasing executives' shareholding to stimulate collaborative innovation. However, from the aspect of agency costs between management and shareholders (i.e. the first type) and between major shareholders and minority shareholders (i.e. the second type), the interests of management, shareholders and creditors will be unbalanced with the change of the marginal utility of executive equity incentives.In order to establish the correlation between the proportion of shares held by executives and investments in corporate innovation, we have chosen a range of publicly listed companies within China's A-share market as the focus of our study. Employing a multi-variable linear regression model, we aim to analyze this relationship thoroughly.The following models were developed: (1) the impact model of executive shareholding on corporate innovation investment; (2) the impact model of executive shareholding on two types of agency costs; (3)The model is employed to examine the mediating influence of the two categories of agency costs. Following both correlation and regression analyses, the findings confirm a meaningful and positive correlation between executives' shareholding and the augmentation of corporate innovation investments. Additionally, the results indicate that executive shareholding contributes to the reduction of the first type of agency cost, thereby fostering corporate innovation investment. However, simultaneously, it leads to an escalation in the second type of agency cost, thus impeding corporate innovation investment.


title: SpikingNeRF: Making Bio-inspired Neural Networks See through the Real World

abstract: Spiking neural networks (SNNs) have been thriving on numerous tasks to leverage their promising energy efficiency and exploit their potentialities as biologically plausible intelligence. Meanwhile, the Neural Radiance Fields (NeRF) render high-quality 3D scenes with massive energy consumption, but few works delve into the energy-saving solution with a bio-inspired approach. In this paper, we propose SpikingNeRF, which aligns the radiance ray with the temporal dimension of SNN, to naturally accommodate the SNN to the reconstruction of Radiance Fields. Thus, the computation turns into a spike-based, multiplication-free manner, reducing the energy consumption. In SpikingNeRF, each sampled point on the ray is matched onto a particular time step, and represented in a hybrid manner where the voxel grids are maintained as well. Based on the voxel grids, sampled points are determined whether to be masked for better training and inference. However, this operation also incurs irregular temporal length. We propose the temporal padding strategy to tackle the masked samples to maintain regular temporal length, i.e., regular tensors, and the temporal condensing strategy to form a denser data structure for hardware-friendly computation. Extensive experiments on various datasets demonstrate that our method reduces the 70.79% energy consumption on average and obtains comparable synthesis quality with the ANN baseline.


title: An optimal ALMA image of the Hubble Ultra Deep Field in the era of JWST: obscured star formation and the cosmic far-infrared background

abstract: We combine archival ALMA data targeting the Hubble Ultra Deep Field (HUDF) to produce the deepest currently attainable 1-mm maps of this key region. Our deepest map covers 4.2arcmin^2, with a beamsize of 1.49''x1.07'' at an effective frequency of 243GHz (1.23mm). It reaches an rms of 4.6uJy/beam, with 1.5arcmin^2 below 9.0uJy/beam, an improvement of >5% (and up to 50% in some regions) over the best previous map. We also make a wider, shallower map, covering 25.4arcmin^2. We detect 45 galaxies in the deep map down to 3.6sigma, 10 more than previously detected, and 39 of these galaxies have JWST counterparts. A stacking analysis on the positions of ALMA-undetected JWST galaxies with z<4 and stellar masses from 10^8.4 to 10^10.4 M_sun yields 10% more signal compared to previous stacking analyses, and we find that detected sources plus stacking contribute (10.0+/-0.5)Jy/deg^2 to the cosmic infrared background (CIB) at 1.23mm. Although this is short of the (uncertain) background level of about 20Jy/deg^2, we show that our measurement is consistent with the background if the HUDF is a mild (~2sigma) negative CIB fluctuation, and that the contribution from faint undetected objects is small and converging. In particular, we predict that the field contains about 60 additional 15uJy galaxies, and over 300 galaxies at the few uJy level. This suggests that JWST has detected essentially all of the galaxies that contribute to the CIB, as anticipated from the strong correlation between galaxy stellar mass and obscured star formation.


title: COSE: A Consistency-Sensitivity Metric for Saliency on Image Classification

abstract: We present a set of metrics that utilize vision priors to effectively assess the performance of saliency methods on image classification tasks. To understand behavior in deep learning models, many methods provide visual saliency maps emphasizing image regions that most contribute to a model prediction. However, there is limited work on analyzing the reliability of saliency methods in explaining model decisions. We propose the metric COnsistency-SEnsitivity (COSE) that quantifies the equivariant and invariant properties of visual model explanations using simple data augmentations. Through our metrics, we show that although saliency methods are thought to be architecture-independent, most methods could better explain transformer-based models over convolutional-based models. In addition, GradCAM was found to outperform other methods in terms of COSE but was shown to have limitations such as lack of variability for fine-grained datasets. The duality between consistency and sensitivity allow the analysis of saliency methods from different angles. Ultimately, we find that it is important to balance these two metrics for a saliency map to faithfully show model behavior.


title: Arithmetic crosscorrelation of binary $m$-sequences with coprime periods

abstract: The arithmetic crosscorrelation of binary $m$-sequences with coprime periods $2^{n_1}-1$ and $2^{n_2}-1$\ ($\gcd(n_1,n_2)=1$) is determined. The result shows that the absolute value of arithmetic crosscorrelation of such binary $m$-sequences is not greater than $2^{\min(n_1,n_2)}-1$.


title: A systematic evaluation of Silicon-rich Nitride Electro-optic Modulator design and tradeoffs

abstract: We present a study of linearized \c{hi}^((3)) based electro-optic modulation beginning with an analysis of the nonlinear polarizability, and how to linearize a modulator based on the quadratic third order DC-Kerr effect. Then we perform a numerical study, designing a linearized \c{hi}^((3)) phase modulator utilizing Silicon-rich Nitride where we show that a phase modulator with a V_{\pi} L_{\pi} metric of 1 Vcm or a V_{\pi} L_{\pi} {\alpha} metric of 37VdB is achievable and a V_{\pi} L_{\pi} as low as 0.5Vcm in a push-pull Mach Zehnder Interferometer. This numerical study argues that linearized modulation exploiting the \c{hi}^((3)), and \c{hi}^((2)) as applicable, is possible and can allow for high-speed modulation using a CMOS compatible material platform.


title: Representations of the restricted Lie superalgebra p(n)

abstract: The center of a quotient of the reduced enveloping algebra of p(n) is studied. By using the obtained results, the restricted representation of p(n) is investigated.


title: Directional Source Separation for Robust Speech Recognition on Smart Glasses

abstract: Modern smart glasses leverage advanced audio sensing and machine learning technologies to offer real-time transcribing and captioning services, considerably enriching human experiences in daily communications. However, such systems frequently encounter challenges related to environmental noises, resulting in degradation to speech recognition and speaker change detection. To improve voice quality, this work investigates directional source separation using the multi-microphone array. We first explore multiple beamformers to assist source separation modeling by strengthening the directional properties of speech signals. In addition to relying on predetermined beamformers, we investigate neural beamforming in multi-channel source separation, demonstrating that automatic learning directional characteristics effectively improves separation quality. We further compare the ASR performance leveraging separated outputs to noisy inputs. Our results show that directional source separation benefits ASR for the wearer but not for the conversation partner. Lastly, we perform the joint training of the directional source separation and ASR model, achieving the best overall ASR performance.


title: Energy-momentum tensor of a hydrogen atom: stability, D-term, and the Lamb shift

abstract: We clarify two issues related to the so-called $D$-term in matrix elements of the energy-momentum tensor. First, we show that in a stable system, the $D$-term can have either sign, contrary to claims that it must be negative. Second, we demonstrate a logarithmic enhancement of the $\mathcal{\alpha}$ correction to the $D$-term in any state of the hydrogen atom. We contrast this enhancement with the Lamb shift where it is present only in S-states.


title: Statistical analysis of the gravitational anomaly in {\it Gaia} wide binaries

abstract: The exploration of the low acceleration $a<a_{0}$ regime, where $a_{0}=1.2 \times 10^{-10}$m s$^{-2}$ is the acceleration scale of MOND around which gravitational anomalies at galactic scale appear, has recently been extended to the much smaller mass and length scales of local wide binaries thanks to the availability of the {\it Gaia} catalogue. Statistical methods to test the underlying structure of gravity using large samples of such binary stars and dealing with the necessary presence of kinematic contaminants in such samples have also been presented. However, an alternative approach using binary samples carefully selected to avoid any such contaminants, and consequently much smaller samples, has been lacking a formal statistical development. In the interest of having independent high quality checks on the results of wide binary gravity tests, we here develop a formal statistical framework for treating small, clean, wide binary samples in the context of testing modifications to gravity of the form $G \to \gamma G$. The method is validated through extensive tests with synthetic data samples, and applied to recent {\it Gaia} DR3 binary star observational samples of relative velocities and internal separations on the plane of the sky, $v_{2D}$ and $r_{2D}$, respectively. Our final results for a high acceleration $r_{2D}<0.01$pc region are of $\gamma=1.000 \pm 0.096$, in full accordance with Newtonian expectations. For a low acceleration $r_{2D}>0.01$pc region however, we obtain $\gamma=1.5 \pm 0.2$, inconsistent with the Newtonian value of $\gamma=1$ at a $2.6 \sigma$ level, and much more indicative of MOND AQUAL predictions of close to $\gamma=1.4$.


title: Hamilton Lie algebroids over Dirac structures and sigma models

abstract: We propose a Hamiltonian Lie algebroid and a momentum section over a Dirac structure as a generalization of a Hamiltonian Lie algebroid over a pre-symplectic manifold and one over a Poisson manifold. A Hamiltonian Lie algebroid and a momentum section are generalizations of a Hamiltonian G-space and a momentum map over a symplectic manifold. We show some properties of a new Hamiltonian Lie algebroid, and construct the mechanics with this structure as an application, which are sigma models called the gauged Poisson sigma model and the gauged Dirac sigma model.


title: On the Gromov-Hausdorff limits of Tori with Ricci conditions

abstract: Let $n\geq 4$. In this paper, we construct a sequence of smooth Riemannian metrics $g_i $ on $\mathbb{R}^n$ such that: (1) $g_i = g_{\rm Euc} $ outside the standard Euclidean unit ball $B_1 (0) \subset \mathbb{R}^n $, (2) ${\rm Ric}_{g_i} \geq -\Lambda $ and $ {\rm diam} \left( B_1 (0) ,g_i \right) \leq D $ for some $\Lambda ,D>0$ independent of $i$, (3) The pointed Gromov-Hausdorff limit of $(\mathbb{R}^n ,g_i) $ is a topological orbifold but not a topological manifold. As a consequence, for $n\geq 4$, we can find a sequence of tori $(T^n , g_i )$ with Ricci lower bound and diameter bound such that the Gromov-Hausdorff limit is not a topological manifold. This answers a question of Bru\`e-Naber-Semola [arXiv:2307.03824] in the negative. In $4$-dimensional case, we prove that the Gromov-Hausdorff limit of tori with $2$-side Ricci bound and diameter bound is always a topological torus. In the K\"ahler case, the Gromov-Hausdorff limit of K\"ahler tori of real dimension $4$ with Ricci lower bound is always a topological orbifold with isolated singularities, and the only type of singularities is $\mathbb{R}^4 / Q_8 $.


title: Quasi-stationary behavior of the stochastic FKPP equation on the circle

abstract: We consider the stochastic Fisher-Kolmogorov-Petrovsky-Piscunov (FKPP) equation on the circle $\mathbb{S}$, \begin{equation*} \partial_t u(t,x) \,= \frac{\alpha}{2}\Delta u +\beta\,u(1-u) + \sqrt{\gamma\,u(1-u)}\,\dot{W}, \qquad (t,x)\in(0,\infty)\times \mathbb{S}, \end{equation*} where $\dot{W}$ is space-time white noise. While any solution will eventually be absorbed at one of two states, the constant 1 and the constant 0 on the circle, essentially nothing had been established about the absorption time (also called the fixation time in population genetics), or about the long-time behavior prior to absorption. We establish the existence and uniqueness of the quasi-stationary distribution (QSD) for the solution of the stochastic FKPP. Moreover, we show that the solution conditioned on not being absorbed at time $t$ converges to this unique QSD as $t\to\infty$, for any initial distribution, and characterize the leading-order asymptotics for the tail distribution of the fixation time. We obtain explicit calculations in the neutral case ($\beta=0$), quantifying the effect of spatial diffusion on fixation time. We explicitly express the fixation rate in terms of the migration rate $\alpha$ for all $\alpha\in (0,\infty)$, finding in particular that the fixation rate is given by $\gamma[1-\frac{\gamma}{12\alpha}+\mathcal{O}(\frac{\gamma^2}{\alpha^2})]$ for fast migration and $\pi^2\alpha[1-\frac{8\alpha}{\gamma}+\mathcal{O}(\frac{\alpha^2}{\gamma^2})]$ for slow migration. Our proof relies on the observation that the absorbed (or killed) stochastic FKPP is dual to a system of $2$-type branching-coalescing Brownian motions killed when one type dies off, and on leveraging the relationship between these two killed processes.

categories: math.PR math.DS math.FA math.SP q-bio.PE


title: Pointing-and-Acquisition for Optical Wireless in 6G: From Algorithms to Performance Evaluation

abstract: The increasing demand for wireless communication services has led to the development of non-terrestrial networks, which enables various air and space applications. Free-space optical (FSO) communication is considered one of the essential technologies capable of connecting terrestrial and non-terrestrial layers. In this article, we analyze considerations and challenges for FSO communications between gateways and aircraft from a pointing-and-acquisition perspective. Based on the analysis, we first develop a baseline method that utilizes conventional devices and mechanisms. Furthermore, we propose an algorithm that combines angle of arrival (AoA) estimation through supplementary radio frequency (RF) links and beam tracking using retroreflectors. Through extensive simulations, we demonstrate that the proposed method offers superior performance in terms of link acquisition and maintenance.


title: Towards Joint Modeling of Dialogue Response and Speech Synthesis based on Large Language Model

abstract: This paper explores the potential of constructing an AI spoken dialogue system that "thinks how to respond" and "thinks how to speak" simultaneously, which more closely aligns with the human speech production process compared to the current cascade pipeline of independent chatbot and Text-to-Speech (TTS) modules. We hypothesize that Large Language Models (LLMs) with billions of parameters possess significant speech understanding capabilities and can jointly model dialogue responses and linguistic features. We conduct two sets of experiments: 1) Prosodic structure prediction, a typical front-end task in TTS, demonstrating the speech understanding ability of LLMs, and 2) Further integrating dialogue response and a wide array of linguistic features using a unified encoding format. Our results indicate that the LLM-based approach is a promising direction for building unified spoken dialogue systems.


title: GME: GPU-based Microarchitectural Extensions to Accelerate Homomorphic Encryption

abstract: Fully Homomorphic Encryption (FHE) enables the processing of encrypted data without decrypting it. FHE has garnered significant attention over the past decade as it supports secure outsourcing of data processing to remote cloud services. Despite its promise of strong data privacy and security guarantees, FHE introduces a slowdown of up to five orders of magnitude as compared to the same computation using plaintext data. This overhead is presently a major barrier to the commercial adoption of FHE. In this work, we leverage GPUs to accelerate FHE, capitalizing on a well-established GPU ecosystem available in the cloud. We propose GME, which combines three key microarchitectural extensions along with a compile-time optimization to the current AMD CDNA GPU architecture. First, GME integrates a lightweight on-chip compute unit (CU)-side hierarchical interconnect to retain ciphertext in cache across FHE kernels, thus eliminating redundant memory transactions. Second, to tackle compute bottlenecks, GME introduces special MOD-units that provide native custom hardware support for modular reduction operations, one of the most commonly executed sets of operations in FHE. Third, by integrating the MOD-unit with our novel pipelined $64$-bit integer arithmetic cores (WMAC-units), GME further accelerates FHE workloads by $19\%$. Finally, we propose a Locality-Aware Block Scheduler (LABS) that exploits the temporal locality available in FHE primitive blocks. Incorporating these microarchitectural features and compiler optimizations, we create a synergistic approach achieving average speedups of $796\times$, $14.2\times$, and $2.3\times$ over Intel Xeon CPU, NVIDIA V100 GPU, and Xilinx FPGA implementations, respectively.


title: PPD: A New Valet Parking Pedestrian Fisheye Dataset for Autonomous Driving

abstract: Pedestrian detection under valet parking scenarios is fundamental for autonomous driving. However, the presence of pedestrians can be manifested in a variety of ways and postures under imperfect ambient conditions, which can adversely affect detection performance. Furthermore, models trained on publicdatasets that include pedestrians generally provide suboptimal outcomes for these valet parking scenarios. In this paper, wepresent the Parking Pedestrian Dataset (PPD), a large-scale fisheye dataset to support research dealing with real-world pedestrians, especially with occlusions and diverse postures. PPD consists of several distinctive types of pedestrians captured with fisheye cameras. Additionally, we present a pedestrian detection baseline on PPD dataset, and introduce two data augmentation techniques to improve the baseline by enhancing the diversity ofthe original dataset. Extensive experiments validate the effectiveness of our novel data augmentation approaches over baselinesand the dataset's exceptional generalizability.


title: Cosmic-ray dark matter confronted by constraints on new light mediators

abstract: The detectability of light dark matter in direct detection experiments is limited by the small kinetic energy of the recoiling targets. Thus, scenarios where dark matter is boosted to relativistic velocities provide a useful tactic to constrain sub-GeV dark matter particles. Of the possible dark matter boosting mechanisms, cosmic-ray upscattering is an appealing paradigm as it doesn't require any additional assumptions beyond dark matter coupling to nucleons or electrons. However, detectable signals are obtained only with relatively large cross sections which, in turn, can only be realized with large couplings, light mediators or composite dark matter. In this work we consider a general set of light mediators that couple dark matter to hadrons. Using data from Borexino, XENON1T, LZ and Super-K, we show that existing constraints on such mediators preclude appreciable cosmic-ray dark matter upscattering. This finding highlights the limited applicability of cosmic-ray upscattering constraints and suggests they only be used in model-dependent studies.


title: Reproducing Failures in Fault Signatures

abstract: Software often fails in the field, however reproducing and debugging field failures is very challenging: the failure-inducing input may be missing, and the program setup can be complicated and hard to reproduce by the developers. In this paper, we propose to generate fault signatures from the failure locations and the original source code to reproduce the faults in small executable programs. We say that a fault signature reproduces the fault in the original program if the two failed in the same location, triggered the same error conditions after executing the same selective sequences of failure-inducing statements. A fault signature aims to contain only sufficient statements that can reproduce the faults. That way, it provides some context to inform how a fault is developed and also avoids unnecessary complexity and setups that may block fault diagnosis. To compute fault signatures from the failures, we applied a path-sensitive static analysis tool to generate a path that leads to the fault, and then applied an existing syntactic patching tool to convert the path into an executable program. Our evaluation on real-world bugs from Corebench, BugBench, and Manybugs shows that fault signatures can reproduce the fault for the original programs. Because fault signatures are less complex, automatic test input generation tools generated failure-inducing inputs that could not be generated by using the entire programs. Some failure-inducing inputs can be directly transferred to the original programs. Our experimental data are publicly available at https://doi.org/10.5281/zenodo.5430155.


title: It's Simplex! Disaggregating Measures to Improve Certified Robustness

abstract: Certified robustness circumvents the fragility of defences against adversarial attacks, by endowing model predictions with guarantees of class invariance for attacks up to a calculated size. While there is value in these certifications, the techniques through which we assess their performance do not present a proper accounting of their strengths and weaknesses, as their analysis has eschewed consideration of performance over individual samples in favour of aggregated measures. By considering the potential output space of certified models, this work presents two distinct approaches to improve the analysis of certification mechanisms, that allow for both dataset-independent and dataset-dependent measures of certification performance. Embracing such a perspective uncovers new certification approaches, which have the potential to more than double the achievable radius of certification, relative to current state-of-the-art. Empirical evaluation verifies that our new approach can certify $9\%$ more samples at noise scale $\sigma = 1$, with greater relative improvements observed as the difficulty of the predictive task increases.


title: STARNet: Sensor Trustworthiness and Anomaly Recognition via Approximated Likelihood Regret for Robust Edge Autonomy

abstract: Complex sensors such as LiDAR, RADAR, and event cameras have proliferated in autonomous robotics to enhance perception and understanding of the environment. Meanwhile, these sensors are also vulnerable to diverse failure mechanisms that can intricately interact with their operation environment. In parallel, the limited availability of training data on complex sensors also affects the reliability of their deep learning-based prediction flow, where their prediction models can fail to generalize to environments not adequately captured in the training set. To address these reliability concerns, this paper introduces STARNet, a Sensor Trustworthiness and Anomaly Recognition Network designed to detect untrustworthy sensor streams that may arise from sensor malfunctions and/or challenging environments. We specifically benchmark STARNet on LiDAR and camera data. STARNet employs the concept of approximated likelihood regret, a gradient-free framework tailored for low-complexity hardware, especially those with only fixed-point precision capabilities. Through extensive simulations, we demonstrate the efficacy of STARNet in detecting untrustworthy sensor streams in unimodal and multimodal settings. In particular, the network shows superior performance in addressing internal sensor failures, such as cross-sensor interference and crosstalk. In diverse test scenarios involving adverse weather and sensor malfunctions, we show that STARNet enhances prediction accuracy by approximately 10% by filtering out untrustworthy sensor streams. STARNet is publicly available at \url{https://github.com/sinatayebati/STARNet}.


title: The Spectral Edge of Constant Degree Erd\H{o}s-R\'{e}nyi Graphs

abstract: We show that for an Erd\H{o}s-R\'{e}nyi graph on $N$ vertices with expected degree $d$ satisfying $\log^{-1/9}N\leq d\leq \log^{1/40}N$, the largest eigenvalues can be precisely determined by small neighborhoods around vertices of close to maximal degree. Moreover, under the added condition that $d\geq\log^{-1/15}N$, the corresponding eigenvectors are localized, in that the mass of the eigenvector decays exponentially away from the high degree vertex. This dependence on local neighborhoods implies that the edge eigenvalues converge to a Poisson point process. These theorems extend a result of Alt, Ducatez, and Knowles, who showed the same behavior for $d$ satisfying $(\log\log N)^4\ll d\leq (1-o_{N}(1))\frac{1}{\log 4-1}\log N$. To achieve high accuracy in the constant degree regime, instead of attempting to guess an approximate eigenvector of a local neighborhood, we analyze the true eigenvector of a local neighborhood, and show it must be localized and depend on local geometry.


title: Propagation of a Gaussian Wigner Function Through a Matrix-Aperture Beamline

abstract: In the framework of statistical optics, a Wigner function represents partially coherent radiation. A Gaussian Wigner function, which is an equivalent representation of the more commonly used Gaussian Schell-model cross-spectral density, may be defined in terms of its covariance matrix and centroid. Starting from the relationship between Gaussian Wigner functions and the Gaussian Schell model, we derive coherence properties of the Gaussian Wigner function, including coherence length and degree of coherence. We define a simplified beamline called a matrix-aperture beamline composed of linear transport sections separated by physical apertures. This is an idealized form for a transport beamline in a synchrotron light source or X-ray free electron laser. An envelope model provides a basic foundation for understanding the optics of a given beamline, in a manner analogous to how linear optics are treated in particle beam dynamics, with corresponding definitions of emittance and Twiss parameters. One major challenge to such an envelope model lies in the hard-edge apertures which break the Gaussian condition, raising the question as to the adequacy of a Gaussian model. We present a consistent way to construct a Gaussian approximation of the far-field Wigner function following the hard edge aperture. To this end, we introduce the concept of a Gaussian aperture and analyze its effects on the radiation Wigner function. A software implementation of this model is described as well.


title: Controllable Dynamic Appearance for Neural 3D Portraits

abstract: Recent advances in Neural Radiance Fields (NeRFs) have made it possible to reconstruct and reanimate dynamic portrait scenes with control over head-pose, facial expressions and viewing direction. However, training such models assumes photometric consistency over the deformed region e.g. the face must be evenly lit as it deforms with changing head-pose and facial expression. Such photometric consistency across frames of a video is hard to maintain, even in studio environments, thus making the created reanimatable neural portraits prone to artifacts during reanimation. In this work, we propose CoDyNeRF, a system that enables the creation of fully controllable 3D portraits in real-world capture conditions. CoDyNeRF learns to approximate illumination dependent effects via a dynamic appearance model in the canonical space that is conditioned on predicted surface normals and the facial expressions and head-pose deformations. The surface normals prediction is guided using 3DMM normals that act as a coarse prior for the normals of the human head, where direct prediction of normals is hard due to rigid and non-rigid deformations induced by head-pose and facial expression changes. Using only a smartphone-captured short video of a subject for training, we demonstrate the effectiveness of our method on free view synthesis of a portrait scene with explicit head pose and expression controls, and realistic lighting effects. The project page can be found here: http://shahrukhathar.github.io/2023/08/22/CoDyNeRF.html


title: Simulation-aided Learning from Demonstration for Robotic LEGO Construction

abstract: Recent advancements in manufacturing have a growing demand for fast, automatic prototyping (i.e. assembly and disassembly) capabilities to meet users' needs. This paper studies automatic rapid LEGO prototyping, which is devoted to constructing target LEGO objects that satisfy individual customization needs and allow users to freely construct their novel designs. A construction plan is needed in order to automatically construct the user-specified LEGO design. However, a freely designed LEGO object might not have an existing construction plan, and generating such a LEGO construction plan requires a non-trivial effort since it requires accounting for numerous constraints (e.g. object shape, colors, stability, etc.). In addition, programming the prototyping skill for the robot requires the users to have expert programming skills, which makes the task beyond the reach of the general public. To address the challenges, this paper presents a simulation-aided learning from demonstration (SaLfD) framework for easily deploying LEGO prototyping capability to robots. In particular, the user demonstrates constructing the customized novel LEGO object. The robot extracts the task information by observing the human operation and generates the construction plan. A simulation is developed to verify the correctness of the learned construction plan and the resulting LEGO prototype. The proposed system is deployed to a FANUC LR-mate 200id/7L robot. Experiments demonstrate that the proposed SaLfD framework can effectively correct and learn the prototyping (i.e. assembly and disassembly) tasks from human demonstrations. And the learned prototyping tasks are realized by the FANUC robot.


title: OCC-VO: Dense Mapping via 3D Occupancy-Based Visual Odometry for Autonomous Driving

abstract: Visual Odometry (VO) plays a pivotal role in autonomous systems, with a principal challenge being the lack of depth information in camera images. This paper introduces OCC-VO, a novel framework that capitalizes on recent advances in deep learning to transform 2D camera images into 3D semantic occupancy, thereby circumventing the traditional need for concurrent estimation of ego poses and landmark locations. Within this framework, we utilize the TPV-Former to convert surround view cameras' images into 3D semantic occupancy. Addressing the challenges presented by this transformation, we have specifically tailored a pose estimation and mapping algorithm that incorporates Semantic Label Filter, Dynamic Object Filter, and finally, utilizes Voxel PFilter for maintaining a consistent global semantic map. Evaluations on the Occ3D-nuScenes not only showcase a 20.6% improvement in Success Ratio and a 29.6% enhancement in trajectory accuracy against ORB-SLAM3, but also emphasize our ability to construct a comprehensive map. Our implementation is open-sourced and available at: https://github.com/USTCLH/OCC-VO.


title: A Survey on Acoustic Side Channel Attacks on Keyboards

abstract: Most electronic devices utilize mechanical keyboards to receive inputs, including sensitive information such as authentication credentials, personal and private data, emails, plans, etc. However, these systems are susceptible to acoustic side-channel attacks. Researchers have successfully developed methods that can extract typed keystrokes from ambient noise. As the prevalence of keyboard-based input systems continues to expand across various computing platforms, and with the improvement of microphone technology, the potential vulnerability to acoustic side-channel attacks also increases. This survey paper thoroughly reviews existing research, explaining why such attacks are feasible, the applicable threat models, and the methodologies employed to launch and enhance these attacks.


title: ModelGiF: Gradient Fields for Model Functional Distance

abstract: The last decade has witnessed the success of deep learning and the surge of publicly released trained models, which necessitates the quantification of the model functional distance for various purposes. However, quantifying the model functional distance is always challenging due to the opacity in inner workings and the heterogeneity in architectures or tasks. Inspired by the concept of "field" in physics, in this work we introduce Model Gradient Field (abbr. ModelGiF) to extract homogeneous representations from the heterogeneous pre-trained models. Our main assumption underlying ModelGiF is that each pre-trained deep model uniquely determines a ModelGiF over the input space. The distance between models can thus be measured by the similarity between their ModelGiFs. We validate the effectiveness of the proposed ModelGiF with a suite of testbeds, including task relatedness estimation, intellectual property protection, and model unlearning verification. Experimental results demonstrate the versatility of the proposed ModelGiF on these tasks, with significantly superiority performance to state-of-the-art competitors. Codes are available at https://github.com/zju-vipa/modelgif.


title: Ensembling Multilingual Pre-Trained Models for Predicting Multi-Label Regression Emotion Share from Speech

abstract: Speech emotion recognition has evolved from research to practical applications. Previous studies of emotion recognition from speech have focused on developing models on certain datasets like IEMOCAP. The lack of data in the domain of emotion modeling emerges as a challenge to evaluate models in the other dataset, as well as to evaluate speech emotion recognition models that work in a multilingual setting. This paper proposes an ensemble learning to fuse results of pre-trained models for emotion share recognition from speech. The models were chosen to accommodate multilingual data from English and Spanish. The results show that ensemble learning can improve the performance of the baseline model with a single model and the previous best model from the late fusion. The performance is measured using the Spearman rank correlation coefficient since the task is a regression problem with ranking values. A Spearman rank correlation coefficient of 0.537 is reported for the test set, while for the development set, the score is 0.524. These scores are higher than the previous study of a fusion method from monolingual data, which achieved scores of 0.476 for the test and 0.470 for the development.


title: 3D-U-SAM Network For Few-shot Tooth Segmentation in CBCT Images

abstract: Accurate representation of tooth position is extremely important in treatment. 3D dental image segmentation is a widely used method, however labelled 3D dental datasets are a scarce resource, leading to the problem of small samples that this task faces in many cases. To this end, we address this problem with a pretrained SAM and propose a novel 3D-U-SAM network for 3D dental image segmentation. Specifically, in order to solve the problem of using 2D pre-trained weights on 3D datasets, we adopted a convolution approximation method; in order to retain more details, we designed skip connections to fuse features at all levels with reference to U-Net. The effectiveness of the proposed method is demonstrated in ablation experiments, comparison experiments, and sample size experiments.


title: A Gigantic Mid-Infrared Outburst in an Embedded Class-I Young Stellar Object J064722.95+031644.6

abstract: We report the serendipitous discovery of a giant mid-infrared (MIR) outburst from a previously unknown source near a star-forming region in the constellation Monoceros. The source gradually brightened by a factor of 5 from 2014 to 2016 before an abrupt rise by a factor of more than 100 in 2017. A total amplitude increase of >500 at 4.5 microns has since faded by a factor of about 10. Prior to the outburst, it was only detected at wavelengths longer than 1.8 microns in UKIDSS, Spitzer, and Herschel with a spectral energy distribution of a Class I Young Stellar Object (YSO). It has not been detected in recent optical surveys, suggesting that it is deeply embedded. With a minimum distance of 3.5 kpc, the source has a bolometric luminosity of at least 9 $L_\odot$ in the quiescent state and 400 $L_\odot$ at the peak of the eruption. The maximum accretion rate is estimated to be at least a few $10^{-5}$ $M_\odot$ year$^{-1}$. It shares several common properties with another eruptive event, WISE~J142238.82-611553.7: exceptionally large amplitude, featureless near-infrared spectrum with the exception of H_2 lines, intermediate eruption duration, an embedded Class I YSO, and a low radiative temperature (<600-700 K) in outburst. We interpret that the radiation from the inner accretion disk and young star is obscured and reprocessed by either an inflated outer disk or thick dusty outflow on scales > 6.5 AU during the outburst.


title: 3SAT on an All-to-All-Connected CMOS Ising Solver Chip

abstract: This work solves 3SAT, a classical NP-complete problem, on a CMOS-based Ising hardware chip with all-to-all connectivity. The paper addresses practical issues in going from algorithms to hardware. It considers several degrees of freedom in mapping the 3SAT problem to the chip - using multiple Ising formulations for 3SAT; exploring multiple strategies for decomposing large problems into subproblems that can be accommodated on the Ising chip; and executing a sequence of these subproblems on CMOS hardware to obtain the solution to the larger problem. These are evaluated within a software framework, and the results are used to identify the most promising formulations and decomposition techniques. These best approaches are then mapped to the all-to-all hardware, and the performance of 3SAT is evaluated on the chip. Experimental data shows that the deployed decomposition and mapping strategies impact SAT solution quality: without our methods, the CMOS hardware cannot achieve 3SAT solutions on SATLIB benchmarks.


title: Conformalized Multimodal Uncertainty Regression and Reasoning

abstract: This paper introduces a lightweight uncertainty estimator capable of predicting multimodal (disjoint) uncertainty bounds by integrating conformal prediction with a deep-learning regressor. We specifically discuss its application for visual odometry (VO), where environmental features such as flying domain symmetries and sensor measurements under ambiguities and occlusion can result in multimodal uncertainties. Our simulation results show that uncertainty estimates in our framework adapt sample-wise against challenging operating conditions such as pronounced noise, limited training data, and limited parametric size of the prediction model. We also develop a reasoning framework that leverages these robust uncertainty estimates and incorporates optical flow-based reasoning to improve prediction prediction accuracy. Thus, by appropriately accounting for predictive uncertainties of data-driven learning and closing their estimation loop via rule-based reasoning, our methodology consistently surpasses conventional deep learning approaches on all these challenging scenarios--pronounced noise, limited training data, and limited model size-reducing the prediction error by 2-3x.


title: Extractors for Polynomial Sources over $\mathbb{F}_2$

abstract: We explicitly construct the first nontrivial extractors for degree $d \ge 2$ polynomial sources over $\mathbb{F}_2^n$. Our extractor requires min-entropy $k\geq n - \tilde{\Omega}(\sqrt{\log n})$. Previously, no constructions were known, even for min-entropy $k\geq n-1$. A key ingredient in our construction is an input reduction lemma, which allows us to assume that any polynomial source with min-entropy $k$ can be generated by $O(k)$ uniformly random bits. We also provide strong formal evidence that polynomial sources are unusually challenging to extract from, by showing that even our most powerful general purpose extractors cannot handle polynomial sources with min-entropy below $k\geq n-o(n)$. In more detail, we show that sumset extractors cannot even disperse from degree $2$ polynomial sources with min-entropy $k\geq n-O(n/\log\log n)$. In fact, this impossibility result even holds for a more specialized family of sources that we introduce, called polynomial non-oblivious bit-fixing (NOBF) sources. Polynomial NOBF sources are a natural new family of algebraic sources that lie at the intersection of polynomial and variety sources, and thus our impossibility result applies to both of these classical settings. This is especially surprising, since we do have variety extractors that slightly beat this barrier - implying that sumset extractors are not a panacea in the world of seedless extraction.


title: An Amphibious Fully-Soft Miniature Crawling Robot Powered by Electrohydraulic Fluid Kinetic Energy

abstract: Miniature locomotion robots with the ability to navigate confined environments show great promise for a wide range of tasks, including search and rescue operations. Soft miniature locomotion robots, as a burgeoning field, have attracted significant research interest due to their exceptional terrain adaptability and safety features. In this paper, we introduce a fully-soft miniature crawling robot directly powered by fluid kinetic energy generated by an electrohydraulic actuator. Through optimization of the operating voltage and design parameters, the crawling velocity of the robot is dramatically enhanced, reaching 16 mm/s. The optimized robot weighs 6.3 g and measures 5 cm in length, 5 cm in width, and 6 mm in height. By combining two robots in parallel, the robot can achieve a turning rate of approximately 3 degrees/s. Additionally, by reconfiguring the distribution of electrodes in the electrohydraulic actuator, the robot can achieve 2 degrees-of-freedom translational motion, improving its maneuverability in narrow spaces. Finally, we demonstrate the use of a soft water-proof skin for underwater locomotion and actuation. In comparison with other soft miniature crawling robots, our robot with full softness can achieve relatively high crawling velocity as well as increased robustness and recovery.


title: An Empirical Study of Malicious Code In PyPI Ecosystem

abstract: PyPI provides a convenient and accessible package management platform to developers, enabling them to quickly implement specific functions and improve work efficiency. However, the rapid development of the PyPI ecosystem has led to a severe problem of malicious package propagation. Malicious developers disguise malicious packages as normal, posing a significant security risk to end-users. To this end, we conducted an empirical study to understand the characteristics and current state of the malicious code lifecycle in the PyPI ecosystem. We first built an automated data collection framework and collated a multi-source malicious code dataset containing 4,669 malicious package files. We preliminarily classified these malicious code into five categories based on malicious behaviour characteristics. Our research found that over 50% of malicious code exhibits multiple malicious behaviours, with information stealing and command execution being particularly prevalent. In addition, we observed several novel attack vectors and anti-detection techniques. Our analysis revealed that 74.81% of all malicious packages successfully entered end-user projects through source code installation, thereby increasing security risks. A real-world investigation showed that many reported malicious packages persist in PyPI mirror servers globally, with over 72% remaining for an extended period after being discovered. Finally, we sketched a portrait of the malicious code lifecycle in the PyPI ecosystem, effectively reflecting the characteristics of malicious code at different stages. We also present some suggested mitigations to improve the security of the Python open-source ecosystem.


title: Information Leakage from Data Updates in Machine Learning Models

abstract: In this paper we consider the setting where machine learning models are retrained on updated datasets in order to incorporate the most up-to-date information or reflect distribution shifts. We investigate whether one can infer information about these updates in the training data (e.g., changes to attribute values of records). Here, the adversary has access to snapshots of the machine learning model before and after the change in the dataset occurs. Contrary to the existing literature, we assume that an attribute of a single or multiple training data points are changed rather than entire data records are removed or added. We propose attacks based on the difference in the prediction confidence of the original model and the updated model. We evaluate our attack methods on two public datasets along with multi-layer perceptron and logistic regression models. We validate that two snapshots of the model can result in higher information leakage in comparison to having access to only the updated model. Moreover, we observe that data records with rare values are more vulnerable to attacks, which points to the disparate vulnerability of privacy attacks in the update setting. When multiple records with the same original attribute value are updated to the same new value (i.e., repeated changes), the attacker is more likely to correctly guess the updated values since repeated changes leave a larger footprint on the trained model. These observations point to vulnerability of machine learning models to attribute inference attacks in the update setting.


title: Preconditioning for time-harmonic Maxwell's equations using the Laguerre transform

abstract: A method of numerically solving the Maxwell equations is considered for modeling harmonic electromagnetic fields. The vector finite element method makes it possible to obtain a physically consistent discretization of the differential equations. However, solving large systems of linear algebraic equations with indefinite ill-conditioned matrices is a challenge. The high order of the matrices limits the capabilities of the Gaussian method to solve such systems, since this requires large RAM and much calculation. To reduce these requirements, an iterative preconditioned algorithm based on integral Laguerre transform in time is used. This approach allows using multigrid algorithms and, as a result, needs less RAM compared to the direct methods of solving systems of linear algebraic equations.


title: On spin optics for gravitational waves lensed by a rotating object

abstract: We study gravitational lensing of gravitational waves taking into account the spin of a graviton coupled with a dragged spacetime made by a rotating object. We decompose the phase of gravitational waves into helicity-dependent and independent components with spin optics, analyzing waves whose wavelengths are shorter than the curvature radius of a lens object. We analytically confirm that the trajectory of gravitational waves splits depending on the helicity, generating additional time delay and elliptical polarization onto the helicity-independent part. We exemplify monotonic gravitational waves lensed by a Kerr black hole and derive the analytical expressions of corrections in phase and magnification. The corrections are enhanced for longer wavelengths, potentially providing a novel probe of rotational properties of lens objects in low-frequency gravitational-wave observations in the future.


title: On the convergence conditions of Laplace importance sampling with randomized quasi-Monte Carlo

abstract: The study further explores randomized QMC (RQMC), which maintains the QMC convergence rate and facilitates computational efficiency analysis. Emphasis is laid on integrating randomly shifted lattice rules, a distinct RQMC quadrature, with IS,a classic variance reduction technique. The study underscores the intricacies of establishing a theoretical convergence rate for IS in QMC compared to MC, given the influence of problem dimensions and smoothness on QMC. The research also touches on the significance of IS density selection and its potential implications. The study culminates in examining the error bound of IS with a randomly shifted lattice rule, drawing inspiration from the reproducing kernel Hilbert space (RKHS). In the realm of finance and statistics, many problems boil down to computing expectations, predominantly integrals concerning a Gaussian measure. This study considers optimal drift importance sampling (ODIS) and Laplace importance sampling (LapIS) as common importance densities. Conclusively, the paper establishes that under certain conditions, the IS-randomly shifted lattice rule can achieve a near $O(N^{-1})$ error bound.


title: Atomic cluster expansion force field based thermal property material design with density functional theory level accuracy in non-equilibrium molecular dynamics calculations over sub-million atoms

abstract: Non-equilibrium molecular dynamics (NEMD) techniques are widely used for investigating lattice thermal conductivity. Recently, machine learning force fields (MLFFs) have emerged as a promising approach to enhance the precision in NEMD simulations. This study is aimed at demonstrating the potential of MLFFs in realizing NEMD calculations for large-scale systems containing over 100,000 atoms with density functional theory (DFT)-level accuracy. Specifically, the atomic cluster expansion (ACE) force field is employed, using Si as an example. The ACE potential incorporates 4-body interactions and features a training dataset consisting of 1000 order structures from first-principles molecular dynamics calculations, resulting in a highly accurate vibrational spectrum. Moreover, the ACE potential can reproduce thermal conductivity values comparable with those derived from DFT calculations via the Boltzmann equation. To demonstrate the application of MLFFs to systems containing over 100,000 atoms, NEMD simulations are conducted on thin films ranging from 100 nm to 500 nm, with the 100 nm films exhibiting defect rates of up to 1.5%. The results show that the thermal conductivity deviates by less than 5% from DFT or theoretical results in both scenarios, which highlights the ability of the ACE potential in calculating the thermal conductivity on a large scale with DFT-level accuracy. The proposed approach is expected to promote the application of MLFFs in various fields and serve as a feasible alternative to virtual experiments. Furthermore, this work demonstrates the potential of MLFFs in enhancing the accuracy of NEMD simulations for investigating lattice thermal conductivity for systems with over 100,000 atoms.


title: Named Entity Recognition via Machine Reading Comprehension: A Multi-Task Learning Approach

abstract: Named Entity Recognition (NER) aims to extract and classify entity mentions in the text into pre-defined types (e.g., organization or person name). Recently, many works have been proposed to shape the NER as a machine reading comprehension problem (also termed MRC-based NER), in which entity recognition is achieved by answering the formulated questions related to pre-defined entity types through MRC, based on the contexts. However, these works ignore the label dependencies among entity types, which are critical for precisely recognizing named entities. In this paper, we propose to incorporate the label dependencies among entity types into a multi-task learning framework for better MRC-based NER. We decompose MRC-based NER into multiple tasks and use a self-attention module to capture label dependencies. Comprehensive experiments on both nested NER and flat NER datasets are conducted to validate the effectiveness of the proposed Multi-NER. Experimental results show that Multi-NER can achieve better performance on all datasets.


title: The Topology and Geometry of Neural Representations

abstract: A central question for neuroscience is how to characterize brain representations of perceptual and cognitive content. An ideal characterization should distinguish different functional regions with robustness to noise and idiosyncrasies of individual brains that do not correspond to computational differences. Previous studies have characterized brain representations by their representational geometry, which is defined by the representational dissimilarity matrix (RDM), a summary statistic that abstracts from the roles of individual neurons (or responses channels) and characterizes the discriminability of stimuli. Here we explore a further step of abstraction: from the geometry to the topology of brain representations. We propose topological representational similarity analysis (tRSA), an extension of representational similarity analysis (RSA) that uses a family of geo-topological summary statistics that generalizes the RDM to characterize the topology while de-emphasizing the geometry. We evaluate this new family of statistics in terms of the sensitivity and specificity for model selection using both simulations and fMRI data. In the simulations, the ground truth is a data-generating layer representation in a neural network model and the models are the same and other layers in different model instances (trained from different random seeds). In fMRI, the ground truth is a visual area and the models are the same and other areas measured in different subjects. Results show that topology-sensitive characterizations of population codes are robust to noise and interindividual variability and maintain excellent sensitivity to the unique representational signatures of different neural network layers and brain regions. These methods enable researchers to calibrate comparisons among representations in brains and models to be sensitive to the geometry, the topology, or a combination of both.


title: Trustworthiness Evaluations of Search Results: The Impact of Rank and Misinformation

abstract: Users rely on search engines for information in critical contexts, such as public health emergencies. Understanding how users evaluate the trustworthiness of search results is therefore essential. Research has identified rank and the presence of misinformation as factors impacting perceptions and click behavior in search. Here, we elaborate on these findings by measuring the effects of rank and misinformation, as well as warning banners, on the perceived trustworthiness of individual results in search. We conducted three online experiments (N=3196) using Covid-19-related queries to address this question. We show that although higher-ranked results are clicked more often, they are not more trusted. We also show that misinformation did not change trust in accurate results below it. However, a warning about unreliable sources backfired, decreasing trust in accurate information but not misinformation. This work addresses concerns about how people evaluate information in search, and illustrates the dangers of generic prevention approaches.


title: Algebraic structures and Hamiltonians from the equivalence classes of 2D conformal algebras

abstract: The construction of superintegrable systems based on Lie algebras and their universal enveloping algebras has been widely studied over the past decades. However, most constructions rely on explicit differential operator realisations and Marsden-Weinstein reductions. In this paper, we develop an algebraic approach based on the subalgebras of the 2D conformal algebra $\mathfrak{c}(2)$. This allows us to classify the centralisers of the enveloping algebra of the conformal algebra and construct the corresponding Hamiltonians with integrals in algebraic form. It is found that the symmetry algebras underlying these algebraic Hamiltonians are six-dimensional quadratic algebras. The Berezin brackets and commutation relations of the quadratic algebraic structures are closed without relying on explicit realisations or representations. We also give the Casimir invariants of the symmetry algebras. Our approach provides algebraic perspectives for the recent work by Fordy and Huang on the construction of superintegrable systems in the Darboux spaces.


title: A Model for the Multi-Virus Contact Process

abstract: We study one specific version of the contact process on a graph. Here, we allow multiple infections carried by the nodes and include a probability of removing nodes in a graph. The removal probability is purely determined by the number of infections the node carries at the moment when it gets another infection. In this paper, we show that on any finite graph, any positive value of infection rate $\lambda$ will result in the death of the process almost surely. In the case of $d$-regular infinite trees, We also give a lower bound on the infection rate in order for the process to survive, and an upper bound for the process to die out.


title: Multi-Risk-RRT: An Efficient Motion Planning Algorithm for Robotic Autonomous Luggage Trolley Collection at Airports

abstract: Robots have become increasingly prevalent in dynamic and crowded environments such as airports and shopping malls. In these scenarios, the critical challenges for robot navigation are reliability and timely arrival at predetermined destinations. While existing risk-based motion planning algorithms effectively reduce collision risks with static and dynamic obstacles, there is still a need for significant performance improvements. Specifically, the dynamic environments demand more rapid responses and robust planning. To address this gap, we introduce a novel risk-based multi-directional sampling algorithm, Multi-directional Risk-based Rapidly-exploring Random Tree (Multi-Risk-RRT). Unlike traditional algorithms that solely rely on a rooted tree or double trees for state space exploration, our approach incorporates multiple sub-trees. Each sub-tree independently explores its surrounding environment. At the same time, the primary rooted tree collects the heuristic information from these sub-trees, facilitating rapid progress toward the goal state. Our evaluations, including simulation and real-world environmental studies, demonstrate that Multi-Risk-RRT outperforms existing unidirectional and bi-directional risk-based algorithms in planning efficiency and robustness.


title: Nine New Cataclysmic Variable Stars with Negative Superhumps

abstract: Negative superhumps (NSHs) are signals a few percent shorter than the orbital period of a binary star and are considered to originate from the reverse precession of the tilted disk. Based on TESS photometry, we find nine new cataclysmic variable stars (CVs) with NSHs. Three (ASAS J1420, TZ Per, and V392 Hya) of these stars similar to AH Her still have NSHs during dwarf nova outbursts, and the NSH amplitude varies with the outburst. The variation in the radius of the accretion disk partially explains this phenomenon. However, it does not explain the rebound of the NSH amplitude after the peak of the outburst and the fact that the NSH amplitude of the quiescence is sometimes not the largest, and it is necessary to combine the disk instability model (DIM) and add other ingredients. Therefore, we suggest that the variation of NSH amplitude with outburst can be an essential basis for studying the origin of NSHs and improving the DIM. The six ( ASASSN-V J1137, ASASSN-V J0611, 2MASS J0715, LAMOST J0925, ASASSN-17qj, and ZTF18acakuxo) remaining stars have been poorly studied, and for the first time we determine their orbital periods, NSHs and Superorbital signal (SOR) periods. The NSH periods and amplitudes of ASASSN-V J1137 and ASASSN-17qj vary with the SOR, and based on the comparison of the observations with the theory, we suggest that a single change in tilted disk angle does not explain the observations of the SOR and that other ingredients need to be considered as well.


title: Multipartite entanglement detection via generalized Wigner-Yanase skew information

abstract: The detection of multipartite entanglement in multipartite quantum systems is a fundamental and key issue in quantum information theory. In this paper, we investigate $k$-nonseparability and $k$-partite entanglement of $N$-partite quantum systems from the perspective of the generalized Wigner-Yanase skew information introduced by Yang $et$ $al$. [\href{https://doi.org/10.1103/PhysRevA.106.052401 }{Phys. Rev. A \textbf{106}, 052401 (2022)}]. More specifically, we develop two different approaches in form of inequalities to construct entanglement criteria, which are expressed in terms of the generalized Wigner-Yanase skew information. Any violation of these inequalities by a quantum state reveals its $k$-nonseparability or $k$-partite entanglement, so these inequalities present the hierarchic classifications of $k$-nonseparability or $k$-partite entanglement for all $N$-partite quantum states from $N$-nonseparability to $2$-nonseparability or from $2$-partite entanglement to $N$-partite entanglement, which are more refined than well-known ways. It is shown that our results reveal some $k$-nonseparability and $k$-partite entanglement that remain undetected by other methods, and these are illustrated through some examples.


title: Learned 1-D passive scalar advection to accelerate chemical transport modeling: a case study with GEOS-FP horizontal wind fields

abstract: We developed and applied a machine-learned discretization for one-dimensional (1-D) horizontal passive scalar advection, which is an operator component common to all chemical transport models (CTMs). Our learned advection scheme resembles a second-order accuracy, three-stencil numerical solver, but differs from a traditional solver in that coefficients for each equation term are output by a neural network rather than being theoretically-derived constants. We downsampled higher-resolution simulation results -- resulting in up to 16$\times$ larger grid size and 64$\times$ larger timestep -- and trained our neural network-based scheme to match the downsampled integration data. In this way, we created an operator that is low-resolution (in time or space) but can reproduce the behavior of a high-resolution traditional solver. Our model shows high fidelity in reproducing its training dataset (a single 10-day 1-D simulation) and is similarly accurate in simulations with unseen initial conditions, wind fields, and grid spacing. In many cases, our learned solver is more accurate than a low-resolution version of the reference solver, but the low-resolution reference solver achieves greater computational speedup (500$\times$ acceleration) over the high-resolution simulation than the learned solver is able to (18$\times$ acceleration). Surprisingly, our learned 1-D scheme -- when combined with a splitting technique -- can be used to predict 2-D advection, and is in some cases more stable and accurate than the low-resolution reference solver in 2-D. Overall, our results suggest that learned advection operators may offer a higher-accuracy method for accelerating CTM simulations as compared to simply running a traditional integrator at low resolution.


title: A Region-Shrinking-Based Acceleration for Classification-Based Derivative-Free Optimization

abstract: Derivative-free optimization algorithms play an important role in scientific and engineering design optimization problems, especially when derivative information is not accessible. In this paper, we study the framework of classification-based derivative-free optimization algorithms. By introducing a concept called hypothesis-target shattering rate, we revisit the computational complexity upper bound of this type of algorithms. Inspired by the revisited upper bound, we propose an algorithm named "RACE-CARS", which adds a random region-shrinking step compared with "SRACOS" (Hu et al., 2017).. We further establish a theorem showing the acceleration of region-shrinking. Experiments on the synthetic functions as well as black-box tuning for language-model-as-a-service demonstrate empirically the efficiency of "RACE-CARS". An ablation experiment on the introduced hyperparameters is also conducted, revealing the mechanism of "RACE-CARS" and putting forward an empirical hyperparameter-tuning guidance.


title: The bimetric model with an informational metric tensor

abstract: We consider a hybrid bimetric model where, in addition to the ordinary metric tensor that determines geometry, an informational metric is introduced to describe the reference frame of an observer. We note that the local information metric being Minkowskian explains one of the key aspects of the Einstein equivalence principle. Our approach has the potential to justify the three-dimensional nature of physical space and address the gravitational energy puzzle. Furthermore, it appears to be free of ghost instabilities in the matter sector, as the second metric tensor couples exclusively to the observer and is non-dynamical.


title: CaveSeg: Deep Semantic Segmentation and Scene Parsing for Autonomous Underwater Cave Exploration

abstract: In this paper, we present CaveSeg - the first visual learning pipeline for semantic segmentation and scene parsing for AUV navigation inside underwater caves. We address the problem of scarce annotated training data by preparing a comprehensive dataset for semantic segmentation of underwater cave scenes. It contains pixel annotations for important navigation markers (e.g. caveline, arrows), obstacles (e.g. ground plane and overhead layers), scuba divers, and open areas for servoing. Through comprehensive benchmark analyses on cave systems in USA, Mexico, and Spain locations, we demonstrate that robust deep visual models can be developed based on CaveSeg for fast semantic scene parsing of underwater cave environments. In particular, we formulate a novel transformer-based model that is computationally light and offers near real-time execution in addition to achieving state-of-the-art performance. Finally, we explore the design choices and implications of semantic segmentation for visual servoing by AUVs inside underwater caves. The proposed model and benchmark dataset open up promising opportunities for future research in autonomous underwater cave exploration and mapping.


title: Federated Learning in Intelligent Transportation Systems: Recent Applications and Open Problems

abstract: Intelligent transportation systems (ITSs) have been fueled by the rapid development of communication technologies, sensor technologies, and the Internet of Things (IoT). Nonetheless, due to the dynamic characteristics of the vehicle networks, it is rather challenging to make timely and accurate decisions of vehicle behaviors. Moreover, in the presence of mobile wireless communications, the privacy and security of vehicle information are at constant risk. In this context, a new paradigm is urgently needed for various applications in dynamic vehicle environments. As a distributed machine learning technology, federated learning (FL) has received extensive attention due to its outstanding privacy protection properties and easy scalability. We conduct a comprehensive survey of the latest developments in FL for ITS. Specifically, we initially research the prevalent challenges in ITS and elucidate the motivations for applying FL from various perspectives. Subsequently, we review existing deployments of FL in ITS across various scenarios, and discuss specific potential issues in object recognition, traffic management, and service providing scenarios. Furthermore, we conduct a further analysis of the new challenges introduced by FL deployment and the inherent limitations that FL alone cannot fully address, including uneven data distribution, limited storage and computing power, and potential privacy and security concerns. We then examine the existing collaborative technologies that can help mitigate these challenges. Lastly, we discuss the open challenges that remain to be addressed in applying FL in ITS and propose several future research directions.


title: Stein Variational Guided Model Predictive Path Integral Control: Proposal and Experiments with Fast Maneuvering Vehicles

abstract: This paper presents a novel Stochastic Optimal Control (SOC) method based on Model Predictive Path Integral control (MPPI), named Stein Variational Guided MPPI (SVG-MPPI), designed to handle rapidly shifting multimodal optimal action distributions. While MPPI can find a Gaussian-approximated optimal action distribution in closed form, i.e., without iterative solution updates, it struggles with the multimodality of the optimal distributions. This is due to the less representative nature of the Gaussian. To overcome this limitation, our method aims to identify a target mode of the optimal distribution and guide the solution to converge to fit it. In the proposed method, the target mode is roughly estimated using a modified Stein Variational Gradient Descent (SVGD) method and embedded into the MPPI algorithm to find a closed-form "mode-seeking" solution that covers only the target mode, thus preserving the fast convergence property of MPPI. Our simulation and real-world experimental results demonstrate that SVG-MPPI outperforms both the original MPPI and other state-of-the-art sampling-based SOC algorithms in terms of path-tracking and obstacle-avoidance capabilities. Source code: https://github.com/kohonda/proj-svg_mppi


title: Polarization-based cyclic weak value metrology for angular velocity measurement

abstract: Weak measurement has been proven to amplify the detection of changes in meters while discarding most photons due to the low probability of post-selection. Previous power-recycling schemes enable the failed post-selection photons to be repeatedly selected, thus overcoming the inefficient post-selection and increasing the precision of detection. In this study, we focus on the polarization-based weak value angular-velocity measurement and introduce three cyclic methods to enhance the accuracy of detecting time shift in a Gaussian beam: power recycling, signal recycling, and dual recycling schemes. By incorporating one or two partially transmitting mirrors into the system, both the power and signal-to-noise ratio (SNR) of the detected light are substantially enhanced. Compared to non-polarization schemes, polarization-based approaches offer several advantages, including lower optical loss, unique cyclic directions, and a wider optimal region. These features effectively reduce crosstalk among different light paths and theoretically eliminate the walk-off effect, thus yielding improvements in both theoretical performance and application.


title: Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapters

abstract: Recently, Large Language Models (LLMs) have achieved amazing zero-shot learning performance over a variety of Natural Language Processing (NLP) tasks, especially for text generative tasks. Yet, the large size of LLMs often leads to the high computational cost of model training and online deployment. In our work, we present ALTER, a system that effectively builds the multi-tAsk Learners with mixTure-of-task-adaptERs upon small language models (with <1B parameters) to address multiple NLP tasks simultaneously, capturing the commonalities and differences between tasks, in order to support domain-specific applications. Specifically, in ALTER, we propose the Mixture-of-Task-Adapters (MTA) module as an extension to the transformer architecture for the underlying model to capture the intra-task and inter-task knowledge. A two-stage training method is further proposed to optimize the collaboration between adapters at a small computational cost. Experimental results over a mixture of NLP tasks show that our proposed MTA architecture and the two-stage training method achieve good performance. Based on ALTER, we have also produced MTA-equipped language models for various domains.


title: Score Mismatching for Generative Modeling

abstract: We propose a new score-based model with one-step sampling. Previously, score-based models were burdened with heavy computations due to iterative sampling. For substituting the iterative process, we train a standalone generator to compress all the time steps with the gradient backpropagated from the score network. In order to produce meaningful gradients for the generator, the score network is trained to simultaneously match the real data distribution and mismatch the fake data distribution. This model has the following advantages: 1) For sampling, it generates a fake image with only one step forward. 2) For training, it only needs 10 diffusion steps.3) Compared with consistency model, it is free of the ill-posed problem caused by consistency loss. On the popular CIFAR-10 dataset, our model outperforms Consistency Model and Denoising Score Matching, which demonstrates the potential of the framework. We further provide more examples on the MINIST and LSUN datasets. The code is available on GitHub.