title: Nondegeneracy and stability in the limit of a one-phase singular perturbation problem

abstract: We study solutions to a one-phase singular perturbation problem that arises in combustion theory and that formally approximates the classical one-phase free boundary problem. We introduce a natural density condition on the transition layers themselves that guarantees that the key nondegeneracy growth property of solutions is satisfied and preserved in the limit. We then apply our result to the problem of classifying global stable solutions of the underlying semilinear problem and we show that those have flat level sets in dimensions $n\leq 4$, provided the density condition is fulfilled. The notion of stability that we use is the one with respect to inner domain deformations and in the process, we derive succinct new formulas for the first and second inner variations of general functionals of the form $I(v) = \int |\nabla v|^2 + \mathcal{F}(v)$ that hold in a Riemannian manifold setting.


title: Sim-and-Real Reinforcement Learning for Manipulation: A Consensus-based Approach

abstract: Sim-and-real training is a promising alternative to sim-to-real training for robot manipulations. However, the current sim-and-real training is neither efficient, i.e., slow convergence to the optimal policy, nor effective, i.e., sizeable real-world robot data. Given limited time and hardware budgets, the performance of sim-and-real training is not satisfactory. In this paper, we propose a Consensus-based Sim-And-Real deep reinforcement learning algorithm (CSAR) for manipulator pick-and-place tasks, which shows comparable performance in both sim-and-real worlds. In this algorithm, we train the agents in simulators and the real world to get the optimal policies for both sim-and-real worlds. We found two interesting phenomenons: (1) Best policy in simulation is not the best for sim-and-real training. (2) The more simulation agents, the better sim-and-real training. The experimental video is available at: https://youtu.be/mcHJtNIsTEQ.


title: Weighted contractivity for derivatives of functions in the Bergman space on the unit disk

abstract: In a recent paper, Ramos and Tilli proved certain sharp inequality for analytic functions in subdomains of the unit disk. We will generalize their main inequality for derivatives of functions from Bergman space with respect to two diferent measures. Some connections with an analog for the Fock spaces, earlier investigated in Kalaj, will also be discussed.


title: A Comprehensive Survey on Uncertainty Quantification for Deep Learning

abstract: Deep neural networks (DNNs) have achieved tremendous success in making accurate predictions for computer vision, natural language processing, as well as science and engineering domains. However, it is also well-recognized that DNNs sometimes make unexpected, incorrect, but overconfident predictions. This can cause serious consequences in high-stake applications, such as autonomous driving, medical diagnosis, and disaster response. Uncertainty quantification (UQ) aims to estimate the confidence of DNN predictions beyond prediction accuracy. In recent years, many UQ methods have been developed for DNNs. It is of great practical value to systematically categorize these UQ methods and compare their advantages and disadvantages. However, existing surveys mostly focus on categorizing UQ methodologies from a neural network architecture perspective or a Bayesian perspective and ignore the source of uncertainty that each methodology can incorporate, making it difficult to select an appropriate UQ method in practice. To fill the gap, this paper presents a systematic taxonomy of UQ methods for DNNs based on the types of uncertainty sources (data uncertainty versus model uncertainty). We summarize the advantages and disadvantages of methods in each category. We show how our taxonomy of UQ methodologies can potentially help guide the choice of UQ method in different machine learning problems (e.g., active learning, robustness, and reinforcement learning). We also identify current research gaps and propose several future research directions.


title: Arrow-Debreu Meets Kyle: Price Discovery for Derivatives

abstract: We analyze price discovery in a model where an agent has general private information regarding state probabilities and trades state-contingent claims. Our model unifies the elements of Arrow and Debreu (1954) and Kyle (1985). In the equivalent options formulation, the informed agent has general information regarding an underlying asset's payoff distribution and trades option portfolios. We characterize the informed demand, the price impact, and the information efficiency of prices. Our informed demand formula prescribes option strategies for trading on any given aspect of the underlying payoff distribution and explains those used in practice -- e.g., for volatility trading.


title: Detecting Learning by Exporting and from Exporters

abstract: Existing literature at the nexus of firm productivity and export behavior mostly focuses on "learning by exporting," whereby firms can improve their performance by engaging in exports. Whereas, the secondary channel of learning via cross-firm spillovers from exporting peers, or "learning from exporters," has largely been neglected. Omitting this important mechanism, which can benefit both exporters and non-exporters, may provide an incomplete assessment of the total productivity benefits of exporting. In this paper, we develop a unified empirical framework for productivity measurement that explicitly accommodates both channels. To do this, we formalize the evolution of firm productivity as an export-controlled process, allowing future productivity to be affected by both the firm's own export behavior as well as export behavior of spatially proximate, same-industry peers. This facilitates a simultaneous, "internally consistent" identification of firm productivity and the corresponding effects of exporting. We apply our methodology to a panel of manufacturing plants in Chile in 1995-2007 and find significant evidence in support of both direct and spillover effects of exporting that substantially boost the productivity of domestic firms.


title: Methods for Integrating Trials and Non-Experimental Data to Examine Treatment Effect Heterogeneity

abstract: Estimating treatment effects conditional on observed covariates can improve the ability to tailor treatments to particular individuals. Doing so effectively requires dealing with potential confounding, and also enough data to adequately estimate effect moderation. A recent influx of work has looked into estimating treatment effect heterogeneity using data from multiple randomized controlled trials and/or observational datasets. With many new methods available for assessing treatment effect heterogeneity using multiple studies, it is important to understand which methods are best used in which setting, how the methods compare to one another, and what needs to be done to continue progress in this field. This paper reviews these methods broken down by data setting: aggregate-level data, federated learning, and individual participant-level data. We define the conditional average treatment effect and discuss differences between parametric and nonparametric estimators, and we list key assumptions, both those that are required within a single study and those that are necessary for data combination. After describing existing approaches, we compare and contrast them and reveal open areas for future research. This review demonstrates that there are many possible approaches for estimating treatment effect heterogeneity through the combination of datasets, but that there is substantial work to be done to compare these methods through case studies and simulations, extend them to different settings, and refine them to account for various challenges present in real data.


title: A System Approach to Structural Identification of Production Functions with Multi-Dimensional Productivity

abstract: There is growing empirical evidence that firm heterogeneity is technologically non-neutral. This paper extends Gandhi et al.'s (2020) proxy variable framework for structurally identifying production functions to a more general case when latent firm productivity is multi-dimensional, with both factor-neutral and (biased) factor-augmenting components. Unlike alternative methodologies, our model can be identified under weaker data requirements, notably, without relying on the typically unavailable cross-sectional variation in input prices for instrumentation. When markets are perfectly competitive, we achieve point identification by leveraging the information contained in static optimality conditions, effectively adopting a system-of-equations approach. We also show how one can partially identify the non-neutral production technology in the traditional proxy variable framework when firms have market power.


title: Accounting for Cross-Location Technological Heterogeneity in the Measurement of Operations Efficiency and Productivity

abstract: Motivated by the long-standing interest in understanding the role of location for firm performance, this paper provides a semiparametric methodology to accommodate locational heterogeneity in production analysis. Our approach is novel in that we explicitly model spatial variation in parameters in the production-function estimation. We accomplish this by allowing both the input-elasticity and productivity parameters to be unknown functions of the firm's geographic location and estimate them via local kernel methods. This allows the production technology to vary across space, thereby accommodating neighborhood influences on firm production. In doing so, we are also able to examine the role of cross-location differences in explaining the variation in operational productivity among firms. Our model is superior to the alternative spatial production-function formulations because it (i) explicitly estimates the cross-locational variation in production functions, (ii) is readily reconcilable with the conventional production axioms and, more importantly, (iii) can be identified from the data by building on the popular proxy-variable methods, which we extend to incorporate locational heterogeneity. Using our methodology, we study China's chemicals manufacturing industry and find that differences in technology (as opposed to in idiosyncratic firm heterogeneity) are the main source of the cross-location differential in total productivity in this industry.


title: Extended Version of "New Theory and Faster Computations for Subspace-Based Sensitivity Map Estimation in Multichannel MRI''

abstract: This is an unabridged version of a journal manuscript that has been submitted for publication [1]. (Due to length restrictions, we were forced to remove substantial amounts of content from the version that was submitted to the journal, including more detailed theoretical explanations, additional figures, and a more comprehensive bibliography. This content remains intact in this version of the document). Sensitivity map estimation is important in many multichannel MRI applications. Subspace-based sensitivity map estimation methods like ESPIRiT are popular and perform well, though can be computationally expensive and their theoretical principles can be nontrivial to understand. In the first part of this work, we present a novel theoretical derivation of subspace-based sensitivity map estimation based on a linear-predictability/structured low-rank modeling perspective. This results in an estimation approach that is equivalent to ESPIRiT, but with distinct theory that may be more intuitive for some readers. In the second part of this work, we propose and evaluate a set of computational acceleration approaches (collectively known as PISCO) that can enable substantial improvements in computation time (up to ~100x in the examples we show) and memory for subspace-based sensitivity map estimation.


title: Large-Block Modular Addition Checksum Algorithms

abstract: Checksum algorithms are widely employed due to their use of a simple algorithm with fast computational speed to provide a basic detection capability for corrupted data. This paper describes the benefits of adding the design parameter of increased data block size for modular addition checksums, combined with an empirical approach to modulus selection. A longer processing block size with the right modulus can provide significantly better fault detection performance with no change in the number of bytes used to store the check value. In particular, a large-block dual-sum approach provides Hamming Distance 3-class fault detection performance for many times the data word length capability of previously studied Fletcher and Adler checksums. Moduli of 253 and 65525 are identified as being particularly effective for general-purpose checksum use.


title: On a Subset Metric

abstract: For a bounded metric space X, we define a metric on the set of all finite subsets of X. This generalizes the sequence-subset distance introduced by Wentu Song, Kui Cai and Kees A. Schouhamer Immink to study error correcting codes for DNA based data storage. This work also complements the work of Eiter and Mannila where they study extensions of distance functions to subsets of a space in the context of various applications.


title: Spatial-temporal Transformer-guided Diffusion based Data Augmentation for Efficient Skeleton-based Action Recognition

abstract: Recently, skeleton-based human action has become a hot research topic because the compact representation of human skeletons brings new blood to this research domain. As a result, researchers began to notice the importance of using RGB or other sensors to analyze human action by extracting skeleton information. Leveraging the rapid development of deep learning (DL), a significant number of skeleton-based human action approaches have been presented with fine-designed DL structures recently. However, a well-trained DL model always demands high-quality and sufficient data, which is hard to obtain without costing high expenses and human labor. In this paper, we introduce a novel data augmentation method for skeleton-based action recognition tasks, which can effectively generate high-quality and diverse sequential actions. In order to obtain natural and realistic action sequences, we propose denoising diffusion probabilistic models (DDPMs) that can generate a series of synthetic action sequences, and their generation process is precisely guided by a spatial-temporal transformer (ST-Trans). Experimental results show that our method outperforms the state-of-the-art (SOTA) motion generation approaches on different naturality and diversity metrics. It proves that its high-quality synthetic data can also be effectively deployed to existing action recognition models with significant performance improvement.


title: Scalable Weight Reparametrization for Efficient Transfer Learning

abstract: This paper proposes a novel, efficient transfer learning method, called Scalable Weight Reparametrization (SWR) that is efficient and effective for multiple downstream tasks. Efficient transfer learning involves utilizing a pre-trained model trained on a larger dataset and repurposing it for downstream tasks with the aim of maximizing the reuse of the pre-trained model. However, previous works have led to an increase in updated parameters and task-specific modules, resulting in more computations, especially for tiny models. Additionally, there has been no practical consideration for controlling the number of updated parameters. To address these issues, we suggest learning a policy network that can decide where to reparametrize the pre-trained model, while adhering to a given constraint for the number of updated parameters. The policy network is only used during the transfer learning process and not afterward. As a result, our approach attains state-of-the-art performance in a proposed multi-lingual keyword spotting and a standard benchmark, ImageNet-to-Sketch, while requiring zero additional computations and significantly fewer additional parameters.


title: Navigating Multi-Stakeholder Incentives and Preferences: Co-Designing Alternatives for the Future of Gig Worker Well-Being

abstract: Gig workers, and the products and services they provide, play an increasingly ubiquitous role in our daily lives. But despite growing evidence suggesting that worker well-being in gig economy platforms have become significant societal problems, few studies have investigated possible solutions. We take a stride in this direction by engaging workers, platform employees, and local regulators in a series of speed dating workshops using storyboards based on real-life situations to rapidly elicit stakeholder preferences for addressing financial, physical, and social issues related to worker well-being. Our results reveal that existing public and platformic infrastructures fall short in providing workers with resources needed to perform gigs, surfacing a need for multi-platform collaborations, technological innovations, as well as changes in regulations, labor laws, and the public's perception of gig workers, among others. Drawing from multi-stakeholder findings, we discuss these implications for technology, policy, and service as well as avenues for collaboration.


title: Suitability of Quantized DEVS LIM Methods for Simulation of Power Systems

abstract: The suitability of the QDL method for analyzing the performance of ac power systems has been evaluated by application to a microgrid. The QDL method is based on a combination of Quantized State Systems (QSS) methods and the Latency Insertion Method (LIM). The accuracy and computational intensity of QDL simulations were evaluated relative to an industry-standard reference method. The key advantages expected of the QDL approach -- including high computational efficiency when the system is operating in steady-state and, when not in steady-state, the need to update only those states that have been affected by quantum level changes of connected states. The expected advantages were largely realized, but with some complications that remain unresolved and require further research such as limit cycle oscillations that emerge in some states after disturbances that should have returned to stationarity. Also, the method in its current state may not be feasible for fault analysis because of the low computational efficiency that results when large disturbances (e.g. faults) create large excursions simultaneously in many system states. The relative strengths and weaknesses of the method are discussed, and some improvements to the method are proposed to overcome the weaknesses. The revelation of observed problems is intended to inspire additional research to overcome those problems.


title: P4L: Privacy Preserving Peer-to-Peer Learning for Infrastructureless Setups

abstract: Distributed (or Federated) learning enables users to train machine learning models on their very own devices, while they share only the gradients of their models usually in a differentially private way (utility loss). Although such a strategy provides better privacy guarantees than the traditional centralized approach, it requires users to blindly trust a centralized infrastructure that may also become a bottleneck with the increasing number of users. In this paper, we design and implement P4L: a privacy preserving peer-to-peer learning system for users to participate in an asynchronous, collaborative learning scheme without requiring any sort of infrastructure or relying on differential privacy. Our design uses strong cryptographic primitives to preserve both the confidentiality and utility of the shared gradients, a set of peer-to-peer mechanisms for fault tolerance and user churn, proximity and cross device communications. Extensive simulations under different network settings and ML scenarios for three real-life datasets show that P4L provides competitive performance to baselines, while it is resilient to different poisoning attacks. We implement P4L and experimental results show that the performance overhead and power consumption is minimal (less than 3mAh of discharge).


title: Navigating the Grey Area: How Expressions of Uncertainty and Overconfidence Affect Language Models

abstract: The increased deployment of LMs for real-world tasks involving knowledge and facts makes it important to understand model epistemology: what LMs think they know, and how their attitudes toward that knowledge are affected by language use in their inputs. Here, we study an aspect of model epistemology: how epistemic markers of certainty, uncertainty, or evidentiality like "I'm sure it's", "I think it's", or "Wikipedia says it's" affect models, and whether they contribute to model failures. We develop a typology of epistemic markers and inject 50 markers into prompts for question answering. We find that LMs are highly sensitive to epistemic markers in prompts, with accuracies varying more than 80%. Surprisingly, we find that expressions of high certainty result in a 7% decrease in accuracy as compared to low certainty expressions; similarly, factive verbs hurt performance, while evidentials benefit performance. Our analysis of a popular pretraining dataset shows that these markers of uncertainty are associated with answers on question-answering websites, while markers of certainty are associated with questions. These associations may suggest that the behavior of LMs is based on mimicking observed language use, rather than truly reflecting epistemic uncertainty.


title: New GO-based Measures and Their Statistical Significance in Multiple Network Alignment

abstract: Protein-protein interaction (PPI) networks provide valuable insights into the function of biological systems, and aligning multiple PPI networks can reveal important functional relationships between different species. However, assessing the quality of multiple network alignments is a challenging problem. In this paper, we propose two new measures, the Squared GO Score (SGS) and the Exposed G Score, to evaluate the quality of multiple network alignments while using functional information from Gene Ontology (GO) terms. We also introduce a $p$-value measure, the Statistical Exposed G Score, to compute the exact significance of a multiple network alignment based on its revealed GO terms. We also show that our measures are highly correlated with the recovered Ortholog count, providing further evidence for their effectiveness. Our work contributes to the development of more reliable and accurate measures for evaluating multiple network alignments and has potential applications in predicting gene function and identifying evolutionary relationships between different species using multiple network alignment.


title: Independence-Encouraging Subsampling for Nonparametric Additive Models

abstract: The additive model is a popular nonparametric regression method due to its ability to retain modeling flexibility while avoiding the curse of dimensionality. The backfitting algorithm is an intuitive and widely used numerical approach for fitting additive models. However, its application to large datasets may incur a high computational cost and is thus infeasible in practice. To address this problem, we propose a novel approach called independence-encouraging subsampling (IES) to select a subsample from big data for training additive models. Inspired by the minimax optimality of an orthogonal array (OA) due to its pairwise independent predictors and uniform coverage for the range of each predictor, the IES approach selects a subsample that approximates an OA to achieve the minimax optimality. Our asymptotic analyses demonstrate that an IES subsample converges to an OA and that the backfitting algorithm over the subsample converges to a unique solution even if the predictors are highly dependent in the original big data. The proposed IES method is also shown to be numerically appealing via simulations and a real data application.


title: Understanding URDF: A Survey Based on User Experience

abstract: With the increasing complexity of robot systems, it is necessary to simulate them before deployment. To do this, a model of the robot's kinematics or dynamics is required. One of the most commonly used formats for modeling robots is the Unified Robot Description Format (URDF). The goal of this article is to understand how URDF is currently used, what challenges people face when working with it, and how the community sees the future of URDF. The outcome can potentially be used to guide future research. This article presents the results from a survey based on 510 anonymous responses from robotic developers of different backgrounds and levels of experience. We find that 96.8% of the participants have simulated robots before, and of them 95.5% had used URDF. We identify a number of challenges and limitations that complicate the use of URDF, such as the inability to model parallel linkages and closed-chain systems, no real standard, lack of documentation, and a limited number of dynamic parameters to model the robot. Future perspectives for URDF are also determined, where 53.5% believe URDF will be more commonly used in the future, 12.2% believe other standards or tools will make URDF obsolete, and 34.4% are not sure what the future of URDF will be. Most participants agree that there is a need for better tooling to ensure URDF's future use.


title: Exact Boundary Controllability of a coupled System of KdV Equations

abstract: We study the exact boundary controllability of a nonlinear coupled system of two Korteweg-de Vries equations on a bounded interval. The model describes the interactions of two weakly nonlinear gravity waves in a stratifed fluid. Due to the nature of the system, six boundary conditions are required. However, to study the controllability property, we consider a different combination of the control inputs, with a maximum of four of them. Firstly, the results are obtained for the linearized system through a classical duality approach together with some hidden regularity properties of the boundary terms. This approach reduces the controllability problem to the study of a spectral problem which is solved by using the Paley-Wiener method introduced by Rosier [16]. Then, the issue is to establish when a certain quotient of entire functions still turn out to be an entire function. It can be viewed as a problem of factoring an entire function that, depending on the control configuration, leads to the study of a transcendental equation. Finally, by using the contraction mapping theorem we derive the local controllability for the full system.


title: An explicit sub-Weyl bound for $\zeta(1/2 + it)$

abstract: In this article we prove an explicit sub-Weyl bound for the Riemann zeta function $\zeta(s)$ on the critical line $s = 1/2 + it$. In particular, we show that $|\zeta(1/2 + it)| \le 66.7\, t^{27/164}$ for $t \ge 3$. Combined, our results form the sharpest known bounds on $\zeta(1/2 + it)$ for $t \ge \exp(61)$.


title: Dynamic Resource Allocation for Metaverse Applications with Deep Reinforcement Learning

abstract: This work proposes a novel framework to dynamically and effectively manage and allocate different types of resources for Metaverse applications, which are forecasted to demand massive resources of various types that have never been seen before. Specifically, by studying functions of Metaverse applications, we first propose an effective solution to divide applications into groups, namely MetaInstances, where common functions can be shared among applications to enhance resource usage efficiency. Then, to capture the real-time, dynamic, and uncertain characteristics of request arrival and application departure processes, we develop a semi-Markov decision process-based framework and propose an intelligent algorithm that can gradually learn the optimal admission policy to maximize the revenue and resource usage efficiency for the Metaverse service provider and at the same time enhance the Quality-of-Service for Metaverse users. Extensive simulation results show that our proposed approach can achieve up to 120% greater revenue for the Metaverse service providers and up to 178.9% higher acceptance probability for Metaverse application requests than those of other baselines.


title: The Simplified approach to the Bose gas without translation invariance

abstract: The Simplified approach to the Bose gas was introduced by Lieb in 1963 to study the ground state of systems of interacting Bosons. In a series of recent papers, it has been shown that the Simplified approach exceeds earlier expectations, and gives asymptotically accurate predictions at both low and high density. In the intermediate density regime, the qualitative predictions of the Simplified approach have also been found to agree very well with Quantum Monte Carlo computations. Until now, the Simplified approach had only been formulated for translation invariant systems, thus excluding external potentials, and non-periodic boundary conditions. In this paper, we extend the formulation of the Simplified approach to a wide class of systems without translation invariance. This also allows us to study observables in translation invariant systems whose computation requires the symmetry to be broken. Such an observable is the momentum distribution, which counts the number of particles in excited states of the Laplacian. In this paper, we show how to compute the momentum distribution in the Simplified approach, and show that, for the Simple Equation, our prediction matches up with Bogolyubov's prediction at low densities, for momenta extending up to the inverse healing length.

categories: math-ph cond-mat.quant-gas cond-mat.stat-mech math.AP math.MP


title: Optimizing Federated Learning in LEO Satellite Constellations via Intra-Plane Model Propagation and Sink Satellite Scheduling

abstract: The advances in satellite technology developments have recently seen a large number of small satellites being launched into space on Low Earth orbit (LEO) to collect massive data such as Earth observational imagery. The traditional way which downloads such data to a ground station (GS) to train a machine learning (ML) model is not desirable due to the bandwidth limitation and intermittent connectivity between LEO satellites and the GS. Satellite edge computing (SEC), on the other hand, allows each satellite to train an ML model onboard and uploads only the model to the GS which appears to be a promising concept. This paper proposes FedLEO, a novel federated learning (FL) framework that realizes the concept of SEC and overcomes the limitation (slow convergence) of existing FL-based solutions. FedLEO (1) augments the conventional FL's star topology with ``horizontal'' intra-plane communication pathways in which model propagation among satellites takes place; (2) optimally schedules communication between ``sink'' satellites and the GS by exploiting the predictability of satellite orbiting patterns. We evaluate FedLEO extensively and benchmark it with the state of the art. Our results show that FedLEO drastically expedites FL convergence, without sacrificing -- in fact it considerably increases -- the model accuracy.


title: Jump-systems of $T$-paths

abstract: Jump systems are sets of integer vectors satisfying a simple axiom, generalizing matroids, also delta-matroids, and well-kown combinatorial examples such as degree sequences of subgraphs of a graph. It is useful to know if a set of vectors defined from combinatorial structures is a jump system: this has consequences for optimizing on the set, or on some derived sets of vectors. In this note we are mainly concerned in telling our proof of the following more than two decades old fact and its original, elementary proof for an example different from degree sequences: {\em Given an udirected graph $G=(V,E)$ and $T\subseteq V$, the vectors $m$ indexed by $T$ for which there exist a set of openly disjoint $T$-paths so that each $t\in T$ is the endpoint of exactly $m(t)$ paths forms a jump system. The same holds for edge-disjoint $T$-paths.} We are also exhibiting the context and some consequences of this fact, with some pointers to recent developments, among them ro another proof by Iwata and Yokoi, to some related jump system intersection theorems and to some open problems.


title: Evidence of a liquid phase in interacting Bosons at intermediate densities

abstract: In this paper, we present evidence for a liquid-like phase in systems of many interacting Bosons at intermediate densities. The interacting Bose gas has been studied extensively in the low and high density regimes, in which interactions do not play a physically significant role, and the system behaves similarly to the ideal quantum gas. Instead, we will turn our attention to the intermediate density regime, and report evidence that the system enters a strongly correlated phase where its behavior is markedly different from that of the ideal quantum gas. To do so, we use the Simplified approach to the Bose gas, which was introduced by Lieb in 1963 and recently found to provide very accurate predictions for many-Boson systems at all densities. Using this tool, we will compute predictions for the radial distribution function, structure factor, condensate fraction and momentum distribution, and show that they are consistent with liquid-type behavior.

categories: cond-mat.quant-gas cond-mat.stat-mech math-ph math.MP physics.comp-ph


title: Enhancement of quantum heat engine by encircling a Liouvillian exceptional point

abstract: Quantum heat engines are expected to outperform the classical counterparts due to quantum coherences involved. Here we experimentally execute a single-ion quantum heat engine and demonstrate, for the first time, the dynamics and the enhanced performance of the heat engine originating from the Liouvillian exceptional points (LEPs). In addition to the topological effects related to LEPs, we focus on thermodynamic effects, which can be understood by the Landau-Zener-Stuckelberg process under decoherence. We witness a positive net work from the quantum heat engine if the heat engine cycle dynamically encircles an LEP. Further investigation reveals that, a larger net work is done when the system is operated closer to the LEP. We attribute the enhanced performance of the quantum heat engine to the LZS process, enabled by the eigenenergy landscape in the vicinity of the LEP, and the EP-induced topological transition. Therefore, our results open new possibilities to towards LEP-enabled control of quantum heat engines and of thermodynamic processes in open quantum systems.


title: A low latency attention module for streaming self-supervised speech representation learning

abstract: The transformer is a fundamental building block in deep learning, and the attention mechanism is the transformer's core component. Self-supervised speech representation learning (SSRL) represents a popular use-case for the transformer architecture. Due to transformers' acausal behavior, the use of transformers for SSRL has been predominantly focused on acausal applications. However, several media processing problems, such as speech processing, require real-time solutions. In this paper, we present an implementation of the attention module that enables training of SSRL architectures with low compute and memory requirements, while allowing real-time inference with low and fixed latency. The attention module proposed in this paper includes two components, streaming attention (SA) and low-latency streaming attention (LLSA). The SA represents our proposal for an efficient streaming SSRL implementation, while the LLSA solves the latency build-up problem of other streaming attention architectures, such as the masked acausal attention (MAA), guaranteeing a latency equal to one layer even when multiple layers are stacked. We present a comparative analysis between the vanilla attention, which we will refer here as acausal attention (AA), the SA, and the LLSA, by training a streaming SSRL with automatic speech recognition as downstream task. When training on librispeech-clean-100 and testing on librispeech-test-clean, our low-latency attention module has a word error rate (WER) of 5.84%, which represents a significant improvement over the MAA (WER = 13.82%). Our implementation also reduces the inference latency from 1.92 to 0.16 seconds. The proposed low-latency module preserves many of the benefits of conventional acausal transformers, but also enables latency characteristics that make it applicable to real-time streaming applications.


title: Euclidean Contractivity of Neural Networks with Symmetric Weights

abstract: This paper investigates stability conditions of continuous-time Hopfield and firing-rate neural networks by leveraging contraction theory. First, we present a number of useful general algebraic results on matrix polytopes and products of symmetric matrices. Then, we give sufficient conditions for strong and weak Euclidean contractivity, i.e., contractivity with respect to the $\ell_2$ norm, of both models with symmetric weights and (possibly) non-smooth activation functions. Our contraction analysis leads to contraction rates which are log-optimal in almost all symmetric synaptic matrices. Finally, we use our results to propose a firing-rate neural network model to solve a quadratic optimization problem with box constraints.


title: Balanced 2-subsets

abstract: Balanced sets appeared in the 1960s in cooperative game theory as a part of nonempty core conditions. In this paper we present a classification of balanced families containing only 2-element subsets. We also discuss generalizations of the classical Sperner and Tucker lemmas using balanced sets.


title: A mathematical modelization of the prosperity of an Apis Mellifera beehive

abstract: Aesop's famous fable The Ant and the Grasshopper emphasizes the choice that living beings have to make between survival (the Ant) and reproduction (the Grasshopper). Apis Mellifera colonies face the same dilemma : must they rather collect nectar in order to produce honey that will enable them to endure the cold of winter or should they choose to bring pollen back to the hive so as to raise young bees ? Both, of course, but in which proportion ? And where should they fly to find the best resources ? We adress these question through a mathematical perspective, by considering the geometry of resources around the hive.


title: Nickell Bias in Panel Local Projection: Financial Crises Are Worse Than You Think

abstract: Local Projection is widely used for impulse response estimation, with the Fixed Effect (FE) estimator being the default for panel data. This paper highlights the presence of Nickell bias for all regressors in the FE estimator, even if lagged dependent variables are absent in the regression. This bias is the consequence of the inherent panel predictive specification. We recommend using the split-panel jackknife estimator to eliminate the asymptotic bias and restore the standard statistical inference. Revisiting three macro-finance studies on the linkage between financial crises and economic contraction, we find that the FE estimator substantially underestimates the post-crisis economic losses.


title: Bergman metrics as pull-backs of the Fubini-Study metric

abstract: Domains and more generally complex manifolds whose Bergman metrics have constant holomorphic sectional curvature are characterized. Our approach is to treat the Bergman metrics as the pull-back by the Bergman-Bochner maps of the Fubini-Study metric of the complex projective space of infinite dimension. Several new domains with surprising curvature properties for their Bergman metrics are constructed. A new conjecture is also formulated at the end of the paper.


title: A Self-Supervised Learning-based Approach to Clustering Multivariate Time-Series Data with Missing Values (SLAC-Time): An Application to TBI Phenotyping

abstract: Self-supervised learning approaches provide a promising direction for clustering multivariate time-series data. However, real-world time-series data often include missing values, and the existing approaches require imputing missing values before clustering, which may cause extensive computations and noise and result in invalid interpretations. To address these challenges, we present a Self-supervised Learning-based Approach to Clustering multivariate Time-series data with missing values (SLAC-Time). SLAC-Time is a Transformer-based clustering method that uses time-series forecasting as a proxy task for leveraging unlabeled data and learning more robust time-series representations. This method jointly learns the neural network parameters and the cluster assignments of the learned representations. It iteratively clusters the learned representations with the K-means method and then utilizes the subsequent cluster assignments as pseudo-labels to update the model parameters. To evaluate our proposed approach, we applied it to clustering and phenotyping Traumatic Brain Injury (TBI) patients in the Transforming Research and Clinical Knowledge in Traumatic Brain Injury (TRACK-TBI) study. Our experiments demonstrate that SLAC-Time outperforms the baseline K-means clustering algorithm in terms of silhouette coefficient, Calinski Harabasz index, Dunn index, and Davies Bouldin index. We identified three TBI phenotypes that are distinct from one another in terms of clinically significant variables as well as clinical outcomes, including the Extended Glasgow Outcome Scale (GOSE) score, Intensive Care Unit (ICU) length of stay, and mortality rate. The experiments show that the TBI phenotypes identified by SLAC-Time can be potentially used for developing targeted clinical trials and therapeutic strategies.


title: Varianceflow: High-Quality and Controllable Text-to-Speech using Variance Information via Normalizing Flow

abstract: There are two types of methods for non-autoregressive text-to-speech models to learn the one-to-many relationship between text and speech effectively. The first one is to use an advanced generative framework such as normalizing flow (NF). The second one is to use variance information such as pitch or energy together when generating speech. For the second type, it is also possible to control the variance factors by adjusting the variance values provided to a model. In this paper, we propose a novel model called VarianceFlow combining the advantages of the two types. By modeling the variance with NF, VarianceFlow predicts the variance information more precisely with improved speech quality. Also, the objective function of NF makes the model use the variance information and the text in a disentangled manner resulting in more precise variance control. In experiments, VarianceFlow shows superior performance over other state-of-the-art TTS models both in terms of speech quality and controllability.


title: Modular differential equations and algebraic systems

abstract: In this paper, we show how solutions to explicit algebraic systems lead to solutions to infinite families of modular differential equations.


title: Automatic detection of boosted Higgs boson and top quark jets in an event image

abstract: We build a deep neural network based on the Mask R-CNN framework to detect the Higgs jets and top quark jets in any event image. We propose an algorithm to assign the top quark final states at the ground truth level so that the network can be trained in a supervised manner. A new jet branch is added to the network, which uses constituent information to predict the four-momenta of the original parton, thus intrinsically implementing the pileup mitigation. The network can predict both the shapes and the momenta of target jets. We show that the network surpasses the LorentzNet in top and Higgs tagging and the PELICAN network in momentum regression for certain cases, in terms of reconstruction efficiency and accuracy. We also show that the performance of the network does not degrade much when applied to events of a process different from the trained one and to events with overlapping jets.


title: Parameters of several families of binary duadic codes and their related codes

abstract: Binary duadic codes are an interesting subclass of cyclic codes since they have large dimensions and their minimum distances may have a square-root bound. In this paper, we present several families of binary duadic codes of length $2^m-1$ and develop some lower bounds on their minimum distances by using the BCH bound on cyclic codes, which partially solves one case of the open problem proposed in \cite{LLD}. It is shown that the lower bounds on their minimum distances are close to the square root bound. Moreover, the parameters of the dual and extended codes of these binary duadic codes are investigated.


title: 3D Neural Beamforming for Multi-channel Speech Separation Against Location Uncertainty

abstract: Multi-channel speech separation using speaker's directional information has demonstrated significant gains over blind speech separation. However, it has two limitations. First, substantial performance degradation is observed when the coming directions of two sounds are close. Second, the result highly relies on the precise estimation of the speaker's direction. To overcome these issues, this paper proposes 3D features and an associated 3D neural beamformer for multi-channel speech separation. Previous works in this area are extended in two important directions. First, the traditional 1D directional beam patterns are generalized to 3D. This enables the model to extract speech from any target region in the 3D space. Thus, speakers with similar directions but different elevations or distances become separable. Second, to handle the speaker location uncertainty, previously proposed spatial feature is extended to a new 3D region feature. The proposed 3D region feature and 3D neural beamformer are evaluated under an in-car scenario. Experimental results demonstrated that the combination of 3D feature and 3D beamformer can achieve comparable performance to the separation model with ground truth speaker location as input.


title: Text-aided Group Decision-making Process Observation Method (x-GDP): A novel methodology for observing the joint decision-making process of travel choices

abstract: Joint travel decisions, particularly related to social activities remain poorly explained in traditional behavioral models. A key reason for this is the lack of empirical data, and the difficulties associated with collecting such data in the first place. To address this problem, we propose Text-aided Group Decision-making Process Observation Method (x-GDP), a novel survey methodology to collect data on joint leisure activities, from all members of a given clique. Through this method we are able to observe not only the outcome (i.e., the joint activity location chosen) but also the decision-making process itself, including the alternatives that compose the choice set, individual and clique characteristics that might affect the choice process, as well as the discussion behind the choice via texts. Observing such a process will allow researchers to gain a deeper understanding of the joint decision-making process, including how alternatives are weighted, how members interact with each other, and finally how joint choices are made. In this paper we introduce the results of a x-GDP survey implementation focusing on joint eating-out activities in the Greater Tokyo Area, giving a detailed overview of the survey components, execution logistics and initial insights on the data. This is to the best of our knowledge the first attempt to observe group joint travel decisions in real time through a zoom-moderated experiment.


title: Randomness in ML Defenses Helps Persistent Attackers and Hinders Evaluators

abstract: It is becoming increasingly imperative to design robust ML defenses. However, recent work has found that many defenses that initially resist state-of-the-art attacks can be broken by an adaptive adversary. In this work we take steps to simplify the design of defenses and argue that white-box defenses should eschew randomness when possible. We begin by illustrating a new issue with the deployment of randomized defenses that reduces their security compared to their deterministic counterparts. We then provide evidence that making defenses deterministic simplifies robustness evaluation, without reducing the effectiveness of a truly robust defense. Finally, we introduce a new defense evaluation framework that leverages a defense's deterministic nature to better evaluate its adversarial robustness.


title: Enhancing quantum synchronization through homodyne measurement, noise and squeezing

abstract: Quantum synchronization has been a central topic in quantum nonlinear dynamics. Despite rapid development in this field, very few have studied how to efficiently boost synchronization. Homodyne measurement emerges as one of the successful candidates for this task, but preferably in the semi-classical regime. In our work, we focus on the phase synchronization of a harmonic-driven quantum Stuart-Landau oscillator, and show that the enhancement induced by homodyne measurement persists into the quantum regime. Interestingly, optimal two-photon damping rates exist when the oscillator and driving are at resonance and with a small single-photon damping rate. We also report noise-induced enhancement in quantum synchronization when the single-photon damping rate is sufficiently large. Apart from these results, we discover that adding a squeezing Hamiltonian can further boost synchronization, especially in the semi-classical regime. Furthermore, the addition of squeezing causes the optimal two-photon pumping rates to shift and converge.


title: Higher-group structure in lattice Abelian gauge theory under instanton-sum modification

abstract: We consider the $U(1)$ gauge theory on a four-dimensional torus, where the instanton number is restricted to an integral multiple of $p$. This theory possesses the nontrivial higher-group structure, which can be regarded as a generalization of the Green--Schwarz mechanism, between $\mathbb{Z}_q$ $1$-form and $\mathbb{Z}_{pq}$ $3$-form symmetries. Here, $\mathbb{Z}_q$ is a subgroup of the center of~$U(1)$. Following the recent study of the lattice construction of the $U(1)/\mathbb{Z}_q$ principal bundle, we examine how such a structure is realized on the basis of lattice regularization.


title: Programming Mechanics in Knitted Materials, Stitch by Stitch

abstract: Knitting turns yarn, a 1D material, into a 2D fabric that is flexible, durable [1], and can be patterned to adopt a wide range of 3D geometries [2]. Like other mechanical metamaterials [3], the elasticity of knitted fabrics is an emergent property of the local stitch topology and pattern that cannot solely be attributed to the yarn itself. Thus, knitting can be viewed as an additive manufacturing technique that allows for stitch-by-stitch programming of elastic properties and has applications in many fields ranging from soft robotics [4-6] and wearable electronics [7,8] to engineered tissue[9] and architected materials [10,11]. However, predicting these mechanical properties based on the stitch type remains elusive. Here we untangle the relationship between changes in stitch topology and emergent elasticity in several types of knitted fabrics. We combine experiment and simulation to construct a constitutive model for the nonlinear bulk response of these fabrics. This model serves as a basis for composite fabrics with bespoke mechanical properties, which crucially do not depend on the constituent yarn.


title: Adaptive Sampling for Linear Sensing Systems via Langevin Dynamics

abstract: Adaptive or dynamic signal sampling in sensing systems can adapt subsequent sampling strategies based on acquired signals, thereby potentially improving image quality and speed. This paper proposes a Bayesian method for adaptive sampling based on greedy variance reduction and stochastic gradient Langevin dynamics (SGLD). The image priors involved can be either analytical or neural network-based. Notably, the learned image priors generalize well to out-of-distribution test cases that have different statistics than the training dataset. As a real-world validation, the method is applied to accelerate the acquisition of magnetic resonance imaging (MRI). Compared to non-adaptive sampling, the proposed method effectively improved the image quality by 2-3 dB in PSNR, and improved the restoration of subtle details.


title: Memory-augmented Contrastive Learning for Talking Head Generation

abstract: Given one reference facial image and a piece of speech as input, talking head generation aims to synthesize a realistic-looking talking head video. However, generating a lip-synchronized video with natural head movements is challenging. The same speech clip can generate multiple possible lip and head movements, that is, there is no one-to-one mapping relationship between them. To overcome this problem, we propose a Speech Feature Extractor (SFE) based on memory-augmented self-supervised contrastive learning, which introduces the memory module to store multiple different speech mapping results. In addition, we introduce the Mixed Density Networks (MDN) into the landmark regression task to generate multiple predicted facial landmarks. Extensive qualitative and quantitative experiments show that the quality of our facial animation is significantly superior to that of the state-of-the-art (SOTA). The code has been released at https://github.com/Yaxinzhao97/MACL.git.


title: Reference-Point-Based Branch and Bound Algorithm for Multiobjective Optimization

abstract: In this paper, a branch and bound algorithm that incorporates the decision maker's preference information is proposed for multiobjective optimization. In the proposed algorithm, a new discarding test is designed to check whether a box contains preferred solutions according to the preference information expressed by means of reference points. In this way, the proposed algorithm is able to gradually guide the search towards the region of interest on the Pareto fronts during the solution process. We prove that the proposed algorithm obtains $\varepsilon$-efficient solutions distributed in the region of interest. Moreover, lower bound on the total finite number of required iterations for predefined precision is also provided. Finally, the algorithm is illustrated with a number of test problems.


title: Design of a Variable Stiffness Spring with Human-Selectable Stiffness

abstract: Springs are commonly used in wearable robotic devices to provide assistive joint torque without the need for motors and batteries. However, different tasks (such as walking or running) and different users (such as athletes with strong legs or the elderly with weak legs) necessitate different assistive joint torques, and therefore, springs with different stiffness. Variable stiffness springs are a special class of springs which can exert more or less torque upon the same deflection, provided that the user is able to change the stiffness of the spring. In this paper, we present a novel variable stiffness spring design in which the user can select a preferred spring stiffness similar to switching gears on a bicycle. Using a leg-swing experiment, we demonstrate that the user can increment and decrement spring stiffness in a large range to effectively assist the hip joint during leg oscillations. Variable stiffness springs with human-selectable stiffness could be key components of wearable devices which augment locomotion tasks, such as walking, running, and swimming.


title: Linear OPF-based Robust Dynamic Operating Envelopes with Uncertainties in Unbalanced Distribution Networks

abstract: Dynamic operating envelopes (DOEs), as a key enabler to facilitate DER integration, have attracted increasing attention in the past years. However, uncertainties, which may come from load forecast errors or inaccurate network parameters, have been rarely discussed in DOE calculation, leading to compromised quality of the hosting capacity allocation strategy. This letter studies how to calculate DOEs that are immune to such uncertainties based on a linearised unbalanced three-phase optimal power flow (UTOPF) model. With uncertain parameters constrained by norm balls, formulations for calculating Robust DOEs (RDOEs) are presented along with discussions on their tractability. Two cases, including a 2-bus illustrative network and a representative Australian network, are tested to demonstrate the effectiveness and efficiency of the proposed approach.


title: Towards Interpretable Federated Learning

abstract: Federated learning (FL) enables multiple data owners to build machine learning models collaboratively without exposing their private local data. In order for FL to achieve widespread adoption, it is important to balance the need for performance, privacy-preservation and interpretability, especially in mission critical applications such as finance and healthcare. Thus, interpretable federated learning (IFL) has become an emerging topic of research attracting significant interest from the academia and the industry alike. Its interdisciplinary nature can be challenging for new researchers to pick up. In this paper, we bridge this gap by providing (to the best of our knowledge) the first survey on IFL. We propose a unique IFL taxonomy which covers relevant works enabling FL models to explain the prediction results, support model debugging, and provide insights into the contributions made by individual data owners or data samples, which in turn, is crucial for allocating rewards fairly to motivate active and reliable participation in FL. We conduct comprehensive analysis of the representative IFL approaches, the commonly adopted performance evaluation metrics, and promising directions towards building versatile IFL techniques.


title: A coherence interpretation of nonlocal realism in the delayed-choice quantum eraser

abstract: The delayed-choice thought experiment proposed by Wheeler has been demonstrated over the last several decades for the wave-particle duality of a single photon. The delayed-choice quantum eraser proposed by Scully and Druhl has also been intensively studied for the violation of the cause-effect relation of a single photon as well as a pair of entangled photons in an interferometric system. Here, a coherence interpretation is conducted for the nonlocal realism of the space-like separated photons observed in Phys. Rev. Lett. 84, 1 (2000). As a result, coherence solutions of the observed nonlocal fringes are deterministically derived from coincidence detection-caused selective measurements, where the resulting product-basis superposition becomes the origin of the otherwise quantum mystery of the nonlocal fringes. For this, a fixed sum-phase relation between entangled photons is a prerequisite, which cannot be explained by conventional particle nature-based quantum mechanics.


title: Elementwise Language Representation

abstract: We propose a new technique for computational language representation called elementwise embedding, in which a material (semantic unit) is abstracted into a horizontal concatenation of lower-dimensional element (character) embeddings. While elements are always characters, materials are arbitrary levels of semantic units so it generalizes to any type of tokenization. To focus only on the important letters, the $n^{th}$ spellings of each semantic unit are aligned in $n^{th}$ attention heads, then concatenated back into original forms creating unique embedding representations; they are jointly projected thereby determining own contextual importance. Technically, this framework is achieved by passing a sequence of materials, each consists of $v$ elements, to a transformer having $h=v$ attention heads. As a pure embedding technique, elementwise embedding replaces the $w$-dimensional embedding table of a transformer model with $256$ $c$-dimensional elements (each corresponding to one of UTF-8 bytes) where $c=w/v$. Using this novel approach, we show that the standard transformer architecture can be reused for all levels of language representations and be able to process much longer sequences at the same time-complexity without "any" architectural modification and additional overhead. BERT trained with elementwise embedding outperforms its subword equivalence (original implementation) in multilabel patent document classification exhibiting superior robustness to domain-specificity and data imbalance, despite using $0.005\%$ of embedding parameters. Experiments demonstrate the generalizability of the proposed method by successfully transferring these enhancements to differently architected transformers CANINE and ALBERT.


title: Boundary obstructed topological superconductor in buckled honeycomb lattice under perpendicular electric field

abstract: In this work, we show that a buckled honeycomb lattice can host a boundary-obstructed topological superconductor (BOTS) in the presence of f-wave spin-triplet pairing (fSTP). The underlying buckled structure allows for the manipulation of both chemical potential and sublattice potential using a double gate setup. Although a finite sublattice potential can stabilize the fSTP with a possible higher-order band topology, because it also breaks the relevant symmetry, the stability of the corner modes is not guaranteed. Here we show that the fSTP on the honeycomb lattice gives BOTS under nonzero sublattice potential, thus the corner modes can survive as long as the boundary is gapped. Also, by examining the large sublattice potential limit where the honeycomb lattice can be decomposed into two triangular lattices, we show that the boundary modes in the normal state are the quintessential ingredient leading to the BOTS. Thus the effective boundary Hamiltonian becomes nothing but the Hamiltonian for Kitaev chains, which eventually gives the corner modes of the BOTS.


title: Adaptive CSI Feedback for Deep Learning-Enabled Image Transmission

abstract: Recently, deep learning-enabled joint-source channel coding (JSCC) has received increasing attention due to its great success in image transmission. However, most existing JSCC studies only focus on single-input single-output (SISO) channels. In this paper, we first propose a JSCC system for wireless image transmission over multiple-input multiple-output (MIMO) channels. As the complexity of an image determines its reconstruction difficulty, the JSCC achieves quite different reconstruction performances on different images. Moreover, we observe that the images with higher reconstruction qualities are generally more robust to the noise, and can be allocated with less communication resources than the images with lower reconstruction qualities. Based on this observation, we propose an adaptive channel state information (CSI) feedback scheme for precoding, which improves the effectiveness by adjusting the feedback overhead. In particular, we develop a performance evaluator to predict the reconstruction quality of each image, so that the proposed scheme can adaptively decrease the CSI feedback overhead for the transmitted images with high predicted reconstruction qualities in the JSCC system. We perform experiments to demonstrate that the proposed scheme can significantly improve the image transmission performance with much-reduced feedback overhead.


title: Roots of certain polynomials over finite fields

abstract: We determine the roots in F_{q^3} of the polynomial X^{2q^k+1} + X + c for each positive integer k and each c in F_q, where q is a power of 2. We introduce a new approach for this type of question, and we obtain results which are more explicit than the previous results in this area. Our results resolve an open problem and a conjecture of Zheng, Kan, Zhang, Peng, and Li.


title: Age Minimization with Energy and Distortion Constraints

abstract: In this paper, we consider a status update system, where an access point collects measurements from multiple sensors that monitor a common physical process, fuses them, and transmits the aggregated sample to the destination over an erasure channel. Under a typical information fusion scheme, the distortion of the fused sample is inversely proportional to the number of measurements received. Our goal is to minimize the long-term average age while satisfying the average energy and general age-based distortion requirements. Specifically, we focus on the setting in which the distortion requirement is stricter when the age of the update is older. We show that the optimal policy is a mixture of two stationary, deterministic, threshold-based policies, each of which is optimal for a parameterized problem that aims to minimize the weighted sum of the age and energy under the distortion constraint. We then derive analytically the associated optimal average age-cost function and characterize its performance in the large threshold regime, the results of which shed critical insights on the tradeoff among age, energy, and the distortion of the samples. We have also developed a closed-form solution for the special case when the distortion requirement is independent of the age, arguably the most important setting for practical applications.


title: $h^1$, $h_1$ of Anderson t-motives, systems of affine equations and non-commutative determinants

abstract: The authors defined in "$h^1\ne h_1$ for Anderson t-motives" the notion of an affine equation associated to a t-motive $M$. Here we define two systems of affine equations associated to a t-motive $M$, used for calculation of $H^1(M)$ and $H_1(M)$. We describe the process of elimination of unknowns in these systems. This is an analog of the corresponding theory of systems of linear differential equations. It gives us a notion of a non-commutative determinant $det_{i,c}(M)$ which belongs to the Anderson ring $\Bbb C_\infty[T,\tau]$ of non-commutative polynomials. Finally, we calculate $det_{i,c}(M)$ for $M=$ a Drinfeld module or its 1-dual. Also, some explicit calculations are made for Anderson t-motives of dimension $n$, rank $2n$. Some problems of future research are formulated.


title: Tight finite-key analysis for mode-pairing quantum key distribution

abstract: Mode-pairing quantum key distribution (MP-QKD) is a potential protocol that is not only immune to all possible detector side channel attacks, but also breaks the repeaterless rate-transmittance bound without needing global phase locking. Here we analyze the finite-key effect for the MP-QKD protocol with rigorous security proof against general attacks. Moreover, we propose a six-state MP-QKD protocol and analyze its finite-key effect. The results show that the original protocol can break the repeaterless rate-transmittance bound with a typical finite number of pulses in practice. And our six-state protocol can improve the secret key rate significantly in long distance cases.


title: PyReason: Software for Open World Temporal Logic

abstract: The growing popularity of neuro symbolic reasoning has led to the adoption of various forms of differentiable (i.e., fuzzy) first order logic. We introduce PyReason, a software framework based on generalized annotated logic that both captures the current cohort of differentiable logics and temporal extensions to support inference over finite periods of time with capabilities for open world reasoning. Further, PyReason is implemented to directly support reasoning over graphical structures (e.g., knowledge graphs, social networks, biological networks, etc.), produces fully explainable traces of inference, and includes various practical features such as type checking and a memory-efficient implementation. This paper reviews various extensions of generalized annotated logic integrated into our implementation, our modern, efficient Python-based implementation that conducts exact yet scalable deductive inference, and a suite of experiments. PyReason is available at: github.com/lab-v2/pyreason.


title: CrystalBox: Future-Based Explanations for Input-Driven Deep RL Systems

abstract: We present CrystalBox, a novel, model-agnostic, posthoc explainability framework for Deep Reinforcement Learning (DRL) controllers in the large family of input-driven environments which includes computer systems. We combine the natural decomposability of reward functions in input-driven environments with the explanatory power of decomposed returns. We propose an efficient algorithm to generate future-based explanations across both discrete and continuous control environments. Using applications such as adaptive bitrate streaming and congestion control, we demonstrate CrystalBox's capability to generate high-fidelity explanations. We further illustrate its higher utility across three practical use cases: contrastive explanations, network observability, and guided reward design, as opposed to prior explainability techniques that identify salient features.


title: Tunable phononic coupling in excitonic quantum emitters

abstract: Engineering the coupling between fundamental quantum excitations is at the heart of quantum science and technologies. A significant case is the creation of quantum light sources in which coupling between single photons and phonons can be controlled and harnessed to enable quantum information transduction. Here, we report the deterministic creation of quantum emitters featuring highly tunable coupling between excitons and phonons. The quantum emitters are formed in strain-induced quantum dots created in homobilayer semiconductor WSe2. The colocalization of quantum confined interlayer excitons and THz interlayer breathing mode phonons, which directly modulate the exciton energy, leads to a uniquely strong phonon coupling to single-photon emission. The single-photon spectrum of interlayer exciton emission features a single-photon purity >83% and multiple phonon replicas, each heralding the creation of a phonon Fock state in the quantum emitter. Owing to the vertical dipole moment of the interlayer exciton, the phonon-photon interaction is electrically tunable in a wide range, promising to reach the strong coupling regime. Our result demonstrates a new type of solid-state quantum excitonic-optomechanical system at the atomic interface that emits flying photonic qubits coupled with stationary phonons, which could be exploited for quantum transduction and interconnection.


title: FedCLIP: Fast Generalization and Personalization for CLIP in Federated Learning

abstract: Federated learning (FL) has emerged as a new paradigm for privacy-preserving computation in recent years. Unfortunately, FL faces two critical challenges that hinder its actual performance: data distribution heterogeneity and high resource costs brought by large foundation models. Specifically, the non-IID data in different clients make existing FL algorithms hard to converge while the high resource costs, including computational and communication costs that increase the deployment difficulty in real-world scenarios. In this paper, we propose an effective yet simple method, named FedCLIP, to achieve fast generalization and personalization for CLIP in federated learning. Concretely, we design an attention-based adapter for the large model, CLIP, and the rest operations merely depend on adapters. Lightweight adapters can make the most use of pretrained model information and ensure models be adaptive for clients in specific tasks. Simultaneously, small-scale operations can mitigate the computational burden and communication burden caused by large models. Extensive experiments are conducted on three datasets with distribution shifts. Qualitative and quantitative results demonstrate that FedCLIP significantly outperforms other baselines (9% overall improvements on PACS) and effectively reduces computational and communication costs (283x faster than FedAVG). Our code will be available at: https://github.com/microsoft/PersonalizedFL.


title: Growing patterns

abstract: Pattern forming systems allow for a wealth of states, where wavelengths and orientation of patterns varies and defects disrupt patches of monocrystalline regions. Growth of patterns has long been recognized as a strong selection mechanism. We present here recent and new results on the selection of patterns in situations where the pattern-forming region expands in time. The wealth of phenomena is roughly organized in bifurcation diagrams that depict wavenumbers of selected crystalline states as functions of growth rates. We show how a broad set of mathematical and numerical tools can help shed light into the complexity of this selection process.


title: Contextual adversarial attack against aerial detection in the physical world

abstract: Deep Neural Networks (DNNs) have been extensively utilized in aerial detection. However, DNNs' sensitivity and vulnerability to maliciously elaborated adversarial examples have progressively garnered attention. Recently, physical attacks have gradually become a hot issue due to they are more practical in the real world, which poses great threats to some security-critical applications. In this paper, we take the first attempt to perform physical attacks in contextual form against aerial detection in the physical world. We propose an innovative contextual attack method against aerial detection in real scenarios, which achieves powerful attack performance and transfers well between various aerial object detectors without smearing or blocking the interested objects to hide. Based on the findings that the targets' contextual information plays an important role in aerial detection by observing the detectors' attention maps, we propose to make full use of the contextual area of the interested targets to elaborate contextual perturbations for the uncovered attacks in real scenarios. Extensive proportionally scaled experiments are conducted to evaluate the effectiveness of the proposed contextual attack method, which demonstrates the proposed method's superiority in both attack efficacy and physical practicality.


title: Dilemma in All-optical Characterization of Single-layer NiI2 Multiferroics

abstract: Matters Arising in Nature on "Evidence for a single layer van der Waals multiferroic". The search for two dimensional multiferroic materials is an exciting yet challenging endeavor. Recently, Song reported the exciting discovery of type II multiferroic order in an antiferromagnetic (AFM) NiI2 single layer and concluded the ferroelectric (FE) polarization induced by a helical magnetic order1. Their finding was presented from all optical experimental evidence, based on the methods of second harmonic generation (SHG) and linear dichroism (LD). However, the all optical characterizations cannot serve as unanimous evidence of the FE existence, particularly in conjunction with magnetic orders in a single layer NiI2 multiferroic. We have designed and built a Magneto-Optical-Electric Joint-measurement Scanning Imaging system (MOEJSI) for identification of two-dimensional vdW multiferroic.


title: Negative R$\acute{\text{e}}$nyi entropy and Brane intersection

abstract: In this work, we revisit the calculation of R$\acute{\text{e}}$nyi entropy in AdS$_3$/(B)CFT$_2$. We find that gravity solutions brane intersection will lead to negative R$\acute{\text{e}}$nyi entropy.


title: Revisiting localization for BPS black hole entropy

abstract: Macroscopic computation of the degeneracy / index of a BPS black hole requires carrying out string theory path integral over the near horizon geometry of the black hole. It has been suggested that the path integral can be localized to a finite dimensional subspace using the unbroken supersymmetries of the near horizon geometry. We discuss several issues that need to be resolved before one can declare victory: (1) delta-function normalizable eigenmodes of the kinetic operator do not form a representation of the supersymmetry algebra since the Killing spinors grow exponentially as we approach the asymptotic boundary of the near horizon geometry, (2) the logarithmic contributions coming from various one loop determinants are sensitive to the ultraviolet cut-off and therefore without detailed knowledge of the ultraviolet cut-off one cannot determine the order one correction to the entropy that could depend on the ratios of the charges, (3) the results of index theorem indicate that there are additional flat directions of the localization action, at least at the quadratic order, than what has been considered so far. We also discuss a limited application of localization techniques to carry out the path integral over the zero modes of the metric and the gravitino, and get a finite answer. This is consistent with the results of arXiv:0905.2686 and shows that for computing BPS black hole entropy it is not necessary to regulate the path integral over these zero modes using the super-Schwartzian action.


title: Orowan strengthening with thermal activation

abstract: Orowan strengthening is a primary way of strengthening metallic materials.The effect of temperature on the Orowan strengthening mechanism is still debatable in the present day.In this study,the effect of temperature on the Orowan strengthening mechanism is systematically investigated,a thermal activation Orowan strengthening mechanism is developed,and the corresponding Orowan stress is deduced.The results indicate that the obstacle scales substantially affect the thermal activation-based dislocation that bypasses the precipitates processes.In small obstacle scales,the thermal activation contribution to Orowan stress cannot be ignored;while in large obstacle scales,the thermal activation contribution can be ignored even at high temperatures.In addition to temperature, the effects of shear modulus,strain rate, and dislocation density are investigated on Orowan stress.This work not only provides new insight into the Orowan strengthening mechanism but also aids in the development of new high-temperature structural materials.


title: Development of a Finite Element Solver Including a Level-Set Method for Modeling Hydrokinetic Turbines

abstract: Hydrokinetic flapping foil turbines in swing-arm mode have gained considerable interest in recent years because of their enhanced capability to extract power, and improved efficiency compared to foils in simple mode. The performance of foil turbines is closely linked to the development and separation of the Leading-Edge Vortex (LEV). To accurately model the formation and the separation of the LEV on flapping foils, a purpose-built 2D numerical model was developed. The model is based on the weighted residual Finite Element Method (FEM); this is combined with an interface capturing technique, Level-Set Method (LSM), which was used to create a reliable and high-quality numerical solver suitable for hydrodynamic investigations. The solver was validated against well-known static and dynamic benchmark problems. The effect of the mesh density was analyzed and discussed. This paper further covers an initial investigation of the hydrodynamics of flapping foil in swing-arm mode, by studying the structure of the vortex around a NACA0012 foil. The presented method helps to provide a better understanding of the relation between the Leading-Edge Vortex creation, growth, and separation over the flapping foil in swing-arm mode and the extracted power from a hydrokinetic turbine.


title: The Provable Benefits of Unsupervised Data Sharing for Offline Reinforcement Learning

abstract: Self-supervised methods have become crucial for advancing deep learning by leveraging data itself to reduce the need for expensive annotations. However, the question of how to conduct self-supervised offline reinforcement learning (RL) in a principled way remains unclear. In this paper, we address this issue by investigating the theoretical benefits of utilizing reward-free data in linear Markov Decision Processes (MDPs) within a semi-supervised setting. Further, we propose a novel, Provable Data Sharing algorithm (PDS) to utilize such reward-free data for offline RL. PDS uses additional penalties on the reward function learned from labeled data to prevent overestimation, ensuring a conservative algorithm. Our results on various offline RL tasks demonstrate that PDS significantly improves the performance of offline RL algorithms with reward-free data. Overall, our work provides a promising approach to leveraging the benefits of unlabeled data in offline RL while maintaining theoretical guarantees. We believe our findings will contribute to developing more robust self-supervised RL methods.


title: X-ray Spectral Estimation using Dictionary Learning

abstract: As computational tools for X-ray computed tomography (CT) become more quantitatively accurate, knowledge of the source-detector spectral response is critical for quantitative system-independent reconstruction and material characterization capabilities. Directly measuring the spectral response of a CT system is hard, which motivates spectral estimation using transmission data obtained from a collection of known homogeneous objects. However, the associated inverse problem is ill-conditioned, making accurate estimation of the spectrum challenging, particularly in the absence of a close initial guess. In this paper, we describe a dictionary-based spectral estimation method that yields accurate results without the need for any initial estimate of the spectral response. Our method utilizes a MAP estimation framework that combines a physics-based forward model along with an $L_0$ sparsity constraint and a simplex constraint on the dictionary coefficients. Our method uses a greedy support selection method and a new pair-wise iterated coordinate descent method to compute the above estimate. We demonstrate that our dictionary-based method outperforms a state-of-the-art method as shown in a cross-validation experiment on four real datasets collected at beamline 8.3.2 of the Advanced Light Source (ALS).


title: LMSeg: Language-guided Multi-dataset Segmentation

abstract: It's a meaningful and attractive topic to build a general and inclusive segmentation model that can recognize more categories in various scenarios. A straightforward way is to combine the existing fragmented segmentation datasets and train a multi-dataset network. However, there are two major issues with multi-dataset segmentation: (1) the inconsistent taxonomy demands manual reconciliation to construct a unified taxonomy; (2) the inflexible one-hot common taxonomy causes time-consuming model retraining and defective supervision of unlabeled categories. In this paper, we investigate the multi-dataset segmentation and propose a scalable Language-guided Multi-dataset Segmentation framework, dubbed LMSeg, which supports both semantic and panoptic segmentation. Specifically, we introduce a pre-trained text encoder to map the category names to a text embedding space as a unified taxonomy, instead of using inflexible one-hot label. The model dynamically aligns the segment queries with the category embeddings. Instead of relabeling each dataset with the unified taxonomy, a category-guided decoding module is designed to dynamically guide predictions to each datasets taxonomy. Furthermore, we adopt a dataset-aware augmentation strategy that assigns each dataset a specific image augmentation pipeline, which can suit the properties of images from different datasets. Extensive experiments demonstrate that our method achieves significant improvements on four semantic and three panoptic segmentation datasets, and the ablation study evaluates the effectiveness of each component.


title: Strategize Before Teaching: A Conversational Tutoring System with Pedagogy Self-Distillation

abstract: Conversational tutoring systems (CTSs) aim to help students master educational material with natural language interaction in the form of a dialog. CTSs have become a key pillar in educational data mining research. A key challenge in CTSs is to engage the student in the conversation while exposing them to a diverse set of teaching strategies, akin to a human teacher, thereby, helping them learn in the process. Different from previous work that generates responses given the strategies as input, we propose to jointly predict teaching strategies and generate tutor responses accordingly, which fits a more realistic application scenario. We benchmark several competitive models on three dialog tutoring datasets and propose a unified framework that combines teaching response generation and pedagogical strategy prediction, where a self-distillation mechanism is adopted to guide the teaching strategy learning and facilitate tutor response generation. Our experiments and analyses shed light on how teaching strategies affect dialog tutoring.


title: Negative electrocaloric effect in nonpolar phases of perovskite over wide range of temperature

abstract: The electrocaloric effect (ECE) offers a promising alternative to the traditional gas compressing refrigeration due to its high efficiency and environmental friendliness. The unusual negative electrocaloric effect refers to the adiabatic temperature drops due to application of electric field, in contrast with the normal (positive) ECE, and provides ways to improve the electrocaloric efficiency in refrigeration cycles. However, negative ECE is unusual and requires a clear understanding of microscopic mechanisms. Here, we found unexpected and extensive negative ECE in nonpolar orthorhombic, tetragonal, and cubic phases of halide and oxide perovskite at wide range of temperature by means of first-principle-based large scale Monte Carlo methods. Such unexpected negative ECE originates from the octahedral tilting related entropy change rather than the polarization entropy change under the application of electric field. Furthermore, a giant negative ECE with temperature change of 8.6 K is found at room temperature. This giant and extensive negative ECE in perovskite opens up new horizon in the research of caloric effects and broadens the electrocaloric refrigeration ways with high efficiency.


title: Pretraining De-Biased Language Model with Large-scale Click Logs for Document Ranking

abstract: Pre-trained language models have achieved great success in various large-scale information retrieval tasks. However, most of pretraining tasks are based on counterfeit retrieval data where the query produced by the tailored rule is assumed as the user's issued query on the given document or passage. Therefore, we explore to use large-scale click logs to pretrain a language model instead of replying on the simulated queries. Specifically, we propose to use user behavior features to pretrain a debiased language model for document ranking. Extensive experiments on Baidu desensitization click logs validate the effectiveness of our method. Our team on WSDM Cup 2023 Pre-training for Web Search won the 1st place with a Discounted Cumulative Gain @ 10 (DCG@10) score of 12.16525 on the final leaderboard.


title: Robustness of Half-Integer Quantized Hall Conductivity against Disorder in an Anisotropic Dirac Semimetal with Parity Anomaly

abstract: Two-dimensional Dirac semimetals with a single massless Dirac cone exhibit the parity anomaly. Usually, such a kind of anomalous topological semimetallic phase in real materials is unstable where any amount of disorder can drive it into a diffusive metal and destroy the half-integer quantized Hall conductivity as an indicator of parity anomaly. Here, based on low-energy effective model, we propose an anisotropic Dirac semimetal which explicitly breaks time-reversal symmetry and carries a half-integer quantized Hall conductivity. This topological semimetallic phase can be realized on a deformed honeycomb lattice subjected to a magnetic flux. Moreover, we perceptively investigate the disorder correction to the Hall conductivity. The results show that the effects of disorder can be strongly suppressed and thereby the nearly half-integer quantization of Hall conductivity can exist in a wide region of disorder, indicating that our proposed anisotropic Dirac semimetal is an exciting platform to investigate the parity anomaly phenomena.


title: Entropy Estimate Between Diffusion Processes with Application to Nonlinear Fokker-Planck Equations

abstract: By developing a new technique called the bi-coupling argument, we estimate the relative entropy between different diffusion processes in terms of the distances of initial distributions and drift-diffusion coefficients. As an application, the entropy-cost inequality is established for nonlinear Fokker-Planck equations, which has potential applications in optimal transport, information theory and mean field particle systems.


title: A Handheld Fine-Grained RFID Localization System with Complex-Controlled Polarization

abstract: There is much interest in fine-grained RFID localization systems. Existing systems for accurate localization typically require infrastructure, either in the form of extensive reference tags or many antennas (e.g., antenna arrays) to localize RFID tags within their radio range. Yet, there remains a need for fine-grained RFID localization solutions that are in a compact, portable, mobile form, that can be held by users as they walk around areas to map them, such as in retail stores, warehouses, or manufacturing plants. We present the design, implementation, and evaluation of POLAR, a portable handheld system for fine-grained RFID localization. Our design introduces two key innovations that enable robust, accurate, and real-time localization of RFID tags. The first is complex-controlled polarization (CCP), a mechanism for localizing RFIDs at all orientations through software-controlled polarization of two linearly polarized antennas. The second is joint tag discovery and localization (JTDL), a method for simultaneously localizing and reading tags with zero-overhead regardless of tag orientation. Building on these two techniques, we develop an end-to-end handheld system that addresses a number of practical challenges in self-interference, efficient inventorying, and self-localization. Our evaluation demonstrates that POLAR achieves a median accuracy of a few centimeters in each of the x/y/z dimensions in practical indoor environments.


title: Spiked multiplicative random matrices and principal components

abstract: In this paper, we study the eigenvalues and eigenvectors of the spiked invariant multiplicative models when the randomness is from Haar matrices. We establish the limits of the outlier eigenvalues $\widehat{\lambda}_i$ and the generalized components ($\langle \mathbf{v}, \widehat{\mathbf{u}}_i \rangle$ for any deterministic vector $\mathbb{v}$) of the outlier eigenvectors $\widehat{\mathbf{u}}_i$ with optimal convergence rates. Moreover, we prove that the non-outlier eigenvalues stick with those of the unspiked matrices and the non-outlier eigenvectors are delocalized. The results also hold near the so-called BBP transition and for degenerate spikes. On one hand, our results can be regarded as a refinement of the counterparts of [12] under additional regularity conditions. On the other hand, they can be viewed as an analog of [34] by replacing the random matrix with i.i.d. entries with Haar random matrix.


title: On the shape of K-semistable domain and wall crossing for K-stability

abstract: Fix two positive integers $d$ and $k$, a positive number $v$, and a finite set $I$ of non-negative rational numbers, we prove that the K-semistable domain of the log pair $(X, \sum_{j=1}^kD_j)$ is a rational polytope lying in the $k$-dimensional simplex $\overline{\Delta^k}$, where $X$ is a Fano variety of dimension $d$, $D_j\sim_\mathbb{Q} -K_X$, $(-K_X)^d=v$, the coefficients of $D_j$ are contained in $I$, and $(X, \sum_{j=1}^kc_jD_j)$ is a K-semistable log Fano pair for some $c_j\in [0,1)\cap \mathbb{Q}$. Moreover, we show that there are only finitely many polytopes which may appear as the K-semistable domains for such log pairs. Based on this, we establish a wall crossing theory for K-moduli with multiple boundaries.


title: Strongly primitive species with potentials: aims and limitations

abstract: This is an extended abstract of my talk at the Oberwolfach Workshop ''Cluster Algebras and Related Topics'' (December 8 - 14, 2013). It is based on a joint work with A. Zelevinsky (arXiv:1306.3495).


title: Multi-Action Dialog Policy Learning from Logged User Feedback

abstract: Multi-action dialog policy, which generates multiple atomic dialog actions per turn, has been widely applied in task-oriented dialog systems to provide expressive and efficient system responses. Existing policy models usually imitate action combinations from the labeled multi-action dialog examples. Due to data limitations, they generalize poorly toward unseen dialog flows. While reinforcement learning-based methods are proposed to incorporate the service ratings from real users and user simulators as external supervision signals, they suffer from sparse and less credible dialog-level rewards. To cope with this problem, we explore to improve multi-action dialog policy learning with explicit and implicit turn-level user feedback received for historical predictions (i.e., logged user feedback) that are cost-efficient to collect and faithful to real-world scenarios. The task is challenging since the logged user feedback provides only partial label feedback limited to the particular historical dialog actions predicted by the agent. To fully exploit such feedback information, we propose BanditMatch, which addresses the task from a feedback-enhanced semi-supervised learning perspective with a hybrid objective of semi-supervised learning and bandit learning. BanditMatch integrates pseudo-labeling methods to better explore the action space through constructing full label feedback. Extensive experiments show that our BanditMatch outperforms the state-of-the-art methods by generating more concise and informative responses. The source code and the appendix of this paper can be obtained from https://github.com/ShuoZhangXJTU/BanditMatch.


title: PolyScope: Multi-Policy Access Control Analysis to Triage Android Scoped Storage

abstract: Android's filesystem access control is a crucial aspect of its system integrity. It utilizes a combination of mandatory access controls, such as SELinux, and discretionary access controls, like Unix permissions, along with specialized access controls such as Android permissions to safeguard OEM and Android services from third-party applications. However, when OEMs introduce differentiating features, they often create vulnerabilities due to their inability to properly reconfigure this complex policy combination. To address this, we introduce the POLYSCOPE tool, which triages Android filesystem access control policies to identify attack operations - authorized operations that may be exploited by adversaries to elevate their privileges. POLYSCOPE has three significant advantages over prior analyses: it allows for the independent extension and analysis of individual policy models, understands the flexibility untrusted parties have in modifying access control policies, and can identify attack operations that system configurations permit. We demonstrate the effectiveness of POLYSCOPE by examining the impact of Scoped Storage on Android, revealing that it reduces the number of attack operations possible on external storage resources by over 50%. However, because OEMs only partially adopt Scoped Storage, we also uncover two previously unknown vulnerabilities, demonstrating how POLYSCOPE can assess an ideal scenario where all apps comply with Scoped Storage, which can reduce the number of untrusted parties accessing attack operations by over 65% on OEM systems. POLYSCOPE thus helps Android OEMs evaluate complex access control policies to pinpoint the attack operations that require further examination.


title: Active Reward Learning from Online Preferences

abstract: Robot policies need to adapt to human preferences and/or new environments. Human experts may have the domain knowledge required to help robots achieve this adaptation. However, existing works often require costly offline re-training on human feedback, and those feedback usually need to be frequent and too complex for the humans to reliably provide. To avoid placing undue burden on human experts and allow quick adaptation in critical real-world situations, we propose designing and sparingly presenting easy-to-answer pairwise action preference queries in an online fashion. Our approach designs queries and determines when to present them to maximize the expected value derived from the queries' information. We demonstrate our approach with experiments in simulation, human user studies, and real robot experiments. In these settings, our approach outperforms baseline techniques while presenting fewer queries to human experts. Experiment videos, code and appendices are found at https://sites.google.com/view/onlineactivepreferences.


title: Detecting Jumps on a Tree: a Hierarchical Pitman-Yor Model for Evolution of Phenotypic Distributions

abstract: This work focuses on clustering populations with a hierarchical dependency structure that can be described by a tree. A particular example that is the focus of our work is the phylogenetic tree, with nodes often representing biological species. Clustering of the populations in this problem is equivalent to identify branches in the tree where the populations at the parent and child node have significantly different distributions. We construct a nonparametric Bayesian model based on hierarchical Pitman-Yor and Poisson processes to exploit this hierarchical structure, with a key contribution being the ability to share statistical information between subpopulations. We develop an efficient particle MCMC algorithm to address computational challenges involved with posterior inference. We illustrate the efficacy of our proposed approach on both synthetic and real-world problems.


title: GeoLCR: Attention-based Geometric Loop Closure and Registration

abstract: We present a novel algorithm specially designed for loop detection and registration that utilizes Lidar-based perception. Our approach to loop detection involves voxelizing point clouds, followed by an overlap calculation to confirm whether a vehicle has completed a loop. We further enhance the current pose's accuracy via an innovative point-level registration model. The efficacy of our algorithm has been assessed across a range of well-known datasets, including KITTI, KITTI-360, Nuscenes, Complex Urban, NCLT, and MulRan. In comparative terms, our method exhibits up to a twofold increase in the precision of both translation and rotation estimations. Particularly noteworthy is our method's performance on challenging sequences where it outperforms others, being the first to achieve a perfect 100% success rate in loop detection.