title: Improved coherent one-way quantum key distribution for high-loss channels

abstract: The coherent one-way (COW) quantum key distribution (QKD) is a highly practical quantum communication protocol that is currently deployed in off-the-shelves products. However, despite its simplicity and widespread use, the security of COW-QKD is still an open problem. This is largely due to its unique security feature based on inter-signal phase distribution, which makes it very difficult to analyze using standard security proof techniques. Here, to overcome this problem, we present a simple variant of COW-QKD and prove its security in the infinite-key limit. The proposed modifications only involve an additional vacuum tail signal following every encoded signal and a balanced beam-splitter for passive measurement basis choice. Remarkably, the resulting key rate of our protocol is comparable with both the existing upper-bound on COW-QKD key rate and the secure key rate of the coherent-state BB84 protocol. Our findings therefore suggest that the secured deployment of COW-QKD systems in high loss optical networks is indeed feasible with minimal adaptations applied to its hardware and software.


title: Revisiting Self-Distillation

abstract: Knowledge distillation is the procedure of transferring "knowledge" from a large model (the teacher) to a more compact one (the student), often being used in the context of model compression. When both models have the same architecture, this procedure is called self-distillation. Several works have anecdotally shown that a self-distilled student can outperform the teacher on held-out data. In this work, we systematically study self-distillation in a number of settings. We first show that even with a highly accurate teacher, self-distillation allows a student to surpass the teacher in all cases. Secondly, we revisit existing theoretical explanations of (self) distillation and identify contradicting examples, revealing possible drawbacks of these explanations. Finally, we provide an alternative explanation for the dynamics of self-distillation through the lens of loss landscape geometry. We conduct extensive experiments to show that self-distillation leads to flatter minima, thereby resulting in better generalization.


title: TKIL: Tangent Kernel Approach for Class Balanced Incremental Learning

abstract: When learning new tasks in a sequential manner, deep neural networks tend to forget tasks that they previously learned, a phenomenon called catastrophic forgetting. Class incremental learning methods aim to address this problem by keeping a memory of a few exemplars from previously learned tasks, and distilling knowledge from them. However, existing methods struggle to balance the performance across classes since they typically overfit the model to the latest task. In our work, we propose to address these challenges with the introduction of a novel methodology of Tangent Kernel for Incremental Learning (TKIL) that achieves class-balanced performance. The approach preserves the representations across classes and balances the accuracy for each class, and as such achieves better overall accuracy and variance. TKIL approach is based on Neural Tangent Kernel (NTK), which describes the convergence behavior of neural networks as a kernel function in the limit of infinite width. In TKIL, the gradients between feature layers are treated as the distance between the representations of these layers and can be defined as Gradients Tangent Kernel loss (GTK loss) such that it is minimized along with averaging weights. This allows TKIL to automatically identify the task and to quickly adapt to it during inference. Experiments on CIFAR-100 and ImageNet datasets with various incremental learning settings show that these strategies allow TKIL to outperform existing state-of-the-art methods.


title: Nonconforming finite elements for the Brinkman and $-\text{curl}\Delta \text{curl}$ problems on cubical meshes

abstract: We propose two families of nonconforming elements on cubical meshes: one for the $-\text{curl}\Delta\text{curl}$ problem and the other for the Brinkman problem. The element for the $-\text{curl}\Delta\text{curl}$ problem is the first nonconforming element on cubical meshes. The element for the Brinkman problem can yield a uniformly stable finite element method with respect to the parameter $\nu$. The lowest-order elements for the $-\text{curl}\Delta\text{curl}$ and the Brinkman problems have 48 and 30 degrees of freedom, respectively. The two families of elements are subspaces of $H(\text{curl};\Omega)$ and $H(\text{div};\Omega)$, and they, as nonconforming approximation to $H(\text{gradcurl};\Omega)$ and $[H^1(\Omega)]^3$, can form a discrete Stokes complex together with the Lagrange element and the $L^2$ element.


title: Factorization Approach for Sparse Spatio-Temporal Brain-Computer Interface

abstract: Recently, advanced technologies have unlimited potential in solving various problems with a large amount of data. However, these technologies have yet to show competitive performance in brain-computer interfaces (BCIs) which deal with brain signals. Basically, brain signals are difficult to collect in large quantities, in particular, the amount of information would be sparse in spontaneous BCIs. In addition, we conjecture that high spatial and temporal similarities between tasks increase the prediction difficulty. We define this problem as sparse condition. To solve this, a factorization approach is introduced to allow the model to obtain distinct representations from latent space. To this end, we propose two feature extractors: A class-common module is trained through adversarial learning acting as a generator; Class-specific module utilizes loss function generated from classification so that features are extracted with traditional methods. To minimize the latent space shared by the class-common and class-specific features, the model is trained under orthogonal constraint. As a result, EEG signals are factorized into two separate latent spaces. Evaluations were conducted on a single-arm motor imagery dataset. From the results, we demonstrated that factorizing the EEG signal allows the model to extract rich and decisive features under sparse condition.


title: Yankee Swap: a Fast and Simple Fair Allocation Mechanism for Matroid Rank Valuations

abstract: We study fair allocation of indivisible goods when agents have matroid rank valuations. Our main contribution is a simple algorithm based on the colloquial Yankee Swap procedure that computes provably fair and efficient Lorenz dominating allocations. While there exist polynomial time algorithms to compute such allocations, our proposed method improves on them in two ways. (a) Our approach is easy to understand and does not use complex matroid optimization algorithms as subroutines. (b) Our approach is scalable; it is provably faster than all known algorithms to compute Lorenz dominating allocations. These two properties are key to the adoption of algorithms in any real fair allocation setting; our contribution brings us one step closer to this goal.


title: Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistency

abstract: Pre-training on time series poses a unique challenge due to the potential mismatch between pre-training and target domains, such as shifts in temporal dynamics, fast-evolving trends, and long-range and short-cyclic effects, which can lead to poor downstream performance. While domain adaptation methods can mitigate these shifts, most methods need examples directly from the target domain, making them suboptimal for pre-training. To address this challenge, methods need to accommodate target domains with different temporal dynamics and be capable of doing so without seeing any target examples during pre-training. Relative to other modalities, in time series, we expect that time-based and frequency-based representations of the same example are located close together in the time-frequency space. To this end, we posit that time-frequency consistency (TF-C) -- embedding a time-based neighborhood of an example close to its frequency-based neighborhood -- is desirable for pre-training. Motivated by TF-C, we define a decomposable pre-training model, where the self-supervised signal is provided by the distance between time and frequency components, each individually trained by contrastive estimation. We evaluate the new method on eight datasets, including electrodiagnostic testing, human activity recognition, mechanical fault detection, and physical status monitoring. Experiments against eight state-of-the-art methods show that TF-C outperforms baselines by 15.4% (F1 score) on average in one-to-one settings (e.g., fine-tuning an EEG-pretrained model on EMG data) and by 8.4% (precision) in challenging one-to-many settings (e.g., fine-tuning an EEG-pretrained model for either hand-gesture recognition or mechanical fault prediction), reflecting the breadth of scenarios that arise in real-world applications. Code and datasets: https://github.com/mims-harvard/TFC-pretraining.


title: Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collections

abstract: 3D models of manufactured objects are important for populating virtual worlds and for synthetic data generation for vision and robotics. To be most useful, such objects should be articulated: their parts should move when interacted with. While articulated object datasets exist, creating them is labor-intensive. Learning-based prediction of part motions can help, but all existing methods require annotated training data. In this paper, we present an unsupervised approach for discovering articulated motions in a part-segmented 3D shape collection. Our approach is based on a concept we call category closure: any valid articulation of an object's parts should keep the object in the same semantic category (e.g. a chair stays a chair). We operationalize this concept with an algorithm that optimizes a shape's part motion parameters such that it can transform into other shapes in the collection. We evaluate our approach by using it to re-discover part motions from the PartNet-Mobility dataset. For almost all shape categories, our method's predicted motion parameters have low error with respect to ground truth annotations, outperforming two supervised motion prediction methods.


title: Large non-reciprocal charge transport in Pt2MnGe up to room temperature

abstract: Non-reciprocal charge transport that is strongly associated with the structural or magnetic chirality of the quantum materials system is one of the most exotic properties of condensed matter physics. Here, using magnetic alloys film Pt2MnGe, we have realized the large non-reciprocal charge transport up to room temperature, which roots in the organic combination of chirality dependent carrier scattering and special magnetic configurations. In this framework, the conduction electrons are scattered asymmetrically by the emerging non-zero vector spin chirality under in-plane magnetic field, resulting in robust non-reciprocal response. More astonishingly, the vector spin chirality in Pt2MnGe film can be reversed by a spin-polarized current through spin Hall effect in a junction with Pt layer. Our work resolves the general limitation of non-reciprocal charge transport to cryogenic temperatures, and paves the way for extending its applications in the emerging field of chiral spintronics.


title: A Parametric Class of Approximate Gradient Updates for Policy Optimization

abstract: Approaches to policy optimization have been motivated from diverse principles, based on how the parametric model is interpreted (e.g. value versus policy representation) or how the learning objective is formulated, yet they share a common goal of maximizing expected return. To better capture the commonalities and identify key differences between policy optimization methods, we develop a unified perspective that re-expresses the underlying updates in terms of a limited choice of gradient form and scaling function. In particular, we identify a parameterized space of approximate gradient updates for policy optimization that is highly structured, yet covers both classical and recent examples, including PPO. As a result, we obtain novel yet well motivated updates that generalize existing algorithms in a way that can deliver benefits both in terms of convergence speed and final result quality. An experimental investigation demonstrates that the additional degrees of freedom provided in the parameterized family of updates can be leveraged to obtain non-trivial improvements both in synthetic domains and on popular deep RL benchmarks.


title: What do navigation agents learn about their environment?

abstract: Today's state of the art visual navigation agents typically consist of large deep learning models trained end to end. Such models offer little to no interpretability about the learned skills or the actions of the agent taken in response to its environment. While past works have explored interpreting deep learning models, little attention has been devoted to interpreting embodied AI systems, which often involve reasoning about the structure of the environment, target characteristics and the outcome of one's actions. In this paper, we introduce the Interpretability System for Embodied agEnts (iSEE) for Point Goal and Object Goal navigation agents. We use iSEE to probe the dynamic representations produced by these agents for the presence of information about the agent as well as the environment. We demonstrate interesting insights about navigation agents using iSEE, including the ability to encode reachable locations (to avoid obstacles), visibility of the target, progress from the initial spawn location as well as the dramatic effect on the behaviors of agents when we mask out critical individual neurons. The code is available at: https://github.com/allenai/iSEE


title: Towards Data Assimilation in Level-Set Wildfire Models Using Bayesian Filtering

abstract: The level-set method is a prominent approach to modelling the evolution of a fire over time based on a characterised rate of spread. It however does not provide a direct means for assimilating new data and quantifying uncertainty. Fire front predictions can be more accurate and agile if the models are able to assimilate data in real time. Furthermore, uncertainty estimation of the location and spread of the fire is critical for decision making. Using Bayesian filtering approaches, we extend the level-set method to allow for data assimilation and uncertainty quantification. We demonstrate these approaches on data from a controlled fire.


title: Master equation approach for transport through Majorana zero modes

abstract: Based on an exact formulation, we present a master equation approach to transport through Majorana zero modes (MZMs). Within the master equation treatment, the occupation dynamics of the regular fermion associated with the MZMs holds a quite different picture from the BdG S-matrix scattering process, in which the "positive" and "negative" energy states are employed, while the master equation treatment does not involve them at all. Via careful analysis for the structure of the rates and the rate processes governed by the master equation, we reveal the intrinsic connection between both approaches. This connection enables us to better understand the confusing issue of teleportation when the Majorana coupling vanishes. We illustrate the behaviors of transient rates, occupation dynamics and currents. Through the bias voltage dependence, we also show the Markovian condition for the rates, which can extremely simplify the applications in practice. As future perspective, the master equation approach developed in this work can be applied to study important time-dependent phenomena such as photon-assisted tunneling through the MZMs and modulation effect of the Majorana coupling energy.


title: Semiparametric Single-Index Estimation for Average Treatment Effects

abstract: We propose a semiparametric method to estimate the average treatment effect under the assumption of unconfoundedness given observational data. Our estimation method alleviates misspecification issues of the propensity score function by estimating the single-index link function involved through Hermite polynomials. Our approach is computationally tractable and allows for moderately large dimension covariates. We provide the large sample properties of the estimator and show its validity. Also, the average treatment effect estimator achieves the parametric rate and asymptotic normality. Our extensive Monte Carlo study shows that the proposed estimator is valid in finite samples. We also provide an empirical analysis on the effect of maternal smoking on babies' birth weight and the effect of job training program on future earnings.


title: Collective infectivity of the pandemic over time and association with vaccine coverage and economic development

abstract: This paper uses new and existing methods to study collective trends across countries throughout the pandemic, with a focus on the multivariate time series of reproduction numbers and vaccine proliferation. We begin with a time-varying analysis of the collective nature of infectivity, where we evaluate the eigenspectrum and collective magnitude of reproduction number time series on a country-by-country basis. Next, we study the topology of this eigenspectrum, measuring the deviation between all points in time, and introduce a graph-theoretic methodology to reveal a clear partition in global infectivity dynamics. Then, we compare countries' vaccine rollouts with economic indicators such as their GDP and HDI in a collective fashion. We investigate time-varying consistency and determine points in time where there is the greatest discrepancy between these indicators as a whole. Our two primary findings are a considerable increase in collective infectivity in the latter half of the period, and a concave-up (``down then up'') pattern in the collective consistency between vaccine coverage and economic/development indicators across countries.


title: ATOMS: ALMA Three-millimeter Observations of Massive Star-forming regions -- XI. From inflow to infall in hub-filament systems

abstract: We investigate the presence of hub-filament systems in a large sample of 146 active proto-clusters, using H$^{13}$CO$^{+}$ J=1-0 molecular line data obtained from the ATOMS survey. We find that filaments are ubiquitous in proto-clusters, and hub-filament systems are very common from dense core scales ($\sim$0.1 pc) to clump/cloud scales ($\sim$1-10 pc). The proportion of proto-clusters containing hub-filament systems decreases with increasing dust temperature ($T_d$) and luminosity-to-mass ratios ($L/M$) of clumps, indicating that stellar feedback from H{\sc ii} regions gradually destroys the hub-filament systems as proto-clusters evolve. Clear velocity gradients are seen along the longest filaments with a mean velocity gradient of 8.71 km s$^{-1}$pc$^{-1}$ and a median velocity gradient of 5.54 km s$^{-1}$pc$^{-1}$. We find that velocity gradients are small for filament lengths larger than $\sim$1~pc, probably hinting at the existence of inertial inflows, although we cannot determine whether the latter are driven by large-scale turbulence or large-scale gravitational contraction. In contrast, velocity gradients below $\sim$1~pc dramatically increase as filament lengths decrease, indicating that the gravity of the hubs or cores starts to dominate gas infall at small scales. We suggest that self-similar hub-filament systems and filamentary accretion at all scales may play a key role in high-mass star formation.


title: A Numerical Reasoning Question Answering System with Fine-grained Retriever and the Ensemble of Multiple Generators for FinQA

abstract: The numerical reasoning in the financial domain -- performing quantitative analysis and summarizing the information from financial reports -- can greatly increase business efficiency and reduce costs of billions of dollars. Here, we propose a numerical reasoning question answering system to answer numerical reasoning questions among financial text and table data sources, consisting of a retriever module, a generator module, and an ensemble module. Specifically, in the retriever module, in addition to retrieving the whole row data, we innovatively design a cell retriever that retrieves the gold cells to avoid bringing unrelated and similar cells in the same row to the inputs of the generator module. In the generator module, we utilize multiple generators to produce programs, which are operation steps to answer the question. Finally, in the ensemble module, we integrate multiple programs to choose the best program as the output of our system. In the final private test set in FinQA Competition, our system obtains 69.79 execution accuracy.


title: On energy-stable and high order finite element methods for the wave equation in heterogeneous media with perfectly matched layers

abstract: This paper presents a stable finite element approximation for the acoustic wave equation on second-order form, with perfectly matched layers (PML) at the boundaries. Energy estimates are derived for varying PML damping for both the discrete and the continuous case. Moreover, a priori error estimates are derived for constant PML damping. Most of the analysis is performed in Laplace space. Numerical experiments in physical space validate the theoretical results.


title: High-performance cavity-enhanced quantum memory with warm atomic cell

abstract: High-performance quantum memory for quantized states of light is a prerequisite building block of quantum information technology. Despite great progresses of optical quantum memories based on interactions of light and atoms, physical features of these memories still cannot satisfy requirements for applications in practical quantum information systems, since all of them suffer from trade-off between memory efficiency and excess noise. Here, we report a high-performance cavity-enhanced electromagnetically-induced-transparency memory with warm atomic cell in which a scheme of optimizing the spatial and temporal modes based on the time-reversal approach is applied. The memory efficiency up to 67% is directly measured and a noise level close to quantum noise limit is simultaneously reached. It has been experimentally demonstrated that the average fidelities for a set of input coherent states with different phases and amplitudes within a Gaussian distribution have exceeded the classical benchmark fidelities. Thus the realized quantum memory platform has been capable of preserving quantized optical states, and is ready to be applied in quantum information systems, such as distributed quantum logic gates and quantum-enhanced atomic magnetometry.


title: Neural Architecture Adaptation for Object Detection by Searching Channel Dimensions and Mapping Pre-trained Parameters

abstract: Most object detection frameworks use backbone architectures originally designed for image classification, conventionally with pre-trained parameters on ImageNet. However, image classification and object detection are essentially different tasks and there is no guarantee that the optimal backbone for classification is also optimal for object detection. Recent neural architecture search (NAS) research has demonstrated that automatically designing a backbone specifically for object detection helps improve the overall accuracy. In this paper, we introduce a neural architecture adaptation method that can optimize the given backbone for detection purposes, while still allowing the use of pre-trained parameters. We propose to adapt both the micro- and macro-architecture by searching for specific operations and the number of layers, in addition to the output channel dimensions of each block. It is important to find the optimal channel depth, as it greatly affects the feature representation capability and computation cost. We conduct experiments with our searched backbone for object detection and demonstrate that our backbone outperforms both manually designed and searched state-of-the-art backbones on the COCO dataset.


title: Quantum computation of nuclear observables involving linear combination of unitary operators

abstract: We present the quantum computation of nuclear observables where the operators of interest are first decomposed in terms of the linear combination of unitaries. Then we utilise the Hadamard test and the linear combination of unitaries (LCU) based methods to compute the expectation values. We apply these methods to calculate the electric quadrupole moment of deuteron. The results are compared for the Jordan-Wigner transformation and Gray code encoding. We discuss the versatility of our approach that can be utilized in general to calculate several observables on a quantum computer.


title: The completeness and separability of function spaces in nonadditive measure theory

abstract: For a nonadditive measure $\mu$, the space $\mathcal{L}^0(\mu)$ of all measurable functions, the Choquet-Lorentz space $\mathcal{L}^{p,q}(\mu)$, the Lorentz space of weak type $\mathcal{L}^{p,\infty}(\mu)$, the space $\mathcal{L}^\infty(\mu)$ of all $\mu$-essentially bounded measurable functions, and their quotient spaces are defined together with suitable prenorms on them. Among those function spaces, the Choquet-Lorentz space is defined by the Choquet integral, while the Lorentz space of weak type is defined by the Shilkret integral. Then the completeness and separability of those spaces are investigated. A new characteristic of nonadditive measures, called property (C), is introduced to establish the Cauchy criterion for convergence in $\mu$-measure of measurable functions. This criterion and suitable convergence theorems of the Choquet and Shilkret integrals provide instruments for carrying out our investigation.


title: On NSOP$_2$ Theories

abstract: Answering a question of D\v{z}amonja and Shelah, we show that every NSOP$_2$ theory is NSOP$_1$.


title: TLETA: Deep Transfer Learning and Integrated Cellular Knowledge for Estimated Time of Arrival Prediction

abstract: Vehicle arrival time prediction has been studied widely. With the emergence of IoT devices and deep learning techniques, estimated time of arrival (ETA) has become a critical component in intelligent transportation systems. Though many tools exist for ETA, ETA for special vehicles, such as ambulances, fire engines, etc., is still challenging due to the limited amount of traffic data for special vehicles. Existing works use one model for all types of vehicles, which can lead to low accuracy. To tackle this, as the first in the field, we propose a deep transfer learning framework TLETA for the driving time prediction. TLETA constructs cellular spatial-temporal knowledge grids for extracting driving patterns, combined with the road network structure embedding to build a deep neural network for ETA. TLETA contains transferable layers to support knowledge transfer between different categories of vehicles. Importantly, our transfer models only train the last layers to map the transferred knowledge, that reduces the training time significantly. The experimental studies show that our model predicts travel time with high accuracy and outperforms many state-of-the-art approaches.


title: A Unified Evaluation of Textual Backdoor Learning: Frameworks and Benchmarks

abstract: Textual backdoor attacks are a kind of practical threat to NLP systems. By injecting a backdoor in the training phase, the adversary could control model predictions via predefined triggers. As various attack and defense models have been proposed, it is of great significance to perform rigorous evaluations. However, we highlight two issues in previous backdoor learning evaluations: (1) The differences between real-world scenarios (e.g. releasing poisoned datasets or models) are neglected, and we argue that each scenario has its own constraints and concerns, thus requires specific evaluation protocols; (2) The evaluation metrics only consider whether the attacks could flip the models' predictions on poisoned samples and retain performances on benign samples, but ignore that poisoned samples should also be stealthy and semantic-preserving. To address these issues, we categorize existing works into three practical scenarios in which attackers release datasets, pre-trained models, and fine-tuned models respectively, then discuss their unique evaluation methodologies. On metrics, to completely evaluate poisoned samples, we use grammar error increase and perplexity difference for stealthiness, along with text similarity for validity. After formalizing the frameworks, we develop an open-source toolkit OpenBackdoor to foster the implementations and evaluations of textual backdoor learning. With this toolkit, we perform extensive experiments to benchmark attack and defense models under the suggested paradigm. To facilitate the underexplored defenses against poisoned datasets, we further propose CUBE, a simple yet strong clustering-based defense baseline. We hope that our frameworks and benchmarks could serve as the cornerstones for future model development and evaluations.


title: ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphs

abstract: Many real-world data can be modeled as 3D graphs, but learning representations that incorporates 3D information completely and efficiently is challenging. Existing methods either use partial 3D information, or suffer from excessive computational cost. To incorporate 3D information completely and efficiently, we propose a novel message passing scheme that operates within 1-hop neighborhood. Our method guarantees full completeness of 3D information on 3D graphs by achieving global and local completeness. Notably, we propose the important rotation angles to fulfill global completeness. Additionally, we show that our method is orders of magnitude faster than prior methods. We provide rigorous proof of completeness and analysis of time complexity for our methods. As molecules are in essence quantum systems, we build the \underline{com}plete and \underline{e}fficient graph neural network (ComENet) by combing quantum inspired basis functions and the proposed message passing scheme. Experimental results demonstrate the capability and efficiency of ComENet, especially on real-world datasets that are large in both numbers and sizes of graphs. Our code is publicly available as part of the DIG library (\url{https://github.com/divelab/DIG}).


title: MetaFed: Federated Learning among Federations with Cyclic Knowledge Distillation for Personalized Healthcare

abstract: Federated learning has attracted increasing attention to building models without accessing the raw user data, especially in healthcare. In real applications, different federations can seldom work together due to possible reasons such as data heterogeneity and distrust/inexistence of the central server. In this paper, we propose a novel framework called MetaFed to facilitate trustworthy FL between different federations. MetaFed obtains a personalized model for each federation without a central server via the proposed Cyclic Knowledge Distillation. Specifically, MetaFed treats each federation as a meta distribution and aggregates knowledge of each federation in a cyclic manner. The training is split into two parts: common knowledge accumulation and personalization. Comprehensive experiments on three benchmarks demonstrate that MetaFed without a server achieves better accuracy compared to state-of-the-art methods (e.g., 10%+ accuracy improvement compared to the baseline for PAMAP2) with fewer communication costs.


title: ECTLO: Effective Continuous-time Odometry Using Range Image for LiDAR with Small FoV

abstract: Prism-based LiDARs are more compact and cheaper than the conventional mechanical multi-line spinning LiDARs, which have become increasingly popular in robotics, recently. However, there are several challenges for these new LiDAR sensors, including small field of view, severe motion distortions, and irregular patterns, which hinder them from being widely used in LiDAR odometry, practically. To tackle these problems, we present an effective continuous-time LiDAR odometry (ECTLO) method for the Risley-prism-based LiDARs with non-repetitive scanning patterns. A single range image covering historical points in LiDAR's small FoV is adopted for efficient map representation. To account for the noisy data from occlusions after map updating, a filter-based point-to-plane Gaussian Mixture Model is used for robust registration. Moreover, a LiDAR-only continuous-time motion model is employed to relieve the inevitable distortions. Extensive experiments have been conducted on various testbeds using the prism-based LiDARs with different scanning patterns, whose promising results demonstrate the efficacy of our proposed approach.


title: Integrated Sensing and Communication with Reconfigurable Intelligent Surfaces: Opportunities, Applications, and Future Directions

abstract: Integrated sensing and communication (ISAC) is emerging as a key enabler to address the growing spectrum congestion problem and satisfy increasing demands for ubiquitous sensing and communication. By sharing various resources and information, ISAC achieves much higher spectral, energy, hardware, and economic efficiencies. Concurrently, reconfigurable intelligent surface (RIS) technology has been deemed as a promising approach due to its capability of intelligently manipulating the wireless propagation environment in an energy and hardware efficient manner. In this article, we analyze the potential of deploying RIS to improve communication and sensing performance in ISAC systems. We first describe the fundamentals of RIS and its applications in traditional communication and sensing systems, then introduce the principles of ISAC and overview existing explorations on RIS-assisted ISAC, followed by one case study to verify the advantages of deploying RIS in ISAC systems. Finally, open challenges and research directions are discussed to stimulate this line of research and pave the way for practical applications.


title: Non-local Coulomb interaction and correlated electronic structure of TaS$_2$: A GW+EDMFT study

abstract: By means of $ab~initio$ computation schemes, we examine the low-energy electronic structure of monolayer TaS$_2$ in its low-temperature commensurate charge-density-wave structure. We estimate and take into account both local and non-local Coulomb correlations within cRPA (constrained random phase approximation) and GW+EDMFT (GW plus extended dynamical mean-field theory) method. Mott nature of its insulating phase is clearly identified. By increasing the level of nonlocal approximation from DMFT ($V=0$) to EDMFT and GW+EDMFT, a systematic change of charge screening effects is clearly observed while its quantitative effect on the electronic structure is small in the realistic Mott state.


title: Thompson Sampling Achieves $\tilde O(\sqrt{T})$ Regret in Linear Quadratic Control

abstract: Thompson Sampling (TS) is an efficient method for decision-making under uncertainty, where an action is sampled from a carefully prescribed distribution which is updated based on the observed data. In this work, we study the problem of adaptive control of stabilizable linear-quadratic regulators (LQRs) using TS, where the system dynamics are unknown. Previous works have established that $\tilde O(\sqrt{T})$ frequentist regret is optimal for the adaptive control of LQRs. However, the existing methods either work only in restrictive settings, require a priori known stabilizing controllers, or utilize computationally intractable approaches. We propose an efficient TS algorithm for the adaptive control of LQRs, TS-based Adaptive Control, TSAC, that attains $\tilde O(\sqrt{T})$ regret, even for multidimensional systems, thereby solving the open problem posed in Abeille and Lazaric (2018). TSAC does not require a priori known stabilizing controller and achieves fast stabilization of the underlying system by effectively exploring the environment in the early stages. Our result hinges on developing a novel lower bound on the probability that the TS provides an optimistic sample. By carefully prescribing an early exploration strategy and a policy update rule, we show that TS achieves order-optimal regret in adaptive control of multidimensional stabilizable LQRs. We empirically demonstrate the performance and the efficiency of TSAC in several adaptive control tasks.


title: CLEAR: A Fully User-side Image Search System

abstract: We use many search engines on the Internet in our daily lives. However, they are not perfect. Their scoring function may not model our intent or they may accept only text queries even though we want to carry out a similar image search. In such cases, we need to make a compromise: We continue to use the unsatisfactory service or leave the service. Recently, a new solution, user-side search systems, has been proposed. In this framework, each user builds their own search system that meets their preference with a user-defined scoring function and user-defined interface. Although the concept is appealing, it is still not clear if this approach is feasible in practice. In this demonstration, we show the first fully user-side image search system, CLEAR, which realizes a similar-image search engine for Flickr. The challenge is that Flickr does not provide an official similar image search engine or corresponding API. Nevertheless, CLEAR realizes it fully on a user-side. CLEAR does not use a backend server at all nor store any images or build search indices. It is in contrast to traditional search algorithms that require preparing a backend server and building a search index. Therefore, each user can easily deploy their own CLEAR engine, and the resulting service is custom-made and privacy-preserving. The online demo is available at https://clear.joisino.net. The source code is available at https://github.com/joisino/clear.


title: VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation

abstract: Benefiting from language flexibility and compositionality, humans naturally intend to use language to command an embodied agent for complex tasks such as navigation and object manipulation. In this work, we aim to fill the blank of the last mile of embodied agents -- object manipulation by following human guidance, e.g., "move the red mug next to the box while keeping it upright." To this end, we introduce an Automatic Manipulation Solver (AMSolver) system and build a Vision-and-Language Manipulation benchmark (VLMbench) based on it, containing various language instructions on categorized robotic manipulation tasks. Specifically, modular rule-based task templates are created to automatically generate robot demonstrations with language instructions, consisting of diverse object shapes and appearances, action types, and motion constraints. We also develop a keypoint-based model 6D-CLIPort to deal with multi-view observations and language input and output a sequence of 6 degrees of freedom (DoF) actions. We hope the new simulator and benchmark will facilitate future research on language-guided robotic manipulation.


title: A Spatio-Temporal Neural Network Forecasting Approach for Emulation of Firefront Models

abstract: Computational simulations of wildfire spread typically employ empirical rate-of-spread calculations under various conditions (such as terrain, fuel type, weather). Small perturbations in conditions can often lead to significant changes in fire spread (such as speed and direction), necessitating a computationally expensive large set of simulations to quantify uncertainty. Model emulation seeks alternative representations of physical models using machine learning, aiming to provide more efficient and/or simplified surrogate models. We propose a dedicated spatio-temporal neural network based framework for model emulation, able to capture the complex behaviour of fire spread models. The proposed approach can approximate forecasts at fine spatial and temporal resolutions that are often challenging for neural network based approaches. Furthermore, the proposed approach is robust even with small training sets, due to novel data augmentation methods. Empirical experiments show good agreement between simulated and emulated firefronts, with an average Jaccard score of 0.76.


title: CDNet: Contrastive Disentangled Network for Fine-Grained Image Categorization of Ocular B-Scan Ultrasound

abstract: Precise and rapid categorization of images in the B-scan ultrasound modality is vital for diagnosing ocular diseases. Nevertheless, distinguishing various diseases in ultrasound still challenges experienced ophthalmologists. Thus a novel contrastive disentangled network (CDNet) is developed in this work, aiming to tackle the fine-grained image categorization (FGIC) challenges of ocular abnormalities in ultrasound images, including intraocular tumor (IOT), retinal detachment (RD), posterior scleral staphyloma (PSS), and vitreous hemorrhage (VH). Three essential components of CDNet are the weakly-supervised lesion localization module (WSLL), contrastive multi-zoom (CMZ) strategy, and hyperspherical contrastive disentangled loss (HCD-Loss), respectively. These components facilitate feature disentanglement for fine-grained recognition in both the input and output aspects. The proposed CDNet is validated on our ZJU Ocular Ultrasound Dataset (ZJUOUSD), consisting of 5213 samples. Furthermore, the generalization ability of CDNet is validated on two public and widely-used chest X-ray FGIC benchmarks. Quantitative and qualitative results demonstrate the efficacy of our proposed CDNet, which achieves state-of-the-art performance in the FGIC task. Code is available at: https://github.com/ZeroOneGame/CDNet-for-OUS-FGIC .


title: Simultaneous Speech Extraction for Multiple Target Speakers under the Meeting Scenarios

abstract: The common target speech separation directly estimate the target source, ignoring the interrelationship between different speakers at each frame. We propose a multiple-target speech separation model (MTSS) to simultaneously extract each speaker's voice from the mixed speech rather than just optimally estimating the target source. Moreover, we propose a speaker diarization (SD) aware MTSS system (SD-MTSS), which consists of a SD module and MTSS module. By exploiting the TSVAD decision and the estimated mask, our SD-MTSS model can extract the speech signal of each speaker concurrently in a conversational recording without additional enrollment audio in advance. Experimental results show that our MTSS model achieves 1.38dB SDR, 1.34dB SI-SDR, and 0.13 PESQ improvements over the baseline on the WSJ0-2mix-extr dataset, respectively. The SD-MTSS system makes 19.2% relative speaker dependent character error rate (CER) reduction on the Alimeeting dataset.


title: k-Sliced Mutual Information: A Quantitative Study of Scalability with Dimension

abstract: Sliced mutual information (SMI) is defined as an average of mutual information (MI) terms between one-dimensional random projections of the random variables. It serves as a surrogate measure of dependence to classic MI that preserves many of its properties but is more scalable to high dimensions. However, a quantitative characterization of how SMI itself and estimation rates thereof depend on the ambient dimension, which is crucial to the understanding of scalability, remain obscure. This work provides a multifaceted account of the dependence of SMI on dimension, under a broader framework termed $k$-SMI, which considers projections to $k$-dimensional subspaces. Using a new result on the continuity of differential entropy in the 2-Wasserstein metric, we derive sharp bounds on the error of Monte Carlo (MC)-based estimates of $k$-SMI, with explicit dependence on $k$ and the ambient dimension, revealing their interplay with the number of samples. We then combine the MC integrator with the neural estimation framework to provide an end-to-end $k$-SMI estimator, for which optimal convergence rates are established. We also explore asymptotics of the population $k$-SMI as dimension grows, providing Gaussian approximation results with a residual that decays under appropriate moment bounds. All our results trivially apply to SMI by setting $k=1$. Our theory is validated with numerical experiments and is applied to sliced InfoGAN, which altogether provide a comprehensive quantitative account of the scalability question of $k$-SMI, including SMI as a special case when $k=1$.


title: Measurement of the branching fraction of $\Xi_{c}^{0}\to \Lambda_{c}^{+}\pi^{-}$ at Belle

abstract: Based on a data sample of 983 fb$^{-1}$ collected with the Belle detector at the KEKB asymmetric-energy $e^+e^-$ collider, we present the study of the heavy-flavor-conserving decay $\Xi_{c}^{0}\to \Lambda_{c}^{+}\pi^{-}$ with $\Lambda_{c}^{+}$ reconstructed via its $pK^{-} \pi^{+}$ decay mode. The branching fraction ratio $\mathcal{B}(\Xi_{c}^{0}\to \Lambda_{c}^{+}\pi^{-})/\mathcal{B}(\Xi_{c}^{0}\to \Xi^{-}\pi^{+})$ is measured to be $0.38 \pm 0.04 \pm 0.04$. Combing with the world average value of $\mathcal{B}(\Xi_{c}^{0}\to \Xi^{-}\pi^{+})$, the branching fraction $\mathcal{B}(\Xi_{c}^{0}\to \Lambda_{c}^{+}\pi^{-})$ is deduced to be $(0.54 \pm 0.05 \pm 0.05 \pm 0.12)\%$. Here, the uncertainties above are statistical, systematic, and from $\mathcal{B}(\Xi_c^{0} \to \Xi^{-}\pi^{+})$, respectively.


title: SafeRL-Kit: Evaluating Efficient Reinforcement Learning Methods for Safe Autonomous Driving

abstract: Safe reinforcement learning (RL) has achieved significant success on risk-sensitive tasks and shown promise in autonomous driving (AD) as well. Considering the distinctiveness of this community, efficient and reproducible baselines are still lacking for safe AD. In this paper, we release SafeRL-Kit to benchmark safe RL methods for AD-oriented tasks. Concretely, SafeRL-Kit contains several latest algorithms specific to zero-constraint-violation tasks, including Safety Layer, Recovery RL, off-policy Lagrangian method, and Feasible Actor-Critic. In addition to existing approaches, we propose a novel first-order method named Exact Penalty Optimization (EPO) and sufficiently demonstrate its capability in safe AD. All algorithms in SafeRL-Kit are implemented (i) under the off-policy setting, which improves sample efficiency and can better leverage past logs; (ii) with a unified learning framework, providing off-the-shelf interfaces for researchers to incorporate their domain-specific knowledge into fundamental safe RL methods. Conclusively, we conduct a comparative evaluation of the above algorithms in SafeRL-Kit and shed light on their efficacy for safe autonomous driving. The source code is available at \href{ https://github.com/zlr20/saferl_kit}{this https URL}.


title: Accelerating Shapley Explanation via Contributive Cooperator Selection

abstract: Even though Shapley value provides an effective explanation for a DNN model prediction, the computation relies on the enumeration of all possible input feature coalitions, which leads to the exponentially growing complexity. To address this problem, we propose a novel method SHEAR to significantly accelerate the Shapley explanation for DNN models, where only a few coalitions of input features are involved in the computation. The selection of the feature coalitions follows our proposed Shapley chain rule to minimize the absolute error from the ground-truth Shapley values, such that the computation can be both efficient and accurate. To demonstrate the effectiveness, we comprehensively evaluate SHEAR across multiple metrics including the absolute error from the ground-truth Shapley value, the faithfulness of the explanations, and running speed. The experimental results indicate SHEAR consistently outperforms state-of-the-art baseline methods across different evaluation metrics, which demonstrates its potentials in real-world applications where the computational resource is limited.


title: GDsmith: Detecting Bugs in Graph Database Engines

abstract: Graph database engines stand out in the era of big data for their efficiency of modeling and processing linked data. There is a strong need of testing graph database engines. However, random testing, the most practical way of automated test generation, faces the challenges of semantic validity, non-empty result, and behavior diversity to detect bugs in graph database engines. To address these challenges, in this paper, we propose GDsmith, the first black-box approach for testing graph database engines. It ensures that each randomly generated Cypher query satisfies the semantic requirements via skeleton generation and completion. GDsmith includes our technique to increase the probability of producing Cypher queries that return non-empty results by leveraging three types of structural mutation strategies. GDsmith also includes our technique to improve the behavior diversity of the generated Cypher queries by selecting property keys according to their previous frequencies when generating new queries. Our evaluation results demonstrate that GDsmith is effective and efficient for automated query generation and substantially outperforms the baseline. GDsmith successfully detects 27 previously unknown bugs on the released versions of three popular open-source graph database engines and receive positive feedback from their developers.


title: Reframed GES with a Neural Conditional Dependence Measure

abstract: In a nonparametric setting, the causal structure is often identifiable only up to Markov equivalence, and for the purpose of causal inference, it is useful to learn a graphical representation of the Markov equivalence class (MEC). In this paper, we revisit the Greedy Equivalence Search (GES) algorithm, which is widely cited as a score-based algorithm for learning the MEC of the underlying causal structure. We observe that in order to make the GES algorithm consistent in a nonparametric setting, it is not necessary to design a scoring metric that evaluates graphs. Instead, it suffices to plug in a consistent estimator of a measure of conditional dependence to guide the search. We therefore present a reframing of the GES algorithm, which is more flexible than the standard score-based version and readily lends itself to the nonparametric setting with a general measure of conditional dependence. In addition, we propose a neural conditional dependence (NCD) measure, which utilizes the expressive power of deep neural networks to characterize conditional independence in a nonparametric manner. We establish the optimality of the reframed GES algorithm under standard assumptions and the consistency of using our NCD estimator to decide conditional independence. Together these results justify the proposed approach. Experimental results demonstrate the effectiveness of our method in causal discovery, as well as the advantages of using our NCD measure over kernel-based measures.


title: Quantum Dynamics of Magnetic Skyrmions: Consistent Path Integral Formulation

abstract: We present a path integral formalism for the intrinsic quantum dynamics of magnetic skyrmions coupled to a thermal background of magnetic fluctuations. Upon promoting the skyrmion's collective coordinate $\boldsymbol{R}$ to a dynamic variable and integrating out the magnonic heat bath, we derive the generalized equation of motion for $\boldsymbol{R}$ with a non-local damping term that describes a steady-state skyrmion dynamics at finite temperatures. Being essentially temperature dependent, the intrinsic damping is shown to originate from the coupling of thermally activated magnon modes to the adiabatic potential driven by a rigid skyrmion motion, which can be regarded as another manifestation of emergent electrodynamics inherent to topological magnetic textures. We further argue that the diagonal components of the damping term act as the source of dissipation and inertia, while its off-diagonal components modify the gyrotropic motion of a magnetic skyrmion. By means of numerical calculations for the lattice spin model of chiral ferromagnets, we study the temperature behavior of the intrinsic damping as a function of magnetic field in periodic and confined geometries. The intrinsic damping is demonstrated to be highly non-local, revealing its quantum-mechanical nature, that becomes more pronounced with increasing temperature. At high temperatures when the magnon occupation factors are large, the intrinsic damping is shown to yield a modified Thiele's equation with the additional non-local dissipative and mass terms that exhibit an almost linear temperature behavior. Our results provide a microscopic background for semiclassical magnetization dynamics and establish a framework for understanding spin caloritronics effects in topological magnetic textures.


title: Picotesla magnetometry of microwave fields with diamond sensors

abstract: Developing robust microwave-field sensors is both fundamentally and practically important with a wide range of applications from astronomy to communication engineering. The Nitrogen-Vacancy (NV) center in diamond is an attractive candidate for such purpose because of its magnetometric sensitivity, stability and compatibility with ambient conditions. However, the existing NV center-based magnetometers have limited sensitivity in the microwave band. Here we present a continuous heterodyne detection method that can enhance the sensor's response to weak microwaves, even in the absence of spin controls. Experimentally, we achieve a sensitivity of 8.9 pT$\cdot$Hz$^{-1/2}$ for microwaves of 2.9 GHz by simultaneously using an ensemble of $n_{\text{NV}} \sim 2.8\times10^{13}$ NV centers within a sensor volume of $4\times10^{-2}$ mm$^3$. Besides, we also achieve $1/t$ scaling of frequency resolution up to measurement time $t$ of 10000 s. Our method removes the control pulses and thus will greatly benefit the practical application of diamond-based microwave sensors.


title: Disintegrations of non-hyperbolic ergodic measures along the center foliation of DA maps

abstract: We show that each non-hyperbolic ergodic measure of a partially hyperbolic diffeomorphism on $\mathbb{T}^3$ which is homotopic to Anosov admits a full measure subset which intersects each center leaf in at most two points.


title: A halo of trapped interstellar matter surrounding the solar system

abstract: This paper shows that gravitating bodies travelling through the Galaxy can trap lighter interstellar particles that pass nearby with small relative velocities onto temporarily-bound orbits. The capture mechanism is driven by the Galactic tidal field, which can decelerate infalling objects to a degree where their binding energy becomes negative. Over time, trapped particles build a local overdensity -- or `halo'-- that reaches a steady state as the number of particles being captured equals that being tidally stripped. This paper uses classical stochastic techniques to calculate the capture rate and the phase-space distribution of particles trapped by a point-mass. In a steady state, bound particles generate a density enhancement that scales as $\delta(r)\sim r^{-3/2}$ (a.k.a `density spike') and follow a velocity dispersion profile $\sigma_h(r)\sim r^{-1/2}$. Collisionless $N$-body experiments show excellent agreement with these theoretical predictions within a distance range $r\gtrsim r_\epsilon$, where $r_\epsilon\simeq 0.8\,\exp[-V_\star^2/(2\sigma^2)]\,Gm_\star/\sigma^2$ is the thermal critical radius of a point-mass $m_\star$ moving with a speed $V_\star$ through a sea of particles with a velocity dispersion $\sigma$. Preliminary estimates that ignore collisions with planets and Galactic substructures suggest that the solar system may be surrounded by a halo that contains the order of $N^{\rm ISO}(<0.1\,{\rm pc})\sim 10^7$ energetically-bound 'Oumuamua-like objects, and a dark matter mass of $M^{\rm DM}(<0.1\,{\rm pc})\sim 10^{-13}M_\odot$. The presence of trapped interstellar matter in the solar system can affect current estimates on the size of the Oort Cloud, and leave a distinct signal in direct dark matter detection experiments.


title: Low-latency Mini-batch GNN Inference on CPU-FPGA Heterogeneous Platform

abstract: Mini-batch inference of Graph Neural Networks (GNNs) is a key problem in many real-world applications. Recently, a GNN design principle of model depth-receptive field decoupling has been proposed to address the well-known issue of neighborhood explosion. Decoupled GNN models achieve higher accuracy than original models and demonstrate excellent scalability for mini-batch inference. We map Decoupled GNNs onto CPU-FPGA heterogeneous platforms to achieve low-latency mini-batch inference. On the FPGA platform, we design a novel GNN hardware accelerator with an adaptive datapath denoted Adaptive Computation Kernel (ACK) that can execute various computation kernels of GNNs with low-latency: (1) for dense computation kernels expressed as matrix multiplication, ACK works as a systolic array with fully localized connections, (2) for sparse computation kernels, ACK follows the scatter-gather paradigm and works as multiple parallel pipelines to support the irregular connectivity of graphs. The proposed task scheduling hides the CPU-FPGA data communication overhead to reduce the inference latency. We develop a fast design space exploration algorithm to generate a single accelerator for multiple target GNN models. We implement our accelerator on a state-of-the-art CPU-FPGA platform and evaluate the performance using three representative models (GCN, GraphSAGE, and GAT). Results show that our CPU-FPGA implementation achieves $21.4-50.8\times$, $2.9-21.6\times$, $4.7\times$ latency reduction compared with state-of-the-art implementations on CPU-only, CPU-GPU and CPU-FPGA platforms.


title: Large-Margin Representation Learning for Texture Classification

abstract: This paper presents a novel approach combining convolutional layers (CLs) and large-margin metric learning for training supervised models on small datasets for texture classification. The core of such an approach is a loss function that computes the distances between instances of interest and support vectors. The objective is to update the weights of CLs iteratively to learn a representation with a large margin between classes. Each iteration results in a large-margin discriminant model represented by support vectors based on such a representation. The advantage of the proposed approach w.r.t. convolutional neural networks (CNNs) is two-fold. First, it allows representation learning with a small amount of data due to the reduced number of parameters compared to an equivalent CNN. Second, it has a low training cost since the backpropagation considers only support vectors. The experimental results on texture and histopathologic image datasets have shown that the proposed approach achieves competitive accuracy with lower computational cost and faster convergence when compared to equivalent CNNs.


title: Mass matrices with CP phase in modular flavor symmetry

abstract: We study the CP violation and the CP phase of quark mass matrices in modular flavor symmetric models. The CP symmetry remains at $\tau = e^{2 \pi i/3}$ by a combination of the $T$-symmetry of the modular symmetry. However, the $T$-symmetry breaking may lead to the CP violation at the fixed point $\tau = e^{2 \pi i/3}$. We study such a possibility in magnetized orbifold models as examples of modular flavor symmetric models. These models, in general, have more than one candidates for Higgs modes, while generic string compactifications also lead to several Higgs modes. These Higgs modes have different behaviors under the $T$-transformation. The light Higgs mode can be a linear combination of those modes so as to lead to realistic quark mass matrices. The CP phase of mass matrix does not appear in a certain case, which is determined by the $T$-transformation behavior. Deviation from it is important to realize the physical CP phase. We discuss an example leading to non-vanishing CP phase at the fixed point $\tau = e^{2 \pi i/3}$.


title: K-stable divisors in $\mathbb{P}^1\times\mathbb{P}^1\times\mathbb{P}^2$ of degree $(1,1,2)$

abstract: We prove that every smooth divisor in $\mathbb{P}^1\times\mathbb{P}^1\times\mathbb{P}^2$ of degree $(1,1,2)$ is K-stable.


title: The Origin of Weakened Magnetic Braking in Old Solar Analogs

abstract: The rotation rates of main-sequence stars slow over time as they gradually lose angular momentum to their magnetized stellar winds. The rate of angular momentum loss depends on the strength and morphology of the magnetic field, the mass-loss rate, and the stellar rotation period, mass, and radius. Previous observations suggested a shift in magnetic morphology between two F-type stars with similar rotation rates but very different ages (88 Leo and rho CrB). In this Letter, we identify a comparable transition in an evolutionary sequence of solar analogs with ages between 2-7 Gyr. We present new spectropolarimetry of 18 Sco and 16 Cyg A & B from the Large Binocular Telescope, and we reanalyze previously published Zeeman Doppler images of HD 76151 and 18 Sco, providing additional constraints on the nature and timing of this transition. We combine archival X-ray observations with updated distances from Gaia to estimate mass-loss rates, and we adopt precise stellar properties from asteroseismology and other sources. We then calculate the wind braking torque for each star in the evolutionary sequence, demonstrating that the rate of angular momentum loss drops by more than an order of magnitude between the ages of HD 76151 and 18 Sco (2.6-3.7 Gyr) and continues to decrease modestly to the age of 16 Cyg A & B (7 Gyr). We suggest that this magnetic transition may represent a disruption of the global dynamo arising from weaker differential rotation, and we outline plans to probe this phenomenon in additional stars spanning a wide range of spectral types.


title: Ensemble distributional forecasting for insurance loss reserving

abstract: Loss reserving generally focuses on identifying a single model that can generate superior predictive performance. However, different loss reserving models specialise in capturing different aspects of loss data. This is recognised in practice in the sense that results from different models are often considered, and sometimes combined. For instance, actuaries may take a weighted average of the prediction outcomes from various loss reserving models, often based on subjective assessments. In this paper, we propose a systematic framework to objectively combine (i.e. ensemble) multiple _stochastic_ loss reserving models such that the strengths offered by different models can be utilised effectively. Our framework contains two main innovations compared to existing literature and practice. Firstly, our criteria model combination considers the full distributional properties of the ensemble and not just the central estimate - which is of particular importance in the reserving context. Secondly, our framework is that it is tailored for the features inherent to reserving data. These include, for instance, accident, development, calendar, and claim maturity effects. Crucially, the relative importance and scarcity of data across accident periods renders the problem distinct from the traditional ensembling techniques in statistical learning. Our framework is illustrated with a complex synthetic dataset. In the results, the optimised ensemble outperforms both (i) traditional model selection strategies, and (ii) an equally weighted ensemble. In particular, the improvement occurs not only with central estimates but also relevant quantiles, such as the 75th percentile of reserves (typically of interest to both insurers and regulators). The framework developed in this paper can be implemented thanks to an R package, `ADLP`, which is available from CRAN.


title: Strategic Representation

abstract: Humans have come to rely on machines for reducing excessive information to manageable representations. But this reliance can be abused -- strategic machines might craft representations that manipulate their users. How can a user make good choices based on strategic representations? We formalize this as a learning problem, and pursue algorithms for decision-making that are robust to manipulation. In our main setting of interest, the system represents attributes of an item to the user, who then decides whether or not to consume. We model this interaction through the lens of strategic classification (Hardt et al. 2016), reversed: the user, who learns, plays first; and the system, which responds, plays second. The system must respond with representations that reveal `nothing but the truth' but need not reveal the entire truth. Thus, the user faces the problem of learning set functions under strategic subset selection, which presents distinct algorithmic and statistical challenges. Our main result is a learning algorithm that minimizes error despite strategic representations, and our theoretical analysis sheds light on the trade-off between learning effort and susceptibility to manipulation.


title: Multi-Classification of Brain Tumor Images Using Transfer Learning Based Deep Neural Network

abstract: In recent advancement towards computer based diagnostics system, the classification of brain tumor images is a challenging task. This paper mainly focuses on elevating the classification accuracy of brain tumor images with transfer learning based deep neural network. The classification approach is started with the image augmentation operation including rotation, zoom, hori-zontal flip, width shift, height shift, and shear to increase the diversity in image datasets. Then the general features of the input brain tumor images are extracted based on a pre-trained transfer learning method comprised of Inception-v3. Fi-nally, the deep neural network with 4 customized layers is employed for classi-fying the brain tumors in most frequent brain tumor types as meningioma, glioma, and pituitary. The proposed model acquires an effective performance with an overall accuracy of 96.25% which is much improved than some existing multi-classification methods. Whereas, the fine-tuning of hyper-parameters and inclusion of customized DNN with the Inception-v3 model results in an im-provement of the classification accuracy.


title: Bio-inspired Intelligence with Applications to Robotics: A Survey

abstract: In the past decades, considerable attention has been paid to bio-inspired intelligence and its applications to robotics. This paper provides a comprehensive survey of bio-inspired intelligence, with a focus on neurodynamics approaches, to various robotic applications, particularly to path planning and control of autonomous robotic systems. Firstly, the bio-inspired shunting model and its variants (additive model and gated dipole model) are introduced, and their main characteristics are given in detail. Then, two main neurodynamics applications to real-time path planning and control of various robotic systems are reviewed. A bio-inspired neural network framework, in which neurons are characterized by the neurodynamics models, is discussed for mobile robots, cleaning robots, and underwater robots. The bio-inspired neural network has been widely used in real-time collision-free navigation and cooperation without any learning procedures, global cost functions, and prior knowledge of the dynamic environment. In addition, bio-inspired backstepping controllers for various robotic systems, which are able to eliminate the speed jump when a large initial tracking error occurs, are further discussed. Finally, the current challenges and future research directions are discussed in this paper.


title: NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Rates

abstract: Conventionally, audio super-resolution models fixed the initial and the target sampling rates, which necessitate the model to be trained for each pair of sampling rates. We introduce NU-Wave 2, a diffusion model for neural audio upsampling that enables the generation of 48 kHz audio signals from inputs of various sampling rates with a single model. Based on the architecture of NU-Wave, NU-Wave 2 uses short-time Fourier convolution (STFC) to generate harmonics to resolve the main failure modes of NU-Wave, and incorporates bandwidth spectral feature transform (BSFT) to condition the bandwidths of inputs in the frequency domain. We experimentally demonstrate that NU-Wave 2 produces high-resolution audio regardless of the sampling rate of input while requiring fewer parameters than other models. The official code and the audio samples are available at https://mindslab-ai.github.io/nuwave2.


title: Enriched purity and presentability in Banach spaces

abstract: The category $Ban$ of Banach spaces and linear maps of norm $\leq 1$ is locally $\aleph_1$-presentable but not locally finitely presentable. We prove, however, that $Ban$ is locally finitely presentable in the enriched sense over complete metric spaces. Moreover, in this sense, pure morphisms are just ideals of Banach spaces. We characterize classes of Banach spaces approximately injective to sets of morphisms having finite-dimensional domains and separable codomains.


title: Texture Generation Using A Graph Generative Adversarial Network And Differentiable Rendering

abstract: Novel photo-realistic texture synthesis is an important task for generating novel scenes, including asset generation for 3D simulations. However, to date, these methods predominantly generate textured objects in 2D space. If we rely on 2D object generation, then we need to make a computationally expensive forward pass each time we change the camera viewpoint or lighting. Recent work that can generate textures in 3D requires 3D component segmentation that is expensive to acquire. In this work, we present a novel conditional generative architecture that we call a graph generative adversarial network (GGAN) that can generate textures in 3D by learning object component information in an unsupervised way. In this framework, we do not need an expensive forward pass whenever the camera viewpoint or lighting changes, and we do not need expensive 3D part information for training, yet the model can generalize to unseen 3D meshes and generate appropriate novel 3D textures. We compare this approach against state-of-the-art texture generation methods and demonstrate that the GGAN obtains significantly better texture generation quality (according to Frechet inception distance). We release our model source code as open source.


title: Some theorems on colocally connected continua

abstract: We show that each refinable map preserves colocal connectedness of the domain while a proximately refinable map does not necessarily. Also, we prove that colocal connectedness is a Whitney property and is not a Whitney reversible property.


title: Rarity Score : A New Metric to Evaluate the Uncommonness of Synthesized Images

abstract: Evaluation metrics in image synthesis play a key role to measure performances of generative models. However, most metrics mainly focus on image fidelity. Existing diversity metrics are derived by comparing distributions, and thus they cannot quantify the diversity or rarity degree of each generated image. In this work, we propose a new evaluation metric, called `rarity score', to measure the individual rarity of each image synthesized by generative models. We first show empirical observation that common samples are close to each other and rare samples are far from each other in nearest-neighbor distances of feature space. We then use our metric to demonstrate that the extent to which different generative models produce rare images can be effectively compared. We also propose a method to compare rarities between datasets that share the same concept such as CelebA-HQ and FFHQ. Finally, we analyze the use of metrics in different designs of feature spaces to better understand the relationship between feature spaces and resulting sparse images. Code will be publicly available online for the research community.


title: Catenoid limits of singly periodic minimal surfaces with Scherk-type ends

abstract: We construct families of embedded, singly periodic minimal surfaces of any genus $g$ in the quotient with any even number $2n>2$ of almost parallel Scherk ends. A surface in such a family looks like $n$ parallel planes connected by $n-1+g$ small catenoid necks. In the limit, the family converges to an $n$-sheeted vertical plane with $n-1+g$ singular points termed nodes in the quotient. For the nodes to open up into catenoid necks, their locations must satisfy a set of balance equations whose solutions are given by the roots of Stieltjes polynomials.


title: Stability of a flattened dipolar binary condensate: emergence of the spin roton

abstract: We develop theory for a two-component miscible dipolar condensate in a planar trap. Using numerical solutions and a variational theory we solve for the excitation spectrum and identify regimes where density- and spin-roton excitations are favored. We characterize the various instabilities that can emerge in this system over a wide parameter regime and present results for the stability phase diagram. Importantly this allows us to identify the parameter regimes where a novel roton-immiscibility transition can occur, driven by the softening of the spin roton excitation.


title: Semilinear Dirichlet problem for subordinate spectral Laplacian

abstract: We study semilinear problems in bounded $C^{1,1}$ domains for non-local operators with a boundary condition. The operators cover and extend the case of the spectral fractional Laplacian. We also study harmonic functions with respect to the non-local operator and boundary behaviour of Green and Poisson potentials.


title: Discovery of double Hall pattern associated with collisionless magnetic reconnection in dusty plasmas

abstract: Magnetic reconnection is prevalent in magnetized plasmas in space and laboratories. Despite significant investigations on reconnection in electron-ion plasmas, studies of reconnection in magnetized plasmas with negatively charged dust grains are quite sparse. Here we report the first fully kinetic simulations of collisionless reconnection in a three-species (i.e., electron, proton, and negatively charged dust grain) dusty plasma, through which the discovery of double Hall pattern is made. The double Hall pattern consists of a traditional Hall quadruple current in between the ion and electron diffusion region, and a reversed Hall current in between the boundary of the ion and dust diffusion region. The analysis of the reconnection rate is also given. This study may be applicable to explain observations of planetary magnetospheres and the astrophysical objects, and may be realized in the laboratory studies of dusty plasmas.


title: Study of the resonance structures in $e^{+}e^{-} \rightarrow \pi^{+}\pi^{-}J/\psi$ process

abstract: Using about 23 $\mathrm{fb^{-1}}$ of data collected with the BESIII detector operating at the BEPCII storage ring, a precise measurement of the $e^{+}e^{-} \rightarrow \pi^{+}\pi^{-}J/\psi$ Born cross section is performed at center-of-mass energies from 3.7730 to 4.7008 GeV. Two structures, identified as the $Y(4220)$ and the $Y(4320)$ states, are observed in the energy-dependent cross section with a significance larger than $10\sigma$. The masses and widths of the two structures are determined to be ($M, \Gamma$) = ($4221.4\pm1.5\pm2.0$ MeV/$c^{2}$, $41.8\pm2.9\pm2.7$ MeV) and ($M, \Gamma$) = ($4298\pm12\pm26$ MeV/$c^{2}$, $127\pm17\pm10$ MeV), respectively. A small enhancement around 4.5 GeV with a significance about $3\sigma$, compatible with the $\psi(4415)$, might also indicate the presence of an additional resonance in the spectrum. The inclusion of this additional contribution in the fit to the cross section affects the resonance parameters of the $Y(4320)$ state.


title: SOS: Score-based Oversampling for Tabular Data

abstract: Score-based generative models (SGMs) are a recent breakthrough in generating fake images. SGMs are known to surpass other generative models, e.g., generative adversarial networks (GANs) and variational autoencoders (VAEs). Being inspired by their big success, in this work, we fully customize them for generating fake tabular data. In particular, we are interested in oversampling minor classes since imbalanced classes frequently lead to sub-optimal training outcomes. To our knowledge, we are the first presenting a score-based tabular data oversampling method. Firstly, we re-design our own score network since we have to process tabular data. Secondly, we propose two options for our generation method: the former is equivalent to a style transfer for tabular data and the latter uses the standard generative policy of SGMs. Lastly, we define a fine-tuning method, which further enhances the oversampling quality. In our experiments with 6 datasets and 10 baselines, our method outperforms other oversampling methods in all cases.


title: Thompson Sampling for Robust Transfer in Multi-Task Bandits

abstract: We study the problem of online multi-task learning where the tasks are performed within similar but not necessarily identical multi-armed bandit environments. In particular, we study how a learner can improve its overall performance across multiple related tasks through robust transfer of knowledge. While an upper confidence bound (UCB)-based algorithm has recently been shown to achieve nearly-optimal performance guarantees in a setting where all tasks are solved concurrently, it remains unclear whether Thompson sampling (TS) algorithms, which have superior empirical performance in general, share similar theoretical properties. In this work, we present a TS-type algorithm for a more general online multi-task learning protocol, which extends the concurrent setting. We provide its frequentist analysis and prove that it is also nearly-optimal using a novel concentration inequality for multi-task data aggregation at random stopping times. Finally, we evaluate the algorithm on synthetic data and show that the TS-type algorithm enjoys superior empirical performance in comparison with the UCB-based algorithm and a baseline algorithm that performs TS for each individual task without transfer.


title: COVID-19 Detection using Transfer Learning with Convolutional Neural Network

abstract: The Novel Coronavirus disease 2019 (COVID-19) is a fatal infectious disease, first recognized in December 2019 in Wuhan, Hubei, China, and has gone on an epidemic situation. Under these circumstances, it became more important to detect COVID-19 in infected people. Nowadays, the testing kits are gradually lessening in number compared to the number of infected population. Under recent prevailing conditions, the diagnosis of lung disease by analyzing chest CT (Computed Tomography) images has become an important tool for both diagnosis and prophecy of COVID-19 patients. In this study, a Transfer learning strategy (CNN) for detecting COVID-19 infection from CT images has been proposed. In the proposed model, a multilayer Convolutional neural network (CNN) with Transfer learning model Inception V3 has been designed. Similar to CNN, it uses convolution and pooling to extract features, but this transfer learning model contains weights of dataset Imagenet. Thus it can detect features very effectively which gives it an upper hand for achieving better accuracy.


title: How You Start Matters for Generalization

abstract: Characterizing the remarkable generalization properties of over-parameterized neural networks remains an open problem. In this paper, we promote a shift of focus towards initialization rather than neural architecture or (stochastic) gradient descent to explain this implicit regularization. Through a Fourier lens, we derive a general result for the spectral bias of neural networks and show that the generalization of neural networks is heavily tied to their initialization. Further, we empirically solidify the developed theoretical insights using practical, deep networks. Finally, we make a case against the controversial flat-minima conjecture and show that Fourier analysis grants a more reliable framework for understanding the generalization of neural networks.


title: Hausdorff and box dimension of self-affine set in non-Archimedean field

abstract: In this paper we consider affine iterated function systems in locally compact non-Archimedean field $\mathbb{F}$. We establish the theory of singular value composition in $\mathbb{F}$ and compute box and Hausdorff dimension of self-affine set in $\mathbb{F}^n$, in generic sense, which is an analogy of Falconer's result for real case. The result has the advantage that no additional assumptions needed to be imposed on the norms of linear parts of affine transformation while such norms are strictly less than $\frac{1}{2}$ for real case, which benefits from the non-Archimedean metric on $\mathbb{F}$.


title: A matter wave Rarity-Tapster interferometer to demonstrate non-locality

abstract: We present an experimentally viable approach to demonstrating quantum non-locality in a matter wave system via a Rarity-Tapster interferometer using two $s$-wave scattering halos generated by colliding helium Bose-Einstein condensates. The theoretical basis for this method is discussed, and its suitability is experimentally quantified. As a proof of concept, we demonstrate an interferometric visibility of $V=0.42(9)$, corresponding to a maximum CSHS-Bell parameter of $S=1.1(1)$, for the Clauser-Horne-Shimony-Holt (CHSH) version of the Bell inequality, between atoms separated by $\sim 4$ correlation lengths. This constitutes a significant step towards a demonstration of a Bell inequality violation for motional degrees of freedom of massive particles and possible measurements of quantum effects in a gravitationally sensitive system.


title: Boosting Graph Structure Learning with Dummy Nodes

abstract: With the development of graph kernels and graph representation learning, many superior methods have been proposed to handle scalability and oversmoothing issues on graph structure learning. However, most of those strategies are designed based on practical experience rather than theoretical analysis. In this paper, we use a particular dummy node connecting to all existing vertices without affecting original vertex and edge properties. We further prove that such the dummy node can help build an efficient monomorphic edge-to-vertex transform and an epimorphic inverse to recover the original graph back. It also indicates that adding dummy nodes can preserve local and global structures for better graph representation learning. We extend graph kernels and graph neural networks with dummy nodes and conduct experiments on graph classification and subgraph isomorphism matching tasks. Empirical results demonstrate that taking graphs with dummy nodes as input significantly boosts graph structure learning, and using their edge-to-vertex graphs can also achieve similar results. We also discuss the gain of expressive power from the dummy in neural networks.


title: Magnetism and Superconductivity in Hydrogenated Graphite Foils

abstract: Unique to certain unconventional superconductors is the coexistence of magnetism and superconductivity. We have previously found ferromagnetism and superconductivity in hydrogenated graphitic materials. Herein we present similar as well as completely new findings this time applicable to hydrogenated graphite foils. As the strength of the magnetic field is increased, the temperature-dependent magnetization shows several important transitions. From a Neel paramagnetic-antiferromagnetic transition, to a ferromagnetic superconductor state, to an orbital paramagnetic glass high-temperature superconductor with critical temperature for the dominant phase at Tc = 50 to 60 K. The ferromagnetic state is observed up to room temperature. Thus, the magnetism of hydrogenated low-density carbon graphite foils plays an important role in establishing electronic correlations of which some are superconducting in nature.


title: Axial vectors in DarkCast

abstract: In this work, we explore new spin-1 states with axial couplings to the standard model fermions. We develop a data-driven method to estimate their hadronic decay rates based on data from $\tau$ decays and using SU(3)$_{\rm flavor}$ symmetry. We derive the current and future experimental constraints for several benchmark models. Our framework is generic and can be used for models with arbitrary vectorial and axial couplings to quarks. We have made our calculations publicly available by incorporating them into the DarkCast package, see https://gitlab.com/darkcast/releases.


title: MET: Masked Encoding for Tabular Data

abstract: We consider the task of self-supervised representation learning (SSL) for tabular data: tabular-SSL. Typical contrastive learning based SSL methods require instance-wise data augmentations which are difficult to design for unstructured tabular data. Existing tabular-SSL methods design such augmentations in a relatively ad-hoc fashion and can fail to capture the underlying data manifold. Instead of augmentations based approaches for tabular-SSL, we propose a new reconstruction based method, called Masked Encoding for Tabular Data (MET), that does not require augmentations. MET is based on the popular MAE approach for vision-SSL [He et al., 2021] and uses two key ideas: (i) since each coordinate in a tabular dataset has a distinct meaning, we need to use separate representations for all coordinates, and (ii) using an adversarial reconstruction loss in addition to the standard one. Empirical results on five diverse tabular datasets show that MET achieves a new state of the art (SOTA) on all of these datasets and improves up to 9% over current SOTA methods. We shed more light on the working of MET via experiments on carefully designed simple datasets.


title: Identifying Counterfeit Products using Blockchain Technology in Supply Chain System

abstract: With the advent of globalization and the evergrowing rate of technology, the volume of production as well as ease of procuring counterfeit goods has become unprecedented. Be it food, drug or luxury items, all kinds of industrial manufacturers and distributors are now seeking greater transparency in supply chain operations with a view to deter counterfeiting. This paper introduces a decentralized Blockchain based application system (DApp) with a view to identifying counterfeit products in the supply chain system. With the rapid rise of Blockchain technology, it has become known that data recorded within Blockchain is immutable and secure. Hence, the proposed project here uses this concept to handle the transfer of ownership of products. A consumer can verify the product distribution and ownership information scanning a Quick Response (QR) code generated by the DApp for each product linked to the Blockchain.


title: Active Data Discovery: Mining Unknown Data using Submodular Information Measures

abstract: Active Learning is a very common yet powerful framework for iteratively and adaptively sampling subsets of the unlabeled sets with a human in the loop with the goal of achieving labeling efficiency. Most real world datasets have imbalance either in classes and slices, and correspondingly, parts of the dataset are rare. As a result, there has been a lot of work in designing active learning approaches for mining these rare data instances. Most approaches assume access to a seed set of instances which contain these rare data instances. However, in the event of more extreme rareness, it is reasonable to assume that these rare data instances (either classes or slices) may not even be present in the seed labeled set, and a critical need for the active learning paradigm is to efficiently discover these rare data instances. In this work, we provide an active data discovery framework which can mine unknown data slices and classes efficiently using the submodular conditional gain and submodular conditional mutual information functions. We provide a general algorithmic framework which works in a number of scenarios including image classification and object detection and works with both rare classes and rare slices present in the unlabeled set. We show significant accuracy and labeling efficiency gains with our approach compared to existing state-of-the-art active learning approaches for actively discovering these rare classes and slices.


title: Rectify ViT Shortcut Learning by Visual Saliency

abstract: Shortcut learning is common but harmful to deep learning models, leading to degenerated feature representations and consequently jeopardizing the model's generalizability and interpretability. However, shortcut learning in the widely used Vision Transformer framework is largely unknown. Meanwhile, introducing domain-specific knowledge is a major approach to rectifying the shortcuts, which are predominated by background related factors. For example, in the medical imaging field, eye-gaze data from radiologists is an effective human visual prior knowledge that has the great potential to guide the deep learning models to focus on meaningful foreground regions of interest. However, obtaining eye-gaze data is time-consuming, labor-intensive and sometimes even not practical. In this work, we propose a novel and effective saliency-guided vision transformer (SGT) model to rectify shortcut learning in ViT with the absence of eye-gaze data. Specifically, a computational visual saliency model is adopted to predict saliency maps for input image samples. Then, the saliency maps are used to distil the most informative image patches. In the proposed SGT, the self-attention among image patches focus only on the distilled informative ones. Considering this distill operation may lead to global information lost, we further introduce, in the last encoder layer, a residual connection that captures the self-attention across all the image patches. The experiment results on four independent public datasets show that our SGT framework can effectively learn and leverage human prior knowledge without eye gaze data and achieves much better performance than baselines. Meanwhile, it successfully rectifies the harmful shortcut learning and significantly improves the interpretability of the ViT model, demonstrating the promise of transferring human prior knowledge derived visual saliency in rectifying shortcut learning


title: Multi-Contextual Predictions with Vision Transformer for Video Anomaly Detection

abstract: Video Anomaly Detection(VAD) has been traditionally tackled in two main methodologies: the reconstruction-based approach and the prediction-based one. As the reconstruction-based methods learn to generalize the input image, the model merely learns an identity function and strongly causes the problem called generalizing issue. On the other hand, since the prediction-based ones learn to predict a future frame given several previous frames, they are less sensitive to the generalizing issue. However, it is still uncertain if the model can learn the spatio-temporal context of a video. Our intuition is that the understanding of the spatio-temporal context of a video plays a vital role in VAD as it provides precise information on how the appearance of an event in a video clip changes. Hence, to fully exploit the context information for anomaly detection in video circumstances, we designed the transformer model with three different contextual prediction streams: masked, whole and partial. By learning to predict the missing frames of consecutive normal frames, our model can effectively learn various normality patterns in the video, which leads to a high reconstruction error at the abnormal cases that are unsuitable to the learned context. To verify the effectiveness of our approach, we assess our model on the public benchmark datasets: USCD Pedestrian 2, CUHK Avenue and ShanghaiTech and evaluate the performance with the anomaly score metric of reconstruction error. The results demonstrate that our proposed approach achieves a competitive performance compared to the existing video anomaly detection methods.


title: Bootstrapped Transformer for Offline Reinforcement Learning

abstract: Offline reinforcement learning (RL) aims at learning policies from previously collected static trajectory data without interacting with the real environment. Recent works provide a novel perspective by viewing offline RL as a generic sequence generation problem, adopting sequence models such as Transformer architecture to model distributions over trajectories, and repurposing beam search as a planning algorithm. However, the training datasets utilized in general offline RL tasks are quite limited and often suffer from insufficient distribution coverage, which could be harmful to training sequence generation models yet has not drawn enough attention in the previous works. In this paper, we propose a novel algorithm named Bootstrapped Transformer, which incorporates the idea of bootstrapping and leverages the learned model to self-generate more offline data to further boost the sequence model training. We conduct extensive experiments on two offline RL benchmarks and demonstrate that our model can largely remedy the existing offline RL training limitations and beat other strong baseline methods. We also analyze the generated pseudo data and the revealed characteristics may shed some light on offline RL training. The codes are available at https://seqml.github.io/bootorl.


title: Event-triggered Design for Optimal Output Consensus of High-order Multi-agent Systems

abstract: This paper studies the optimal output consensus problem for a group of heterogeneous linear multi-agent systems. Different from existing results, we aim at effective controllers for these high-order agents under both event-triggered control and event-triggered communication settings. We conduct an embedded design for the problem and constructively propose a multi-rate event-triggered controller with a set of applicable parameters. The proposed event-triggered rules are shown to be free of Zeno behaviors and can achieve the optimal output consensus goal for these high-order agents. A simulation example is given to verify the efficacy of our designs.


title: On the exponent governing the correlation decay of the Airy$_1$ process

abstract: We study the decay of the covariance of the Airy$_1$ process, $\mathcal{A}_1$, a stationary stochastic process on $\mathbb{R}$ that arises as a universal scaling limit in the Kardar-Parisi-Zhang (KPZ) universality class. We show that the decay is super-exponential and determine the leading order term in the exponent by showing that $\textrm{Cov}(\mathcal{A}_1(0),\mathcal{A}_1(u))= e^{-(\frac{4}{3}+o(1))u^3}$ as $u\to\infty$. The proof employs a combination of probabilistic techniques and integrable probability estimates. The upper bound uses the connection of $\mathcal{A}_1$ to planar exponential last passage percolation and several new results on the geometry of point-to-line geodesics in the latter model which are of independent interest; while the lower bound is primarily analytic, using the Fredholm determinant expressions for the two point function of the Airy$_1$ process together with the FKG inequality.


title: Enhanced Bi-directional Motion Estimation for Video Frame Interpolation

abstract: We present a novel simple yet effective algorithm for motion-based video frame interpolation. Existing motion-based interpolation methods typically rely on a pre-trained optical flow model or a U-Net based pyramid network for motion estimation, which either suffer from large model size or limited capacity in handling complex and large motion cases. In this work, by carefully integrating intermediateoriented forward-warping, lightweight feature encoder, and correlation volume into a pyramid recurrent framework, we derive a compact model to simultaneously estimate the bidirectional motion between input frames. It is 15 times smaller in size than PWC-Net, yet enables more reliable and flexible handling of challenging motion cases. Based on estimated bi-directional motion, we forward-warp input frames and their context features to intermediate frame, and employ a synthesis network to estimate the intermediate frame from warped representations. Our method achieves excellent performance on a broad range of video frame interpolation benchmarks. Code and trained models are available at \url{https://github.com/srcn-ivl/EBME}.


title: Optimal Extragradient-Based Bilinearly-Coupled Saddle-Point Optimization

abstract: We consider the smooth convex-concave bilinearly-coupled saddle-point problem, $\min_{\mathbf{x}}\max_{\mathbf{y}}~F(\mathbf{x}) + H(\mathbf{x},\mathbf{y}) - G(\mathbf{y})$, where one has access to stochastic first-order oracles for $F$, $G$ as well as the bilinear coupling function $H$. Building upon standard stochastic extragradient analysis for variational inequalities, we present a stochastic \emph{accelerated gradient-extragradient (AG-EG)} descent-ascent algorithm that combines extragradient and Nesterov's acceleration in general stochastic settings. This algorithm leverages scheduled restarting to admit a fine-grained nonasymptotic convergence rate that matches known lower bounds by both \citet{ibrahim2020linear} and \citet{zhang2021lower} in their corresponding settings, plus an additional statistical error term for bounded stochastic noise that is optimal up to a constant prefactor. This is the first result that achieves such a relatively mature characterization of optimality in saddle-point optimization.