title: Price of Stability in Quality-Aware Federated Learning

abstract: Federated Learning (FL) is a distributed machine learning scheme that enables clients to train a shared global model without exchanging local data. The presence of label noise can severely degrade the FL performance, and some existing studies have focused on algorithm design for label denoising. However, they ignored the important issue that clients may not apply costly label denoising strategies due to them being self-interested and having heterogeneous valuations on the FL performance. To fill this gap, we model the clients' interactions as a novel label denoising game and characterize its equilibrium. We also analyze the price of stability, which quantifies the difference in the system performance (e.g., global model accuracy, social welfare) between the equilibrium outcome and the socially optimal solution. We prove that the equilibrium outcome always leads to a lower global model accuracy than the socially optimal solution does. We further design an efficient algorithm to compute the socially optimal solution. Numerical experiments on MNIST dataset show that the price of stability increases as the clients' data become noisier, calling for an effective incentive mechanism.


title: Refinements on vertical Sato-Tate

abstract: Vertical Sato-Tate states that the Frobenius trace of a randomly chosen elliptic curve over $\mathbb F_p$ tends to a semicircular distribution as $p\rightarrow \infty$. We go beyond this statement by considering the number of elliptic curves $N_{t,p}'$ with a given trace $t$ over $\mathbb F_p$ and characterizing the 2-dimensional distribution of $(t,N_{t,p}')$. In particular, this gives the distribution of the size of isogeny classes of elliptic curves over $\mathbb F_p$. Furthermore, we show a notion of stronger convergence for vertical Sato-Tate which states that the number of elliptic curves with Frobenius trace in an interval of length $p^\epsilon$ converges to the expected amount. The key step in the proof is to truncate Gekeler's infinite product formula, which relies crucially on an effective Chebotarev's density theorem that was recently developed by Pierce, Turnage-Butterbaugh and Wood.


title: Incentive Mechanism Design for Distributed Ensemble Learning

abstract: Distributed ensemble learning (DEL) involves training multiple models at distributed learners, and then combining their predictions to improve performance. Existing related studies focus on DEL algorithm design and optimization but ignore the important issue of incentives, without which self-interested learners may be unwilling to participate in DEL. We aim to fill this gap by presenting a first study on the incentive mechanism design for DEL. Our proposed mechanism specifies both the amount of training data and reward for learners with heterogeneous computation and communication costs. One design challenge is to have an accurate understanding regarding how learners' diversity (in terms of training data) affects the ensemble accuracy. To this end, we decompose the ensemble accuracy into a diversity-precision tradeoff to guide the mechanism design. Another challenge is that the mechanism design involves solving a mixed-integer program with a large search space. To this end, we propose an alternating algorithm that iteratively updates each learner's training data size and reward. We prove that under mild conditions, the algorithm converges. Numerical results using MNIST dataset show an interesting result: our proposed mechanism may prefer a lower level of learner diversity to achieve a higher ensemble accuracy.


title: Analysis of Weather and Time Features in Machine Learning-aided ERCOT Load Forecasting

abstract: Accurate load forecasting is critical for efficient and reliable operations of the electric power system. A large part of electricity consumption is affected by weather conditions, making weather information an important determinant of electricity usage. Personal appliances and industry equipment also contribute significantly to electricity demand with temporal patterns, making time a useful factor to consider in load forecasting. This work develops several machine learning (ML) models that take various time and weather information as part of the input features to predict the short-term system-wide total load. Ablation studies were also performed to investigate and compare the impacts of different weather factors on the prediction accuracy. Actual load and historical weather data for the same region were processed and then used to train the ML models. It is interesting to observe that using all available features, each of which may be correlated to the load, is unlikely to achieve the best forecasting performance; features with redundancy may even decrease the inference capabilities of ML models. This indicates the importance of feature selection for ML models. Overall, case studies demonstrated the effectiveness of ML models trained with different weather and time input features for ERCOT load forecasting.


title: Federated Learning in Competitive EV Charging Market

abstract: Federated Learning (FL) has demonstrated a significant potential to improve the quality of service (QoS) of EV charging stations. While existing studies have primarily focused on developing FL algorithms, the effect of FL on the charging stations' operation in terms of price competition has yet to be fully understood. This paper aims to fill this gap by modeling the strategic interactions between two charging stations and EV owners as a multi-stage game. Each station first decides its FL participation strategy and charging price, and then individual EV owners decide their charging strategies. The game analysis involves solving a non-concave problem and by decomposing it into a piece-wise concave program we manage to fully characterize the equilibrium. Based on real-world datasets, our numerical results reveal an interesting insight: even if FL improves QoS, it can lead to smaller profits for both stations. The key reason is that FL intensifies the price competition between charging stations by improving stations' QoS to a similar level. We further show that the stations will participate in FL when their data distributions are mildly dissimilar.


title: Mitigating Bias for Question Answering Models by Tracking Bias Influence

abstract: Models of various NLP tasks have been shown to exhibit stereotypes, and the bias in the question answering (QA) models is especially harmful as the output answers might be directly consumed by the end users. There have been datasets to evaluate bias in QA models, while bias mitigation technique for the QA models is still under-explored. In this work, we propose BMBI, an approach to mitigate the bias of multiple-choice QA models. Based on the intuition that a model would lean to be more biased if it learns from a biased example, we measure the bias level of a query instance by observing its influence on another instance. If the influenced instance is more biased, we derive that the query instance is biased. We then use the bias level detected as an optimization objective to form a multi-task learning setting in addition to the original QA task. We further introduce a new bias evaluation metric to quantify bias in a comprehensive and sensitive way. We show that our method could be applied to multiple QA formulations across multiple bias categories. It can significantly reduce the bias level in all 9 bias categories in the BBQ dataset while maintaining comparable QA accuracy.


title: End-to-end Story Plot Generator

abstract: Story plots, while short, carry most of the essential information of a full story that may contain tens of thousands of words. We study the problem of automatic generation of story plots, which includes story premise, character descriptions, plot outlines, etc. To generate a single engaging plot, existing plot generators (e.g., DOC (Yang et al., 2022a)) require hundreds to thousands of calls to LLMs (e.g., OpenAI API) in the planning stage of the story plot, which is costly and takes at least several minutes. Moreover, the hard-wired nature of the method makes the pipeline non-differentiable, blocking fast specialization and personalization of the plot generator. In this paper, we propose three models, $\texttt{OpenPlot}$, $\texttt{E2EPlot}$ and $\texttt{RLPlot}$, to address these challenges. $\texttt{OpenPlot}$ replaces expensive OpenAI API calls with LLaMA2 (Touvron et al., 2023) calls via careful prompt designs, which leads to inexpensive generation of high-quality training datasets of story plots. We then train an end-to-end story plot generator, $\texttt{E2EPlot}$, by supervised fine-tuning (SFT) using approximately 13000 story plots generated by $\texttt{OpenPlot}$. $\texttt{E2EPlot}$ generates story plots of comparable quality to $\texttt{OpenPlot}$, and is > 10$\times$ faster (1k tokens in only 30 seconds on average). Finally, we obtain $\texttt{RLPlot}$ that is further fine-tuned with RLHF on several different reward models for different aspects of story quality, which yields 60.0$\%$ winning rate against $\texttt{E2EPlot}$ along the aspect of suspense and surprise.


title: A Comparative Analysis of Task-Agnostic Distillation Methods for Compressing Transformer Language Models

abstract: Large language models have become a vital component in modern NLP, achieving state of the art performance in a variety of tasks. However, they are often inefficient for real-world deployment due to their expensive inference costs. Knowledge distillation is a promising technique to improve their efficiency while retaining most of their effectiveness. In this paper, we reproduce, compare and analyze several representative methods for task-agnostic (general-purpose) distillation of Transformer language models. Our target of study includes Output Distribution (OD) transfer, Hidden State (HS) transfer with various layer mapping strategies, and Multi-Head Attention (MHA) transfer based on MiniLMv2. Through our extensive experiments, we study the effectiveness of each method for various student architectures in both monolingual (English) and multilingual settings. Overall, we show that MHA transfer based on MiniLMv2 is generally the best option for distillation and explain the potential reasons behind its success. Moreover, we show that HS transfer remains as a competitive baseline, especially under a sophisticated layer mapping strategy, while OD transfer consistently lags behind other approaches. Findings from this study helped us deploy efficient yet effective student models for latency-critical applications.


title: Alteration Detection of Tensor Dependence Structure via Sparsity-Exploited Reranking Algorithm

abstract: Tensor-valued data arise frequently from a wide variety of scientific applications, and many among them can be translated into an alteration detection problem of tensor dependence structures. In this article, we formulate the problem under the popularly adopted tensor-normal distributions and aim at two-sample correlation/partial correlation comparisons of tensor-valued observations. Through decorrelation and centralization, a separable covariance structure is employed to pool sample information from different tensor modes to enhance the power of the test. Additionally, we propose a novel Sparsity-Exploited Reranking Algorithm (SERA) to further improve the multiple testing efficiency. The algorithm is approached through reranking of the p-values derived from the primary test statistics, by incorporating a carefully constructed auxiliary tensor sequence. Besides the tensor framework, SERA is also generally applicable to a wide range of two-sample large-scale inference problems with sparsity structures, and is of independent interest. The asymptotic properties of the proposed test are derived and the algorithm is shown to control the false discovery at the pre-specified level. We demonstrate the efficacy of the proposed method through intensive simulations and two scientific applications.


title: Optical ladder operators in the Glauber-Fock oscillator array

abstract: In this study, we investigate the stationary states of the Glauber-Fock oscillator waveguide array. We begin by transforming the associated Hamiltonian into the form of a quantum harmonic oscillator Hamiltonian, allowing the implementation of a supersymmetric (SUSY) approach. By considering the simplest case for the intertwining operator, the optical ladder operators are straightforwardly constructed and shown to map eigensolutions into eigensolutions of the corresponding Hamiltonian operator, in pretty much the same manner as it is done for the quantum harmonic oscillator case. The ladder of the corresponding (eigen) supermodes is then easily established.


title: DDMT: Denoising Diffusion Mask Transformer Models for Multivariate Time Series Anomaly Detection

abstract: Anomaly detection in multivariate time series has emerged as a crucial challenge in time series research, with significant research implications in various fields such as fraud detection, fault diagnosis, and system state estimation. Reconstruction-based models have shown promising potential in recent years for detecting anomalies in time series data. However, due to the rapid increase in data scale and dimensionality, the issues of noise and Weak Identity Mapping (WIM) during time series reconstruction have become increasingly pronounced. To address this, we introduce a novel Adaptive Dynamic Neighbor Mask (ADNM) mechanism and integrate it with the Transformer and Denoising Diffusion Model, creating a new framework for multivariate time series anomaly detection, named Denoising Diffusion Mask Transformer (DDMT). The ADNM module is introduced to mitigate information leakage between input and output features during data reconstruction, thereby alleviating the problem of WIM during reconstruction. The Denoising Diffusion Transformer (DDT) employs the Transformer as an internal neural network structure for Denoising Diffusion Model. It learns the stepwise generation process of time series data to model the probability distribution of the data, capturing normal data patterns and progressively restoring time series data by removing noise, resulting in a clear recovery of anomalies. To the best of our knowledge, this is the first model that combines Denoising Diffusion Model and the Transformer for multivariate time series anomaly detection. Experimental evaluations were conducted on five publicly available multivariate time series anomaly detection datasets. The results demonstrate that the model effectively identifies anomalies in time series data, achieving state-of-the-art performance in anomaly detection.


title: Neural Dysfunction Underlying Working Memory Processing at Different Stages of the Illness Course in Schizophrenia:A Comparative Meta-analysis

abstract: Schizophrenia (SCZ), as a chronic and persistent disorder, exhibits working memory deficits across various stages of the disorder, yet the neural mechanisms underlying these deficits remain elusive with inconsistent neuroimaging findings. We aimed to compare the brain functional changes of working memory in patients at different stages: clinical high risk (CHR), first-episode psychosis (FEP), and long-term SCZ, using meta-analyses of functional magnetic resonance imaging (fMRI) studies. Following a systematic literature search, fifty-six whole-brain task-based fMRI studies (15 for CHR, 16 for FEP, 25 for long-term SCZ) were included. The separate and pooled neurofunctional mechanisms among CHR, FEP and long-term SCZ were generated by Seed-based d Mapping toolbox. The CHR and FEP groups exhibited overlapping hypoactivation in the right inferior parietal lobule, right middle frontal gyrus, and left superior parietal lobule, indicating key lesion sites in the early phase of SCZ. Individuals with FEP showed lower activation in left inferior parietal lobule than those with long-term SCZ, reflecting a possible recovery process or more neural inefficiency. We concluded that SCZ represent as a continuum in the early stage of illness progression, while the neural bases are inversely changed with the development of illness course to long-term course.


title: Multi-Robot Geometric Task-and-Motion Planning for Collaborative Manipulation Tasks

abstract: We address multi-robot geometric task-and-motion planning (MR-GTAMP) problems in synchronous, monotone setups. The goal of the MR-GTAMP problem is to move objects with multiple robots to goal regions in the presence of other movable objects. We focus on collaborative manipulation tasks where the robots have to adopt intelligent collaboration strategies to be successful and effective, i.e., decide which robot should move which objects to which positions, and perform collaborative actions, such as handovers. To endow robots with these collaboration capabilities, we propose to first collect occlusion and reachability information for each robot by calling motion-planning algorithms. We then propose a method that uses the collected information to build a graph structure which captures the precedence of the manipulations of different objects and supports the implementation of a mixed-integer program to guide the search for highly effective collaborative task-and-motion plans. The search process for collaborative task-and-motion plans is based on a Monte-Carlo Tree Search (MCTS) exploration strategy to achieve exploration-exploitation balance. We evaluate our framework in two challenging MR-GTAMP domains and show that it outperforms two state-of-the-art baselines with respect to the planning time, the resulting plan length and the number of objects moved. We also show that our framework can be applied to underground mining operations where a robotic arm needs to coordinate with an autonomous roof bolter. We demonstrate plan execution in two roof-bolting scenarios both in simulation and on robots.


title: Advancing Perception in Artificial Intelligence through Principles of Cognitive Science

abstract: Although artificial intelligence (AI) has achieved many feats at a rapid pace, there still exist open problems and fundamental shortcomings related to performance and resource efficiency. Since AI researchers benchmark a significant proportion of performance standards through human intelligence, cognitive sciences-inspired AI is a promising domain of research. Studying cognitive science can provide a fresh perspective to building fundamental blocks in AI research, which can lead to improved performance and efficiency. In this review paper, we focus on the cognitive functions of perception, which is the process of taking signals from one's surroundings as input, and processing them to understand the environment. Particularly, we study and compare its various processes through the lens of both cognitive sciences and AI. Through this study, we review all current major theories from various sub-disciplines of cognitive science (specifically neuroscience, psychology and linguistics), and draw parallels with theories and techniques from current practices in AI. We, hence, present a detailed collection of methods in AI for researchers to build AI systems inspired by cognitive science. Further, through the process of reviewing the state of cognitive-inspired AI, we point out many gaps in the current state of AI (with respect to the performance of the human brain), and hence present potential directions for researchers to develop better perception systems in AI.


title: Spiking Semantic Communication for Feature Transmission with HARQ

abstract: In Collaborative Intelligence (CI), the Artificial Intelligence (AI) model is divided between the edge and the cloud, with intermediate features being sent from the edge to the cloud for inference. Several deep learning-based Semantic Communication (SC) models have been proposed to reduce feature transmission overhead and mitigate channel noise interference. Previous research has demonstrated that Spiking Neural Network (SNN)-based SC models exhibit greater robustness on digital channels compared to Deep Neural Network (DNN)-based SC models. However, the existing SNN-based SC models require fixed time steps, resulting in fixed transmission bandwidths that cannot be adaptively adjusted based on channel conditions. To address this issue, this paper introduces a novel SC model called SNN-SC-HARQ, which combines the SNN-based SC model with the Hybrid Automatic Repeat Request (HARQ) mechanism. SNN-SC-HARQ comprises an SNN-based SC model that supports the transmission of features at varying bandwidths, along with a policy model that determines the appropriate bandwidth. Experimental results show that SNN-SC-HARQ can dynamically adjust the bandwidth according to the channel conditions without performance loss.


title: Two-Stage Deep Learning Framework for Quality Assessment of Left Atrial Late Gadolinium Enhanced MRI Images

abstract: Accurate assessment of left atrial fibrosis in patients with atrial fibrillation relies on high-quality 3D late gadolinium enhancement (LGE) MRI images. However, obtaining such images is challenging due to patient motion, changing breathing patterns, or sub-optimal choice of pulse sequence parameters. Automated assessment of LGE-MRI image diagnostic quality is clinically significant as it would enhance diagnostic accuracy, improve efficiency, ensure standardization, and contributes to better patient outcomes by providing reliable and high-quality LGE-MRI scans for fibrosis quantification and treatment planning. To address this, we propose a two-stage deep-learning approach for automated LGE-MRI image diagnostic quality assessment. The method includes a left atrium detector to focus on relevant regions and a deep network to evaluate diagnostic quality. We explore two training strategies, multi-task learning, and pretraining using contrastive learning, to overcome limited annotated data in medical imaging. Contrastive Learning result shows about $4\%$, and $9\%$ improvement in F1-Score and Specificity compared to Multi-Task learning when there's limited data.


title: Loops in surfaces, chord diagrams, interlace graphs: operad factorisations and generating grammars

abstract: A filoop is a generic immersion of a circle in a closed oriented surface, whose complement is a disjoint union of discs, considered up to orientation preserving diffeomorphisms. It gives rise to a chord diagram C which has an interlace graph G, called a chordiagraph. For a graph G with even degrees, we compute a quantity mg(G) which yields, for every chord diagram $C$ with interlace graph G, the minimal genus of filoops with chord diagram C. If mg(G)=0 then C admits exactly two framings of genus 0, corresponding to spheriloops. After recalling the Cunningham factorisation of connected graphs, we describe a canonical factorisation of filoops into spheric sums followed by toric sums, for which the genus is additive. This is analogous to the factorisation of compact connected 3-manifolds along spheres and tori. We describe unambiguous context-sensitive grammars generating the set of all graphs and with mg(G)=0 and deduce stability properties with respect to spheric and toric factorisations. Similar results hold for chordiagraphs with mg(G) = 0 and their corresponding spheriloops.


title: Unified framework of the microscopic Landau-Lifshitz-Gilbert equation and its application to Skyrmion dynamics

abstract: The Landau-Lifshitz-Gilbert (LLG) equation is widely used to describe magnetization dynamics. We develop a unified framework of the microscopic LLG equation based on the nonequilibrium Green's function formalism. We present a unified treatment for expressing the microscopic LLG equation in several limiting cases, including the adiabatic, inertial, and nonadiabatic limits with respect to the precession frequency for a magnetization with fixed magnitude, as well as the spatial adiabatic limit for the magnetization with slow variation in both its magnitude and direction. The coefficients of those terms in the microscopic LLG equation are explicitly expressed in terms of nonequilibrium Green's functions. As a concrete example, this microscopic theory is applied to simulate the dynamics of a magnetic Skyrmion driven by quantum parametric pumping. Our work provides a practical formalism of the microscopic LLG equation for exploring magnetization dynamics.


title: Attacks Meet Interpretability (AmI) Evaluation and Findings

abstract: To investigate the effectiveness of the model explanation in detecting adversarial examples, we reproduce the results of two papers, Attacks Meet Interpretability: Attribute-steered Detection of Adversarial Samples and Is AmI (Attacks Meet Interpretability) Robust to Adversarial Examples. And then conduct experiments and case studies to identify the limitations of both works. We find that Attacks Meet Interpretability(AmI) is highly dependent on the selection of hyperparameters. Therefore, with a different hyperparameter choice, AmI is still able to detect Nicholas Carlini's attack. Finally, we propose recommendations for future work on the evaluation of defense techniques such as AmI.


title: DexCatch: Learning to Catch Arbitrary Objects with Dexterous Hands

abstract: Achieving human-like dexterous manipulation remains a crucial area of research in robotics. Current research focuses on improving the success rate of pick-and-place tasks. Compared with pick-and-place, throw-catching behavior has the potential to increase picking speed without transporting objects to their destination. However, dynamic dexterous manipulation poses a major challenge for stable control due to a large number of dynamic contacts. In this paper, we propose a Stability-Constrained Reinforcement Learning (SCRL) algorithm to learn to catch diverse objects with dexterous hands. The SCRL algorithm outperforms baselines by a large margin, and the learned policies show strong zero-shot transfer performance on unseen objects. Remarkably, even though the object in a hand facing sideward is extremely unstable due to the lack of support from the palm, our method can still achieve a high level of success in the most challenging task. Video demonstrations of learned behaviors and the code can be found on the supplementary website.


title: Spectroscopic signatures of excitonic order effect on quantum spin Hall edge states

abstract: One of the proposed ground states of monolayer WTe$_2$, a two-dimensional topological insulator, is an excitonic condensate. However, time-reversal preserving and breaking solutions are competing at the mean-field level of analysis, and it is unclear which condensate, if any, is realized in nature. In this work we analyze the experimental signatures that allow to provide evidence for the excitonic ground states and to distinguish between the two types of condensates using scanning tunneling microscopy. We provide clear experimental signatures in local mapping and quasiparticle interference patterns that visualize the expected changes in local charge and spin density, and characterize allowed backscattering processes in the presence of impurities and disorder. Our results will thus help in the determination of the nature of the WTe$_2$ ground state.


title: An enhanced and highly efficient semi-implicit combined Lagrange multiplier approach with preserving original energy law for dissipative systems

abstract: Recently, a new Lagrange multiplier approach was introduced by Cheng, Liu and Shen in \cite{cheng2020new}, which has been broadly used to solve various challenging phase field problems. To design original energy stable schemes, they have to solve a nonlinear algebraic equation to determine the introduced Lagrange multiplier, which can be computationally expensive, especially for large-scale and long-time simulations involving complex nonlinear terms. This paper presents an essential improved technique to modify this issue, which can be seen as a semi-implicit combined Lagrange multiplier approach. In general, the new constructed schemes keep all the advantages of the Lagrange multiplier method and significantly reduce the computation costs. Besides, the new proposed BDF2 scheme dissipates the original energy, as opposed to a modified energy for the classical Lagrange multiplier approach in \cite{cheng2020new}. We further construct high-order BDF$k$ schemes based on the new proposed approach. In addition, we establish a general framework for extending our constructed method to dissipative systems. Finally several examples have been presented to demonstrate the effectiveness of the proposed approach.


title: A novel decomposed-ensemble time series forecasting framework: capturing underlying volatility information

abstract: Time series forecasting represents a significant and challenging task across various fields. Recently, methods based on mode decomposition have dominated the forecasting of complex time series because of the advantages of capturing local characteristics and extracting intrinsic modes from data. Unfortunately, most models fail to capture the implied volatilities that contain significant information. To enhance the prediction of contemporary diverse and complex time series, we propose a novel time series forecasting paradigm that integrates decomposition with the capability to capture the underlying fluctuation information of the series. In our methodology, we implement the Variational Mode Decomposition algorithm to decompose the time series into K distinct sub-modes. Following this decomposition, we apply the Generalized Autoregressive Conditional Heteroskedasticity (GARCH) model to extract the volatility information in these sub-modes. Subsequently, both the numerical data and the volatility information for each sub-mode are harnessed to train a neural network. This network is adept at predicting the information of the sub-modes, and we aggregate the predictions of all sub-modes to generate the final output. By integrating econometric and artificial intelligence methods, and taking into account both the numerical and volatility information of the time series, our proposed framework demonstrates superior performance in time series forecasting, as evidenced by the significant decrease in MSE, RMSE, and MAPE in our comparative experimental results.


title: A Unifying Quantum Speed Limit For Time-Independent Hamiltonian Evolution

abstract: Quantum speed limit (QSL) is the study of fundamental limits on the evolution time of quantum systems. For instance, under the action of a time-independent Hamiltonian, the evolution time between an initial and a final quantum state obeys various mutually complementary lower bounds. They include the Mandelstam-Tamm, Margolus-Levitin, Luo-Zhang, dual ML and Lee-Chau bounds. Here we show that the Mandelstam-Tamm bound can be obtained by optimizing the Lee-Chau bound over a certain parameter. More importantly, we report a QSL that includes all the above bounds as special cases before optimizing over the physically meaningless reference energy level of a quantum system. This unifying bound depends on a certain parameter $p$. For any fixed $p$, we find all pairs of time-independent Hamiltonian and initial pure quantum state that saturate this unifying bound. More importantly, these pairs allow us to compute this bound accurately and efficiently using an oracle that returns certain $p$th moments related to the absolute value of energy of the quantum state. Moreover, this oracle can be simulated by a computationally efficient and accurate algorithm for finite-dimensional quantum systems as well as for certain infinite-dimensional quantum states with bounded and continuous energy spectra. This makes our computational method feasible in a lot of practical situations. We compare the performance of this bound for the case of a fixed $p$ as well as the case of optimizing over $p$ with existing QSLs. We find that if the dimension of the underlying Hilbert space is $\lesssim 2000$, our unifying bound optimized over $p$ can be computed accurately in a few minutes using Mathematica code with just-in-time compilation in a typical desktop. Besides, this optimized unifying QSL is at least as good as all the existing ones combined and can occasionally be a few percent to a few times better.


title: PT-symmetry enabled stable modes in multi-core fiber

abstract: Open systems with balanced gain and loss, described by parity-time PT-symmetric Hamiltonians have been deeply explored over the past decade. Most explorations are limited to finite discrete models (in real or reciprocal spaces) or continuum problems in one dimension. As a result, these models do not leverage the complexity and variability of two-dimensional continuum problems on a compact support. Here, we investigate eigenvalues of the Schrodinger equation on a disk with zero boundary condition, in the presence of constant, PT-symmetric, gain-loss potential that is confined to two mirror-symmetric disks. We find a rich variety of exceptional points, re-entrant PT-symmetric phases, and a non-monotonic dependence of the PT-symmetry breaking threshold on the system parameters. By comparing results of two model variations, we show that this simple model of a multi-core fiber supports propagating modes in the presence of gain and loss.


title: Incremental Object Detection with CLIP

abstract: In contrast to the incremental classification task, the incremental detection task is characterized by the presence of data ambiguity, as an image may have differently labeled bounding boxes across multiple continuous learning stages. This phenomenon often impairs the model's ability to effectively learn new classes. However, existing research has paid less attention to the forward compatibility of the model, which limits its suitability for incremental learning. To overcome this obstacle, we propose leveraging a visual-language model such as CLIP to generate text feature embeddings for different class sets, which enhances the feature space globally. We then employ super-classes to replace the unavailable novel classes in the early learning stage to simulate the incremental scenario. Finally, we utilize the CLIP image encoder to accurately identify potential objects. We incorporate the finely recognized detection boxes as pseudo-annotations into the training process, thereby further improving the detection performance. We evaluate our approach on various incremental learning settings using the PASCAL VOC 2007 dataset, and our approach outperforms state-of-the-art methods, particularly for recognizing the new classes.


title: A rigorous theory on electromagnetic diffraction by a planar aperture in a perfectly conducting screen

abstract: In this paper, we revisit the classic problem of diffraction of electromagnetic waves by an aperture in a perfectly conducting plane. We formulate the diffraction problem using a boundary integral equation that is defined on the aperture using Dyadic Green's function. This integral equation turns out to align with the one derived by Bethe using fictitious magnetic charges and currents. We then investigate the boundary integral equation using a saddle point formulation and establish the well-posedness of the boundary integral equation, including the existence and uniqueness of the solution in an appropriately defined Sobolev space.


title: Exploring the relationship between response time sequence in scale answering process and severity of insomnia: a machine learning approach

abstract: Objectives: The study aims to investigate the relationship between insomnia and response time. Additionally, it aims to develop a machine learning model to predict the presence of insomnia in participants using response time data. Methods: A mobile application was designed to administer scale tests and collect response time data from 2729 participants. The relationship between symptom severity and response time was explored, and a machine learning model was developed to predict the presence of insomnia. Results: The result revealed a statistically significant difference (p<.001) in the total response time between participants with or without insomnia symptoms. A correlation was observed between the severity of specific insomnia aspects and response times at the individual questions level. The machine learning model demonstrated a high predictive accuracy of 0.743 in predicting insomnia symptoms based on response time data. Conclusions: These findings highlight the potential utility of response time data to evaluate cognitive and psychological measures, demonstrating the effectiveness of using response time as a diagnostic tool in the assessment of insomnia.


title: Algorithm xxxx: HiPPIS A High-Order Positivity-Preserving Mapping Software for Structured Meshes

abstract: Polynomial interpolation is an important component of many computational problems. In several of these computational problems, failure to preserve positivity when using polynomials to approximate or map data values between meshes can lead to negative unphysical quantities. Currently, most polynomial-based methods for enforcing positivity are based on splines and polynomial rescaling. The spline-based approaches build interpolants that are positive over the intervals in which they are defined and may require solving a minimization problem and/or system of equations. The linear polynomial rescaling methods allow for high-degree polynomials but enforce positivity only at limited locations (e.g., quadrature nodes). This work introduces open-source software (HiPPIS) for high-order data-bounded interpolation (DBI) and positivity-preserving interpolation (PPI) that addresses the limitations of both the spline and polynomial rescaling methods. HiPPIS is suitable for approximating and mapping physical quantities such as mass, density, and concentration between meshes while preserving positivity. This work provides Fortran and Matlab implementations of the DBI and PPI methods, presents an analysis of the mapping error in the context of PDEs, and uses several 1D and 2D numerical examples to demonstrate the benefits and limitations of HiPPIS.


title: Floquet Non-Abelian Topological Insulator and Multifold Bulk-Edge Correspondence

abstract: Topological phases characterized by non-Abelian charges are beyond the scope of the paradigmatic tenfold way and have gained increasing attention recently. Here we investigate topological insulators with multiple tangled gaps in Floquet settings and identify uncharted Floquet non-Abelian topological insulators without any static or Abelian analog. We demonstrate that the bulk-edge correspondence is multifold and follows the multiplication rule of the quaternion group $Q_8$. The same quaternion charge corresponds to several distinct edge-state configurations that are fully determined by phase-band singularities of the time evolution. In the anomalous non-Abelian phase, edge states appear in all bandgaps despite trivial quaternion charge. Furthermore, we uncover an exotic swap effect -- the emergence of interface modes with swapped driving, which is a signature of the non-Abelian dynamics and absent in Floquet Abelian systems. Our work, for the first time, presents Floquet topological insulators characterized by non-Abelian charges and opens up exciting possibilities for exploring the rich and uncharted territory of non-equilibrium topological phases.

categories: cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.quant-gas math-ph math.MP quant-ph


title: Learning to Adapt SAM for Segmenting Cross-domain Point Clouds

abstract: Unsupervised domain adaptation (UDA) in 3D segmentation tasks presents a formidable challenge, primarily stemming from the sparse and unordered nature of point cloud data. Especially for LiDAR point clouds, the domain discrepancy becomes obvious across varying capture scenes, fluctuating weather conditions, and the diverse array of LiDAR devices in use. While previous UDA methodologies have often sought to mitigate this gap by aligning features between source and target domains, this approach falls short when applied to 3D segmentation due to the substantial domain variations. Inspired by the remarkable generalization capabilities exhibited by the vision foundation model, SAM, in the realm of image segmentation, our approach leverages the wealth of general knowledge embedded within SAM to unify feature representations across diverse 3D domains and further solves the 3D domain adaptation problem. Specifically, we harness the corresponding images associated with point clouds to facilitate knowledge transfer and propose an innovative hybrid feature augmentation methodology, which significantly enhances the alignment between the 3D feature space and SAM's feature space, operating at both the scene and instance levels. Our method is evaluated on many widely-recognized datasets and achieves state-of-the-art performance.


title: Political Elites in False Statements on the Internet

abstract: Political elites play a critical role in driving engagement with misinformation on the internet. However, an understanding of the strategies with which the political left and right attempt to harness animosity toward political elites in their misinformation stories is missing. To this end, we collected a comprehensive dataset consisting of 35,014 true and false statements that have been fact-checked by renowned fact-checking organizations (e.g., snopes.com) between 2008 and 2023, i.e., within an observation period of 15 years. Subsequently, we perform content analysis and explanatory regression modeling to analyze how veracity is linked to mentions of US political elites (Republicans and Democrats) in fact-checked statements. Our analysis yields four main findings: (i) False statements are, on average, 20% more likely to mention political elites than true statements. (ii) However, there is a partisan asymmetry such that false statements are 88.1% more likely to mention Democrats, but 26.5% less likely to mention Republicans. (iii) Mentions of political elites in false statements reach the highest level during the months preceding elections. (iiii) False statements that mention political elites carry stronger other-condemning emotions. In sum, these empirical findings shed new light on the connection between online misinformation and political elites -- and suggest that authors of misinformation frequently harness animosity toward the political out-groups in their misinformation stories.


title: A High-throughput and Secure Coded Blockchain for IoT

abstract: We propose a new coded blockchain scheme suitable for the Internet-of-Things (IoT) network. In contrast to existing works for coded blockchains, especially blockchain-of-things, the proposed scheme is more realistic, practical, and secure while achieving high throughput. This is accomplished by: 1) modeling the variety of transactions using a reward model, based on which an optimization problem is solved to select transactions that are more accessible and cheaper computational-wise to be processed together; 2) a transaction-based and lightweight consensus algorithm that emphasizes on using the minimum possible number of miners for processing the transactions; and 3) employing the raptor codes with linear-time encoding and decoding which results in requiring lower storage to maintain the blockchain and having a higher throughput. We provide detailed analysis and simulation results on the proposed scheme and compare it with the state-of-the-art coded IoT blockchain schemes including Polyshard and LCB, to show the advantages of our proposed scheme in terms of security, storage, decentralization, and throughput.


title: Distance-rank Aware Sequential Reward Learning for Inverse Reinforcement Learning with Sub-optimal Demonstrations

abstract: Inverse reinforcement learning (IRL) aims to explicitly infer an underlying reward function based on collected expert demonstrations. Considering that obtaining expert demonstrations can be costly, the focus of current IRL techniques is on learning a better-than-demonstrator policy using a reward function derived from sub-optimal demonstrations. However, existing IRL algorithms primarily tackle the challenge of trajectory ranking ambiguity when learning the reward function. They overlook the crucial role of considering the degree of difference between trajectories in terms of their returns, which is essential for further removing reward ambiguity. Additionally, it is important to note that the reward of a single transition is heavily influenced by the context information within the trajectory. To address these issues, we introduce the Distance-rank Aware Sequential Reward Learning (DRASRL) framework. Unlike existing approaches, DRASRL takes into account both the ranking of trajectories and the degrees of dissimilarity between them to collaboratively eliminate reward ambiguity when learning a sequence of contextually informed reward signals. Specifically, we leverage the distance between policies, from which the trajectories are generated, as a measure to quantify the degree of differences between traces. This distance-aware information is then used to infer embeddings in the representation space for reward learning, employing the contrastive learning technique. Meanwhile, we integrate the pairwise ranking loss function to incorporate ranking information into the latent features. Moreover, we resort to the Transformer architecture to capture the contextual dependencies within the trajectories in the latent space, leading to more accurate reward estimation. Through extensive experimentation, our DRASRL framework demonstrates significant performance improvements over previous SOTA methods.


title: Confounding-Robust Policy Improvement with Human-AI Teams

abstract: Human-AI collaboration has the potential to transform various domains by leveraging the complementary strengths of human experts and Artificial Intelligence (AI) systems. However, unobserved confounding can undermine the effectiveness of this collaboration, leading to biased and unreliable outcomes. In this paper, we propose a novel solution to address unobserved confounding in human-AI collaboration by employing the marginal sensitivity model (MSM). Our approach combines domain expertise with AI-driven statistical modeling to account for potential confounders that may otherwise remain hidden. We present a deferral collaboration framework for incorporating the MSM into policy learning from observational data, enabling the system to control for the influence of unobserved confounding factors. In addition, we propose a personalized deferral collaboration system to leverage the diverse expertise of different human decision-makers. By adjusting for potential biases, our proposed solution enhances the robustness and reliability of collaborative outcomes. The empirical and theoretical analyses demonstrate the efficacy of our approach in mitigating unobserved confounding and improving the overall performance of human-AI collaborations.


title: From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models

abstract: Multi-modal Large Language Models (MLLMs) have made significant strides in expanding the capabilities of Large Language Models (LLMs) through the incorporation of visual perception interfaces. Despite the emergence of exciting applications and the availability of diverse instruction tuning data, existing approaches often rely on CLIP or its variants as the visual branch, and merely extract features from the deep layers. However, these methods lack a comprehensive analysis of the visual encoders in MLLMs. In this paper, we conduct an extensive investigation into the effectiveness of different vision encoders within MLLMs. Our findings reveal that the shallow layer features of CLIP offer particular advantages for fine-grained tasks such as grounding and region understanding. Surprisingly, the vision-only model DINO, which is not pretrained with text-image alignment, demonstrates promising performance as a visual branch within MLLMs. By simply equipping it with an MLP layer for alignment, DINO surpasses CLIP in fine-grained related perception tasks. Building upon these observations, we propose a simple yet effective feature merging strategy, named COMM, that integrates CLIP and DINO with Multi-level features Merging, to enhance the visual capabilities of MLLMs. We evaluate COMM through comprehensive experiments on a wide range of benchmarks, including image captioning, visual question answering, visual grounding, and object hallucination. Experimental results demonstrate the superior performance of COMM compared to existing methods, showcasing its enhanced visual capabilities within MLLMs.


title: Revisiting Multi-modal 3D Semantic Segmentation in Real-world Autonomous Driving

abstract: LiDAR and camera are two critical sensors for multi-modal 3D semantic segmentation and are supposed to be fused efficiently and robustly to promise safety in various real-world scenarios. However, existing multi-modal methods face two key challenges: 1) difficulty with efficient deployment and real-time execution; and 2) drastic performance degradation under weak calibration between LiDAR and cameras. To address these challenges, we propose CPGNet-LCF, a new multi-modal fusion framework extending the LiDAR-only CPGNet. CPGNet-LCF solves the first challenge by inheriting the easy deployment and real-time capabilities of CPGNet. For the second challenge, we introduce a novel weak calibration knowledge distillation strategy during training to improve the robustness against the weak calibration. CPGNet-LCF achieves state-of-the-art performance on the nuScenes and SemanticKITTI benchmarks. Remarkably, it can be easily deployed to run in 20ms per frame on a single Tesla V100 GPU using TensorRT TF16 mode. Furthermore, we benchmark performance over four weak calibration levels, demonstrating the robustness of our proposed approach.


title: Probing axion-like particles at the Electron-Ion Collider

abstract: The Electron-Ion Collider~(EIC), a forthcoming powerful high-luminosity facility, represents an exciting opportunity to explore new physics. In this article, we study the potential of the EIC to probe the coupling between axion-like particles~(ALPs) and photons in coherent scattering. The ALPs can be produced via photon fusion and decay back to two photons inside the EIC detector. In a prompt-decay search, we find that the EIC can set the most stringent bound for $m_a \lesssim 20\,\GeV$ and probe the effective scales $\Lambda \lesssim 10^{5}\,$GeV. In a displaced-vertex search, which requires adopting an EM calorimeter technology that provides directionality, the EIC could probe ALPs with $m_a \lesssim 1\,\GeV$ at effective scales $\Lambda \lesssim 10^{7}\,\GeV$. Combining the two search strategies, the EIC can probe a significant portion of unexplored parameter space in the $0.2 < m_a <20\,\GeV$ mass range.


title: UAV Routing for Enhancing the Performance of a Classifier-in-the-loop

abstract: Some human-machine systems are designed so that machines (robots) gather and deliver data to remotely located operators (humans) through an interface in order to aid them in classification. The performance of a human as a (binary) classifier-in-the-loop is characterized by probabilities of correctly classifying objects of type $T$ and $F$. These two probabilities depend on the dwell time, $d$, spent collecting information at a point of interest (POI or interchangeably, target). The information gain associated with collecting information at a target is then a function of dwell time $d$ and discounted by the revisit time, $R$, i.e., the duration between consecutive revisits to the same target. The objective of the problem of routing for classification is to optimally route the vehicles and determine the optimal dwell time at each target so as to maximize the total discounted information gain while visiting every target at least once. In this paper, we make a simplifying assumption that the information gain is discounted exponentially by the revisit time; this assumption enables one to decouple the problem of routing with the problem of determining optimal dwell time at each target for a single vehicle problem. For the multi-vehicle problem, we provide a fast heuristic to obtain the allocation of targets to each vehicle and the corresponding dwell time.


title: Disappearing galaxies: the orientation dependence of JWST-bright, HST-dark, star-forming galaxy selection

abstract: Galaxies that are invisible in deep optical-NIR imaging but detected at longer wavelengths have been the focus of several recent observational studies, with speculation that they could constitute a substantial missing population and even dominate the cosmic star formation rate density at $z\gtrsim4$. The depths now achievable with JWST at the longest wavelengths probed by HST, coupled with the transformative resolution at longer wavelengths, are already enabling detailed, spatially-resolved characterisation of sources that were invisible to HST, often known as `HST-dark' galaxies. However, until now, there has been little theoretical work to compare against. We present the first simulation-based study of this population, using highly-resolved galaxies from the Feedback in Realistic Environments (FIRE) project, with multi-wavelength images along several lines of sight forward-modelled using radiative transfer. We naturally recover a population of modelled sources that meet commonly-used selection criteria ($H_{\rm{AB}}>27\,\rm{mag}$ and $H_{\rm{AB}}-\rm{F444W}>2.3$). These simulated HST-dark galaxies lie at high redshifts ($z=4-7$), have high levels of dust attenuation ($A_{V}=2-4$), and display compact recent star formation ($R_{1/2,\,\rm{4.4\,\mu\rm{m}}}\lesssim1\,\rm{kpc}$). Orientation is very important: for all but one of the 17 simulated galaxy snapshots with HST-dark sightlines, there exist other sightlines that do not meet the criteria. This result has important implications for comparisons between observations and models that do not resolve the detailed star-dust geometry, such as semi-analytic models or coarsely-resolved hydrodynamical simulations. Critically, we demonstrate that HST-dark sources are not an unexpected or exotic population, but a subset of high-redshift, highly-dust-attenuated sources viewed along certain lines of sight.


title: Urban Drone Navigation: Autoencoder Learning Fusion for Aerodynamics

abstract: Drones are vital for urban emergency search and rescue (SAR) due to the challenges of navigating dynamic environments with obstacles like buildings and wind. This paper presents a method that combines multi-objective reinforcement learning (MORL) with a convolutional autoencoder to improve drone navigation in urban SAR. The approach uses MORL to achieve multiple goals and the autoencoder for cost-effective wind simulations. By utilizing imagery data of urban layouts, the drone can autonomously make navigation decisions, optimize paths, and counteract wind effects without traditional sensors. Tested on a New York City model, this method enhances drone SAR operations in complex urban settings.


title: Biases in estimates of air pollution impacts: the role of omitted variables and measurement errors

abstract: Observational studies often use linear regression to assess the effect of ambient air pollution on outcomes of interest, such as human health indicators or crop yields. Yet pollution datasets are typically noisy and include only a subset of the potentially relevant pollutants, giving rise to both measurement error bias (MEB) and omitted variable bias (OVB). While it is well understood that these biases exist, less is understood about whether these biases tend to be positive or negative, even though it is sometimes falsely claimed that measurement error simply biases regression coefficient estimates towards zero. In this paper, we study the direction of these biases under the realistic assumptions that the concentrations of different types of air pollutants are positively correlated with each other and that each type of pollutant has a nonpositive association with the outcome variable. We demonstrate both theoretically and using simulations that under these two assumptions, the OVB will typically be negative and that more often than not the MEB for null pollutants or for pollutants that are perfectly measured will be negative. We also use a crop yield and air pollution dataset to show that these biases tend to be negative in the setting of our motivating application. We do this by introducing a validation scheme that does not require knowing the true coefficients. While this paper is motivated by studies assessing the effect of air pollutants on crop yields, the findings are also relevant to regression-based studies assessing the effect of air pollutants on human health outcomes. The validation scheme can also be used to empirically study OVB or MEB in other contexts.


title: What is a 4-connected matroid?

abstract: The breadth of a tangle $\mathcal{T}$ in a matroid is the size of the largest spanning uniform submatroid of the tangle matroid of $\mathcal{T}$. The matroid $M$ is weakly 4-connected if it is 3-connected and whenever $(X,Y)$ is a partition of $E(M)$ with $|X|,|Y|>4$, then $\lambda(X)\geq 3$. We prove that if $\mathcal{T}$ is a tangle of order $k\geq 4$ and breadth $l$ in a matroid $M$, then $M$ has a weakly 4-connected minor $N$ with a tangle $\mathcal{T}_N$ of order $k$, breadth $l$ and has the property that $\mathcal{T}$ is the tangle in $M$ induced by $\mathcal{T}_N$. A set $Z$ of elements of a matroid $M$ is 4-connected if $\lambda(A)\geq\min\{|A\cap Z|,|Z-A|,3\}$ for all $A\subseteq E(M)$. As a corollary of our theorems on tangles we prove that if $M$ contains an $n$-element 4-connected set where $n\geq 7$, then $M$ has a weakly $4$-connected minor that contains an $n$-element $4$-connected set.


title: Optimal Sample Complexity for Average Reward Markov Decision Processes

abstract: We resolve the open question regarding the sample complexity of policy learning for maximizing the long-run average reward associated with a uniformly ergodic Markov decision process (MDP), assuming a generative model. In this context, the existing literature provides a sample complexity upper bound of $\widetilde O(|S||A|t_{\text{mix}}^2 \epsilon^{-2})$ and a lower bound of $\Omega(|S||A|t_{\text{mix}} \epsilon^{-2})$. In these expressions, $|S|$ and $|A|$ denote the cardinalities of the state and action spaces respectively, $t_{\text{mix}}$ serves as a uniform upper limit for the total variation mixing times, and $\epsilon$ signifies the error tolerance. Therefore, a notable gap of $t_{\text{mix}}$ still remains to be bridged. Our primary contribution is the development of an estimator for the optimal policy of average reward MDPs with a sample complexity of $\widetilde O(|S||A|t_{\text{mix}}\epsilon^{-2})$. This marks the first algorithm and analysis to reach the literature's lower bound. Our new algorithm draws inspiration from ideas in Li et al. (2020), Jin and Sidford (2021), and Wang et al. (2023). Additionally, we conduct numerical experiments to validate our theoretical findings.


title: 2D Slice-driven Physics-based 3D Motion Estimation Framework for Pancreatic Radiotherapy

abstract: Pancreatic diseases are difficult to treat with high doses of radiation, as they often present both periodic and aperiodic deformations. Nevertheless, we expect that these difficulties can be overcome, and treatment results may be improved with the practical use of a device that can capture 2D slices of organs during irradiation. However, since only a few 2D slices can be taken, the 3D motion needs to be estimated from partially observed information. In this study, we propose a physics-based framework for estimating the 3D motion of organs, regardless of periodicity, from motion information obtained by 2D slices in one or more directions and a regression model that estimates the accuracy of the proposed framework to select the optimal slice. Using information obtained by slice-to-slice registration and setting the surrounding organs as boundaries, the framework drives the physical models for estimating 3D motion. The R2 score of the proposed regression model was greater than 0.9, and the RMSE was 0.357 mm. The mean errors were 5.11 $\pm$ 1.09 mm using an axial slice and 2.13 $\pm$ 0.598 mm using concurrent axial, sagittal, and coronal slices. Our results suggest that the proposed framework is comparable to volume-to-volume registration, and is feasible.


title: Demonstration of chronometric leveling using transportable optical clocks beyond laser coherence limit

abstract: Optical clock network requires the establishment of optical frequency transmission link between multiple optical clocks, utilizing narrow linewidth lasers. Despite achieving link noise levels of 10${^{-20}}$, the final accuracy is limited by the phase noise of the clock laser. Correlation spectroscopy is developed to transmit frequency information between two optical clocks directly, enabling optical clock comparison beyond the phase noise limit of clock lasers, and significantly enhancing the measurement accuracy or shorten the measurement time. In this letter, two compact transportable ${^{40}}$Ca${^+}$ clocks are employed to accomplish the correlation spectroscopy comparison, demonstrating an 10 cm level measurement accuracy of chronometric leveling using a mediocre clock laser with linewidth of 200 Hz. The relative frequency instability reaches $6.0\times10{^{-15}}/\sqrt{\tau/s}$, which is about 20 times better than the result with Rabi spectroscopy using the same clock laser. This research greatly reduces the harsh requirements on the performance of the clock laser, so that an ordinary stable-laser can also be employed in the construction of optical clock network, which is essential for the field applications, especially for the chronometric leveling.


title: A Framework for Few-Shot Policy Transfer through Observation Mapping and Behavior Cloning

abstract: Despite recent progress in Reinforcement Learning for robotics applications, many tasks remain prohibitively difficult to solve because of the expensive interaction cost. Transfer learning helps reduce the training time in the target domain by transferring knowledge learned in a source domain. Sim2Real transfer helps transfer knowledge from a simulated robotic domain to a physical target domain. Knowledge transfer reduces the time required to train a task in the physical world, where the cost of interactions is high. However, most existing approaches assume exact correspondence in the task structure and the physical properties of the two domains. This work proposes a framework for Few-Shot Policy Transfer between two domains through Observation Mapping and Behavior Cloning. We use Generative Adversarial Networks (GANs) along with a cycle-consistency loss to map the observations between the source and target domains and later use this learned mapping to clone the successful source task behavior policy to the target domain. We observe successful behavior policy transfer with limited target task interactions and in cases where the source and target task are semantically dissimilar.


title: Static Code Analysis in the AI Era: An In-depth Exploration of the Concept, Function, and Potential of Intelligent Code Analysis Agents

abstract: The escalating complexity of software systems and accelerating development cycles pose a significant challenge in managing code errors and implementing business logic. Traditional techniques, while cornerstone for software quality assurance, exhibit limitations in handling intricate business logic and extensive codebases. To address these challenges, we introduce the Intelligent Code Analysis Agent (ICAA), a novel concept combining AI models, engineering process designs, and traditional non-AI components. The ICAA employs the capabilities of large language models (LLMs) such as GPT-3 or GPT-4 to automatically detect and diagnose code errors and business logic inconsistencies. In our exploration of this concept, we observed a substantial improvement in bug detection accuracy, reducing the false-positive rate to 66\% from the baseline's 85\%, and a promising recall rate of 60.8\%. However, the token consumption cost associated with LLMs, particularly the average cost for analyzing each line of code, remains a significant consideration for widespread adoption. Despite this challenge, our findings suggest that the ICAA holds considerable potential to revolutionize software quality assurance, significantly enhancing the efficiency and accuracy of bug detection in the software development process. We hope this pioneering work will inspire further research and innovation in this field, focusing on refining the ICAA concept and exploring ways to mitigate the associated costs.


title: Higher-dimensional symmetric informationally complete measurement via programmable photonic integrated optics

abstract: Symmetric informationally complete measurements are both important building blocks in many quantum information protocols and the seminal example of a generalised, non-orthogonal, quantum measurement. In higher-dimensional systems, these measurements become both increasingly interesting and increasingly complex to implement. Here, we demonstrate an integrated quantum photonic platform to realize such a measurement on three-level quantum systems. The device operates at the high fidelities necessary for verifying a genuine many-outcome quantum measurement, performing near-optimal quantum state discrimination, and beating the projective limit in quantum random number generation. Moreover, it is programmable and can readily implement other quantum measurements at similarly high quality. Our work paves the way for the implementation of sophisticated higher-dimensional quantum measurements that go beyond the traditional orthogonal projections.


title: HybridChain: Fast, Accurate, and Secure Transaction Processing with Distributed Learning

abstract: In order to fully unlock the transformative power of distributed ledgers and blockchains, it is crucial to develop innovative consensus algorithms that can overcome the obstacles of security, scalability, and interoperability, which currently hinder their widespread adoption. This paper introduces HybridChain that combines the advantages of sharded blockchain and DAG distributed ledger, and a consensus algorithm that leverages decentralized learning. Our approach involves validators exchanging perceptions as votes to assess potential conflicts between transactions and the witness set, representing input transactions in the UTXO model. These perceptions collectively contribute to an intermediate belief regarding the validity of transactions. By integrating their beliefs with those of other validators, localized decisions are made to determine validity. Ultimately, a final consensus is achieved through a majority vote, ensuring precise and efficient validation of transactions. Our proposed approach is compared to the existing DAG-based scheme IOTA and the sharded blockchain Omniledger through extensive simulations. The results show that IOTA has high throughput and low latency but sacrifices accuracy and is vulnerable to orphanage attacks especially with low transaction rates. Omniledger achieves stable accuracy by increasing shards but has increased latency. In contrast, the proposed HybridChain exhibits fast, accurate, and secure transaction processing, and excellent scalability.


title: Large Language Models as Source Planner for Personalized Knowledge-grounded Dialogue

abstract: Open-domain dialogue system usually requires different sources of knowledge to generate more informative and evidential responses. However, existing knowledge-grounded dialogue systems either focus on a single knowledge source or overlook the dependency between multiple sources of knowledge, which may result in generating inconsistent or even paradoxical responses. To incorporate multiple knowledge sources and dependencies between them, we propose SAFARI, a novel framework that leverages the exceptional capabilities of large language models (LLMs) in planning, understanding, and incorporating under both supervised and unsupervised settings. Specifically, SAFARI decouples the knowledge grounding into multiple sources and response generation, which allows easy extension to various knowledge sources including the possibility of not using any sources. To study the problem, we construct a personalized knowledge-grounded dialogue dataset \textit{\textbf{K}nowledge \textbf{B}ehind \textbf{P}ersona}~(\textbf{KBP}), which is the first to consider the dependency between persona and implicit knowledge. Experimental results on the KBP dataset demonstrate that the SAFARI framework can effectively produce persona-consistent and knowledge-enhanced responses.


title: Leveraging Optimal Transport for Enhanced Offline Reinforcement Learning in Surgical Robotic Environments

abstract: Most Reinforcement Learning (RL) methods are traditionally studied in an active learning setting, where agents directly interact with their environments, observe action outcomes, and learn through trial and error. However, allowing partially trained agents to interact with real physical systems poses significant challenges, including high costs, safety risks, and the need for constant supervision. Offline RL addresses these cost and safety concerns by leveraging existing datasets and reducing the need for resource-intensive real-time interactions. Nevertheless, a substantial challenge lies in the demand for these datasets to be meticulously annotated with rewards. In this paper, we introduce Optimal Transport Reward (OTR) labelling, an innovative algorithm designed to assign rewards to offline trajectories, using a small number of high-quality expert demonstrations. The core principle of OTR involves employing Optimal Transport (OT) to calculate an optimal alignment between an unlabeled trajectory from the dataset and an expert demonstration. This alignment yields a similarity measure that is effectively interpreted as a reward signal. An offline RL algorithm can then utilize these reward signals to learn a policy. This approach circumvents the need for handcrafted rewards, unlocking the potential to harness vast datasets for policy learning. Leveraging the SurRoL simulation platform tailored for surgical robot learning, we generate datasets and employ them to train policies using the OTR algorithm. By demonstrating the efficacy of OTR in a different domain, we emphasize its versatility and its potential to expedite RL deployment across a wide range of fields.


title: A Case-Based Persistent Memory for a Large Language Model

abstract: Case-based reasoning (CBR) as a methodology for problem-solving can use any appropriate computational technique. This position paper argues that CBR researchers have somewhat overlooked recent developments in deep learning and large language models (LLMs). The underlying technical developments that have enabled the recent breakthroughs in AI have strong synergies with CBR and could be used to provide a persistent memory for LLMs to make progress towards Artificial General Intelligence.


title: A Longitudinal Analysis about the Effect of Air Pollution on Astigmatism for Children and Young Adults

abstract: Purpose: This study aimed to investigate the correlation between air pollution and astigmatism, considering the detrimental effects of air pollution on respiratory, cardiovascular, and eye health. Methods: A longitudinal study was conducted with 127,709 individuals aged 4-27 years from 9 cities in Guangdong Province, China, spanning from 2019 to 2021. Astigmatism was measured using cylinder values. Multiple measurements were taken at intervals of at least 1 year. Various exposure windows were used to assess the lagged impacts of air pollution on astigmatism. A panel data model with random effects was constructed to analyze the relationship between pollutant exposure and astigmatism. Results: The study revealed significant associations between astigmatism and exposure to carbon monoxide (CO), nitrogen dioxide (NO2), and particulate matter (PM2.5) over time. A 10 {\mu}g/m3 increase in a 3-year exposure window of NO2 and PM2.5 was associated with a decrease in cylinder value of -0.045 diopters and -0.017 diopters, respectively. A 0.1 mg/m3 increase in CO concentration within a 2-year exposure window correlated with a decrease in cylinder value of -0.009 diopters. No significant relationships were found between PM10 exposure and astigmatism. Conclusion: This study concluded that greater exposure to NO2 and PM2.5 over longer periods aggravates astigmatism. The negative effect of CO on astigmatism peaks in the exposure window of 2 years prior to examination and diminishes afterward. No significant association was found between PM10 exposure and astigmatism, suggesting that gaseous and smaller particulate pollutants have easier access to human eyes, causing heterogeneous morphological changes to the eyeball.


title: Impact of Stricter Content Moderation on Parler's Users' Discourse

abstract: Social media platforms employ various content moderation techniques to remove harmful, offensive, and hate speech content. The moderation level varies across platforms; even over time, it can evolve in a platform. For example, Parler, a fringe social media platform popular among conservative users, was known to have the least restrictive moderation policies, claiming to have open discussion spaces for their users. However, after linking the 2021 US Capitol Riots and the activity of some groups on Parler, such as QAnon and Proud Boys, on January 12, 2021, Parler was removed from the Apple and Google App Store and suspended from Amazon Cloud hosting service. Parler would have to modify their moderation policies to return to these online stores. After a month of downtime, Parler was back online with a new set of user guidelines, which reflected stricter content moderation, especially regarding the \emph{hate speech} policy. In this paper, we studied the moderation changes performed by Parler and their effect on the toxicity of its content. We collected a large longitudinal Parler dataset with 17M parleys from 432K active users from February 2021 to January 2022, after its return to the Internet and App Store. To the best of our knowledge, this is the first study investigating the effectiveness of content moderation techniques using data-driven approaches and also the first Parler dataset after its brief hiatus. Our quasi-experimental time series analysis indicates that after the change in Parler's moderation, the severe forms of toxicity (above a threshold of 0.5) immediately decreased and sustained. In contrast, the trend did not change for less severe threats and insults (a threshold between 0.5 - 0.7). Finally, we found an increase in the factuality of the news sites being shared, as well as a decrease in the number of conspiracy or pseudoscience sources being shared.


title: Very high energy gamma-ray emission beyond 10 TeV from GRB 221009A

abstract: The highest energy gamma-rays from gamma-ray bursts (GRBs) have important implications for their radiation mechanism. Here we report for the first time the detection of gamma-rays up to 13 TeV from the brightest GRB 221009A by the Large High Altitude Air-shower Observatory (LHAASO). The LHAASO-KM2A detector registered more than 140 gamma-rays with energies above 3 TeV during 230$-$900s after the trigger. The intrinsic energy spectrum of gamma-rays can be described by a power-law after correcting for extragalactic background light (EBL) absorption. Such a hard spectrum challenges the synchrotron self-Compton (SSC) scenario of relativistic electrons for the afterglow emission above several TeV. Observations of gamma-rays up to 13 TeV from a source with a measured redshift of z=0.151 hints more transparency in intergalactic space than previously expected. Alternatively, one may invoke new physics such as Lorentz Invariance Violation (LIV) or an axion origin of very high energy (VHE) signals.


title: Speaking rate attention-based duration prediction for speed control TTS

abstract: With the advent of high-quality speech synthesis, there is a lot of interest in controlling various prosodic attributes of speech. Speaking rate is an essential attribute towards modelling the expressivity of speech. In this work, we propose a novel approach to control the speaking rate for non-autoregressive TTS. We achieve this by conditioning the speaking rate inside the duration predictor, allowing implicit speaking rate control. We show the benefits of this approach by synthesising audio at various speaking rate factors and measuring the quality of speaking rate-controlled synthesised speech. Further, we study the effect of the speaking rate distribution of the training data towards effective rate control. Finally, we fine-tune a baseline pretrained TTS model to obtain speaking rate control TTS. We provide various analyses to showcase the benefits of using this proposed approach, along with objective as well as subjective metrics. We find that the proposed methods have higher subjective scores and lower speaker rate errors across many speaking rate factors over the baseline.


title: On the Over-Memorization During Natural, Robust and Catastrophic Overfitting

abstract: Overfitting negatively impacts the generalization ability of deep neural networks (DNNs) in both natural and adversarial training. Existing methods struggle to consistently address different types of overfitting, typically designing strategies that focus separately on either natural or adversarial patterns. In this work, we adopt a unified perspective by solely focusing on natural patterns to explore different types of overfitting. Specifically, we examine the memorization effect in DNNs and reveal a shared behaviour termed over-memorization, which impairs their generalization capacity. This behaviour manifests as DNNs suddenly becoming high-confidence in predicting certain training patterns and retaining a persistent memory for them. Furthermore, when DNNs over-memorize an adversarial pattern, they tend to simultaneously exhibit high-confidence prediction for the corresponding natural pattern. These findings motivate us to holistically mitigate different types of overfitting by hindering the DNNs from over-memorization training patterns. To this end, we propose a general framework, Distraction Over-Memorization (DOM), which explicitly prevents over-memorization by either removing or augmenting the high-confidence natural patterns. Extensive experiments demonstrate the effectiveness of our proposed method in mitigating overfitting across various training paradigms.


title: Semi-Supervised End-To-End Contrastive Learning For Time Series Classification

abstract: Time series classification is a critical task in various domains, such as finance, healthcare, and sensor data analysis. Unsupervised contrastive learning has garnered significant interest in learning effective representations from time series data with limited labels. The prevalent approach in existing contrastive learning methods consists of two separate stages: pre-training the encoder on unlabeled datasets and fine-tuning the well-trained model on a small-scale labeled dataset. However, such two-stage approaches suffer from several shortcomings, such as the inability of unsupervised pre-training contrastive loss to directly affect downstream fine-tuning classifiers, and the lack of exploiting the classification loss which is guided by valuable ground truth. In this paper, we propose an end-to-end model called SLOTS (Semi-supervised Learning fOr Time clasSification). SLOTS receives semi-labeled datasets, comprising a large number of unlabeled samples and a small proportion of labeled samples, and maps them to an embedding space through an encoder. We calculate not only the unsupervised contrastive loss but also measure the supervised contrastive loss on the samples with ground truth. The learned embeddings are fed into a classifier, and the classification loss is calculated using the available true labels. The unsupervised, supervised contrastive losses and classification loss are jointly used to optimize the encoder and classifier. We evaluate SLOTS by comparing it with ten state-of-the-art methods across five datasets. The results demonstrate that SLOTS is a simple yet effective framework. When compared to the two-stage framework, our end-to-end SLOTS utilizes the same input data, consumes a similar computational cost, but delivers significantly improved performance. We release code and datasets at https://anonymous.4open.science/r/SLOTS-242E.


title: Path To Gain Functional Transparency In Artificial Intelligence With Meaningful Explainability

abstract: Artificial Intelligence (AI) is rapidly integrating into various aspects of our daily lives, influencing decision-making processes in areas such as targeted advertising and matchmaking algorithms. As AI systems become increasingly sophisticated, ensuring their transparency and explainability becomes crucial. Functional transparency is a fundamental aspect of algorithmic decision-making systems, allowing stakeholders to comprehend the inner workings of these systems and enabling them to evaluate their fairness and accuracy. However, achieving functional transparency poses significant challenges that need to be addressed. In this paper, we propose a design for user-centered compliant-by-design transparency in transparent systems. We emphasize that the development of transparent and explainable AI systems is a complex and multidisciplinary endeavor, necessitating collaboration among researchers from diverse fields such as computer science, artificial intelligence, ethics, law, and social science. By providing a comprehensive understanding of the challenges associated with transparency in AI systems and proposing a user-centered design framework, we aim to facilitate the development of AI systems that are accountable, trustworthy, and aligned with societal values.


title: An unprecedented synergy of high-temperature tensile strength and ductility in a NiCoCrAlTi high-entropy alloy

abstract: The present work reported a novel L12-strengthening NiCoCrAlTi high entropy alloy (HEA) with an outstanding synergy of tensile strength and ductility at both ambient and high temperatures. Transmission electron microscopy (TEM) characterization revealed a high density of rod-like and spheroidal L12 precipitates distributing in the micro/nanograins and non-recrystallized regions in the annealed specimens. The tremendously high yield stress, ultimate tensile stress (UTS), and ductility of the HEA at 600 C were ~1060 MPa, 1271 MPa, and 25%, respectively, which were significantly superior to most reported HEAs and Co- and Ni-based superalloys to date. Systematic TEM analysis unveiled that the cooperation among L12 precipitation, extensive stacking faults (SFs), deformation twins (DTs), immobile Lomer-Cottrell (L-C) locks formed from interactions between SFs and SFs/DTs, hierarchical SFs/DTs networks, as well as hetero-deformation-induced strengthening dominated the plastic deformation at 600 C. Such a unique deformation mechanism enabled extremely high tensile strength and sustained ductility of the HEA at a high temperature.


title: A Two-Stage 2D Channel Extrapolation Scheme for TDD 5G NR Systems

abstract: Recently, channel extrapolation has been widely investigated in frequency division duplex (FDD) massive MIMO systems. However, in time division duplex (TDD) fifth generation (5G) new radio (NR) systems, the channel extrapolation problem also arises due to the hopping uplink pilot pattern, which has not been fully researched yet. This paper addresses this gap by formulating a channel extrapolation problem in TDD massive MIMO-OFDM systems for 5G NR, incorporating imperfection factors. A novel two-stage two-dimensional (2D) channel extrapolation scheme in both frequency and time domain is proposed, designed to mitigate the negative effects of imperfection factors and ensure high-accuracy channel estimation. Specifically, in the channel estimation stage, we propose a novel multi-band and multi-timeslot based high-resolution parameter estimation algorithm to achieve 2D channel extrapolation in the presence of imperfection factors. Then, to avoid repeated multi-timeslot based channel estimation, a channel tracking stage is designed during the subsequent time instants, in which a sparse Markov channel model is formulated to capture the dynamic sparsity of massive MIMO-OFDM channels under the influence of imperfection factors. Next, an expectation-maximization (EM) based compressive channel tracking algorithm is designed to jointly estimate unknown imperfection and channel parameters by exploiting the high-resolution prior information of the delay/angle parameters from the previous timeslots. Simulation results underscore the superior performance of our proposed channel extrapolation scheme over baselines.


title: Thin-shell gravastar in a noncommutative BTZ geometry

abstract: In this paper, we build a thin-shell gravastar model within a noncommutative BTZ geometry. For this, we consider a noncommutative BTZ metric in the inner region and a geometry associated with a BTZ solution in the outer region, joined by the generalized join technique. After investigating the inner spacetime, surface and outer spacetime, we observe that there is a surface energy density and surface pressure, such as to make gravastar stable. This effect persists even when the cosmological constant is zero. Besides, we found a bound for the noncommutativity parameter. In addition, we examine the thermodynamics of the noncommutative BTZ black hole in Schwarzschildtype form in three-dimensional spacetime. We also check the stability condition by calculating the specific heat capacity.


title: Spatially Continuous Non-Contact Cold Sensation Presentation Based on Low-Temperature Airflows

abstract: Our perception of cold enriches our understanding of the world and allows us to interact with it. Therefore, the presentation of cold sensations will be beneficial in improving the sense of immersion and presence in virtual reality and the metaverse. This study proposed a novel method for spatially continuous cold sensation presentation based on low-temperature airflows. We defined the shortest distance between two airflows perceived as different cold stimuli as a local cold stimulus group discrimination threshold (LCSGDT). By setting the distance between airflows within the LCSGDT, spatially continuous cold sensations can be achieved with an optimal number of cold airflows. We hypothesized that the LCSGDTs are related to the heat-transfer capability of airflows and developed a model to relate them. We investigated the LCSGDTs at a flow rate of 25 L/min and presentation distances ranging from 10 to 50 mm. The results showed that under these conditions, the LCSGDTs are 131.4 $\pm$ 1.9 mm, and the heat-transfer capacity of the airflow corresponding to these LCSGDTs is an almost constant value, that is, 0.92.


title: Rank-DETR for High Quality Object Detection

abstract: Modern detection transformers (DETRs) use a set of object queries to predict a list of bounding boxes, sort them by their classification confidence scores, and select the top-ranked predictions as the final detection results for the given input image. A highly performant object detector requires accurate ranking for the bounding box predictions. For DETR-based detectors, the top-ranked bounding boxes suffer from less accurate localization quality due to the misalignment between classification scores and localization accuracy, thus impeding the construction of high-quality detectors. In this work, we introduce a simple and highly performant DETR-based object detector by proposing a series of rank-oriented designs, combinedly called Rank-DETR. Our key contributions include: (i) a rank-oriented architecture design that can prompt positive predictions and suppress the negative ones to ensure lower false positive rates, as well as (ii) a rank-oriented loss function and matching cost design that prioritizes predictions of more accurate localization accuracy during ranking to boost the AP under high IoU thresholds. We apply our method to improve the recent SOTA methods (e.g., H-DETR and DINO-DETR) and report strong COCO object detection results when using different backbones such as ResNet-$50$, Swin-T, and Swin-L, demonstrating the effectiveness of our approach. Code is available at \url{https://github.com/LeapLabTHU/Rank-DETR}.


title: Overcoming Recency Bias of Normalization Statistics in Continual Learning: Balance and Adaptation

abstract: Continual learning entails learning a sequence of tasks and balancing their knowledge appropriately. With limited access to old training samples, much of the current work in deep neural networks has focused on overcoming catastrophic forgetting of old tasks in gradient-based optimization. However, the normalization layers provide an exception, as they are updated interdependently by the gradient and statistics of currently observed training samples, which require specialized strategies to mitigate recency bias. In this work, we focus on the most popular Batch Normalization (BN) and provide an in-depth theoretical analysis of its sub-optimality in continual learning. Our analysis demonstrates the dilemma between balance and adaptation of BN statistics for incremental tasks, which potentially affects training stability and generalization. Targeting on these particular challenges, we propose Adaptive Balance of BN (AdaB$^2$N), which incorporates appropriately a Bayesian-based strategy to adapt task-wise contributions and a modified momentum to balance BN statistics, corresponding to the training and testing stages. By implementing BN in a continual learning fashion, our approach achieves significant performance gains across a wide range of benchmarks, particularly for the challenging yet realistic online scenarios (e.g., up to 7.68%, 6.86% and 4.26% on Split CIFAR-10, Split CIFAR-100 and Split Mini-ImageNet, respectively). Our code is available at https://github.com/lvyilin/AdaB2N.


title: Two-parameter estimation with single squeezed-light interferometer via double homodyne detection

abstract: The simultaneous two-parameter estimation problem in single squeezed-light Mach-Zehnder interferometer with double-port homodyne detection is investigated in this work. The analytical form of the two-parameter quantum Cramer-Bao bound defined by the quantum Fisher information matrix is presented, which shows the ultimate limit of the phase sensitivity will be further approved by the squeezed vacuum state. It can not only surpass the shot-noise limit, but also can even surpass the Heisenberg limit when half of the input intensity of the interferometer is provided by the coherent state and half by the squeezed light. For the double-port homodyne detection, the classical Fisher information matrix is also obtained. Our results show that although the classical Cramer-Rao bound does not saturate the quantum one, it can still asymptotically approach the quantum Cramer -Bao bound when the intensity of the coherent state is large enough. Our results also indicate that the squeezed vacuum state indeed can further improve the phase sensitivity. In addition, when half of the input intensity of the interferometer is provided by the coherent state and half by the squeezed light, the phase sensitivity obtained by the double-port homodyne detection can surpass the Heisenberg limit for a small range of the estimated phase.


title: Transmission Planning for Climate-impacted Renewable Energy Grid: Data Preparation, Model Improvement, and Evaluation

abstract: As renewable energy is becoming the major resource in future grids, the weather and climate can have higher impact on the grid reliability. Transmission expansion planning (TEP) has the potential to reinforce a transmission network that is suitable for climate-impacted grids. In this paper, we propose a systematic TEP procedure for climate-impacted renewable energy-enriched grids. Particularly, this work developed an improved model for TEP considering climate impact (TEP-CI) and evaluated the system reliability with the obtained transmission investment plan. Firstly, we created climate-impacted spatio temporal future grid data to facilitate the TEP-CI study, which includes the future climate-dependent renewable production as well as the dynamic rating profiles of the Texas 123-bus backbone transmission system (TX-123BT). Secondly, we proposed the TEP-CI which considers the variation in renewable production and dynamic line rating, and obtained the investment plan for future TX-123BT. Thirdly, we presented a customized security-constrained unit commitment (SCUC) specifically for climate-impacted grids. The future grid reliability under various investment scenarios is analyzed, based on the daily operation conditions from SCUC simulations. The whole procedure presented in this paper enables numerical studies on grid planning considering climate-impacts. It can also serve as a benchmark for other TEP-CI research and performance evaluation.


title: Adam-family Methods with Decoupled Weight Decay in Deep Learning

abstract: In this paper, we investigate the convergence properties of a wide class of Adam-family methods for minimizing quadratically regularized nonsmooth nonconvex optimization problems, especially in the context of training nonsmooth neural networks with weight decay. Motivated by the AdamW method, we propose a novel framework for Adam-family methods with decoupled weight decay. Within our framework, the estimators for the first-order and second-order moments of stochastic subgradients are updated independently of the weight decay term. Under mild assumptions and with non-diminishing stepsizes for updating the primary optimization variables, we establish the convergence properties of our proposed framework. In addition, we show that our proposed framework encompasses a wide variety of well-known Adam-family methods, hence offering convergence guarantees for these methods in the training of nonsmooth neural networks. More importantly, we show that our proposed framework asymptotically approximates the SGD method, thereby providing an explanation for the empirical observation that decoupled weight decay enhances generalization performance for Adam-family methods. As a practical application of our proposed framework, we propose a novel Adam-family method named Adam with Decoupled Weight Decay (AdamD), and establish its convergence properties under mild conditions. Numerical experiments demonstrate that AdamD outperforms Adam and is comparable to AdamW, in the aspects of both generalization performance and efficiency.


title: Scattering and Blow-up for threshold even solutions to the nonlinear Schr\"{o}dinger equation with repulsive delta potential at low frequencies

abstract: We consider the $L^2$-supercritical nonlinear Schr\"{o}dinger equation with a repulsive Dirac delta potential in one dimensional space. In a previous work, we clarified the global dynamics of even solutions with the same action as the high-frequency ground state standing wave solutions. In that case, there are obvious non-scattering global solutions, i.e., the standing waves. In this paper, we show a scattering and blow-up dichotomy for threshold even solutions in the low-frequency case. We emphasize that this dichotomy still holds at the critical frequency between high and low.


title: Guiding AMR Parsing with Reverse Graph Linearization

abstract: Abstract Meaning Representation (AMR) parsing aims to extract an abstract semantic graph from a given sentence. The sequence-to-sequence approaches, which linearize the semantic graph into a sequence of nodes and edges and generate the linearized graph directly, have achieved good performance. However, we observed that these approaches suffer from structure loss accumulation during the decoding process, leading to a much lower F1-score for nodes and edges decoded later compared to those decoded earlier. To address this issue, we propose a novel Reverse Graph Linearization (RGL) enhanced framework. RGL defines both default and reverse linearization orders of an AMR graph, where most structures at the back part of the default order appear at the front part of the reversed order and vice versa. RGL incorporates the reversed linearization to the original AMR parser through a two-pass self-distillation mechanism, which guides the model when generating the default linearizations. Our analysis shows that our proposed method significantly mitigates the problem of structure loss accumulation, outperforming the previously best AMR parsing model by 0.8 and 0.5 Smatch scores on the AMR 2.0 and AMR 3.0 dataset, respectively. The code are available at https://github.com/pkunlp-icler/AMR_reverse_graph_linearization.


title: Re-initialization-free Level Set Method via Molecular Beam Epitaxy Equation Regularization for Image Segmentation

abstract: Variational level set method has become a powerful tool in image segmentation due to its ability to handle complex topological changes and maintain continuity and smoothness in the process of evolution. However its evolution process can be unstable, which results in over flatted or over sharpened contours and segmentation failure. To improve the accuracy and stability of evolution, we propose a high-order level set variational segmentation method integrated with molecular beam epitaxy (MBE) equation regularization. This method uses the crystal growth in the MBE process to limit the evolution of the level set function, and thus can avoid the re-initialization in the evolution process and regulate the smoothness of the segmented curve. It also works for noisy images with intensity inhomogeneity, which is a challenge in image segmentation. To solve the variational model, we derive the gradient flow and design scalar auxiliary variable (SAV) scheme coupled with fast Fourier transform (FFT), which can significantly improve the computational efficiency compared with the traditional semi-implicit and semi-explicit scheme. Numerical experiments show that the proposed method can generate smooth segmentation curves, retain fine segmentation targets and obtain robust segmentation results of small objects. Compared to existing level set methods, this model is state-of-the-art in both accuracy and efficiency.