title: TIDo: Source-free Task Incremental Learning in Non-stationary Environments

abstract: This work presents an incremental learning approach for autonomous agents to learn new tasks in a non-stationary environment. Updating a DNN model-based agent to learn new target tasks requires us to store past training data and needs a large labeled target task dataset. Few-shot task incremental learning methods overcome the limitation of labeled target datasets by adapting trained models to learn private target classes using a few labeled representatives and a large unlabeled target dataset. However, the methods assume that the source and target tasks are stationary. We propose a one-shot task incremental learning approach that can adapt to non-stationary source and target tasks. Our approach minimizes adversarial discrepancy between the model's feature space and incoming incremental data to learn an updated hypothesis. We also use distillation loss to reduce catastrophic forgetting of previously learned tasks. Finally, we use Gaussian prototypes to generate exemplar instances eliminating the need to store past training data. Unlike current work in task incremental learning, our model can learn both source and target task updates incrementally. We evaluate our method on various problem settings for incremental object detection and disease prediction model update. We evaluate our approach by measuring the performance of shared class and target private class prediction. Our results show that our approach achieved improved performance compared to existing state-of-the-art task incremental learning methods.


title: Variational Latent Branching Model for Off-Policy Evaluation

abstract: Model-based methods have recently shown great potential for off-policy evaluation (OPE); offline trajectories induced by behavioral policies are fitted to transitions of Markov decision processes (MDPs), which are used to rollout simulated trajectories and estimate the performance of policies. Model-based OPE methods face two key challenges. First, as offline trajectories are usually fixed, they tend to cover limited state and action space. Second, the performance of model-based methods can be sensitive to the initialization of their parameters. In this work, we propose the variational latent branching model (VLBM) to learn the transition function of MDPs by formulating the environmental dynamics as a compact latent space, from which the next states and rewards are then sampled. Specifically, VLBM leverages and extends the variational inference framework with the recurrent state alignment (RSA), which is designed to capture as much information underlying the limited training data, by smoothing out the information flow between the variational (encoding) and generative (decoding) part of VLBM. Moreover, we also introduce the branching architecture to improve the model's robustness against randomly initialized model weights. The effectiveness of the VLBM is evaluated on the deep OPE (DOPE) benchmark, from which the training trajectories are designed to result in varied coverage of the state-action space. We show that the VLBM outperforms existing state-of-the-art OPE methods in general.


title: Object Preserving Siamese Network for Single Object Tracking on Point Clouds

abstract: Obviously, the object is the key factor of the 3D single object tracking (SOT) task. However, previous Siamese-based trackers overlook the negative effects brought by randomly dropped object points during backbone sampling, which hinder trackers to predict accurate bounding boxes (BBoxes). Exploring an approach that seeks to maximize the preservation of object points and their object-aware features is of particular significance. Motivated by this, we propose an Object Preserving Siamese Network (OPSNet), which can significantly maintain object integrity and boost tracking performance. Firstly, the object highlighting module enhances the object-aware features and extracts discriminative features from template and search area. Then, the object-preserved sampling selects object candidates to obtain object-preserved search area seeds and drop the background points that contribute less to tracking. Finally, the object localization network precisely locates 3D BBoxes based on the object-preserved search area seeds. Extensive experiments demonstrate our method outperforms the state-of-the-art performance (9.4% and 2.5% success gain on KITTI and Waymo Open Dataset respectively).


title: Aerial Image Object Detection With Vision Transformer Detector (ViTDet)

abstract: The past few years have seen an increased interest in aerial image object detection due to its critical value to large-scale geo-scientific research like environmental studies, urban planning, and intelligence monitoring. However, the task is very challenging due to the birds-eye view perspective, complex backgrounds, large and various image sizes, different appearances of objects, and the scarcity of well-annotated datasets. Recent advances in computer vision have shown promise tackling the challenge. Specifically, Vision Transformer Detector (ViTDet) was proposed to extract multi-scale features for object detection. The empirical study shows that ViTDet's simple design achieves good performance on natural scene images and can be easily embedded into any detector architecture. To date, ViTDet's potential benefit to challenging aerial image object detection has not been explored. Therefore, in our study, 25 experiments were carried out to evaluate the effectiveness of ViTDet for aerial image object detection on three well-known datasets: Airbus Aircraft, RarePlanes, and Dataset of Object DeTection in Aerial images (DOTA). Our results show that ViTDet can consistently outperform its convolutional neural network counterparts on horizontal bounding box (HBB) object detection by a large margin (up to 17% on average precision) and that it achieves the competitive performance for oriented bounding box (OBB) object detection. Our results also establish a baseline for future research.


title: Potential energy surface prediction of Alumina polymorphs using graph neural network

abstract: The process of design and discovery of new materials can be significantly expedited and simplified if we can learn effectively from available data. Deep learning (DL) approaches have recently received a lot of interest for their ability to speed up the design of novel materials by predicting material properties with precision close to experiments and ab-initio calculations. The application of deep learning to predict materials properties measured by experiments are valuable yet challenging due to the limited amount of experimental data. Most of the existing approaches to predict properties from computational data have also been directed towards specific material properties. In this work, we extend this approach, by proposing Landscape Crystal Graph Convolution Network(LCGCN), an accurate and transferable deep learning framework based on graph convolutional networks. LCGCN directly learns the potential energy surface (PES) from atomic configurations. This approach can enable transferable models that can predict different material properties. We apply this framework to bulk crystals (i.e. Al2O3), and test it by calculating potential energy surfaces at different temperatures and across different phases of crystal.


title: An Unbounded Fully Homomorphic Encryption Scheme Based on Ideal Lattices and Chinese Remainder Theorem

abstract: We propose an unbounded fully homomorphic encryption scheme, i.e. a scheme that allows one to compute on encrypted data for any desired functions without needing to decrypt the data or knowing the decryption keys. This is a rational solution to an old problem proposed by Rivest, Adleman, and Dertouzos \cite{32} in 1978, and to some new problems appeared in Peikert \cite{28} as open questions 10 and open questions 11 a few years ago. Our scheme is completely different from the breakthrough work \cite{14,15} of Gentry in 2009. Gentry's bootstrapping technique constructs a fully homomorphic encryption (FHE) scheme from a somewhat homomorphic one that is powerful enough to evaluate its own decryption function. To date, it remains the only known way of obtaining unbounded FHE. Our construction of unbounded FHE scheme is straightforward and noise-free that can handle unbounded homomorphic computation on any refreshed ciphertexts without bootstrapping transformation technique.


title: (Private) Kernelized Bandits with Distributed Biased Feedback

abstract: In this paper, we study kernelized bandits with distributed biased feedback. This problem is motivated by several real-world applications (such as dynamic pricing, cellular network configuration, and policy making), where users from a large population contribute to the reward of the action chosen by a central entity, but it is difficult to collect feedback from all users. Instead, only biased feedback (due to user heterogeneity) from a subset of users may be available. In addition to such partial biased feedback, we are also faced with two practical challenges due to communication cost and computation complexity. To tackle these challenges, we carefully design a new \emph{distributed phase-then-batch-based elimination (\texttt{DPBE})} algorithm, which samples users in phases for collecting feedback to reduce the bias and employs \emph{maximum variance reduction} to select actions in batches within each phase. By properly choosing the phase length, the batch size, and the confidence width used for eliminating suboptimal actions, we show that \texttt{DPBE} achieves a sublinear regret of $\tilde{O}(T^{1-\alpha/2}+\sqrt{\gamma_T T})$, where $\alpha\in (0,1)$ is the user-sampling parameter one can tune. Moreover, \texttt{DPBE} can significantly reduce both communication cost and computation complexity in distributed kernelized bandits, compared to some variants of the state-of-the-art algorithms (originally developed for standard kernelized bandits). Furthermore, by incorporating various \emph{differential privacy} models (including the central, local, and shuffle models), we generalize \texttt{DPBE} to provide privacy guarantees for users participating in the distributed learning process. Finally, we conduct extensive simulations to validate our theoretical results and evaluate the empirical performance.


title: Physics-guided Residual Learning for Probabilistic Power Flow Analysis

abstract: Probabilistic power flow (PPF) analysis is critical to power system operation and planning. PPF aims at obtaining probabilistic descriptions of the state of the system with stochastic power injections (e.g., renewable power generation and load demands). Given power injection samples, numerical methods repeatedly run classic power flow (PF) solvers to find the voltage phasors. However, the computational burden is heavy due to many PF simulations. Recently, many data-driven based PF solvers have been proposed due to the availability of sufficient measurements. This paper proposes a novel neural network (NN) framework which can accurately approximate the non-linear AC-PF equations. The trained NN works as a rapid PF solver, significantly reducing the heavy computational burden in classic PPF analysis. Inspired by residual learning, we develop a fully connected linear layer between the input and output in the multilayer perceptron (MLP). To improve the NN training convergence, we propose three schemes to initialize the NN weights of the shortcut connection layer based on the physical characteristics of AC-PF equations. Specifically, two model-based methods require the knowledge of system topology and line parameters, while the purely data-driven method can work without power grid parameters. Numerical tests on five benchmark systems show that our proposed approaches achieve higher accuracy in estimating voltage phasors than existing methods. In addition, three meticulously designed initialization schemes help the NN training process converge faster, which is appealing under limited training time.


title: HAT-GAE: Self-Supervised Graph Auto-encoders with Hierarchical Adaptive Masking and Trainable Corruption

abstract: Self-supervised auto-encoders have emerged as a successful framework for representation learning in computer vision and natural language processing in recent years, However, their application to graph data has been met with limited performance due to the non-Euclidean and complex structure of graphs in comparison to images or text, as well as the limitations of conventional auto-encoder architectures. In this paper, we investigate factors impacting the performance of auto-encoders on graph data and propose a novel auto-encoder model for graph representation learning. Our model incorporates a hierarchical adaptive masking mechanism to incrementally increase the difficulty of training in order to mimic the process of human cognitive learning, and a trainable corruption scheme to enhance the robustness of learned representations. Through extensive experimentation on ten benchmark datasets, we demonstrate the superiority of our proposed method over state-of-the-art graph representation learning models.


title: Optimizing a Bayesian method for estimating the Hurst exponent in behavioral sciences

abstract: The Bayesian Hurst-Kolmogorov (HK) method estimates the Hurst exponent of a time series more accurately than the age-old detrended fluctuation analysis (DFA), especially when the time series is short. However, this advantage comes at the cost of computation time. The computation time increases exponentially with $N$, easily exceeding several hours for $N = 1024$, limiting the utility of the HK method in real-time paradigms, such as biofeedback and brain-computer interfaces. To address this issue, we have provided data on the estimation accuracy of $H$ for synthetic time series as a function of \textit{a priori} known values of $H$, the time series length, and the simulated sample size from the posterior distribution -- a critical step in the Bayesian estimation method. The simulated sample from the posterior distribution as small as $n = 25$ suffices to estimate $H$ with reasonable accuracy for a time series as short as $256$ measurements. Using a larger simulated sample from the posterior distribution -- i.e., $n > 50$ -- provides only marginal gain in accuracy, which might not be worth trading off with computational efficiency. We suggest balancing the simulated sample size from the posterior distribution of $H$ with the computational resources available to the user, preferring a minimum of $n = 50$ and opting for larger sample sizes based on time and resource constraints


title: Decentralized Entropic Optimal Transport for Privacy-preserving Distributed Distribution Comparison

abstract: Privacy-preserving distributed distribution comparison measures the distance between the distributions whose data are scattered across different agents in a distributed system and cannot be shared among the agents. In this study, we propose a novel decentralized entropic optimal transport (EOT) method, which provides a privacy-preserving and communication-efficient solution to this problem with theoretical guarantees. In particular, we design a mini-batch randomized block-coordinate descent (MRBCD) scheme to optimize the decentralized EOT distance in its dual form. The dual variables are scattered across different agents and updated locally and iteratively with limited communications among partial agents. The kernel matrix involved in the gradients of the dual variables is estimated by a distributed kernel approximation method, and each agent only needs to approximate and store a sub-kernel matrix by one-shot communication and without sharing raw data. We analyze our method's communication complexity and provide a theoretical bound for the approximation error caused by the convergence error, the approximated kernel, and the mismatch between the storage and communication protocols. Experiments on synthetic data and real-world distributed domain adaptation tasks demonstrate the effectiveness of our method.


title: Truth Machines: Synthesizing Veracity in AI Language Models

abstract: As AI technologies are rolled out into healthcare, academia, human resources, law, and a multitude of other domains, they become de-facto arbiters of truth. But truth is highly contested, with many different definitions and approaches. This article discusses the struggle for truth in AI systems and the general responses to date. It then investigates the production of truth in InstructGPT, a large language model, highlighting how data harvesting, model architectures, and social feedback mechanisms weave together disparate understandings of veracity. It conceptualizes this performance as an operationalization of truth, where distinct, often conflicting claims are smoothly synthesized and confidently presented into truth-statements. We argue that these same logics and inconsistencies play out in Instruct's successor, ChatGPT, reiterating truth as a non-trivial problem. We suggest that enriching sociality and thickening "reality" are two promising vectors for enhancing the truth-evaluating capacities of future language models. We conclude, however, by stepping back to consider AI truth-telling as a social practice: what kind of "truth" do we as listeners desire?


title: Learning Optimal Features via Partial Invariance

abstract: Learning models that are robust to distribution shifts is a key concern in the context of their real-life applicability. Invariant Risk Minimization (IRM) is a popular framework that aims to learn robust models from multiple environments. The success of IRM requires an important assumption: the underlying causal mechanisms/features remain invariant across environments. When not satisfied, we show that IRM can over-constrain the predictor and to remedy this, we propose a relaxation via $\textit{partial invariance}$. In this work, we theoretically highlight the sub-optimality of IRM and then demonstrate how learning from a partition of training domains can help improve invariant models. Several experiments, conducted both in linear settings as well as with deep neural networks on tasks over both language and image data, allow us to verify our conclusions.


title: Pre-Training Protein Encoder via Siamese Sequence-Structure Diffusion Trajectory Prediction

abstract: Self-supervised pre-training methods on proteins have recently gained attention, with most approaches focusing on either protein sequences or structures, neglecting the exploration of their joint distribution, which is crucial for a comprehensive understanding of protein functions by integrating co-evolutionary information and structural characteristics. In this work, inspired by the success of denoising diffusion models in generative tasks, we propose the DiffPreT approach to pre-train a protein encoder by sequence-structure joint diffusion modeling. DiffPreT guides the encoder to recover the native protein sequences and structures from the perturbed ones along the joint diffusion trajectory, which acquires the joint distribution of sequences and structures. Considering the essential protein conformational variations, we enhance DiffPreT by a method called Siamese Diffusion Trajectory Prediction (SiamDiff) to capture the correlation between different conformers of a protein. SiamDiff attains this goal by maximizing the mutual information between representations of diffusion trajectories of structurally-correlated conformers. We study the effectiveness of DiffPreT and SiamDiff on both atom- and residue-level structure-based protein understanding tasks. Experimental results show that the performance of DiffPreT is consistently competitive on all tasks, and SiamDiff achieves new state-of-the-art performance, considering the mean ranks on all tasks. Our implementation is available at https://github.com/DeepGraphLearning/SiamDiff.


title: Dynamical Generation of Epsilon-Near-Zero Behaviour via Tracking and Feedback Control

abstract: To date, epsilon near zero (ENZ) responses, characterized by an infinite phase velocity, are primarily achieved by applying a monochromatic light source to a tailored metamaterial. Here, we derive the equations for inducing a dynamically generated broadband ENZ response in a large class of many-body systems via tracking and feedback control. We further find that this response leads to a current-energy relationship identical to that of an ideal inductor. Using a Fermi-Hubbard model, we numerically confirm these results which have the potential to advance optical computation on the nanoscale.


title: Wright's Strict Finitistic Logic in the Classical Metatheory: The Propositional Case

abstract: Crispin Wright in his 1982 paper argues for strict finitism, a constructive standpoint that is more restrictive than intuitionism. In its appendix, he proposes models of strict finitistic arithmetic. They are tree-like structures, formed in his strict finitistic metatheory, of equations between numerals on which concrete arithmetical sentences are evaluated. As a first step towards classical formalisation of strict finitism, we propose their counterparts in the classical metatheory with one additional assumption, and then extract the propositional part of `strict finitistic logic' from it and investigate. We will provide a sound and complete pair of a Kripke-style semantics and a sequent calculus, and compare with other logics. The logic lacks the law of excluded middle and Modus Ponens and is weaker than classical logic, but stronger than any proper intermediate logics in terms of theoremhood. In fact, all the other well-known classical theorems are found to be theorems. Finally, we will make an observation that models of this semantics can be seen as nodes of an intuitionistic model.


title: RCsearcher: Reaction Center Identification in Retrosynthesis via Deep Q-Learning

abstract: The reaction center consists of atoms in the product whose local properties are not identical to the corresponding atoms in the reactants. Prior studies on reaction center identification are mainly on semi-templated retrosynthesis methods. Moreover, they are limited to single reaction center identification. However, many reaction centers are comprised of multiple bonds or atoms in reality. We refer to it as the multiple reaction center. This paper presents RCsearcher, a unified framework for single and multiple reaction center identification that combines the advantages of the graph neural network and deep reinforcement learning. The critical insight in this framework is that the single or multiple reaction center must be a node-induced subgraph of the molecular product graph. At each step, it considers choosing one node in the molecular product graph and adding it to the explored node-induced subgraph as an action. Comprehensive experiments demonstrate that RCsearcher consistently outperforms other baselines and can extrapolate the reaction center patterns that have not appeared in the training set. Ablation experiments verify the effectiveness of individual components, including the beam search and one-hop constraint of action space.


title: Unbiased estimators for the Heston model with stochastic interest rates

abstract: We combine the unbiased estimators in Rhee and Glynn (Operations Research: 63(5), 1026-1043, 2015) and the Heston model with stochastic interest rates. Specifically, we first develop a semi-exact log-Euler scheme for the Heston model with stochastic interest rates. Then, under mild assumptions, we show that the convergence rate in the $L^2$ norm is $O(h)$, where $h$ is the step size. The result applies to a large class of models, such as the Heston-Hull-While model, the Heston-CIR model and the Heston-Black-Karasinski model. Numerical experiments support our theoretical convergence rate.


title: Towards Equitable Representation in Text-to-Image Synthesis Models with the Cross-Cultural Understanding Benchmark (CCUB) Dataset

abstract: It has been shown that accurate representation in media improves the well-being of the people who consume it. By contrast, inaccurate representations can negatively affect viewers and lead to harmful perceptions of other cultures. To achieve inclusive representation in generated images, we propose a culturally-aware priming approach for text-to-image synthesis using a small but culturally curated dataset that we collected, known here as Cross-Cultural Understanding Benchmark (CCUB) Dataset, to fight the bias prevalent in giant datasets. Our proposed approach is comprised of two fine-tuning techniques: (1) Adding visual context via fine-tuning a pre-trained text-to-image synthesis model, Stable Diffusion, on the CCUB text-image pairs, and (2) Adding semantic context via automated prompt engineering using the fine-tuned large language model, GPT-3, trained on our CCUB culturally-aware text data. CCUB dataset is curated and our approach is evaluated by people who have a personal relationship with that particular culture. Our experiments indicate that priming using both text and image is effective in improving the cultural relevance and decreasing the offensiveness of generated images while maintaining quality.


title: Comparing Intrinsic Gender Bias Evaluation Measures without using Human Annotated Examples

abstract: Numerous types of social biases have been identified in pre-trained language models (PLMs), and various intrinsic bias evaluation measures have been proposed for quantifying those social biases. Prior works have relied on human annotated examples to compare existing intrinsic bias evaluation measures. However, this approach is not easily adaptable to different languages nor amenable to large scale evaluations due to the costs and difficulties when recruiting human annotators. To overcome this limitation, we propose a method to compare intrinsic gender bias evaluation measures without relying on human-annotated examples. Specifically, we create multiple bias-controlled versions of PLMs using varying amounts of male vs. female gendered sentences, mined automatically from an unannotated corpus using gender-related word lists. Next, each bias-controlled PLM is evaluated using an intrinsic bias evaluation measure, and the rank correlation between the computed bias scores and the gender proportions used to fine-tune the PLMs is computed. Experiments on multiple corpora and PLMs repeatedly show that the correlations reported by our proposed method that does not require human annotated examples are comparable to those computed using human annotated examples in prior work.


title: An Examination of Ranked Choice Voting in the United States, 2004-2022

abstract: From the perspective of social choice theory, ranked-choice voting (RCV) is known to have many flaws. RCV can fail to elect a Condorcet winner and is susceptible to monotonicity paradoxes and the spoiler effect, for example. We use a database of 182 American ranked-choice elections for political office from the years 2004-2022 to investigate empirically how frequently RCV's deficiencies manifest in practice. Our general finding is that RCV's weaknesses are rarely observed in real-world elections, with the exception that ballot exhaustion frequently causes majoritarian failures.


title: Difference between signal and background of the chiral magnetic effect relative to spectator and participant planes in isobar collisions at $\sqrt{s_{_{\rm NN}}} = 200$ GeV

abstract: The search for the chiral magnetic effect (CME) in relativistic heavy-ion collisions helps us understand the $\mathcal{CP}$ symmetry breaking in strong interactions and the topological nature of the QCD vacuum. Since the background and signal of the CME have different correlations with the spectator and participant planes, a two-plane method has been proposed to extract the fraction of the CME signal inside the CME observable of $\Delta\gamma$ from the experimental measurements relative to the two planes. Using a multiphase transport model with different strengths of the CME, we reexamine the two-plane method in isobar collisions at $\sqrt{s_{_{\rm NN}}} = 200$ GeV. The ratios of the CME signals and the elliptic flow backgrounds relative to the two different planes are found to be different, which is inconsistent with the assumptions made in the current experimental measurements. This difference arises from the decorrelation effect of the chiral magnetic effect relative to the spectator and participant planes caused by final state interactions. Our finding suggests that the current experimental measurements may overestimate the fraction of the CME signal in the CME observable in the final state of relativistic heavy-ion collisions.


title: ALIM: Adjusting Label Importance Mechanism for Noisy Partial Label Learning

abstract: Noisy partial label learning (noisy PLL) is an important branch of weakly supervised learning. Unlike PLL where the ground-truth label must conceal in the candidate label set, noisy PLL relaxes this constraint and allows the ground-truth label may not be in the candidate label set. To address this challenging problem, most of the existing works attempt to detect noisy samples and estimate the ground-truth label for each noisy sample. However, detection errors are unavoidable. These errors can accumulate during training and continuously affect model optimization. To this end, we propose a novel framework for noisy PLL with theoretical guarantees, called ``Adjusting Label Importance Mechanism (ALIM)''. It aims to reduce the negative impact of detection errors by trading off the initial candidate set and model outputs. ALIM is a plug-in strategy that can be integrated with existing PLL approaches. Experimental results on benchmark datasets demonstrate that our method can achieve state-of-the-art performance on noisy PLL. \textcolor[rgb]{0.93,0.0,0.47}{Our code can be found in Supplementary Material}.


title: Division and new multiplication between vectors

abstract: The division between two vectors belonging to the same vector space is obtained by elementary procedures of vector algebra and is defined by a matrix. This representation is obtained for two and three dimensional vector spaces. A new vector multiplication is defined and an the inverse vector. Through this multiplication we can obtain the division previously defined.The meaning of vector division and multiplication are analyzed.


title: Surface and hypersurface meshing techniques for space-time finite element methods

abstract: A general method is introduced for constructing two-dimensional (2D) surface meshes embedded in three-dimensional (3D) space time, and 3D hypersurface meshes embedded in four-dimensional (4D) space time. In particular, we begin by dividing the space-time domain into time slabs. Each time slab is equipped with an initial plane (hyperplane), in conjunction with an unstructured simplicial surface (hypersurface) mesh that covers the initial plane. We then obtain the vertices of the terminating plane (hyperplane) of the time slab from the vertices of the initial plane using a space-time trajectory-tracking approach. Next, these vertices are used to create an unstructured simplicial mesh on the terminating plane (hyperplane). Thereafter, the initial and terminating boundary vertices are stitched together to form simplicial meshes on the intermediate surfaces or sides of the time slab. After describing this new mesh-generation method in rigorous detail, we provide the results of multiple numerical experiments which demonstrate its validity and flexibility.


title: Yosida Distance and Existence of Invariant Manifolds in the Infinite-Dimensional Dynamical Systems

abstract: We introduce a new concept of Yosida distance between two (unbounded) linear operators $A$ and $B$ in a Banach space $\mathbb{X}$ defined as $d_Y(A,B):=\limsup_{\mu\to +\infty} \| A_\mu-B_\mu\|$, where $A_\mu$ and $B_\mu$ are the Yosida approximations of $A$ and $B$, respectively, and then study the persistence of evolution equations under small Yosida perturbation. This new concept of distance is also used to define the continuity of the proto-derivative of the operator $F$ in the equation $u'(t)=Fu(t)$, where $F \colon D(F)\subset \mathbb{X} \rightarrow \mathbb{X}$ is a nonlinear operator. We show that the above-mentioned equation has local stable and unstable invariant manifolds near an exponentially dichotomous equilibrium if the proto-derivative of $F$ is continuous. The Yosida distance approach to perturbation theory allows us to free the requirement on the domains of the perturbation operators. Finally, the obtained results seem to be new.


title: A Hierarchy of Multipartite Nonlocality and Device-Independent Effect Witnesses

abstract: According to recent new definitions, a multi-party behavior is genuinely multipartite nonlocal (GMNL) if it cannot be modeled by measurements on an underlying network of bipartite-only nonlocal resources, possibly supplemented with local (classical) resources shared by all parties. The new definitions differ on whether to allow entangled measurements upon, and/or superquantum behaviors among, the underlying bipartite resources. Here, we categorize the full hierarchy of these new candidate definitions of GMNL in three-party quantum networks, highlighting the intimate link to device-independent witnesses of network effects. A key finding is the existence of a behavior in the simplest nontrivial multi-partite measurement scenario (3 parties, 2 measurement settings, and 2 outcomes) that cannot be simulated in a bipartite network prohibiting entangled measurements and superquantum resources -- thus witnessing the most general form of GMNL -- but can be simulated with bipartite-only quantum states with an entangled measurement, indicating an approach to device independent certification of entangled measurements with fewer settings than in previous protocols. Surprisingly, we also find that this (3,2,2) behavior, as well as the others previously studied as device-independent witnesses of entangled measurements, can all be simulated at a higher echelon of the GMNL hierarchy that allows superquantum bipartite resources while still prohibiting entangled measurements. This poses a challenge to a theory-independent understanding of entangled measurements as an observable phenomenon distinct from bipartite nonlocality.


title: Pushing the Limits of Fewshot Anomaly Detection in Industry Vision: Graphcore

abstract: In the area of fewshot anomaly detection (FSAD), efficient visual feature plays an essential role in memory bank M-based methods. However, these methods do not account for the relationship between the visual feature and its rotated visual feature, drastically limiting the anomaly detection performance. To push the limits, we reveal that rotation-invariant feature property has a significant impact in industrial-based FSAD. Specifically, we utilize graph representation in FSAD and provide a novel visual isometric invariant feature (VIIF) as anomaly measurement feature. As a result, VIIF can robustly improve the anomaly discriminating ability and can further reduce the size of redundant features stored in M by a large amount. Besides, we provide a novel model GraphCore via VIIFs that can fast implement unsupervised FSAD training and can improve the performance of anomaly detection. A comprehensive evaluation is provided for comparing GraphCore and other SOTA anomaly detection models under our proposed fewshot anomaly detection setting, which shows GraphCore can increase average AUC by 5.8%, 4.1%, 3.4%, and 1.6% on MVTec AD and by 25.5%, 22.0%, 16.9%, and 14.1% on MPDD for 1, 2, 4, and 8-shot cases, respectively.


title: Beyond Exponentially Fast Mixing in Average-Reward Reinforcement Learning via Multi-Level Monte Carlo Actor-Critic

abstract: Many existing reinforcement learning (RL) methods employ stochastic gradient iteration on the back end, whose stability hinges upon a hypothesis that the data-generating process mixes exponentially fast with a rate parameter that appears in the step-size selection. Unfortunately, this assumption is violated for large state spaces or settings with sparse rewards, and the mixing time is unknown, making the step size inoperable. In this work, we propose an RL methodology attuned to the mixing time by employing a multi-level Monte Carlo estimator for the critic, the actor, and the average reward embedded within an actor-critic (AC) algorithm. This method, which we call \textbf{M}ulti-level \textbf{A}ctor-\textbf{C}ritic (MAC), is developed especially for infinite-horizon average-reward settings and neither relies on oracle knowledge of the mixing time in its parameter selection nor assumes its exponential decay; it, therefore, is readily applicable to applications with slower mixing times. Nonetheless, it achieves a convergence rate comparable to the state-of-the-art AC algorithms. We experimentally show that these alleviated restrictions on the technical conditions required for stability translate to superior performance in practice for RL problems with sparse rewards.


title: Automated Arrangements of Multi-Part Music for Sets of Monophonic Instruments

abstract: Arranging music for a different set of instruments that it was originally written for is traditionally a tedious and time-consuming process, performed by experts with intricate knowledge of the specific instruments and involving significant experimentation. In this paper we study the problem of automating music arrangements for music pieces written for monophonic instruments or voices. We designed and implemented an algorithm that can always produce a music arrangement when feasible by transposing the music piece to a different scale, permuting the assigned parts to instruments/voices, and transposing individual parts by one or more octaves. We also published open source software written in Python that processes MusicXML files and allows musicians to experiment with music arrangements. It is our hope that our software can serve as a platform for future extensions that will include music reductions and inclusion of polyphonic instruments.


title: Resource Allocation of Federated Learning Assisted Mobile Augmented Reality System in the Metaverse

abstract: Metaverse has become a buzzword recently. Mobile augmented reality (MAR) is a promising approach to providing users with an immersive experience in the Metaverse. However, due to limitations of bandwidth, latency and computational resources, MAR cannot be applied on a large scale in the Metaverse yet. Moreover, federated learning, with its privacy-preserving characteristics, has emerged as a prospective distributed learning framework in the future Metaverse world. In this paper, we propose a federated learning assisted MAR system via non-orthogonal multiple access for the Metaverse. Additionally, to optimize a weighted sum of energy, latency and model accuracy, a resource allocation algorithm is devised by setting appropriate transmission power, CPU frequency and video frame resolution for each user. Experimental results demonstrate that our proposed algorithm achieves an overall good performance compared to a random algorithm and greedy algorithm.


title: Uplink Performance of Cell-Free Extremely Large-Scale MIMO Systems

abstract: In this paper, we investigate the uplink performance of cell-free (CF) extremely large-scale multiple-input-multipleoutput (XL-MIMO) systems, which is a promising technique for future wireless communications. More specifically, we consider the practical scenario with multiple base stations (BSs) and multiple user equipments (UEs). To this end, we derive exact achievable spectral efficiency (SE) expressions for any combining scheme. It is worth noting that we derive the closed-form SE expressions for the CF XL-MIMO with maximum ratio (MR) combining. Numerical results show that the SE performance of the CF XL-MIMO can be hugely improved compared with the small-cell XL-MIMO. It is interesting that a smaller antenna spacing leads to a higher correlation level among patch antennas. Finally, we prove that increasing the number of UE antennas may decrease the SE performance with MR combining.


title: Optimization and scheduling for a large scale urban transportation system in a fast-changing world

abstract: This paper proposes a set of technological solutions to transform existing transport systems into more intelligent, interactive systems by utilizing optimization and control methods that can be implemented in the near future. This will result in improved public services and quality of life for residents. Three application scenes that are closely related to people's daily life are discussed. We first propose a traffic light scheduling strategy using a model predictive control (MPC) method, with the aim of fairly minimizing delays for both pedestrians and vehicles. Then, a combined dispatching-operation system is proposed to increase control flexibility, with a corresponding implementation solution for boarding control. Finally, a possible scheme to combine both public transport and autonomous vehicle systems is proposed to improve existing public transport systems.


title: Wireless and Service Allocation for Mobile Computation Offloading with Task Deadlines

abstract: In mobile computation offloading (MCO), mobile devices (MDs) can choose to either execute tasks locally or to have them executed on a remote edge server (ES). This paper addresses the problem of assigning both the wireless communication bandwidth needed, along with the ES capacity that is used for the task execution, so that task completion time constraints are satisfied. The objective is to obtain these allocations so that the average power consumption of the mobile devices is minimized, subject to a cost budget constraint. The paper includes contributions for both soft and hard task completion deadline constraints. The problems are first formulated as mixed integer nonlinear programs (MINLPs). Approximate solutions are then obtained by decomposing the problems into a collection of convex subproblems that can be efficiently solved. Results are presented that demonstrate the quality of the proposed solutions, which can achieve near optimum performance over a wide range of system parameters.


title: Scattering Delay Mitigation in High Accuracy Pulsar Timing: Cyclic Spectroscopy Techniques

abstract: We simulate scattering delays from the interstellar medium to examine the effectiveness of three estimators in recovering these delays in pulsar timing data. Two of these estimators use the more traditional process of fitting autocorrelation functions to pulsar dynamic spectra to extract scintillation bandwidths, while the third estimator uses the newer technique of cyclic spectroscopy on baseband pulsar data to recover the interstellar medium's impulse response function. We find that either fitting a Lorentzian or Gaussian distribution to an autocorrelation function or recovering the impulse response function from the cyclic spectrum are, on average, accurate in recovering scattering delays, although autocorrelation function estimators have a large variance, even at high signal-to-noise ratio (S/N). We find that, given sufficient S/N, cyclic spectroscopy is more accurate than both Gaussian and Lorentzian fitting for recovering scattering delays at specific epochs, suggesting that cyclic spectroscopy is a superior method for scattering estimation in high quality data.


title: Strategies, Benefits and Challenges of App Store-inspired Requirements Elicitation

abstract: App store-inspired elicitation is the practice of exploring competitors' apps, to get inspiration for requirements. This activity is common among developers, but little insight is available on its practical use, advantages, and possible issues. This paper aims to study strategies, benefits, and challenges of app store-inspired elicitation, and to compare this technique with the more traditional requirements elicitation interviews. We conduct an experimental simulation with 58 analysts and collect qualitative data. Our results show that: (1) specific guidelines and procedures are required to better conduct app store-inspired elicitation; (2) current search features made available by app stores are not suitable for this practice, and more tool support is required to help analysts in the retrieval and evaluation of competing products; (3) while interviews focus on the why dimension of requirements engineering (i.e., goals), app store-inspired elicitation focuses on how (i.e., solutions), offering indications for implementation and improved usability. Our study provides a framework for researchers to address existing challenges and suggests possible benefits to foster app store-inspired elicitation among practitioners.


title: Informational Diversity and Affinity Bias in Team Growth Dynamics

abstract: Prior work has provided strong evidence that, within organizational settings, teams that bring a diversity of information and perspectives to a task are more effective than teams that do not. If this form of informational diversity confers performance advantages, why do we often see largely homogeneous teams in practice? One canonical argument is that the benefits of informational diversity are in tension with affinity bias. To better understand the impact of this tension on the makeup of teams, we analyze a sequential model of team formation in which individuals care about their team's performance (captured in terms of accurately predicting some future outcome based on a set of features) but experience a cost as a result of interacting with teammates who use different approaches to the prediction task. Our analysis of this simple model reveals a set of subtle behaviors that team-growth dynamics can exhibit: (i) from certain initial team compositions, they can make progress toward better performance but then get stuck partway to optimally diverse teams; while (ii) from other initial compositions, they can also move away from this optimal balance as the majority group tries to crowd out the opinions of the minority. The initial composition of the team can determine whether the dynamics will move toward or away from performance optimality, painting a path-dependent picture of inefficiencies in team compositions. Our results formalize a fundamental limitation of utility-based motivations to drive informational diversity in organizations and hint at interventions that may improve informational diversity and performance simultaneously.

categories: cs.GT cs.AI cs.CY cs.LG econ.GN q-fin.EC


title: The Benefits of Vulnerability Discovery and Bug Bounty Programs: Case Studies of Chromium and Firefox

abstract: Recently, bug-bounty programs have gained popularity and become a significant part of the security culture of many organizations. Bug-bounty programs enable organizations to enhance their security posture by harnessing the diverse expertise of crowds of external security experts (i.e., bug hunters). Nonetheless, quantifying the benefits of bug-bounty programs remains elusive, which presents a significant challenge for managing them. Previous studies focused on measuring their benefits in terms of the number of vulnerabilities reported or based on the properties of the reported vulnerabilities, such as severity or exploitability. However, beyond these inherent properties, the value of a report also depends on the probability that the vulnerability would be discovered by a threat actor before an internal expert could discover and patch it. In this paper, we present a data-driven study of the Chromium and Firefox vulnerability-reward programs. First, we estimate the difficulty of discovering a vulnerability using the probability of rediscovery as a novel metric. Our findings show that vulnerability discovery and patching provide clear benefits by making it difficult for threat actors to find vulnerabilities; however, we also identify opportunities for improvement, such as incentivizing bug hunters to focus more on development releases. Second, we compare the types of vulnerabilities that are discovered internally vs. externally and those that are exploited by threat actors. We observe significant differences between vulnerabilities found by external bug hunters, internal security teams, and external threat actors, which indicates that bug-bounty programs provide an important benefit by complementing the expertise of internal teams, but also that external hunters should be incentivized more to focus on the types of vulnerabilities that are likely to be exploited by threat actors.


title: Local Contrast and Global Contextual Information Make Infrared Small Object Salient Again

abstract: Infrared small object detection (ISOS) aims to segment small objects only covered with several pixels from clutter background in infrared images. It's of great challenge due to: 1) small objects lack of sufficient intensity, shape and texture information; 2) small objects are easily lost in the process where detection models, say deep neural networks, obtain high-level semantic features and image-level receptive fields through successive downsampling. This paper proposes a reliable detection model for ISOS, dubbed UCFNet, which can handle well the two issues. It builds upon central difference convolution (CDC) and fast Fourier convolution (FFC). On one hand, CDC can effectively guide the network to learn the contrast information between small objects and the background, as the contrast information is very essential in human visual system dealing with the ISOS task. On the other hand, FFC can gain image-level receptive fields and extract global information while preventing small objects from being overwhelmed.Experiments on several public datasets demonstrate that our method significantly outperforms the state-of-the-art ISOS models, and can provide useful guidelines for designing better ISOS deep models. Code are available at https://github.com/wcyjerry/BasicISOS.


title: Disease progression model anchored around clinical diagnosis in longitudinal cohorts: example of Alzheimer's disease and related dementia

abstract: Background. Alzheimer's disease and related dementia (ADRD) are characterized by multiple and progressive anatomo clinical changes. Yet, modeling changes over disease course from cohort data is challenging as the usual timescales are inappropriate and time-to-clinical diagnosis is available on small subsamples of participants with short follow-up durations prior to diagnosis. One solution to circumvent this challenge is to define the disease time as a latent variable. Methods: We developed a multivariate mixed model approach that realigns individual trajectories into the latent disease time to describe disease progression. Our methodology exploits the clinical diagnosis information as a partially observed and approximate reference to guide the estimation of the latent disease time. The model estimation was carried out in the Bayesian Framework using Stan. We applied the methodology to 2186 participants of the MEMENTO study with 5-year follow-up. Repeated measures of 12 ADRD markers stemmed from cerebrospinal fluid (CSF), brain imaging and cognitive tests were analyzed. Result: The estimated latent disease time spanned over twenty years before the clinical diagnosis. Considering the profile of a woman aged 70 with a high level of education and APOE4 carrier (the main genetic risk factor for ADRD), CSF markers of tau proteins accumulation preceded markers of brain atrophy by 5 years and cognitive decline by 10 years. We observed that individual characteristics could substantially modify the sequence and timing of these changes. Conclusion: Our disease progression model does not only realign trajectories into the most homogeneous way. It accounts for the inherent residual inter-individual variability in dementia progression to describe the long-term changes according to the years preceding clinical diagnosis, and to provide clinically meaningful information on the sequence of events.


title: MetaNO: How to Transfer Your Knowledge on Learning Hidden Physics

abstract: Gradient-based meta-learning methods have primarily been applied to classical machine learning tasks such as image classification. Recently, PDE-solving deep learning methods, such as neural operators, are starting to make an important impact on learning and predicting the response of a complex physical system directly from observational data. Since the data acquisition in this context is commonly challenging and costly, the call of utilization and transfer of existing knowledge to new and unseen physical systems is even more acute. Herein, we propose a novel meta-learning approach for neural operators, which can be seen as transferring the knowledge of solution operators between governing (unknown) PDEs with varying parameter fields. Our approach is a provably universal solution operator for multiple PDE solving tasks, with a key theoretical observation that underlying parameter fields can be captured in the first layer of neural operator models, in contrast to typical final-layer transfer in existing meta-learning methods. As applications, we demonstrate the efficacy of our proposed approach on PDE-based datasets and a real-world material modeling problem, illustrating that our method can handle complex and nonlinear physical response learning tasks while greatly improving the sampling efficiency in unseen tasks.


title: QD3SET-1: A Database with Quantum Dissipative Dynamics Data Sets

abstract: Simulations of the dynamics of dissipative quantum systems utilize many methods such as physics-based quantum, semiclassical, and quantum-classical as well as machine learning-based approximations, development and testing of which requires diverse data sets. Here we present a new database QD3SET-1 containing eight data sets of quantum dynamical data for two systems of broad interest, spin-boson (SB) model and the Fenna--Matthews--Olson (FMO) complex, generated with two different methods solving the dynamics, approximate local thermalizing Lindblad master equation (LTLME) and highly accurate hierarchy equations of motion (HEOM). One data set was generated with the SB model which is a two-level quantum system coupled to a harmonic environment using HEOM for 1,000 model parameters. Seven data sets were collected for the FMO complex of different sizes(7- and 8-site monomer and 24-site trimer with LTLME and 8-site monomer with HEOM) for 500--879 model parameters. Our QD3SET-1 database contains both population and coherence dynamics data and part of it has been already used for machine learning-based quantum dynamics studies.


title: Enhancing Dyadic Relations with Homogeneous Graphs for Multimodal Recommendation

abstract: User interaction data in recommender systems is a form of dyadic relation that reflects the preferences of users with items. Learning the representations of these two discrete sets of objects, users and items, is critical for recommendation. Recent multimodal recommendation models leveraging multimodal features (e.g., images and text descriptions) have been demonstrated to be effective in improving recommendation accuracy. However, state-of-the-art models enhance the dyadic relations between users and items by considering either user-user or item-item relations, leaving the high-order relations of the other side (i.e., users or items) unexplored. Furthermore, we experimentally reveal that the current multimodality fusion methods in the state-of-the-art models may degrade their recommendation performance. That is, without tainting the model architectures, these models can achieve even better recommendation accuracy with uni-modal information. On top of the finding, we propose a model that enhances the dyadic relations by learning Dual RepresentAtions of both users and items via constructing homogeneous Graphs for multimOdal recommeNdation. We name our model as DRAGON. Specifically, DRAGON constructs the user-user graph based on the commonly interacted items and the item-item graph from item multimodal features. It then utilizes graph learning on both the user-item heterogeneous graph and the homogeneous graphs (user-user and item-item) to obtain the dual representations of users and items. To capture information from each modality, DRAGON employs a simple yet effective fusion method, attentive concatenation, to derive the representations of users and items. Extensive experiments on three public datasets and seven baselines show that DRAGON can outperform the strongest baseline by 22.03% on average. Various ablation studies are conducted on DRAGON to validate its effectiveness.


title: Turbulence control in plane Couette flow using low-dimensional neural ODE-based models and deep reinforcement learning

abstract: The high dimensionality and complex dynamics of turbulent flows remain an obstacle to the discovery and implementation of control strategies. Deep reinforcement learning (RL) is a promising avenue for overcoming these obstacles, but requires a training phase in which the RL agent iteratively interacts with the flow environment to learn a control policy, which can be prohibitively expensive when the environment involves slow experiments or large-scale simulations. We overcome this challenge using a framework we call "DManD-RL" (data-driven manifold dynamics-RL), which generates a data-driven low-dimensional model of our system that we use for RL training. With this approach, we seek to minimize drag in a direct numerical simulation (DNS) of a turbulent minimal flow unit of plane Couette flow at Re=400 using two slot jets on one wall. We obtain, from DNS data with $\mathcal{O}(10^5)$ degrees of freedom, a 25-dimensional DManD model of the dynamics by combining an autoencoder and neural ordinary differential equation. Using this model as the environment, we train an RL control agent, yielding a 440-fold speedup over training on the DNS, with equivalent control performance. The agent learns a policy that laminarizes 84% of unseen DNS test trajectories within 900 time units, significantly outperforming classical opposition control (58%), despite the actuation authority being much more restricted. The agent often achieves laminarization through a counterintuitive strategy that drives the formation of two low-speed streaks, with a spanwise wavelength that is too small to be self-sustaining. The agent demonstrates the same performance when we limit observations to wall shear rate.


title: Violation-Aware Contextual Bayesian Optimization for Controller Performance Optimization with Unmodeled Constraints

abstract: We study the problem of performance optimization of closed-loop control systems with unmodeled dynamics. Bayesian optimization (BO) has been demonstrated to be effective for improving closed-loop performance by automatically tuning controller gains or reference setpoints in a model-free manner. However, BO methods have rarely been tested on dynamical systems with unmodeled constraints and time-varying ambient conditions. In this paper, we propose a violation-aware contextual BO algorithm (VACBO) that optimizes closed-loop performance while simultaneously learning constraint-feasible solutions under time-varying ambient conditions. Unlike classical constrained BO methods which allow unlimited constraint violations, or 'safe' BO algorithms that are conservative and try to operate with near-zero violations, we allow budgeted constraint violations to improve constraint learning and accelerate optimization. We demonstrate the effectiveness of our proposed VACBO method for energy minimization of industrial vapor compression systems under time-varying ambient temperature and humidity.


title: Reachability Analysis of Neural Network Control Systems

abstract: Neural network controllers (NNCs) have shown great promise in autonomous and cyber-physical systems. Despite the various verification approaches for neural networks, the safety analysis of NNCs remains an open problem. Existing verification approaches for neural network control systems (NNCSs) either can only work on a limited type of activation functions, or result in non-trivial over-approximation errors with time evolving. This paper proposes a verification framework for NNCS based on Lipschitzian optimisation, called DeepNNC. We first prove the Lipschitz continuity of closed-loop NNCSs by unrolling and eliminating the loops. We then reveal the working principles of applying Lipschitzian optimisation on NNCS verification and illustrate it by verifying an adaptive cruise control model. Compared to state-of-the-art verification approaches, DeepNNC shows superior performance in terms of efficiency and accuracy over a wide range of NNCs. We also provide a case study to demonstrate the capability of DeepNNC to handle a real-world, practical, and complex system. Our tool \textbf{DeepNNC} is available at \url{https://github.com/TrustAI/DeepNNC}.


title: Non-Hermitian Physics-Inspired Voltage-Controlled Oscillators with Resistive Tuning

abstract: This paper presents a non-Hermitian physics-inspired voltage-controlled oscillator (VCO) topology, which is termed parity-time-symmetric topology. The VCO consists of two coupled inductor-capacitor (LC) cores with a balanced gain and loss profile. Due to the interplay between the gain/loss and their coupling, an extra degree of freedom is enabled via resistive tuning, which can enhance the frequency tuning range (FTR) beyond the bounds of conventional capacitive or inductive tuning. A silicon prototype is implemented in a standard 130 nm bulk CMOS process with a core area of 0.15mm^2. Experimental results show that it achieves a 3.1x FTR improvement and 30% phase noise reduction of the baseline VCO with the same amount of capacitive tuning ability.


title: Characterizing and Detecting WebAssembly Runtime Bugs

abstract: WebAssembly (abbreviated WASM) has emerged as a promising language of the Web and also been used for a wide spectrum of software applications such as mobile applications and desktop applications. These applications, named as WASM applications, commonly run in WASM runtimes. Bugs in WASM runtimes are frequently reported by developers and cause the crash of WASM applications. However, these bugs have not been well studied. To fill in the knowledge gap, we present a systematic study to characterize and detect bugs in WASM runtimes. We first harvest a dataset of 311 real-world bugs from hundreds of related posts on GitHub. Based on the collected high-quality bug reports, we distill 31 bug categories of WASM runtimes and summarize their common fix strategies. Furthermore, we develop a pattern-based bug detection framework to automatically detect bugs in WASM runtimes. We apply the detection framework to five popular WASM runtimes and successfully uncover 53 bugs that have never been reported previously, among which 14 have been confirmed and 6 have been fixed by runtime developers.


title: Revised constraints on the photon mass from well-localized fast radio bursts

abstract: We constrain the photon mass from well-localized fast radio bursts (FRBs) using Bayes inference method. The probability distributions of dispersion measures (DM) of host galaxy and intergalactic medium are properly taken into account. The photon mass is tightly constrained from 17 well-localized FRBs in the redshift range $0<z<0.66$. Assuming that there is no redshift evolution of host DM, the $1\sigma$ and $2\sigma$ upper limits of photon mass are constrained to be $m_\gamma<4.8\times 10^{-51}$ kg and $m_\gamma<7.1\times 10^{-51}$ kg, respectively. Monte Carlo simulations show that, even enlarging the FRB sample to 200 and extending the redshift range to $0<z<3$ couldn't significantly improve the constraining ability on photon mass. This is because of the large uncertainty on the DM of intergalactic medium.


title: Unbiased and Efficient Self-Supervised Incremental Contrastive Learning

abstract: Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been studied, which brings the limitation in applying it to real-world applications. Contrastive learning identifies the samples with the negative ones from the noise distribution that changes in the incremental scenarios. Therefore, only fitting the change of data without noise distribution causes bias, and directly retraining results in low efficiency. To bridge this research gap, we propose a self-supervised Incremental Contrastive Learning (ICL) framework consisting of (i) a novel Incremental InfoNCE (NCE-II) loss function by estimating the change of noise distribution for old data to guarantee no bias with respect to the retraining, (ii) a meta-optimization with deep reinforced Learning Rate Learning (LRL) mechanism which can adaptively learn the learning rate according to the status of the training processes and achieve fast convergence which is critical for incremental learning. Theoretically, the proposed ICL is equivalent to retraining, which is based on solid mathematical derivation. In practice, extensive experiments in different domains demonstrate that, without retraining a new model, ICL achieves up to 16.7x training speedup and 16.8x faster convergence with competitive results.


title: Dynamic Multi-Behavior Sequence Modeling for Next Item Recommendation

abstract: Sequential Recommender Systems (SRSs) aim to predict the next item that users will consume, by modeling the user interests within their item sequences. While most existing SRSs focus on a single type of user behavior, only a few pay attention to multi-behavior sequences, although they are very common in real-world scenarios. It is challenging to effectively capture the user interests within multi-behavior sequences, because the information about user interests is entangled throughout the sequences in complex relationships. To this end, we first address the characteristics of multi-behavior sequences that should be considered in SRSs, and then propose novel methods for Dynamic Multi-behavior Sequence modeling named DyMuS, which is a light version, and DyMuS+, which is an improved version, considering the characteristics. DyMuS first encodes each behavior sequence independently, and then combines the encoded sequences using dynamic routing, which dynamically integrates information required in the final result from among many candidates, based on correlations between the sequences. DyMuS+, furthermore, applies the dynamic routing even to encoding each behavior sequence to further capture the correlations at item-level. Moreover, we release a new, large and up-to-date dataset for multi-behavior recommendation. Our experiments on DyMuS and DyMuS+ show their superiority and the significance of capturing the characteristics of multi-behavior sequences.


title: Covariate-assisted bounds on causal effects with instrumental variables

abstract: When an exposure of interest is confounded by unmeasured factors, an instrumental variable (IV) can be used to identify and estimate certain causal contrasts. Identification of the marginal average treatment effect (ATE) from IVs relies on strong untestable structural assumptions. When one is unwilling to assert such structure, IVs can nonetheless be used to construct bounds on the ATE. Famously, Balke and Pearl (1997) proved tight bounds on the ATE for a binary outcome, in a randomized trial with noncompliance and no covariate information. We demonstrate how these bounds remain useful in observational settings with baseline confounders of the IV, as well as randomized trials with measured baseline covariates. The resulting bounds on the ATE are non-smooth functionals, and thus standard nonparametric efficiency theory is not immediately applicable. To remedy this, we propose (1) under a novel margin condition, influence function-based estimators of the bounds that can attain parametric convergence rates when the nuisance functions are modeled flexibly, and (2) estimators of smooth approximations of these bounds. We propose extensions to continuous outcomes, explore finite sample properties in simulations, and illustrate the proposed estimators in an observational study targeting the effect of higher education on wages.


title: Constraints on the Parameterized Deceleration Parameter in FLRW Universe

abstract: Confirmation of accelerated expansion of the universe probed the concept of dark energy theory, and since then, numerous models have been introduced to explain its origin and nature. The present work is based on reconstructing dark energy by parametrization of the deceleration parameter in the FRW universe filled with radiation, dark matter, and dark energy. We have chosen some well-motivated parametrized models 1-3 in an attempt to investigate the energy density in terms of deceleration parameters by estimating the cosmological parameters with the help of different observational datasets. Also, we have introduced a new model 4 for the parametrization of the deceleration parameter. Then we analyzed the cosmography parameters using the best-fit values of the parameters. Using the information criteria, we have examined the viability of the models.


title: Positive Correlation between Heavy Alcoholic Drinking and SARS-Cov-2 Not-infection Rate

abstract: An investigation on the correlation between the strong alcoholic drinking and SARS-Cov-2 uninfection rate is carried out. The investigation is done through a simple survey in China based on the social media software Weixin and the survey mini program Wenjuanxin, during 15:00 Jan.1, 2023 to 12:35 Jan.3, 2023. From the $211$ survey questionnaires collected, we find a significant positive correlation between the frequent (no less than three times a week) strong liquor (higher than $40\%$ alcoholic content in volume) drinking and the higher SARS-Cov-2 uninfection rate ($38.6\%$ compared to the value $25.1\%$ for general population). The p-value of this statistical result shows that the correlation is significant.


title: The TIME Table: Rotation and Ages of Cool Exoplanet Host Stars

abstract: Age is a stellar parameter that is both fundamental and difficult to determine. Among middle-aged M dwarfs, the most prolific hosts of close-in and detectable exoplanets, gyrochronology is the most promising method to assign ages, but requires calibration by rotation-temperature sequences (gyrochrones) in clusters of known ages. We curated a catalog of 249 late K- and M-type (($T_{eff}$=3200-4200K) exoplanet host stars with established rotation periods, and applied empirical, temperature-dependent rotation-age relations based on relevant published gyrochrones, including one derived from observations of the 4 Gyr-old open cluster M67. We estimated ages for 227 of these stars, and upper limits for 8 others, excluding 14 which have too rapidly rotating or are otherwise outside the valid parameter range of our gyrochronology. We estimated uncertainties based on observed scatter in rotation periods in young clusters, error in the gyrochrones, and uncertainties in temperature and non-solar metallicity. For those stars with measured metallicities, we provide but do not incorporate a correction for the effects of deviation from solar metallicity. The age distribution of our sample declines to near zero at 10 Gyr, the age of the Galactic disk, with the handful of outliers explainable by large uncertainties. Continued addition or extension of cluster rotation sequences to more thoroughly calibrate the gyrochronology in time and temperature space, more precise and robust measurement of rotation periods, and more accurate stellar parameter measurements will enable continued improvements in the age estimates of these important exoplanet host stars.


title: Free Fermionic Schur Functions

abstract: We introduce a new family of Schur functions $s_{\lambda/\mu;a,b}(x/y)$ that depend on two sets of variables and two sequences of parameters. These free fermionic Schur functions have a hidden symmetry between the two sets of parameters that allows us to generalize and unify factorial, supersymmetric, and dual Schur functions from literature. We then prove that these functions satisfy the supersymmetric Cauchy identity $$ \sum_{\lambda}s_{\lambda;a,b}(x/y)\widehat{s}_{\lambda;a,b}(z/w) = \prod_{i,j}\frac{1+y_iz_j}{1-x_iz_j}\frac{1+x_iw_j}{1-y_iw_j}, $$ where $\widehat{s}_{\lambda;a,b}(z/w) = s_{\lambda';b',a'}(w/z)$ are the dual functions. Our approach is based on the integrable six vertex model with free fermionic Boltzmann weights. We show that these weights satisfy the \textit{refined Yang-Baxter equation}, which allows us to prove well-known properties of Schur functions: supersymmetry, combinatorial descriptions, the Jacobi-Trudi identity, the N\"agelsbach-Kostka formula, the Giambelli formula, the Ribbon formula, the Weyl determinant formula, the Berele-Regev factorization, dual Cauchy identity, the flagged determinant formula, and many others. We emphasize that many of these results are novel even in special cases.


title: First-Principles Theory of the Relativistic Magnetic Reconnection Rate in Astrophysical Pair Plasmas

abstract: We develop a first-principles model for the relativistic magnetic reconnection rate in strongly magnetized pair plasmas. By considering the energy budget and required current density near the x-line, we analytically show that in the magnetically-dominated relativistic regime, the x-line thermal pressure is significantly lower than the upstream magnetic pressure due to the extreme energy needed to sustain the current density, consistent with kinetic simulations. This causes the upstream magnetic field lines to collapse in, producing the open outflow geometry which enables fast reconnection. The result is important for understanding a wide range of extreme astrophysical environments, where fast reconnection has been evoked to explain observations such as transient flares and nonthermal particle signatures.


title: On Pre-trained Language Models for Antibody

abstract: Antibodies are vital proteins offering robust protection for the human body from pathogens. The development of general protein and antibody-specific pre-trained language models both facilitate antibody prediction tasks. However, there have been limited studies that comprehensively explore the representation capability of distinct pre-trained language models on different antibody tasks. To investigate the problem, we aim to answer several key questions in this paper, such as how pre-trained language models perform in antibody tasks with different specificity and how introducing specific biological mechanisms to the pre-training process can benefit the model. Additionally, we evaluate if the learned antibody pre-trained representations can be applied to real-world antibody problems, like drug discovery and immune process understanding. Previously, no benchmark available largely hindered the study to answer these questions. To aid in our investigation, we provide an AnTibody Understanding Evaluation (ATUE) benchmark. We comprehensively evaluate the performance of protein pre-trained language models by empirical study along with conclusions and new insights. Our ATUE and code are released at https://github.com/dqwang122/EATLM.


title: Strong quantum metrological limit from many-body physics

abstract: Surpassing the standard quantum limit and even reaching the Heisenberg limit using quantum entanglement, represents the Holy Grail of quantum metrology. However, quantum entanglement is a valuable resource that does not come without a price. The exceptional time overhead for the preparation of large-scale entangled states raises disconcerting concerns about whether the Heisenberg limit is fundamentally achievable. Here we find a universal speed limit set by the Lieb-Robinson light cone for the quantum Fisher information growth to characterize the metrological potential of quantum resource states during their preparation. Our main result establishes a strong precision limit of quantum metrology accounting for the complexity of many-body quantum resource state preparation and reveals a fundamental constraint for reaching the Heisenberg limit in a generic many-body lattice system with bounded one-site energy. It enables us to identify the essential features of quantum many-body systems that are crucial for achieving the quantum advantage of quantum metrology, and brings an interesting connection between many-body quantum dynamics and quantum metrology.


title: Cohomologies and deformations of coassociative coderivations

abstract: The motivation of this paper is to construct a deformation theory of coderivations of coassociative coalgebras. We introduce a notion of a Coder pair, that is, a coassociative coalgebra with a coderivation. Then we define a proper corepresentation of a Coder pair and study the corresponding cohomology. Finally, we show that a Coder pair is rigid, provided that the second cohomology group is trivial and point out that a deformation of finite order is extensible to higher order deformations if the obstruction class, which is defined to be in the third cohomology group, is trivial.


title: Computing expected moments of the R\'enyi parking problem on the circle

abstract: A highly accurate and efficient method to compute the expected values of the count, sum, and squared norm of the sum of the centre vectors of a random maximal sized collection of non-overlapping unit diameter disks touching a fixed unit-diameter disk is presented. This extends earlier work on R\'enyi's parking problem [Magyar Tud. Akad. Mat. Kutat\'{o} Int. K\"{o}zl. 3 (1-2), 1958, pp. 109-127]. Underlying the method is a splitting of the the problem conditional on the value of the first disk. This splitting is proven and then used to derive integral equations for the expectations. These equations take a lower block triangular form. They are solved using substitution and approximation of the integrals to very high accuracy using a polynomial approximation within the blocks.


title: Non-quasistatic response coefficients and dissipated availability for macroscopic thermodynamic systems

abstract: The characterization of finite-time thermodynamic processes is of crucial importance for extending equilibrium thermodynamics to nonequilibrium thermodynamics. The central issue is to quantify responses of thermodynamic variables and irreversible dissipation associated with non-quasistatic changes of thermodynamic forces applied to the system. In this study, we derive a simple formula that incorporates the non-quasistatic response coefficients with Onsager's kinetic coefficients, where the Onsager coefficients characterize the relaxation dynamics of fluctuation of extensive thermodynamic variables of semi-macroscopic systems. Moreover, the thermodynamic length and the dissipated availability that quantifies the efficiency of irreversible thermodynamic processes are formulated in terms of the derived non-quasistatic response coefficients. The present results are demonstrated by using an ideal gas model. The present results are, in principle, verifiable through experiments and are thus expected to provide a guiding principle for the nonequilibrium control of macroscopic thermodynamic systems.


title: Effective manipulation and realization of a colossal nonlinear Hall effect in an electric-field tunable moir\'e system

abstract: The second-order nonlinear Hall effect illuminates a frequency-doubling transverse current emerging in quantum materials with broken inversion symmetry even when time-reversal symmetry is preserved. This nonlinear response originates from both the Berry curvature dipole and the chiral Bloch electron skew scatterings, reflecting various information of the lattice symmetries, band dispersions, and topology of the electron wavefunctions. Even though many efforts have been put in detecting the nonlinear Hall effect in diverse condensed matter systems, effective manipulation of the two principal mechanisms in a single system has been lacking, and the reported response is relatively weak. Here, we report effective manipulation of the nonlinear Hall effect and realization of a colossal second-order Hall conductivity, $\sim500 {\mu}mSV^{-1}$, orders of magnitudes higher than the reported values, in AB-BA stacked twisted double bilayer graphene. A Berry-curvature-dipole-dominated nonlinear Hall effect, as well as its controllable transition to skew-scattering-dominated response, is identified near the band edge. The colossal response, on the other hand, is detected near the van Hove singularities, mainly determined by the skew scattering of the chiral Bloch electrons. Our findings establish electrically tunable moir\'e systems promising for nonlinear Hall effect manipulations and applications.


title: Physics-informed Neural Network: The Effect of Reparameterization in Solving Differential Equations

abstract: Differential equations are used to model and predict the behaviour of complex systems in a wide range of fields, and the ability to solve them is an important asset for understanding and predicting the behaviour of these systems. Complicated physics mostly involves difficult differential equations, which are hard to solve analytically. In recent years, physics-informed neural networks have been shown to perform very well in solving systems with various differential equations. The main ways to approximate differential equations are through penalty function and reparameterization. Most researchers use penalty functions rather than reparameterization due to the complexity of implementing reparameterization. In this study, we quantitatively compare physics-informed neural network models with and without reparameterization using the approximation error. The performance of reparameterization is demonstrated based on two benchmark mechanical engineering problems, a one-dimensional bar problem and a two-dimensional bending beam problem. Our results show that when dealing with complex differential equations, applying reparameterization results in a lower approximation error.


title: Introduction to the Fifth-rung Density Functional Approximations: Concept, Formulation, and Applications

abstract: The widespread use of (generalized) Kohn-Sham density functional theory (KS-DFT) lies in the fact that hierarchical sets of approximations of the exchange-correlation (XC) energy functional can be designed, offering versatile choices to satisfy different levels of accuracy needs. The XC functionals standing on the fifth (top) rung of the Jacob's ladder incorporate the information of unoccupied Kohn-Sham orbitals, and by doing so can describe seamlessly non-local electron correlations that the lower-rung functionals fail to capture. The doubly hybrid approximations (DHAs) and random phase approximation (RPA) based methods are two representative classes of fifth-rung functionals that have been under active development over the past two decades. In this review, we recapitulate the basic concepts of DHAs and RPA, derive their underlying theoretical formulation from the perspective of adiabatic-connection fluctuation-dissipation theory, and describe the implementation algorithms based on the resolution-of-identity technique within an atomic-orbital basis-set framework. Illustrating examples of practical applications of DHAs and RPA are presented, highlighting the usefulness of these functionals in resolving challenging problems in computational materials science. The most recent advances in the realms of these two types of functionals are briefly discussed.


title: A forgotten fermion: the hypercharge -3/2 doublet, its phenomenology and connections to dark matter

abstract: A weak-doublet with hypercharge $-3/2$ is one of only a handful of fermions which has a renormalisable interaction with Standard Model fields. This should make it worthy of attention, but it has thus far received little consideration in the literature. In this paper, we perform a thorough investigation of the phenomenology which results from the introduction of this field, $F$. After expressing the model in terms of its effective field theory at dimension-6, we compute a range of electroweak and leptonic observables, the most stringent of which probe up to $M_F \sim 300$ TeV. The simplicity of this scenario makes it very predictive and allows us to correlate the different processes. We then study how this new fermion can connect the SM to various simple but distinct dark sectors. Some of the most minimal cases of $F$-mediated dark matter (DM) involve frozen-in keV-scale scalar DM, which may produce x-ray lines, and frozen-out TeV-scale fermionic DM.


title: Self-driven Hybrid Atomic Spin Oscillator

abstract: A self-driven hybrid atomic spin oscillator is demonstrated in theory and experiment with a vapor Rb-Xe dual-spin system. The raw signal of Rb spin oscillation is amplified, phase-shifted and sent back to drive the Xe spins coherently. By fine tuning the driving field strength and phase, a self-sustaining spin oscillation signal with zero frequency shift is obtained. The effective coherence time is infinitely prolonged beyond the intrinsic coherence time of Xe spins, forming a hybrid atomic spin oscillator. Spectral analysis indicates that a frequency resolution of 13.1 nHz is achieved, enhancing the detection sensitivity for magnetic field. Allan deviation analysis shows that the spin oscillator can operate in continuous wave mode like a spin maser. The prototype spin oscillator can be easily implanted into other hybrid spin systems and enhance the detection sensitivity of alkali metal-noble gas comagnetometers.


title: Rethinking NPN Classification from Face and Point Characteristics of Boolean Functions

abstract: NPN classification is an essential problem in the design and verification of digital circuits. Most existing works explored variable symmetries and cofactor signatures to develop their classification methods. However, cofactor signatures only consider the face characteristics of Boolean functions. In this paper, we propose a new NPN classifier using both face and point characteristics of Boolean functions, including cofactor, influence, and sensitivity. The new method brings a new perspective to the classification of Boolean functions. The classifier only needs to compute some signatures, and the equality of corresponding signatures is a prerequisite for NPN equivalence. Therefore, these signatures can be directly used for NPN classification, thus avoiding the exhaustive transformation enumeration. The experiments show that the proposed NPN classifier gains better NPN classification accuracy with comparable speed.


title: Note on the First Part of Borel-Cantelli Lemma

abstract: In this short note, we briefly discuss the Borel-Cantelli lemma and propose a new generalization of the first part of it.


title: Controlled alignment of supermoir\'e lattice in double-aligned graphene heterostructures

abstract: The supermoir\'e lattice, built by stacking two moir\'e patterns, provides a platform for creating flat mini-bands and studying electron correlations. An ultimate challenge in assembling a graphene supermoir\'e lattice is in the deterministic control of its rotational alignment, which is made highly aleatory due to the random nature of the edge chirality and crystal symmetry of each component layer. Employing the so-called golden rule of three, here we present an experimental strategy to overcome this challenge and realize the controlled alignment of double-aligned hBN/graphene/hBN supermoir\'e lattice, where graphene is precisely aligned with both top hBN and bottom hBN. Remarkably, we find that the crystallographic edge of neighboring graphite can be used to better guide the stacking alignment, as demonstrated by the controlled production of 20 moir\'e samples with an accuracy better than 0.2 degree. Finally, we extend our technique to other strongly correlated electron systems, such as low-angle twisted bilayer graphene and ABC-stacked trilayer graphene, providing a strategy for flat-band engineering in these moir\'e materials.


title: Coherent Curvature Radiation Spectrum by Dynamically Fluctuating Bunches in Magnetospheres

abstract: Coherent curvature radiation by charged bunches has been discussed as the radiation mechanism for radio pulsars and fast radio bursts. Important issues for this radiation mechanism include how the bunches form and disperse in the magnetosphere of a pulsar or magnetar. More likely, bunches form and disperse continuously and it remains unclear what the spectral features are for these fluctuating bunches. In this work, we consider that the bunches in a magnetosphere have a formation rate of $\lambda_B$, a lifetime of $\tau_B$, and a typical Lorentz factor of $\gamma$, and analyze the spectral features of coherent curvature radiation by these fluctuating bunches. We find that the emission spectrum by a single fluctuating bunch is suppressed by a factor of $\sim(\lambda_B\tau_B)^2$ compared with that of a single persistent bunch, and there is a quasi-white noise in a wider band in the frequency domain. The high-frequency cutoff of the spectrum is at $\sim\max(\omega_{\rm peak},2\gamma^2/\tau_B)$, where $\omega_{\rm peak}$ is the peak frequency of curvature radiation. If the observed spectrum is not white-noise-like, the condition of $2\gamma^2\lambda_B\gtrsim \min(\omega_{\rm peak},2\gamma^2/\tau_B)$ would be required. Besides, the radiation by multiple fluctuating bunches along a field line is the incoherent summation of the radiation by single bunches if the bunch separation is longer than the wavelength. Conversely, a coherent summation should be involved. We also discuss the effects of bunch structures and the mechanism of bunch formation and dispersion.


title: Smooth maps like special generic maps

abstract: In our paper, we introduce special-generic-like maps or SGL maps as smooth maps and study their several algebraic topological and differential topological properties. The new class generalize the class of so-called special generic maps. Special generic maps are smooth maps which are locally projections or the product maps of Morse functions and the identity maps on disks. Morse functions with exactly two singular points on spheres or Morse functions in Reeb's theorem are simplest examples. Special generic maps and the manifolds of their domains have been studied well. Their structures are simple and this help us to study explicitly. As important properties, they have been shown to restrict the topologies and the differentiable structures of the manifolds strongly by Saeki and Sakuma, followed by Nishioka, Wrazidlo and the author. To cover wider classes of manifolds as the domains, the author previously introduced a class generalizing the class of special generic maps and smaller than our class: simply generalized special generic maps.


title: Could an Artificial-Intelligence agent pass an introductory physics course?

abstract: Massive pre-trained language models have garnered attention and controversy due to their ability to generate human-like responses: attention due to their frequent indistinguishability from human-generated phraseology and narratives, and controversy due to the fact that their convincingly presented arguments and facts are frequently simply false. Just how human-like are these responses when it comes to dialogues about physics, in particular about the standard content of introductory physics courses? This study explores that question by having ChatGTP, the pre-eminent language model in 2023, work through representative assessment content of an actual calculus-based physics course and grading the responses in the same way human responses would be graded. As it turns out, ChatGPT would narrowly pass this course while exhibiting many of the preconceptions and errors of a beginning learner.


title: Curvature surfaces in generic conformally flat hypersurfaces arising from Poincar\'{e} metric -- Extension and Approximation

abstract: We study generic conformally flat (analytic-)hypersurfaces in the Euclidean $4$-space $\mathbb{R}^4$. Such a local-hypersurface is obtained as an evolution of surfaces issuing from a certain surface in $\mathbb{R}^4$, and then, in consequence, the original surface is a (principal-)curvature surface of the hypersurface. The Poincar\'{e} metric ${\check g}_H$ of the upper half plane leads to a $6$-dimensional set of rational Riemannian metrics $g_0$ of $\mathbb{R}^2$: on a simply connected open set in the regular domain of $g_0$, a curvature surface $f^0$ with the metric $g_0$ is determined, which we denote by $(f^0,g_0)$. In this paper, we choose a suitable metric $g_0$ of $\mathbb{R}^2$ determined by ${\check g}_H$ to get nice curvature surfaces (but it also has degenerate and divergent points in $\mathbb{R}^2$), and clarify the structure of the curvature surfaces $(f^0,g_0)$: the curvature surfaces $(f^0,g_0)$ extend analytically to what kind of set in $\mathbb{R}^2$ beyond the regular set of $g_0$, and then the extended surface $(f^0,g_0)$ is defined on a certain open set of $\mathbb{R}^2$ and bounded in $\mathbb{R}^4$; for the extended surface $(f^0,g_0)$, we explicitly catch the set of degenerate points and the limits in $\mathbb{R}^4$ of both ends of every principal curvature line, and then the two limits of every line for one principal curvature are parallel small circles in a standard $2$-sphere $\mathbb{S}^2$. Then, every principal curvature line in the extended surface $(f^0,g_0)$ is expressed by a frame field of $\mathbb{R}^4$ induced on the surface from a hypersurface and it lies on a standard $2$-sphere $\mathbb{S}^2$ with line-dependent radius. We also provide a general method of constructing an approximation of such frame fields, and obtain the entire pictures of those lines including degenerate points of $(f^0,g_0)$.


title: Decentralized Energy Market Integrating Carbon Allowance Trade and Uncertainty Balance in Energy Communities

abstract: With the sustained attention on carbon neutrality, the personal carbon trading (PCT) scheme has been embraced as an auspicious paradigm for scaling down carbon emissions. To facilitate the simultaneous clearance of energy and carbon allowance inside the energy community while hedging against uncertainty, a joint trading framework is proposed in this article. The energy trading is implemented in a peer-to-peer (P2P) manner without the intervention of a central operator, and the uncertainty trading is materialized through procuring reserve of conventional generators and flexibility of users. Under the PCT scheme, carbon allowance is transacted via a sharing mechanism. Possible excessive carbon emissions due to uncertainty balance are tackled by obliging renewable agents to procure sufficient carbon allowances, following the consumption responsibility principle. A two-stage iterative method consisting of tightening McCormick envelope and alternating direction method of multipliers (ADMM) is devised to transform the model into a mixed-integer second-order cone program (MISOCP) and to allow for a fully decentralized market-clearing procedure. Numerical results have validated the effectiveness of the proposed market model.


title: Constrained Policy Optimization with Explicit Behavior Density for Offline Reinforcement Learning

abstract: Due to the inability to interact with the environment, offline reinforcement learning (RL) methods face the challenge of estimating the Out-of-Distribution (OOD) points. Existing methods for addressing this issue either control policy to exclude the OOD action or make the $Q$ function pessimistic. However, these methods can be overly conservative or fail to identify OOD areas accurately. To overcome this problem, we propose a Constrained Policy optimization with Explicit Behavior density (CPED) method that utilizes a flow-GAN model to explicitly estimate the density of behavior policy. By estimating the explicit density, CPED can accurately identify the safe region and enable optimization within the region, resulting in less conservative learning policies. We further provide theoretical results for both the flow-GAN estimator and performance guarantee for CPED by showing that CPED can find the optimal $Q$-function value. Empirically, CPED outperforms existing alternatives on various standard offline reinforcement learning tasks, yielding higher expected returns.


title: Restricted Orthogonal Gradient Projection for Continual Learning

abstract: Continual learning aims to avoid catastrophic forgetting and effectively leverage learned experiences to master new knowledge. Existing gradient projection approaches impose hard constraints on the optimization space for new tasks to minimize interference, which simultaneously hinders forward knowledge transfer. To address this issue, recent methods reuse frozen parameters with a growing network, resulting in high computational costs. Thus, it remains a challenge whether we can improve forward knowledge transfer for gradient projection approaches using a fixed network architecture. In this work, we propose the Restricted Orthogonal Gradient prOjection (ROGO) framework. The basic idea is to adopt a restricted orthogonal constraint allowing parameters optimized in the direction oblique to the whole frozen space to facilitate forward knowledge transfer while consolidating previous knowledge. Our framework requires neither data buffers nor extra parameters. Extensive experiments have demonstrated the superiority of our framework over several strong baselines. We also provide theoretical guarantees for our relaxing strategy.


title: AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning

abstract: Large pretrained language models are widely used in downstream NLP tasks via task-specific fine-tuning, but such procedures can be costly. Recently, Parameter-Efficient Fine-Tuning (PEFT) methods have achieved strong task performance while updating much fewer parameters than full model fine-tuning (FFT). However, it is non-trivial to make informed design choices on the PEFT configurations, such as their architecture, the number of tunable parameters, and even the layers in which the PEFT modules are inserted. Consequently, it is highly likely that the current, manually designed configurations are suboptimal in terms of their performance-efficiency trade-off. Inspired by advances in neural architecture search, we propose AutoPEFT for automatic PEFT configuration selection: we first design an expressive configuration search space with multiple representative PEFT modules as building blocks. Using multi-objective Bayesian optimisation in a low-cost setup, we then discover a Pareto-optimal set of configurations with strong performance-cost trade-offs across different numbers of parameters that are also highly transferable across different tasks. Empirically, on GLUE and SuperGLUE tasks, we show that AutoPEFT-discovered configurations significantly outperform existing PEFT methods and are on par or better than FFT without incurring substantial training efficiency costs.