title: Housekeep: Tidying Virtual Households using Commonsense Reasoning

abstract: We introduce Housekeep, a benchmark to evaluate commonsense reasoning in the home for embodied AI. In Housekeep, an embodied agent must tidy a house by rearranging misplaced objects without explicit instructions specifying which objects need to be rearranged. Instead, the agent must learn from and is evaluated against human preferences of which objects belong where in a tidy house. Specifically, we collect a dataset of where humans typically place objects in tidy and untidy houses constituting 1799 objects, 268 object categories, 585 placements, and 105 rooms. Next, we propose a modular baseline approach for Housekeep that integrates planning, exploration, and navigation. It leverages a fine-tuned large language model (LLM) trained on an internet text corpus for effective planning. We show that our baseline agent generalizes to rearranging unseen objects in unknown environments. See our webpage for more details: https://yashkant.github.io/housekeep/


title: Understanding and Supporting the Design Systems Practice

abstract: Design systems represent a user interaction design and development approach that is currently of avid interest in the industry. However, little research work has been done to synthesize knowledge related to design systems in order to inform the design of tools to support their creation, maintenance, and usage practices. This paper represents an important step in which we explored the issues that design system projects usually deal with and the perceptions and values of design system project leaders. Through this exploration, we aim to investigate the needs for tools that support the design system approach. We found that the open source communities around design systems focused on discussing issues related to behaviors of user interface components of design systems. At the same time, leaders of design system projects faced considerable challenges when evolving their design systems to make them both capable of capturing stable design knowledge and flexible to the needs of the various concrete products. They valued a bottom-up approach for design system creation and maintenance, in which components are elevated and merged from the evolving products. Our findings synthesize the knowledge and lay foundations for designing techniques and tools aimed at supporting the design system practice and related modern user interaction design and development approaches.


title: Interpretable Proof Generation via Iterative Backward Reasoning

abstract: We present IBR, an Iterative Backward Reasoning model to solve the proof generation tasks on rule-based Question Answering (QA), where models are required to reason over a series of textual rules and facts to find out the related proof path and derive the final answer. We handle the limitations of existed works in two folds: 1) enhance the interpretability of reasoning procedures with detailed tracking, by predicting nodes and edges in the proof path iteratively backward from the question; 2) promote the efficiency and accuracy via reasoning on the elaborate representations of nodes and history paths, without any intermediate texts that may introduce external noise during proof generation. There are three main modules in IBR, QA and proof strategy prediction to obtain the answer and offer guidance for the following procedure; parent node prediction to determine a node in the existing proof that a new child node will link to; child node prediction to find out which new node will be added to the proof. Experiments on both synthetic and paraphrased datasets demonstrate that IBR has better in-domain performance as well as cross-domain transferability than several strong baselines. Our code and models are available at https://github.com/find-knowledge/IBR .


title: Policy-based Primal-Dual Methods for Concave CMDP with Variance Reduction

abstract: We study Concave Constrained Markov Decision Processes (Concave CMDPs) where both the objective and constraints are defined as concave functions of the state-action occupancy measure. We propose the Variance-Reduced Primal-Dual Policy Gradient Algorithm (VR-PDPG), which updates the primal variable via policy gradient ascent and the dual variable via projected sub-gradient descent. Despite the challenges posed by the loss of additivity structure and the nonconcave nature of the problem, we establish the global convergence of VR-PDPG by exploiting a form of hidden concavity. In the exact setting, we prove an $O(T^{-1/3})$ convergence rate for both the average optimality gap and constraint violation, which further improves to $O(T^{-1/2})$ under strong concavity of the objective in the occupancy measure. In the sample-based setting, we demonstrate that VR-PDPG achieves an $\widetilde{O}(\epsilon^{-4})$ sample complexity for $\epsilon$-global optimality. Moreover, by incorporating a diminishing pessimistic term into the constraint, we show that VR-PDPG can attain a zero constraint violation without compromising the convergence rate of the optimality gap. Finally, we validate the effectiveness of our methods through numerical experiments.


title: Cohomology, Bocksteins, and resonance varieties in characteristic 2

abstract: We use the action of the Bockstein homomorphism on the cohomology ring $H^*(X,\mathbb{Z}_2)$ of a finite-type CW-complex $X$ in order to define the resonance varieties of $X$ in characteristic 2. Much of the theory is done in the more general framework of the Maurer-Cartan sets and the resonance varieties attached to a finite-type commutative differential graded algebra. We illustrate these concepts with examples mainly drawn from closed manifolds, where Poincar\'e duality over $\mathbb{Z}_2$ has strong implications on the nature of the resonance varieties.


title: Formation of Mass-gap Black Holes from Neutron Star X-ray Binaries with Super-Eddington Accretion

abstract: Electromagnetic and gravitational wave observations indicate that there is dearth of compact objects with mass $\sim 2.5-5~{\rm M_\odot}$. This so-called "mass gap" may be linked to the supernova explosion mechanisms that produce neutron stars (NSs) and black holes (BHs). However, the existence of a few mass-gap compact objects, some of which have been confirmed to be BHs, poses a challenge to the traditional theory of black hole formation. In this work we investigate the possible formation channel of BHs from accretion-induced collapse (AIC) of NSs in X-ray binaries. In particular, we consider the influence of super-Eddington accretion of NSs. Recent observations of ultraluminous X-ray pulsars suggest that their apparent luminosities may reflect the true accretion luminosities of the accreting NSs, even exceeding the Eddington limit by a factor of $\gtrsim 100$. Thus, NSs accreting at a super-Eddington accretion rate may rapidly grow into BHs in intermediate/low-mass X-ray binaries. Based on the super-Eddington accretion disk models, we have investigated the evolution of NSs in intermediate/low-mass X-ray binaries by combining binary population synthesis and detailed stellar evolutionary calculations. We show that super-Eddington accretion plays a critical role in mass growth of NSs, and the final masses of the descendant BHs are heavily dependent on the NS magnetic fields, the metallicity of the donor star, and the bifurcation period of the binaries. AIC of NSs may account for some of the observed mass-gap BHs like GRO J0422+32. We also present the parameter distributions of the potential mass-gap BHs in a Milky Way-like galaxy, and point out that future space-based gravitational wave observations may provide important test of or constraints on the formation of mass-gap BHs from the AIC channel.


title: Search for Neutrinoless Double-Beta Decay of $^{76}$Ge with a Natural Broad Energy Germanium Detector

abstract: A natural broad energy germanium (BEGe) detector is operated in the China Jinping Underground Laboratory (CJPL) for a feasibility study of building the next generation experiment of the neutrinoless double-beta (0{$\nu\beta\beta$}) decay of $^{76}$Ge. The setup of the prototype facility, characteristics of the BEGe detector, background reduction methods, and data analysis are described in this paper. A background index of 6.4$\times$10$^{-3}$ counts/(keV$\cdot$kg$\cdot$day) is achieved and 1.86 times lower than our previous result of the CDEX-1 detector. No signal is observed with an exposure of 186.4 kg$\cdot$day, thus a limit on the half life of $^{76}$Ge 0$\nu\beta\beta$ decay is set at T$_{1/2}^{0\nu}$ $>$ 5.62$\times$10$^{22}$ yr at 90% C.L.. The limit corresponds to an effective Majorana neutrino mass in the range of 4.6 $\sim$ 10.3 eV, dependent on the nuclear matrix elements.


title: Symmetric Teleparallel Geometries

abstract: In teleparallel gravity and, in particular, in $F(T)$ teleparallel gravity, there is a challenge in determining an appropriate (co-)frame and its corresponding spin connection to describe the geometry. Very often, the "proper" frame, the frame in which all inertial effects are absent, is not the simplest (e.g, diagonal) (co-)frame. The determination of the frame and its corresponding spin connection for $F(T)$ teleparallel gravity theories when there exist affine symmetries is of much interest. In this paper we present the general form of the coframe and its corresponding spin connection for teleparallel geometries which are invariant under a $G_6$ group of affine symmetries. The proper coframe and the corresponding $F(T)$ field equations are also shown for these Teleparallel Robertson Walker (TRW) geometries. Further, with the addition of an additional affine symmetry, it is possible to define a Teleparallel de Sitter (TdS) geometry.


title: Galaxy morphoto-Z with neural Networks (GaZNets). I. Optimized accuracy and outlier fraction from Imaging and Photometry

abstract: In the era of large sky surveys, photometric redshifts (photo-z) represent crucial information for galaxy evolution and cosmology studies. In this work, we propose a new Machine Learning (ML) tool called Galaxy morphoto-Z with neural Networks (GaZNet-1), which uses both images and multi-band photometry measurements to predict galaxy redshifts, with accuracy, precision and outlier fraction superior to standard methods based on photometry only. As a first application of this tool, we estimate photo-z of a sample of galaxies in the Kilo-Degree Survey (KiDS). GaZNet-1 is trained and tested on $\sim140 000$ galaxies collected from KiDS Data Release 4 (DR4), for which spectroscopic redshifts are available from different surveys. This sample is dominated by bright (MAG$\_$AUTO$<21$) and low redshift ($z < 0.8$) systems, however, we could use $\sim$ 6500 galaxies in the range $0.8 < z < 3$ to effectively extend the training to higher redshift. The inputs are the r-band galaxy images plus the 9-band magnitudes and colours, from the combined catalogs of optical photometry from KiDS and near-infrared photometry from the VISTA Kilo-degree Infrared survey. By combining the images and catalogs, GaZNet-1 can achieve extremely high precision in normalized median absolute deviation (NMAD=0.014 for lower redshift and NMAD=0.041 for higher redshift galaxies) and low fraction of outliers ($0.4$\% for lower and $1.27$\% for higher redshift galaxies). Compared to ML codes using only photometry as input, GaZNet-1 also shows a $\sim 10-35$% improvement in precision at different redshifts and a $\sim$ 45% reduction in the fraction of outliers. We finally discuss that, by correctly separating galaxies from stars and active galactic nuclei, the overall photo-z outlier fraction of galaxies can be cut down to $0.3$\%.


title: System-Level Evaluation of Beam Hopping in NR-Based LEO Satellite Communication System

abstract: Satellite communication by leveraging the use of low earth orbit (LEO) satellites is expected to play an essential role in future communication systems through providing ubiquitous and continuous wireless connectivity. This thus has motivated the work in the 3rd generation partnership project (3GPP) to ensure the operation of fifth generation (5G) New Radio (NR) protocols for non-terrestrial network (NTN). In this paper, we consider a NR-based LEO satellite communication system, where satellites equipped with phased array antennas are employed to serve user equipments (UEs) on the ground. To reduce payload weight and meet the time-varying traffic demands of UEs, an efficient beam hopping scheme considering both the traffic demands and inter-beam interference is proposed to jointly schedule beams and satellite transmit power. Then based on NR protocols, we present the first system-level evaluations of beam hopping scheme in LEO satellite system under different operating frequency bands and traffic models. Simulation results indicate that significant performance gains can be achieved by the proposed beam hopping scheme, especially under the distance limit constraint that avoids scheduling adjacent beams simultaneously, as compared to benchmark schemes.


title: Noncommutative Partial Derivative

abstract: We introduce the axiomatic definition of the point-derivative for noncommutative algebras and present the counterparts of the ordinary multi-variable chain rule and Clairaut's Theorem in the context of partial point-derivatives.


title: Stochastic Models of Neuronal Growth

abstract: Neurons are the basic cells of the nervous system. During their growth neurons extend two types of processes: axons and dendrites, which navigate to other neurons and form complex neuronal networks that transmit electrical signals throughout the body. The basic process underlying the network formation is axonal growth, a process involving the extension of axons from the cell body towards target neurons. During growth axons sense their environment, process information, and respond to external stimuli by adapting their growth dynamics. Environmental stimuli include intercellular interactions, biochemical cues, and the mechanical and geometrical features of the growth substrate. Axonal dynamics is controlled both by deterministic components (tendency to grow in certain preferred directions imparted by surface properties), and a random deviation from these growth directions due to stochastic processes. Despite recent impressive advances in our understanding of how neurons grow and form functional connections, a fully quantitative description of axonal dynamics is still missing. In this paper, we present a review of our work on stochastic models. We show that Langevin and Fokker-Planck stochastic differential equations provide a powerful theoretical framework for describing how collective axonal dynamics and the formation of neuronal network emerge from biophysics of single neurons and their interactions. We combine this theoretical analysis with experimental data to extract key parameters of axonal growth: diffusion coefficients, speed and angular distributions, mean square displacements, and mechanical parameters describing the cell-substrate coupling. These results have important implications for our understanding of the fundamental mechanisms involved in the formation of functional neuronal networks, as well as for bioengineering novel scaffolds to promote nerve regeneration.


title: Learnable Visual Words for Interpretable Image Recognition

abstract: To interpret deep models' predictions, attention-based visual cues are widely used in addressing \textit{why} deep models make such predictions. Beyond that, the current research community becomes more interested in reasoning \textit{how} deep models make predictions, where some prototype-based methods employ interpretable representations with their corresponding visual cues to reveal the black-box mechanism of deep model behaviors. However, these pioneering attempts only either learn the category-specific prototypes and deteriorate their generalizing capacities, or demonstrate several illustrative examples without a quantitative evaluation of visual-based interpretability with further limitations on their practical usages. In this paper, we revisit the concept of visual words and propose the Learnable Visual Words (LVW) to interpret the model prediction behaviors with two novel modules: semantic visual words learning and dual fidelity preservation. The semantic visual words learning relaxes the category-specific constraint, enabling the general visual words shared across different categories. Beyond employing the visual words for prediction to align visual words with the base model, our dual fidelity preservation also includes the attention guided semantic alignment that encourages the learned visual words to focus on the same conceptual regions for prediction. Experiments on six visual benchmarks demonstrate the superior effectiveness of our proposed LVW in both accuracy and model interpretation over the state-of-the-art methods. Moreover, we elaborate on various in-depth analyses to further explore the learned visual words and the generalizability of our method for unseen categories.


title: Schrodinger dynamics and Berry phase of undulatory locomotion

abstract: Spectral mode representations play an essential role in various areas of physics, from quantum mechanics to fluid turbulence, but they are not yet extensively used to characterize and describe the behavioral dynamics of living systems. Here, we show that mode-based linear models inferred from experimental live-imaging data can provide an accurate low-dimensional description of undulatory locomotion in worms, centipedes, robots, and snakes. By incorporating physical symmetries and known biological constraints into the dynamical model, we find that the shape dynamics are generically governed by Schrodinger equations in mode space. The eigenstates of the effective biophysical Hamiltonians and their adiabatic variations enable the efficient classification and differentiation of locomotion behaviors in natural, simulated, and robotic organisms using Grassmann distances and Berry phases. While our analysis focuses on a widely studied class of biophysical locomotion phenomena, the underlying approach generalizes to other physical or living systems that permit a mode representation subject to geometric shape constraints.


title: TWEET-FID: An Annotated Dataset for Multiple Foodborne Illness Detection Tasks

abstract: Foodborne illness is a serious but preventable public health problem -- with delays in detecting the associated outbreaks resulting in productivity loss, expensive recalls, public safety hazards, and even loss of life. While social media is a promising source for identifying unreported foodborne illnesses, there is a dearth of labeled datasets for developing effective outbreak detection models. To accelerate the development of machine learning-based models for foodborne outbreak detection, we thus present TWEET-FID (TWEET-Foodborne Illness Detection), the first publicly available annotated dataset for multiple foodborne illness incident detection tasks. TWEET-FID collected from Twitter is annotated with three facets: tweet class, entity type, and slot type, with labels produced by experts as well as by crowdsource workers. We introduce several domain tasks leveraging these three facets: text relevance classification (TRC), entity mention detection (EMD), and slot filling (SF). We describe the end-to-end methodology for dataset design, creation, and labeling for supporting model development for these tasks. A comprehensive set of results for these tasks leveraging state-of-the-art single- and multi-task deep learning methods on the TWEET-FID dataset are provided. This dataset opens opportunities for future research in foodborne outbreak detection.


title: Residual regularization path-following methods for linear complementarity problems

abstract: In this article, we consider the residual regularization path-following method with the trust-region updating strategy for the linear complementarity problem. This time-stepping selection based on the trust-region updating strategy overcomes the shortcoming of the line search method, which consumes the unnecessary trial steps in the transient-state phase. In order to improve the robustness of the path-following method, we use the residual regularization parameter to replace the traditional complementarity regularization parameter. Moreover, we prove the global convergence of the new method under the standard assumptions without the traditional assumption condition of the priority to feasibility over complementarity. Numerical results show that the new method is robust and efficient for the linear complementarity problem, especially for the dense cases. And it is more robust and faster than some state-of-the-art solvers such as the built-in subroutines PATH and MILES of the GAMS v28.2 (2019) environment. The computational time of the new method is about 1/3 to 1/10 of that of PATH for the dense linear complementarity problem.

categories: math.OC cs.CE cs.MS cs.NA math.DS math.NA


title: Neural Lyapunov Differentiable Predictive Control

abstract: We present a learning-based predictive control methodology using the differentiable programming framework with probabilistic Lyapunov-based stability guarantees. The neural Lyapunov differentiable predictive control (NLDPC) learns the policy by constructing a computational graph encompassing the system dynamics, state and input constraints, and the necessary Lyapunov certification constraints, and thereafter using the automatic differentiation to update the neural policy parameters. In conjunction, our approach jointly learns a Lyapunov function that certifies the regions of state-space with stable dynamics. We also provide a sampling-based statistical guarantee for the training of NLDPC from the distribution of initial conditions. Our offline training approach provides a computationally efficient and scalable alternative to classical explicit model predictive control solutions. We substantiate the advantages of the proposed approach with simulations to stabilize the double integrator model and on an example of controlling an aircraft model.


title: Near-Optimal Algorithms for Autonomous Exploration and Multi-Goal Stochastic Shortest Path

abstract: We revisit the incremental autonomous exploration problem proposed by Lim & Auer (2012). In this setting, the agent aims to learn a set of near-optimal goal-conditioned policies to reach the $L$-controllable states: states that are incrementally reachable from an initial state $s_0$ within $L$ steps in expectation. We introduce a new algorithm with stronger sample complexity bounds than existing ones. Furthermore, we also prove the first lower bound for the autonomous exploration problem. In particular, the lower bound implies that our proposed algorithm, Value-Aware Autonomous Exploration, is nearly minimax-optimal when the number of $L$-controllable states grows polynomially with respect to $L$. Key in our algorithm design is a connection between autonomous exploration and multi-goal stochastic shortest path, a new problem that naturally generalizes the classical stochastic shortest path problem. This new problem and its connection to autonomous exploration can be of independent interest.


title: Orthogonal inner product graphs of odd characteristic and their automorphisms

abstract: Let $\mathbb{F}_q$ be a finite field of odd characteristic and $2\nu+\delta\geq2$ an integer number with $\delta=0,1$ or $2$. The orthogonal inner product graph $Oi\big(2\nu+\delta,q\big)$ over $\mathbb{F}_q$ is defined and the automorphism groups of $Oi\big(2\nu+\delta,q\big)$ are determined. We show that $Oi\big(2\nu+\delta,q\big)$ is a disconnected graph if $2\nu+\delta=2$; otherwise it is not. Moreover, we have two necessary and sufficient conditions for two vertices of $Oi\big(2\nu+\delta,q\big)$ and two edges of $Oi\big(2\nu+\delta,q\big)$ respectively are in the same orbit under the action of the automorphism group of $Oi\big(2\nu+\delta,q\big).$


title: Atomic-scale Manipulation of Single-Polaron in a Two-Dimensional Semiconductor

abstract: Polaron is a composite quasiparticle derived from an excess carrier trapped by local lattice distortion, and it has been studied extensively for decades both theoretically and experimentally. However, atomic-scale creation and manipulation of single-polarons in real space have still not been achieved so far, which precludes the atomistic understanding of the properties of polarons as well as their applications. Herein, using scanning tunneling microscopy, we succeeded to create single polarons in a monolayer two-dimensional semiconductor, CoCl2. Combined with first-principles calculations, two stable polaron configurations, centered at on-top and hollow sites, respectively, have been revealed. Remarkably, a series of manipulation progresses, from creation, erasure to transition, can be accurately implemented on individual polarons. Our results pave the way to understand the polaronic physics at atomic level, and the easy control of single polarons in 2D semiconductor may open the door to 2D polaronics including the data storage.


title: Robust Flow-based Conformal Inference (FCI) with Statistical Guarantee

abstract: Conformal prediction aims to determine precise levels of confidence in predictions for new objects using past experience. However, the commonly used exchangeable assumptions between the training data and testing data limit its usage in dealing with contaminated testing sets. In this paper, we develop a novel flow-based conformal inference (FCI) method to build predictive sets and infer outliers for complex and high-dimensional data. We leverage ideas from adversarial flow to transfer the input data to a random vector with known distributions. Our roundtrip transformation can map the input data to a low-dimensional space, meanwhile reserving the conditional distribution of input data given each class label, which enables us to construct a non-conformity score for uncertainty quantification. Our approach is applicable and robust when the testing data is contaminated. We evaluate our method, robust flow-based conformal inference, on benchmark datasets. We find that it produces effective predictive sets and accurate outlier detection and is more powerful relative to competing approaches.


title: GraB: Finding Provably Better Data Permutations than Random Reshuffling

abstract: Random reshuffling, which randomly permutes the dataset each epoch, is widely adopted in model training because it yields faster convergence than with-replacement sampling. Recent studies indicate greedily chosen data orderings can further speed up convergence empirically, at the cost of using more computation and memory. However, greedy ordering lacks theoretical justification and has limited utility due to its non-trivial memory and computation overhead. In this paper, we first formulate an example-ordering framework named herding and answer affirmatively that SGD with herding converges at the rate $O(T^{-2/3})$ on smooth, non-convex objectives, faster than the $O(n^{1/3}T^{-2/3})$ obtained by random reshuffling, where $n$ denotes the number of data points and $T$ denotes the total number of iterations. To reduce the memory overhead, we leverage discrepancy minimization theory to propose an online Gradient Balancing algorithm (GraB) that enjoys the same rate as herding, while reducing the memory usage from $O(nd)$ to just $O(d)$ and computation from $O(n^2)$ to $O(n)$, where $d$ denotes the model dimension. We show empirically on applications including MNIST, CIFAR10, WikiText and GLUE that GraB can outperform random reshuffling in terms of both training and validation performance, and even outperform state-of-the-art greedy ordering while reducing memory usage over $100\times$.


title: Limit Cycles Analysis and Control of Evolutionary Game Dynamics with Environmental Feedback

abstract: Recently, an evolutionary game dynamics model taking into account the environmental feedback has been proposed to describe the co-evolution of strategic actions of a population of individuals and the state of the surrounding environment; correspondingly a range of interesting dynamic behaviors have been reported. In this paper, we provide new theoretical insight into such behaviors and discuss control options. Instead of the standard replicator dynamics, we use a more realistic and comprehensive model of replicator-mutator dynamics, to describe the strategic evolution of the population. After integrating the environment feedback, we study the effect of mutations on the resulting closed-loop system dynamics. We prove the conditions for two types of bifurcations, Hopf bifurcation and Heteroclinic bifurcation, both of which result in stable limit cycles. These limit cycles have not been identified in existing works, and we further prove that such limit cycles are in fact persistent in a large parameter space and are almost globally stable. In the end, an intuitive control policy based on incentives is applied, and the effectiveness of this control policy is examined by analysis and simulations.


title: Computation time and thermodynamic uncertainty relation of Brownian circuits

abstract: We analyze a token-based Brownian circuit in which Brownian particles, coined `tokens,' move randomly by exploiting thermal fluctuations, searching for a path in multi-token state space corresponding to the solution of a given problem. The circuit can evaluate a Boolean function with a unique solution. However, its computation time varies with each run. We numerically calculate the probability distributions of Brownian adders' computation time, given by the first-passage time, and analyze the thermodynamic uncertainty relation and the thermodynamic cost based on stochastic thermodynamics. The computation can be completed in finite time without environment entropy production, i.e., without wasting heat to the environment. The thermodynamics cost is paid through error-free output detection and the resets of computation cycles. The signal-to-noise ratio quantifies the computation time's predictability, and it is well estimated by the mixed bound, which is approximated by the square root of the number of token detections. The thermodynamic cost tends to play a minor role in token-based Brownian circuits in computation cycles. This contrasts with the logically reversible Brownian Turing machine, in which the entropy production increases logarithmically with the size of the state space, and thus worsens the mixed bound.


title: Should Models Be Accurate?

abstract: Model-based Reinforcement Learning (MBRL) holds promise for data-efficiency by planning with model-generated experience in addition to learning with experience from the environment. However, in complex or changing environments, models in MBRL will inevitably be imperfect, and their detrimental effects on learning can be difficult to mitigate. In this work, we question whether the objective of these models should be the accurate simulation of environment dynamics at all. We focus our investigations on Dyna-style planning in a prediction setting. First, we highlight and support three motivating points: a perfectly accurate model of environment dynamics is not practically achievable, is not necessary, and is not always the most useful anyways. Second, we introduce a meta-learning algorithm for training models with a focus on their usefulness to the learner instead of their accuracy in modelling the environment. Our experiments show that in a simple non-stationary environment, our algorithm enables faster learning than even using an accurate model built with domain-specific knowledge of the non-stationarity.


title: ALITA: A Large-scale Incremental Dataset for Long-term Autonomy

abstract: For long-term autonomy, most place recognition methods are mainly evaluated on simplified scenarios or simulated datasets, which cannot provide solid evidence to evaluate the readiness for current Simultaneous Localization and Mapping (SLAM). In this paper, we present a long-term place recognition dataset for use in mobile localization under large-scale dynamic environments. This dataset includes a campus-scale track and a city-scale track: 1) the campus-track focuses the long-term property, we record LiDAR device and an omnidirectional camera on 10 trajectories, and each trajectory are repeatly recorded 8 times under variant illumination conditions. 2) the city-track focuses the large-scale property, we mount the LiDAR device on the vehicle and traversing through a 120km trajectories, which contains open streets, residential areas, natural terrains, etc. They includes 200 hours of raw data of all kinds scenarios within urban environments. The ground truth position for both tracks are provided on each trajectory, which is obtained from the Global Position System with an additional General ICP based point cloud refinement. To simplify the evaluation procedure, we also provide the Python-API with a set of place recognition metrics is proposed to quickly load our dataset and evaluate the recognition performance against different methods. This dataset targets at finding methods with high place recognition accuracy and robustness, and providing real robotic system with long-term autonomy. The dataset and the provided tools can be accessed from https://github.com/MetaSLAM/ALITA.


title: OTAdapt: Optimal Transport-based Approach For Unsupervised Domain Adaptation

abstract: Unsupervised domain adaptation is one of the challenging problems in computer vision. This paper presents a novel approach to unsupervised domain adaptations based on the optimal transport-based distance. Our approach allows aligning target and source domains without the requirement of meaningful metrics across domains. In addition, the proposal can associate the correct mapping between source and target domains and guarantee a constraint of topology between source and target domains. The proposed method is evaluated on different datasets in various problems, i.e. (i) digit recognition on MNIST, MNIST-M, USPS datasets, (ii) Object recognition on Amazon, Webcam, DSLR, and VisDA datasets, (iii) Insect Recognition on the IP102 dataset. The experimental results show that our proposed method consistently improves performance accuracy. Also, our framework could be incorporated with any other CNN frameworks within an end-to-end deep network design for recognition problems to improve their performance.


title: Offline Policy Comparison with Confidence: Benchmarks and Baselines

abstract: Decision makers often wish to use offline historical data to compare sequential-action policies at various world states. Importantly, computational tools should produce confidence values for such offline policy comparison (OPC) to account for statistical variance and limited data coverage. Nevertheless, there is little work that directly evaluates the quality of confidence values for OPC. In this work, we address this issue by creating benchmarks for OPC with Confidence (OPCC), derived by adding sets of policy comparison queries to datasets from offline reinforcement learning. In addition, we present an empirical evaluation of the risk versus coverage trade-off for a class of model-based baselines. In particular, the baselines learn ensembles of dynamics models, which are used in various ways to produce simulations for answering queries with confidence values. While our results suggest advantages for certain baseline variations, there appears to be significant room for improvement in future work.


title: Exact SDP Formulation for Discrete-Time Covariance Steering with Wasserstein Terminal Cost

abstract: In this paper, we present new results on the covariance steering problem with Wasserstein distance terminal cost. We show that the state history feedback control policy parametrization, which has been used before to solve this class of problems, requires an unnecessarily large number of variables and can be replaced by a randomized state feedback policy which leads to more tractable problem formulations without any performance loss. In particular, we show that under the latter policy, the problem can be equivalently formulated as a semi-definite program (SDP) which is in sharp contrast with our previous results that could only guarantee that the stochastic optimal control problem can be reduced to a difference of convex functions program. Then, we show that the optimal policy that is found by solving the associated SDP corresponds to a deterministic state feedback policy. Finally, we present non-trivial numerical simulations which show the benefits of our proposed randomized state feedback policy derived from the SDP formulation of the problem over existing approaches in the field in terms of computational efficacy and controller performance.


title: Exploiting Constructive Interference for Backscatter Communication Systems

abstract: Backscatter communication (BackCom), one of the core technologies to realize zero-power communication, is expected to be a pivotal paradigm for the next generation of the Internet of Things (IoT). However, the "strong" direct link (DL) interference (DLI) is traditionally assumed to be harmful, and generally drowns out the "weak" backscattered signals accordingly, thus deteriorating the performance of BackCom. In contrast to the previous efforts to eliminate the DLI, in this paper, we exploit the constructive interference (CI), in which the DLI contributes to the backscattered signal. To be specific, our objective is to maximize the received signal power by jointly optimizing the receive beamforming vectors and tag selection factors, which is, however, non-convex and difficult to solve due to constraints on the Kullback-Leibler (KL) divergence. In order to solve this problem, we first decompose the original problem, and then propose two algorithms to solve the sub-problem with beamforming design via a change of variables and semi-definite programming (SDP) and a greedy algorithm to solve the sub-problem with tag selection. In order to gain insight into the CI, we consider a special case with the single-antenna reader to reveal the channel angle between the backscattering link (BL) and the DL, in which the DLI will become constructive. Simulation results show that significant performance gain can always be achieved in the proposed algorithms compared with the traditional algorithms without the DL in terms of the strength of the received signal. The derived constructive channel angle for the BackCom system with the single-antenna reader is also confirmed by simulation results.


title: Effects of pairing gap and band gap on superfluid density in the inner crust of neutron stars

abstract: Calculations of the superfluid density in the inner crust of neutron stars by different approaches are in strong disagreement, which causes a debate on the accountability of pulsar glitches based on superfluidity. Taking a simple unified model, we study the dependence on approximation of the superfluid density in a periodic potential. In comparison with the Hartree-Fock-Bogoliubov (HF-Bogoliubov) theory which treats the effects of the band gap and the pairing gap on equal footing, we examine the HF-BCS-type approximation in which the former is incorporated in priority, and another approximation in which the latter is incorporated in priority. We find that, when the pairing gap and the band gap are comparable as in the inner crust of neutron stars, they need to be treated on equal footing, and the HF-BCS approximation can considerably underestimate the superfluid density even if the pairing gap is much smaller than the Fermi energy. Our result suggests that the validity of the HF-BCS approximation for evaluating the superfluid density in neutron star crusts is questionable.


title: Do Deep Learning Models and News Headlines Outperform Conventional Prediction Techniques on Forex Data?

abstract: Foreign Exchange (FOREX) is a decentralised global market for exchanging currencies. The Forex market is enormous, and it operates 24 hours a day. Along with country-specific factors, Forex trading is influenced by cross-country ties and a variety of global events. Recent pandemic scenarios such as COVID19 and local elections can also have a significant impact on market pricing. We tested and compared various predictions with external elements such as news items in this work. Additionally, we compared classical machine learning methods to deep learning algorithms. We also added sentiment features from news headlines using NLP-based word embeddings and compared the performance. Our results indicate that simple regression model like linear, SGD, and Bagged performed better than deep learning models such as LSTM and RNN for single-step forecasting like the next two hours, the next day, and seven days. Surprisingly, news articles failed to improve the predictions indicating domain-based and relevant information only adds value. Among the text vectorization techniques, Word2Vec and SentenceBERT perform better.


title: All Birds with One Stone: Multi-task Text Classification for Efficient Inference with One Forward Pass

abstract: Multi-Task Learning (MTL) models have shown their robustness, effectiveness, and efficiency for transferring learned knowledge across tasks. In real industrial applications such as web content classification, multiple classification tasks are predicted from the same input text such as a web article. However, at the serving time, the existing multitask transformer models such as prompt or adaptor based approaches need to conduct N forward passes for N tasks with O(N) computation cost. To tackle this problem, we propose a scalable method that can achieve stronger performance with close to O(1) computation cost via only one forward pass. To illustrate real application usage, we release a multitask dataset on news topic and style classification. Our experiments show that our proposed method outperforms strong baselines on both the GLUE benchmark and our news dataset. Our code and dataset are publicly available at https://bit.ly/mtop-code.


title: Classification of Quasars, Galaxies, and Stars in the Mapping of the Universe Multi-modal Deep Learning

abstract: In this paper, the fourth version the Sloan Digital Sky Survey (SDSS-4), Data Release 16 dataset was used to classify the SDSS dataset into galaxies, stars, and quasars using machine learning and deep learning architectures. We efficiently utilize both image and metadata in tabular format to build a novel multi-modal architecture and achieve state-of-the-art results. In addition, our experiments on transfer learning using Imagenet weights on five different architectures (Resnet-50, DenseNet-121 VGG-16, Xception, and EfficientNet) reveal that freezing all layers and adding a final trainable layer may not be an optimal solution for transfer learning. It is hypothesized that higher the number of trainable layers, higher will be the training time and accuracy of predictions. It is also hypothesized that any subsequent increase in the number of training layers towards the base layers will not increase in accuracy as the pre trained lower layers only help in low level feature extraction which would be quite similar in all the datasets. Hence the ideal level of trainable layers needs to be identified for each model in respect to the number of parameters. For the tabular data, we compared classical machine learning algorithms (Logistic Regression, Random Forest, Decision Trees, Adaboost, LightGBM etc.,) with artificial neural networks. Our works shed new light on transfer learning and multi-modal deep learning architectures. The multi-modal architecture not only resulted in higher metrics (accuracy, precision, recall, F1 score) than models using only image data or tabular data. Furthermore, multi-modal architecture achieved the best metrics in lesser training epochs and improved the metrics on all classes.


title: Athlete rating in multi-competitor games with scored outcomes via monotone transformations

abstract: Sports organizations often want to estimate athlete strengths. For games with scored outcomes, a common approach is to assume observed game scores follow a normal distribution conditional on athletes' latent abilities, which may change over time. In many games, however, this assumption of conditional normality does not hold. To estimate athletes' time-varying latent abilities using non-normal game score data, we propose a Bayesian dynamic linear model with flexible monotone response transformations. Our model learns nonlinear monotone transformations to address non-normality in athlete scores and can be easily fit using standard regression and optimization routines, which we implement in the dlmt package in R. We demonstrate our method on data from several Olympic sports, including biathlon, diving, rugby, and fencing.


title: Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners

abstract: The goal of this work is to build flexible video-language models that can generalize to various video-to-text tasks from few examples, such as domain-specific captioning, question answering, and future event prediction. Existing few-shot video-language learners focus exclusively on the encoder, resulting in the absence of a video-to-text decoder to handle generative tasks. Video captioners have been pretrained on large-scale video-language datasets, but they rely heavily on finetuning and lack the ability to generate text for unseen tasks in a few-shot setting. We propose VidIL, a few-shot Video-language Learner via Image and Language models, which demonstrates strong performance on few-shot video-to-text tasks without the necessity of pretraining or finetuning on any video datasets. We use the image-language models to translate the video content into frame captions, object, attribute, and event phrases, and compose them into a temporal structure template. We then instruct a language model, with a prompt containing a few in-context examples, to generate a target output from the composed content. The flexibility of prompting allows the model to capture any form of text input, such as automatic speech recognition (ASR) transcripts. Our experiments demonstrate the power of language models in understanding videos on a wide variety of video-language tasks, including video captioning, video question answering, video caption retrieval, and video future event prediction. Especially, on video future event prediction, our few-shot model significantly outperforms state-of-the-art supervised models trained on large-scale video datasets. Code and resources are publicly available for research purposes at https://github.com/MikeWangWZHL/VidIL .


title: Preparing data for pathological artificial intelligence with clinical-grade performance

abstract: [Purpose] The pathology is decisive for disease diagnosis, but relies heavily on the experienced pathologists. Recently, pathological artificial intelligence (PAI) is thought to improve diagnostic accuracy and efficiency. However, the high performance of PAI based on deep learning in the laboratory generally cannot be reproduced in the clinic. [Methods] Because the data preparation is important for PAI, the paper has reviewed PAI-related studies in the PubMed database published from January 2017 to February 2022, and 118 studies were included. The in-depth analysis of methods for preparing data is performed, including obtaining slides of pathological tissue, cleaning, screening, and then digitizing. Expert review, image annotation, dataset division for model training and validation are also discussed. We further discuss the reasons why the high performance of PAI is not reproducible in the clinical practices and show some effective ways to improve clinical performances of PAI. [Results] The robustness of PAI depend on randomized collection of representative disease slides, including rigorous quality control and screening, correction of digital discrepancies, reasonable annotation, and the amount of data. The digital pathology is fundamental of clinical-grade PAI, and the techniques of data standardization and weakly supervised learning methods based on whole slide image (WSI) are effective ways to overcome obstacles of performance reproduction. [Conclusion] The representative data, the amount of labeling and consistency from multi-centers is the key to performance reproduction. The digital pathology for clinical diagnosis, data standardization and technique of WSI-based weakly supervised learning hopefully build clinical-grade PAI. Keywords: pathological artificial intelligence; data preparation; clinical-grade; deep learning


title: Vanishing Spaces of Random Sets and Applications to Reed-Muller Codes

abstract: We study the following natural question on random sets of points in $\mathbb{F}_2^m$: Given a random set of $k$ points $Z=\{z_1, z_2, \dots, z_k\} \subseteq \mathbb{F}_2^m$, what is the dimension of the space of degree at most $r$ multilinear polynomials that vanish on all points in $Z$? We show that, for $r \leq \gamma m$ (where $\gamma > 0$ is a small, absolute constant) and $k = (1-\epsilon) \cdot \binom{m}{\leq r}$ for any constant $\epsilon > 0$, the space of degree at most $r$ multilinear polynomials vanishing on a random set $Z = \{z_1,\ldots, z_k\}$ has dimension exactly $\binom{m}{\leq r} - k$ with probability $1 - o(1)$. This bound shows that random sets have a much smaller space of degree at most $r$ multilinear polynomials vanishing on them, compared to the worst-case bound (due to Wei (IEEE Trans. Inform. Theory, 1991)) of $\binom{m}{\leq r} - \binom{\log_2 k}{\leq r} \gg \binom{m}{\leq r} - k$. Using this bound, we show that high-degree Reed-Muller codes ($\text{RM}(m,d)$ with $d > (1-\gamma) m$) "achieve capacity" under the Binary Erasure Channel in the sense that, for any $\epsilon > 0$, we can recover from $(1 - \epsilon) \cdot \binom{m}{\leq m-d-1}$ random erasures with probability $1 - o(1)$. This also implies that $\text{RM}(m,d)$ is also efficiently decodable from $\approx \binom{m}{\leq m-(d/2)}$ random errors for the same range of parameters.


title: Multi-Agent Feedback Enabled Neural Networks for Intelligent Communications

abstract: In the intelligent communication field, deep learning (DL) has attracted much attention due to its strong fitting ability and data-driven learning capability. Compared with the typical DL feedforward network structures, an enhancement structure with direct data feedback have been studied and proved to have better performance than the feedfoward networks. However, due to the above simple feedback methods lack sufficient analysis and learning ability on the feedback data, it is inadequate to deal with more complicated nonlinear systems and therefore the performance is limited for further improvement. In this paper, a novel multi-agent feedback enabled neural network (MAFENN) framework is proposed, which make the framework have stronger feedback learning capabilities and more intelligence on feature abstraction, denoising or generation, etc. Furthermore, the MAFENN framework is theoretically formulated into a three-player Feedback Stackelberg game, and the game is proved to converge to the Feedback Stackelberg equilibrium. The design of MAFENN framework and algorithm are dedicated to enhance the learning capability of the feedfoward DL networks or their variations with the simple data feedback. To verify the MAFENN framework's feasibility in wireless communications, a multi-agent MAFENN based equalizer (MAFENN-E) is developed for wireless fading channels with inter-symbol interference (ISI). Experimental results show that when the quadrature phase-shift keying (QPSK) modulation scheme is adopted, the SER performance of our proposed method outperforms that of the traditional equalizers by about 2 dB in linear channels. When in nonlinear channels, the SER performance of our proposed method outperforms that of either traditional or DL based equalizers more significantly, which shows the effectiveness and robustness of our proposal in the complex channel environment.


title: Duality and Sheared Analytic Response in Mechanism-Based Metamaterials

abstract: Mechanical metamaterials designed around a zero-energy pathway of deformation, known as a mechanism, have repeatedly challenged the conventional picture of elasticity. However, the complex spatial deformations these structures are able to support beyond the uniform mechanism remain largely uncharted. Here we present a unified theoretical framework, showing that the presence of any uniform mechanism in a two-dimensional structure fundamentally changes its elastic response by admitting a family of non-uniform zero-energy deformations. Our formalism reveals a mathematical duality between these stress-free strains, which we term "sheared analytic modes" and the supported spatial profiles of stress. These modes undergo a transition from bulk periodic response to evanescent surface response as the Poisson's ratio $\nu$ of the mechanism is tuned through an exceptional point at $\nu=0$. We suggest a first application of these unusual response properties as a switchable signal amplifier and filter for use in mechanical circuitry and computation.


abstract: Single-objective optimization algorithms search for the single highest-quality solution with respect to an objective. Quality diversity (QD) optimization algorithms, such as Covariance Matrix Adaptation MAP-Elites (CMA-ME), search for a collection of solutions that are both high-quality with respect to an objective and diverse with respect to specified measure functions. However, CMA-ME suffers from three major limitations highlighted by the QD community: prematurely abandoning the objective in favor of exploration, struggling to explore flat objectives, and having poor performance for low-resolution archives. We propose a new quality diversity algorithm, Covariance Matrix Adaptation MAP-Annealing (CMA-MAE), that addresses all three limitations. We provide theoretical justifications for the new algorithm with respect to each limitation. Our theory informs our experiments, which support the theory and show that CMA-MAE achieves state-of-the-art performance and robustness.


title: High-resolution European daily soil moisture derived with machine learning (2003-2020)

abstract: Machine learning (ML) has emerged as a novel tool for generating large-scale land surface data in recent years. ML can learn the relationship between input and target, e.g. meteorological variables and in-situ soil moisture, and then estimate soil moisture across space and time, independently of prior physics-based knowledge. Here we develop a high-resolution (0.1{\deg}) daily soil moisture dataset in Europe (SoMo.ml-EU) using Long Short-Term Memory trained with in-situ measurements. The resulting dataset covers three vertical layers and the period 2003-2020. Compared to its previous version with a lower spatial resolution (0.25{\deg}), it shows a closer agreement with independent in-situ data in terms of temporal variation, demonstrating the enhanced usefulness of in-situ observations when processed jointly with high-resolution meteorological data. Regional comparison with other gridded datasets also demonstrates the ability of SoMo.ml-EU in describing the variability of soil moisture, including drought conditions. As a result, our new dataset will benefit regional studies requiring high-resolution observation-based soil moisture, such as hydrological and agricultural analyses. The SoMo.ml-EU is available at figshare.


title: Arithmetic properties of orders in imaginary quadratic fields

abstract: Let $K$ be an imaginary quadratic field. For an order $\mathcal{O}$ in $K$ and a positive integer $N$, let $K_{\mathcal{O},\,N}$ be the ray class field of $\mathcal{O}$ modulo $N\mathcal{O}$. We deal with various subjects related to $K_{\mathcal{O},\,N}$, mainly about Galois representations attached to elliptic curves with complex multiplication, form class groups and $L$-functions for orders.


title: Spatiotemporal pattern formation in nonlinear coupled reaction-diffusion systems with a mixed-type modal discontinuous Galerkin approach

abstract: The nonlinear coupled reaction-diffusion (NCRD) systems are important in the formation of spatiotemporal patterns in many scientific and engineering fields, including physical and chemical processes, biology, electrochemical processes, fractals, viscoelastic materials, porous media, and many others. In this study, a mixed-type modal discontinuous Galerkin approach is developed for one- and two- dimensional NCRD systems, including linear, Gray-Scott, Brusselator, isothermal chemical, and Schnakenberg models to yield the spatiotemporal patterns. These models essentially represent a variety of complicated natural spatiotemporal patterns such as spots, spot replication, stripes, hexagons, and so on. In this approach, a mixed-type formulation is presented to address the second-order derivatives emerging in the diffusion terms. For spatial discretization, hierarchical modal basis functions premised on the orthogonal scaled Legendre polynomials are used. Moreover, a novel reaction term treatment is proposed for the NCRD systems, demonstrating an intrinsic feature of the new DG scheme and preventing erroneous solutions due to extremely nonlinear reaction terms. The proposed approach reduces the NCRD systems into a framework of ordinary differential equations in time, which are addressed by an explicit third-order TVD Runge-Kutta algorithm. The spatiotemporal patterns generated with the present approach are very comparable to those found in the literature. This approach can readily be expanded to handle large multi-dimensional problems that come up as model equations in developed biological and chemical applications.


title: Real Time Detection Free Tracking of Multiple Objects Via Equilibrium Optimizer

abstract: Multiple objects tracking (MOT) is a difficult task, as it usually requires special hardware and higher computation complexity. In this work, we present a new framework of MOT by using of equilibrium optimizer (EO) algorithm and reducing the resolution of the bounding boxes of the objects to solve such problems in the detection free framework. First, in the first frame the target objects are initialized and its size is computed, then its resolution is reduced if it is higher than a threshold, and then modeled by their kernel color histogram to establish a feature model. The Bhattacharya distances between the histogram of object models and other candidates are used as the fitness function to be optimized. Multiple agents are generated by EO, according to the number of the target objects to be tracked. EO algorithm is used because of its efficiency and lower computation cost compared to other algorithms in global optimization. Experimental results confirm that EO multi-object tracker achieves satisfying tracking results then other trackers.


title: Deep Feature Fusion via Graph Convolutional Network for Intracranial Artery Labeling

abstract: Intracranial arteries are critical blood vessels that supply the brain with oxygenated blood. Intracranial artery labels provide valuable guidance and navigation to numerous clinical applications and disease diagnoses. Various machine learning algorithms have been carried out for automation in the anatomical labeling of cerebral arteries. However, the task remains challenging because of the high complexity and variations of intracranial arteries. This study investigates a novel graph convolutional neural network with deep feature fusion for cerebral artery labeling. We introduce stacked graph convolutions in an encoder-core-decoder architecture, extracting high-level representations from graph nodes and their neighbors. Furthermore, we efficiently aggregate intermediate features from different hierarchies to enhance the proposed model's representation capability and labeling performance. We perform extensive experiments on public datasets, in which the results prove the superiority of our approach over baselines by a clear margin.


title: Residual Channel Attention Network for Brain Glioma Segmentation

abstract: A glioma is a malignant brain tumor that seriously affects cognitive functions and lowers patients' life quality. Segmentation of brain glioma is challenging because of interclass ambiguities in tumor regions. Recently, deep learning approaches have achieved outstanding performance in the automatic segmentation of brain glioma. However, existing algorithms fail to exploit channel-wise feature interdependence to select semantic attributes for glioma segmentation. In this study, we implement a novel deep neural network that integrates residual channel attention modules to calibrate intermediate features for glioma segmentation. The proposed channel attention mechanism adaptively weights feature channel-wise to optimize the latent representation of gliomas. We evaluate our method on the established dataset BraTS2017. Experimental results indicate the superiority of our method.


title: Sequential/Session-based Recommendations: Challenges, Approaches, Applications and Opportunities

abstract: In recent years, sequential recommender systems (SRSs) and session-based recommender systems (SBRSs) have emerged as a new paradigm of RSs to capture users' short-term but dynamic preferences for enabling more timely and accurate recommendations. Although SRSs and SBRSs have been extensively studied, there are many inconsistencies in this area caused by the diverse descriptions, settings, assumptions and application domains. There is no work to provide a unified framework and problem statement to remove the commonly existing and various inconsistencies in the area of SR/SBR. There is a lack of work to provide a comprehensive and systematic demonstration of the data characteristics, key challenges, most representative and state-of-the-art approaches, typical real-world applications and important future research directions in the area. This work aims to fill in these gaps so as to facilitate further research in this exciting and vibrant area.


title: CNNs Avoid Curse of Dimensionality by Learning on Patches

abstract: Despite the success of convolutional neural networks (CNNs) in numerous computer vision tasks and their extraordinary generalization performances, several attempts to predict the generalization errors of CNNs have only been limited to a posteriori analyses thus far. A priori theories explaining the generalization performances of deep neural networks have mostly ignored the convolutionality aspect and do not specify why CNNs are able to seemingly overcome curse of dimensionality on computer vision tasks like image classification where the image dimensions are in thousands. Our work attempts to explain the generalization performance of CNNs on image classification under the hypothesis that CNNs operate on the domain of image patches. Ours is the first work we are aware of to derive an a priori error bound for the generalization error of CNNs and we present both quantitative and qualitative evidences in the support of our theory. Our patch-based theory also offers explanation for why data augmentation techniques like Cutout, CutMix and random cropping are effective in improving the generalization error of CNNs.


title: The Role of Placebo Samples in Observational Studies

abstract: In an observational study, it is common to leverage known null effect to detect bias. One such strategy is to set aside a placebo sample -- a subset of data immune from the hypothesized cause-and-effect relationship. Existence of an effect in the placebo sample raises concern of unmeasured confounding bias while absence of it corroborates the causal conclusion. This paper establishes a formal framework for using a placebo sample to detect and remove bias. We state identification assumption, and develop estimation and inference methods based on outcome regression, inverse probability weighting, and doubly-robust approaches. Simulation studies and an empirical application illustrate the finite-sample performance of the proposed methods.


title: How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contexts

abstract: Neural Machine Translation systems built on top of Transformer-based architectures are routinely improving the state-of-the-art in translation quality according to word-overlap metrics. However, a growing number of studies also highlight the inherent gender bias that these models incorporate during training, which reflects poorly in their translations. In this work, we investigate whether these models can be instructed to fix their bias during inference using targeted, guided instructions as contexts. By translating relevant contextual sentences during inference along with the input, we observe large improvements in reducing the gender bias in translations, across three popular test suites (WinoMT, BUG, SimpleGen). We further propose a novel metric to assess several large pre-trained models (OPUS-MT, M2M-100) on their sensitivity towards using contexts during translation to correct their biases. Our approach requires no fine-tuning and thus can be used easily in production systems to de-bias translations from stereotypical gender-occupation bias 1. We hope our method, along with our metric, can be used to build better, bias-free translation systems.


title: A Deep Conjugate Direction Method for Iteratively Solving Linear Systems

abstract: We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for partial differential equations. Algorithms for approximating the solution to these systems are often the bottleneck in problems that require their solution, particularly for modern applications that require many millions of unknowns. Indeed, numerical linear algebra techniques have been investigated for many decades to alleviate this computational burden. Recently, data-driven techniques have also shown promise for these problems. Motivated by the conjugate gradients algorithm that iteratively selects search directions for minimizing the matrix norm of the approximation error, we design an approach that utilizes a deep neural network to accelerate convergence via data-driven improvement of the search directions. Our method leverages a carefully chosen convolutional network to approximate the action of the inverse of the linear operator up to an arbitrary constant. We train the network using unsupervised learning with a loss function equal to the $L^2$ difference between an input and the system matrix times the network evaluation, where the unspecified constant in the approximate inverse is accounted for. We demonstrate the efficacy of our approach on spatially discretized Poisson equations with millions of degrees of freedom arising in computational fluid dynamics applications. Unlike state-of-the-art learning approaches, our algorithm is capable of reducing the linear system residual to a given tolerance in a small number of iterations, independent of the problem size. Moreover, our method generalizes effectively to various systems beyond those encountered during training.


title: Evidence for Hypodescent in Visual Semantic AI

abstract: We examine the state-of-the-art multimodal "visual semantic" model CLIP ("Contrastive Language Image Pretraining") for the rule of hypodescent, or one-drop rule, whereby multiracial people are more likely to be assigned a racial or ethnic label corresponding to a minority or disadvantaged racial or ethnic group than to the equivalent majority or advantaged group. A face morphing experiment grounded in psychological research demonstrating hypodescent indicates that, at the midway point of 1,000 series of morphed images, CLIP associates 69.7% of Black-White female images with a Black text label over a White text label, and similarly prefers Latina (75.8%) and Asian (89.1%) text labels at the midway point for Latina-White female and Asian-White female morphs, reflecting hypodescent. Additionally, assessment of the underlying cosine similarities in the model reveals that association with White is correlated with association with "person," with Pearson's rho as high as 0.82 over a 21,000-image morph series, indicating that a White person corresponds to the default representation of a person in CLIP. Finally, we show that the stereotype-congruent pleasantness association of an image correlates with association with the Black text label in CLIP, with Pearson's rho = 0.48 for 21,000 Black-White multiracial male images, and rho = 0.41 for Black-White multiracial female images. CLIP is trained on English-language text gathered using data collected from an American website (Wikipedia), and our findings demonstrate that CLIP embeds the values of American racial hierarchy, reflecting the implicit and explicit beliefs that are present in human minds. We contextualize these findings within the history and psychology of hypodescent. Overall, the data suggests that AI supervised using natural language will, unless checked, learn biases that reflect racial hierarchies.


title: The Hubble PanCET Program: A Featureless Transmission Spectrum for WASP-29b and Evidence of Enhanced Atmospheric Metallicity on WASP-80b

abstract: We present a uniform analysis of transit observations from the Hubble Space Telescope and Spitzer Space Telescope of two warm gas giants orbiting K-type stars - WASP-29b and WASP-80b. The transmission spectra, which span 0.4-5.0 $\mu$m, are interpreted using a suite of chemical equilibrium PLATON atmospheric retrievals. Both planets show evidence of significant aerosol opacity along the day-night terminator. The spectrum of WASP-29b is flat throughout the visible and near-infrared, suggesting the presence of condensate clouds extending to low pressures. The lack of spectral features hinders our ability to constrain the atmospheric metallicity and C/O ratio. In contrast, WASP-80b shows a discernible, albeit muted H$_2$O absorption feature at 1.4 $\mu$m, as well as a steep optical spectral slope that is caused by fine-particle aerosols and/or contamination from unocculted spots on the variable host star. WASP-80b joins the small number of gas-giant exoplanets that show evidence for enhanced atmospheric metallicity: the transmission spectrum is consistent with metallicities ranging from $\sim$30-100 times solar in the case of cloudy limbs to a few hundred times solar in the cloud-free scenario. In addition to the detection of water, we infer the presence of CO$_2$ in the atmosphere of WASP-80b based on the enhanced transit depth in the Spitzer 4.5 $\mu$m bandpass. From a complementary analysis of Spitzer secondary eclipses, we find that the dayside emission from WASP-29b and WASP-80b is consistent with brightness temperatures of $937 \pm 48$ and $851 \pm 14$ K, respectively, indicating relatively weak day-night heat transport and low Bond albedo.


title: Recent Advances in Embedding Methods for Multi-Object Tracking: A Survey

abstract: Multi-object tracking (MOT) aims to associate target objects across video frames in order to obtain entire moving trajectories. With the advancement of deep neural networks and the increasing demand for intelligent video analysis, MOT has gained significantly increased interest in the computer vision community. Embedding methods play an essential role in object location estimation and temporal identity association in MOT. Unlike other computer vision tasks, such as image classification, object detection, re-identification, and segmentation, embedding methods in MOT have large variations, and they have never been systematically analyzed and summarized. In this survey, we first conduct a comprehensive overview with in-depth analysis for embedding methods in MOT from seven different perspectives, including patch-level embedding, single-frame embedding, cross-frame joint embedding, correlation embedding, sequential embedding, tracklet embedding, and cross-track relational embedding. We further summarize the existing widely used MOT datasets and analyze the advantages of existing state-of-the-art methods according to their embedding strategies. Finally, some critical yet under-investigated areas and future research directions are discussed.


title: Human Instance Matting via Mutual Guidance and Multi-Instance Refinement

abstract: This paper introduces a new matting task called human instance matting (HIM), which requires the pertinent model to automatically predict a precise alpha matte for each human instance. Straightforward combination of closely related techniques, namely, instance segmentation, soft segmentation and human/conventional matting, will easily fail in complex cases requiring disentangling mingled colors belonging to multiple instances along hairy and thin boundary structures. To tackle these technical challenges, we propose a human instance matting framework, called InstMatt, where a novel mutual guidance strategy working in tandem with a multi-instance refinement module is used, for delineating multi-instance relationship among humans with complex and overlapping boundaries if present. A new instance matting metric called instance matting quality (IMQ) is proposed, which addresses the absence of a unified and fair means of evaluation emphasizing both instance recognition and matting quality. Finally, we construct a HIM benchmark for evaluation, which comprises of both synthetic and natural benchmark images. In addition to thorough experimental results on complex cases with multiple and overlapping human instances each has intricate boundaries, preliminary results are presented on general instance matting. Code and benchmark are available in https://github.com/nowsyn/InstMatt.


title: Neuro-Symbolic Artificial Intelligence (AI) for Intent based Semantic Communication

abstract: Intent-based networks that integrate sophisticated machine reasoning technologies will be a cornerstone of future wireless 6G systems. Intent-based communication requires the network to consider the semantics (meanings) and effectiveness (at end-user) of the data transmission. This is essential if 6G systems are to communicate reliably with fewer bits while simultaneously providing connectivity to heterogeneous users. In this paper, contrary to state of the art, which lacks explainability of data, the framework of neuro-symbolic artificial intelligence (NeSy AI) is proposed as a pillar for learning causal structure behind the observed data. In particular, the emerging concept of generative flow networks (GFlowNet) is leveraged for the first time in a wireless system to learn the probabilistic structure which generates the data. Further, a novel optimization problem for learning the optimal encoding and decoding functions is rigorously formulated with the intent of achieving higher semantic reliability. Novel analytical formulations are developed to define key metrics for semantic message transmission, including semantic distortion, semantic similarity, and semantic reliability. These semantic measure functions rely on the proposed definition of semantic content of the knowledge base and this information measure is reflective of the nodes' reasoning capabilities. Simulation results validate the ability to communicate efficiently (with less bits but same semantics) and significantly better compared to a conventional system which does not exploit the reasoning capabilities.


title: Average shadowing revisited

abstract: We propose a novel unifying approach to study the shadowing property for a broad class of dynamical systems (in particular, discontinuous and non-invertible) under a variety of perturbations. In distinction to known constructions, our approach is local: it is based on the gluing property which takes into account the shadowing under a single (not necessarily small) perturbation.


title: Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models

abstract: Despite their wide adoption, the underlying training and memorization dynamics of very large language models is not well understood. We empirically study exact memorization in causal and masked language modeling, across model sizes and throughout the training process. We measure the effects of dataset size, learning rate, and model size on memorization, finding that larger language models memorize training data faster across all settings. Surprisingly, we show that larger models can memorize a larger portion of the data before over-fitting and tend to forget less throughout the training process. We also analyze the memorization dynamics of different parts of speech and find that models memorize nouns and numbers first; we hypothesize and provide empirical evidence that nouns and numbers act as a unique identifier for memorizing individual training examples. Together, these findings present another piece of the broader puzzle of trying to understand what actually improves as models get bigger.


title: Ring Pearcey vortex beam dynamics through atmospheric turbulence

abstract: The subject area of free space optical communication with optical beam carrying orbital angular momentum has attracted a great deal of research attention since last two decades. Efforts to understand, model and execute communication links through turbulent atmosphere with OAM beams have gained particular importance. In this regard, different types of shape preserving beams, which can withstand turbulences of varying strengths, have been proposed and studied. In this paper, we present a numerical investigation of the propagation characteristics of ring Pearcey vortex beam through turbulent atmosphere. The study details on both moderate as well as strong atmospheric turbulences. Modified von Karman model has been relied on to model random phase screen. In moderate turbulence, the ring PVB preserved its singularity. In strong turbulence, the ring PVB preserved its singularity for short propagation distances but lost its singularity at longer propagation distances. We found that upon increasing the value of topological charge, aperture averaged scintillation index increases. We calculated the aperture averaged SI for different truncation factors and noticed that the ring PVB with a truncation factor 0.1 performed better in stronger turbulence. In moderate turbulence, the aperture averaged SI performed better for shorter propagation distances and relatively larger truncation factors. Further, we calculated the aperture averaged SI for spatially chirped ring PVB, and it has been found that aperture averaged SI improved largely for negatively chirped ring PVB. Furthermore, on comparing the aperture averaged SI of ring PVB and ring Airy vortex beam, it has been noticed that in strong turbulence ring PVB exhibited better aperture averaged SI. Additionally, we have calculated the beam wander for ring PVB and ring AVB and found that ring PVB demonstrates better beam wander.


title: Fast Instrument Learning with Faster Rates

abstract: We investigate nonlinear instrumental variable (IV) regression given high-dimensional instruments. We propose a simple algorithm which combines kernelized IV methods and an arbitrary, adaptive regression algorithm, accessed as a black box. Our algorithm enjoys faster-rate convergence and adapts to the dimensionality of informative latent features, while avoiding an expensive minimax optimization procedure, which has been necessary to establish similar guarantees. It further brings the benefit of flexible machine learning models to quasi-Bayesian uncertainty quantification, likelihood-based model selection, and model averaging. Simulation studies demonstrate the competitive performance of our method.


title: A Domain-adaptive Pre-training Approach for Language Bias Detection in News

abstract: Media bias is a multi-faceted construct influencing individual behavior and collective decision-making. Slanted news reporting is the result of one-sided and polarized writing which can occur in various forms. In this work, we focus on an important form of media bias, i.e. bias by word choice. Detecting biased word choices is a challenging task due to its linguistic complexity and the lack of representative gold-standard corpora. We present DA-RoBERTa, a new state-of-the-art transformer-based model adapted to the media bias domain which identifies sentence-level bias with an F1 score of 0.814. In addition, we also train, DA-BERT and DA-BART, two more transformer models adapted to the bias domain. Our proposed domain-adapted models outperform prior bias detection approaches on the same data.


title: X- and Gamma-ray astrophysics in the era of Multi-messenger astronomy

abstract: Multi-messenger astronomy is becoming a major avenue to explore the Universe. Several well known astrophysical sources are also expected to emit other 'messenger' than photons: namely cosmic rays, gravitational waves and neutrinos. These additional messengers bring complementary pieces of information to the ones carried by electromagnetic radiation and concur to draw a complete phenomenological picture of several astrophysical events as well as to measure key cosmological parameters. Indeed, it is widely believed in the astronomical community that several aspects of fundamental physics and cosmology will be unveiled only within the framework of multi-messenger astronomy. The most recent breakthrough discoveries of a gravitational wave source associated with a short gamma-ray burst, and of a neutrino event found to be spatially consistent with a flaring blazar, have already shown the key role that high-energy sources will play in multi-messenger observations. The first part of this chapter provides a description of the main properties of gamma-ray bursts, blazars, and other high-energy sources from which we expect to detect gravitational waves and/or neutrinos in the next years, and the achievements that will be reached from multi-messenger observations. The second part of the chapter is focused on the major facilities that are playing and that will play a crucial role in multi-messenger observational campaigns. More specifically, we provide an overview of current and next generation ground-based gravitational wave interferometers and neutrino telescopes, as well as the major X-ray and gamma-ray observatories that will be crucial for multi-messenger observations in the coming years.


title: Ada-Ranker: A Data Distribution Adaptive Ranking Paradigm for Sequential Recommendation

abstract: A large-scale recommender system usually consists of recall and ranking modules. The goal of ranking modules (aka rankers) is to elaborately discriminate users' preference on item candidates proposed by recall modules. With the success of deep learning techniques in various domains, we have witnessed the mainstream rankers evolve from traditional models to deep neural models. However, the way that we design and use rankers remains unchanged: offline training the model, freezing the parameters, and deploying it for online serving. Actually, the candidate items are determined by specific user requests, in which underlying distributions (e.g., the proportion of items for different categories, the proportion of popular or new items) are highly different from one another in a production environment. The classical parameter-frozen inference manner cannot adapt to dynamic serving circumstances, making rankers' performance compromised. In this paper, we propose a new training and inference paradigm, termed as Ada-Ranker, to address the challenges of dynamic online serving. Instead of using parameter-frozen models for universal serving, Ada-Ranker can adaptively modulate parameters of a ranker according to the data distribution of the current group of item candidates. We first extract distribution patterns from the item candidates. Then, we modulate the ranker by the patterns to make the ranker adapt to the current data distribution. Finally, we use the revised ranker to score the candidate list. In this way, we empower the ranker with the capacity of adapting from a global model to a local model which better handles the current task.


title: Stress concentration factors for the Stokes flow with two nearly touching rigid particles

abstract: In this paper, a mathematical model of two adjacent rigid particles immersed into a viscous incompressible fluid is considered. The main feature of the flow is that the Cauchy stress tensor consisting of the strain tensor and the pressure will appear blow-up as the distance between these two particles tends to zero. For the purpose of making clear this high concentration, a family of unified stress concentration factors are precisely captured in all dimensions, which determine whether the Cauchy stress tensor will blow up or not. As a direct application, we establish optimal gradient estimates and asymptotics of the Cauchy stress tensor for Stokes flow, which indicate that its maximal singularity comes from the pressure.


title: Radius and Convolution problems of analytic functions involving Semigroup Generators

abstract: We establish the membership criteria in terms of Hadamard product for a normalized analytic function to be in the class of infinitesimal generators. Furthermore, the embedding of various subclasses of normalized univalent functions in the class of infinitesimal generators and the radii problems for this class are studied. The results derived, generalize the already known results.


title: Sleep Posture One-Shot Learning Framework Using Kinematic Data Augmentation: In-Silico and In-Vivo Case Studies

abstract: Sleep posture is linked to several health conditions such as nocturnal cramps and more serious musculoskeletal issues. However, in-clinic sleep assessments are often limited to vital signs (e.g. brain waves). Wearable sensors with embedded inertial measurement units have been used for sleep posture classification; nonetheless, previous works consider only few (commonly four) postures, which are inadequate for advanced clinical assessments. Moreover, posture learning algorithms typically require longitudinal data collection to function reliably, and often operate on raw inertial sensor readings unfamiliar to clinicians. This paper proposes a new framework for sleep posture classification based on a minimal set of joint angle measurements. The proposed framework is validated on a rich set of twelve postures in two experimental pipelines: computer animation to obtain synthetic postural data, and human participant pilot study using custom-made miniature wearable sensors. Through fusing raw geo-inertial sensor measurements to compute a filtered estimate of relative segment orientations across the wrist and ankle joints, the body posture can be characterised in a way comprehensible to medical experts. The proposed sleep posture learning framework offers plug-and-play posture classification by capitalising on a novel kinematic data augmentation method that requires only one training example per posture. Additionally, a new metric together with data visualisations are employed to extract meaningful insights from the postures dataset, demonstrate the added value of the data augmentation method, and explain the classification performance. The proposed framework attained promising overall accuracy as high as 100% on synthetic data and 92.7% on real data, on par with state of the art data-hungry algorithms available in the literature.


title: Anomaly free quantum dynamics for Euclidean LQG

abstract: Classical gravitational evolution admits an elegant and compact re-expression in terms of gauge covariant generalizations of Lie derivatives with respect to a spatial phase space dependent $su(2)$ valued vector field called the Electric Shift [1]. A quantum dynamics for Euclidean Loop Quantum Gravity which ascribes a central role to the Electric Shift operator is derived in [2]. $Here\; we\; show\; that\; this \;quantum\; dynamics\; is\; nontrivially\; anomaly$ $free$. Specifically, we show that on a suitable space of off shell states (a) the (non-vanishing) commutator between a pair of Hamiltonian constraint operators mirrors the Poisson bracket between their classical correspondents, (b) the group of finite spatial diffeomorphisms is faithfully represented and (c) the action of the Hamiltonian constraint operator is diffeomorphism covariant with respect to the action of spatial diffeomorphisms.


title: Data-aided Active User Detection with a User Activity Extraction Network for Grant-free SCMA Systems

abstract: In grant-free sparse code multiple access (GF-SCMA) system, active user detection (AUD) is a major performance bottleneck as it involves complex combinatorial problem, which makes joint design of contention resources for users and AUD at the receiver a crucial but a challenging problem. To this end, we propose autoencoder (AE)-based joint optimization of both preamble generation networks (PGNs) in the encoder side and data-aided AUD in the decoder side. The core architecture of the proposed AE is a novel user activity extraction network (UAEN) in the decoder that extracts a priori user activity information from the SCMA codeword data for the data-aided AUD. An end-to-end training of the proposed AE enables joint optimization of the contention resources, i.e., preamble sequences, each associated with one of the codebooks, and extraction of user activity information from both preamble and SCMA-based data transmission. Furthermore, we propose a self-supervised pre-training scheme for the UAEN prior to the end-to-end training, to ensure the convergence of the UAEN which lies deep inside the AE network. Simulation results demonstrated that the proposed AUD scheme achieved 3 to 5dB gain at a target activity detection error rate of $\bf{{10}^{-3}}$ compared to the state-of-the-art DL-based AUD schemes.


title: A Hierarchical MPC Approach to Car-Following via Linearly Constrained Quadratic Programming

abstract: Single-lane car-following is a fundamental task in autonomous driving. A desirable car-following controller should keep a reasonable range of distances to the preceding vehicle and do so as smoothly as possible. To achieve this, numerous control methods have been proposed: some only rely on local sensing; others also make use of non-local downstream observations. While local methods are capable of attenuating high-frequency velocity oscillation and are economical to compute, non-local methods can dampen a wider spectrum of oscillatory traffic but incur a larger cost in computing. In this article, we design a novel non-local tri-layer MPC controller that is capable of smoothing a wide range of oscillatory traffic and is amenable to real-time applications. At the core of the controller design are 1) an accessible prediction method based on ETA estimation and 2) a robust, light-weight optimization procedure, designed specifically for handling various headway constraints. Numerical simulations suggest that the proposed controller can simultaneously maintain a variable headway while driving with modest acceleration and is robust to imperfect traffic predictions.


title: Instruction Induction: From Few Examples to Natural Language Task Descriptions

abstract: Large language models are able to perform a task by conditioning on a few input-output demonstrations - a paradigm known as in-context learning. We show that language models can explicitly infer an underlying task from a few demonstrations by prompting them to generate a natural language instruction that fits the examples. To explore this ability, we introduce the instruction induction challenge, compile a dataset consisting of 24 tasks, and define a novel evaluation metric based on executing the generated instruction. We discover that, to a large extent, the ability to generate instructions does indeed emerge when using a model that is both large enough and aligned to follow instructions; InstructGPT achieves 65.7% of human performance in our execution-based metric, while the original GPT-3 model reaches only 9.8% of human performance. This surprising result suggests that instruction induction might be a viable learning paradigm in and of itself, where instead of fitting a set of latent continuous parameters to the data, one searches for the best description in the natural language hypothesis space.


title: 6G Radio Requirements to Support Integrated Communication, Localization, and Sensing

abstract: 6G will be characterized by extreme use cases, not only for communication, but also for localization, and sensing. The use cases can be directly mapped to requirements in terms of standard key performance indicators (KPIs), such as data rate, latency, or localization accuracy. The goal of this paper is to go one step further and map these standard KPIs to requirements on signals, on hardware architectures, and on deployments. Based on this, system solutions can be identified that can support several use cases simultaneously. Since there are several ways to meet the KPIs, there is no unique solution and preferable configurations will be discussed.


title: Fully symmetric nonequilibrium response of stochastic systems

abstract: We show that the nonequilibrium response of Markovian dynamics can be made fully symmetric, both near and far from equilibrium. This is achieved by varying the affinities along equivalence classes in the space of stochastic dynamics.


title: Responsible Artificial Intelligence -- from Principles to Practice

abstract: The impact of Artificial Intelligence does not depend only on fundamental research and technological developments, but for a large part on how these systems are introduced into society and used in everyday situations. AI is changing the way we work, live and solve challenges but concerns about fairness, transparency or privacy are also growing. Ensuring responsible, ethical AI is more than designing systems whose result can be trusted. It is about the way we design them, why we design them, and who is involved in designing them. In order to develop and use AI responsibly, we need to work towards technical, societal, institutional and legal methods and tools which provide concrete support to AI practitioners, as well as awareness and training to enable participation of all, to ensure the alignment of AI systems with our societies' principles and values.


title: KMS states of quasi-free dynamics on $C^*$-algebras of product systems over right LCM monoids

abstract: We generalise recent results of Afsar, Larsen and Neshveyev for product systems over quasi-lattice orders by showing that the equilibrium states of quasi-free dynamics on the Nica-Toeplitz $C^*$-algebras of product systems over right LCM monoids must satisfy a positivity condition encoded in a system of inequalities satisfied by their restrictions to the coefficient algebra. We prove that the reduction of this positivity condition to a finite subset of inequalities is valid for a wider class of monoids that properly includes finite-type Artin monoids, answering a question left open in their work. Our main technical tool is a combinatorially generated tree modelled on a recent construction developed by Boyu Li for dilations of contractive representations. We also obtain a reduction of the positivity condition to inequalities arising from a certain minimal subset that may not be finite but has the advantage of holding for all Noetherian right LCM monoids, and we present an example, arising from a finite-type Artin monoid, that exhibits a gap in its inverse temperature space.


title: A Dirichlet Process Mixture of Robust Task Models for Scalable Lifelong Reinforcement Learning

abstract: While reinforcement learning (RL) algorithms are achieving state-of-the-art performance in various challenging tasks, they can easily encounter catastrophic forgetting or interference when faced with lifelong streaming information. In the paper, we propose a scalable lifelong RL method that dynamically expands the network capacity to accommodate new knowledge while preventing past memories from being perturbed. We use a Dirichlet process mixture to model the non-stationary task distribution, which captures task relatedness by estimating the likelihood of task-to-cluster assignments and clusters the task models in a latent space. We formulate the prior distribution of the mixture as a Chinese restaurant process (CRP) that instantiates new mixture components as needed. The update and expansion of the mixture are governed by the Bayesian non-parametric framework with an expectation maximization (EM) procedure, which dynamically adapts the model complexity without explicit task boundaries or heuristics. Moreover, we use the domain randomization technique to train robust prior parameters for the initialization of each task model in the mixture, thus the resulting model can better generalize and adapt to unseen tasks. With extensive experiments conducted on robot navigation and locomotion domains, we show that our method successfully facilitates scalable lifelong RL and outperforms relevant existing methods.


title: Learning Muti-expert Distribution Calibration for Long-tailed Video Classification

abstract: Most existing state-of-the-art video classification methods assume that the training data obey a uniform distribution. However, video data in the real world typically exhibit an imbalanced long-tailed class distribution, resulting in a model bias towards head class and relatively low performance on tail class. While the current long-tailed classification methods usually focus on image classification, adapting it to video data is not a trivial extension. We propose an end-to-end multi-expert distribution calibration method to address these challenges based on two-level distribution information. The method jointly considers the distribution of samples in each class (intra-class distribution) and the overall distribution of diverse data (inter-class distribution) to solve the issue of imbalanced data under long-tailed distribution. By modeling the two-level distribution information, the model can jointly consider the head classes and the tail classes and significantly transfer the knowledge from the head classes to improve the performance of the tail classes. Extensive experiments verify that our method achieves state-of-the-art performance on the long-tailed video classification task.