title: An Amazing Prime Heuristic

abstract: Dickson conjectured that a set of polynomials will take on infinitely many simultaneous prime values. Later others, such as Hardy and Littlewood, gave estimates for the number of these primes. In this article we look at this conjecture, develop a simple heuristic and rederive these classic estimates. We then apply them to several special forms of primes and compare the estimates with the actual numbers.


title: Suppression of blow up by mixing in generalized Keller-Segel system with fractional dissipation and strong singular kernel

abstract: In this paper, we consider the Cauchy problem for a generalized parabolic-elliptic Keller-Segel equation with a fractional dissipation and advection by a weakly mixing (see Definition \ref{def:2.4}). Here the attractive kernel has strong singularity, namely, the derivative appears in the nonlinear term by singular integral. Without advection, the solution of equation blows up in finite time. Under a suitable mixing condition on the advection, we show the global existence of classical solution with large initial data in the case of the derivative of dissipative term is higher than that of nonlinear term. Since the attractive kernel is strong singularity, the weakly mixing has destabilizing effect in addition to the enhanced dissipation effect, which makes the problem more complicated and difficult. In this paper, we establish the $L^\infty$-criterion and obtain the global $L^\infty$ estimate of the solution through some new ideas and techniques. Combined with \cite{Shi.2019}, we discuss all cases of generalized Keller-Segel system with mixing effect, which was proposed by Kiselev, Xu (see \cite{Kiselev.2016}) and Hopf, Rodrigo (see \cite{Hopf.2018}). Based on more precise estimate of solution and the resolvent estimate of semigroup operator, we introduce a new method to study the enhanced dissipation effect of mixing in generalized parabolic-elliptic Keller-Segel equation with a fractional dissipation. And the RAGE theorem is no longer needed in our analysis.


title: Convolutional Graph-Tensor Net for Graph Data Completion

abstract: Graph data completion is a fundamentally important issue as data generally has a graph structure, e.g., social networks, recommendation systems, and the Internet of Things. We consider a graph where each node has a data matrix, represented as a \textit{graph-tensor} by stacking the data matrices in the third dimension. In this paper, we propose a \textit{Convolutional Graph-Tensor Net} (\textit{Conv GT-Net}) for the graph data completion problem, which uses deep neural networks to learn the general transform of graph-tensors. The experimental results on the ego-Facebook data sets show that the proposed \textit{Conv GT-Net} achieves significant improvements on both completion accuracy (50\% higher) and completion speed (3.6x $\sim$ 8.1x faster) over the existing algorithms.


title: Dynamic Message Scheduling With Activity-Aware Residual Belief Propagation for Asynchronous mMTC Systems

abstract: In this letter, we propose a joint active device detection and channel estimation framework based on factor graphs for asynchronous uplink grant-free massive multiple-antenna systems. We then develop the message-scheduling GAMP (MSGAMP) algorithm to perform joint active device detection and channel estimation. In MSGAMP we apply scheduling techniques based on the residual belief propagation (RBP) and the activity user detection (AUD) in which messages are generated using the latest available information. MSGAMP-type schemes show a good performance in terms of activity error rate and normalized mean squared error, requiring a smaller number of iterations for convergence and lower complexity than state-of-the-art techniques.


title: Rapidly-exploring Random Forest: Adaptively Exploits Local Structure with Generalised Multi-Trees Motion Planning

abstract: Sampling-based motion planners perform exceptionally well in robotic applications that operate in high-dimensional space. However, most works often constrain the planning workspace rooted at some fixed locations, do not adaptively reason on strategy in narrow passages, and ignore valuable local structure information. In this paper, we propose Rapidly-exploring Random Forest (RRF*) -- a generalised multi-trees motion planner that combines the rapid exploring property of tree-based methods and adaptively learns to deploys a Bayesian local sampling strategy in regions that are deemed to be bottlenecks. Local sampling exploits the local-connectivity of spaces via Markov Chain random sampling, which is updated sequentially with a Bayesian proposal distribution to learns the local structure from past observations. The trees selection problem is formulated as a multi-armed bandit problem, which efficiently allocates resources on the most promising tree to accelerate planning runtime. RRF* learns the region that is difficult to perform tree extensions and adaptively deploys local sampling in those regions to maximise the benefit of exploiting local structure. We provide rigorous proofs of completeness and optimal convergence guarantees, and we experimentally demonstrate that the effectiveness of RRF*'s adaptive multi-trees approach allows it to performs well in a wide range of problems.


title: Lower bounds for artificial neural network approximations: A proof that shallow neural networks fail to overcome the curse of dimensionality

abstract: Artificial neural networks (ANNs) have become a very powerful tool in the approximation of high-dimensional functions. Especially, deep ANNs, consisting of a large number of hidden layers, have been very successfully used in a series of practical relevant computational problems involving high-dimensional input data ranging from classification tasks in supervised learning to optimal decision problems in reinforcement learning. There are also a number of mathematical results in the scientific literature which study the approximation capacities of ANNs in the context of high-dimensional target functions. In particular, there are a series of mathematical results in the scientific literature which show that sufficiently deep ANNs have the capacity to overcome the curse of dimensionality in the approximation of certain target function classes in the sense that the number of parameters of the approximating ANNs grows at most polynomially in the dimension $d \in \mathbb{N}$ of the target functions under considerations. In the proofs of several of such high-dimensional approximation results it is crucial that the involved ANNs are sufficiently deep and consist a sufficiently large number of hidden layers which grows in the dimension of the considered target functions. It is the topic of this work to look a bit more detailed to the deepness of the involved ANNs in the approximation of high-dimensional target functions. In particular, the main result of this work proves that there exists a concretely specified sequence of functions which can be approximated without the curse of dimensionality by sufficiently deep ANNs but which cannot be approximated without the curse of dimensionality if the involved ANNs are shallow or not deep enough.


title: Auto-FuzzyJoin: Auto-Program Fuzzy Similarity Joins Without Labeled Examples

abstract: Fuzzy similarity join is an important database operator widely used in practice. So far the research community has focused exclusively on optimizing fuzzy join \textit{scalability}. However, practitioners today also struggle to optimize fuzzy-join \textit{quality}, because they face a daunting space of parameters (e.g., distance-functions, distance-thresholds, tokenization-options, etc.), and often have to resort to a manual trial-and-error approach to program these parameters in order to optimize fuzzy-join quality. This key challenge of automatically generating high-quality fuzzy-join programs has received surprisingly little attention thus far. In this work, we study the problem of "auto-program" fuzzy-joins. Leveraging a geometric interpretation of distance-functions, we develop an unsupervised \textsc{Auto-FuzzyJoin} framework that can infer suitable fuzzy-join programs on given input tables, without requiring explicit human input such as labeled training data. Using \textsc{Auto-FuzzyJoin}, users only need to provide two input tables $L$ and $R$, and a desired precision target $\tau$ (say 0.9). \textsc{Auto-FuzzyJoin} leverages the fact that one of the input is a reference table to automatically program fuzzy-joins that meet the precision target $\tau$ in expectation, while maximizing fuzzy-join recall (defined as the number of correctly joined records). Experiments on both existing benchmarks and a new benchmark with 50 fuzzy-join tasks created from Wikipedia data suggest that the proposed \textsc{Auto-FuzzyJoin} significantly outperforms existing unsupervised approaches, and is surprisingly competitive even against supervised approaches (e.g., Magellan and DeepMatcher) when 50\% of ground-truth labels are used as training data.


title: Adaptive-Control-Oriented Meta-Learning for Nonlinear Systems

abstract: Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments. Adaptive control laws can endow even nonlinear systems with good trajectory tracking performance, provided that any uncertain dynamics terms are linearly parameterizable with known nonlinear features. However, it is often difficult to specify such features a priori, such as for aerodynamic disturbances on rotorcraft or interaction forces between a manipulator arm and various objects. In this paper, we turn to data-driven modeling with neural networks to learn, offline from past data, an adaptive controller with an internal parametric model of these nonlinear features. Our key insight is that we can better prepare the controller for deployment with control-oriented meta-learning of features in closed-loop simulation, rather than regression-oriented meta-learning of features to fit input-output data. Specifically, we meta-learn the adaptive controller with closed-loop tracking simulation as the base-learner and the average tracking error as the meta-objective. With a nonlinear planar rotorcraft subject to wind, we demonstrate that our adaptive controller outperforms other controllers trained with regression-oriented meta-learning when deployed in closed-loop for trajectory tracking control.


title: Arbitrary controlled-phase gate on fluxonium qubits using differential ac-Stark shifts

abstract: Large scale quantum computing motivates the invention of two-qubit gate schemes that not only maximize the gate fidelity but also draw minimal resources. In the case of superconducting qubits, the weak anharmonicity of transmons imposes profound constraints on the gate design, leading to increased complexity of devices and control protocols. Here we demonstrate a resource-efficient control over the interaction of strongly-anharmonic fluxonium qubits. Namely, applying an off-resonant drive to non-computational transitions in a pair of capacitively-coupled fluxoniums induces a $\textrm{ZZ}$-interaction due to unequal ac-Stark shifts of the computational levels. With a continuous choice of frequency and amplitude, the drive can either cancel the static $\textrm{ZZ}$-term or increase it by an order of magnitude to enable a controlled-phase (CP) gate with an arbitrary programmed phase shift. The cross-entropy benchmarking of these non-Clifford operations yields a sub $1\%$ error, limited solely by incoherent processes. Our result demonstrates the advantages of strongly-anharmonic circuits over transmons in designing the next generation of quantum processors.


title: Phase Reduction and Synchronization of Coupled Noisy Oscillators

abstract: We study the synchronization behavior of a noisy network in which each system is driven by two sources of state-dependent noise: (1) an intrinsic noise which is common among all systems and can be generated by the environment or any internal fluctuations, and (2) a coupling noise which is generated by interactions with other systems. After providing sufficient conditions that foster synchronization in networks of general noisy systems, we focus on weakly coupled networks of noisy oscillators and, using the first- and second-order phase response curves (PRCs), we derive a reduced order stochastic differential equation to describe the corresponding phase evolutions. Finally, we derive synchronization conditions based on the PRCs and illustrate the theoretical results on a couple of models.


title: Localization and Mapping using Instance-specific Mesh Models

abstract: This paper focuses on building semantic maps, containing object poses and shapes, using a monocular camera. This is an important problem because robots need rich understanding of geometry and context if they are to shape the future of transportation, construction, and agriculture. Our contribution is an instance-specific mesh model of object shape that can be optimized online based on semantic information extracted from camera images. Multi-view constraints on the object shape are obtained by detecting objects and extracting category-specific keypoints and segmentation masks. We show that the errors between projections of the mesh model and the observed keypoints and masks can be differentiated in order to obtain accurate instance-specific object shapes. We evaluate the performance of the proposed approach in simulation and on the KITTI dataset by building maps of car poses and shapes.


title: Fully Convolutional Geometric Features for Category-level Object Alignment

abstract: This paper focuses on pose registration of different object instances from the same category. This is required in online object mapping because object instances detected at test time usually differ from the training instances. Our approach transforms instances of the same category to a normalized canonical coordinate frame and uses metric learning to train fully convolutional geometric features. The resulting model is able to generate pairs of matching points between the instances, allowing category-level registration. Evaluation on both synthetic and real-world data shows that our method provides robust features, leading to accurate alignment of instances with different shapes.


title: Optical Magnetic Multipolar Resonances in Large Dynamic Metamolecules

abstract: Dynamic metamolecules (DMMs) are composed of a dielectric core made of hydrogel surrounded by randomly-packed plasmonic beads that can display magnetic resonances when excited by light at optical frequencies. Their optical properties can be controlled by controlling their core diameter through temperature variations. We have recently shown that DMMs display strong optical magnetism, including magnetic dipole and magnetic quadrupole resonances, offering significant potential for novel applications. Here, we use a T-matrix approach to characterize the magnetic multipole resonance modes of model metamolecules and explore their presence in experimental data. We show that high-order multipole resonances become prominent as the bead size and the overall structure sizes are increased, and when the the inter-bead gap is decreased. In this limit, mode mixing among high-order magnetic multipole modes also become significant, particularly in the directional scattering spectra. We discuss trends in magnetic scattering observed in both experiments and simulations, and provide suggestions for experimental design and verification of high-order optical magnetic resonances in the forward or backward scattering spectra. In addition, angular scattering of higher-order magnetic modes can display Fano-like interference patterns that should be experimentally detectable.


title: Sparsification for Fast Optimal Multi-Robot Path Planning in Lazy Compilation Schemes

abstract: Path planning for multiple robots (MRPP) represents a task of finding non-colliding paths for robots through which they can navigate from their initial positions to specified goal positions. The problem is usually modeled using undirected graphs where robots move between vertices across edges. Contemporary optimal solving algorithms include dedicated search-based methods, that solve the problem directly, and compilation-based algorithms that reduce MRPP to a different formalism for which an efficient solver exists, such as constraint programming (CP), mixed integer programming (MIP), or Boolean satisfiability (SAT). In this paper, we enhance existing SAT-based algorithm for MRPP via spartification of the set of candidate paths for each robot from which target Boolean encoding is derived. Suggested sparsification of the set of paths led to smaller target Boolean formulae that can be constructed and solved faster while optimality guarantees of the approach have been kept.


title: Remark on the local nature of metric mean dimension

abstract: Metric mean dimension is a metric invariant of dynamical systems. It is a dynamical analogue of Minkowski dimension of metric spaces. We explain that old ideas of Bowen (1972) can be used for clarifying the local nature of metric mean dimension. We also explain the generalization to $\mathbb{R}^D$-actions and an illustrating example.


title: Let's be friends! A rapport-building 3D embodied conversational agent for the Human Support Robot

abstract: Partial subtle mirroring of nonverbal behaviors during conversations (also known as mimicking or parallel empathy), is essential for rapport building, which in turn is essential for optimal human-human communication outcomes. Mirroring has been studied in interactions between robots and humans, and in interactions between Embodied Conversational Agents (ECAs) and humans. However, very few studies examine interactions between humans and ECAs that are integrated with robots, and none of them examine the effect of mirroring nonverbal behaviors in such interactions. Our research question is whether integrating an ECA able to mirror its interlocutor's facial expressions and head movements (continuously or intermittently) with a human-service robot will improve the user's experience with the support robot that is able to perform useful mobile manipulative tasks (e.g. at home). Our contribution is the complex integration of an expressive ECA, able to track its interlocutor's face, and to mirror his/her facial expressions and head movements in real time, integrated with a human support robot such that the robot and the agent are fully aware of each others', and of the users', nonverbals cues. We also describe a pilot study we conducted towards answering our research question, which shows promising results for our forthcoming larger user study.


title: Bers' simultaneous uniformization and the intersection of Poincare holonomy varieties

abstract: We consider the space of ordered pairs of distinct $\mathbb{C}P^1$-structures on Riemann surfaces (of any orientations) which have identical holonomy, so that the quasi-Fuchsian space is identified with a connected component of this space. This space holomorphically maps to the product of the Teichm\"uller spaces minus its diagonal. In this paper, we prove that this mapping is a complete local branched covering map. As a corollary, we reprove Bers' simultaneous uniformization theorem without any quasi-conformal deformation theory. Our main theorem is that the intersection of arbitrary two Poincar\'e holonomy varieties (${\rm SL}_2\mathbb{C}$-opers) is a non-empty discrete set, which is closely related to the mapping.


title: Separate variable blow-up patterns for a reaction-diffusion equation with critical weighted reaction

abstract: We study the separate variable blow-up patterns associated to the following second order reaction-diffusion equation: $$ \partial_tu=\Delta u^m + |x|^{\sigma}u^m, $$ posed for $x\in\mathbb{R}^N$, $t\geq0$, where $m>1$, dimension $N\geq2$ and $\sigma>0$. A new and explicit critical exponent $$ \sigma_c=\frac{2(m-1)(N-1)}{3m+1} $$ is introduced and a classification of the blow-up profiles is given. The most interesting contribution of the paper is showing that existence and behavior of the blow-up patterns is split into different regimes by the critical exponent $\sigma_c$ and also depends strongly on whether the dimension $N\geq4$ or $N\in\{2,3\}$. These results extend previous works of the authors in dimension $N=1$.


title: Large Deviations for High Minima of Gaussian Processes with Nonnegatively Correlated Increments

abstract: In this article we prove large deviations principles for high minima of Gaussian processes with nonnegatively correlated increments on arbitrary intervals. Furthermore, we prove large deviations principles for the increments of such processes on intervals $[a,b]$ where $b-a$ is either less than the increment or twice the increment, assuming stationarity of the increments. As a chief example, we consider fractional Brownian motion and fractional Gaussian noise for $H\geq 1/2$.


title: Quantum-accelerated constraint programming

abstract: Constraint programming (CP) is a paradigm used to model and solve constraint satisfaction and combinatorial optimization problems. In CP, problems are modeled with constraints that describe acceptable solutions and solved with backtracking tree search augmented with logical inference. In this paper, we show how quantum algorithms can accelerate CP, at both the levels of inference and search. Leveraging existing quantum algorithms, we introduce a quantum-accelerated filtering algorithm for the $\texttt{alldifferent}$ global constraint and discuss its applicability to a broader family of global constraints with similar structure. We propose frameworks for the integration of quantum filtering algorithms within both classical and quantum backtracking search schemes, including a novel hybrid classical-quantum backtracking search method. This work suggests that CP is a promising candidate application for early fault-tolerant quantum computers and beyond.


title: End-to-End Human Object Interaction Detection with HOI Transformer

abstract: We propose HOI Transformer to tackle human object interaction (HOI) detection in an end-to-end manner. Current approaches either decouple HOI task into separated stages of object detection and interaction classification or introduce surrogate interaction problem. In contrast, our method, named HOI Transformer, streamlines the HOI pipeline by eliminating the need for many hand-designed components. HOI Transformer reasons about the relations of objects and humans from global image context and directly predicts HOI instances in parallel. A quintuple matching loss is introduced to force HOI predictions in a unified way. Our method is conceptually much simpler and demonstrates improved accuracy. Without bells and whistles, HOI Transformer achieves $26.61\% $ $ AP $ on HICO-DET and $52.9\%$ $AP_{role}$ on V-COCO, surpassing previous methods with the advantage of being much simpler. We hope our approach will serve as a simple and effective alternative for HOI tasks. Code is available at https://github.com/bbepoch/HoiTransformer .


title: A reproducing kernel Hilbert space framework for functional data classification

abstract: We encounter a bottleneck when we try to borrow the strength of classical classifiers to classify functional data. The major issue is that functional data are intrinsically infinite dimensional, thus classical classifiers cannot be applied directly or have poor performance due to the curse of dimensionality. To address this concern, we propose to project functional data onto one specific direction, and then a distance-weighted discrimination DWD classifier is built upon the projection score. The projection direction is identified through minimizing an empirical risk function that contains the particular loss function in a DWD classifier, over a reproducing kernel Hilbert space. Hence our proposed classifier can avoid overfitting and enjoy appealing properties of DWD classifiers. This framework is further extended to accommodate functional data classification problems where scalar covariates are involved. In contrast to previous work, we establish a non-asymptotic estimation error bound on the relative misclassification rate. In finite sample case, we demonstrate that the proposed classifiers compare favorably with some commonly used functional classifiers in terms of prediction accuracy through simulation studies and a real-world application.


title: Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges

abstract: Mobile devices such as smartphones and autonomous vehicles increasingly rely on deep neural networks (DNNs) to execute complex inference tasks such as image classification and speech recognition, among others. However, continuously executing the entire DNN on mobile devices can quickly deplete their battery. Although task offloading to cloud/edge servers may decrease the mobile device's computational burden, erratic patterns in channel quality, network, and edge server load can lead to a significant delay in task execution. Recently, approaches based on split computing (SC) have been proposed, where the DNN is split into a head and a tail model, executed respectively on the mobile device and on the edge server. Ultimately, this may reduce bandwidth usage as well as energy consumption. Another approach, called early exiting (EE), trains models to embed multiple "exits" earlier in the architecture, each providing increasingly higher target accuracy. Therefore, the trade-off between accuracy and delay can be tuned according to the current conditions or application demands. In this paper, we provide a comprehensive survey of the state of the art in SC and EE strategies by presenting a comparison of the most relevant approaches. We conclude the paper by providing a set of compelling research challenges.


title: On the Lack of Consensus Among Technical Debt Detection Tools

abstract: A vigorous and growing set of technical debt analysis tools have been developed in recent years -- both research tools and industrial products -- such as Structure 101, SonarQube, and DV8. Each of these tools identifies problematic files using their own definitions and measures. But to what extent do these tools agree with each other in terms of the files that they identify as problematic? If the top-ranked files reported by these tools are largely consistent, then we can be confident in using any of these tools. Otherwise, a problem of accuracy arises. In this paper, we report the results of an empirical study analyzing 10 projects using multiple tools. Our results show that: 1) these tools report very different results even for the most common measures, such as size, complexity, file cycles, and package cycles. 2) These tools also differ dramatically in terms of the set of problematic files they identify, since each implements its own definitions of "problematic". After normalizing by size, the most problematic file sets that the tools identify barely overlap. 3) Our results show that code-based measures, other than size and complexity, do not even moderately correlate with a file's change-proneness or error-proneness. In contrast, co-change-related measures performed better. Our results suggest that, to identify files with true technical debt -- those that experience excessive changes or bugs -- co-change information must be considered. Code-based measures are largely ineffective at pinpointing true debt. Finally, this study reveals the need for the community to create benchmarks and data sets to assess the accuracy of software analysis tools in terms of commonly used measures.


title: OPANAS: One-Shot Path Aggregation Network Architecture Search for Object Detection

abstract: Recently, neural architecture search (NAS) has been exploited to design feature pyramid networks (FPNs) and achieved promising results for visual object detection. Encouraged by the success, we propose a novel One-Shot Path Aggregation Network Architecture Search (OPANAS) algorithm, which significantly improves both searching efficiency and detection accuracy. Specifically, we first introduce six heterogeneous information paths to build our search space, namely top-down, bottom-up, fusing-splitting, scale-equalizing, skip-connect and none. Second, we propose a novel search space of FPNs, in which each FPN candidate is represented by a densely-connected directed acyclic graph (each node is a feature pyramid and each edge is one of the six heterogeneous information paths). Third, we propose an efficient one-shot search method to find the optimal path aggregation architecture, that is, we first train a super-net and then find the optimal candidate with an evolutionary algorithm. Experimental results demonstrate the efficacy of the proposed OPANAS for object detection: (1) OPANAS is more efficient than state-of-the-art methods (e.g., NAS-FPN and Auto-FPN), at significantly smaller searching cost (e.g., only 4 GPU days on MS-COCO); (2) the optimal architecture found by OPANAS significantly improves main-stream detectors including RetinaNet, Faster R-CNN and Cascade R-CNN, by 2.3-3.2 % mAP comparing to their FPN counterparts; and (3) a new state-of-the-art accuracy-speed trade-off (52.2 % mAP at 7.6 FPS) at smaller training costs than comparable state-of-the-arts. Code will be released at https://github.com/VDIGPKU/OPANAS.


title: Predictive Visual Tracking: A New Benchmark and Baseline Approach

abstract: As a crucial robotic perception capability, visual tracking has been intensively studied recently. In the real-world scenarios, the onboard processing time of the image streams inevitably leads to a discrepancy between the tracking results and the real-world states. However, existing visual tracking benchmarks commonly run the trackers offline and ignore such latency in the evaluation. In this work, we aim to deal with a more realistic problem of latency-aware tracking. The state-of-the-art trackers are evaluated in the aerial scenarios with new metrics jointly assessing the tracking accuracy and efficiency. Moreover, a new predictive visual tracking baseline is developed to compensate for the latency stemming from the onboard computation. Our latency-aware benchmark can provide a more realistic evaluation of the trackers for the robotic applications. Besides, exhaustive experiments have proven the effectiveness of the proposed predictive visual tracking baseline approach.


title: Gravitational contributions to the electron $g$-factor

abstract: In a previous paper, the authors with Ann Nelson proposed that the UV and IR applicability of effective quantum field theories should be constrained by requiring that strong gravitational effects are nowhere encountered in a theory's domain of validity [Phys. Rev. Lett. 82, 4971 (1999)]. The constraint was proposed to delineate the boundary beyond which conventional quantum field theory, viewed as an effective theory excluding quantum gravitational effects, might be expected to break down. In this Letter we revisit this idea and show that quantum gravitational effects could lead to a deviation of size $(\alpha/2\pi)\sqrt{m_e/M_p}$ from the Standard Model calculation for the electron magnetic moment. This is the same size as QED and hadronic uncertainties in the theory of $a_e$, and a little more than one order of magnitude smaller than both the dominant uncertainty in its Standard Model value arising from the accuracy with which $\alpha$ is measured, as well as the experimental uncertainty in measurement of $a_e$.

categories: hep-ph gr-qc hep-ex hep-th physics.atom-ph


title: ColoRadar: The Direct 3D Millimeter Wave Radar Dataset

abstract: Millimeter wave radar is becoming increasingly popular as a sensing modality for robotic mapping and state estimation. However, there are very few publicly available datasets that include dense, high-resolution millimeter wave radar scans and there are none focused on 3D odometry and mapping. In this paper we present a solution to that problem. The ColoRadar dataset includes 3 different forms of dense, high-resolution radar data from 2 FMCW radar sensors as well as 3D lidar, IMU, and highly accurate groundtruth for the sensor rig's pose over approximately 2 hours of data collection in highly diverse 3D environments.


title: An Energy-Saving Snake Locomotion Gait Policy Obtained Using Deep Reinforcement Learning

abstract: Snake robots, comprised of sequentially connected joint actuators, have recently gained increasing attention in the industrial field, like life detection in narrow space. Such robots can navigate through the complex environment via the cooperation of multiple motors located on the backbone. However, controlling the robots in an unknown environment is challenging, and conventional control strategies can be energy inefficient or even fail to navigate to the destination. In this work, a snake locomotion gait policy is developed via deep reinforcement learning (DRL) for energy-efficient control. We apply proximal policy optimization (PPO) to each joint motor parameterized by angular velocity and the DRL agent learns the standard serpenoid curve at each timestep. The robot simulator and task environment are built upon PyBullet. Comparing to conventional control strategies, the snake robots controlled by the trained PPO agent can achieve faster movement and more energy-efficient locomotion gait. This work demonstrates that DRL provides an energy-efficient solution for robot control.


title: Anisotropic magnon-magnon coupling in synthetic antiferromagnets

abstract: The magnon-magnon coupling in synthetic antiferromagnets advances it as hybrid magnonic systems to explore the quantum information technologies. To induce the magnon-magnon coupling, the parity symmetry between two magnetization needs to be broken. Here we experimentally demonstrate a convenient method to break the parity symmetry by the asymmetric thickness of two magnetic layers and thus introduce a magnon-magnon coupling in Ir-based synthetic antiferromagnets CoFeB(10 nm)/Ir(tIr=0.6 nm, 1.2 nm)/CoFeB(13 nm). Remarkably, we find that the weakly uniaxial anisotropy field (~ 20 Oe) makes the magnon-magnon coupling anisotropic. The coupling strength presented by a characteristic anticrossing gap varies in the range between 0.54 GHz and 0.90 GHz for tIr =0.6 nm, and between nearly zero to 1.4 GHz for tIr = 1.2 nm, respectively. Our results demonstrate a feasible way to induce the magnon-magnon coupling by an asymmetric structure and tune the coupling strength by varying the direction of in-plane magnetic field. The magnon-magnon coupling in this highly tunable material system could open exciting perspectives for exploring quantum-mechanical coupling phenomena.


title: Improving Global Adversarial Robustness Generalization With Adversarially Trained GAN

abstract: Convolutional neural networks (CNNs) have achieved beyond human-level accuracy in the image classification task and are widely deployed in real-world environments. However, CNNs show vulnerability to adversarial perturbations that are well-designed noises aiming to mislead the classification models. In order to defend against the adversarial perturbations, adversarially trained GAN (ATGAN) is proposed to improve the adversarial robustness generalization of the state-of-the-art CNNs trained by adversarial training. ATGAN incorporates adversarial training into standard GAN training procedure to remove obfuscated gradients which can lead to a false sense in defending against the adversarial perturbations and are commonly observed in existing GANs-based adversarial defense methods. Moreover, ATGAN adopts the image-to-image generator as data augmentation to increase the sample complexity needed for adversarial robustness generalization in adversarial training. Experimental results in MNIST SVHN and CIFAR-10 datasets show that the proposed method doesn't rely on obfuscated gradients and achieves better global adversarial robustness generalization performance than the adversarially trained state-of-the-art CNNs.


title: Nondeterminism and Instability in Neural Network Optimization

abstract: Nondeterminism in neural network optimization produces uncertainty in performance, making small improvements difficult to discern from run-to-run variability. While uncertainty can be reduced by training multiple model copies, doing so is time-consuming, costly, and harms reproducibility. In this work, we establish an experimental protocol for understanding the effect of optimization nondeterminism on model diversity, allowing us to isolate the effects of a variety of sources of nondeterminism. Surprisingly, we find that all sources of nondeterminism have similar effects on measures of model diversity. To explain this intriguing fact, we identify the instability of model training, taken as an end-to-end procedure, as the key determinant. We show that even one-bit changes in initial parameters result in models converging to vastly different values. Last, we propose two approaches for reducing the effects of instability on run-to-run variability.


title: Matrix product state approach for a quantum system at finite temperatures using random phases and Trotter gates

abstract: We develop a numerical method based on matrix product states for simulating quantum many-body systems at finite temperatures without importance sampling and evaluate its performance in spin 1/2 systems. Our method is an extension of the random phase product state (RPPS) approach introduced recently [T. Iitaka, arXiv:2006.14459]. We show that the original RPPS approach often gives unphysical values for thermodynamic quantities even in the Heisenberg chain. We find that by adding the operation of Trotter gates to the RPPS, the sampling efficiency of the approach significantly increases and its results are consistent with those of the purification approach. We also apply our method to a frustrated spin 1/2 system to exemplify that it can simulate a system in which the purification approach fails.


title: Loosely Synchronized Search for Multi-agent Path Finding with Asynchronous Actions

abstract: Multi-agent path finding (MAPF) determines an ensemble of collision-free paths for multiple agents between their respective start and goal locations. Among the available MAPF planners for workspace modeled as a graph, A*-based approaches have been widely investigated due to their guarantees on completeness and solution optimality, and have demonstrated their efficiency in many scenarios. However, almost all of these A*-based methods assume that each agent executes an action concurrently in that all agents start and stop together. This article presents a natural generalization of MAPF with asynchronous actions (MAPF-AA) where agents do not necessarily start and stop concurrently. The main contribution of the work is a proposed approach called Loosely Synchronized Search (LSS) that extends A*-based MAPF planners to handle asynchronous actions. We show LSS is complete and finds an optimal solution if one exists. We also combine LSS with other existing MAPF methods that aims to trade-off optimality for computational efficiency. Numerical results are presented to corroborate the performance of LSS and the applicability of the proposed method is verified in the Robotarium, a remotely accessible swarm robotics research platform.


title: Optimal H\"{o}lder regularity for the $\bar\partial$ problem on product domains in $\mathbb C^2$

abstract: The note concerns the $\bar\partial$ problem on product domains in $\mathbb C^2$. We show that there exists a bounded solution operator from $C^{k, \alpha}$ into itself, $k\in \mathbb Z^+\cup \{0\}, 0<\alpha< 1$. The regularity result is optimal in view of an example of Stein-Kerzman.


title: "Sharks are not the threat humans are": Argument Component Segmentation in School Student Essays

abstract: Argument mining is often addressed by a pipeline method where segmentation of text into argumentative units is conducted first and proceeded by an argument component identification task. In this research, we apply a token-level classification to identify claim and premise tokens from a new corpus of argumentative essays written by middle school students. To this end, we compare a variety of state-of-the-art models such as discrete features and deep learning architectures (e.g., BiLSTM networks and BERT-based architectures) to identify the argument components. We demonstrate that a BERT-based multi-task learning architecture (i.e., token and sentence level classification) adaptively pretrained on a relevant unlabeled dataset obtains the best results


title: Formal Verification of Authenticated, Append-Only Skip Lists in Agda: Extended Version

abstract: Authenticated Append-Only Skiplists (AAOSLs) enable maintenance and querying of an authenticated log (such as a blockchain) without requiring any single party to store or verify the entire log, or to trust another party regarding its contents. AAOSLs can help to enable efficient dynamic participation (e.g., in consensus) and reduce storage overhead. In this paper, we formalize an AAOSL originally described by Maniatis and Baker, and prove its key correctness properties. Our model and proofs are machine checked in Agda. Our proofs apply to a generalization of the original construction and provide confidence that instances of this generalization can be used in practice. Our formalization effort has also yielded some simplifications and optimizations.


title: Global study of separable pairing interaction in covariant density functional theory

abstract: A systematic global investigation of pairing properties based on all available experimental data on pairing indicators has been performed for the first time in the framework of covariant density functional theory. It is based on separable pairing interaction of Ref. [1]. The optimization of the scaling factors of this interaction to experimental data clearly reveals its isospin dependence in neutron subsystem. However, the situation is less certain in proton subsystem since similar accuracy of the description of pairing indicators can be achieved both with isospin-dependent and mass-dependent scaling factors. The differences in the functional dependencies of scaling factors lead to the uncertainties in the prediction of proton and neutron pairing properties which are especially pronounced at high isospin and could have a significant impact on some physical observables. For a given part of nuclear chart the scaling factors for spherical nuclei are smaller than those for deformed ones; this feature exists also in non-relativistic density functional theories. Its origin is traced back to particle-vibration coupling in odd-$A$ nuclei which is missing in all existing global studies of pairing. Although the present investigation is based on the NL5(E) covariant energy density functional (CEDF), its general conclusions are expected to be valid also for other CEDFs built at the Hartree level.


title: A method of immersed layers on Cartesian grids, with application to incompressible flows

abstract: The immersed boundary method (IBM) of Peskin (J. Comput. Phys., 1977), and derived forms such as the projection method of Taira and Colonius (J. Comput. Phys., 2007), have been useful for simulating flow physics in problems with moving interfaces on stationary grids. However, in their interface treatment, these methods do not distinguish one side from the other, but rather, apply the motion constraint to both sides, and the associated interface force is an inseparable mix of contributions from each side. In this work, we define a discrete Heaviside function, a natural companion to the familiar discrete Dirac delta function (DDF), to define a masked version of each field on the grid which, to within the error of the DDF, takes the intended value of the field on the respective sides of the interface. From this foundation we develop discrete operators and identities that are uniformly applicable to any surface geometry. We use these to develop extended forms of prototypical partial differential equations, including Poisson, convection-diffusion, and incompressible Navier-Stokes, that govern the discrete masked fields. These equations contain the familiar forcing term of the IBM, but also additional terms that regularize the jumps in field quantities onto the grid and enable us to individually specify the constraints on field behavior on each side of the interface. Drawing the connection between these terms and the layer potentials in elliptic problems, we refer to them generically as immersed layers. We demonstrate the application of the method to several representative problems, including two-dimensional incompressible flows inside a rotating cylinder and external to a rotating square.


title: Number of singular points on projective surfaces

abstract: The number of singular points on a klt Fano surface $X$ is $\leq 2\rho(X)+2$.


title: Unveiling the Potential of Structure Preserving for Weakly Supervised Object Localization

abstract: Weakly supervised object localization(WSOL) remains an open problem given the deficiency of finding object extent information using a classification network. Although prior works struggled to localize objects through various spatial regularization strategies, we argue that how to extract object structural information from the trained classification network is neglected. In this paper, we propose a two-stage approach, termed structure-preserving activation (SPA), toward fully leveraging the structure information incorporated in convolutional features for WSOL. First, a restricted activation module (RAM) is designed to alleviate the structure-missing issue caused by the classification network on the basis of the observation that the unbounded classification map and global average pooling layer drive the network to focus only on object parts. Second, we designed a post-process approach, termed self-correlation map generating (SCG) module to obtain structure-preserving localization maps on the basis of the activation maps acquired from the first stage. Specifically, we utilize the high-order self-correlation (HSC) to extract the inherent structural information retained in the learned model and then aggregate HSC of multiple points for precise object localization. Extensive experiments on two publicly available benchmarks including CUB-200-2011 and ILSVRC show that the proposed SPA achieves substantial and consistent performance gains compared with baseline approaches.Code and models are available at https://github.com/Panxjia/SPA_CVPR2021


title: FastFlowNet: A Lightweight Network for Fast Optical Flow Estimation

abstract: Dense optical flow estimation plays a key role in many robotic vision tasks. In the past few years, with the advent of deep learning, we have witnessed great progress in optical flow estimation. However, current networks often consist of a large number of parameters and require heavy computation costs, largely hindering its application on low power-consumption devices such as mobile phones. In this paper, we tackle this challenge and design a lightweight model for fast and accurate optical flow prediction. Our proposed FastFlowNet follows the widely-used coarse-to-fine paradigm with following innovations. First, a new head enhanced pooling pyramid (HEPP) feature extractor is employed to intensify high-resolution pyramid features while reducing parameters. Second, we introduce a new center dense dilated correlation (CDDC) layer for constructing compact cost volume that can keep large search radius with reduced computation burden. Third, an efficient shuffle block decoder (SBD) is implanted into each pyramid level to accelerate flow estimation with marginal drops in accuracy. Experiments on both synthetic Sintel data and real-world KITTI datasets demonstrate the effectiveness of the proposed approach, which needs only 1/10 computation of comparable networks to achieve on par accuracy. In particular, FastFlowNet only contains 1.37M parameters; and can execute at 90 FPS (with a single GTX 1080Ti) or 5.7 FPS (embedded Jetson TX2 GPU) on a pair of Sintel images of resolution 1024x436.


title: Near-field radiation assisted smart skin for spacecraft thermal control

abstract: Thermal control is of critical importance for normal operation of spacecraft. Given thermal radiation is the only means of heat dissipation in space, an efficient thermal control approach for spacecraft is to coat the radiator with a tunable-emittance "skin" that can tune its heat dissipation according to various thermal conditions. The existing schemes solely relying on far-field thermal radiation, which are based on mechanical, electrochromic or thermochromic working principles, are difficult to combine the advantages of all-solid-state structure, actively and accurate tuning, and large tuning range of heat flux. In this work, we propose a near-field radiation assisted (NFRA) smart skin for thermal control which can tune the heat rejection accurately and in a large range. It contains a metal-insulator-semiconductor (MIS) structure, where the carrier distribution in the semiconductor layer can be electrically altered. In this way, the near-field heat flux, and ultimately the skin emission power expressed using effective emittance, can be controlled as a function of the applied voltage. The variation range of the effective emittance can exceed 0.7 when adjusting the applied voltage from -10 V to 100 V with our preliminary design. This work opens a new way of smart skin design for active spacecraft thermal control.


title: Incremental Learning for Multi-organ Segmentation with Partially Labeled Datasets

abstract: There exists a large number of datasets for organ segmentation, which are partially annotated, and sequentially constructed. A typical dataset is constructed at a certain time by curating medical images and annotating the organs of interest. In other words, new datasets with annotations of new organ categories are built over time. To unleash the potential behind these partially labeled, sequentially-constructed datasets, we propose to learn a multi-organ segmentation model through incremental learning (IL). In each IL stage, we lose access to the previous annotations, whose knowledge is assumingly captured by the current model, and gain the access to a new dataset with annotations of new organ categories, from which we learn to update the organ segmentation model to include the new organs. We give the first attempt to conjecture that the different distribution is the key reason for 'catastrophic forgetting' that commonly exists in IL methods, and verify that IL has the natural adaptability to medical image scenarios. Extensive experiments on five open-sourced datasets are conducted to prove the effectiveness of our method and the conjecture mentioned above.


title: One-Shot Medical Landmark Detection

abstract: The success of deep learning methods relies on the availability of a large number of datasets with annotations; however, curating such datasets is burdensome, especially for medical images. To relieve such a burden for a landmark detection task, we explore the feasibility of using only a single annotated image and propose a novel framework named Cascade Comparing to Detect (CC2D) for one-shot landmark detection. CC2D consists of two stages: 1) Self-supervised learning (CC2D-SSL) and 2) Training with pseudo-labels (CC2D-TPL). CC2D-SSL captures the consistent anatomical information in a coarse-to-fine fashion by comparing the cascade feature representations and generates predictions on the training set. CC2D-TPL further improves the performance by training a new landmark detector with those predictions. The effectiveness of CC2D is evaluated on a widely-used public dataset of cephalometric landmark detection, which achieves a competitive detection accuracy of 81.01\% within 4.0mm, comparable to the state-of-the-art fully-supervised methods using a lot more than one training image.


title: Rydberg blockade in an ultracold strontium gas revealed by two-photon excitation dynamics

abstract: We demonstrate the interaction-induced blockade effect in an ultracold $^{88}$Sr gas via studying the time dynamics of a two-photon excitation to the triplet Rydberg series $5\mathrm{s}n\mathrm{s}\, ^3\textrm{S}_1$ for five different principle quantum numbers $n$ ranging from 19 to 37. By using a multi-pulse excitation sequence to increase the detection sensitivity we could identify Rydberg-excitation-induced atom losses as low as $<1\%$. Based on an optical Bloch equation formalism, treating the Rydberg-Rydberg interaction on a mean-field level, the van der Waals coefficients are extracted from the observed dynamics, which agree fairly well with \emph{ab initio} calculations.


title: Self-Supervised Online Reward Shaping in Sparse-Reward Environments

abstract: We introduce Self-supervised Online Reward Shaping (SORS), which aims to improve the sample efficiency of any RL algorithm in sparse-reward environments by automatically densifying rewards. The proposed framework alternates between classification-based reward inference and policy update steps -- the original sparse reward provides a self-supervisory signal for reward inference by ranking trajectories that the agent observes, while the policy update is performed with the newly inferred, typically dense reward function. We introduce theory that shows that, under certain conditions, this alteration of the reward function will not change the optimal policy of the original MDP, while potentially increasing learning speed significantly. Experimental results on several sparse-reward environments demonstrate that, across multiple domains, the proposed algorithm is not only significantly more sample efficient than a standard RL baseline using sparse rewards, but, at times, also achieves similar sample efficiency compared to when hand-designed dense reward functions are used.


title: Weather Analogs with a Machine Learning Similarity Metric for Renewable Resource Forecasting

abstract: The Analog Ensemble (AnEn) technique has been shown effective on several weather problems. Unlike previous weather analogs that are sought within a large spatial domain and an extended temporal window, AnEn strictly confines space and time, and independently generates results at each grid point within a short time window. AnEn can find similar forecasts that lead to accurate and calibrated ensemble forecasts. The central core of the AnEn technique is a similarity metric that sorts historical forecasts with respect to a new target prediction. A commonly used metric is Euclidean distance. However, a significant difficulty using this metric is the definition of the weights for all the parameters. Generally, feature selection and extensive weight search are needed. This paper proposes a novel definition of weather analogs through a Machine Learning (ML) based similarity metric. The similarity metric uses neural networks that are trained and instantiated to search for weather analogs. This new metric allows incorporating all variables without requiring a prior feature selection and weight optimization. Experiments are presented on the application of this new metric to forecast wind speed and solar irradiance. Results show that the ML metric generally outperforms the original metric. The ML metric has a better capability to correct for larger errors and to take advantage of a larger search repository. Spatial predictions using a learned metric also show the ability to define effective latent features that are transferable to other locations.


title: V2S: A Tool for Translating Video Recordings of Mobile App Usages into Replayable Scenarios

abstract: Screen recordings are becoming increasingly important as rich software artifacts that inform mobile application development processes. However, the amount of manual effort required to extract information from these graphical artifacts can hinder resource-constrained mobile developers. This paper presents Video2Scenario (V2S), an automated tool that processes video recordings of Android app usages, utilizes neural object detection and image classification techniques to classify the depicted user actions, and translates these actions into a replayable scenario. We conducted a comprehensive evaluation to demonstrate V2S's ability to reproduce recorded scenarios across a range of devices and a diverse set of usage cases and applications. The results indicate that, based on its performance with 175 videos depicting 3,534 GUI-based actions, V2S is accurate in reproducing $\approx$89\% of actions from collected videos.


title: Characterization of Tl$_2$NaYCl$_6$:Ce Scintillation Crystals as Gamma-Ray Detectors

abstract: In this paper the growth of a 16mm diameter Ce-doped Tl$_2$NaYCl$_6$ and its characterization as a gamma-ray detector are reported. With a 16 mm dia. x 8 mm cylindrical sample, energy resolution of 4.1% (FWHM) at 662 keV and light yield of 27,800ph/MeV are measured. Decay times of 91 ns (34%), 462 ns (52%), and 2.1 microseconds (15%) are calculated. The x-ray excited emission spectrum exhibits bands that are similar to other Tl-based elpasolite scintillators like Tl$_2$NaYCl$_6$:Ce.


title: Volcano: Stateless Cache Side-channel Attack by Exploiting Mesh Interconnect

abstract: Cache side-channel attacks lead to severe security threats to the settings that a CPU is shared across users, e.g., in the cloud. The existing attacks rely on sensing the micro-architectural state changes made by victims, and this assumption can be invalidated by combining spatial (\eg, Intel CAT) and temporal isolation (\eg, time protection). In this work, we advance the state of cache side-channel attacks by showing stateless cache side-channel attacks that cannot be defeated by both spatial and temporal isolation. This side-channel exploits the timing difference resulted from interconnect congestion. Specifically, to complete cache transactions, for Intel CPUs, cache lines would travel across cores via the CPU mesh interconnect. Nonetheless, the mesh links are shared by all cores, and cache isolation does not segregate the traffic. An attacker can generate interconnect traffic to contend with the victim's on a mesh link, hoping that extra delay will be measured. With the variant delays, the attacker can deduce the memory access pattern of a victim program, and infer its sensitive data. Based on this idea, we implement Volcano and test it against the existing RSA implementations of JDK. We found the RSA private key used by a victim process can be partially recovered. In the end, we propose a few directions for defense and call for the attention of the security community.


title: Achieving two-dimensional optical spectroscopy with temporal and spectral resolution using quantum entangled three photons

abstract: Recent advances in techniques for generating quantum light have stimulated research on novel spectroscopic measurements using quantum entangled photons. One such spectroscopy technique utilizes non-classical correlations among entangled photons to enable measurements with enhanced sensitivity and selectivity. Here, we investigate spectroscopic measurement utilizing entangled three photons. In this measurement, time-resolved entangled photon spectroscopy with monochromatic pumping [J. Chem. Phys. 153, 051102 (2020).] is integrated with the frequency-dispersed two-photon counting technique, which suppresses undesired accidental photon counts in the detector and thus allows one to separate the weak desired signal. This time-resolved frequency-dispersed two-photon counting signal, which is a function of two frequencies, is shown to provide the same information as that of coherent two-dimensional optical spectra. The spectral distribution of the phase-matching function works as a frequency filter to selectively resolve a specific region of the two-dimensional spectra, whereas the excited-state dynamics under investigation are temporally resolved in the time region longer than the entanglement time. The signal is not subject to Fourier limitations on the joint temporal and spectral resolution, and therefore, it is expected to be useful for investigating complex molecular systems in which multiple electronic states are present within a narrow energy range.


title: Decision-Making under On-Ramp merge Scenarios by Distributional Soft Actor-Critic Algorithm

abstract: Merging into the highway from the on-ramp is an essential scenario for automated driving. The decision-making under the scenario needs to balance the safety and efficiency performance to optimize a long-term objective, which is challenging due to the dynamic, stochastic, and adversarial characteristics. The Rule-based methods often lead to conservative driving on this task while the learning-based methods have difficulties meeting the safety requirements. In this paper, we propose an RL-based end-to-end decision-making method under a framework of offline training and online correction, called the Shielded Distributional Soft Actor-critic (SDSAC). The SDSAC adopts the policy evaluation with safety consideration and a safety shield parameterized with the barrier function in its offline training and online correction, respectively. These two measures support each other for better safety while not damaging the efficiency performance severely. We verify the SDSAC on an on-ramp merge scenario in simulation. The results show that the SDSAC has the best safety performance compared to baseline algorithms and achieves efficient driving simultaneously.


title: AI-enabled Future Wireless Networks: Challenges, Opportunities and Open Issues

abstract: A plethora of demanding services and use cases mandate a revolutionary shift in the management of future wireless network resources. Indeed, when tight quality of service demands of applications are combined with increased complexity of the network, legacy network management routines will become unfeasible in 6G. Artificial Intelligence (AI) is emerging as a fundamental enabler to orchestrate the network resources from bottom to top. AI-enabled radio access and AI-enabled core will open up new opportunities for automated configuration of 6G. On the other hand, there are many challenges in AI-enabled networks that need to be addressed. Long convergence time, memory complexity, and complex behaviour of machine learning algorithms under uncertainty as well as highly dynamic channel, traffic and mobility conditions of the network contribute to the challenges. In this paper, we survey the state-of-art research in utilizing machine learning techniques in improving the performance of wireless networks. In addition, we identify challenges and open issues to provide a roadmap for the researchers.


title: Multimodal Representation Learning via Maximization of Local Mutual Information

abstract: We propose and demonstrate a representation learning approach by maximizing the mutual information between local features of images and text. The goal of this approach is to learn useful image representations by taking advantage of the rich information contained in the free text that describes the findings in the image. Our method trains image and text encoders by encouraging the resulting representations to exhibit high local mutual information. We make use of recent advances in mutual information estimation with neural network discriminators. We argue that the sum of local mutual information is typically a lower bound on the global mutual information. Our experimental results in the downstream image classification tasks demonstrate the advantages of using local features for image-text representation learning.


title: Appearance of the Kashiwara-Saito singularity in the representation theory of $p$-adic $\mathop{GL}_{16}$

abstract: In 1993 David Vogan proposed a basis for the vector space of stable distributions on $p$-adic groups using the microlocal geometry of moduli spaces of Langlands parameters. In the case of general linear groups, distribution characters of irreducible admissible representations, taken up to equivalence, form a basis for the vector space of stable distributions. In this paper we show that these two bases, one putative, cannot be equal. Specifically, we use the Kashiwara-Saito singularity to find a non-Arthur type irreducible admissible representation of $p$-adic $\mathop{GL}_{16}$ whose ABV-packet, as defined in earlier work, contains exactly one other representation; remarkably, this other admissible representation is of Arthur type. In the course of this study we strengthen the main result concerning the Kashiwara-Saito singularity. The irreducible admissible representations in this paper illustrate a fact we found surprising: for general linear groups, while all A-packets are singletons, some ABV-packets are not.


title: Model-Free Online Learning in Unknown Sequential Decision Making Problems and Games

abstract: Regret minimization has proved to be a versatile tool for tree-form sequential decision making and extensive-form games. In large two-player zero-sum imperfect-information games, modern extensions of counterfactual regret minimization (CFR) are currently the practical state of the art for computing a Nash equilibrium. Most regret-minimization algorithms for tree-form sequential decision making, including CFR, require (i) an exact model of the player's decision nodes, observation nodes, and how they are linked, and (ii) full knowledge, at all times t, about the payoffs -- even in parts of the decision space that are not encountered at time t. Recently, there has been growing interest towards relaxing some of those restrictions and making regret minimization applicable to settings for which reinforcement learning methods have traditionally been used -- for example, those in which only black-box access to the environment is available. We give the first, to our knowledge, regret-minimization algorithm that guarantees sublinear regret with high probability even when requirement (i) -- and thus also (ii) -- is dropped. We formalize an online learning setting in which the strategy space is not known to the agent and gets revealed incrementally whenever the agent encounters new decision points. We give an efficient algorithm that achieves $O(T^{3/4})$ regret with high probability for that setting, even when the agent faces an adversarial environment. Our experiments show it significantly outperforms the prior algorithms for the problem, which do not have such guarantees. It can be used in any application for which regret minimization is useful: approximating Nash equilibrium or quantal response equilibrium, approximating coarse correlated equilibrium in multi-player games, learning a best response, learning safe opponent exploitation, and online play against an unknown opponent/environment.


title: Sliding Window Persistence of Quasiperiodic Functions

abstract: A function is called quasiperiodic if its fundamental frequencies are linearly independent over the rationals. With appropriate parameters, the sliding window point clouds of such functions can be shown to be dense in tori with dimension equal to the number of independent frequencies. In this paper, we develop theoretical and computational techniques to study the persistent homology of such sets. Specifically, we provide parameter optimization schemes for sliding windows of quasiperiodic functions, and present theoretical lower bounds on their Rips persistent homology. The latter leverages a recent persistent K\"{u}nneth formula. The theory is illustrated via computational examples and an application to dissonance detection in music audio samples.


title: A Reinforcement Learning Based R-Tree for Spatial Data Indexing in Dynamic Environments

abstract: Learned indices have been proposed to replace classic index structures like B-Tree with machine learning (ML) models. They require to replace both the indices and query processing algorithms currently deployed by the databases, and such a radical departure is likely to encounter challenges and obstacles. In contrast, we propose a fundamentally different way of using ML techniques to improve on the query performance of the classic R-Tree without the need of changing its structure or query processing algorithms. Specifically, we develop reinforcement learning (RL) based models to decide how to choose a subtree for insertion and how to split a node when building an R-Tree, instead of relying on hand-crafted heuristic rules currently used by R-Tree and its variants. Experiments on real and synthetic datasets with up to more than 100 million spatial objects clearly show that our RL based index outperforms R-Tree and its variants in terms of query processing time.


title: Topology and retardation effect of a giant atom in a topological waveguide

abstract: The interaction between the quantum emitter and topological photonic system makes both the emitter and the photon behave in exotic ways. We here study a system that a giant atom is coupled to two points of a one-dimensional topological waveguide formed by the Su-Schrieffer-Heeger (SSH) chain. The topological nature of the hybrid system is studied. We find that the giant atom can act as an effective boundary and induce the chiral zero energy modes for the waveguide under the periodical boundary. The properties of these modes are similar to those in the SSH model with open boundary. Meanwhile, the SSH waveguide, as a structured environment, induces the retarded effect and the non-Markovian dissipation of the giant atom. Our work may promote more studies on the interaction between matter and topological environment. Experimental demonstration for our study using superconducting quantum circuits is very possible within current technology.


title: Online Directed Spanners and Steiner Forests

abstract: We present online algorithms for directed spanners and Steiner forests. These problems fall under the unifying framework of online covering linear programming formulations, developed by Buchbinder and Naor (MOR, 34, 2009), based on primal-dual techniques. Our results include the following: For the pairwise spanner problem, in which the pairs of vertices to be spanned arrive online, we present an efficient randomized $\tilde{O}(n^{4/5})$-competitive algorithm for graphs with general lengths, where $n$ is the number of vertices. With uniform lengths, we give an efficient randomized $\tilde{O}(n^{2/3+\epsilon})$-competitive algorithm, and an efficient deterministic $\tilde{O}(k^{1/2+\epsilon})$-competitive algorithm, where $k$ is the number of terminal pairs. These are the first online algorithms for directed spanners. In the offline setting, the current best approximation ratio with uniform lengths is $\tilde{O}(n^{3/5 + \epsilon})$, due to Chlamtac, Dinitz, Kortsarz, and Laekhanukit (TALG 2020). For the directed Steiner forest problem with uniform costs, in which the pairs of vertices to be connected arrive online, we present an efficient randomized $\tilde{O}(n^{2/3 + \epsilon})$-competitive algorithm. The state-of-the-art online algorithm for general costs is due to Chakrabarty, Ene, Krishnaswamy, and Panigrahi (SICOMP 2018) and is $\tilde{O}(k^{1/2 + \epsilon})$-competitive. In the offline version, the current best approximation ratio with uniform costs is $\tilde{O}(n^{4/7 + \epsilon})$, due to Abboud and Bodwin (SODA 2018). A small modification of the online covering framework by Buchbinder and Naor implies a polynomial-time primal-dual approach with separation oracles, which a priori might perform exponentially many calls. We convert the online spanner problem and the online Steiner forest problem into online covering problems and round in a problem-specific fashion.


title: Exploring a Makeup Support System for Transgender Passing based on Automatic Gender Recognition

abstract: How to handle gender with machine learning is a controversial topic. A growing critical body of research brought attention to the numerous issues transgender communities face with the adoption of current automatic gender recognition (AGR) systems. In contrast, we explore how such technologies could potentially be appropriated to support transgender practices and needs, especially in non-Western contexts like Japan. We designed a virtual makeup probe to assist transgender individuals with passing, that is to be perceived as the gender they identify as. To understand how such an application might support expressing transgender individuals gender identity or not, we interviewed 15 individuals in Tokyo and found that in the right context and under strict conditions, AGR based systems could assist transgender passing.


title: Anytime Ellipsoidal Over-approximation of Forward Reach Sets of Uncertain Linear Systems

abstract: Computing tight over-approximation of reach sets of a controlled uncertain dynamical system is a common practice in verification of safety-critical cyber-physical systems (CPS). While several algorithms are available for this purpose, they tend to be computationally demanding in CPS applications since here, the computational resources such as processor availability tend to be scarce, time-varying and difficult to model. A natural idea then is to design "computation-aware" algorithms that can dynamically adapt with respect to the processor availability in a provably safe manner. Even though this idea should be applicable in broader context, here we focus on ellipsoidal over-approximations. We demonstrate that the algorithms for ellipsoidal over-approximation of reach sets of uncertain linear systems, are well-suited for anytime implementation in the sense the quality of the over-approximation can be dynamically traded off depending on the computational time available, all the while guaranteeing safety. We give a numerical example to illustrate the idea, and point out possible future directions.


title: Bandit Linear Optimization for Sequential Decision Making and Extensive-Form Games

abstract: Tree-form sequential decision making (TFSDM) extends classical one-shot decision making by modeling tree-form interactions between an agent and a potentially adversarial environment. It captures the online decision-making problems that each player faces in an extensive-form game, as well as Markov decision processes and partially-observable Markov decision processes where the agent conditions on observed history. Over the past decade, there has been considerable effort into designing online optimization methods for TFSDM. Virtually all of that work has been in the full-feedback setting, where the agent has access to counterfactuals, that is, information on what would have happened had the agent chosen a different action at any decision node. Little is known about the bandit setting, where that assumption is reversed (no counterfactual information is available), despite this latter setting being well understood for almost 20 years in one-shot decision making. In this paper, we give the first algorithm for the bandit linear optimization problem for TFSDM that offers both (i) linear-time iterations (in the size of the decision tree) and (ii) $O(\sqrt{T})$ cumulative regret in expectation compared to any fixed strategy, at all times $T$. This is made possible by new results that we derive, which may have independent uses as well: 1) geometry of the dilated entropy regularizer, 2) autocorrelation matrix of the natural sampling scheme for sequence-form strategies, 3) construction of an unbiased estimator for linear losses for sequence-form strategies, and 4) a refined regret analysis for mirror descent when using the dilated entropy regularizer.


title: Visible and Near-infrared Microdisk Resonators on a 4H-Silicon-Carbide-on-Insulator Platform

abstract: Wavelength-sized microdisk resonators were fabricated on a single crystalline 4H-silicon-carbide-oninsulator platform (4H-SiCOI). By carrying out microphotoluminescence measurements at room temperature, we show that the microdisk resonators support whispering-gallery modes (WGMs) with quality factors up to $5.25 \times 10^3$ and mode volumes down to $2.69 \times(\lambda /n)^3$ at the visible and near-infrared wavelengths. Moreover, the demonstrated wavelength-sized microdisk resonators exhibit WGMs whose resonant wavelengths compatible with the zero-phonon lines of spin defects in 4H-SiCOI, making them a promising candidate for applications in cavity quantum electrodynamics and integrated quantum photonic circuits.


title: Learning to Control an Unstable System with One Minute of Data: Leveraging Gaussian Process Differentiation in Predictive Control

abstract: We present a straightforward and efficient way to control unstable robotic systems using an estimated dynamics model. Specifically, we show how to exploit the differentiability of Gaussian Processes to create a state-dependent linearized approximation of the true continuous dynamics that can be integrated with model predictive control. Our approach is compatible with most Gaussian process approaches for system identification, and can learn an accurate model using modest amounts of training data. We validate our approach by learning the dynamics of an unstable system such as a segway with a 7-D state space and 2-D input space (using only one minute of data), and we show that the resulting controller is robust to unmodelled dynamics and disturbances, while state-of-the-art control methods based on nominal models can fail under small perturbations. Code is open sourced at https://github.com/learning-and-control/core .


title: Duality of positive and negative integrable hierarchies via relativistically invariant fields

abstract: It is shown that the relativistic invariance plays a key role in the study of integrable systems. Using the relativistically invariant sine-Gordon equation, the Tzitzeica equation, the Toda fields and the second heavenly equation as dual relations, some continuous and discrete integrable positive hierarchies such as the potential modified Korteweg-de Vries hierarchy, the potential Fordy-Gibbons hierarchies, the potential dispersionless Kadomtsev-Petviashvili-like (dKPL) hierarchy, the differential-difference dKPL hierarchy and the second heavenly hierarchies are converted to the integrable negative hierarchies including the sG hierarchy and the Tzitzeica hierarchy, the two-dimensional dispersionless Toda hierarchy, the two-dimensional Toda hierarchies and negative heavenly hierarchy. In (1+1)-dimensional cases the positive/negative hierarchy dualities are guaranteed by the dualities between the recursion operators and their inverses. In (2+1)-dimensional cases, the positive/negative hierarchy dualities are explicitly shown by using the formal series symmetry approach, the mastersymmetry method and the relativistic invariance of the duality relations. For the 4-dimensional heavenly system, the duality problem is studied firstly by formal series symmetry approach. Two elegant commuting recursion operators of the heavenly equation appear naturally from the formal series symmetry approach so that the duality problem can also be studied by means of the recursion operators.


title: No Weighted-Regret Learning in Adversarial Bandits with Delays

abstract: Consider a scenario where a player chooses an action in each round $t$ out of $T$ rounds and observes the incurred cost after a delay of $d_{t}$ rounds. The cost functions and the delay sequence are chosen by an adversary. We show that in a non-cooperative game, the expected weighted ergodic distribution of play converges to the set of coarse correlated equilibria if players use algorithms that have "no weighted-regret" in the above scenario, even if they have linear regret due to too large delays. For a two-player zero-sum game, we show that no weighted-regret is sufficient for the weighted ergodic average of play to converge to the set of Nash equilibria. We prove that the FKM algorithm with $n$ dimensions achieves an expected regret of $O\left(nT^{\frac{3}{4}}+\sqrt{n}T^{\frac{1}{3}}D^{\frac{1}{3}}\right)$ and the EXP3 algorithm with $K$ arms achieves an expected regret of $O\left(\sqrt{\log K\left(KT+D\right)}\right)$ even when $D=\sum_{t=1}^{T}d_{t}$ and $T$ are unknown. These bounds use a novel doubling trick that, under mild assumptions, provably retains the regret bound for when $D$ and $T$ are known. Using these bounds, we show that FKM and EXP3 have no weighted-regret even for $d_{t}=O\left(t\log t\right)$. Therefore, algorithms with no weighted-regret can be used to approximate a CCE of a finite or convex unknown game that can only be simulated with bandit feedback, even if the simulation involves significant delays.


title: Behavior From the Void: Unsupervised Active Pre-Training

abstract: We introduce a new unsupervised pre-training method for reinforcement learning called APT, which stands for Active Pre-Training. APT learns behaviors and representations by actively searching for novel states in reward-free environments. The key novel idea is to explore the environment by maximizing a non-parametric entropy computed in an abstract representation space, which avoids challenging density modeling and consequently allows our approach to scale much better in environments that have high-dimensional observations (e.g., image observations). We empirically evaluate APT by exposing task-specific reward after a long unsupervised pre-training phase. In Atari games, APT achieves human-level performance on 12 games and obtains highly competitive performance compared to canonical fully supervised RL algorithms. On DMControl suite, APT beats all baselines in terms of asymptotic performance and data efficiency and dramatically improves performance on tasks that are extremely difficult to train from scratch.


title: U-DuDoNet: Unpaired dual-domain network for CT metal artifact reduction

abstract: Recently, both supervised and unsupervised deep learning methods have been widely applied on the CT metal artifact reduction (MAR) task. Supervised methods such as Dual Domain Network (Du-DoNet) work well on simulation data; however, their performance on clinical data is limited due to domain gap. Unsupervised methods are more generalized, but do not eliminate artifacts completely through the sole processing on the image domain. To combine the advantages of both MAR methods, we propose an unpaired dual-domain network (U-DuDoNet) trained using unpaired data. Unlike the artifact disentanglement network (ADN) that utilizes multiple encoders and decoders for disentangling content from artifact, our U-DuDoNet directly models the artifact generation process through additions in both sinogram and image domains, which is theoretically justified by an additive property associated with metal artifact. Our design includes a self-learned sinogram prior net, which provides guidance for restoring the information in the sinogram domain, and cyclic constraints for artifact reduction and addition on unpaired data. Extensive experiments on simulation data and clinical images demonstrate that our novel framework outperforms the state-of-the-art unpaired approaches.


title: Classification of certain weakly integral fusion categories

abstract: We prove that braided fusion categories of Frobenius-Perron $p^mq^nd$ or $p^2q^2r^2$ are weakly group-theoretical, where $p,q,r$ are distinct prime numbers, $d$ is a square-free natural number such that $(pq,d)=1$. As an application, we obtain that weakly integral braided fusion categories of Frobenius-Perron dimension less than $1800$ are weakly group-theoretical, and weakly integral braided fusion categories of odd dimension less than $33075$ are solvable. For the general case, we prove that fusion categories (not necessarily braided) of Frobenius-Perron dimension $84$ and $90$ either solvable or group-theoretical. Together with the results in the literature, this shows that every weakly integral fusion category of Frobenius-Perron dimension less than $120$ is either solvable or group-theoretical. Thus we complete the classification of all these fusion categories in terms of Morita equivalence.


title: Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models

abstract: Recent work showed that there could be a large gap between the classical uniform convergence bound and the actual test error of zero-training-error predictors (interpolators) such as deep neural networks. To better understand this gap, we study the uniform convergence in the nonlinear random feature model and perform a precise theoretical analysis on how uniform convergence depends on the sample size and the number of parameters. We derive and prove analytical expressions for three quantities in this model: 1) classical uniform convergence over norm balls, 2) uniform convergence over interpolators in the norm ball (recently proposed by Zhou et al. (2020)), and 3) the risk of minimum norm interpolator. We show that, in the setting where the classical uniform convergence bound is vacuous (diverges to $\infty$), uniform convergence over the interpolators still gives a non-trivial bound of the test error of interpolating solutions. We also showcase a different setting where classical uniform convergence bound is non-vacuous, but uniform convergence over interpolators can give an improved sample complexity guarantee. Our result provides a first exact comparison between the test errors and uniform convergence bounds for interpolators beyond simple linear models.


title: Real-world Ride-hailing Vehicle Repositioning using Deep Reinforcement Learning

abstract: We present a new practical framework based on deep reinforcement learning and decision-time planning for real-world vehicle repositioning on ride-hailing (a type of mobility-on-demand, MoD) platforms. Our approach learns the spatiotemporal state-value function using a batch training algorithm with deep value networks. The optimal repositioning action is generated on-demand through value-based policy search, which combines planning and bootstrapping with the value networks. For the large-fleet problems, we develop several algorithmic features that we incorporate into our framework and that we demonstrate to induce coordination among the algorithmically-guided vehicles. We benchmark our algorithm with baselines in a ride-hailing simulation environment to demonstrate its superiority in improving income efficiency meausred by income-per-hour. We have also designed and run a real-world experiment program with regular drivers on a major ride-hailing platform. We have observed significantly positive results on key metrics comparing our method with experienced drivers who performed idle-time repositioning based on their own expertise.


title: T-SCI: A Two-Stage Conformal Inference Algorithm with Guaranteed Coverage for Cox-MLP

abstract: It is challenging to deal with censored data, where we only have access to the incomplete information of survival time instead of its exact value. Fortunately, under linear predictor assumption, people can obtain guaranteed coverage for the confidence band of survival time using methods like Cox Regression. However, when relaxing the linear assumption with neural networks (e.g., Cox-MLP (Katzman et al., 2018; Kvamme et al., 2019)), we lose the guaranteed coverage. To recover the guaranteed coverage without linear assumption, we propose two algorithms based on conformal inference. In the first algorithm WCCI, we revisit weighted conformal inference and introduce a new non-conformity score based on partial likelihood. We then propose a two-stage algorithm T-SCI, where we run WCCI in the first stage and apply quantile conformal inference to calibrate the results in the second stage. Theoretical analysis shows that T-SCI returns guaranteed coverage under milder assumptions than WCCI. We conduct extensive experiments on synthetic data and real data using different methods, which validate our analysis.


title: Asymptotics of Ridge Regression in Convolutional Models

abstract: Understanding generalization and estimation error of estimators for simple models such as linear and generalized linear models has attracted a lot of attention recently. This is in part due to an interesting observation made in machine learning community that highly over-parameterized neural networks achieve zero training error, and yet they are able to generalize well over the test samples. This phenomenon is captured by the so called double descent curve, where the generalization error starts decreasing again after the interpolation threshold. A series of recent works tried to explain such phenomenon for simple models. In this work, we analyze the asymptotics of estimation error in ridge estimators for convolutional linear models. These convolutional inverse problems, also known as deconvolution, naturally arise in different fields such as seismology, imaging, and acoustics among others. Our results hold for a large class of input distributions that include i.i.d. features as a special case. We derive exact formulae for estimation error of ridge estimators that hold in a certain high-dimensional regime. We show the double descent phenomenon in our experiments for convolutional models and show that our theoretical results match the experiments.


title: CRLF: Automatic Calibration and Refinement based on Line Feature for LiDAR and Camera in Road Scenes

abstract: For autonomous vehicles, an accurate calibration for LiDAR and camera is a prerequisite for multi-sensor perception systems. However, existing calibration techniques require either a complicated setting with various calibration targets, or an initial calibration provided beforehand, which greatly impedes their applicability in large-scale autonomous vehicle deployment. To tackle these issues, we propose a novel method to calibrate the extrinsic parameter for LiDAR and camera in road scenes. Our method introduces line features from static straight-line-shaped objects such as road lanes and poles in both image and point cloud and formulates the initial calibration of extrinsic parameters as a perspective-3-lines (P3L) problem. Subsequently, a cost function defined under the semantic constraints of the line features is designed to perform refinement on the solved coarse calibration. The whole procedure is fully automatic and user-friendly without the need to adjust environment settings or provide an initial calibration. We conduct extensive experiments on KITTI and our in-house dataset, quantitative and qualitative results demonstrate the robustness and accuracy of our method.


title: Parser-Free Virtual Try-on via Distilling Appearance Flows

abstract: Image virtual try-on aims to fit a garment image (target clothes) to a person image. Prior methods are heavily based on human parsing. However, slightly-wrong segmentation results would lead to unrealistic try-on images with large artifacts. Inaccurate parsing misleads parser-based methods to produce visually unrealistic results where artifacts usually occur. A recent pioneering work employed knowledge distillation to reduce the dependency of human parsing, where the try-on images produced by a parser-based method are used as supervisions to train a "student" network without relying on segmentation, making the student mimic the try-on ability of the parser-based model. However, the image quality of the student is bounded by the parser-based model. To address this problem, we propose a novel approach, "teacher-tutor-student" knowledge distillation, which is able to produce highly photo-realistic images without human parsing, possessing several appealing advantages compared to prior arts. (1) Unlike existing work, our approach treats the fake images produced by the parser-based method as "tutor knowledge", where the artifacts can be corrected by real "teacher knowledge", which is extracted from the real person images in a self-supervised way. (2) Other than using real images as supervisions, we formulate knowledge distillation in the try-on problem as distilling the appearance flows between the person image and the garment image, enabling us to find accurate dense correspondences between them to produce high-quality results. (3) Extensive evaluations show large superiority of our method (see Fig. 1).


title: Extension of topological groupoids and Serre, Hurewicz morphisms

abstract: In this paper, we introduce the notion of a topological groupoid extension and relate it to the already existing notion of a gerbe over a topological stack. We further study the properties of a gerbe over a Serre, Hurewicz stack.


title: Decompositions of index one Jacobi forms into $N=4$ characters and formulas for mock modular forms

abstract: It is shown that every weak Jacobi form of weight zero and index one on a congruence subgroup of the full Jacobi group can be decomposed into $N=4$ superconformal characters. Additionally, a simple expression for the mock modular form determining the superconformal character coefficients is obtained, as well as a universal completion structure. Along the way, a useful vector-valued mock modular form is also found and studied. These results are applied to analyze some Jacobi trace functions associated to super vertex operator algebras and a distinguished sector.


title: Robust Pipek-Mezey Orbital Localization in Periodic Solids

abstract: We describe a robust method for determining Pipek-Mezey (PM) Wannier functions (WF), recently introduced by J\'onsson et al. (J. Chem. Theor. Chem. 2017, 13, 460), which provide some formal advantages over the more common Boys (also known as maximally-localized) Wannier functions. The Broyden-Fletcher-Goldfarb-Shanno (BFGS) based PMWF solver is demonstrated to yield dramatically faster convergence compared to the alternatives (steepest ascent and conjugate gradient) in a variety of 1-, 2-, and 3-dimensional solids (including some with vanishing gaps), and can be used to obtain Wannier functions robustly in supercells with thousands of atoms. Evaluation of the PM functional and its gradient in periodic LCAO representation used a particularly simple definition of atomic charges obtained by Moore-Penrose pseudoinverse projection onto the minimal atomic orbital basis. An automated "Canonicalize Phase then Randomize" (CPR) method for generating the initial guess for WFs contributes significantly to the robustness of the solver.


title: Human-Machine Adaptive Shared Control for Safe Automated Driving under Automation Degradation

abstract: In this paper, a human-machine adaptive shared control method is proposed for automated vehicles (AVs) under automation performance degradation. First, a novel risk assessment module is proposed to monitor driving behavior and evaluate automation performance degradation for AVs. Then, an adaptive control authority allocation module is developed. In the event of any performance degradation detection, the allocated control authority of the automation system is decreased based on the assessed risk to reduce the potential risk of vehicle motion. Consequently, the control authority allocated to the human driver is adaptively increased and thus requires more driver engagement in the control loop to compensate for the automation degradation and ensure AV safety. Experimental validation is conducted under different driving scenarios. The testing results show that the proposed approach is able to effectively compensate for the performance degradation of vehicle automation through the human-machine adaptive shared control, ensuring the safety of automated driving


title: Discovering Diverse Multi-Agent Strategic Behavior via Reward Randomization

abstract: We propose a simple, general and effective technique, Reward Randomization for discovering diverse strategic policies in complex multi-agent games. Combining reward randomization and policy gradient, we derive a new algorithm, Reward-Randomized Policy Gradient (RPG). RPG is able to discover multiple distinctive human-interpretable strategies in challenging temporal trust dilemmas, including grid-world games and a real-world game Agar.io, where multiple equilibria exist but standard multi-agent policy gradient algorithms always converge to a fixed one with a sub-optimal payoff for every player even using state-of-the-art exploration techniques. Furthermore, with the set of diverse strategies from RPG, we can (1) achieve higher payoffs by fine-tuning the best policy from the set; and (2) obtain an adaptive agent by using this set of strategies as its training opponents. The source code and example videos can be found in our website: https://sites.google.com/view/staghuntrpg.


title: Improving Transformation-based Defenses against Adversarial Examples with First-order Perturbations

abstract: Deep neural networks have been successfully applied in various machine learning tasks. However, studies show that neural networks are susceptible to adversarial attacks. This exposes a potential threat to neural network-based intelligent systems. We observe that the probability of the correct result outputted by the neural network increases by applying small first-order perturbations generated for non-predicted class labels to adversarial examples. Based on this observation, we propose a method for counteracting adversarial perturbations to improve adversarial robustness. In the proposed method, we randomly select a number of class labels and generate small first-order perturbations for these selected labels. The generated perturbations are added together and then clamped onto a specified space. The obtained perturbation is finally added to the adversarial example to counteract the adversarial perturbation contained in the example. The proposed method is applied at inference time and does not require retraining or finetuning the model. We experimentally validate the proposed method on CIFAR-10 and CIFAR-100. The results demonstrate that our method effectively improves the defense performance of several transformation-based defense methods, especially against strong adversarial examples generated using more iterations.