title: The first photometric investigation and spectroscopic analysis of two contact binaries: ASAS J124343+1531.7 and LINEAR 2323566

abstract: The multi-color passband CCD light curves of ASAS J124343+1531.7 and LINEAR 2323566 were first obtained by the 0.84-m Ritchey-Chr\'{e}tien telescope with follow up observations by the WIYN 0.90m Cassegrain telescope. The data from the $Transiting\quad Exoplanet\quad Survey\quad Satellite\quad (TESS)$ of ASAS J124343+1531.7 was also applied for subsequent analysis. By analyzing the data through the W-D program, their mass ratios and fill-out factors were determined as 3.758, 1.438 and 31.8$\%$, 14.9$\%$, respectively. ASAS J124343+1531.7 is a W-subtype median contact binary, while LINEAR 2323566 is a W-subtype shallow contact binary, and the asymmetric light curves prove that they both have the O'Connell effect, which is generally explained by magnetic activity. The equivalent widths (EWs) of H$_\alpha$ lines were calculated, which show they certainly have magnetic activity. Moreover, LINEAR 2323566 has a stronger magnetic activity. The analysis of orbital period changes shows that ASAS J124343+1531.7 has a trend of secular period increase, which is generally explained by the mass transfer from the less massive to the more massive star. According to the estimated absolute parameters, their evolutionary states are discussed. The two components of ASAS J124343+1531.7 are both main sequence stars. While for LINEAR 2323566, the more massive star is a main sequence star, the less massive star has evolved out of main sequence and is over-luminous and over-sized.


title: Classifying Video based on Automatic Content Detection Overview

abstract: Video classification and analysis is always a popular and challenging field in computer vision. It is more than just simple image classification due to the correlation with respect to the semantic contents of subsequent frames brings difficulties for video analysis. In this literature review, we summarized some state-of-the-art methods for multi-label video classification. Our goal is first to experimentally research the current widely used architectures, and then to develop a method to deal with the sequential data of frames and perform multi-label classification based on automatic content detection of video.


title: An Algebraic Framework for Multi-Qudit Computations with Generalized Clifford Algebras

abstract: In this article, we develop an algebraic framework of axioms which abstracts various high-level properties of multi-qudit representations of generalized Clifford algebras. We further construct an explicit model and prove that it satisfies these axioms. Strengths of our algebraic framework include the minimality of its assumptions, and the readiness by which one may give an explicit construction satisfying these assumptions. In terms of applications, this algebraic framework provides a solid foundation which opens the way for developing a graphical calculus for multi-qudit representations of generalized Clifford algebras using purely algebraic methods, which is addressed in a follow-up paper.


title: Electronic properties and quasi-particle model of monolayer MoSi$_2$N$_4$

abstract: By a combined study with first-principles calculations and symmetry analysis, we theoretically investigate the electronic properties of monolayer MoSi$_2$N$_4$. While the spin-orbital coupling results in bands splitting, the horizontal mirror symmetry locks the spin polarization along z-direction. In addition, a three-band tight-binding model is constructed to describe the low-energy quasi-particle states of monolayer MoSi$_2$N$_4$, which can be generalized to strained MoSi$_2$N$_4$ and its derivatives. The calculations using the tight-binding model show an undamped $\sqrt{q}$-dependent plasmon mode that agrees well with the results of first-principles calculations. Our model can be extended to be suitable for future theoretical and numerical studies of low-energy properties in MoSi$_2$N$_4$ family materials. Furthermore, the study of electronic properties of monolayer MoSi$_2$N$_4$ paves a way for its applications in spintronics and plasmonics.


title: Fooling LiDAR Perception via Adversarial Trajectory Perturbation

abstract: LiDAR point clouds collected from a moving vehicle are functions of its trajectories, because the sensor motion needs to be compensated to avoid distortions. When autonomous vehicles are sending LiDAR point clouds to deep networks for perception and planning, could the motion compensation consequently become a wide-open backdoor in those networks, due to both the adversarial vulnerability of deep learning and GPS-based vehicle trajectory estimation that is susceptible to wireless spoofing? We demonstrate such possibilities for the first time: instead of directly attacking point cloud coordinates which requires tampering with the raw LiDAR readings, only adversarial spoofing of a self-driving car's trajectory with small perturbations is enough to make safety-critical objects undetectable or detected with incorrect positions. Moreover, polynomial trajectory perturbation is developed to achieve a temporally-smooth and highly-imperceptible attack. Extensive experiments on 3D object detection have shown that such attacks not only lower the performance of the state-of-the-art detectors effectively, but also transfer to other detectors, raising a red flag for the community. The code is available on https://ai4ce.github.io/FLAT/.


title: Centrality Meets Centroid: A Graph-based Approach for Unsupervised Document Summarization

abstract: Unsupervised document summarization has re-acquired lots of attention in recent years thanks to its simplicity and data independence. In this paper, we propose a graph-based unsupervised approach for extractive document summarization. Instead of ranking sentences by salience and extracting sentences one by one, our approach works at a summary-level by utilizing graph centrality and centroid. We first extract summary candidates as subgraphs based on centrality from the sentence graph and then select from the summary candidates by matching to the centroid. We perform extensive experiments on two bench-marked summarization datasets, and the results demonstrate the effectiveness of our model compared to state-of-the-art baselines.


title: Phenomenology of the Zee model for Dirac neutrinos and general neutrino interactions

abstract: The Zee model for Dirac neutrinos is one of the simplest models featuring one-loop Dirac neutrino masses. The interactions between the new scalars (two singly-charged fields) and neutrinos induce general neutrino interactions (GNI) which, as a generalisation of the non standard neutrino interactions, constitute an additional tool to probe models beyond the SM like this. In this work, we consider a $U(1)_{{B-L}}$ gauge symmetry as the responsible for the Diracness of the neutrinos and the radiative character of the neutrino masses. We determine the viable parameter space consistent with neutrino oscillation data, leptonic rare decays and collider constraints, and establish the most relevant experimental prospects regarding lepton flavor violation searches and GNI in future solar neutrino experiments.


title: A Fast and Small Subsampled R-index

abstract: The $r$-index (Gagie et al., JACM 2020) represented a breakthrough in compressed indexing of repetitive text collections, outperforming its alternatives by orders of magnitude. Its space usage, $\mathcal{O}(r)$ where $r$ is the number of runs in the Burrows-Wheeler Transform of the text, is however larger than Lempel-Ziv and grammar-based indexes, and makes it uninteresting in various real-life scenarios of milder repetitiveness. In this paper we introduce the $sr$-index, a variant that limits the space to $\mathcal{O}(\min(r,n/s))$ for a text of length $n$ and a given parameter $s$, at the expense of multiplying by $s$ the time per occurrence reported. The $sr$-index is obtained by carefully subsampling the text positions indexed by the $r$-index, in a way that we prove is still able to support pattern matching with guaranteed performance. Our experiments demonstrate that the $sr$-index sharply outperforms virtually every other compressed index on repetitive texts, both in time and space, even matching the performance of the $r$-index while using 1.5--3.0 times less space. Only some Lempel-Ziv-based indexes achieve better compression than the $sr$-index, using about half the space, but they are an order of magnitude slower.


title: Extending Multi-Sense Word Embedding to Phrases and Sentences for Unsupervised Semantic Applications

abstract: Most unsupervised NLP models represent each word with a single point or single region in semantic space, while the existing multi-sense word embeddings cannot represent longer word sequences like phrases or sentences. We propose a novel embedding method for a text sequence (a phrase or a sentence) where each sequence is represented by a distinct set of multi-mode codebook embeddings to capture different semantic facets of its meaning. The codebook embeddings can be viewed as the cluster centers which summarize the distribution of possibly co-occurring words in a pre-trained word embedding space. We introduce an end-to-end trainable neural model that directly predicts the set of cluster centers from the input text sequence during test time. Our experiments show that the per-sentence codebook embeddings significantly improve the performances in unsupervised sentence similarity and extractive summarization benchmarks. In phrase similarity experiments, we discover that the multi-facet embeddings provide an interpretable semantic representation but do not outperform the single-facet baseline.


title: POSEFusion: Pose-guided Selective Fusion for Single-view Human Volumetric Capture

abstract: We propose POse-guided SElective Fusion (POSEFusion), a single-view human volumetric capture method that leverages tracking-based methods and tracking-free inference to achieve high-fidelity and dynamic 3D reconstruction. By contributing a novel reconstruction framework which contains pose-guided keyframe selection and robust implicit surface fusion, our method fully utilizes the advantages of both tracking-based methods and tracking-free inference methods, and finally enables the high-fidelity reconstruction of dynamic surface details even in the invisible regions. We formulate the keyframe selection as a dynamic programming problem to guarantee the temporal continuity of the reconstructed sequence. Moreover, the novel robust implicit surface fusion involves an adaptive blending weight to preserve high-fidelity surface details and an automatic collision handling method to deal with the potential self-collisions. Overall, our method enables high-fidelity and dynamic capture in both visible and invisible regions from a single RGBD camera, and the results and experiments show that our method outperforms state-of-the-art methods.


title: Measuring Sample Efficiency and Generalization in Reinforcement Learning Benchmarks: NeurIPS 2020 Procgen Benchmark

abstract: The NeurIPS 2020 Procgen Competition was designed as a centralized benchmark with clearly defined tasks for measuring Sample Efficiency and Generalization in Reinforcement Learning. Generalization remains one of the most fundamental challenges in deep reinforcement learning, and yet we do not have enough benchmarks to measure the progress of the community on Generalization in Reinforcement Learning. We present the design of a centralized benchmark for Reinforcement Learning which can help measure Sample Efficiency and Generalization in Reinforcement Learning by doing end to end evaluation of the training and rollout phases of thousands of user submitted code bases in a scalable way. We designed the benchmark on top of the already existing Procgen Benchmark by defining clear tasks and standardizing the end to end evaluation setups. The design aims to maximize the flexibility available for researchers who wish to design future iterations of such benchmarks, and yet imposes necessary practical constraints to allow for a system like this to scale. This paper presents the competition setup and the details and analysis of the top solutions identified through this setup in context of 2020 iteration of the competition at NeurIPS.


title: A Distributed Scheme for Stability Assessment in Large-Scale Structure-Preserving Models via Singular Perturbation

abstract: Assessing small-signal stability of power systems composed of thousands of interacting generators is a computationally challenging task. To reduce the computational burden, this paper introduces a novel condition to assess and certify small-signal stability. Using this certificate, we can see the impact of network topology and system parameters (generators' damping and inertia) on the eigenvalues of the system. The proposed certificate is derived from rigorous analysis of the classical structure-preserving swing equation model and has a physically insightful interpretation related to the generators' parameters and reactive power. To develop the certificate, we use singular perturbation techniques, and in the process, we establish the relationship between the structure-preserving model and its singular perturbation counterpart. As the proposed method is fully distributed and uses only local measurements, its computational cost does not increase with the size of the system. The effectiveness of the scheme is numerically illustrated on the WSCC system.


title: Quantum algorithm for time-dependent Hamiltonian simulation by permutation expansion

abstract: We present a quantum algorithm for the dynamical simulation of time-dependent Hamiltonians. Our method involves expanding the interaction-picture Hamiltonian as a sum of generalized permutations, which leads to an integral-free Dyson series of the time-evolution operator. Under this representation, we perform a quantum simulation for the time-evolution operator by means of the linear combination of unitaries technique. We optimize the time steps of the evolution based on the Hamiltonian's dynamical characteristics, leading to a gate count that scales with an $L^1$-norm-like scaling with respect only to the norm of the interaction Hamiltonian, rather than that of the total Hamiltonian. We demonstrate that the cost of the algorithm is independent of the Hamiltonian's frequencies, implying its advantage for systems with highly oscillating components, and for time-decaying systems the cost does not scale with the total evolution time asymptotically. In addition, our algorithm retains the near optimal $\log(1/\epsilon)/\log\log(1/\epsilon)$ scaling with simulation error $\epsilon$.


title: Changing the Mind of Transformers for Topically-Controllable Language Generation

abstract: Large Transformer-based language models can aid human authors by suggesting plausible continuations of text written so far. However, current interactive writing assistants do not allow authors to guide text generation in desired topical directions. To address this limitation, we design a framework that displays multiple candidate upcoming topics, of which a user can select a subset to guide the generation. Our framework consists of two components: (1) a method that produces a set of candidate topics by predicting the centers of word clusters in the possible continuations, and (2) a text generation model whose output adheres to the chosen topics. The training of both components is self-supervised, using only unlabeled text. Our experiments demonstrate that our topic options are better than those of standard clustering approaches, and our framework often generates fluent sentences related to the chosen topics, as judged by automated metrics and crowdsourced workers.


title: A Lax formulation of a generalized $q$-Garnier system

abstract: Recently, a birational representation of an extended affine Weyl group of type $A_{mn-1}^{(1)}\times A_{m-1}^{(1)}\times A_{m-1}^{(1)}$ was proposed with the aid of a cluster mutation. In this article we formulate this representation in a framework of a system of $q$-difference equations with $mn\times mn$ matrices. This formulation is called a Lax form and is used to derive a generalization of the $q$-Garnier system.


title: The Inverse Problems of some Mathematical Programming Problems

abstract: The non-convex quadratic orogramming problem and the non-monotone linear complementarity problem are NP-complete problems. In this paper we first show taht the inverse problem of determinning a KKT point of the non-convex quadratic programming problem is polynomial. We then show that the inverse problems of non-monotone linear complementarity problem are polynomial solvable in some cases, and in another case is NP-hard. Therefore we solve an open question raised by Heuberger on inverse NP-hard problems and prove that CoNP=NP.


title: Higher order cumulants of transverse momentum and harmonic flow in relativistic heavy ion collisions

abstract: Higher order symmetric cumulants of global collective observables in heavy ion collisions are studied. The symmetric cumulants can be straightforwardly constructed for scalar observables: the average transverse momentum, the multiplicity, and the squares of harmonic flow vectors. Third and fourth order cumulants are calculated in the hydrodynamic model. A linear predictor of the average transverse momentum and harmonic flow coefficients in a collision is used to predict the value of the cumulants from the moments of the initial distribution. The symmetric cumulants divided by the averages (or the standard deviations) of the considered observables can be used as a fine tool to study correlations present in the initial state of the collision.


title: Multi-facet Universal Schema

abstract: Universal schema (USchema) assumes that two sentence patterns that share the same entity pairs are similar to each other. This assumption is widely adopted for solving various types of relation extraction (RE) tasks. Nevertheless, each sentence pattern could contain multiple facets, and not every facet is similar to all the facets of another sentence pattern co-occurring with the same entity pair. To address the violation of the USchema assumption, we propose multi-facet universal schema that uses a neural model to represent each sentence pattern as multiple facet embeddings and encourage one of these facet embeddings to be close to that of another sentence pattern if they co-occur with the same entity pair. In our experiments, we demonstrate that multi-facet embeddings significantly outperform their single-facet embedding counterpart, compositional universal schema (CUSchema) (Verga et al., 2016), in distantly supervised relation extraction tasks. Moreover, we can also use multiple embeddings to detect the entailment relation between two sentence patterns when no manual label is available.


title: Finite-temperature topological phase transitions of spin-$j$ systems in Uhlmann processes: General formalism and experimental protocols

abstract: The Uhlmann process is built on the density matrix of a mixed quantum state and offers a way to characterize topological properties at finite temperatures. We analyze an ideal spin-j quantum paramagnet in a magnetic field undergoing an Uhlmann process and derive general formulae of the Uhlmann phase and Loschmidt amplitude for arbitrary j as the system traverses a great circle in the parameter space. A quantized jump of the Uhlmann phase signifies a topological quantum phase transition (TQPT) of the underlying process, which is accompanied by a zero of the Loschmidt amplitude. The exact results of j=1/2 and j=1 systems show topological regimes that only survive at finite temperatures but not at zero temperature, and the number of TQPTs is associated with the winding number in the parameter space. Our results pave the way for future studies on finite-temperature topological properties, and possible experimental protocols and implications for atomic simulators and digital simulations are discussed.


title: Stiff Neural Ordinary Differential Equations

abstract: Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised from chemical kinetic modeling in chemical and biological systems. We first show the challenges of learning neural ODE in the classical stiff ODE systems of Robertson's problem and propose techniques to mitigate the challenges associated with scale separations in stiff systems. We then present successful demonstrations in stiff systems of Robertson's problem and an air pollution problem. The demonstrations show that the usage of deep networks with rectified activations, proper scaling of the network outputs as well as loss functions, and stabilized gradient calculations are the key techniques enabling the learning of stiff neural ODE. The success of learning stiff neural ODE opens up possibilities of using neural ODEs in applications with widely varying time-scales, like chemical dynamics in energy conversion, environmental engineering, and the life sciences.


title: A bandit-learning approach to multifidelity approximation

abstract: Multifidelity approximation is an important technique in scientific computation and simulation. In this paper, we introduce a bandit-learning approach for leveraging data of varying fidelities to achieve precise estimates of the parameters of interest. Under a linear model assumption, we formulate a multifidelity approximation as a modified stochastic bandit, and analyze the loss for a class of policies that uniformly explore each model before exploiting. Utilizing the estimated conditional mean-squared error, we propose a consistent algorithm, adaptive Explore-Then-Commit (AETC), and establish a corresponding trajectory-wise optimality result. These results are then extended to the case of vector-valued responses, where we demonstrate that the algorithm is efficient without the need to worry about estimating high-dimensional parameters. The main advantage of our approach is that we require neither hierarchical model structure nor \textit{a priori} knowledge of statistical information (e.g., correlations) about or between models. Instead, the AETC algorithm requires only knowledge of which model is a trusted high-fidelity model, along with (relative) computational cost estimates of querying each model. Numerical experiments are provided at the end to support our theoretical findings.


abstract: We present a variational inference (VI) framework that unifies and leverages sequential Monte-Carlo (particle filtering) with \emph{approximate} rejection sampling to construct a flexible family of variational distributions. Furthermore, we augment this approach with a resampling step via Bernoulli race, a generalization of a Bernoulli factory, to obtain a low-variance estimator of the marginal likelihood. Our framework, Variational Rejection Particle Filtering (VRPF), leads to novel variational bounds on the marginal likelihood, which can be optimized efficiently with respect to the variational parameters and generalizes several existing approaches in the VI literature. We also present theoretical properties of the variational bound and demonstrate experiments on various models of sequential data, such as the Gaussian state-space model and variational recurrent neural net (VRNN), on which VRPF outperforms various existing state-of-the-art VI methods.


title: Construction of $A$-$B$ hetero-layer intermetallic crystals: case studies of the 1144-phase TM-phosphides \textit{AB}(TM)$_4$P$_4$ (TM=Fe, Ru, Co, Ni

abstract: The discovery of the 1144-phase, e.g. CaKFe$_4$As$_4$, creates opportunities to build novel intermetallics with alternative stacking of two parent compounds. Here we formalize the idea by defining a class of bulk crystalline solids with $A$-$B$ stacking (including 1144-phases and beyond), which is a generalization of hetero-structures from few-layer or thin-film semi-conductors to bulk intermetallics. Theoretically, four families of phosphides \textit{AB}(TM)$_4$P$_4$ (TM=Fe, Ru, Co, Ni) are investigated by first-principles calculations, wherein configurational, vibrational and electronic degrees of freedom are considered. It predicts a variety of stable 1144-phases (especially Ru- and Fe-phosphides). Stability rules are found and structural/electronic properties are discussed. Experimentally, we synthesize high-purity CaKRu$_4$P$_4$ as a proof of principle example. The synthetic method is simple and easily applied. Moreover, it alludes to a strategy to explore complex multi-component compounds, facilitated by a phase diagram coordinated by collective descriptors.


title: FixNorm: Dissecting Weight Decay for Training Deep Neural Networks

abstract: Weight decay is a widely used technique for training Deep Neural Networks(DNN). It greatly affects generalization performance but the underlying mechanisms are not fully understood. Recent works show that for layers followed by normalizations, weight decay mainly affects the effective learning rate. However, despite normalizations have been extensively adopted in modern DNNs, layers such as the final fully-connected layer do not satisfy this precondition. For these layers, the effects of weight decay are still unclear. In this paper, we comprehensively investigate the mechanisms of weight decay and find that except for influencing effective learning rate, weight decay has another distinct mechanism that is equally important: affecting generalization performance by controlling cross-boundary risk. These two mechanisms together give a more comprehensive explanation for the effects of weight decay. Based on this discovery, we propose a new training method called FixNorm, which discards weight decay and directly controls the two mechanisms. We also propose a simple yet effective method to tune hyperparameters of FixNorm, which can find near-optimal solutions in a few trials. On ImageNet classification task, training EfficientNet-B0 with FixNorm achieves 77.7%, which outperforms the original baseline by a clear margin. Surprisingly, when scaling MobileNetV2 to the same FLOPS and applying the same tricks with EfficientNet-B0, training with FixNorm achieves 77.4%, which is only 0.3% lower. A series of SOTA results show the importance of well-tuned training procedures, and further verify the effectiveness of our approach. We set up more well-tuned baselines using FixNorm, to facilitate fair comparisons in the community.


title: Motion Basis Learning for Unsupervised Deep Homography Estimation with Subspace Projection

abstract: In this paper, we introduce a new framework for unsupervised deep homography estimation. Our contributions are 3 folds. First, unlike previous methods that regress 4 offsets for a homography, we propose a homography flow representation, which can be estimated by a weighted sum of 8 pre-defined homography flow bases. Second, considering a homography contains 8 Degree-of-Freedoms (DOFs) that is much less than the rank of the network features, we propose a Low Rank Representation (LRR) block that reduces the feature rank, so that features corresponding to the dominant motions are retained while others are rejected. Last, we propose a Feature Identity Loss (FIL) to enforce the learned image feature warp-equivariant, meaning that the result should be identical if the order of warp operation and feature extraction is swapped. With this constraint, the unsupervised optimization is achieved more effectively and more stable features are learned. Extensive experiments are conducted to demonstrate the effectiveness of all the newly proposed components, and results show that our approach outperforms the state-of-the-art on the homography benchmark datasets both qualitatively and quantitatively. Code is available at https://github.com/megvii-research/BasesHomo.


title: Local well-posedness for the Zakharov system in dimension $d=2, 3$

abstract: The Zakharov system in dimension $d=2,3$ is shown to have a local unique solution for any initial values in the energy space $H^{s} \times H^{l} \times H^{l-1}$, where the range of regularity $(s, l)$ is extended, especially at $s=l-1$. The result is obtained mainly by the normal form reduction and the Strichartz estimates.


title: LayoutParser: A Unified Toolkit for Deep Learning Based Document Image Analysis

abstract: Recent advances in document image analysis (DIA) have been primarily driven by the application of neural networks. Ideally, research outcomes could be easily deployed in production and extended for further investigation. However, various factors like loosely organized codebases and sophisticated model configurations complicate the easy reuse of important innovations by a wide audience. Though there have been on-going efforts to improve reusability and simplify deep learning (DL) model development in disciplines like natural language processing and computer vision, none of them are optimized for challenges in the domain of DIA. This represents a major gap in the existing toolkit, as DIA is central to academic research across a wide range of disciplines in the social sciences and humanities. This paper introduces layoutparser, an open-source library for streamlining the usage of DL in DIA research and applications. The core layoutparser library comes with a set of simple and intuitive interfaces for applying and customizing DL models for layout detection, character recognition, and many other document processing tasks. To promote extensibility, layoutparser also incorporates a community platform for sharing both pre-trained models and full document digitization pipelines. We demonstrate that layoutparser is helpful for both lightweight and large-scale digitization pipelines in real-word use cases. The library is publicly available at https://layout-parser.github.io/.


title: Refractive Light-Field Features for Curved Transparent Objects in Structure from Motion

abstract: Curved refractive objects are common in the human environment, and have a complex visual appearance that can cause robotic vision algorithms to fail. Light-field cameras allow us to address this challenge by capturing the view-dependent appearance of such objects in a single exposure. We propose a novel image feature for light fields that detects and describes the patterns of light refracted through curved transparent objects. We derive characteristic points based on these features allowing them to be used in place of conventional 2D features. Using our features, we demonstrate improved structure-from-motion performance in challenging scenes containing refractive objects, including quantitative evaluations that show improved camera pose estimates and 3D reconstructions. Additionally, our methods converge 15-35% more frequently than the state-of-the-art. Our method is a critical step towards allowing robots to operate around refractive objects, with applications in manufacturing, quality assurance, pick-and-place, and domestic robots working with acrylic, glass and other transparent materials.


title: Adversarial Specification Mining

abstract: There have been numerous studies on mining temporal specifications from execution traces. These approaches learn finite-state automata (FSA) from execution traces when running tests. To learn accurate specifications of a software system, many tests are required. Existing approaches generalize from a limited number of traces or use simple test generation strategies. Unfortunately, these strategies may not exercise uncommon usage patterns of a software system. To address this problem, we propose a new approach, adversarial specification mining, and develop a prototype, DICE (Diversity through Counter-Examples). DICE has two components: DICE-Tester and DICE-Miner. After mining Linear Temporal Logic specifications from an input test suite, DICE-Tester adversarially guides test generation, searching for counterexamples to these specifications to invalidate spurious properties. These counterexamples represent gaps in the diversity of the input test suite. This process produces execution traces of usage patterns that were unrepresented in the input test suite. Next, we propose a new specification inference algorithm, DICE-Miner, to infer FSAs using the traces, guided by the temporal specifications. We find that the inferred specifications are of higher quality than those produced by existing state-of-the-art specification miners. Finally, we use the FSAs in a fuzzer for servers of stateful protocols, increasing its coverage.


title: Rank Minimization-based Toeplitz Reconstruction for DoA Estimation Using Coprime Array

abstract: In this paper, we address the problem of direction finding using coprime array, which is one of the most preferred sparse array configurations. Motivated by the fact that non-uniform element spacing hinders full utilization of the underlying information in the receive signals, we propose a direction-of-arrival (DoA) estimation algorithm based on low-rank reconstruction of the Toeplitz covariance matrix. The atomic-norm representation of the measurements from the interpolated virtual array is considered, and the equivalent dual-variable rank minimization problem is formulated and solved using a cyclic optimization approach. The recovered covariance matrix enables the application of conventional subspace-based spectral estimation algorithms, such as MUSIC, to achieve enhanced DoA estimation performance. The estimation performance of the proposed approach, in terms of the degrees-of-freedom and spatial resolution, is examined. We also show the superiority of the proposed method over the competitive approaches in the root-mean-square error sense.


title: Private Non-smooth Empirical Risk Minimization and Stochastic Convex Optimization in Subquadratic Steps

abstract: We study the differentially private Empirical Risk Minimization (ERM) and Stochastic Convex Optimization (SCO) problems for non-smooth convex functions. We get a (nearly) optimal bound on the excess empirical risk and excess population loss with subquadratic gradient complexity. More precisely, our differentially private algorithm requires $O(\frac{N^{3/2}}{d^{1/8}}+ \frac{N^2}{d})$ gradient queries for optimal excess empirical risk, which is achieved with the help of subsampling and smoothing the function via convolution. This is the first subquadratic algorithm for the non-smooth case when $d$ is super constant. As a direct application, using the iterative localization approach of Feldman et al. \cite{fkt20}, we achieve the optimal excess population loss for stochastic convex optimization problem, with $O(\min\{N^{5/4}d^{1/8},\frac{ N^{3/2}}{d^{1/8}}\})$ gradient queries. Our work makes progress towards resolving a question raised by Bassily et al. \cite{bfgt20}, giving first algorithms for private ERM and SCO with subquadratic steps. We note that independently Asi et al. \cite{afkt21} gave other algorithms for private ERM and SCO with subquadratic steps.


title: Quantum deleting and cloning in a pseudo-unitary system

abstract: In conventional quantum mechanics, quantum no-deleting and no-cloning theorems indicate that two different and nonorthogonal states cannot be perfectly and deterministically deleted and cloned, respectively. Here, we investigate the quantum deleting and cloning in a pseudo-unitary system. We first present a pseudo-Hermitian Hamiltonian with real eigenvalues in a two-qubit system. By using the pseudo-unitary operators generated from this pseudo-Hermitian Hamiltonian, we show that it is possible to delete and clone a class of two different and nonorthogonal states, and it can be generalized to arbitrary two different and nonorthogonal pure qubit states. Furthermore, state discrimination, which is strongly related to quantum no-cloning theorem, is also discussed. Last but not least, we simulate the pseudo-unitary operators in conventional quantum mechanics with post-selection, and obtain the success probability of simulations. Pseudo-unitary operators are implemented with a limited efficiency due to the post-selections. Thus, the success probabilities of deleting and cloning in the simulation by conventional quantum mechanics are less than unity, which maintain the quantum no-deleting and no-cloning theorems.


title: Towards Robust State Estimation by Boosting the Maximum Correntropy Criterion Kalman Filter with Adaptive Behaviors

abstract: This work proposes a resilient and adaptive state estimation framework for robots operating in perceptually-degraded environments. The approach, called Adaptive Maximum Correntropy Criterion Kalman Filtering (AMCCKF), is inherently robust to corrupted measurements, such as those containing jumps or general non-Gaussian noise, and is able to modify filter parameters online to improve performance. Two separate methods are developed -- the Variational Bayesian AMCCKF (VB-AMCCKF) and Residual AMCCKF (R-AMCCKF) -- that modify the process and measurement noise models in addition to the bandwidth of the kernel function used in MCCKF based on the quality of measurements received. The two approaches differ in computational complexity and overall performance which is experimentally analyzed. The method is demonstrated in real experiments on both aerial and ground robots and is part of the solution used by the COSTAR team participating at the DARPA Subterranean Challenge.


title: Prevalence of Extra Power-Law Spectral Components in Short Gamma-Ray Bursts

abstract: Prompt extra power-law (PL) spectral component is discovered in some bright gamma-ray bursts (GRBs), which usually dominates the spectral energy distribution below tens of keV or above about 10 MeV. However, its origin is still unclear. In this paper, we present a systematic analysis 13 Fermi short GRBs as of August 2020, with the contemporaneous keV-MeV and GeV detections at the prompt emission phase. We find that the extra PL component is a ubiquitous spectral feature for short GRBs, showing up in all 13 analyzed GRBs. The PL indices are mostly harder than -2.0, which may be well reproduced by considering the electromagnetic cascade induced by ultra-relativistic protons or electrons accelerated in the prompt emission phase. The average flux of these extra PL components positively correlates with that of the main spectral components, which implies they may share the same physical origin.


title: Transcription-translation machinery -- an autocatalytic network coupling all cellular cycles and generating a plethora of growth laws

abstract: Recently discovered simple quantitative relations, known as bacterial growth laws, hint on the existence of simple underlying principles at the heart of bacterial growth. In this work, we provide a unifying picture on how these known relations, as well as new relations that we derive, stems from a universal autocatalytic network common to all bacteria, facilitating balanced exponential growth of individual cells. We show that the core of the cellular autocatalytic network is the transcription -- translation machinery -- in itself an autocatalytic network comprising several coupled autocatalytic cycles, including the ribosome, RNA polymerase, and tRNA charging cycles. We derive two types of growth laws per autocatalytic cycle, one relating growth rate to the relative fraction of the catalyst and its catalysis rate, and the other relating growth rate to all the time scales in the cycle. The structure of the autocatalytic network generates numerous regimes in state space, determined by the limiting components, while the number of growth laws can be much smaller. We also derive a growth law that accounts for the RNA polymerase autocatalytic cycle, which we use to explain how growth rate depends on the inducible expression of the rpoB and rpoC genes, which code for the RpoB and C protein subunits of RNA polymerase, and how the concentration of rifampicin, which targets RNA polymerase, affects growth rate without changing the RNA-to-protein ratio. We derive growth laws for tRNA synthesis and charging, and predict how growth rate depends on temperature, perturbation to ribosome assembly, and membrane synthesis.


title: Hybrid Beamforming Optimization for DOA Estimation Based on the CRB Analysis

abstract: Direction-of-arrival (DOA) estimation is one of the most demanding tasks for the millimeter wave (mmWave) communication of massive multiple-input multiple-output (MIMO) systems with the hybrid beamforming (HBF) architecture. In this paper, we focus on the optimization of the HBF matrix for receiving pilots to enhance the DOA estimation performance. Motivated by the fact that many existing DOA estimation algorithms can achieve the Cram\'{e}r-Rao bound (CRB), we formulate the HBF optimization problem aiming at minimizing the CRB with the prior knowledge of the rough DOA range. Then, to tackle the problem with intractable non-convex constraint introduced by the analog beamformers, we propose an efficient manifold optimization (MO) based algorithm. Simulation results demonstrate the significant improvement of the proposed CRB-MO algorithm over the conventional random HBF algorithm, and provide insights for the HBF design in the beam training stage for practical applications.


title: Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding

abstract: This paper presents a new Vision Transformer (ViT) architecture Multi-Scale Vision Longformer, which significantly enhances the ViT of \cite{dosovitskiy2020image} for encoding high-resolution images using two techniques. The first is the multi-scale model structure, which provides image encodings at multiple scales with manageable computational cost. The second is the attention mechanism of vision Longformer, which is a variant of Longformer \cite{beltagy2020longformer}, originally developed for natural language processing, and achieves a linear complexity w.r.t. the number of input tokens. A comprehensive empirical study shows that the new ViT significantly outperforms several strong baselines, including the existing ViT models and their ResNet counterparts, and the Pyramid Vision Transformer from a concurrent work \cite{wang2021pyramid}, on a range of vision tasks, including image classification, object detection, and segmentation. The models and source code are released at \url{https://github.com/microsoft/vision-longformer}.


title: Anyonic-parity-time symmetry in complex-coupled lasers

abstract: Non-Hermitian Hamiltonians, and particularly parity-time (PT) and anti-PT symmetric Hamiltonians, play an important role in many branches of physics, from quantum mechanics to optical systems and acoustics. Both the PT and anti-PT symmetries are specific instances of a broader class known as anyonic-PT symmetry, where the Hamiltonian and the PT operator satisfy a generalized commutation relation. Here, we study theoretically these novel symmetries and demonstrate them experimentally in coupled lasers systems. We resort to complex coupling of mixed dispersive and dissipative nature, which allows unprecedented control on the location in parameter space where the symmetry and symmetry-breaking occur. Moreover, tuning the coupling in the same physical system, allows us to realize the special cases of PT and anti-PT symmetries. In a more general perspective, we present and experimentally validate a new relation between laser synchronization and the symmetry of the underlying non-Hermitian Hamiltonian.


title: Sharp quantitative estimates of Struwe's Decomposition

abstract: Suppose $u\in \dot{H}^1(\mathbb{R}^n)$. In a seminal work, Struwe proved that if $u\geq 0$ and $\|\Delta u+u^{\frac{n+2}{n-2}}\|_{H^{-1}}:=\Gamma(u)\to 0$ then $dist(u,\mathcal{T})\to 0$, where $dist(u,\mathcal{T})$ denotes the $\dot{H}^1(\mathbb{R}^n)$-distance of $u$ from the manifold of sums of Talenti bubbles. Ciraolo, Figalli and Maggi obtained the first quantitative version of Struwe's decomposition with one bubble in all dimensions, namely $\delta (u) \leq C \Gamma (u)$. For Struwe's decomposition with two or more bubbles, Figalli and Glaudo showed a striking dimensional dependent quantitative estimate, namely $\delta(u)\leq C \Gamma(u)$ when $3\leq n\leq 5$ while this is false for $ n\geq 6$. In this paper, we show that \[dist (u,\mathcal{T})\leq C\begin{cases} \Gamma(u)\left|\log \Gamma(u)\right|^{\frac{1}{2}}\quad&\text{if }n=6, |\Gamma(u)|^{\frac{n+2}{2(n-2)}}\quad&\text{if }n\geq 7.\end{cases}\] Furthermore, we show that this inequality is sharp.


title: Embedding API Dependency Graph for Neural Code Generation

abstract: The problem of code generation from textual program descriptions has long been viewed as a grand challenge in software engineering. In recent years, many deep learning based approaches have been proposed, which can generate a sequence of code from a sequence of textual program description. However, the existing approaches ignore the global relationships among API methods, which are important for understanding the usage of APIs. In this paper, we propose to model the dependencies among API methods as an API dependency graph (ADG) and incorporate the graph embedding into a sequence-to-sequence (Seq2Seq) model. In addition to the existing encoder-decoder structure, a new module named ``embedder" is introduced. In this way, the decoder can utilize both global structural dependencies and textual program description to predict the target code. We conduct extensive code generation experiments on three public datasets and in two programming languages (Python and Java). Our proposed approach, called ADG-Seq2Seq, yields significant improvements over existing state-of-the-art methods and maintains its performance as the length of the target code increases. Extensive ablation tests show that the proposed ADG embedding is effective and outperforms the baselines.


title: Self-triggered Stabilization of Discrete-time Linear Systems with Quantized State Measurements

abstract: We study the self-triggered stabilization of discrete-time linear systems with quantized state measurements. In the networked control system we consider, sensors may be spatially distributed and be connected to a self-triggering mechanism through finite data-rate channels. Each sensor independently encodes its measurements and sends them to the self-triggering mechanism. The self-triggering mechanism integrates quantized measurement data and then computes sampling times. Assuming that the closed-loop system is stable in the absence of quantization and self-triggered sampling, we propose a joint design method of an encoding scheme and a self-triggering mechanism for stabilization. To deal with data inaccuracy due to quantization, the proposed self-triggering mechanism uses not only quantized data but also an upper bound of quantization errors, which is shared with a decoder.


title: Infinite-horizon Risk-constrained Linear Quadratic Regulator with Average Cost

abstract: The behaviour of a stochastic dynamical system may be largely influenced by those low-probability, yet extreme events. To address such occurrences, this paper proposes an infinite-horizon risk-constrained Linear Quadratic Regulator (LQR) framework with time-average cost. In addition to the standard LQR objective, the average one-stage predictive variance of the state penalty is constrained to lie within a user-specified level. By leveraging the duality, its optimal solution is first shown to be stationary and affine in the state, i.e., $u(x,\lambda^*) = -K(\lambda^*)x + l(\lambda^*)$, where $\lambda^*$ is an optimal multiplier, used to address the risk constraint. Then, we establish the stability of the resulting closed-loop system. Furthermore, we propose a primal-dual method with sublinear convergence rate to find an optimal policy $u(x,\lambda^*)$. Finally, a numerical example is provided to demonstrate the effectiveness of the proposed framework and the primal-dual method.


title: Electrical conductivity of strongly magnetized dense quark matter -- possibility of quantum hall effect

abstract: We have pointed out the possibility of quantum Hall effect or quantum patterns of transportation in a degenerate strongly magnetized quark matter, which might be expected inside a highly dense compact star. An anisotropic pattern of electrical conductivity and resistivity tensor in classical and quantum cases is explored by considering cyclotron motion and Landau quantization respectively. With increasing magnetic field, classical to quantum transitions are realized through enhanced/reduced resistivity/conductivity with jumping pattern. Considering QCD relaxation time scale of 10 fm, $eB\approx (1-4) m_\pi^2$ might be considered as strong magnetic field for massless and degenerate quark matter with quark chemical potential $\mu\approx 0.2-0.4$ GeV. Beyond these threshold ranges of magnetic field, perpendicular motion of quarks might be stopped and 3 $\rightarrow$ 1 dimensionally reduced conduction picture might be established.


title: Visual Distant Supervision for Scene Graph Generation

abstract: Scene graph generation aims to identify objects and their relations in images, providing structured image representations that can facilitate numerous applications in computer vision. However, scene graph models usually require supervised learning on large quantities of labeled data with intensive human annotation. In this work, we propose visual distant supervision, a novel paradigm of visual relation learning, which can train scene graph models without any human-labeled data. The intuition is that by aligning commonsense knowledge bases and images, we can automatically create large-scale labeled data to provide distant supervision for visual relation learning. To alleviate the noise in distantly labeled data, we further propose a framework that iteratively estimates the probabilistic relation labels and eliminates the noisy ones. Comprehensive experimental results show that our distantly supervised model outperforms strong weakly supervised and semi-supervised baselines. By further incorporating human-labeled data in a semi-supervised fashion, our model outperforms state-of-the-art fully supervised models by a large margin (e.g., 8.3 micro- and 7.8 macro-recall@50 improvements for predicate classification in Visual Genome evaluation). We make the data and code for this paper publicly available at https://github.com/thunlp/VisualDS.


title: Photonic spin lattices: symmetry constraints for skyrmion and meron topologies

abstract: Symmetry governs many electronic and photonic phenomena in optics and condensed matter physics. Skyrmions and merons are prominent topological structures in magnetic materials, with the topological features determined by the interplay between anisotropy of a material and its magnetization. Here we theoretically show and experimentally demonstrate that the symmetry of the electromagnetic field determines the spin topological properties of the guided modes via spin-orbit coupling and may only result in either hexagonal spin-skyrmion or square spin-meron lattices. We also show that in the absence of spin-orbit coupling these spin topologies are degenerated in dynamic field-skyrmions, unifying description of electromagnetic field topologies. The results provide new understanding of electromagnetic field topology and its transformations as well as new opportunities for applications in quantum optics, spin-optics and topological photonics.


title: Joint User Association and Power Allocation in Heterogeneous Ultra Dense Network via Semi-Supervised Representation Learning

abstract: Heterogeneous Ultra-Dense Network (HUDN) is one of the vital networking architectures due to its ability to enable higher connectivity density and ultra-high data rates. Rational user association and power control schedule in HUDN can reduce wireless interference. This paper proposes a novel idea for resolving the joint user association and power control problem: the optimal user association and Base Station transmit power can be represented by channel information. Then, we solve this problem by formulating an optimal representation function. We model the HUDNs as a heterogeneous graph and train a Graph Neural Network (GNN) to approach this representation function by using semi-supervised learning, in which the loss function is composed of the unsupervised part that helps the GNN approach the optimal representation function and the supervised part that utilizes the previous experience to reduce useless exploration. We separate the learning process into two parts, the generalization-representation learning (GRL) part and the specialization-representation learning (SRL) part, which train the GNN for learning representation for generalized scenario quasi-static user distribution scenario, respectively. Simulation results demonstrate that the proposed GRL-based solution has higher computational efficiency than the traditional optimization algorithm, and the performance of SRL outperforms the GRL.


title: Attention-guided Image Compression by Deep Reconstruction of Compressive Sensed Saliency Skeleton

abstract: We propose a deep learning system for attention-guided dual-layer image compression (AGDL). In the AGDL compression system, an image is encoded into two layers, a base layer and an attention-guided refinement layer. Unlike the existing ROI image compression methods that spend an extra bit budget equally on all pixels in ROI, AGDL employs a CNN module to predict those pixels on and near a saliency sketch within ROI that are critical to perceptual quality. Only the critical pixels are further sampled by compressive sensing (CS) to form a very compact refinement layer. Another novel CNN method is developed to jointly decode the two compression layers for a much refined reconstruction, while strictly satisfying the transmitted CS constraints on perceptually critical pixels. Extensive experiments demonstrate that the proposed AGDL system advances the state of the art in perception-aware image compression.


title: Contextual Scene Augmentation and Synthesis via GSACNet

abstract: Indoor scene augmentation has become an emerging topic in the field of computer vision and graphics with applications in augmented and virtual reality. However, current state-of-the-art systems using deep neural networks require large datasets for training. In this paper we introduce GSACNet, a contextual scene augmentation system that can be trained with limited scene priors. GSACNet utilizes a novel parametric data augmentation method combined with a Graph Attention and Siamese network architecture followed by an Autoencoder network to facilitate training with small datasets. We show the effectiveness of our proposed system by conducting ablation and comparative studies with alternative systems on the Matterport3D dataset. Our results indicate that our scene augmentation outperforms prior art in scene synthesis with limited scene priors available.


title: Robust Reinforcement Learning under model misspecification

abstract: Reinforcement learning has achieved remarkable performance in a wide range of tasks these days. Nevertheless, some unsolved problems limit its applications in real-world control. One of them is model misspecification, a situation where an agent is trained and deployed in environments with different transition dynamics. We propose an novel framework that utilize history trajectory and Partial Observable Markov Decision Process Modeling to deal with this dilemma. Additionally, we put forward an efficient adversarial attack method to assist robust training. Our experiments in four gym domains validate the effectiveness of our framework.


title: Joint Resource Management for MC-NOMA: A Deep Reinforcement Learning Approach

abstract: This paper presents a novel and effective deep reinforcement learning (DRL)-based approach to addressing joint resource management (JRM) in a practical multi-carrier non-orthogonal multiple access (MC-NOMA) system, where hardware sensitivity and imperfect successive interference cancellation (SIC) are considered. We first formulate the JRM problem to maximize the weighted-sum system throughput. Then, the JRM problem is decoupled into two iterative subtasks: subcarrier assignment (SA, including user grouping) and power allocation (PA). Each subtask is a sequential decision process. Invoking a deep deterministic policy gradient algorithm, our proposed DRL-based JRM (DRL-JRM) approach jointly performs the two subtasks, where the optimization objective and constraints of the subtasks are addressed by a new joint reward and internal reward mechanism. A multi-agent structure and a convolutional neural network are adopted to reduce the complexity of the PA subtask. We also tailor the neural network structure for the stability and convergence of DRL-JRM. Corroborated by extensive experiments, the proposed DRL-JRM scheme is superior to existing alternatives in terms of system throughput and resistance to interference, especially in the presence of many users and strong inter-cell interference. DRL-JRM can flexibly meet individual service requirements of users.


title: Sobolev space theory and H\"older estimates for the stochastic partial differential equations on conic and polygonal domains

abstract: We establish existence, uniqueness, and Sobolev and H\"older regularity results for the stochastic partial differential equation $$ du=\left(\sum_{i,j=1}^d a^{ij}u_{x^ix^j}+f^0+\sum_{i=1}^d f^i_{x^i}\right)dt+\sum_{k=1}^{\infty}g^kdw^k_t, \quad t>0, \,x\in \mathcal{D} $$ given with non-zero initial data. Here $\{w^k_t: k=1,2,\cdots\}$ is a family of independent Wiener processes defined on a probability space $(\Omega, \mathbb{P})$, $a^{ij}=a^{ij}(\omega,t)$ are merely measurable functions on $\Omega\times (0,\infty)$, and $\mathcal{D}$ is either a polygonal domain in $\mathbb{R}^2$ or an arbitrary dimensional conic domain of the type \begin{equation} \label{conic} \mathcal{D}(\mathcal{M}):=\left\{x\in \mathbb{R}^d :\,\frac{x}{|x|}\in \mathcal{M}\right\}, \quad \quad \mathcal{M}\in S^{d-1}, \quad (d\geq 2) \end{equation} where $\mathcal{M}$ is an open subset of $S^{d-1}$ with $C^2$ boundary. We measure the Sobolev and H\"older regularities of arbitrary order derivatives of the solution using a system of mixed weights consisting of appropriate powers of the distance to the vertices and of the distance to the boundary. The ranges of admissible powers of the distance to the vertices and to the boundary are sharp.


title: Large and infinite order solitons of the coupled nonlinear Schr\"odinger equation

abstract: We study the large order and infinite order soliton of the coupled nonlinear Schrodinger equation with the Riemann-Hilbert method. By using the Riemann-Hilbert representation for the high order Darboux dressing matrix, the large order and infinite order solitons can be analyzed directly without using inverse scattering transform. We firstly disclose the asymptotics for large order soliton, which is divided into four different regions -- the elliptic function region, the non-oscillatory region, the exponential and algebraic decay region. We verify the consistence between asymptotic expression and exact solutions by the Darboux dressing method numerically. Moreover, we consider the property and dynamics for infinite order solitons -- a special limitation for the larger order soliton. It is shown that the elliptic function and exponential region will disappear for the infinite order solitons.


title: Lifelong Learning for Minimizing Age of Information in Internet of Things Networks

abstract: In this paper, a lifelong learning problem is studied for an Internet of Things (IoT) system. In the considered model, each IoT device aims to balance its information freshness and energy consumption tradeoff by controlling its computational resource allocation at each time slot under dynamic environments. An unmanned aerial vehicle (UAV) is deployed as a flying base station so as to enable the IoT devices to adapt to novel environments. To this end, a new lifelong reinforcement learning algorithm, used by the UAV, is proposed in order to adapt the operation of the devices at each visit by the UAV. By using the experience from previously visited devices and environments, the UAV can help devices adapt faster to future states of their environment. To do so, a knowledge base shared by all devices is maintained at the UAV. Simulation results show that the proposed algorithm can converge $25\%$ to $50\%$ faster than a policy gradient baseline algorithm that optimizes each device's decision making problem in isolation.


title: AlignMixup: Improving Representations By Interpolating Aligned Features

abstract: Mixup is a powerful data augmentation method that interpolates between two or more examples in the input or feature space and between the corresponding target labels. Many recent mixup methods focus on cutting and pasting two or more objects into one image, which is more about efficient processing than interpolation. However, how to best interpolate images is not well defined. In this sense, mixup has been connected to autoencoders, because often autoencoders "interpolate well", for instance generating an image that continuously deforms into another. In this work, we revisit mixup from the interpolation perspective and introduce AlignMix, where we geometrically align two images in the feature space. The correspondences allow us to interpolate between two sets of features, while keeping the locations of one set. Interestingly, this gives rise to a situation where mixup retains mostly the geometry or pose of one image and the texture of the other, connecting it to style transfer. More than that, we show that an autoencoder can still improve representation learning under mixup, without the classifier ever seeing decoded images. AlignMix outperforms state-of-the-art mixup methods on five different benchmarks.


title: Analysis of contact Cauchy-Riemann maps III: energy, bubbling and Fredholm theory

abstract: In [OW2,OW3], the authors studied the nonlinear elliptic system $$ \overline{\partial}^\pi w = 0, \, d(w^*\lambda \circ j) = 0 $$ without involving symplectization for each given contact triad $(Q,\lambda, J)$, and established the a priori $W^{k,2}$ elliptic estimates and proved the asymptotic (subsequence) convergence of the map $w: \dot \Sigma \to Q$ for any solution, called a contact instanton, on $\dot \Sigma$ under the hypothesis $\|w^*\lambda\|_{C^0} < \infty$ and $d^\pi w \in L^2 \cap L^4$. The asymptotic limit of a contact instanton is a `spiraling' instanton along a `rotating' Reeb orbit near each puncture on a punctured Riemann surface $\dot \Sigma$. Each limiting Reeb orbit carries a `charge' arising from the integral of $w^*\lambda \circ j$. In this article, we further develop analysis of contact instantons, especially the $W^{1,p}$ estimate for $p > 2$ (or the $C^1$-estimate), which is essential for the study of compactfication of the moduli space and the relevant Fredholm theory for contact instantons. In particular, we define a Hofer-type off-shell energy $E^\lambda(j,w)$ for any pair $(j,w)$ with a smooth map $w$ satisfying $d(w^*\lambda \circ j) = 0$, and develop the bubbling-off analysis and prove an $\epsilon$-regularity result. We also develop the relevant Fredholm theory and carry out index calculations (for the case of vanishing charge).


title: Importance of van der Waals interactions in hydrogen adsorption on a silicon-carbide nanotube revisited with vdW-DFT and quantum Monte Carlo

abstract: DFT is a valuable tool for calculating adsorption energies toward designing materials for hydrogen storage. However, dispersion forces being absent from the theory, it remains unclear how the consideration of van der Waals (vdW) interactions affects such calculations. For the first time, we applied diffusion Monte Carlo (DMC) to evaluate the adsorption characteristics of a hydrogen molecule on a (5,5) armchair silicon-carbide nanotube (H$_2$-SiCNT). Within the framework of density functional theory (DFT), we also benchmarked various exchange-correlation functionals, including those recently developed for treating dispersion or vdW interactions. We found that the vdW-corrected DFT methods agree well with DMC, whereas the local (semilocal) functional significantly over (under)-binds. Furthermore, we fully optimized the H$_2$-SiCNT geometry within the DFT framework and investigated the correlation between structure and charge density. The vdW contribution to adsorption was found to be non-negligible at approximately 1 kcal/mol per hydrogen molecule, which amounts to 9-29 % of the ideal adsorption energy required for hydrogen storage applications.


title: Bilayer graphene encapsulated within monolayers of WS$_2$ or Cr$_2$Ge$_2$Te$_6$: Tunable proximity spin-orbit or exchange coupling

abstract: Van der Waals (vdW) heterostructures consisting of bilayer graphene (BLG) encapsulated within monolayers of strong spin-orbit semiconductor WS$_2$ or ferromagnetic semiconductor Cr$_2$Ge$_2$Te$_6$ (CGT), are investigated. By performing realistic first-principles calculations we capture the essential BLG band structure features, including layer- and sublattice-resolved proximity spin-orbit or exchange couplings. For different relative twist angles (0 or 60$^{\circ}$) of the WS$_2$ layers, and the magnetizations (parallel or antiparallel) of the CGT layers, with respect to BLG, the low energy bands are found and characterized by a series of fit parameters of model Hamiltonians. These effective models are then employed to investigate the tunability of the relevant energy dispersions by a gate field. For WS$_2$/BLG/WS$_2$ encapsulation we find that twisting allows to turn off the spin splittings away from the $K$ points, due to opposite proximity-induced valley-Zeeman couplings in the two sheets of BLG. Close to the $K$ points the electron spins are polarized out of the plane. This polarization can be flipped by applying a gate field. As for magnetic CGT/BLG/CGT structures, we realize the recently proposed spin-valve effect, whereby a gap opens for antiparallel magnetizations of the CGT layers. Furthermore, we find that for the antiferromagnetic orientation the electron states away from $K$ have vanishingly weak proximity exchange, while the states close to $K$ remain spin polarized in the presence of an electric field. The induced magnetization can be flipped by changing the gate field. These findings should be useful for spin transport, spin filtering, and spin relaxation anisotropy studies of BLG-based vdW heterostructures.


title: A Novel Conversion Technique from Nodal to Edge Finite Element Data Structure for Electromagnetic Analysis

abstract: Standard nodal finite elements in electromagnetic analysis have well-known limitation of occurrence of spurious solution. In order to circumvent the problem, a penalty function method or a regularization method is used with potential formulation. These methods solve the problem partially by pushing the spurious mode to the higher end of the spectrum. But it fails to capture singular eigenvalues in case of the problem domains with sharp edges and corners. To circumvent this limitation, edge elements have been developed for electromagnetic analysis where degree of freedoms are along the edges. But most of the preprocessors develop complex meshes in nodal framework. In this work, we have developed a novel technique to convert nodal data structure to edge data structure for electromagnetic analysis. We have explained the conversion algorithm in details, mentioning associated complexities with relevant examples. The performance of the developed algorithm has been demonstrated extensively with several examples.


title: Classification of the d-representation-finite trivial extensions of quiver algebras

abstract: We give a complete classification of all d-representation-finite symmetric Nakayama algebras, and of all d-representation-finite trivial extensions of path algebras of quivers, over an arbitrary field.


title: Computing Coordinated Motion Plans for Robot Swarms: The CG:SHOP Challenge 2021

abstract: We give an overview of the 2021 Computational Geometry Challenge, which targeted the problem of optimally coordinating a set of robots by computing a family of collision-free trajectories for a set set S of n pixel-shaped objects from a given start configuration into a desired target configuration.


title: Willmore obstacle problems under Dirichlet boundary conditions

abstract: We consider obstacle problems for the Willmore functional in the class of graphs of functions and surfaces of revolution with Dirichlet boundary conditions. We prove the existence of minimisers of the obstacle problems under the assumption that the Willmore energy with the unilateral constraint is below a universal bound. We address the question whether such bounds are necessary in order to ensure the solvability of the obstacle problems. Moreover, we give several instructive examples of obstacles such that minimisers exist.


title: Selective Output Smoothing Regularization: Regularize Neural Networks by Softening Output Distributions

abstract: In this paper, we propose Selective Output Smoothing Regularization, a novel regularization method for training the Convolutional Neural Networks (CNNs). Inspired by the diverse effects on training from different samples, Selective Output Smoothing Regularization improves the performance by encouraging the model to produce equal logits on incorrect classes when dealing with samples that the model classifies correctly and over-confidently. This plug-and-play regularization method can be conveniently incorporated into almost any CNN-based project without extra hassle. Extensive experiments have shown that Selective Output Smoothing Regularization consistently achieves significant improvement in image classification benchmarks, such as CIFAR-100, Tiny ImageNet, ImageNet, and CUB-200-2011. Particularly, our method obtains 77.30% accuracy on ImageNet with ResNet-50, which gains 1.1% than baseline (76.2%). We also empirically demonstrate the ability of our method to make further improvements when combining with other widely used regularization techniques. On Pascal detection, using the SOSR-trained ImageNet classifier as the pretrained model leads to better detection performances.


title: Fermi-LAT detection of GeV $\gamma$-ray emission from Type Ia supernova remnant G272.2-3.2

abstract: A new $\gamma$-ray source with a significance level of approximately 5$\sigma$ was reported in the region of SNR G272.2-3.2, analysing the approximately 12.4 years of observation data from the Fermi Large Area Telescope (Fermi-LAT). Its $\gamma$-ray spatial distribution did not show extended feature, and it had a soft spectrum with the spectral index of 2.56$\pm$0.01 of a power-law model. No significant variability of its light curve (LC) with 10 time bins was identified, and its spatial positions in the X-ray and GeV bands overlapped. We suggest that the new $\gamma$-ray source is a likely counterpart of SNR G272.2-3.2. Analysing its spectrum, we discussed the likely origins of the $\gamma$-ray emission.


title: Lagrangian Objective Function Leads to Improved Unforeseen Attack Generalization in Adversarial Training

abstract: Recent improvements in deep learning models and their practical applications have raised concerns about the robustness of these models against adversarial examples. Adversarial training (AT) has been shown effective to reach a robust model against the attack that is used during training. However, it usually fails against other attacks, i.e. the model overfits to the training attack scheme. In this paper, we propose a simple modification to the AT that mitigates the mentioned issue. More specifically, we minimize the perturbation $\ell_p$ norm while maximizing the classification loss in the Lagrangian form. We argue that crafting adversarial examples based on this scheme results in enhanced attack generalization in the learned model. We compare our final model robust accuracy against attacks that were not used during training to closely related state-of-the-art AT methods. This comparison demonstrates that our average robust accuracy against unseen attacks is 5.9% higher in the CIFAR-10 dataset and is 3.2% higher in the ImageNet-100 dataset than corresponding state-of-the-art methods. We also demonstrate that our attack is faster than other attack schemes that are designed for unseen attack generalization, and conclude that it is feasible for large-scale datasets.


title: Large-Scale Approximate k-NN Graph Construction on GPU

abstract: k-nearest neighbor graph is a key data structure in many disciplines such as manifold learning, machine learning and information retrieval, etc. NN-Descent was proposed as an effective solution for the graph construction problem. However, it cannot be directly transplanted to GPU due to the intensive memory accesses required in the approach. In this paper, NN-Descent has been redesigned to adapt to the GPU architecture. In particular, the number of memory accesses has been reduced significantly. The redesign fully exploits the parallelism of the GPU hardware. In the meantime, the genericness as well as the simplicity of NN-Descent are well-preserved. In addition, a simple but effective k-NN graph merge approach is presented. It allows two graphs to be merged efficiently on GPUs. More importantly, it makes the construction of high-quality k-NN graphs for out-of-GPU-memory datasets tractable. The results show that our approach is 100-250x faster than single-thread NN-Descent and is 2.5-5x faster than existing GPU-based approaches.


title: Scaling of the elastic energy of small balls for maps between manifolds with different curvature tensors

abstract: Motivated by experiments and formal asymptotic expansions in the physics literature, Maor and Shachar (J. Elasticity 134 (2019), 149-173) studied the behaviour of a model elastic energy of maps between manifolds with incompatible metrics. For thin objects they analysed the scaling of the minimal elastic energy as a function of the thickness. In particular they showed that for maps from a ball of radius h in an oriented Riemannian manifold to Euclidean space, the infimum of a model elastic energy per unit volume scales like the fourth power of h and after rescaling one gets convergence to a quadratic expression in the curvature tensor R(p), where p denotes the centre of the ball. In this paper we show the same result for general compact oriented Riemannian targets with R(p) replaced by a suitable difference of the curvature tensors in the target and the domain, thus answering Open Question 1 in the paper by Maor and Shachar. The result extends noncompact targets provided they satisfy a uniform regularity condition. A key idea in the proof is to use Lipschitz approximations to define a suitable notion of convergence.


title: Distributionally Robust Trajectory Optimization Under Uncertain Dynamics via Relative Entropy Trust-Regions

abstract: Trajectory optimization and model predictive control are essential techniques underpinning advanced robotic applications, ranging from autonomous driving to full-body humanoid control. State-of-the-art algorithms have focused on data-driven approaches that infer the system dynamics online and incorporate posterior uncertainty during planning and control. Despite their success, such approaches are still susceptible to catastrophic errors that may arise due to statistical learning biases, unmodeled disturbances, or even directed adversarial attacks. In this paper, we tackle the problem of dynamics mismatch and propose a distributionally robust optimal control formulation that alternates between two relative entropy trust-region optimization problems. Our method finds the worst-case maximum entropy Gaussian posterior over the dynamics parameters and the corresponding robust policy. Furthermore, we show that our approach admits a closed-form backward-pass for a certain class of systems. Finally, we demonstrate the resulting robustness on linear and nonlinear numerical examples.


title: Measurement of the very rare $K^+\rightarrow\pi^+\nu\bar{\nu}$ decay

abstract: The NA62 experiment reports the branching ratio measurement BR$(K^+ \rightarrow \pi^+ \nu\bar{\nu}) = (10.6^{+4.0}_{-3.4} |_{\rm stat} \pm 0.9_{\rm syst}) \times 10 ^{-11}$ at 68% CL, based on the observation of 20 signal candidates with an expected background of 7.0 events from the total data sample collected at the CERN SPS during 2016-2018. This provides evidence for the very rare $K^+ \rightarrow \pi^+ \nu\bar{\nu}$ decay, observed with a significance of 3.4$\sigma$. The experiment achieves a single event sensitivity of $(0.839\pm 0.054)\times 10^{-11}$, corresponding to 10.0 events assuming the Standard Model branching ratio of $(8.4\pm1.0)\times10^{-11}$. This measurement is also used to set limits on BR($K^+ \to \pi^+ X$), where $X$ is a scalar or pseudo-scalar particle. Details are given of the analysis of the 2018 data sample, which corresponds to about 80% of the total data sample.


title: Contact Hamiltonian dynamics and perturbed contact instantons with Legendrian boundary condition

abstract: This is the first of a series of papers in preparation in which we study the Hamiltonian perturbed contact instantons with Legendrian boundary condition and its applications. In this paper, we prove that the asymptotic charge of contact instantons at the punctures under the Legendrian boundary condition vanishes, which eliminates the phenomenon of the appearance of `spiraling cusp instanton along a Reeb core'. This removes the only remaining obstacle towards the compactification and the Fredholm theory of the moduli space of contact instantons in the open string case, which plagues the closed string case. We also extend the a priori elliptic coercive estimates for the contact instantons with boundary, and prove an asymptotic exponential $C^\infty$-convergence result at a puncture under the uniform $C^1$ bound. In a sequel to the present paper, we study the $C^1$ estimates by defining a proper notion of energy for the contact instantons, and develop a Fredholm theory and construct a Gromov-type compactification of the moduli space of contact instantons with Legendrian boundary condition and of finite energy, and apply them to problems in contact topology and dynamics.


title: On the role of boundary conditions within Ho\v{r}ava-Lifshitz gravity

abstract: On a class of four-dimensional Lifshitz spacetimes with critical exponent $z=2$, including a hyperbolic and a spherical Lifshitz topological black hole, we consider a real Klein-Gordon field. Using a mode-decomposition, we split the equation of motion into a radial and into an angular component. As first step, we discuss under which conditions on the underlying parameters, we can impose to the radial equation boundary conditions of Robin type and whether bound state solutions do occur. Subsequently, we show that, whenever bound states are absent, one can associate to each admissible boundary condition a ground and a KMS state whose associated two-point correlation function is of local Hadamard form.


title: Synthesis of Three-Dimensionally Interconnected Hexagonal Boron Nitride Networked Cu-Ni Composite

abstract: A three-dimensionally interconnected hexagonal boron nitride (3Di-hBN) networked Cu-Ni (3Di-hBN-Cu-Ni) composite was successfully synthesized in situ using a simple two-step process which involved the compaction of mixed Cu-Ni powders (70 wt.% Cu and 30 wt.% Ni) into a disc followed by metal-organic chemical vapor deposition (MOCVD) process at 1000{\deg}C. During MOCVD, the Cu-Ni alloy grains acted as a template for the growth of hexagonal boron nitride (hBN) while decaborane and ammonia were used as precursors for boron and nitrogen, respectively. Boron and nitrogen atoms diffused into the Cu-Ni solution during the MOCVD process, precipitated out and grew along the Cu-Ni interfaces upon cooling. It was demonstrated that pores were generated during the sintering process and then filled by bulk hBN during the MOCVD process (indicated by energy dispersive spectroscopy) as the pores also served as catalytic sites for the nucleation and growth of hBN. Optical microscopy examination indicated that there was a minimum amount of bulk hBN at certain compaction pressure (280 MPa) and sintering time (30 min). Scanning electron microscopy and transmission electron microscopy revealed that the interconnected network of hBN layers surrounding the Cu-Ni grains was developed in the 3Di-hBN-Cu-Ni composite. This 3Di-hBN network is expected to enhance the resistance of the 3Di-hBN-Cu-Ni composite against mechanical, thermal and chemical attacks. Moreover, foam-like 3Di-hBN was extracted from 3Di-hBN-Cu-Ni composite which could be further applied in the fields of biomedicine and energy storage.


title: Dark Energy Stars with Phantom Field

abstract: Dark energy is the constituent with an enormous abundance of the present universe, responsible for the universe's accelerated expansion. Therefore, it is plausible that dark energy may interact within any compact astrophysical objects. The author in Ref. [Phys. Rev. D 83, 127501 (2011)], constructs an exact star solution consisting of an ordinary matter and phantom field from a constant density star (CDS) known as Schwarzschild interior solution. The star denotes a dark energy star (DES). The author claims that the phantom field represents dark energy within the star. So far, the role of the phantom field as dark energy in DES is not systematically studied yet. Related to this issue, we analyze the energy condition of DES. We expect that DES shall violate the strong energy condition (SEC) for a particular condition. We discover that SEC is fully violated only when the compactness reaches the Buchdahl limit. Furthermore, we also investigate the causal conditions and stabilities due to the convective motion and gravitational cracking. We also find that those conditions are violated. These results indicate that DES is not physically stable. However, we may consider DES as an ultra-compact object of which we can calculate the gravitational wave echo time and echo frequency and compare them to those of CDS. We find that the contribution of the phantom field delays the gravitational wave echoes. The effective potential of the perturbed DES is also studied. The potential also enjoys a potential well like CDS but with a deeper well. We also investigate the possibility that DES could form a gravastar when $ C=1 $. It is found that gravastar produced from DES possesses no singularity with a dS-like phase as the interior. These results could open more opportunities for the observational study of dark energy in the near future, mostly from the compact astrophysical objects.


title: Directional tests in Gaussian graphical models

abstract: Directional tests to compare incomplete undirected graphs are developed in the general context of covariance selection for Gaussian graphical models. The exactness of the underlying saddlepoint approximation is proved for chordal graphs and leads to exact control of the size of the tests, given that the only approximation error involved is due to the numerical calculation of two scalar integrals. Although exactness is not guaranteed for non-chordal graphs, the ability of the saddlepoint approximation to control the relative error leads the directional test to overperform its competitors even in these cases. The accuracy of our proposal is verified by simulation experiments under challenging scenarios, where inference via standard asymptotic approximations to the likelihood ratio test and some of its higher-order modifications fails. The directional approach is used to illustrate the assessment of Markovian dependencies in a dataset from a veterinary trial on cattle. A second example with microarray data shows how to select the graph structure related to genetic anomalies due to acute lymphocytic leukemia.


title: No frame left behind: Full Video Action Recognition

abstract: Not all video frames are equally informative for recognizing an action. It is computationally infeasible to train deep networks on all video frames when actions develop over hundreds of frames. A common heuristic is uniformly sampling a small number of video frames and using these to recognize the action. Instead, here we propose full video action recognition and consider all video frames. To make this computational tractable, we first cluster all frame activations along the temporal dimension based on their similarity with respect to the classification task, and then temporally aggregate the frames in the clusters into a smaller number of representations. Our method is end-to-end trainable and computationally efficient as it relies on temporally localized clustering in combination with fast Hamming distances in feature space. We evaluate on UCF101, HMDB51, Breakfast, and Something-Something V1 and V2, where we compare favorably to existing heuristic frame sampling methods.


title: SIENet: Spatial Information Enhancement Network for 3D Object Detection from Point Cloud

abstract: LiDAR-based 3D object detection pushes forward an immense influence on autonomous vehicles. Due to the limitation of the intrinsic properties of LiDAR, fewer points are collected at the objects farther away from the sensor. This imbalanced density of point clouds degrades the detection accuracy but is generally neglected by previous works. To address the challenge, we propose a novel two-stage 3D object detection framework, named SIENet. Specifically, we design the Spatial Information Enhancement (SIE) module to predict the spatial shapes of the foreground points within proposals, and extract the structure information to learn the representative features for further box refinement. The predicted spatial shapes are complete and dense point sets, thus the extracted structure information contains more semantic representation. Besides, we design the Hybrid-Paradigm Region Proposal Network (HP-RPN) which includes multiple branches to learn discriminate features and generate accurate proposals for the SIE module. Extensive experiments on the KITTI 3D object detection benchmark show that our elaborately designed SIENet outperforms the state-of-the-art methods by a large margin.


title: A paradifferential approach for hyperbolic dynamical systems and applications

abstract: We develop a paradifferential approach for studying non-smooth hyperbolic dynamics and related non-linear PDE from a microlocal point of view. As an application, we describe the microlocal regularity, i.e the $H^s$ wave-front set for all $s$, of the unstable bundle $E_u$ for an Anosov flow. We also recover rigidity results of Hurder-Katok and Hasselblatt in the Sobolev class rather than H\"older: there is $s_0>0$ such that if $E_u$ has $H^s$ regularity for $s>s_0$ then it is smooth (with $s_0=2$ for volume preserving $3$-dimensional Anosov flows). In the appendix by Guedes Bonthonneau, it is also shown that it can be applied to deal with non-smooth flows and potentials. This work could serve as a toolbox for other applications.


title: The young Adelaide family: Possible sibling to Datura?

abstract: Very young asteroid families may record processes that accompanied their formation in the most pristine way. This makes analysis of this special class particularly interesting. We studied the very young Adelaide family in the inner part of the main belt. This cluster is extremely close to the previously known Datura family in the space of proper orbital elements and their ages overlap. As a result, we investigated the possibility of a causal relationship between the two families. We identified Adelaide family members in the up-to-date catalogue of asteroids. By computing their proper orbital elements we inferred the family structure. Backward orbital integration of selected members allowed us to determine the age of the family. The largest fragment (525) Adelaide, an S-type asteroid about $10$ km in size, is accompanied by 50 sub-kilometre fragments. This family is a typical example of a cratering event. The very tiny extent in the semi-major axis minimises chances that some significant mean motion resonances influence the dynamics of its members, though we recognise that part of the Adelaide family is affected by weak, three-body resonances. Weak chaos is also produced by distant encounters with Mars. Simultaneous convergence of longitude of node for the orbits of six selected members to that of (525) Adelaide constrains the Adelaide family age to $536\pm 12$ kyr (formal solution). While suspiciously overlapping with the age of the Datura family, we find it unlikely that the formation events of the two families are causally linked. In all likelihood, the similarity of their ages is just a coincidence.


title: Fatigue crack propagation in carbon steel using RVE based model

abstract: A representative volume element (RVE) based multi-scale method is proposed to investigate the mechanism of fatigue crack propagation by the molecular dynamics (MD) and the extended finite element methods(XFEM) in this study. An atomic model of carbon steel plate is built to study the behavior of fatigue crack at the micro scale by MD method. Then the RVE model for fatigue crack propagation should be built by fitting the data which was obtained from the MD result with the Paris law model. Moreover, the effect of micro-structural defects including interstitial atoms, vacancies have also been considered in this study. The results indicate that the micro-structural defects can deeply influence the values of Paris law constants and the life of the specimen can be evaluated by the proposed method.


title: Research on Portfolio Liquidation Strategy under Discrete Times

abstract: This paper presents an optimal strategy for portfolio liquidation under discrete time conditions. We assume that N risky assets held will be liquidated according to the same time interval and order quantity, and the basic price processes of assets are generated by an N-dimensional independent standard Brownian motion. The permanent impact generated by an asset in the portfolio during the liquidation will affect all assets, and the temporary impact generated by one asset will only affect itself. On this basis, we establish a liquidation cost model based on the VaR measurement and obtain an optimal liquidation time under discrete-time conditions. The optimal solution shows that the liquidation time is only related to the temporary impact rather than the permanent impact. In the simulation analysis, we give the relationship between volatility parameters, temporary price impact and the optimal liquidation strategy.


title: Suppressing the Rebound of Impacting Droplets from Solvophobic Surfaces by Polymer Additives: Polymer Adsorption and Molecular Mechanisms

abstract: A liquid droplet impacting on a solvophobic surface normally rebounds. The rebound is suppressed by a small amount of dissolved polymer. In this work, using multi-body dissipative particle dynamics simulations, two anti-rebound mechanisms, the slow-retraction and the slow-hopping mechanisms, are identified. Which of them dominates depends on the polymer-surface attraction strength. However, these two mechanisms are not excluding each other but may coexist. During the droplet rebound, the surface-adsorbed polymer acts in two ways: the adsorbed beads mediate solvent-surface interactions, and highly stretching unadsorbed polymer segment exerts a retraction force on the liquid. Both actions increase the friction against retraction and the resistance against hopping. We also investigate the effects of the molecular weight and the concentration of the polymer additive, the droplet size, and the impact velocity on the rebound tendency. As the first work to provide a microscopic explanation of the anti-rebound mechanism by polymer additives, this study allows better understanding of wetting behavior by polymer-solution droplets.


title: Mining Latent Classes for Few-shot Segmentation

abstract: Few-shot segmentation (FSS) aims to segment unseen classes given only a few annotated samples. Existing methods suffer the problem of feature undermining, i.e. potential novel classes are treated as background during training phase. Our method aims to alleviate this problem and enhance the feature embedding on latent novel classes. In our work, we propose a novel joint-training framework. Based on conventional episodic training on support-query pairs, we add an additional mining branch that exploits latent novel classes via transferable sub-clusters, and a new rectification technique on both background and foreground categories to enforce more stable prototypes. Over and above that, our transferable sub-cluster has the ability to leverage extra unlabeled data for further feature enhancement. Extensive experiments on two FSS benchmarks demonstrate that our method outperforms previous state-of-the-art by a large margin of 3.7% mIOU on PASCAL-5i and 7.0% mIOU on COCO-20i at the cost of 74% fewer parameters and 2.5x faster inference speed. The source code is available at https://github.com/LiheYoung/MiningFSS.


title: Quadratic starlike trees

abstract: In this paper, we introduce the notion of the quadratic graph, that is a graph whose eigenvalues are integral or quadratic algebraic integral, and determine nine infinite families of quadratic starlike trees, which are just all the quadratic starlike trees including integral starlike trees. Thus the quadratic starlike trees are completely characterized, and moreover, the display expressions for the characteristic polynomials of the quadratic starlike trees are also given.


title: Outerspatial 2-complexes: Extending the class of outerplanar graphs to three dimensions

abstract: We introduce the class of outerspatial 2-complexes as the natural generalisation of the class of outerplanar graphs to three dimensions. Answering a question of O-joung Kwon, we prove that a locally 2-connected 2-complex is outerspatial if and only if it does not contain a surface of positive genus as a subcomplex and does not have a space minor that is a generalised cone over $K_4$ or $K_{2,3}$. This is applied to nested plane embeddings of graphs; that is, plane embeddings constrained by conditions placed on a set of cycles of the graph.


title: Design and first tests of the Gotthard-II readout ASIC for the European X-ray Free-Electron Laser

abstract: Gotthard-II is a charge-integrating microstrip detector developed for experiments and diagnostics at free-electron lasers using hard X-rays of 5 keV - 20 keV. Thanks to its excellent single photon sensitivity, large dynamic range as well as high frame rate of 4.5 MHz in burst mode, its potential scientific applications include X-ray absorption/emission spectroscopy, hard X-ray high resolution single-shot spectrometry (HiREX), beam diagnostics, as well as veto signal generation for pixel detectors. The Gotthard-II ASIC has been designed and fabricated using UMC-110 nm technology. The final ASIC design and performance in terms of noise, linearity, dynamic range, coupling between channels and speed will be discussed in the paper. In addition, a first measurement of an X-ray absorption spectrum of a standard copper sample has been done. The performance of the Gotthard-II in an experiment using energy dispersive X-rays has been demonstrated.


title: Fundamental Challenges in Deep Learning for Stiff Contact Dynamics

abstract: Frictional contact has been extensively studied as the core underlying behavior of legged locomotion and manipulation, and its nearly-discontinuous nature makes planning and control difficult even when an accurate model of the robot is available. Here, we present empirical evidence that learning an accurate model in the first place can be confounded by contact, as modern deep learning approaches are not designed to capture this non-smoothness. We isolate the effects of contact's non-smoothness by varying the mechanical stiffness of a compliant contact simulator. Even for a simple system, we find that stiffness alone dramatically degrades training processes, generalization, and data-efficiency. Our results raise serious questions about simulated testing environments which do not accurately reflect the stiffness of rigid robotic hardware. Significant additional investigation will be necessary to fully understand and mitigate these effects, and we suggest several avenues for future study.


title: Self-Supervised Visibility Learning for Novel View Synthesis

abstract: We address the problem of novel view synthesis (NVS) from a few sparse source view images. Conventional image-based rendering methods estimate scene geometry and synthesize novel views in two separate steps. However, erroneous geometry estimation will decrease NVS performance as view synthesis highly depends on the quality of estimated scene geometry. In this paper, we propose an end-to-end NVS framework to eliminate the error propagation issue. To be specific, we construct a volume under the target view and design a source-view visibility estimation (SVE) module to determine the visibility of the target-view voxels in each source view. Next, we aggregate the visibility of all source views to achieve a consensus volume. Each voxel in the consensus volume indicates a surface existence probability. Then, we present a soft ray-casting (SRC) mechanism to find the most front surface in the target view (i.e. depth). Specifically, our SRC traverses the consensus volume along viewing rays and then estimates a depth probability distribution. We then warp and aggregate source view pixels to synthesize a novel view based on the estimated source-view visibility and target-view depth. At last, our network is trained in an end-to-end self-supervised fashion, thus significantly alleviating error accumulation in view synthesis. Experimental results demonstrate that our method generates novel views in higher quality compared to the state-of-the-art.


title: A simpler encoding of indexed types

abstract: In functional programming languages, generalized algebraic data types (GADTs) are very useful as the unnecessary pattern matching over them can be ruled out by the failure of unification of type arguments. In dependent type systems, this is usually called indexed types and it's particularly useful as the identity type is a special case of it. However, pattern matching over indexed types is very complicated as it requires term unification in general. We study a simplified version of indexed types (called simpler indexed types) where we explicitly specify the selection process of constructors, and we discuss its expressiveness, limitations, and properties.