title: Anisotropic oriented percolation in high dimensions

abstract: In this paper we study anisotropic oriented percolation on $\mathbb{Z}^d$ for $d\geq 4$ and show that the local condition for phase transition is closely related to the mean-field condition. More precisely, we show that if the sum of the local probabilities is strictly greater than one and each probability is not too large, then percolation occurs.


title: Subjective Sentiment Analysis for Arabic Newswire Comments

abstract: This paper presents an approach based on supervised machine learning methods to discriminate between positive, negative and neutral Arabic reviews in online newswire. The corpus is labeled for subjectivity and sentiment analysis (SSA) at the sentence-level. The model uses both count and TF-IDF representations and apply six machine learning algorithms; Multinomial Naive Bayes, Support Vector Machines (SVM), Random Forest, Logistic Regression, Multi-layer perceptron and k-nearest neighbors using uni-grams, bi-grams features. With the goal of extracting users sentiment from written text. Experimental results showed that n-gram features could substantially improve performance; and showed that the Multinomial Naive Bayes approach is the most accurate in predicting topic polarity. Best results were achieved using count vectors trained by combination of word-based uni-grams and bi-grams with an overall accuracy of 85.57% over two classes and 65.64% over three classes.


title: Dust in brown dwarfs and extra-solar planets. VII. Cloud formation in diffusive atmospheres

abstract: The precipitation of cloud particles in brown dwarf and exoplanet atmospheres establishes an ongoing downward flux of condensable elements. To understand the efficiency of cloud formation, it is therefore crucial to quantify the replenishment mechanism that is able to compensate for the element losses in the upper atmosphere, to keep the extrasolar weather cycle running. In this paper, we introduce a new cloud formation model by combining the cloud particle moment method of Helling & Woitke with a diffusive mixing approach, taking into account turbulent mixing and gas-kinetic diffusion for both gas and cloud particles. The equations are of diffusion-reaction type and are solved time-dependently for a prescribed 1D atmospheric structure, until the model has relaxed toward a time-independent solution. In comparison to our previous models, the new hot Jupiter model results (Teff=2000K, log g=3) show fewer but larger cloud particles which are more concentrated towards the cloud base. The abundances of condensable elements in the gas phase are featured by a steep decline above the cloud base, followed by a shallower, monotonous decrease towards a plateau, the level of which depends on temperature. The chemical composition of the cloud particles also differs significantly from our previous models. Due to the condensation of specific condensates like Mg2SiO4[s] in deeper layers, certain elements, such as Mg, are almost entirely removed from the gas phase early. This leads to unusual (and non-solar) element ratios in higher atmospheric layers, which then favours the formation of SiO[s] and SiO2[s], for example, rather than MgSiO3[s]. Such condensates are not expected in phase-equilibrium models that start from solar abundances. Above the main silicate cloud layer, which is enriched with iron and metal oxides, we find a second cloud layer made of Na2S[s] particles in cooler models (Teff<1500K).


title: Dynamic and programmable cellular-scale granules enable tissue-like materials

abstract: Tissue-like materials are required in many robotic systems to improve human-machine interactions. However, the mechanical properties of living tissues are difficult to replicate. Synthetic materials are not usually capable of simultaneously displaying the behaviors of the cellular ensemble and the extracellular matrix. A particular challenge is identification of a cell-like synthetic component which is tightly integrated with its matrix and also responsive to external stimuli at the population level. Here, we demonstrate that cellular-scale hydrated starch granules, an underexplored component in materials science, can turn conventional hydrogels into tissue-like materials when composites are formed. Using several synchrotron-based X-ray techniques, we reveal the mechanically-induced motion and training dynamics of the starch granules in the hydrogel matrix. These dynamic behaviors enable multiple tissue-like properties such as strain-stiffening, anisotropy, mechanical heterogeneity, programmability, mechanochemistry, impact absorption, and self-healability. The starch-hydrogel composites can be processed as robotic skins that maintain these tissue-like characteristics.


title: Empirical validation of network learning with taxi GPS data from Wuhan, China

abstract: In prior research, a statistically cheap method was developed to monitor transportation network performance by using only a few groups of agents without having to forecast the population flows. The current study validates this "multi-agent inverse optimization" method using taxi GPS probe data from the city of Wuhan, China. Using a controlled 2062-link network environment and different GPS data processing algorithms, an online monitoring environment is simulated using the real data over a 4-hour period. Results show that using only samples from one OD pair, the multi-agent inverse optimization method can learn network parameters such that forecasted travel times have a 0.23 correlation with the observed travel times. By increasing to monitoring from just two OD pairs, the correlation improves further to 0.56.


title: Repurposing an Energy System Optimization Model for Seasonal Power Generation Planning

abstract: Seasonal climate variations affect electricity demand, which in turn affects month-to-month electricity planning and operations. Electricity system planning at the monthly timescale can be improved by adapting climate forecasts to estimate electricity demand and utilizing energy models to estimate monthly electricity generation and associated operational costs. The objective of this paper is to develop and test a computationally efficient model that can support seasonal planning while preserving key aspects of system operation over hourly and daily timeframes. To do so, an energy system optimization model is repurposed for seasonal planning using features drawn from a unit commitment model. Different scenarios utilizing a well-known test system are used to evaluate the errors associated with both the repurposed energy system model and an imperfect load forecast. The results show that the energy system optimization model using an imperfect load forecast produces differences in monthly cost and generation levels that are less than 2% compared with a unit commitment model using a perfect load forecast. The enhanced energy system optimization model can be solved approximately 100 times faster than the unit commitment model, making it a suitable tool for future work aimed at evaluating seasonal electricity generation and demand under uncertainty.


title: Search for new neutral Higgs bosons through the H $\to$ ZA $\to$ $\ell^{+}\ell^{-} \mathrm{b\bar{b}}$ process in pp collisions at $\sqrt{s} =$ 13 TeV

abstract: This paper reports on a search for an extended scalar sector of the standard model, where a new CP-even (odd) boson decays to a Z boson and a lighter CP-odd (even) boson, and the latter further decays to a b quark pair. The Z boson is reconstructed via its decays to electron or muon pairs. The analysed data were recorded in proton-proton collisions at a center-of-mass energy $\sqrt{s} = $ 13 TeV, collected by the CMS experiment at the LHC during 2016, corresponding to an integrated luminosity of 35.9 fb$^{-1}$. Data and predictions from the standard model are in agreement within the uncertainties. Upper limits at 95% confidence level are set on the production cross section times branching fraction, with masses of the new bosons up to 1000 GeV. The results are interpreted in the context of the two-Higgs-doublet model.


title: Enforcing Encoder-Decoder Modularity in Sequence-to-Sequence Models

abstract: Inspired by modular software design principles of independence, interchangeability, and clarity of interface, we introduce a method for enforcing encoder-decoder modularity in seq2seq models without sacrificing the overall model quality or its full differentiability. We discretize the encoder output units into a predefined interpretable vocabulary space using the Connectionist Temporal Classification (CTC) loss. Our modular systems achieve near SOTA performance on the 300h Switchboard benchmark, with WER of 8.3% and 17.6% on the SWB and CH subsets, using seq2seq models with encoder and decoder modules which are independent and interchangeable.


title: Hypothesis testing for populations of networks

abstract: It has become an increasingly common practice for scientists in modern science and engineering to collect samples of multiple network data in which a network serves as a basic data object. The increasing prevalence of multiple network data calls for developments of models and theory that can deal with inference problems for populations of networks. In this work, we propose a general procedure for hypothesis testing of networks and in particular, for differentiating distributions of two samples of networks. We consider a very general framework which allows us to perform tests on large and sparse networks. Our contribution is two-fold: (1) We propose a test statistics based on the singular value of a generalized Wigner matrix. The asymptotic null distribution of the statistics is shown to follow the Tracy--Widom distribution as the number of nodes tends to infinity. The test also yields asymptotic power guarantee with the power tending to one under the alternative; (2) The test procedure is adapted for change-point detection in dynamic networks which is proven to be consistent in detecting the change-points. In addition to theoretical guarantees, another appealing feature of this adapted procedure is that it provides a principled and simple method for selecting the threshold that is also allowed to vary with time. Extensive simulation studies and real data analyses demonstrate the superior performance of our procedure with competitors.


title: Adaptive versus Standard Descent Methods and Robustness Against Adversarial Examples

abstract: Adversarial examples are a pervasive phenomenon of machine learning models where seemingly imperceptible perturbations to the input lead to misclassifications for otherwise statistically accurate models. In this paper we study how the choice of optimization algorithm influences the robustness of the resulting classifier to adversarial examples. Specifically we show an example of a learning problem for which the solution found by adaptive optimization algorithms exhibits qualitatively worse robustness properties against both $L_{2}$- and $L_{\infty}$-adversaries than the solution found by non-adaptive algorithms. Then we fully characterize the geometry of the loss landscape of $L_{2}$-adversarial training in least-squares linear regression. The geometry of the loss landscape is subtle and has important consequences for optimization algorithms. Finally we provide experimental evidence which suggests that non-adaptive methods consistently produce more robust models than adaptive methods.


title: PoD: Positional Dependency-Based Word Embedding for Aspect Term Extraction

abstract: Dependency context-based word embedding jointly learns the representations of word and dependency context, and has been proved effective in aspect term extraction. In this paper, we design the positional dependency-based word embedding (PoD) which considers both dependency context and positional context for aspect term extraction. Specifically, the positional context is modeled via relative position encoding. Besides, we enhance the dependency context by integrating more lexical information (e.g., POS tags) along dependency paths. Experiments on SemEval 2014/2015/2016 datasets show that our approach outperforms other embedding methods in aspect term extraction.


title: Spatially Regularized Parametric Map Reconstruction for Fast Magnetic Resonance Fingerprinting

abstract: Magnetic resonance fingerprinting (MRF) provides a unique concept for simultaneous and fast acquisition of multiple quantitative MR parameters. Despite acquisition efficiency, adoption of MRF into the clinics is hindered by its dictionary matching-based reconstruction, which is computationally demanding and lacks scalability. Here, we propose a convolutional neural network-based reconstruction, which enables both accurate and fast reconstruction of parametric maps, and is adaptable based on the needs of spatial regularization and the capacity for the reconstruction. We evaluated the method using MRF T1-FF, an MRF sequence for T1 relaxation time of water (T1H2O) and fat fraction (FF) mapping. We demonstrate the method's performance on a highly heterogeneous dataset consisting of 164 patients with various neuromuscular diseases imaged at thighs and legs. We empirically show the benefit of incorporating spatial regularization during the reconstruction and demonstrate that the method learns meaningful features from MR physics perspective. Further, we investigate the ability of the method to handle highly heterogeneous morphometric variations and its generalization to anatomical regions unseen during training. The obtained results outperform the state-of-the-art in deep learning-based MRF reconstruction. The method achieved normalized root mean squared errors of 0.048 $\pm$ 0.011 for T1H2O maps and 0.027 $\pm$ 0.004 for FF maps when compared to the dictionary matching in a test set of 50 patients. Coupled with fast MRF sequences, the proposed method has the potential of enabling multiparametric MR imaging in clinically feasible time.


title: Learning to Optimize in Swarms

abstract: Learning to optimize has emerged as a powerful framework for various optimization and machine learning tasks. Current such "meta-optimizers" often learn in the space of continuous optimization algorithms that are point-based and uncertainty-unaware. To overcome the limitations, we propose a meta-optimizer that learns in the algorithmic space of both point-based and population-based optimization algorithms. The meta-optimizer targets at a meta-loss function consisting of both cumulative regret and entropy. Specifically, we learn and interpret the update formula through a population of LSTMs embedded with sample- and feature-level attentions. Meanwhile, we estimate the posterior directly over the global optimum and use an uncertainty measure to help guide the learning process. Empirical results over non-convex test functions and the protein-docking application demonstrate that this new meta-optimizer outperforms existing competitors.


title: Existence of solutions for Kirchhoff-type fractional Dirichlet problem with $p$-Laplacian

abstract: In this paper, we investigate the existence of solutions for a class of $p$-Laplacian fractional order Kirchhoff-type system with Riemann-Liouville fractional derivatives and a parameter $\lambda$. By mountain pass theorem, we obtain that system has at least one non-trivial weak solution $u_\lambda$ under some local superquadratic conditions for each given large parameter $\lambda$. We get a concrete lower bound of the parameter $\lambda$, and then obtain two estimates of weak solutions $u_\lambda$. We also obtain that $u_\lambda\to 0$ if $\lambda$ tends to $\infty$. Finally, we present an example as an application of our results.


title: Observation of the $\Lambda_\mathrm{b}^0$ $\to$ J/$\psi \Lambda \phi$ decay in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: The observation of the $\Lambda_\mathrm{b}^0$ $\to$ J/$\psi \Lambda \phi$ decay is reported using proton-proton collision data collected at $\sqrt{s} =$ 13 TeV by the CMS experiment at the LHC in 2018, corresponding to an integrated luminosity of 60 fb$^{-1}$. The ratio of the branching fractions $\mathcal{B}(\Lambda_\mathrm{b}^0$ $\to$ J/$\psi \Lambda \phi)$ $/$ $\mathcal{B}(\Lambda_\mathrm{b}^0$ $\to$ $\psi \Lambda)$ is measured to be (8.26 $\pm$ 0.90 (stat) $\pm$ 0.68 (syst) $\pm$ 0.11 $(\mathcal{B}))$ $\times$ 10$^{-2}$, where the first uncertainty is statistical, the second is systematic, and the last uncertainty reflects the uncertainties in the world-average branching fractions of $\phi$ and $\psi$(2S) decays to the reconstructed final states.


title: Spectral Characterization and Modeling of Wavelength-shifting Fibers

abstract: We have constructed a detailed software model of photon transport in clear and wavelength shifting polystyrene optical fibers based on the GEANT4 framework. We validate the model with measurements obtained from several different lengths of fiber illuminated with several LEDs, using two independent acquisition systems. The simulated spectral and spatial light distributions at the end of the fiber and the resultant attenuation lengths show good agreement with measurement. We use the model to predict the fiber behaviour for several test cases and discuss potential applications.


title: An Electromagnetic Framework for the Deployment of Reconfigurable Intelligent Surfaces to Control Massive MIMO Channel Characteristics

abstract: In this paper, we deploy a full-wave FDTD paradigm to investigate the effect of reconfigurable intelligent surface (RIS) -- switchable frequency-selective surfaces (FSS) -- on generic massive MIMO uplink channel's eigenspace structure. We place an RIS based on two switchable FSS layers in the vicinity of a 64-element massive MIMO base-station (BS) array, serving a cluster of four fixed user equipment (UE) units. Utilizing an electromagnetic tool based on time-averaged Poynting flow developed recently by the authors, we demonstrate how the illumination of BS-array aperture can be controlled by the intentional deployment of various switching states in the RIS placed near the BS. We show that such supplementary RIS structures may assist the wireless link engineer in deterministically "customizing" the uplink channel behaviour by selectively enhancing/suppressing certain channel eigenvalues.


title: Coalescence estimates for the corner growth model with exponential weights

abstract: We establish estimates for the coalescence time of semi-infinite directed geodesics in the planar corner growth model with i.i.d. exponential weights. There are four estimates: upper and lower bounds on the probabilities of both fast and slow coalescence on the correct spatial scale with exponent $3/2$. Our proofs utilize a geodesic duality introduced by Pimentel and properties of the increment-stationary last-passage percolation process. For fast coalescence our bounds are new and they have matching optimal exponential order of magnitude. For slow coalescence we reproduce bounds proved earlier with integrable probability inputs, except that our upper bound misses the optimal order by a logarithmic factor.


title: A Robust Blind 3-D Mesh Watermarking based on Wavelet Transform for Copyright Protection

abstract: Nowadays, three-dimensional meshes have been extensively used in several applications such as, industrial, medical, computer-aided design (CAD) and entertainment due to the processing capability improvement of computers and the development of the network infrastructure. Unfortunately, like digital images and videos, 3-D meshes can be easily modified, duplicated and redistributed by unauthorized users. Digital watermarking came up while trying to solve this problem. In this paper, we propose a blind robust watermarking scheme for three-dimensional semiregular meshes for Copyright protection. The watermark is embedded by modifying the norm of the wavelet coefficient vectors associated with the lowest resolution level using the edge normal norms as synchronizing primitives. The experimental results show that in comparison with alternative 3-D mesh watermarking approaches, the proposed method can resist to a wide range of common attacks, such as similarity transformations including translation, rotation, uniform scaling and their combination, noise addition, Laplacian smoothing, quantization, while preserving high imperceptibility.


title: Investigation of the Yu-Shiba-Rusinov states of a multi-impurity Kondo system

abstract: Recent studies of mutually interacting magnetic atoms coupled to a superconductor have gained enormous interest due to the potential realization of topological superconductivity. The Kondo exchange coupling J_K of such atoms with the electrons in the superconductor has a pair-breaking effect which produces so-called Yu-Shiba-Rusinov (YSR) states within the superconducting energy gap, whose energetic positions are intimately connected with the requirements for topological superconductivity. Here, using the tip of a scanning tunneling microscope, we artificially craft a multi-impurity Kondo system coupled to a superconducting host consisting of an Fe adatom interacting with an assembly of interstitial Fe atoms on an oxygen-reconstructed Ta(100) surface and we experimentally investigate the signatures of Kondo screening and the YSR states. With the help of numerical renormalization group (NRG) calculations, we show that the observed behavior can be qualitatively reproduced by a two-impurity Kondo system whose inter-impurity antiferromagnetic interaction J is adjusted by the number of interstitial Fe atoms in the assembly. When driving the system from the regime of two decoupled Kondo singlets (small J) to that of an antiferromagnetic dimer (large J), the YSR state shows a characteristic cross-over in its energetic position and particle-hole asymmetry.


title: Impact of internal migration on population redistribution in Europe: Urbanisation, counterurbanisation or spatial equilibrium?

abstract: The classical foundations of migration research date from the 1880s with Ravenstein's Laws of migration, which represent the first comparative analyses of internal migration. While his observations remain largely valid, the ensuing century has seen considerable progress in data collection practices and methods of analysis, which in turn has permitted theoretical advances in understanding the role of migration in population redistribution. Coupling the extensive range of migration data now available with these recent theoretical and methodological advances, we endeavour to advance beyond Ravenstein's understanding by examining the direction of population redistribution and comparing the impact of internal migration on patterns of human settlement in 27 European countries. Results show that the overall redistributive impact of internal migration is low in most European countries but the mechanisms differ across the continent. In Southern and Eastern Europe migration effectiveness is above average but is offset by low migration intensities, whereas in Northern and Western Europe high intensities are absorbed in reciprocal flows resulting in low migration effectiveness. About half the European countries are experiencing a process of concentration toward urbanised regions, particularly in Northern, Central and Eastern Europe, whereas countries in the West and South are undergoing a process of population deconcentration. These results suggest that population deconcentration is now more common than it was in the 1990s when counterurbanisation was limited to Western Europe. The results show that 130 years on, Ravenstein's law of migration streams and counter-streams remains a central facet of migration dynamics, while underlining the importance of simple yet robust indices for the spatial analysis of migration.


title: Generalizations of Douady's magic formula

abstract: We generalize a combinatorial formula of Douady from the main cardioid to other hyperbolic components $H$ of the Mandelbrot set, constructing an explicit piecewise linear map which sends the set of angles of external rays landing on $H$ to the set of angles of external rays landing on the real axis.


title: Multi-Principal-Element Approach to High-Performance Thermoelectric Materials

abstract: High-entropy alloys are characterized by high configurational entropy. Since the discovery of high-entropy alloys (HEA) in 2004, entropy engineering has provided a promising direction for exploiting composition, lattice disorder, band structure, and microstructure effects to advance thermoelectric performance. This review discusses the impact of entropy on thermoelectric properties and looks back at the role of multi-principal-element alloys, a weaker version of HEA, on the development of compositionally complex thermoelectric alloys in achieving high thermoelectric performance. The experimental and theoretical efforts in a wide range of material systems such as TAGS, LAST, half-Heusler, liquid-like copper chalcogenides, SnTe, and CuInTe2 chalcopyrites provide insights into the entropy engineering approach and also promise an emerging paradigm of high-entropy thermoelectrics.


title: Left orderable surgeries of double twist knots

abstract: A rational number $r$ is called a left orderable slope of a knot $K \subset S^3$ if the 3-manifold obtained from $S^3$ by $r$-surgery along $K$ has left orderable fundamental group. In this paper we consider the double twist knots $C(k,l)$ in the Conway notation. For any positive integers $m$ and $n$, we show that if $K$ is a double twist knot of the form $C(2m,-2n)$, $C(2m+1, 2n)$ or $C(2m+1, -2n)$ then there is an explicit unbounded interval $I$ such that any rational number $r \in I$ is a left orderable slope of $K$.


title: Hierarchical Reinforcement Learning Method for Autonomous Vehicle Behavior Planning

abstract: In this work, we propose a hierarchical reinforcement learning (HRL) structure which is capable of performing autonomous vehicle planning tasks in simulated environments with multiple sub-goals. In this hierarchical structure, the network is capable of 1) learning one task with multiple sub-goals simultaneously; 2) extracting attentions of states according to changing sub-goals during the learning process; 3) reusing the well-trained network of sub-goals for other similar tasks with the same sub-goals. The states are defined as processed observations which are transmitted from the perception system of the autonomous vehicle. A hybrid reward mechanism is designed for different hierarchical layers in the proposed HRL structure. Compared to traditional RL methods, our algorithm is more sample-efficient since its modular design allows reusing the policies of sub-goals across similar tasks. The results show that the proposed method converges to an optimal policy faster than traditional RL methods.


title: Measurement of the jet mass distribution and top quark mass in hadronic decays of boosted top quarks in pp collisions at $\sqrt{s} =$ 13 TeV

abstract: A measurement is reported of the jet mass distribution in hadronic decays of boosted top quarks produced in pp collisions at $\sqrt{s} =$ 13 TeV. The data were collected with the CMS detector at the LHC and correspond to an integrated luminosity of 35.9 fb$^{-1}$. The measurement is performed in the lepton+jets channel of $\mathrm{t\bar{t}}$ events, where the lepton is an electron or muon. The products of the hadronic top quark decay t $\to$ bW $\to$ bq$\mathrm{\bar{q}}'$ are reconstructed as a single jet with transverse momentum larger than 400 GeV. The $\mathrm{t\bar{t}}$ cross section as a function of the jet mass is unfolded at the particle level and used to extract a value of the top quark mass of 172.6 $\pm$ 2.5 GeV. A novel jet reconstruction technique is used for the first time at the LHC, which improves the precision by a factor of three relative to an earlier measurement. This highlights the potential of measurements using boosted top quarks, where the new technique will enable future precision measurements.


title: Human Driver Behavior Prediction based on UrbanFlow

abstract: How autonomous vehicles and human drivers share public transportation systems is an important problem, as fully automatic transportation environments are still a long way off. Understanding human drivers' behavior can be beneficial for autonomous vehicle decision making and planning, especially when the autonomous vehicle is surrounded by human drivers who have various driving behaviors and patterns of interaction with other vehicles. In this paper, we propose an LSTM-based trajectory prediction method for human drivers which can help the autonomous vehicle make better decisions, especially in urban intersection scenarios. Meanwhile, in order to collect human drivers' driving behavior data in the urban scenario, we describe a system called UrbanFlow which includes the whole procedure from raw bird's-eye view data collection via drone to the final processed trajectories. The system is mainly intended for urban scenarios but can be extended to be used for any traffic scenarios.


title: Signature of a pair of Majorana zero modes in superconducting gold surface states

abstract: Under certain conditions, a fermion in a superconductor can separate in space into two parts known as Majorana zero modes, which are immune to decoherence from local noise sources and are attractive building blocks for quantum computers. Promising experimental progress has been made to demonstrate Majorana zero modes in materials with strong spin-orbit coupling proximity coupled to superconductors. Here we report signatures of Majorana zero modes in a new material platform utilizing the surface states of gold. Using scanning tunneling microscope to probe EuS islands grown on top of gold nanowires, we observe two well separated zero bias tunneling conductance peaks aligned along the direction of the applied magnetic field, as expected for a pair of Majorana zero modes. This platform has the advantage of having a robust energy scale and the possibility of realizing complex designs using lithographic methods.


title: XceptionTime: A Novel Deep Architecture based on Depthwise Separable Convolutions for Hand Gesture Classification

abstract: Capitalizing on the need for addressing the existing challenges associated with gesture recognition via sparse multichannel surface Electromyography (sEMG) signals, the paper proposes a novel deep learning model, referred to as the XceptionTime architecture. The proposed innovative XceptionTime is designed by integration of depthwise separable convolutions, adaptive average pooling, and a novel non-linear normalization technique. At the heart of the proposed architecture is several XceptionTime modules concatenated in series fashion designed to capture both temporal and spatial information-bearing contents of the sparse multichannel sEMG signals without the need for data augmentation and/or manual design of feature extraction. In addition, through integration of adaptive average pooling, Conv1D, and the non-linear normalization approach, XceptionTime is less prone to overfitting, more robust to temporal translation of the input, and more importantly is independent from the input window size. Finally, by utilizing the depthwise separable convolutions, the XceptionTime network has far fewer parameters resulting in a less complex network. The performance of XceptionTime is tested on a sub Ninapro dataset, DB1, and the results showed a superior performance in comparison to any existing counterparts. In this regard, 5:71% accuracy improvement, on a window size 200ms, is reported in this paper, for the first time.


title: ISLET: Fast and Optimal Low-rank Tensor Regression via Importance Sketching

abstract: In this paper, we develop a novel procedure for low-rank tensor regression, namely \emph{\underline{I}mportance \underline{S}ketching \underline{L}ow-rank \underline{E}stimation for \underline{T}ensors} (ISLET). The central idea behind ISLET is \emph{importance sketching}, i.e., carefully designed sketches based on both the responses and low-dimensional structure of the parameter of interest. We show that the proposed method is sharply minimax optimal in terms of the mean-squared error under low-rank Tucker assumptions and under randomized Gaussian ensemble design. In addition, if a tensor is low-rank with group sparsity, our procedure also achieves minimax optimality. Further, we show through numerical study that ISLET achieves comparable or better mean-squared error performance to existing state-of-the-art methods while having substantial storage and run-time advantages including capabilities for parallel and distributed computing. In particular, our procedure performs reliable estimation with tensors of dimension $p = O(10^8)$ and is $1$ or $2$ orders of magnitude faster than baseline methods.

categories: stat.ML cs.LG cs.NA math.NA math.ST stat.ME stat.TH


title: Nonlinearity + Networks: A 2020 Vision

abstract: I briefly survey several fascinating topics in networks and nonlinearity. I highlight a few methods and ideas, including several of personal interest, that I anticipate to be especially important during the next several years. These topics include temporal networks (in which the entities and/or their interactions change in time), stochastic and deterministic dynamical processes on networks, adaptive networks (in which a dynamical process on a network is coupled to dynamics of network structure), and network structure and dynamics that include "higher-order" interactions (which involve three or more entities in a network). I draw examples from a variety of scenarios, including contagion dynamics, opinion models, waves, and coupled oscillators.

categories: cs.SI cond-mat.stat-mech math.DS nlin.AO physics.soc-ph


title: Multiple Pursuer Multiple Evader Differential Games

abstract: In this paper an N-pursuer vs. M-evader team conflict is studied. The differential game of border defense is addressed and we focus on the game of degree in the region of the state space where the pursuers are able to win. This work extends classical differential game theory to simultaneously address weapon assignments and multi-player pursuit-evasion scenarios. Saddle-point strategies that provide guaranteed performance for each team regardless of the actual strategies implemented by the opponent are devised. The players' optimal strategies require the co-design of cooperative optimal assignments and optimal guidance laws. A representative measure of performance is proposed and the Value function of the game is obtained. It is shown that the Value function is continuous, continuously differentiable, and that it satisfies the Hamilton-Jacobi-Isaacs equation - the curse of dimensionality is overcome and the optimal strategies are obtained. The cases of N=M and N>M are considered. In the latter case, cooperative guidance strategies are also developed in order for the pursuers to exploit their numerical advantage. This work provides a foundation to formally analyze complex and high-dimensional conflicts between teams of N pursuers and M evaders by means of differential game theory.


title: Synthesis of coordination programs from linear temporal logic

abstract: This paper presents a method for synthesizing a reactive program which coordinates the actions of a group of other reactive programs, so that the combined system satisfies a temporal specification of its desired long-term behavior. Traditionally, reactive synthesis has been applied to the construction of a stateful hardware circuit. This work is motivated by applications to other domains, such as the IoT (the Internet of Things) and robotics, where it is necessary to coordinate the actions of multiple sensors, devices, and robots. The mathematical model represents such entities as individual processes in Hoare's CSP model. Given a network of interacting entities, called an \emph{environment}, and a temporal specification of long-term behavior, the synthesis method constructs a \emph{coordinator} process (if one exists) that guides the actions of the environment entities so that the combined system is deadlock-free and satisfies the given specification. The main technical challenge is that a coordinator may have only \emph{partial knowledge} of the environment state, due to non-determinism within the environment, and environment actions that are hidden from the coordinator. This is the first method to handle both sources of partial knowledge, and to do so for arbitrary linear temporal logic specifications. It is shown that the coordination synthesis problem is \PSPACE-hard in the size of the environment. A prototype implementation is able to synthesize compact solutions for a number of coordination problems.


title: Non-intrusive model reduction of large-scale, nonlinear dynamical systems using deep learning

abstract: Projection-based model reduction has become a popular approach to reduce the cost associated with integrating large-scale dynamical systems so they can be used in many-query settings such as optimization and uncertainty quantification. For nonlinear systems, significant cost reduction is only possible with an additional layer of approximation to reduce the computational bottleneck of evaluating the projected nonlinear terms. Prevailing methods to approximate the nonlinear terms are code intrusive, potentially requiring years of development time to integrate into an existing codebase, and have been known to lack parametric robustness. This work develops a non-intrusive method to efficiently and accurately approximate the expensive nonlinear terms that arise in reduced nonlinear dynamical system using deep neural networks. The neural network is trained using only the simulation data used to construct the reduced basis and evaluations of the nonlinear terms at these snapshots. Once trained, the neural network-based reduced-order model only requires forward and backward propagation through the network to evaluate the nonlinear term and its derivative, which are used to integrate the reduced dynamical system at a new parameter configuration. We provide two numerical experiments---the dynamical systems result from the semi-discretization of parametrized, nonlinear, hyperbolic partial differential equations---that show, in addition to non-intrusivity, the proposed approach provides more stable and accurate approximations to each dynamical system across a large number of training and testing points than the popular empirical interpolation method.


title: Meta Label Correction for Noisy Label Learning

abstract: Leveraging weak or noisy supervision for building effective machine learning models has long been an important research problem. Its importance has further increased recently due to the growing need for large-scale datasets to train deep learning models. Weak or noisy supervision could originate from multiple sources including non-expert annotators or automatic labeling based on heuristics or user interaction signals. There is an extensive amount of previous work focusing on leveraging noisy labels. Most notably, recent work has shown impressive gains by using a meta-learned instance re-weighting approach where a meta-learning framework is used to assign instance weights to noisy labels. In this paper, we extend this approach via posing the problem as label correction problem within a meta-learning framework. We view the label correction procedure as a meta-process and propose a new meta-learning based framework termed MLC (Meta Label Correction) for learning with noisy labels. Specifically, a label correction network is adopted as a meta-model to produce corrected labels for noisy labels while the main model is trained to leverage the corrected labeled. Both models are jointly trained by solving a bi-level optimization problem. We run extensive experiments with different label noise levels and types on both image recognition and text classification tasks. We compare the reweighing and correction approaches showing that the correction framing addresses some of the limitation of reweighting. We also show that the proposed MLC approach achieves large improvements over previous methods in many settings.


title: Parameter Estimation in Adaptive Control of Time-Varying Systems Under a Range of Excitation Conditions

abstract: This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error trajectories to tend exponentially fast towards a compact set whenever excitation conditions are satisfied. This algorithm is employed in a large class of problems where unknown parameters are present and are time-varying. It is shown that this algorithm guarantees global boundedness of the state and parameter errors of the system, and avoids an often used filtering approach for constructing key regressor signals. In addition, intervals of time over which these errors tend exponentially fast toward a compact set are provided, both in the presence of finite and persistent excitation. A projection operator is used to ensure the boundedness of the learning rate matrix, as compared to a time-varying forgetting factor. Numerical simulations are provided to complement the theoretical analysis.


title: Generating dynamic contact graphs with indirect links

abstract: Graph models are widely used to study diffusion processes in contact networks. Recent data-driven research has highlighted the significance of indirect links, where interactions are possible when two nodes visit the same place at different times (SPDT), in determining network structure and diffusion dynamics. However, how to generate dynamic graphs with indirect links for modeling diffusion remains an unsolved challenge. Here, we present a dynamic contact graph model for generating contact networks with direct and indirect links. Our model introduces the concept of multiple concurrently active copies of a node for capturing indirect transmission links. The SPDT graph model builds on activity driven time-varying network modelling for generating dynamic contact networks using simple statistical distributions. This model is fitted with a large city-scale empirical dataset using maximum likelihood estimation methods. Finally, the performance of the model is evaluated by analysing the capability of capturing the network properties observed in empirical graphs constructed using the location updates of a social networking app and simulating SPDT diffusion processes. Our results show that, in comparison to current graph models that only include direct links, our graph model with indirect links match empirical network properties and diffusion dynamics much more closely.


title: Anisotropic decay and global well-posedness of viscous surface waves without surface tension

abstract: We consider a viscous incompressible fluid below the air and above a fixed bottom. The fluid dynamics is governed by the gravity-driven incompressible Navier-Stokes equations, and the effect of surface tension is neglected on the free surface. The global well-posedness and long-time behavior of solutions near equilibrium have been intriguing questions since Beale (\emph{Comm. Pure Appl. Math.} 34 (1981), no. 3, 359--392). It had been thought that certain low frequency assumption of the initial data is needed to derive an integrable decay rate of the velocity so that the global solutions in $3D$ can be constructed, while the global well-posedness in $2D$ was left open. In this paper, by exploiting the anisotropic decay rates of the velocity, which are even not integrable, we prove the global well-posedness in both $2D$ and $3D$, without any low frequency assumption of the initial data. One of key observations here is a cancelation in nonlinear estimates of the viscous stress tensor term in the bulk by using Alinhac good unknowns, when estimating the energy evolution of the highest order horizontal spatial derivatives of the solution.


title: Estimating Higher-Order Moments Using Symmetric Tensor Decomposition

abstract: We consider the problem of decomposing higher-order moment tensors, i.e., the sum of symmetric outer products of data vectors. Such a decomposition can be used to estimate the means in a Gaussian mixture model and for other applications in machine learning. The $d$th-order empirical moment tensor of a set of $p$ observations of $n$ variables is a symmetric $d$-way tensor. Our goal is to find a low-rank tensor approximation comprising $r \ll p$ symmetric outer products. The challenge is that forming the empirical moment tensors costs $O(pn^d)$ operations and $O(n^d)$ storage, which may be prohibitively expensive; additionally, the algorithm to compute the low-rank approximation costs $O(n^d)$ per iteration. Our contribution is avoiding formation of the moment tensor, computing the low-rank tensor approximation of the moment tensor implicitly using $O(pnr)$ operations per iteration and no extra memory. This advance opens the door to more applications of higher-order moments since they can now be efficiently computed. We present numerical evidence of the computational savings and show an example of estimating the means for higher-order moments.


title: Scalable Zero-shot Entity Linking with Dense Entity Retrieval

abstract: This paper introduces a conceptually simple, scalable, and highly effective BERT-based entity linking model, along with an extensive evaluation of its accuracy-speed trade-off. We present a two-stage zero-shot linking algorithm, where each entity is defined only by a short textual description. The first stage does retrieval in a dense space defined by a bi-encoder that independently embeds the mention context and the entity descriptions. Each candidate is then re-ranked with a cross-encoder, that concatenates the mention and entity text. Experiments demonstrate that this approach is state of the art on recent zero-shot benchmarks (6 point absolute gains) and also on more established non-zero-shot evaluations (e.g. TACKBP-2010), despite its relative simplicity (e.g. no explicit entity embeddings or manually engineered mention tables). We also show that bi-encoder linking is very fast with nearest neighbour search (e.g. linking with 5.9 million candidates in 2 milliseconds), and that much of the accuracy gain from the more expensive cross-encoder can be transferred to the bi-encoder via knowledge distillation. Our code and models are available at https://github.com/facebookresearch/BLINK.


title: Large-scale multiconfiguration Dirac-Hartree-Fock calculations for astrophysics: Cl-like ions from Cr~VIII to Zn~XIV

abstract: We use the multiconfiguration Dirac-Hartree-Fock (MCDHF) method combined with the relativistic configuration interaction (RCI) approach (GRASP2K) to provide a consistent set of transition energies and radiative transition data for the lower $n =3$ states in all Cl-like ions of astrophysical importance, from \ion{Cr}{8} to \ion{Zn}{14}. We also provide excitation energies calculated for \mbox{Fe X} using the many-body perturbation theory (MBPT, implemented within FAC). The comparison of the present MCDHF results with MBPT and with the available experimental energies indicates that the theoretical excitation energies are highly accurate, with uncertainties of only a few hundred cm$^{-1}$. Detailed comparisons for Fe~X and Ni~XII highlight discrepancies in the experimental energies found in the literature. Several new identifications are proposed.


title: Parking On A Random Rooted Plane Tree

abstract: In this paper, we investigate a parking process on a uniform random rooted plane tree with $n$ vertices. Every vertex of the tree has a parking space for a single car. Cars arrive at independent uniformly random vertices of the tree. If the parking space at a vertex is unoccupied when a car arrives there, it parks. If not, the car drives towards the root and parks in the first empty space it encounters (if there is one). We are interested in asymptotics of the probability of the event that all cars can park when $\lfloor \alpha n \rfloor$ cars arrive, for $\alpha > 0$. We observe that there is a phase transition at $\alpha_c := \sqrt{2} -1$: if $\alpha < \alpha_c$ then the event has positive probability, whereas for $\alpha > \alpha_c$ it has probability 0. Analogous results have been proved by Lackner and Panholzer, Goldschmidt and Przykucki, and Jones for different underlying random tree models.


title: Adversarial Learning on the Latent Space for Diverse Dialog Generation

abstract: Generating relevant responses in a dialog is challenging, and requires not only proper modeling of context in the conversation but also being able to generate fluent sentences during inference. In this paper, we propose a two-step framework based on generative adversarial nets for generating conditioned responses. Our model first learns a meaningful representation of sentences by autoencoding and then learns to map an input query to the response representation, which is in turn decoded as a response sentence. Both quantitative and qualitative evaluations show that our model generates more fluent, relevant, and diverse responses than existing state-of-the-art methods.


title: Einstein's E = mc^2 derivable from Heisenberg's Uncertainty Relations

abstract: Heisenberg's uncertainty relation can be written in terms of the step-up and step-down operators in the harmonic oscillator representation. It is noted that the single-variable Heisenberg commutation relation contains the symmetry of the Sp(2) group which is isomorphic to the Lorentz group applicable to one time-like dimension and two space-like dimensions, known as the O(2,1) group. This group has three independent generators. The one-dimensional step-up and step-down operators can be combined into one two-by-two Hermitian matrix which contains three independent operators. If we use a two-variable Heisenberg commutation relation, the two pairs of independent step-up, step-down operators can be combined into a four-by-four block-diagonal Hermitian matrix with six independent parameters. It is then possible to add one off-diagonal two-by-two matrix and its Hermitian conjugate to complete the four-by-four Hermitian matrix. This off-diagonal matrix has four independent generators. There are thus ten independent generators. It is then shown that these ten generators can be linearly combined to the ten generators for the Dirac's two oscillator system leadingto the group isomorphic to the de Sitter group O(3,2), which can the be contracted to the inhomogeneous Lorentz group with four translation generators corresponding to the four-momentum in the Lorentz-covariant world. This Lorentz-covariant four-momentum is known as Einstein's E = mc^2.


title: Complexity and Emergence of Warped $\text{AdS}_3$ Space-time from Chiral Liouville Action

abstract: In this work we explore the complexity path integral optimization process for the case of warped $\text{AdS}_3$/warped $\text{CFT}_2$ correspondence. We first present the specific renormalization flow equations and analyze the differences with the case of CFT. We discuss how the "chiral Liouville action" could replace the Liouville action as the suitable cost function for this case. Starting from the other side of the story, we also show how the deformed Liouville actions could be derived from the spacelike, timelike and null warped metrics and how the behaviors of boundary topological terms creating these metrics, versus the deformation parameter are consistent with our expectations. As the main results of this work, we develop many holographic tools for the case of warped $\text{AdS}_3$, which include the tensor network structure for the chiral warped CFTs, entangler function, surface/state correspondence, quantum circuits of Kac-Moody algebra and kinematic space of WAdS/WCFTs. In addition, we discuss how and why the path-integral complexity should be generalized and propose several other examples such as Polyakov, p-adic strings and Zabrodin actions as the more suitable cost functions to calculate the circuit complexity.


title: A continuity of cycle integrals of modular functions

abstract: In this paper we study a continuity of the "values" of modular functions at the real quadratic numbers which are defined in terms of their cycle integrals along the associated closed geodesics. Our main theorem reveals a more finer structure of the continuity of these values with respect to continued fraction expansions and it turns out that it is different from the continuity with respect to Euclidean topology.


title: Adaptive Fusion Techniques for Multimodal Data

abstract: Effective fusion of data from multiple modalities, such as video, speech, and text, is challenging due to the heterogeneous nature of multimodal data. In this paper, we propose adaptive fusion techniques that aim to model context from different modalities effectively. Instead of defining a deterministic fusion operation, such as concatenation, for the network, we let the network decide "how" to combine a given set of multimodal features more effectively. We propose two networks: 1) Auto-Fusion, which learns to compress information from different modalities while preserving the context, and 2) GAN-Fusion, which regularizes the learned latent space given context from complementing modalities. A quantitative evaluation on the tasks of multimodal machine translation and emotion recognition suggests that our lightweight, adaptive networks can better model context from other modalities than existing methods, many of which employ massive transformer-based networks.


title: Generalizing Natural Language Analysis through Span-relation Representations

abstract: Natural language processing covers a wide variety of tasks predicting syntax, semantics, and information content, and usually each type of output is generated with specially designed architectures. In this paper, we provide the simple insight that a great variety of tasks can be represented in a single unified format consisting of labeling spans and relations between spans, thus a single task-independent model can be used across different tasks. We perform extensive experiments to test this insight on 10 disparate tasks spanning dependency parsing (syntax), semantic role labeling (semantics), relation extraction (information content), aspect based sentiment analysis (sentiment), and many others, achieving performance comparable to state-of-the-art specialized models. We further demonstrate benefits of multi-task learning, and also show that the proposed method makes it easy to analyze differences and similarities in how the model handles different tasks. Finally, we convert these datasets into a unified format to build a benchmark, which provides a holistic testbed for evaluating future models for generalized natural language analysis.


title: Translationese as a Language in "Multilingual" NMT

abstract: Machine translation has an undesirable propensity to produce "translationese" artifacts, which can lead to higher BLEU scores while being liked less by human raters. Motivated by this, we model translationese and original (i.e. natural) text as separate languages in a multilingual model, and pose the question: can we perform zero-shot translation between original source text and original target text? There is no data with original source and original target, so we train sentence-level classifiers to distinguish translationese from original target text, and use this classifier to tag the training data for an NMT model. Using this technique we bias the model to produce more natural outputs at test time, yielding gains in human evaluation scores on both accuracy and fluency. Additionally, we demonstrate that it is possible to bias the model to produce translationese and game the BLEU score, increasing it while decreasing human-rated quality. We analyze these models using metrics to measure the degree of translationese in the output, and present an analysis of the capriciousness of heuristically-based train-data tagging.


title: Packing $(1,1,2,2)$-coloring of some subcubic graphs

abstract: For a sequence of non-decreasing positive integers $S = (s_1, \ldots, s_k)$, a packing $S$-coloring is a partition of $V(G)$ into sets $V_1, \ldots, V_k$ such that for each $1\leq i \leq k$ the distance between any two distinct $x,y\in V_i$ is at least $s_i+1$. The smallest $k$ such that $G$ has a packing $(1,2, \ldots, k)$-coloring is called the packing chromatic number of $G$ and is denoted by $\chi_p(G)$. For a graph $G$, let $D(G)$ denote the graph obtained from $G$ by subdividing every edge. The question whether $\chi_p(D(G)) \le 5$ for all subcubic graphs was first asked by Gastineau and Togni and later conjectured by Bresar, Klavzar, Rall and Wash. Gastineau and Togni observed that if one can prove every subcubic graph except the Petersen graph is packing $(1,1,2,2)$-colorable then the conjecture holds. The maximum average degree, mad($G$), is defined to be $\max\{\frac{2|E(H)|}{|V(H)|}: H \subset G\}$. In this paper, we prove that subcubic graphs with $mad(G)<\frac{30}{11}$ are packing $(1,1,2,2)$-colorable. As a corollary, the conjecture of Bresar et al holds for every subcubic graph $G$ with $mad(G)<\frac{30}{11}$.


title: High-order accurate entropy stable nodal discontinuous Galerkin schemes for the ideal special relativistic magnetohydrodynamics

abstract: This paper studies high-order accurate entropy stable nodal discontinuous Galerkin (DG) schemes for the ideal special relativistic magnetohydrodynamics (RMHD). It is built on the modified RMHD equations with a particular source term, which is analogous to the Powell's eight-wave formulation and can be symmetrized so that an entropy pair is obtained. We design an affordable fully consistent two-point entropy conservative flux, which is not only consistent with the physical flux, but also maintains the zero parallel magnetic component, and then construct high-order accurate semi-discrete entropy stable DG schemes based on the quadrature rules and the entropy conservative and stable fluxes. They satisfy the semidiscrete entropy inequality for the given entropy pair and are integrated in time by using the high-order explicit strong stability preserving Runge-Kutta schemes to get further the fully-discrete nodal DG schemes. Extensive numerical tests are conducted to validate the accuracy and the ability to capture discontinuities of our schemes. Moreover, our entropy conservative flux is compared to an existing flux through some numerical tests. The results show that the zero parallel magnetic component in the numerical flux can help to decrease the error in the parallel magnetic component in one-dimensional tests, but two entropy conservative fluxes give similar results since the error in the magnetic field divergence seems dominated in the two-dimensional tests.


title: Drill-down: Interactive Retrieval of Complex Scenes using Natural Language Queries

abstract: This paper explores the task of interactive image retrieval using natural language queries, where a user progressively provides input queries to refine a set of retrieval results. Moreover, our work explores this problem in the context of complex image scenes containing multiple objects. We propose Drill-down, an effective framework for encoding multiple queries with an efficient compact state representation that significantly extends current methods for single-round image retrieval. We show that using multiple rounds of natural language queries as input can be surprisingly effective to find arbitrarily specific images of complex scenes. Furthermore, we find that existing image datasets with textual captions can provide a surprisingly effective form of weak supervision for this task. We compare our method with existing sequential encoding and embedding networks, demonstrating superior performance on two proposed benchmarks: automatic image retrieval on a simulated scenario that uses region captions as queries, and interactive image retrieval using real queries from human evaluators.


title: Online Optimization with Predictions and Non-convex Losses

abstract: We study online optimization in a setting where an online learner seeks to optimize a per-round hitting cost, which may be non-convex, while incurring a movement cost when changing actions between rounds. We ask: \textit{under what general conditions is it possible for an online learner to leverage predictions of future cost functions in order to achieve near-optimal costs?} Prior work has provided near-optimal online algorithms for specific combinations of assumptions about hitting and switching costs, but no general results are known. In this work, we give two general sufficient conditions that specify a relationship between the hitting and movement costs which guarantees that a new algorithm, Synchronized Fixed Horizon Control (SFHC), provides a $1+O(1/w)$ competitive ratio, where $w$ is the number of predictions available to the learner. Our conditions do not require the cost functions to be convex, and we also derive competitive ratio results for non-convex hitting and movement costs. Our results provide the first constant, dimension-free competitive ratio for online non-convex optimization with movement costs. Further, we give an example of a natural instance, Convex Body Chasing (CBC), where the sufficient conditions are not satisfied and we can prove that no online algorithm can have a competitive ratio that converges to 1.


title: Stylized Text Generation Using Wasserstein Autoencoders with a Mixture of Gaussian Prior

abstract: Wasserstein autoencoders are effective for text generation. They do not however provide any control over the style and topic of the generated sentences if the dataset has multiple classes and includes different topics. In this work, we present a semi-supervised approach for generating stylized sentences. Our model is trained on a multi-class dataset and learns the latent representation of the sentences using a mixture of Gaussian prior without any adversarial losses. This allows us to generate sentences in the style of a specified class or multiple classes by sampling from their corresponding prior distributions. Moreover, we can train our model on relatively small datasets and learn the latent representation of a specified class by adding external data with other styles/classes to our dataset. While a simple WAE or VAE cannot generate diverse sentences in this case, generated sentences with our approach are diverse, fluent, and preserve the style and the content of the desired classes.


title: Distilling Knowledge Learned in BERT for Text Generation

abstract: Large-scale pre-trained language model such as BERT has achieved great success in language understanding tasks. However, it remains an open question how to utilize BERT for language generation. In this paper, we present a novel approach, Conditional Masked Language Modeling (C-MLM), to enable the finetuning of BERT on target generation tasks. The finetuned BERT (teacher) is exploited as extra supervision to improve conventional Seq2Seq models (student) for better text generation performance. By leveraging BERT's idiosyncratic bidirectional nature, distilling knowledge learned in BERT can encourage auto-regressive Seq2Seq models to plan ahead, imposing global sequence-level supervision for coherent text generation. Experiments show that the proposed approach significantly outperforms strong Transformer baselines on multiple language generation tasks such as machine translation and text summarization. Our proposed model also achieves new state of the art on IWSLT German-English and English-Vietnamese MT datasets. Code is available at https://github.com/ChenRocks/Distill-BERT-Textgen.


title: Path independence of the additive functionals for McKean-Vlasov stochastic differential equations with jumps

abstract: In this article, the path independent property of additive functionals of McKean-Vlasov stochastic differential equations with jumps is characterised by nonlinear partial integro-differential equations involving $L$-derivatives with respect to probability measures introduced by P.-L. Lions. Our result extends the recent work [16] by Ren and Wang where their concerned McKean-Vlasov stochastic differential equations are driven by Brownian motions.


title: Manifold Denoising by Nonlinear Robust Principal Component Analysis

abstract: This paper extends robust principal component analysis (RPCA) to nonlinear manifolds. Suppose that the observed data matrix is the sum of a sparse component and a component drawn from some low dimensional manifold. Is it possible to separate them by using similar ideas as RPCA? Is there any benefit in treating the manifold as a whole as opposed to treating each local region independently? We answer these two questions affirmatively by proposing and analyzing an optimization framework that separates the sparse component from the manifold under noisy data. Theoretical error bounds are provided when the tangent spaces of the manifold satisfy certain incoherence conditions. We also provide a near optimal choice of the tuning parameters for the proposed optimization formulation with the help of a new curvature estimation method. The efficacy of our method is demonstrated on both synthetic and real datasets.


title: Strong measure zero in Polish groups

abstract: The notion of strong measure zero is studied in the context of Polish groups. In particular, the extent to which the theorem of Galvin, Mycielski and Solovay holds in the context of an arbitrary Polish group is studied. Hausdorff measure and dimension is used to characterize strong measure zero. The products of strong measure zero sets are examined. Sharp measure zero, a notion stronger that strong measure zero, is shown to be related to meageradditive sets in the Cantor set and Polish groups by a theorem very similar to the theorem of Galvin, Mycielski and Solovay.


title: Prospect Theoretic Analysis of Privacy-Preserving Mechanism

abstract: We study a problem of privacy-preserving mechanism design. A data collector wants to obtain data from individuals to perform some computations. To relieve the privacy threat to the contributors, the data collector adopts a privacy-preserving mechanism by adding random noise to the computation result, at the cost of reduced accuracy. Individuals decide whether to contribute data when faced with the privacy issue. Due to the intrinsic uncertainty in privacy protection, we model individuals' privacy-related decision using Prospect Theory. Such a theory more accurately models individuals' behavior under uncertainty than the traditional expected utility theory, whose prediction always deviates from practical human behavior. We show that the data collector's utility maximization problem involves a polynomial of high and fractional order, the root of which is difficult to compute analytically. We get around this issue by considering a large population approximation, and obtain a closed-form solution that well approximates the precise solution. We discover that the data collector who considers the more realistic Prospect Theory based individual decision modeling would adopt a more conservative privacy-preserving mechanism, compared with the case based on the expected utility theory modeling. We also study the impact of Prospect Theory parameters, and concludes that more loss-averse or risk-seeking individuals will trigger a more conservative mechanism. When individuals have different Prospect Theory parameters, simulations demonstrate that the privacy protection first becomes stronger and then becomes weaker as the heterogeneity increases from a low value to a high one.


title: Contextualized End-to-End Neural Entity Linking

abstract: We propose yet another entity linking model (YELM) which links words to entities instead of spans. This overcomes any difficulties associated with the selection of good candidate mention spans and makes the joint training of mention detection (MD) and entity disambiguation (ED) easily possible. Our model is based on BERT and produces contextualized word embeddings which are trained against a joint MD and ED objective. We achieve state-of-the-art results on several standard entity linking (EL) datasets.


title: Engineering the dissipation of crystalline micromechanical resonators

abstract: High quality micro- and nano-mechanical resonators are widely used in sensing, communications and timing, and have future applications in quantum technologies and fundamental studies of quantum physics. Crystalline thin-films are particularly attractive for such resonators due to their prospects for high quality, intrinsic stress and yield strength, and low dissipation. However, when grown on a silicon substrate, interfacial defects arising from lattice mismatch with the substrate have been postulated to introduce additional dissipation. Here, we develop a new backside etching process for single crystal silicon carbide microresonators that allows us to quantitatively verify this prediction. By engineering the geometry of the resonators and removing the defective interfacial layer, we achieve quality factors exceeding a million in silicon carbide trampoline resonators at room temperature, a factor of five higher than without the removal of the interfacial defect layer. We predict that similar devices fabricated from ultrahigh purity silicon carbide and leveraging its high yield strength, could enable room temperature quality factors as high as $6\times10^9$


title: Influence of resonances on the noise performance of SQUID susceptometers

abstract: Scanning Superconducting Quantum Interference Device (SQUID) Susceptometry simultaneously images the local magnetic fields and susceptibilities above a sample with sub-micron spatial resolution. Further development of this technique requires a thorough understanding of the current, voltage, and flux characteristics of scanning SQUID susceptometers. These sensors often have striking anomalies in their current-voltage characteristics, which we believe to be due to electromagnetic resonances. The effect of these resonances on the performance of these SQUIDs is unknown. To explore the origin and impact of the resonances, we have developed a model that qualitatively reproduces the experimentally-determined current-voltage characteristics of our scanning SQUID susceptometers. We use this model to calculate the noise characteristics of SQUIDs of different designs. We find that the calculated ultimate flux noise is better in susceptometers with damping resistors that diminish the resonances than susceptometers without damping resistors. Such calculations will enable the optimization of the signal-to-noise characteristics of scanning SQUID susceptometers.


title: Foliations on the open $3$-ball by complete surfaces

abstract: When is a manifold a leaf of a complete closed foliation on the open unit ball? We give some answers to this question.


title: A Cotlar Type Maximal Function Associated With Fourier Multipliers

abstract: We prove the $L^p$ boundedness of a maximal operator associated with a dyadic frequency decomposition of a Fourier multiplier, under a weak regularity assumption.


title: In Vitro Fertilization (IVF) Cumulative Pregnancy Rate Prediction from Basic Patient Characteristics

abstract: Tens of millions of women suffer from infertility worldwide each year. In vitro fertilization (IVF) is the best choice for many such patients. However, IVF is expensive, time-consuming, and both physically and emotionally demanding. The first question that a patient usually asks before the IVF is how likely she will conceive, given her basic medical examination information. This paper proposes three approaches to predict the cumulative pregnancy rate after multiple oocyte pickup cycles. Experiments on 11,190 patients showed that first clustering the patients into different groups and then building a support vector machine model for each group can achieve the best overall performance. Our model could be a quick and economic approach for reliably estimating the cumulative pregnancy rate for a patient, given only her basic medical examination information, well before starting the actual IVF procedure. The predictions can help the patient make optimal decisions on whether to use her own oocyte or donor oocyte, how many oocyte pickup cycles she may need, whether to use embryo frozen, etc. They will also reduce the patient's cost and time to pregnancy, and improve her quality of life.


title: Transverse-Momentum-Dependent Parton Distribution Functions from Large-Momentum Effective Theory

abstract: We show that transverse-momentum-dependent parton distribution functions (TMDPDFs), important non-perturbative quantities for describing the properties of hadrons in high-energy scattering processes such as Drell-Yan and semi-inclusive deep-inelastic scattering with observed small transverse momentum, can be obtained from Euclidean QCD calculations in the framework of large-momentum effective theory (LaMET). We present a LaMET factorization of the Euclidean quasi-TMDPDFs in terms of the physical TMDPDFs and off-light-cone soft function at leading order in $1/P^z$ expansion, with the perturbative matching coefficient satisfying a renormalization group equation. We also discuss the implementation in lattice QCD with finite-length gauge links as well as the rapidity-regularization-independent factorization for Drell-Yan cross section.


title: Quantum Correction of the Wilson Line and Entanglement Entropy in the Pure AdS$_3$ Einstein Gravity Theory

abstract: We calculate the expectation value of the Wilson line in the pure AdS$_3$ Einstein gravity theory and also the entanglement entropy in the boundary theory. Our one-loop calculation of entanglement entropy shows a shift of the central charge 26. Finally, we show that the Wilson line provides the equivalent description to the boundary entanglement entropy. This equivalence leads to a concrete example of the building of "minimum surface=entanglement entropy".


title: Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation

abstract: Models often easily learn biases present in the training data, and their predictions directly reflect this bias. We analyze gender bias in dialogue data, and examine how this bias is actually amplified in subsequent generative chit-chat dialogue models. We measure gender bias in six existing dialogue datasets, and focus on the most biased one, the multi-player text-based fantasy adventure dataset LIGHT, as a testbed for our bias mitigation techniques. The LIGHT dataset is highly imbalanced with respect to gender, containing predominantly male characters, likely because it is entirely collected by crowdworkers and reflects common biases that exist in fantasy or medieval settings. We consider three techniques to mitigate gender bias: counterfactual data augmentation, targeted data collection, and bias controlled training. We show that our proposed techniques mitigate gender bias in LIGHT by balancing the genderedness of generated dialogue utterances and are particularly effective in combination. We quantify performance using various evaluation methods---such as quantity of gendered words, a dialogue safety classifier, and human studies---all of which show that our models generate less gendered, but equally engaging chit-chat responses.


title: Characterizing dynamically varying acoustic scenes from egocentric audio recordings in workplace setting

abstract: Devices capable of detecting and categorizing acoustic scenes have numerous applications such as providing context-aware user experiences. In this paper, we address the task of characterizing acoustic scenes in a workplace setting from audio recordings collected with wearable microphones. The acoustic scenes, tracked with Bluetooth transceivers, vary dynamically with time from the egocentric perspective of a mobile user. Our dataset contains experience sampled long audio recordings collected from clinical providers in a hospital, who wore the audio badges during multiple work shifts. To handle the long egocentric recordings, we propose a Time Delay Neural Network~(TDNN)-based segment-level modeling. The experiments show that TDNN outperforms other models in the acoustic scene classification task. We investigate the effect of primary speaker's speech in determining acoustic scenes from audio badges, and provide a comparison between performance of different models. Moreover, we explore the relationship between the sequence of acoustic scenes experienced by the users and the nature of their jobs, and find that the scene sequence predicted by our model tend to possess similar relationship. The initial promising results reveal numerous research directions for acoustic scene classification via wearable devices as well as egocentric analysis of dynamic acoustic scenes encountered by the users.


title: Magnetotransport properties of the layered CaAl2Si2 semimetal hosting multiple nontrivial topological states

abstract: Combination of different nontrivial topological states in a single material is capable of realizing multiple functionalities and exotic physics, but such materials are still very sparse. We report herein the results of magnetotransport measurements and ab initio calculations on single crystalline CaAl2Si2 semimetal. The transport properties could be well understood in connection with the two-band model, agreeing well with the theoretical calculations indicating four main sheets of Fermi surface consisting of three hole pockets centered at the {\Gamma} point and one electron pocket centered at the M point in the Brillouin zone. The single fundamental frequency imposed in the quantum oscillations of magnetoresistance corresponds to the electron Fermi pocket. Without spin-orbit coupling (SOC), the ab initio calculations suggest CaAl2Si2 as a system hosting a topological nodal-line setting around the {\Gamma} point in the Brillouin zone close to the Fermi level. Once including the SOC, the fragile nodal-line will be gapped and a pair of Dirac points emerge along the high symmetric {\Gamma}-A direction, which is about 1.22 eV below the Fermi level. The SOC can also induce a topological insulator state along the {\Gamma}-A direction with a gap of about 3 meV. The results demonstrate CaAl2Si2 as an excellent platform for the study of novel topological physics with multiple topological states.


title: Model-Based Reinforcement Learning with Adversarial Training for Online Recommendation

abstract: Reinforcement learning is well suited for optimizing policies of recommender systems. Current solutions mostly focus on model-free approaches, which require frequent interactions with the real environment, and thus are expensive in model learning. Offline evaluation methods, such as importance sampling, can alleviate such limitations, but usually request a large amount of logged data and do not work well when the action space is large. In this work, we propose a model-based reinforcement learning solution which models user-agent interaction for offline policy learning via a generative adversarial network. To reduce bias in the learned model and policy, we use a discriminator to evaluate the quality of generated data and scale the generated rewards. Our theoretical analysis and empirical evaluations demonstrate the effectiveness of our solution in learning policies from the offline and generated data.


title: Pressure-driven switching of magnetism in layered CrCl3

abstract: Layered transition-metal compounds with controllable magnetic behaviors provide many fascinating opportunities for the fabrication of high-performance magneto-electric and spintronic devices. The tuning of their electronic and magnetic properties is usually limited to the change of layer thickness, electrostatic doping, and the control of electric and magnetic fields. However, pressure has been rarely exploited as a control parameter for tailoring their magneto-electric properties. Here, we report a unique pressure-driven isostructural phase transition in layered CrCl3 accompanied by a simultaneous switching of magnetism from a ferromagnetic to an antiferromagnetic ordering. Our experiments, in combination with ab initio calculations, demonstrate that such a magnetic transformation hinders the band-gap collapse under pressure, leading to an anomalous semiconductor-to-semiconductor transition. Our findings not only reveal high potential of CrCl3 in electronic and spintronic applications under ambient and extreme conditions but also establish the basis for exploring unusual phase transitions in layered transition-metal compounds.


title: Power System Problems in Teaching Control Theory on Simulink

abstract: This experiment demonstrates to engineering students that control system and power system theory are not orthogonal, but highly interrelated. It introduces a real-world power system problem to enhance time domain State Space Modelling (SSM) skills of students. It also shows how power quality is affected with real-world scenarios. Power system was modeled in State Space by following its circuit topology in a bottom-up fashion. At two different time instances of the power generator sinusoidal wave, the transmission line was switched on. Fourier transform was used to analyze resulting line currents. It validated the harmonic components, as expected, from power system theory. Students understood the effects of switching transients at various times on supply voltage sinusoid within control theory and learned time domain analysis. They were surveyed to gauge their perception of the project. Results from a before/after assessment analyzed using T-Tests showed a statistically significant enhanced learning in SSM.


title: Embedded Neural Networks for Robot Autonomy

abstract: We present a library to automatically embed signal processing and neural network predictions into the material robots are made of. Deep and shallow neural network models are first trained offline using state-of-the-art machine learning tools and then transferred onto general purpose microcontrollers that are co-located with a robot's sensors and actuators. We validate this approach using multiple examples: a smart robotic tire for terrain classification, a robotic finger sensor for load classification and a smart composite capable of regressing impact source localization. In each example, sensing and computation are embedded inside the material, creating artifacts that serve as stand-in replacement for otherwise inert conventional parts. The open source software library takes as inputs trained model files from higher level learning software, such as Tensorflow/Keras, and outputs code that is readable in a microcontroller that supports C. We compare the performance of this approach for various embedded platforms. In particular, we show that low-cost off-the-shelf microcontrollers can match the accuracy of a desktop computer, while being fast enough for real-time applications at different neural network configurations. We provide means to estimate the maximum number of parameters that the hardware will support based on the microcontroller's specifications.


title: Minimalistic Attacks: How Little it Takes to Fool a Deep Reinforcement Learning Policy

abstract: Recent studies have revealed that neural network-based policies can be easily fooled by adversarial examples. However, while most prior works analyze the effects of perturbing every pixel of every frame assuming white-box policy access, in this paper we take a more restrictive view towards adversary generation - with the goal of unveiling the limits of a model's vulnerability. In particular, we explore minimalistic attacks by defining three key settings: (1) black-box policy access: where the attacker only has access to the input (state) and output (action probability) of an RL policy; (2) fractional-state adversary: where only several pixels are perturbed, with the extreme case being a single-pixel adversary; and (3) tactically-chanced attack: where only significant frames are tactically chosen to be attacked. We formulate the adversarial attack by accommodating the three key settings and explore their potency on six Atari games by examining four fully trained state-of-the-art policies. In Breakout, for example, we surprisingly find that: (i) all policies showcase significant performance degradation by merely modifying 0.01% of the input state, and (ii) the policy trained by DQN is totally deceived by perturbation to only 1% frames.


title: Not All Claims are Created Equal: Choosing the Right Statistical Approach to Assess Hypotheses

abstract: Empirical research in Natural Language Processing (NLP) has adopted a narrow set of principles for assessing hypotheses, relying mainly on p-value computation, which suffers from several known issues. While alternative proposals have been well-debated and adopted in other fields, they remain rarely discussed or used within the NLP community. We address this gap by contrasting various hypothesis assessment techniques, especially those not commonly used in the field (such as evaluations based on Bayesian inference). Since these statistical techniques differ in the hypotheses they can support, we argue that practitioners should first decide their target hypothesis before choosing an assessment method. This is crucial because common fallacies, misconceptions, and misinterpretation surrounding hypothesis assessment methods often stem from a discrepancy between what one would like to claim versus what the method used actually assesses. Our survey reveals that these issues are omnipresent in the NLP research community. As a step forward, we provide best practices and guidelines tailored to NLP research, as well as an easy-to-use package called 'HyBayes' for Bayesian assessment of hypotheses, complementing existing tools.


title: Misalignment of Magnetic Fields, Outflows and Discs in Star-forming Clouds

abstract: Using resistive magnetohydrodynamics simulations, the propagation of protostellar jets, the formation of circumstellar discs and the configuration of magnetic fields are investigated from the prestellar cloud phase until $\sim$500 yr after protostar formation. As the initial state, we prepare magnetized rotating clouds, in which the rotation axis is misaligned with the global magnetic field by an angle $\theta_0$. We calculate the cloud evolution for nine models with different $\theta_0 (=$ 0, 5, 10, 30, 45, 60, 80, 85, 90$^\circ$). Our simulations show that there is no significant difference in the physical quantities of the protostellar jet, such as the mass and momentum, among the models except for the model with $\theta_0=90^\circ$. On the other hand, the directions of the jet, disc normal and magnetic field are never aligned with each other during the early phase of star formation except for the model with $\theta_0=0^\circ$. Even when the rotation axis of the prestellar cloud is slightly inclined to the global magnetic field, the directions of the jet, disc normal and local magnetic field differ considerably, and they randomly change over time. Our results indicate that it is very difficult to extract any information from the observations of the directions of the outflow, disc and magnetic field at the scale of $\lesssim 1000$ au. Thus, we cannot use such observations to derive any restrictions on the star formation process.


title: HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networks

abstract: Quantization is an effective method for reducing memory footprint and inference time of Neural Networks, e.g., for efficient inference in the cloud, especially at the edge. However, ultra low precision quantization could lead to significant degradation in model generalization. A promising method to address this is to perform mixed-precision quantization, where more sensitive layers are kept at higher precision. However, the search space for a mixed-precision quantization is exponential in the number of layers. Recent work has proposed HAWQ, a novel Hessian based framework, with the aim of reducing this exponential search space by using second-order information. While promising, this prior work has three major limitations: (i) HAWQV1 only uses the top Hessian eigenvalue as a measure of sensitivity and do not consider the rest of the Hessian spectrum; (ii) HAWQV1 approach only provides relative sensitivity of different layers and therefore requires a manual selection of the mixed-precision setting; and (iii) HAWQV1 does not consider mixed-precision activation quantization. Here, we present HAWQV2 which addresses these shortcomings. For (i), we perform a theoretical analysis showing that a better sensitivity metric is to compute the average of all of the Hessian eigenvalues. For (ii), we develop a Pareto frontier based method for selecting the exact bit precision of different layers without any manual selection. For (iii), we extend the Hessian analysis to mixed-precision activation quantization. We have found this to be very beneficial for object detection. We show that HAWQV2 achieves new state-of-the-art results for a wide range of tasks.


title: Modelling Bahdanau Attention using Election methods aided by Q-Learning

abstract: Neural Machine Translation has lately gained a lot of "attention" with the advent of more and more sophisticated but drastically improved models. Attention mechanism has proved to be a boon in this direction by providing weights to the input words, making it easy for the decoder to identify words representing the present context. But by and by, as newer attention models with more complexity came into development, they involved large computation, making inference slow. In this paper, we have modelled the attention network using techniques resonating with social choice theory. Along with that, the attention mechanism, being a Markov Decision Process, has been represented by reinforcement learning techniques. Thus, we propose to use an election method ($k$-Borda), fine-tuned using Q-learning, as a replacement for attention networks. The inference time for this network is less than a standard Bahdanau translator, and the results of the translation are comparable. This not only experimentally verifies the claims stated above but also helped provide a faster inference.


title: r/Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detection

abstract: Fake news has altered society in negative ways in politics and culture. It has adversely affected both online social network systems as well as offline communities and conversations. Using automatic machine learning classification models is an efficient way to combat the widespread dissemination of fake news. However, a lack of effective, comprehensive datasets has been a problem for fake news research and detection model development. Prior fake news datasets do not provide multimodal text and image data, metadata, comment data, and fine-grained fake news categorization at the scale and breadth of our dataset. We present Fakeddit, a novel multimodal dataset consisting of over 1 million samples from multiple categories of fake news. After being processed through several stages of review, the samples are labeled according to 2-way, 3-way, and 6-way classification categories through distant supervision. We construct hybrid text+image models and perform extensive experiments for multiple variations of classification, demonstrating the importance of the novel aspect of multimodality and fine-grained classification unique to Fakeddit.


title: Correcting Sociodemographic Selection Biases for Population Prediction from Social Media

abstract: Social media is increasingly used for large-scale population predictions, such as estimating community health statistics. However, social media users are not typically a representative sample of the intended population -- a "selection bias". Within the social sciences, such a bias is typically addressed with restratification techniques, where observations are reweighted according to how under- or over-sampled their socio-demographic groups are. Yet, restratifaction is rarely evaluated for improving prediction. In this two-part study, we first evaluate standard, "out-of-the-box" restratification techniques, finding they provide no improvement and often even degraded prediction accuracies across four tasks of esimating U.S. county population health statistics from Twitter. The core reasons for degraded performance seem to be tied to their reliance on either sparse or shrunken estimates of each population's socio-demographics. In the second part of our study, we develop and evaluate Robust Poststratification, which consists of three methods to address these problems: (1) estimator redistribution to account for shrinking, as well as (2) adaptive binning and (3) informed smoothing to handle sparse socio-demographic estimates. We show that each of these methods leads to significant improvement in prediction accuracies over the standard restratification approaches. Taken together, Robust Poststratification enables state-of-the-art prediction accuracies, yielding a 53.0% increase in variance explained (R^2) in the case of surveyed life satisfaction, and a 17.8% average increase across all tasks.


title: The hydroxyl satellite-line `flip' as a tracer of expanding HII regions

abstract: Observations of the four $^{2}\Pi_{3/2},~J = 3/2$~ground state transitions of the hydroxyl radical (OH) have emerged as an informative tracer of molecular gas in the Galactic ISM. We discuss an OH spectral feature known as the `flip', in which the satellite lines at 1612 and 1720\,MHz flip -- one from emission to absorption and the other the reverse -- across a closely blended double feature. We highlight 30 examples of the flip from the literature, 27 of which exhibit the same orientation with respect to velocity: the 1720\,MHz line is seen in emission at more negative velocities. These same examples are also observed toward bright background continuum, many (perhaps all) show stimulated emission, and 23 of these are coincident in on-sky position and velocity with H\textsc{ii}~radio recombination lines. To explain these remarkable correlations we propose that the 1720\,MHz stimulated emission originates in heated and compressed post-shock gas expanding away from a central H\textsc{ii}~region, which collides with cooler and more diffuse gas hosting the 1612\,MHz stimulated emission. The foreground gas dominates the spectrum due to the bright central continuum, hence the expanding post-shock gas is blue-shifted relative to the stationary pre-shock gas. We employ non-LTE excitation modelling to examine this scenario, and find that indeed FIR emission from warm dust adjacent to the H\textsc{ii}~region radiatively pumps the 1612 MHz line in the diffuse, cool gas ahead of the expanding shock front, while collisional pumping in the warm, dense shocked gas inverts the 1720 MHz line.


title: Multiphoton blockade in the two-photon Jaynes-Cummings model

abstract: We study multiphoton blockade and photon-induced tunneling effects in the two-photon Jaynes-Cummings model, where a single-mode cavity field and a two-level atom are coupled via a two-photon interaction. We consider both the cavity-field-driving and atom-driving cases, and find that single-photon blockade and photon-induced tunneling effects can be observed when the cavity mode is driven, while the two-photon blockade effect appears when the atom is driven. For the atom-driving case (the two-photon transition process), we present a criterion of the correlation functions for the multiphoton blockade effect. Specifically, we show that quantum interference can enhance the photon blockade effect in the single-photon cavity-field-driving case. Our results are confirmed by analytically and numerically calculating the correlation function of the cavity-field mode. Our work has potential applications in quantum information processing and paves the way for the study of multiphoton quantum coherent devices.


title: Ar{\i}kan meets Shannon: Polar codes with near-optimal convergence to channel capacity

abstract: Let $W$ be a binary-input memoryless symmetric (BMS) channel with Shannon capacity $I(W)$ and fix any $\alpha > 0$. We construct, for any sufficiently small $\delta > 0$, binary linear codes of block length $O(1/\delta^{2+\alpha})$ and rate $I(W)-\delta$ that enable reliable communication on $W$ with quasi-linear time encoding and decoding. Shannon's noisy coding theorem established the \emph{existence} of such codes (without efficient constructions or decoding) with block length $O(1/\delta^2)$. This quadratic dependence on the gap $\delta$ to capacity is known to be best possible. Our result thus yields a constructive version of Shannon's theorem with near-optimal convergence to capacity as a function of the block length. This resolves a central theoretical challenge associated with the attainment of Shannon capacity. Previously such a result was only known for the erasure channel. Our codes are a variant of Ar{\i}kan's polar codes based on multiple carefully constructed local kernels, one for each intermediate channel that arises in the decoding. A crucial ingredient in the analysis is a strong converse of the noisy coding theorem when communicating using random linear codes on arbitrary BMS channels. Our converse theorem shows extreme unpredictability of even a single message bit for random coding at rates slightly above capacity.


title: Collision-free spatial motion of rigid bodies via topological complexity

abstract: The Topological complexity a la Farber $\text{TC}(-)$ is a homotopy invariant which have interesting applications in Robotics, specifically, in the robot motion planning problem. In this work we calculate the topological complexity of the configuration space of $k$ distinct rigid bodies without collisions in $\mathbb{R}^d$, for $d=2,3$. Furthermore, we present optimal algorithms which can be used in designing practical systems controlling motion of many rigid bodies moving in space without collisions. The motion planning algorithms we present in this work are easily implementable in practice.