title: Continuous-in-Depth Neural Networks

abstract: Recent work has attempted to interpret residual networks (ResNets) as one step of a forward Euler discretization of an ordinary differential equation, focusing mainly on syntactic algebraic similarities between the two systems. Discrete dynamical integrators of continuous dynamical systems, however, have a much richer structure. We first show that ResNets fail to be meaningful dynamical integrators in this richer sense. We then demonstrate that neural network models can learn to represent continuous dynamical systems, with this richer structure and properties, by embedding them into higher-order numerical integration schemes, such as the Runge Kutta schemes. Based on these insights, we introduce ContinuousNet as a continuous-in-depth generalization of ResNet architectures. ContinuousNets exhibit an invariance to the particular computational graph manifestation. That is, the continuous-in-depth model can be evaluated with different discrete time step sizes, which changes the number of layers, and different numerical integration schemes, which changes the graph connectivity. We show that this can be used to develop an incremental-in-depth training scheme that improves model quality, while significantly decreasing training time. We also show that, once trained, the number of units in the computational graph can even be decreased, for faster inference with little-to-no accuracy drop.


title: A restricted superposition principle for (non-)linear Fokker-Planck-Kolmogorov equations on Hilbert spaces

abstract: We prove a version of the Ambrosio-Figalli-Trevisan superposition principle for a restricted subclass of solutions to the Fokker-Planck-Kolmogorov equation, that is valid on separable infinite-dimensional Hilbert spaces. Furthermore, we transfer this restricted superposition principle into a nonlinear setting.


title: Long Time Dynamics for Combustion in Random Media

abstract: We study long time dynamics of combustive processes in random media, modeled by reaction-diffusion equations with random ignition reactions. One expects that under reasonable hypotheses on the randomness, large space-time scale dynamics of solutions to these equations is almost surely governed by a different effective PDE, which should be a homogeneous Hamilton-Jacobi equation. While this was previously proved in one dimension as well as for isotropic reactions in several dimensions (i.e., with radially symmetric laws), we provide here the first proof of this phenomenon in the general non-isotropic multidimensional setting. Our results hold for reactions that have finite ranges of dependence (i.e., their values are independent at sufficiently distant points in space) as well as for some with infinite ranges of dependence, and are based on proving existence of deterministic front (propagation) speeds in all directions for these reactions.


title: The Discovery of lambda Bootis Stars -- The Southern Survey II

abstract: The $\lambda$ Boo stars are chemically peculiar A-type stars whose abundance anomalies are associated with the accretion of metal-poor material. We searched for $\lambda$ Boo stars in the southern hemisphere in a targeted spectroscopic survey of metal-weak and emission-line stars. Obtaining spectra for 308 stars and classifying them on the MK system, we found or co-discovered 24 new $\lambda$ Boo stars. We also revised the classifications of 11 known $\lambda$ Boo stars, one of which turned out to be a chemically normal rapid rotator. We show that stars previously classified in the literature as blue horizontal branch stars or emission-line A stars have a high probability of being $\lambda$ Boo stars, although this conclusion is based on small-number statistics. Using WISE infrared fluxes, we searched our targets for infrared excesses that might be attributable to protoplanetary or debris discs as the source of the accreted material. Of the 34 $\lambda$ Boo stars in our sample, 21 at various main-sequence ages have infrared excesses, confirming that not all $\lambda$ Boo stars are young.


title: The common origin of the family mass hierarchy and CP violation from flavour-dependent vacuum for quarks and leptons

abstract: We rewrite the Yukawa interactions of the standard model in terms of flavour-dependent vacuum structure to address the family mass hierarchy and CP violation in both the quark sector and lepton sector. It is realized for the first time that the Lagrangian only includes the same number of degrees of freedom as phenomenological observables with no requirement of extra particles or any new symmetry. The quark and lepton mass hierarchy arises as a natural result of the close-to-flat vacuum in flavour space. The CP violation in CKM and PMNS is explained as a general quantum phase between weak gauge eigenstates and Yukawa interaction states. The mechanism is proven by reproduction of all current quark/lepton mass data and the CKM/PMNS flavour mixings.


title: Open Systems: A Double Categorical Perspective

abstract: Fong developed `decorated cospans' to model various kinds of open systems: that is, systems with inputs and outputs. In this framework, open systems are seen as the morphisms of a category and can be composed as such, allowing larger open systems to be built up from smaller ones. Much work has already been done in this direction, but there is a problem: the notion of isomorphism between decorated cospans is often too restrictive. Here we introduce and compare two ways around this problem: structured cospans, and a new version of decorated cospans. Structured cospans are very simple: given a functor $L \colon \mathsf{A} \to \mathsf{X}$, a `structured cospan' is a diagram in $\mathsf{X}$ of the form $L(a) \rightarrow x \leftarrow L(b)$. If $\mathsf{A}$ and $\mathsf{X}$ have finite colimits and $L$ is a left adjoint, there is a symmetric monoidal category whose objects are those of $\mathsf{A}$ and whose morphisms are isomorphism classes of structured cospans. However, this category arises from a more fundamental structure: a symmetric monoidal double category. Under certain conditions this symmetric monoidal double category is equivalent to one built using our new version of decorated cospans. We apply these ideas to symmetric monoidal double categories of open electrical circuits, open Markov processes and open Petri nets.


title: A simple relationship for the spectro-temporal structure of bursts from FRB 121102

abstract: We consider a simple dynamical and relativistic model to explain the spectro-temporal structure often displayed by repeating fast radio bursts (FRBs). We show how this model can account for the downward frequency drift in a sequence of sub-bursts of increasing arrival time (the "sad trombone" effect) and their tendency for exhibiting a reduced pulse width with increasing frequency of observation. Most importantly, this model also predicts a systematic inverse relationship between the (steeper) slope of the frequency drift observed within a single sub-burst and its temporal duration. Using already published data for FRB 121102 we find and verify the relationship predicted by this model. We therefore argue that the overall behaviour observed for this object as a function of frequency is consistent with an underlying narrow-band emission process, where the wide-band nature of the measured FRB spectrum is due to relativistic motions. Although this scenario and the simple dynamics we consider could be applied to other theories, they are well-suited for a model based upon Dicke's superradiance as the physical process responsible for FRB radiation in this and similar sources.


title: Learning Illumination from Diverse Portraits

abstract: We present a learning-based technique for estimating high dynamic range (HDR), omnidirectional illumination from a single low dynamic range (LDR) portrait image captured under arbitrary indoor or outdoor lighting conditions. We train our model using portrait photos paired with their ground truth environmental illumination. We generate a rich set of such photos by using a light stage to record the reflectance field and alpha matte of 70 diverse subjects in various expressions. We then relight the subjects using image-based relighting with a database of one million HDR lighting environments, compositing the relit subjects onto paired high-resolution background imagery recorded during the lighting acquisition. We train the lighting estimation model using rendering-based loss functions and add a multi-scale adversarial loss to estimate plausible high frequency lighting detail. We show that our technique outperforms the state-of-the-art technique for portrait-based lighting estimation, and we also show that our method reliably handles the inherent ambiguity between overall lighting strength and surface albedo, recovering a similar scale of illumination for subjects with diverse skin tones. We demonstrate that our method allows virtual objects and digital characters to be added to a portrait photograph with consistent illumination. Our lighting inference runs in real-time on a smartphone, enabling realistic rendering and compositing of virtual objects into live video for augmented reality applications.


title: DANA: Dimension-Adaptive Neural Architecture for Multivariate Sensor Data

abstract: Motion sensors embedded in wearable and mobile devices allow for dynamic selection of sensor streams and sampling rates, enabling several applications, such as power management and data-sharing control. While deep neural networks (DNNs) achieve competitive accuracy in sensor data classification, DNNs generally process incoming data from a fixed set of sensors with a fixed sampling rate, and changes in the dimensions of their inputs cause considerable accuracy loss, unnecessary computations, or failure in operation. We introduce a dimension-adaptive pooling (DAP) layer that makes DNNs flexible and more robust to changes in sensor availability and in sampling rate. DAP operates on convolutional filter maps of variable dimensions and produces an input of fixed dimensions suitable for feedforward and recurrent layers. We also propose a dimension-adaptive training (DAT) procedure for enabling DNNs that use DAP to better generalize over the set of feasible data dimensions at inference time. DAT comprises the random selection of dimensions during the forward passes and optimization with accumulated gradients of several backward passes. Combining DAP and DAT, we show how to transform non-adaptive DNNs into a Dimension-Adaptive Neural Architecture (DANA), while keeping the same number of parameters. Compared to existing approaches, our solution provides better classification accuracy over the range of possible data dimensions at inference time and does not require up-sampling or imputation, thus reducing unnecessary computations. Experiments on seven datasets (four benchmark real-world datasets for human activity recognition and three synthetic datasets) show that DANA prevents significant losses in classification accuracy of the state-of-the-art DNNs and, compared to baselines, it better captures correlated patterns in sensor data under dynamic sensor availability and varying sampling rates.


title: An Evolver program for weighted Steiner trees

abstract: We present an algorithm to find near-optimal weighted Steiner minimal trees in the plane. The algorithm is implemented in Evolver programming language, which already contains many built-in energy minimisation routines. Some are invoked in the program, which enable it to consist of only 183 lines of source code. Our algorithm reproduces the physical experiment of a soap film detaching from connected pins towards a stable configuration. In the non-weighted case comparisons with GeoSteiner are drawn for terminals that form a pattern.


title: Optimization Fabrics

abstract: This paper presents a theory of optimization fabrics, second-order differential equations that encode nominal behaviors on a space and can be used to define the behavior of a smooth optimizer. Optimization fabrics can encode commonalities among optimization problems that reflect the structure of the space itself, enabling smooth optimization processes to intelligently navigate each problem even when optimizing simple naive potential functions. Importantly, optimization over a fabric is inherently asymptotically stable. The majority of this paper is dedicated to the development of a tool set for the design and use of a broad class of fabrics called geometric fabrics. Geometric fabrics encode behavior as general nonlinear geometries which are covariant second-order differential equations with a special homogeneity property that ensures their behavior is independent of the system's speed through the medium. A class of Finsler Lagrangian energies can be used to both define how these nonlinear geometries combine with one another and how they react when potential functions force them from their nominal paths. Furthermore, these geometric fabrics are closed under the standard operations of pullback and combination on a transform tree. For behavior representation, this class of geometric fabrics constitutes a broad class of spectral semi-sprays (specs), also known as Riemannian Motion Policies (RMPs) in the context of robotic motion generation, that captures both the intuitive separation between acceleration policy and priority metric critical for modular design and are inherently stable. Therefore, geometric fabrics are safe and easier to use by less experienced behavioral designers. Application of this theory to policy representation and generalization in learning are discussed as well.


title: Accuracy and Resiliency of Analog Compute-in-Memory Inference Engines

abstract: Recently, analog compute-in-memory (CIM) architectures based on emerging analog non-volatile memory (NVM) technologies have been explored for deep neural networks (DNN) to improve energy efficiency. Such architectures, however, leverage charge conservation, an operation with infinite resolution, and thus are susceptible to errors. The computations in DNN realized by analog NVM thus have high uncertainty due to the device stochasticity. Several reports have demonstrated the use of analog NVM for CIM in a limited scale. It is unclear whether the uncertainties in computations will prohibit large-scale DNNs. To explore this critical issue of scalability, this paper first presents a simulation framework to evaluate the feasibility of large-scale DNNs based on CIM architecture and analog NVM. Simulation results show that DNNs trained for high-precision digital computing engines are not resilient against the uncertainty of the analog NVM devices. To avoid such catastrophic failures, this paper introduces the analog floating-point representation for the DNN, and the Hessian-Aware Stochastic Gradient Descent (HA-SGD) training algorithm to enhance the inference accuracy of trained DNNs. As a result of such enhancements, DNNs such as Wide ResNets for the CIFAR-100 image recognition problem are demonstrated to have significant performance improvements in accuracy without adding cost to the inference hardware.


title: StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows

abstract: High-quality, diverse, and photorealistic images can now be generated by unconditional GANs (e.g., StyleGAN). However, limited options exist to control the generation process using (semantic) attributes, while still preserving the quality of the output. Further, due to the entangled nature of the GAN latent space, performing edits along one attribute can easily result in unwanted changes along other attributes. In this paper, in the context of conditional exploration of entangled latent spaces, we investigate the two sub-problems of attribute-conditioned sampling and attribute-controlled editing. We present StyleFlow as a simple, effective, and robust solution to both the sub-problems by formulating conditional exploration as an instance of conditional continuous normalizing flows in the GAN latent space conditioned by attribute features. We evaluate our method using the face and the car latent space of StyleGAN, and demonstrate fine-grained disentangled edits along various attributes on both real photographs and StyleGAN generated images. For example, for faces, we vary camera pose, illumination variation, expression, facial hair, gender, and age. Finally, via extensive qualitative and quantitative comparisons, we demonstrate the superiority of StyleFlow to other concurrent works.


title: Thirteen years of Weather Statistics at San Pedro Martir Observatory

abstract: We present weather statistics for thirteen years of data gathered with the meteorological stations at Observatorio Astron\'omico Nacional in the Sierra San Pedro M\'artir (OAN-SPM) over the period 2007-2019. These weather stations include sensors that measure temperature, atmospheric pressure, relative humidity, precipitation and wind conditions, among other climatological variables. The median values of the air temperature are $10.3^{\circ}$ C and $7.0^{\circ}$ C for daytime and nighttime, respectively. The relative humidity follows a seasonal variation with April-June being the driest months while July-September being the most humid. The median values for the sustained wind speed are 11 and 14 km hr$^{-1}$ for daytime and nighttime data, respectively. Preferred wind directions are SSW and North. Sustained winds are stronger at night and during December, January and February. Our data indicate an annual mean rain precipitation of 313 mm, most of which occurs during the summer season as afternoon thunderstorms.


title: Second-Harmonic Young Interference in Atom-Thin Heterocrystals

abstract: Optical second-harmonic generation (SHG) is a nonlinear parametric process that doubles the frequency of incoming light. Only allowed in non-centrosymmetric materials, it has been widely used in frequency modulation of lasers, surface scientific investigation, and label-free imaging in biological and medical sciences. Two-dimensional crystals are ideal SHG-materials not only for their strong light-matter interaction and atomic thickness defying the phase-matching requirement but also for their stackability into customized hetero-crystals with high angular precision and material diversity. Here we directly show that SHG in hetero-bilayers of transition metal dichalcogenides (TMDs) is governed by optical interference between two coherent SH fields with material-dependent phase delays using spectral phase interferometry. We also quantify the frequency-dependent phase difference between MoS2 and WS2, which also agrees with polarization-resolved data and first-principles calculations on complex susceptibility. The second-harmonic analogue of Young double-slit interference shown in this work demonstrates the potential of custom-designed parametric generation by atom-thick nonlinear optical materials.


title: Baryons Shaping Dark Matter Haloes

abstract: In this work we aim at investigating the effects of baryons on the dark matter (DM) haloes structure, focusing on the correlation between the presence and importance of stellar discs and the halo shapes. We study the properties of a subsample of DM haloes from Fenix and EAGLE cosmological simulations. We inspect the central regions of haloes in the mass range [10.9 - 992.3] x 10^{10} Msun at z=0, comparing the hydrodynamic runs and their dark matter only (DMo) counterparts. Our results indicate that baryons have a significant impact on the shape of the inner halo, mainly within ~ 20 percent of the virial radius. We find haloes to be more spherical when hosting baryons. While the impact of baryons depends on the mass of the haloes, we also find a trend with morphology which suggests that the way baryons are assembled is also relevant in agreement with previous works. Our findings also indicate that disc galaxies preferentially form in haloes whose DMo counterparts were originally more spherical and with stronger velocity anisotropy. The presence of baryons alter the orbital structure of the DM particles of the haloes, which show a decrease in their velocity anisotropy, towards more tangentially biased orbits. This relative decrease is weaker in the case of disc-dominated galaxies. Our results point out to a cosmological connection between the final morphology of galaxies and the intrinsic properties of their DM haloes, which gets reinforce by the growth of the discs.


title: Research on PM emission and energy consumption of mixed traffic flow based on cellular automata FI model

abstract: Traffic congestion leads to a sharp increase in fuel consumption and exhaust emissions, which easily leads to air pollution and fuel waste. Based on Fukui-Ishibashi (FI) model, this paper studies particulate matter(PM) emission and energy dissipation of traffic flow by considering the maximum speed, mixing ratio and random slowing probability. Simulation results show that the energy dissipation of the traffic flow consisting of the same length and different maximum velocity is associated with the maximum velocity. The greater the maximum velocity, the more the energy consumes. When the maximum velocity is different, the PM emission is similar to the change of energy consumption. Moreover, for the same maximum velocity and different mixing ratio, the energy dissipation and the PM emission related to the mixing ratio. There are the maximum fuel consumption and emission value in the maximum flow. For the same maximum velocity and length of vehicles, their energy consumption and emission are determined by random slowing probability.


title: SU(N)1 Chern-Simons theory, the Clifford group, and Entropy Cone

abstract: Entropy cones for SU(N)1 Chern-Simons theory are discussed. It is shown that stabilizer states can be constructed from topological operators in SU(N)1 for N odd prime, but not for SU(N)K; K >= 2. This implies that the topological entropy cone is properly contained in the stabilizer entropy cone for SU(N)K; K >= 2.


title: Bifurcation for a free boundary problem modeling a small arterial plaque

abstract: Atherosclerosis, hardening of the arteries, originates from small plaque in the arteries; it is a major cause of disability and premature death in the United States and worldwide. In this paper, we study the bifurcation of a highly nonlinear and highly coupled PDE model describing the growth of arterial plaque in the early stage of atherosclerosis. The model involves LDL and HDL cholesterols, macrophage cells as well as foam cells, with the interface separating the plaque and blood flow regions being a free boundary. We establish finite branches of symmetry-breaking stationary solutions which bifurcate from the radially symmetric solution. Since plaque in reality is unlikely to be strictly radially symmetric, our result would be useful to explain the asymmetric shapes of plaque.


title: Central limit theorems for spatial averages of the stochastic heat equation via Malliavin-Stein's method

abstract: Suppose that $\{u(t\,, x)\}_{t >0, x \in\mathbb{R}^d}$ is the solution to a $d$-dimensional stochastic heat equation driven by a Gaussian noise that is white in time and has a spatially homogeneous covariance that satisfies Dalang's condition. The purpose of this paper is to establish quantitative central limit theorems for spatial averages of the form $N^{-d} \int_{[0,N]^d} g(u(t\,,x))\, \mathrm{d} x$, as $N\rightarrow\infty$, where $g$ is a Lipschitz-continuous function or belongs to a class of locally-Lipschitz functions, using a combination of the Malliavin calculus and Stein's method for normal approximations. Our results include a central limit theorem for the {\it Hopf-Cole} solution to KPZ equation. We also establish a functional central limit theorem for these spatial averages.


title: Stability of Conical Shocks in the Three-Dimensional Steady Supersonic Isothermal Flows past Lipschitz Perturbed Cones

abstract: We are concerned with the structural stability of conical shocks in the three-dimensional steady supersonic flows past Lipschitz perturbed cones whose vertex angles are less than the critical angle. The flows under consideration are governed by the steady isothermal Euler equations for potential flow with axisymmetry so that the equations contain a singular geometric source term. We first formulate the shock stability problem as an initial-boundary value problem with the leading conical shock-front as a free boundary, and then establish the existence and asymptotic behavior of global entropy solutions of bounded variation (BV) of the problem. To achieve this, we first develop a modified Glimm scheme to construct approximate solutions via self-similar solutions as building blocks in order to incorporate with the geometric source term. Then we introduce the Glimm-type functional, based on the local interaction estimates between weak waves, the strong leading conical shock, and self-similar solutions, as well as the estimates of the center changes of the self-similar solutions. To make sure the decreasing of the Glimm-type functional, we choose appropriate weights by careful asymptotic analysis of the reflection coefficients in the interaction estimates, when the Mach number of the incoming flow is sufficiently large. Finally, we establish the existence of global entropy solutions involving a strong leading conical shock-front, besides weak waves, under the conditions that the Mach number of the incoming flow is sufficiently large and the weighted total variation of the slopes of the generating curve of the Lipschitz perturbed cone is sufficiently small. Furthermore, the entropy solution is shown to approach asymptotically the self-similar solution that is determined by the incoming flow and the asymptotic tangent of the cone boundary at infinity.


title: An Extremal Problem on Rainbow Spanning Trees in Graphs

abstract: A spanning tree of an edge-colored graph is rainbow provided that each of its edges receives a distinct color. In this paper we consider the natural extremal problem of maximizing and minimizing the number of rainbow spanning trees in a graph $G$. Such a question clearly needs restrictions on the colorings to be meaningful. For edge-colorings using $n-1$ colors and without rainbow cycles, known in the literature as JL-colorings, there turns out to be a particularly nice way of counting the rainbow spanning trees and we solve this problem completely for JL-colored complete graphs $K_n$ and complete bipartite graphs $K_{n,m}$. In both cases, we find tight upper and lower bounds; the lower bound for $K_n$, in particular, proves to have an unexpectedly chaotic and interesting behavior. We further investigate this question for JL-colorings of general graphs and prove several results including characterizing graphs which have JL-colorings achieving the lowest possible number of rainbow spanning trees. We establish other results for general $n-1$ colorings, including providing an analogue of Kirchoff's matrix tree theorem which yields a way of counting rainbow spanning trees in a general graph $G$.


title: A universal 3D imaging sensor on a silicon photonics platform

abstract: Accurate 3D imaging is essential for machines to map and interact with the physical world. While numerous 3D imaging technologies exist, each addressing niche applications with varying degrees of success, none have achieved the breadth of applicability and impact that digital image sensors have achieved in the 2D imaging world. A large-scale two-dimensional array of coherent detector pixels operating as a light detection and ranging (LiDAR) system could serve as a universal 3D imaging platform. Such a system would offer high depth accuracy and immunity to interference from sunlight, as well as the ability to directly measure the velocity of moving objects. However, due to difficulties in providing electrical and photonic connections to every pixel, previous systems have been restricted to fewer than 20 pixels. Here, we demonstrate the first large-scale coherent detector array consisting of 512 ($32 \times 16$) pixels, and its operation in a 3D imaging system. Leveraging recent advances in the monolithic integration of photonic and electronic circuits, a dense array of optical heterodyne detectors is combined with an integrated electronic readout architecture, enabling straightforward scaling to arbitrarily large arrays. Meanwhile, two-axis solid-state beam steering eliminates any tradeoff between field of view and range. Operating at the quantum noise limit, our system achieves an accuracy of $3.1~\mathrm{mm}$ at a distance of 75 metres using only $4~\mathrm{mW}$ of light, an order of magnitude more accurate than existing solid-state systems at such ranges. Future reductions of pixel size using state-of-the-art components could yield resolutions in excess of 20 megapixels for arrays the size of a consumer camera sensor. This result paves the way for the development and proliferation of low cost, compact, and high performance 3D imaging cameras.


title: Artificial magnetic field for synthetic quantum matter without dynamical modulation

abstract: We propose an all-static method to realize an artificial magnetic field for charge neutral particles without introducing any time modulation. Our proposal consists of one-dimensional tubes subject to harmonic trapping potentials with shifted centers. We show that this setup realizes an artificial magnetic field in a hybrid real-momentum space. We discuss how characteristic features of particles in a magnetic field, such as chiral edge states and the quantized Hall response, can be observed in this setup. We find that the mean-field ground state of bosons in this setup in the presence of long-range interactions in physical real space can have quantized vortices in the hybrid real-momentum space; such a state with vortices exhibits a supersolid structure in the physical real space. Our method can be applied to a variety of synthetic quantum matter, including ultracold atomic gases, coupled photonic cavities, coupled waveguides, and exciton-polariton lattices.


title: Impact of COVID-19 on Public Transit Accessibility and Ridership

abstract: Public transit is central to cultivating equitable communities. Meanwhile, the novel coronavirus disease COVID-19 and associated social restrictions has radically transformed ridership behavior in urban areas. Perhaps the most concerning aspect of the COVID-19 pandemic is that low-income and historically marginalized groups are not only the most susceptible to economic shifts but are also most reliant on public transportation. As revenue decreases, transit agencies are tasked with providing adequate public transportation services in an increasingly hostile economic environment. Transit agencies therefore have two primary concerns. First, how has COVID-19 impacted ridership and what is the new post-COVID normal? Second, how has ridership varied spatio-temporally and between socio-economic groups? In this work we provide a data-driven analysis of COVID-19's affect on public transit operations and identify temporal variation in ridership change. We then combine spatial distributions of ridership decline with local economic data to identify variation between socio-economic groups. We find that in Nashville and Chattanooga, TN, fixed-line bus ridership dropped by 66.9% and 65.1% from 2019 baselines before stabilizing at 48.4% and 42.8% declines respectively. The largest declines were during morning and evening commute time. Additionally, there was a significant difference in ridership decline between the highest-income areas and lowest-income areas (77% vs 58%) in Nashville.


title: Pseudospin symmetry and octupole correlations for multiple chiral doublets in 131Ba

abstract: A reflection-asymmetric triaxial particle rotor model with three quasiparticles and a reflection-asymmetric triaxial rotor is developed, and applied to investigate the observed multiple chiral doublets (M\c{hi}D) candidates with octupole correlations in 131Ba, i.e., two pairs of positive-parity bands D3-D4 and D5-D6, as well as one pair of negative-parity bands D7-D8. The energy spectra, the energy staggering parameters, the B(M1)/B(E2) ratios, and the B(E1)/B(E2) ratios are reproduced well. The chiral geometries for these M\c{hi}D candidates are examined by the azimuthal plots, and the evolution of chiral geometry with spin is clearly demonstrated. The intrinsic structure for the positive-parity bands is analyzed and the possible pseudospin-chiral quartet bands are suggested.


title: Network comparison and the within-ensemble graph distance

abstract: Quantifying the differences between networks is a challenging and ever-present problem in network science. In recent years a multitude of diverse, ad hoc solutions to this problem have been introduced. Here we propose that simple and well-understood ensembles of random networks (such as Erd\H{o}s-R\'{e}nyi graphs, random geometric graphs, Watts-Strogatz graphs, the configuration model, and preferential attachment networks) are natural benchmarks for network comparison methods. Moreover, we show that the expected distance between two networks independently sampled from a generative model is a useful property that encapsulates many key features of that model. To illustrate our results, we calculate this within-ensemble graph distance and related quantities for classic network models (and several parameterizations thereof) using 20 distance measures commonly used to compare graphs. The within-ensemble graph distance provides a new framework for developers of graph distances to better understand their creations and for practitioners to better choose an appropriate tool for their particular task.


title: Emergence of a sharp quantum collective mode in a one-dimensional Fermi polaron

abstract: The Fermi-polaron problem of a mobile impurity interacting with fermionic medium emerges in various contexts, ranging from the foundations of Landau's Fermi-liquid theory to electron-exciton interaction in semiconductors, to unusual properties of high-temperature superconductors. While classically the medium provides only a dissipative environment to the impurity, quantum picture of polaronic dressing is more intricate and arises from the interplay of few- and many-body aspects of the problem. The conventional expectation for the dynamics of Fermi polarons is that it is dissipative in character, and any excess energy is rapidly emitted away from the impurity as particle-hole excitations. Here we report a strikingly different type of polaron dynamics in a one-dimensional system of the impurity interacting repulsively with the fermions. When the total momentum of the system equals the Fermi momentum, there emerges a sharp collective mode corresponding to long-lived oscillations of the polaronic cloud surrounding the impurity. This mode can be observed experimentally with ultracold atoms using Ramsey interferometry and radio-frequency spectroscopy.


title: First-Principles Study of Two-Dimensional Ferroelectrics Using Self-Consistent Hubbard Parameters

abstract: The discovery of two-dimensional (2D) materials possessing switchable spontaneous polarization with atomic thickness opens up exciting opportunities to realize ultrathin, high-density electronic devices with potential applications ranging from memories and sensors to photocatalysis and solar cells. First-principles methods based on density functional theory (DFT) have facilitated the discovery and design of 2D ferroelectrics (FEs). However, DFT calculations employing local and semilocal exchange-correlation functionals failed to predict accurately the band gaps for this family of low-dimensional materials. Here, we present a DFT+$U$+$V$ study on 2D FEs represented by single-layer $\alpha$-In$_2$Se$_3$ and its homologous III$_2$-VI$_3$ compounds with both out-of-plane and in-plane polarization, using Hubbard parameters computed from first-principles. We find that ACBN0, a pseudo-hybrid density functional that allows self-consistent determination of $U$ parameters, improves the prediction of band gaps for all investigated 2D FEs with a computational cost much lower than the hybrid density functional. The inter-site Coulomb interaction $V$ becomes critical for accurate descriptions of the electronic structures of van der Waals heterostructures such as bilayer In$_2$Se$_3$ and In$_2$Se$_3$/InTe. Pertinent to the study of FE-based catalysis, we find that the application of self-consistent $U$ corrections can strongly affect the adsorption energies of open-shell molecules on the polar surfaces of 2D FEs.


title: Finding Equilibria in the Traffic Assignment Problem with Primal-Dual Gradient Methods for Stable Dynamics Model and Beckmann Model

abstract: In this paper we consider the application of several gradient methods to the traffic assignment problem: we search equilibria in the stable dynamics model (Nesterov and De Palma, 2003) and the Beckmann model. Unlike the celebrated Frank--Wolfe algorithm widely used for the Beckmann model, these gradients methods solve the dual problem and then reconstruct a solution to the primal one. We deal with the universal gradient method, the universal method of similar triangles, and the method of weighted dual averages, and estimate their complexity for the problem. Due to the primal-dual nature of these methods, we use a duality gap in a stopping criterion. In particular, we present a novel way to reconstruct admissible flows (i.e.,\ meeting the capacity constraints and induced by flows on the paths) in the stable dynamics model, which provides us with a computable duality gap.


title: Star-triangle type relations from $2d$ $\mathcal{N}=(0,2)$ $USp(2N)$ dualities

abstract: Inspired by the gauge/YBE correspondence this paper derives some star-triangle type relations from dualities in $2d$ $\mathcal{N}=(0,2)$ $USp(2N)$ supersymmetric quiver gauge theories. To be precise, we study two cases. The first case is the Intriligator-Pouliot duality in $2d$ $\mathcal{N}=(0,2)$ $USp(2N)$ theories. The description is performed explicitly for $N=1,2,3,4,5$ and also for $N=3k+2$, which generalizes the situation in $N=2,5$. For $N=1$ a triangle identity is obtained. For $N=2,5$ it is found that the realization of duality implies slight variations of a star-triangle relation type (STR type). The values $N=3,4$ are associated to a similar version of the asymmetric STR. The second case is a new duality for $2d$ $\mathcal{N}=(0,2)$ $USp(2N)$ theories with matter in the antisymmetric tensor representation that arises from dimensional reduction of $4d$ $\mathcal{N}=1$ $USp(2N)$ Cs\'aki-Skiba-Schmaltz duality. It is shown that this duality is associated to a triangle type identity for any value of $N$. In all cases Boltzmann weights as well as interaction and normalization factors are completely determined. Finally, our relations are compared with those previously reported in the literature.


title: Minimal Quantile Functions Subject to Stochastic Dominance Constraints

abstract: We consider a problem of finding an SSD (second-order stochastic dominance)-minimal quantile function subject to the mixture of FSD (first-order stochastic dominance) and SSD constraints. The SSD-minimal solution is explicitly worked out and has a close relation to the Skorokhod problem. This result is then applied to explicitly solve a risk minimizing problem in financial economics.


title: Cross-Model Image Annotation Platform with Active Learning

abstract: We have seen significant leapfrog advancement in machine learning in recent decades. The central idea of machine learnability lies on constructing learning algorithms that learn from good data. The availability of more data being made publicly available also accelerates the growth of AI in recent years. In the domain of computer vision, the quality of image data arises from the accuracy of image annotation. Labeling large volume of image data is a daunting and tedious task. This work presents an End-to-End pipeline tool for object annotation and recognition aims at enabling quick image labeling. We have developed a modular image annotation platform which seamlessly incorporates assisted image annotation (annotation assistance), active learning and model training and evaluation. Our approach provides a number of advantages over current image annotation tools. Firstly, the annotation assistance utilizes reference hierarchy and reference images to locate the objects in the images, thus reducing the need for annotating the whole object. Secondly, images can be annotated using polygon points allowing for objects of any shape to be annotated. Thirdly, it is also interoperable across several image models, and the tool provides an interface for object model training and evaluation across a series of pre-trained models. We have tested the model and embeds several benchmarking deep learning models. The highest accuracy achieved is 74%.


title: Equivariant Iwasawa theory for elliptic curves

abstract: We discuss abelian equivariant Iwasawa theory for elliptic curves over $\mathbb{Q}$ at good supersingular primes and non-anomalous good ordinary primes. Using Kobayashi's method, we construct equivariant Coleman maps, which send the Beilinson-Kato element to the equivariant $p$-adic $L$-functions. Then we propose equivariant main conjectures and, under certain assumptions, prove one divisibility via Euler system machinery. As an application, we prove a case of a conjecture of Mazur-Tate.


title: Electron shelving of a superconducting artificial atom

abstract: Interfacing stationary qubits with propagating photons is a fundamental problem in quantum technology. Cavity quantum electrodynamics (CQED) invokes a mediator degree of freedom in the form of a far-detuned cavity mode, the adaptation of which to superconducting circuits (cQED) proved remarkably fruitful. The cavity both blocks the qubit emission and it enables a dispersive readout of the qubit state. Yet, a more direct (cavityless) interface is possible with atomic clocks, in which an orbital cycling transition can scatter photons depending on the state of a hyperfine or quadrupole qubit transition. Originally termed "electron shelving", such a conditional fluorescence phenomenon is the cornerstone of many quantum information platforms, including trapped ions, solid state defects, and semiconductor quantum dots. Here we apply the shelving idea to circuit atoms and demonstrate a conditional fluorescence readout of fluxonium qubit placed inside a matched one-dimensional waveguide. Cycling the non-computational transition between ground and third excited states produces a microwave photon every 91 ns conditioned on the qubit ground state, while the qubit coherence time exceeds 50 us. The readout has a built-in quantum non-demolition property, allowing over 100 fluorescence cycles in agreement with a four-level optical pumping model. Our result introduces a resource-efficient alternative to cQED. It also adds a state-of-the-art quantum memory to the growing toolbox of waveguide QED.


title: Weakly positive and directed Anosov representations

abstract: Given a finitely generated group $\Gamma$, a directed graph $\Lambda$, and a map $R:\Lambda\to\Gamma$, we introduce the notion of an $(R,\Lambda)$-directed Anosov representation. This is a weakening of the notion of Anosov representations. Our main theorem gives a procedure to construct $(R,\Lambda)$-directed Anosov representations using Fock-Goncharov positivity. As an application of our main theorem, we construct large families of primitive stable representations from $F_2$ to $\mathrm{PGL}(V)$, including non-discrete and non-faithful examples.


title: Abundance of Primordial Black Holes in Peak Theory for an Arbitrary Power Spectrum

abstract: We modify the procedure to estimate PBH abundance proposed in arXiv:1805.03946 so that it can be applied to a broad power spectrum such as the scale-invariant flat power spectrum. In the new procedure, we focus on peaks of the Laplacian of the curvature perturbation $\triangle \zeta$ and use the values of $\triangle \zeta$ and $\triangle \triangle \zeta $ at each peak to specify the profile of $\zeta$ as a function of the radial coordinate while the values of $\zeta$ and $\triangle \zeta$ are used in arXiv:1805.03946. The new procedure decouples the larger-scale environmental effect from the estimate of PBH abundance. Because the redundant variance due to the environmental effect is eliminated, we obtain a narrower shape of the mass spectrum compared to the previous procedure in arXiv:1805.03946. Furthermore, the new procedure allows us to estimate PBH abundance for the scale-invariant flat power spectrum by introducing a window function. Although the final result depends on the choice of the window function, we show that the $k$-space tophat window minimizes the extra reduction of the mass spectrum due to the window function. That is, the $k$-space tophat window has the minimum required property in the theoretical PBH estimation. Our procedure makes it possible to calculate the PBH mass spectrum for an arbitrary power spectrum by using a plausible PBH formation criterion with the nonlinear relation taken into account.


title: The SAMI Galaxy Survey: A Range in S0 Properties Indicating Multiple Formation Pathways

abstract: It has been proposed that S0 galaxies are either fading spirals or the result of galaxy mergers. The relative contribution of each pathway, and the environments in which they occur remains unknown. Here we investigate stellar and gas kinematics of 219 S0s in the SAMI Survey to look for signs of multiple formation pathways occurring across the full range of environments. We identify a large range of rotational support in their stellar kinematics, which correspond to ranges in their physical structure. We find that pressure-supported S0s with $v/{\sigma}$ below 0.5 tend to be more compact and feature misaligned stellar and gas components, suggesting an external origin for their gas. We postulate that these S0s are consistent with being formed through a merger process. Meanwhile, comparisons of ellipticity, stellar mass and S\'ersic index distributions with spiral galaxies shows that the rotationally supported S0s with $v/{\sigma}$ above 0.5 are more consistent with a faded spiral origin. In addition, a simulated merger pathway involving a compact elliptical and gas-rich satellite results in an S0 that lies within the pressure-supported group. We conclude that two S0 formation pathways are active, with mergers dominating in isolated galaxies and small groups, and the faded spiral pathway being most prominent in large groups ($10^{13} < M_{halo} < 10^{14}$).


title: Salvage Reusable Samples from Noisy Data for Robust Learning

abstract: Due to the existence of label noise in web images and the high memorization capacity of deep neural networks, training deep fine-grained (FG) models directly through web images tends to have an inferior recognition ability. In the literature, to alleviate this issue, loss correction methods try to estimate the noise transition matrix, but the inevitable false correction would cause severe accumulated errors. Sample selection methods identify clean ("easy") samples based on the fact that small losses can alleviate the accumulated errors. However, "hard" and mislabeled examples that can both boost the robustness of FG models are also dropped. To this end, we propose a certainty-based reusable sample selection and correction approach, termed as CRSSC, for coping with label noise in training deep FG models with web images. Our key idea is to additionally identify and correct reusable samples, and then leverage them together with clean examples to update the networks. We demonstrate the superiority of the proposed approach from both theoretical and experimental perspectives.


title: Experimental and numerical studies on kV scattered x-ray imaging for real-time image guidance in radiation therapy

abstract: Motion management is a critical component of image guidance radiotherapy for lung cancer. We previously proposed a scheme using kV scattered x-ray photons for marker-less real-time image guidance in lung cancer radiotherapy. This study reports our recently progress using the photon counting detection technique to demonstrate potential feasibility of this method and using Monte Carlo (MC) simulations and ray-tracing calculations to characterize the performance. In our scheme, a thin slice of x-ray beam was directed to the target and we measured the outgoing scattered photons using a photon counting detector with a parallel-hole collimator to establish the correspondence between detector pixels and scatter positions. Image corrections of geometry, beam attenuation and scattering angle were performed to convert the raw image to the actual image of Compton attenuation coefficient. We set up a MC simulation system using an in-house developed GPU-based MC package modeling the image formation process. We also performed ray-tracing calculations to investigate the impacts of imaging system geometry on resulting image resolution. The experiment demonstrated feasibility of using a photon counting detector to measure scattered x-ray photons and generate the proposed scattered x-ray image. After correction, x-ray scattering image intensity and Compton scattering attenuation coefficient were linearly related, with R2=0.91. Contrast to Noise Ratios of different objects were improved and the values in experimental results and MC simulation results agreed with each other. Ray-tracing calculations revealed the dependence of image resolution on imaging geometry. The image resolution increases with reduced source to object distance and increased collimator height. The study demonstrated potential feasibility of using scattered x-ray imaging as a real-time image guidance method in radiation therapy.


title: Foundations of Reasoning with Uncertainty via Real-valued Logics

abstract: Real-valued logics underlie an increasing number of neuro-symbolic approaches, though typically their logical inference capabilities are characterized only qualitatively. We provide foundations for establishing the correctness and power of such systems. We give a sound and strongly complete axiomatization that can be parametrized to cover essentially every real-valued logic, including all the common fuzzy logics. Our class of sentences are very rich, and each describes a set of possible real values for a collection of formulas of the real-valued logic, including which combinations of real values are possible. Strong completeness allows us to derive exactly what information can be inferred about the combinations of real values of a collection of formulas given information about the combinations of real values of several other collections of formulas. We then extend the axiomatization to deal with weighted subformulas. Finally, we give a decision procedure based on linear programming for deciding, for certain real-valued logics and under certain natural assumptions, whether a set of our sentences logically implies another of our sentences.


title: Contrastive Variational Reinforcement Learning for Complex Observations

abstract: Deep reinforcement learning (DRL) has achieved significant success in various robot tasks: manipulation, navigation, etc. However, complex visual observations in natural environments remains a major challenge. This paper presents Contrastive Variational Reinforcement Learning (CVRL), a model-based method that tackles complex visual observations in DRL. CVRL learns a contrastive variational model by maximizing the mutual information between latent states and observations discriminatively, through contrastive learning. It avoids modeling the complex observation space unnecessarily, as the commonly used generative observation model often does, and is significantly more robust. CVRL achieves comparable performance with state-of-the-art model-based DRL methods on standard Mujoco tasks. It significantly outperforms them on Natural Mujoco tasks and a robot box-pushing task with complex observations, e.g., dynamic shadows. The CVRL code is available publicly at https://github.com/Yusufma03/CVRL.


title: Symmetry breaking in binary Bose-Einstein condensates in the presence of an inhomogeneous artificial gauge field

abstract: We study a two component Bose-Einstein condensate in the presence of an inhomogeneous artificial gauge field. In response to this field, the condensate forms a localised vortex lattice structure that leads to a non-trivial symmetry breaking in the phase separated regime. The underlying physical mechanism can be understood by considering the energy landscape and we present a simplified model that is capable of reproducing the main features of the phase separation transition. The intuition gained by numerically solving this simplified model is then corroborated using the analytical Thomas-Fermi model.


title: Sequential Motion Planning for Bipedal Somersault via Flywheel SLIP and Momentum Transmission with Task Space Control

abstract: In this paper, we present a sequential motion planning and control method for generating somersaults on bipedal robots. The somersault (backflip or frontflip) is considered as a coupling between an axile hopping motion and a rotational motion about the center of mass of the robot; these are encoded by a hopping Spring-loaded Inverted Pendulum (SLIP) model and the rotation of a Flywheel, respectively. We thus present the Flywheel SLIP model for generating the desired motion on the ground phase. In the flight phase, we present a momentum transmission method to adjust the orientation of the lower body based on the conservation of the centroidal momentum. The generated motion plans are realized on the full-dimensional robot via momentum-included task space control. Finally, the proposed method is implemented on a modified version of the bipedal robot Cassie in simulation wherein multiple somersault motions are generated.


title: Groups in which the co-degrees of the irreducible characters are distinct

abstract: Let $G$ be a finite group and let $\rm{Irr}(G)$ be the set of all irreducible complex characters of $G$. For a character $\chi \in \rm{Irr}(G)$, the number $\rm{cod}(\chi):=|G:\rm{ker}\chi|/\chi(1)$ is called the co-degree of $\chi$. The set of co-degrees of all irreducible characters of $G$ is denoted by $\rm{cod}(G)$. In this paper, we show that for a non-trivial finite group $G$, $|\rm{Irr}(G)|=|\rm{cod}(G)|$ if and only if $G$ is isomorphic to the cyclic group $\mathbb{Z}_2$ or the symmetric group $S_3$.


title: Interpretable Multi-Step Reasoning with Knowledge Extraction on Complex Healthcare Question Answering

abstract: Healthcare question answering assistance aims to provide customer healthcare information, which widely appears in both Web and mobile Internet. The questions usually require the assistance to have proficient healthcare background knowledge as well as the reasoning ability on the knowledge. Recently a challenge involving complex healthcare reasoning, HeadQA dataset, has been proposed, which contains multiple-choice questions authorized for the public healthcare specialization exam. Unlike most other QA tasks that focus on linguistic understanding, HeadQA requires deeper reasoning involving not only knowledge extraction, but also complex reasoning with healthcare knowledge. These questions are the most challenging for current QA systems, and the current performance of the state-of-the-art method is slightly better than a random guess. In order to solve this challenging task, we present a Multi-step reasoning with Knowledge extraction framework (MurKe). The proposed framework first extracts the healthcare knowledge as supporting documents from the large corpus. In order to find the reasoning chain and choose the correct answer, MurKe iterates between selecting the supporting documents, reformulating the query representation using the supporting documents and getting entailment score for each choice using the entailment model. The reformulation module leverages selected documents for missing evidence, which maintains interpretability. Moreover, we are striving to make full use of off-the-shelf pre-trained models. With less trainable weight, the pre-trained model can easily adapt to healthcare tasks with limited training samples. From the experimental results and ablation study, our system is able to outperform several strong baselines on the HeadQA dataset.


title: Dynamic and Versatile Humanoid Walking via Embedding 3D Actuated SLIP Model with Hybrid LIP Based Stepping

abstract: In this paper, we propose an efficient approach to generate dynamic and versatile humanoid walking with non-constant center of mass (COM) height. We exploit the benefits of using reduced order models (ROMs) and stepping control to generate dynamic and versatile walking motion. Specifically, we apply the stepping controller based on the Hybrid Linear Inverted Pendulum Model (H-LIP) to perturb a periodic walking motion of a 3D actuated Spring Loaded Inverted Pendulum (3D-aSLIP), which yields versatile walking behaviors of the 3D-aSLIP, including various 3D periodic walking, fixed location tracking, and global trajectory tracking. The 3D-aSLIP walking is then embedded on the fully-actuated humanoid via the task space control on the COM dynamics and ground reaction forces. The proposed approach is realized on the robot model of Atlas in simulation, wherein versatile dynamic motions are generated.


title: GL-GAN: Adaptive Global and Local Bilevel Optimization model of Image Generation

abstract: Although Generative Adversarial Networks have shown remarkable performance in image generation, there are some challenges in image realism and convergence speed. The results of some models display the imbalances of quality within a generated image, in which some defective parts appear compared with other regions. Different from general single global optimization methods, we introduce an adaptive global and local bilevel optimization model(GL-GAN). The model achieves the generation of high-resolution images in a complementary and promoting way, where global optimization is to optimize the whole images and local is only to optimize the low-quality areas. With a simple network structure, GL-GAN is allowed to effectively avoid the nature of imbalance by local bilevel optimization, which is accomplished by first locating low-quality areas and then optimizing them. Moreover, by using feature map cues from discriminator output, we propose the adaptive local and global optimization method(Ada-OP) for specific implementation and find that it boosts the convergence speed. Compared with the current GAN methods, our model has shown impressive performance on CelebA, CelebA-HQ and LSUN datasets.


title: A Sharp Blockwise Tensor Perturbation Bound for Orthogonal Iteration

abstract: In this paper, we develop novel perturbation bounds for the high-order orthogonal iteration (HOOI) [DLDMV00b]. Under mild regularity conditions, we establish blockwise tensor perturbation bounds for HOOI with guarantees for both tensor reconstruction in Hilbert-Schmidt norm $\|\widehat{\bcT} - \bcT \|_{\tHS}$ and mode-$k$ singular subspace estimation in Schatten-$q$ norm $\| \sin \Theta (\widehat{\U}_k, \U_k) \|_q$ for any $q \geq 1$. We show the upper bounds of mode-$k$ singular subspace estimation are unilateral and converge linearly to a quantity characterized by blockwise errors of the perturbation and signal strength. For the tensor reconstruction error bound, we express the bound through a simple quantity $\xi$, which depends only on perturbation and the multilinear rank of the underlying signal. Rate matching deterministic lower bound for tensor reconstruction, which demonstrates the optimality of HOOI, is also provided. Furthermore, we prove that one-step HOOI (i.e., HOOI with only a single iteration) is also optimal in terms of tensor reconstruction and can be used to lower the computational cost. The perturbation results are also extended to the case that only partial modes of $\bcT$ have low-rank structure. We support our theoretical results by extensive numerical studies. Finally, we apply the novel perturbation bounds of HOOI on two applications, tensor denoising and tensor co-clustering, from machine learning and statistics, which demonstrates the superiority of the new perturbation results.

categories: math.ST cs.LG cs.NA math.NA stat.ML stat.TH


title: Data-driven Meta-set Based Fine-Grained Visual Classification

abstract: Constructing fine-grained image datasets typically requires domain-specific expert knowledge, which is not always available for crowd-sourcing platform annotators. Accordingly, learning directly from web images becomes an alternative method for fine-grained visual recognition. However, label noise in the web training set can severely degrade the model performance. To this end, we propose a data-driven meta-set based approach to deal with noisy web images for fine-grained recognition. Specifically, guided by a small amount of clean meta-set, we train a selection net in a meta-learning manner to distinguish in- and out-of-distribution noisy images. To further boost the robustness of model, we also learn a labeling net to correct the labels of in-distribution noisy data. In this way, our proposed method can alleviate the harmful effects caused by out-of-distribution noise and properly exploit the in-distribution noisy samples for training. Extensive experiments on three commonly used fine-grained datasets demonstrate that our approach is much superior to state-of-the-art noise-robust methods.


title: Simultaneous measurement of time-invariant linear and nonlinear, and random and extra responses using frequency domain variant of velvet noise

abstract: We introduce a new acoustic measurement method that can measure the linear time-invariant response, the nonlinear time-invariant response, and random and time-varying responses simultaneously. The method uses a set of orthogonal sequences made from a set of unit FVNs (Frequency domain variant of Velvet Noise), a new member of the TSP (Time Stretched Pulse). FVN has a unique feature that other TSP members do not. It is a high degree of design freedom that makes the proposed method possible without introducing extra equipment. We introduce two useful cases using two and four orthogonal sequences and illustrates their use using simulations and acoustic measurement examples. We developed an interactive and realtime acoustic analysis tool based on the proposed method. We made it available in an open-source repository. The proposed response analysis method is general and applies to other fields, such as auditory-feedback research and assessment of sound recording and coding.


title: Structural Multi-Colour Invisible Inks with Submicron 4D Printing of Shape Memory Polymers

abstract: Four-dimensional (4D) printing of shape memory polymer (SMP) imparts time responsive properties to 3D structures. Here, we explore 4D printing of a SMP in the submicron length scale, extending its applications to nanophononics. We report a new SMP photoresist based on Vero Clear achieving print features at a resolution of ~300 nm half pitch using two-photon polymerization lithography (TPL). Prints consisting of grids with size-tunable multi-colours enabled the study of shape memory effects to achieve large visual shifts through nanoscale structure deformation. As the nanostructures are flattened, the colours and printed information become invisible. Remarkably, the shape memory effect recovers the original surface morphology of the nanostructures along with its structural colour within seconds of heating above its glass transition temperature. The high-resolution printing and excellent reversibility in both microtopography and optical properties promises a platform for temperature-sensitive labels, information hiding for anti-counterfeiting, and tunable photonic devices.


title: Group Activity Prediction with Sequential Relational Anticipation Model

abstract: In this paper, we propose a novel approach to predict group activities given the beginning frames with incomplete activity executions. Existing action prediction approaches learn to enhance the representation power of the partial observation. However, for group activity prediction, the relation evolution of people's activity and their positions over time is an important cue for predicting group activity. To this end, we propose a sequential relational anticipation model (SRAM) that summarizes the relational dynamics in the partial observation and progressively anticipates the group representations with rich discriminative information. Our model explicitly anticipates both activity features and positions by two graph auto-encoders, aiming to learn a discriminative group representation for group activity prediction. Experimental results on two popularly used datasets demonstrate that our approach significantly outperforms the state-of-the-art activity prediction methods.


title: A stable and adaptive polygenic signal detection method based on repeated sample splitting

abstract: Focusing on polygenic signal detection in high dimensional genetic association studies of complex traits, we develop an adaptive test for generalized linear models to accommodate different alternatives. To facilitate valid post-selection inference for high dimensional data, our study here adheres to the original sampling-splitting principle but does so, repeatedly, to increase stability of the inference. We show the asymptotic null distributions of the proposed test for both fixed and diverging number of variants. We also show the asymptotic properties of the proposed test under local alternatives, providing insights on why power gain attributed to variable selection and weighting can compensate for efficiency loss due to sample splitting. We support our analytical findings through extensive simulation studies and two applications. The proposed procedure is computationally efficient and has been implemented as the R package DoubleCauchy.


title: Near Total Electronic Spin Separation as Caused by Nuclear Dynamics: Perturbing a Real-Valued Conical Intersection with Complex-Valued Spin-Orbit Coupling

abstract: We investigate the nuclear dynamics near a real-valued conical intersection that is perturbed by a complex-valued spin-orbit coupling. For a model Hamiltonian with two outgoing channels, we find that even a small spin-orbit coupling can dramatically affect the pathway selection on account of Berry force, leading to extremely large spin selectivity (sometime as large as 100%). Thus, this Letter opens the door for organic chemists to start designing spintronic devices that use nuclear motion and conical intersections (combined with standard spin-orbit coupling) in order to achieve spin selection. Vice versa, for physical chemists, this Letter also emphasizes that future semiclassical simulations of intersystem crossing (which have heretofore ignored Berry force) should be corrected to account for the spin polarization that inevitably arises when dynamics pass near conical intersections.


title: Constraining the ellipticity of millisecond pulsars with observed spin-down rates

abstract: A spinning neutron star (NS) that is asymmetric with respect to its spin axis can emit continuous gravitational wave (GW) signals. The spin frequencies and their distribution of radio millisecond pulsars (MSPs) and accreting MSPs provide some evidences of GW radiation, and MSPs are ideal probes detecting high frequency GW signals. It is generally thought that MSPs originate from the recycled process, in which the NS accretes the material and angular momentum from the donor star. The accreted matter would be confined at the polar cap zone by an equatorial belt of compressed magnetic field fixed in the deep crust of the NS, and yields "magnetic mountain". Based on an assumption that the spin-down rates of three transitional MSPs including PSR J1023+0038 are the combinational contribution of the accretion torque, the propeller torque, and the GW radiation torque, in this work we attempt to constrain the ellipticities of MSPs with observed spin-down rates. Assuming some canonical parameters of NSs, the ellipticities of three transitional MSPs and ten redbacks are estimated to be $\epsilon=(0.9-23.4)\times 10^{-9}$. The electrical resistivities of three transitional MSPs are also derived to be in the range $\eta=(1.2-15.3)\times 10^{-31}~\rm s$, which display an ideal power law relation with the accretion rate. The characteristic strains ($h_{\rm c}=(0.6-2.5)\times10^{-27}$) of GW signals emitting by these sources are obviously beyond the sensitivity scope of the aLIGO. We expect that the third-generation GW detectors like the Einstein Telescope can seize the GW signals from these sources in the future.


title: GRB 140423A: A Case of Stellar Wind to Interstellar Medium Transition in the Afterglow

abstract: We present very early ground-based optical follow-up observations of GRB~140423A, which was discovered by \emph{Swift}/BAT and by {\it Fermi}/GBM. Its broadband afterglow was monitored by {\it Swift}/XRT and ground-based optical telescopes from $T_0+$70.96~s to 4.8~d after the {\it Swift}/BAT trigger. This is one more case of prompt optical emission observation. The temporal and spectral joint fit of the multiwavelength light curves of GRB 140423A reveals that achromatic behavior is consistent with the external shock model including a transition from a stellar wind to the interstellar medium (ISM) and energy injection. In terms of the optical light curves, there is an onset bump in the early afterglow with a rising index $\alpha_{\rm O,I} = -0.59 \pm 0.04$ (peaking at $t_{\rm peak}-T_0 \approx 206$~s). It then decays with a steep index $\alpha_{\rm O,II} = 1.78 \pm 0.03$, and shows a steeper to flatter "transition" with $\alpha_{\rm O,III} = 1.13 \pm 0.03$ at around $T_0 + 5000$~s. The observed X-ray afterglow reflects an achromatic behavior, as does the optical light curve. There is no obvious evolution of the spectral energy distribution between the X-ray and optical afterglow, with an average value of the photon index $\Gamma \approx 1.95$. This "transition" is consistent with an external shock model having the circumburst medium transition from a wind to the ISM, by introducing a long-lasting energy injection with a Lorentz factor stratification of the ejecta. The best parameters from Monte Carlo Markov Chain fitting are $E_{\rm K,iso} \approx 2.14\times10^{55}$ erg, $\Gamma_0 \approx 162$, $\epsilon_e \approx 0.02$, $\epsilon_B \approx 1.7\times10^{-6}$, $A_\ast \approx 1.0$, $R_t \approx 4.1\times10^{17}$ cm, $n \approx 11.0 \rm\ cm^{-3}$, $L_0 \approx 3.1\times10^{52} \rm\ erg\ s^{-1}$, $k \approx 1.98$, $s \approx 1.54$, and $\theta_j > 0.3$ rad.


title: Paramagnetic spin Hall magnetoresistance

abstract: Spin Hall magnetoresistance (SMR) refers to a resistance change in a metallic film reflecting the magnetization direction of a magnet attached to the film. The mechanism of this phenomenon is spin exchange between conduction-electron spins and magnetization at the interface. SMR has been used to read out information written in a small magnet and to detect magnetization dynamics, but it has been limited to magnets; magnetic ordered phases or instability of magnetic phase transition has been believed to be indispensable. Here, we report the observation of SMR in a paramagnetic insulator Gd$_{3}$Ga$_{5}$O$_{12}$ (GGG) without spontaneous magnetization combined with a Pt film. The paramagnetic SMR can be attributed to spin-transfer torque acting on localized spins in GGG. We determine the efficiencies of spin torque and spin-flip scattering at the Pt/GGG interface, and demonstrate these quantities can be tuned with external magnetic fields. The results clarify the mechanism of spin-transport at a metal/paramagnetic insulator interface, which gives new insight into the spintronic manipulation of spin states in paramagnetic systems.


title: Functional Regularization for Representation Learning: A Unified Theoretical Perspective

abstract: Unsupervised and self-supervised learning approaches have become a crucial tool to learn representations for downstream prediction tasks. While these approaches are widely used in practice and achieve impressive empirical gains, their theoretical understanding largely lags behind. Towards bridging this gap, we present a unifying perspective where several such approaches can be viewed as imposing a regularization on the representation via a learnable function using unlabeled data. We propose a discriminative theoretical framework for analyzing the sample complexity of these approaches, which generalizes the framework of (Balcan and Blum, 2010) to allow learnable regularization functions. Our sample complexity bounds show that, with carefully chosen hypothesis classes to exploit the structure in the data, these learnable regularization functions can prune the hypothesis space, and help reduce the amount of labeled data needed. We then provide two concrete examples of functional regularization, one using auto-encoders and the other using masked self-supervision, and apply our framework to quantify the reduction in the sample complexity bound of labeled data. We also provide complementary empirical results to support our analysis.


title: Fine-grained Iterative Attention Network for TemporalLanguage Localization in Videos

abstract: Temporal language localization in videos aims to ground one video segment in an untrimmed video based on a given sentence query. To tackle this task, designing an effective model to extract ground-ing information from both visual and textual modalities is crucial. However, most previous attempts in this field only focus on unidirectional interactions from video to query, which emphasizes which words to listen and attends to sentence information via vanilla soft attention, but clues from query-by-video interactions implying where to look are not taken into consideration. In this paper, we propose a Fine-grained Iterative Attention Network (FIAN) that consists of an iterative attention module for bilateral query-video in-formation extraction. Specifically, in the iterative attention module, each word in the query is first enhanced by attending to each frame in the video through fine-grained attention, then video iteratively attends to the integrated query. Finally, both video and query information is utilized to provide robust cross-modal representation for further moment localization. In addition, to better predict the target segment, we propose a content-oriented localization strategy instead of applying recent anchor-based localization. We evaluate the proposed method on three challenging public benchmarks: Ac-tivityNet Captions, TACoS, and Charades-STA. FIAN significantly outperforms the state-of-the-art approaches.


title: Studying Politeness across Cultures Using English Twitter and Mandarin Weibo

abstract: Modeling politeness across cultures helps to improve intercultural communication by uncovering what is considered appropriate and polite. We study the linguistic features associated with politeness across US English and Mandarin Chinese. First, we annotate 5,300 Twitter posts from the US and 5,300 Sina Weibo posts from China for politeness scores. Next, we develop an English and Chinese politeness feature set, `PoliteLex'. Combining it with validated psycholinguistic dictionaries, we then study the correlations between linguistic features and perceived politeness across cultures. We find that on Mandarin Weibo, future-focusing conversations, identifying with a group affiliation, and gratitude are considered to be more polite than on English Twitter. Death-related taboo topics, lack of or poor choice of pronouns, and informal language are associated with higher impoliteness on Mandarin Weibo compared to English Twitter. Finally, we build language-based machine learning models to predict politeness with an F1 score of 0.886 on Mandarin Weibo and a 0.774 on English Twitter.


title: Training DNN Model with Secret Key for Model Protection

abstract: In this paper, we propose a model protection method by using block-wise pixel shuffling with a secret key as a preprocessing technique to input images for the first time. The protected model is built by training with such preprocessed images. Experiment results show that the performance of the protected model is close to that of non-protected models when the key is correct, while the accuracy is severely dropped when an incorrect key is given, and the proposed model protection is robust against not only brute-force attacks but also fine-tuning attacks, while maintaining almost the same performance accuracy as that of using a non-protected model.


title: Effective magnetic field induced by inhomogeneous Fermi velocity in strained honeycomb structures

abstract: In addition to the known pseudomagnetic field, nonuniform strains independently induce a position-dependent Fermi velocity (PDFV) in graphene. Here we demonstrate that, due to the presence of a PDFV, the Dirac fermions on a nonuniform (strained) honeycomb lattice may experiment a sort of magnetic effect, which is linearly proportional to the momentum of the quasiparticle. As a consequence, the quasiparticles have a sublinear dispersion relation. Moreover, we analyze the general consequence of a PDFV on the Klein tunneling of electrons through pseudomagnetic barriers. In particular, we report an anomalous (Klein) tunneling for an electron passing across velocity barriers with magnetic features. Our findings about the effects induced by a PDFV on Dirac fermions in (2D) strained honeycomb lattice could be extended to (3D) Dirac and Weyl semimetals and/or its analogous artificial systems.


title: Federated Transfer Learning with Dynamic Gradient Aggregation

abstract: In this paper, a Federated Learning (FL) simulation platform is introduced. The target scenario is Acoustic Model training based on this platform. To our knowledge, this is the first attempt to apply FL techniques to Speech Recognition tasks due to the inherent complexity. The proposed FL platform can support different tasks based on the adopted modular design. As part of the platform, a novel hierarchical optimization scheme and two gradient aggregation methods are proposed, leading to almost an order of magnitude improvement in training convergence speed compared to other distributed or FL training algorithms like BMUF and FedAvg. The hierarchical optimization offers additional flexibility in the training pipeline besides the enhanced convergence speed. On top of the hierarchical optimization, a dynamic gradient aggregation algorithm is proposed, based on a data-driven weight inference. This aggregation algorithm acts as a regularizer of the gradient quality. Finally, an unsupervised training pipeline tailored to FL is presented as a separate training scenario. The experimental validation of the proposed system is based on two tasks: first, the LibriSpeech task showing a speed-up of 7x and 6% Word Error Rate reduction (WERR) compared to the baseline results. The second task is based on session adaptation providing an improvement of 20% WERR over a competitive production-ready LAS model. The proposed Federated Learning system is shown to outperform the golden standard of distributed training in both convergence speed and overall model performance.


title: Photo ionization of an atom passed through a diffraction grating

abstract: We consider photo ionization of an atom which, due to passing through a diffraction grating, is prepared in a multi-site state possessing a periodic space structure with alternating maxima and minima. It has been found that this process qualitatively differs from photo ionization of a 'normal' atom. In particular, the spectra of emitted electrons and recoil ions in this process display clear one- and two-particle interference effects. Moreover, there are also striking differences between the momentum distributions of these particles, which no longer mirror each other. The origin of all these features is discussed in detail. It is also shown that the information about the diffraction grating, which is encoded in the multi-site state of the atom, can be fully decoded by exploring the spectra of recoil ions whereas the photo-electron spectra contain this information only partially.


title: Structured Convolutions for Efficient Neural Network Design

abstract: In this work, we tackle model efficiency by exploiting redundancy in the \textit{implicit structure} of the building blocks of convolutional neural networks. We start our analysis by introducing a general definition of Composite Kernel structures that enable the execution of convolution operations in the form of efficient, scaled, sum-pooling components. As its special case, we propose \textit{Structured Convolutions} and show that these allow decomposition of the convolution operation into a sum-pooling operation followed by a convolution with significantly lower complexity and fewer weights. We show how this decomposition can be applied to 2D and 3D kernels as well as the fully-connected layers. Furthermore, we present a Structural Regularization loss that promotes neural network layers to leverage on this desired structure in a way that, after training, they can be decomposed with negligible performance loss. By applying our method to a wide range of CNN architectures, we demonstrate "structured" versions of the ResNets that are up to 2$\times$ smaller and a new Structured-MobileNetV2 that is more efficient while staying within an accuracy loss of 1% on ImageNet and CIFAR-10 datasets. We also show similar structured versions of EfficientNet on ImageNet and HRNet architecture for semantic segmentation on the Cityscapes dataset. Our method performs equally well or superior in terms of the complexity reduction in comparison to the existing tensor decomposition and channel pruning methods.


title: Exact Convergence Rate Analysis of the Independent Metropolis-Hastings Algorithms

abstract: A well-known difficult problem regarding Metropolis-Hastings algorithms is to get sharp bounds on their convergence rates. Moreover, a fundamental but often overlooked problem in Markov chain theory is to study the convergence rates for different initializations. In this paper, we study the two issues mentioned above of the Independent Metropolis-Hastings (IMH) algorithms on both general and discrete state spaces. We derive the exact convergence rate and prove that the IMH algorithm's different deterministic initializations have the same convergence rate. We get the exact convergence speed for IMH algorithms on general state spaces.


title: Predicting Missing Information of Key Aspects in Vulnerability Reports

abstract: Software vulnerabilities have been continually disclosed and documented. An important practice in documenting vulnerabilities is to describe the key vulnerability aspects, such as vulnerability type, root cause, affected product, impact, attacker type and attack vector, for the effective search and management of fast-growing vulnerabilities. We investigate 120,103 vulnerability reports in the Common Vulnerabilities and Exposures (CVE) over the past 20 years. We find that 56%, 85%, 38% and 28% of CVEs miss vulnerability type, root causes, attack vector and attacker type respectively. To help to complete the missing information of these vulnerability aspects, we propose a neural-network based approach for predicting the missing information of a key aspect of a vulnerability based on the known aspects of the vulnerability. We explore the design space of the neural network models and empirically identify the most effective model design. Using a large-scale vulnerability datas\-et from CVE, we show that we can effectively train a neural-network based classifier with less than 20% of historical CVEs. Our model achieves the prediction accuracy 94%, 79%, 89%and 70% for vulnerability type, root cause, attacker type and attack vector, respectively. Our ablation study reveals the prominent correlations among vulnerability aspects and further confirms the practicality of our approach.


title: Graph Convolutional Networks for Hyperspectral Image Classification

abstract: To read the final version please go to IEEE TGRS on IEEE Xplore. Convolutional neural networks (CNNs) have been attracting increasing attention in hyperspectral (HS) image classification, owing to their ability to capture spatial-spectral feature representations. Nevertheless, their ability in modeling relations between samples remains limited. Beyond the limitations of grid sampling, graph convolutional networks (GCNs) have been recently proposed and successfully applied in irregular (or non-grid) data representation and analysis. In this paper, we thoroughly investigate CNNs and GCNs (qualitatively and quantitatively) in terms of HS image classification. Due to the construction of the adjacency matrix on all the data, traditional GCNs usually suffer from a huge computational cost, particularly in large-scale remote sensing (RS) problems. To this end, we develop a new mini-batch GCN (called miniGCN hereinafter) which allows to train large-scale GCNs in a mini-batch fashion. More significantly, our miniGCN is capable of inferring out-of-sample data without re-training networks and improving classification performance. Furthermore, as CNNs and GCNs can extract different types of HS features, an intuitive solution to break the performance bottleneck of a single model is to fuse them. Since miniGCNs can perform batch-wise network training (enabling the combination of CNNs and GCNs) we explore three fusion strategies: additive fusion, element-wise multiplicative fusion, and concatenation fusion to measure the obtained performance gain. Extensive experiments, conducted on three HS datasets, demonstrate the advantages of miniGCNs over GCNs and the superiority of the tested fusion strategies with regards to the single CNN or GCN models. The codes of this work will be available at https://github.com/danfenghong/IEEE_TGRS_GCN for the sake of reproducibility.


title: The hierarchy recurrences in local relaxation

abstract: Inside a closed many-body system undergoing the unitary evolution, a small partition of the whole system exhibits a local relaxation. If the total degrees of freedom of the whole system is a large but finite number, such a local relaxation would come across a recurrence after a certain time, namely, the dynamics of the local system suddenly appear random after a well-ordered oscillatory decay process. It is found in this paper, for a collection of $N$ two-level systems (TLSs), the local relaxation of one TLS within has a hierarchy structure hiding in the randomness after such a recurrence: similar recurrences appear in a periodical way, and the later recurrence brings in stronger randomness than the previous one. Both analytical and numerical results that we obtained well explains such hierarchy recurrences: the population of the local TLS (as an open system) diffuses out and regathers back periodically due the finite-size effect of the bath [the remaining $(N-1)$ TLSs]. We also find that the total correlation entropy, which sums up the entropy of all the $N$ TLSs, approximately exhibit a monotonic increase; in contrast, the entropy of each single TLS increases and decreases from time to time, and the entropy of the whole $N$-body system keeps constant during the unitary evolution.


title: MetaRadar: Indoor Localization by Reconfigurable Metamaterials

abstract: Indoor localization has drawn much attention owing to its potential for supporting location based services. Among various indoor localization techniques, the received signal strength (RSS) based technique is widely researched. However, in conventional RSS based systems where the radio environment is unconfigurable, adjacent locations may have similar RSS values, which limits the localization precision. In this paper, we present MetaRadar, which explores reconfigurable radio reflection with a surface/plane made of metamaterial units for multi-user localization. By changing the reflectivity of metamaterial, MetaRadar modifies the radio channels at different locations, and improves localization accuracy by making RSS values at adjacent locations have significant differences. However, in MetaRadar, it is challenging to build radio maps for all the radio environments generated by metamaterial units and select suitable maps from all the possible maps to realize a high accuracy localization. To tackle this challenge, we propose a compressive construction technique which can predict all the possible radio maps, and propose a configuration optimization algorithm to select favorable metamaterial reflectivities and the corresponding radio maps. The experimental results show a significant improvement from a decimeter-level localization error in the traditional RSS-based systems to a centimeter-level one in MetaRadar.


title: DeText: A Deep Text Ranking Framework with BERT

abstract: Ranking is the most important component in a search system. Mostsearch systems deal with large amounts of natural language data,hence an effective ranking system requires a deep understandingof text semantics. Recently, deep learning based natural languageprocessing (deep NLP) models have generated promising results onranking systems. BERT is one of the most successful models thatlearn contextual embedding, which has been applied to capturecomplex query-document relations for search ranking. However,this is generally done by exhaustively interacting each query wordwith each document word, which is inefficient for online servingin search product systems. In this paper, we investigate how tobuild an efficient BERT-based ranking model for industry use cases.The solution is further extended to a general ranking framework,DeText, that is open sourced and can be applied to various rankingproductions. Offline and online experiments of DeText on threereal-world search systems present significant improvement overstate-of-the-art approaches.


title: Bounding the quantum capacity with flagged extensions

abstract: In this article we consider flagged extensions of convex combination of quantum channels, and find general sufficient conditions for the degradability of the flagged extension. An immediate application is a bound on the quantum $Q$ and private $P$ capacities of any channel being a mixture of a unitary map and another channel, with the probability associated to the unitary component being larger than $1/2$. We then specialize our sufficient conditions to flagged Pauli channels, obtaining a family of upper bounds on quantum and private capacities of Pauli channels. In particular, we establish new state-of-the-art upper bounds on the quantum and private capacities of the depolarizing channel, BB84 channel and generalized amplitude damping channel. Moreover, the flagged construction can be naturally applied to tensor powers of channels with less restricting degradability conditions, suggesting that better upper bounds could be found by considering a larger number of channel uses.


title: Double Descent in Classical Groups

abstract: Let ${\bf A}$ be the ring of adeles of a number field $F$. Given a self-dual irreducible, automorphic, cuspidal representation $\tau$ of $\GL_n(\BA)$, with trivial central characters, we construct its full inverse image under the weak Langlands functorial lift from the appropriate split classical group $G$. We do this by a new automorphic descent method, namely the double descent. This method is derived from the recent generalized doubling integrals of Cai, Friedberg, Ginzburg and Kaplan \cite{CFGK17}, which represent the standard $L$-functions for $G\times \GL_n$. Our results are valid also for double covers of symplectic groups.


title: The Effect of Mechanical Strain on Lithium Staging in Graphene

abstract: Lithium intercalation into graphite is the foundation for the lithium-ion battery, and the thermodynamics of the lithiation of graphitic electrodes have been heavily investigated. Intercalated lithium in bulk graphite undergoes structural ordering known as staging to minimize electrostatic repulsions within the crystal lattice. While this process is well-understood for bulk graphite, confinement effects become important at the nanoscale, which can significantly impact the electrochemistry of nanostructured electrodes. Therefore, graphene offers a model platform to study intercalation dynamics at the nanoscale by combining on-chip device fabrication and electrochemical intercalation with in situ characterization. We show that microscale mechanical strain significantly affects the formation of ordered lithium phases in graphene. In situ Raman spectroscopy of graphene microflakes mechanically constrained at the edge during lithium intercalation reveals a thickness-dependent increase of up to 1.26 V in the electrochemical potential that induces lithium staging. While the induced mechanical strain energy increases with graphene thickness to the fourth power, its magnitude is small compared to the observed increase in electrochemical energy. We hypothesize that the mechanical strain energy increases a nucleation barrier for lithium staging, greatly delaying the formation of ordered lithium phases. Our results indicate that electrode assembly can critically impact lithium staging dynamics important for cycling rates and power generation for batteries. We demonstrate strain engineering in two-dimensional nanomaterials as an approach to manipulate phase transitions and chemical reactivity.


title: A Matrix Chernoff Bound for Markov Chains and Its Application to Co-occurrence Matrices

abstract: We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued function on its state space. Our result gives exponentially decreasing bounds on the tail distributions of the extreme eigenvalues of the sample mean matrix. Our proof is based on the matrix expander (regular undirected graph) Chernoff bound [Garg et al. STOC '18] and scalar Chernoff-Hoeffding bounds for Markov chains [Chung et al. STACS '12]. Our matrix Chernoff bound for Markov chains can be applied to analyze the behavior of co-occurrence statistics for sequential data, which have been common and important data signals in machine learning. We show that given a regular Markov chain with $n$ states and mixing time $\tau$, we need a trajectory of length $O(\tau (\log{(n)}+\log{(\tau)})/\epsilon^2)$ to achieve an estimator of the co-occurrence matrix with error bound $\epsilon$. We conduct several experiments and the experimental results are consistent with the exponentially fast convergence rate from theoretical analysis. Our result gives the first bound on the convergence rate of the co-occurrence matrix and the first sample complexity analysis in graph representation learning.


title: Few-shot Classification via Adaptive Attention

abstract: Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from two aspects, namely optimizing an initial model or learning a distance metric. In this work, we propose a novel few-shot learning method via optimizing and fast adapting the query sample representation based on very few reference samples. To be specific, we devise a simple and efficient meta-reweighting strategy to adapt the sample representations and generate soft attention to refine the representation such that the relevant features from the query and support samples can be extracted for a better few-shot classification. Such an adaptive attention model is also able to explain what the classification model is looking for as the evidence for classification to some extent. As demonstrated experimentally, the proposed model achieves state-of-the-art classification results on various benchmark few-shot classification and fine-grained recognition datasets.


title: Structural and optical properties of single- and few-layer magnetic semiconductor CrPS4

abstract: Atomically thin binary 2-dimensional (2D) semiconductors exhibit diverse physical properties depending on their composition, structure and thickness. By adding another element in those materials, which will lead to formation of ternary 2D materials, the property and structure would greatly change and significantly expanded applications could be explored. In this work, we report structural and optical properties of atomically thin chromium thiophosphate (CrPS4), a ternary antiferromagnetic semiconductor. Its structural details were revealed by X-ray and electron diffractions. Transmission electron microscopy showed that preferentially-cleaved edges are parallel to diagonal Cr atom rows, which readily identified their crystallographic orientations. Strong in-plane optical anisotropy induced birefringence that also enabled efficient determination of crystallographic orientation using polarized microscopy. The lattice vibrations were probed by Raman spectroscopy for the first time and exhibited significant dependence on thickness of crystals exfoliated down to single layer. Optical absorption determined by reflectance contrast was dominated by d-d type transitions localized at Cr3+ ions, which was also responsible for the major photoluminescence peak at 1.31 eV. The spectral features in the absorption and emission spectra exhibited noticeable thickness-dependence and hinted a high photochemical activity for single layer CrPS4. The current structural and optical investigation will provide a firm basis for future study and application of this novel magnetic semiconductor.


title: Unravelling the Architecture of Membrane Proteins with Conditional Random Fields

abstract: In this paper, we will show that the recently introduced graphical model: Conditional Random Fields (CRF) provides a template to integrate micro-level information about biological entities into a mathematical model to understand their macro-level behavior. More specifically, we will apply the CRF model to an important classification problem in protein science, namely the secondary structure prediction of proteins based on the observed primary structure. A comparison on benchmark data sets against twenty-eight other methods shows that not only does the CRF model lead to extremely accurate predictions but the modular nature of the model and the freedom to integrate disparate, overlapping and non-independent sources of information, makes the model an extremely versatile tool to potentially solve many other problems in bioinformatics.