title: Improving Conditioning in Context-Aware Sequence to Sequence Models

abstract: Neural sequence to sequence models are well established for applications which can be cast as mapping a single input sequence into a single output sequence. In this work, we focus on cases where generation is conditioned on both a short query and a long context, such as abstractive question answering or document-level translation. We modify the standard sequence-to-sequence approach to make better use of both the query and the context by expanding the conditioning mechanism to intertwine query and context attention. We also introduce a simple and efficient data augmentation method for the proposed model. Experiments on three different tasks show that both changes lead to consistent improvements.


title: Quantum Lissajous Scars

abstract: A quantum scar - an enhancement of a quantum probability density in the vicinity of a classical periodic orbit - is a fundamental phenomenon connecting quantum and classical mechanics. Here we demonstrate that some of the eigenstates of the perturbed two-dimensional anisotropic (elliptic) harmonic oscillator are strongly scarred by the Lissajous orbits of the unperturbed classical counterpart. In particular, we show that the occurrence and geometry of these quantum Lissajous scars are connected to the anisotropy of the harmonic confinement, but unlike the classical Lissajous orbits the scars survive under a small perturbation of the potential. This Lissajous scarring is caused by the combined effect of the quantum (near) degeneracies in the unperturbed system and the localized character of the perturbation. Furthermore, we discuss experimental schemes to observe this perturbation-induced scarring.


title: Delay master stability of inertial oscillator networks

abstract: Time lags occur in a vast range of real-world dynamical systems due to finite reaction times or propagation speeds. Here we derive an analytical approach to determine the asymptotic stability of synchronous states in networks of coupled inertial oscillators with constant delay. Building on the master stability formalism, our technique provides necessary and sufficient delay master stability conditions. We apply it to two classes of potential future power grids, where processing delays in control dynamics will likely pose a challenge as renewable energies proliferate. Distinguishing between phase and frequency delay, our method offers an insight into how bifurcation points depend on the network topology of these system designs.


title: Phase mapping for cardiac unipolar electrograms with neural network instead of phase transformation

abstract: A phase mapping is an approach to processing signals of electrograms recorded from the surface of cardiac tissue. The main concept of phase mapping is the application of the phase transformation with the aim to obtain signals with useful properties. In our study, we propose to use a simple sawtooth signal instead of a phase signal for processing of electrogram data and building of the phase maps. We denote transformation that can provide this signal as a phase-like transformation (PLT). PLT defined via a convolutional neural network that is trained on a dataset from computer models of cardiac tissue electrophysiology. The proposed approaches were validated on data from the detailed personalized model of the human torso electrophysiology. This paper includes visualization of the phase map based on PLT and shows the robustness of the proposed approaches in the analysis of the complex non-stationary periodic activity of the excitable cardiac tissue.


title: Separate and Attend in Personal Email Search

abstract: In personal email search, user queries often impose different requirements on different aspects of the retrieved emails. For example, the query "my recent flight to the US" requires emails to be ranked based on both textual contents and recency of the email documents, while other queries such as "medical history" do not impose any constraints on the recency of the email. Recent deep learning-to-rank models for personal email search often directly concatenate dense numerical features (e.g., document age) with embedded sparse features (e.g., n-gram embeddings). In this paper, we first show with a set of experiments on synthetic datasets that direct concatenation of dense and sparse features does not lead to the optimal search performance of deep neural ranking models. To effectively incorporate both sparse and dense email features into personal email search ranking, we propose a novel neural model, SepAttn. SepAttn first builds two separate neural models to learn from sparse and dense features respectively, and then applies an attention mechanism at the prediction level to derive the final prediction from these two models. We conduct a comprehensive set of experiments on a large-scale email search dataset, and demonstrate that our SepAttn model consistently improves the search quality over the baseline models.


title: A class of integration by parts formulae in stochastic analysis I

abstract: An integration by parts formula is the foundation for stochastic analysis on path spaces over a (finite dimensional) Riemannian manifold or over $R^n$, from which we may deduce the operator $d$ is closable and define the Laplacian operator on path spaces. A useful formula on the Riemannian manifold is $$dP_tf(v)=(1/t)E f(x_t) \int_0^t \langle d\{x_s\}, v_s\rangle ,$$ for $P_t$ the heat semi-group, $x_t$ the BM, $v_t$ the derivative flow or its conditional expectation (which is a damped parallel translation), $d\{x_s\}$ is the martingale part of $x_t$. As a meta theorem, this leads to the Clark-Ocone formula (martingale representation theorem with specific integrand) and Logrithmic Sobolev inequalities. Interpreted appropriately, the latter formula is obviously a special case of the integration by parts formula. Here we show by the Markov property and by induction that the latter formula implies the integration by parts formula. WE also use Bismut's original approach to prove an integration by parts formula, using a connection with torsion and one on the free path space.


title: Strain-induced phase transition in CrI$_{3}$ bilayers

abstract: A monolayer of CrI$_3$ is a two-dimensional crystal that in its equilibrium configuration is a ferromagnetic semiconductor, however, two coupled layers can be ferromagnetic or antiferromagnetic depending on the stacking. We study the magnetic phase diagram upon the strain of the antiferromagnetically coupled bilayer with C2/m symmetry. We found that strain may be an efficient tool to tune the magnetic phase of the structure. A tensile strain stabilizes the antiferromagnetic phase, while a compressive strain turns the system ferromagnetic. We understood that behavior by looking at the relative displacement between layers due to the strain. We also study the evolution of the magnetic anisotropy, the magnetic exchange coupling between Cr atoms, and how the Curie temperature is affected by the strain.


title: Global Health Monitor: A Web-based System for Detecting and Mapping Infectious Diseases

abstract: We present the Global Health Monitor, an online Web-based system for detecting and mapping infectious disease outbreaks that appear in news stories. The system analyzes English news stories from news feed providers, classifies them for topical relevance and plots them onto a Google map using geo-coding information, helping public health workers to monitor the spread of diseases in a geo-temporal context. The background knowledge for the system is contained in the BioCaster ontology (BCO) (Collier et al., 2007a) which includes both information on infectious diseases as well as geographical locations with their latitudes/longitudes. The system consists of four main stages: topic classification, named entity recognition (NER), disease/location detection and visualization. Evaluation of the system shows that it achieved high accuracy on a gold standard corpus. The system is now in practical use. Running on a clustercomputer, it monitors more than 1500 news feeds 24/7, updating the map every hour.


title: Quantifying interference in multipartite quantum systems

abstract: The characterization of quantum correlations is crucial to the development of new quantum technologies and to understand how dramatically quantum theory departs from classical physics. Here we systematically study single- and multiparticle interference patterns produced by general two- and three-qubit systems. From this we establish on phenomenological grounds a new type of quantum correlation for these systems, which we name quantum interference, deriving some quantifiers that are given explicitly in terms of the density matrix elements of the complete system. By using these quantifiers, we show that, contrary to our expectations, entanglement is not a required property for a composite quantum system to manifest multiparticle interference.


title: Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Networks

abstract: Batch Normalization (BN) uses mini-batch statistics to normalize the activations during training, introducing dependence between mini-batch elements. This dependency can hurt the performance if the mini-batch size is too small, or if the elements are correlated. Several alternatives, such as Batch Renormalization and Group Normalization (GN), have been proposed to address this issue. However, they either do not match the performance of BN for large batches, or still exhibit degradation in performance for smaller batches, or introduce artificial constraints on the model architecture. In this paper we propose the Filter Response Normalization (FRN) layer, a novel combination of a normalization and an activation function, that can be used as a replacement for other normalizations and activations. Our method operates on each activation channel of each batch element independently, eliminating the dependency on other batch elements. Our method outperforms BN and other alternatives in a variety of settings for all batch sizes. FRN layer performs $\approx 0.7-1.0\%$ better than BN on top-1 validation accuracy with large mini-batch sizes for Imagenet classification using InceptionV3 and ResnetV2-50 architectures. Further, it performs $>1\%$ better than GN on the same problem in the small mini-batch size regime. For object detection problem on COCO dataset, FRN layer outperforms all other methods by at least $0.3-0.5\%$ in all batch size regimes.


title: Rethinking Normalization and Elimination Singularity in Neural Networks

abstract: In this paper, we study normalization methods for neural networks from the perspective of elimination singularity. Elimination singularities correspond to the points on the training trajectory where neurons become consistently deactivated. They cause degenerate manifolds in the loss landscape which will slow down training and harm model performances. We show that channel-based normalizations (e.g. Layer Normalization and Group Normalization) are unable to guarantee a far distance from elimination singularities, in contrast with Batch Normalization which by design avoids models from getting too close to them. To address this issue, we propose BatchChannel Normalization (BCN), which uses batch knowledge to avoid the elimination singularities in the training of channel-normalized models. Unlike Batch Normalization, BCN is able to run in both large-batch and micro-batch training settings. The effectiveness of BCN is verified on many tasks, including image classification, object detection, instance segmentation, and semantic segmentation. The code is here: https://github.com/joe-siyuan-qiao/Batch-Channel-Normalization.


title: Integration by parts formulae for degenerate diffusion measures on path spaces and diffeomorphism groups

abstract: Integration by parts formulae are given for a class of measures on the space of paths of a smooth manifold $M$ determined by the laws of degenerate diffusions. The mother of such formulae, on the path space of diffeomorphism group of $M$ is shown to arise from a quasi-invariance property of measures determined by stochastic flows. From this the other formulae are derived by filtering out redundant noise using an associated LeJan-Watanabe connection.


title: An Upper Bound for the Number of Rectangulations of a Planar Point Set

abstract: We prove that every set of n points in the plane has at most $(16+5/6)^n$ rectangulations. This improves upon a long-standing bound of Ackerman. Our proof is based on the cross-graph charging-scheme technique.


title: Polarization Transfer from the Twisted Light to an Atom

abstract: When polarized light is absorbed by an atom, the excited atomic system carries information about the initial polarization of light. For the light that carries an orbital angular momentum, or the twisted light, the polarization states are described by eight independent parameters, as opposed to three Stokes parameters for plane waves. We use a parameterization of the spin-density matrix of the twisted light in terms of vector and tensor polarization, in analogy with massive spin-1 particles, and derive formulae that define atom's response to specific polarization components of the twisted light. It is shown that for dipole ($S\to P$) atomic transitions, the atom's polarization is in one-to-one correspondence with polarization of the incident light; this relation is violated, however, for the transitions of higher multipolarity ($S\to D$, $S\to F$, etc.) We pay special attention to contributions of the longitudinal electric field into the matrix elements of atomic transitions.


title: Probing the linearly polarized gluons in unpolarized proton with heavy-quark pair production

abstract: We consider the azimuthal $\cos \varphi$ and $\cos 2\varphi$ distributions and the Callan-Gross ratio $R={\rm d}\sigma_L/{\rm d}\sigma_T$ in heavy-quark pair electroproduction, $lN\rightarrow l^{\prime}Q\bar{Q}X$, as probes of linearly polarized gluons in unpolarized nucleons. Our analysis shows that the azimuthal asymmetries and Callan-Gross ratio are predicted to be large and very sensitive to the contribution of the gluonic counterpart of the Boer-Mulders function, $h_{1}^{\perp g}$, describing the linear polarization of gluons inside unpolarized nucleon. In particular, the maximum values of the azimuthal distributions vary from 0 to 1 depending on $h_{1}^{\perp g}$. We conclude that future measurements of these quantities at the proposed EIC and LHeC colliders could clarify in details the proton spin decomposition puzzle.


title: Nature of the vector resonance $Y(2175)$

abstract: Spectroscopic parameters and decay channels of the vector resonance $Y(2175)$ are studied by considering it as a diquark-antidiquark state with the quark content $su\overline{s}\overline{u}$. The mass and coupling of the tetraquark $Y(2175)$ are calculated using the QCD two-point sum rules by taking into account various quark, gluon and mixed condensates up to dimension 15. Partial widths of its strong decays to $\phi f_{0}(980)$, $ \phi \eta$, and $\phi \eta^{\prime}$ are computed as well. To this end, we explore the vertices $Y\phi f_{0}(980)$, $Y\phi \eta$, and $Y\phi \eta^{\prime}$, and calculate the corresponding strong couplings by means of the QCD light-cone sum rule method. The coupling $G_{Y\phi f}$ of the vertex $Y\phi f_{0}(980)$ is found using the full version of this method, and by treating the scalar meson $f_{0}(980)$ as a diquark-antidiquark tetraquark state. The couplings $g_{Y\phi \eta }$ and $g_{Y\phi \eta^{\prime}}$, however, are calculated by applying the soft-meson approximation to the light-cone sum rule method. Prediction for the mass of the resonance $m_{Y} =\left( 2173\pm 85\right)~\mathrm{MeV}$ is in excellent agreement with the data of the BaBar Collaboration \cite{Aubert:2006bu}, and within errors of calculations is compatible with the result reported by BESIII \cite {Ablikim:2014pfc}. The full width $\Gamma _{\mathrm{full}}=(91.1\pm 20.5)~ \mathrm{MeV}$ of the $Y(2175)$ saturated by its three strong decay channels is in a reasonable agreement with existing experimental data.


title: Lecture Notes on Chern-Simons Perturbation Theory

abstract: The goal of these lectures is to exhibit the framing anomaly in the Batalin-Vilkovisky formulation of perturbative Chern-Simons theory. Concretely, we show that the partition function fails to satisfy the Quantum Master Equation, and show that this can be remedied at the cost of introducing a framing. Along the way, we discuss principal bundles and connections, the Chern-Simons action functional, and perturbative quantization of gauge theories in the Batalin-Vilkovisky formalism.


title: Understanding $\Omega_\mathrm{gw}(f)$ in Gravitational Wave Experiments

abstract: In this paper we provide a comprehensive derivation of the energy density in the stochastic gravitational-wave background $\Omega_\mathrm{gw}(f)$, and show how this quantity is measured in ground-based detectors such as Laser Interferometer Gravitational-Wave Observatory (LIGO), space-based Laser Interferometer Space Antenna (LISA), and Pulsar Timing Arrays. By definition $\Omega_\mathrm{gw}(f) \propto S_h(f)$ -- the power spectral density (PSD) of the Fourier modes of the gravitational-wave background. However, this is often confused with the PSD of the strain signal, which we call $S_\mathrm{gw}(f)$, and is a detector-dependent quantity. This has led to confusing definitions of $\Omega_\mathrm{gw}(f)$ in the literature which differ by factors of up to 5 when written in a detector-dependent way. In addition to clarifying this confusion, formulas presented in this paper facilitate easy comparison of results from different detector groups, and how to convert from one measure of the strength of the background (or an upper limit) to another. Our codes are public and on GitHub.


title: Stability of neutral minima against charge breaking in the Higgs triplet model

abstract: We analyse the possibility of charge breaking minima developing in the Higgs triplet model, and under what conditions they are deeper than charge-preserving ones. Analytical expressions relating the depth of minima of different types are deduced. A global symmetry of the model leads to increased stability for charge-preserving vacua. However, if that symmetry is broken by a soft term, deeper charge-breaking minima may occur more easily. We identify the vev configurations most likely to produce charge breaking minima.


title: Decentralized Consensus Optimization Based on Parallel Random Walk

abstract: The alternating direction method of multipliers (ADMM) has recently been recognized as a promising approach for large-scale machine learning models. However, very few results study ADMM from the aspect of communication costs, especially jointly with running time. In this letter, we investigate the communication efficiency and running time of ADMM in solving the consensus optimization problem over decentralized networks. We first review the effort of random walk ADMM (W-ADMM), which reduces communication costs at the expense of running time. To accelerate the convergence speed of W-ADMM, we propose the parallel random walk ADMM (PW-ADMM) algorithm, where multiple random walks are active at the same time. Moreover, to further reduce the running time of PW-ADMM, the intelligent parallel random walk ADMM (IPW-ADMM) algorithm is proposed through integrating the \textit{Random Walk with Choice} with PW-ADMM. By numerical results from simulations, we demonstrate that the proposed algorithms can be both communication efficient and fast in running speed compared with state-of-the-art methods.


title: The nature of the chemical bond in the dicarbon molecule

abstract: The molecular dissociation energy has often been explained and discussed in terms of singlet bonds, formed by bounded pairs of valence electrons. In this work we use a highly correlated resonating valence bond ansatz, providing a consistent paradigm for the chemical bond, where spin fluctuations are shown to play a crucial role. Spin fluctuations are known to be important in magnetic systems and correspond to the zero point motion of the spin waves emerging from a magnetic broken symmetry state. Recently, in order to explain the excitation spectrum of the carbon dimer, an unusual quadruple bond has been proposed. Within our ansatz, a satisfactory description of the carbon dimer is determined by the magnetic interaction of two Carbon atoms with antiferromagnetically ordered S = 1 magnetic moments. This is a first step that, thanks to the highly scalable and efficient quantum Monte Carlo technique, may open the way for understanding challenging complex systems containing atoms with large spins (e.g. transition metals).


title: Energy cascade rate measured in a collisionless space plasma with MMS data and compressible Hall magnetohydrodynamic turbulence theory

abstract: The first complete estimation of the compressible energy cascade rate $|\varepsilon_\text{C}|$ at magnetohydrodynamic (MHD) and sub-ion scales is obtained in the Earth's magnetosheath using Magnetospheric MultiScale (MMS) spacecraft data and an exact law derived recently for {\it compressible} Hall MHD turbulence. A multi-spacecraft technique is used to compute the velocity and magnetic gradients, and then all the correlation functions involved in the exact relation. It is shown that when the density fluctuations are relatively small, $|\varepsilon_\text{C}|$ identifies well with its incompressible analogue $|\varepsilon_\text{I}|$ at MHD scales but becomes much larger than $|\varepsilon_\text{I}|$ at sub-ion scales. For larger density fluctuations, $|\varepsilon_\text{C}|$ is larger than $|\varepsilon_\text{I}|$ at every scale with a value significantly higher than for smaller density fluctuations. Our study reveals also that for both small and large density fluctuations, the non-flux terms remain always negligible with respect to the flux terms and that the major contribution to $|\varepsilon_\text{C}|$ at sub-ion scales comes from the compressible Hall flux.


title: Electron and hole mobility of rutile GeO$_2$ from first principles: an ultrawide-band-gap semiconductor for power electronics

abstract: Rutile germanium dioxide (r-GeO$_2$) is a recently predicted ultrawide-band-gap semiconductor with potential applications in high-power electronic devices, for which the carrier mobility is an important material parameter that controls the device efficiency. We apply first-principles calculations based on density functional and density functional perturbation theory to investigate carrier-phonon coupling in r-GeO$_2$ and predict its phonon-limited electron and hole mobilities as a function of temperature and crystallographic orientation. The calculated carrier mobilities at 300 K are $\mu_{\text{elec},\perp \vec{c}}$=244 cm$^2$ V$^{-1}$ s$^{-1}$, $\mu_{\text{elec},||\vec{c}}$=377 cm$^2$ V$^{-1}$ s$^{-1}$, $\mu_{\text{hole},\perp \vec{c}}$=27 cm$^2$ V$^{-1}$ s$^{-1}$, and $\mu_{\text{hole},||\vec{c}}$=29 cm$^2$ V$^{-1}$ s$^{-1}$. At room temperature, carrier scattering is dominated by the low-frequency polar-optical phonon modes. The predicted Baliga figure of merit of n-type r-GeO$_2$ surpasses several incumbent semiconductors such as Si, SiC, GaN, and $\beta$-Ga$_2$O$_3$, demonstrating its superior performance in high-power electronic devices.


title: First detection of the carbon chain molecules 13CCC and C13CC towards SgrB2(M)

abstract: We report the first detection of the isotopologues 13CCC and C13CC. We used the heterodyne receivers GREAT and upGREAT on board SOFIA to search for the ro-vibrational transitions Q(2) and Q(4) of 13CCC and C13CC at 1.9 THz along the line of sight towards SgrB2(M). For both species the ro-vibrational absorption lines Q(2) and Q(4) have been identified, primarily arising from the warm gas physically associated with the strong continuum source SgrB2(M). In addition, to determine the local excitation temperature we analyzed data from nine ro-vibrational transitions of the main isotopologue CCC in the frequency range between 1.6-1.9 THz which were taken from the Herschel Science Data Archive, and derived a gas excitation temperature of Tex = 44.4(+4.7/-3.9) K and a total column density of N(CCC)=3.88(+0.39/-0.35)x10^15 cm^-2. Assuming the excitation temperatures of C13CC and 13CCC to be the same as for CCC, we obtained column densities of the 13C-isotopologues of N(C13CC) = 2.1(+0.9/-0.6)X10^14 cm^-2 and N(13CCC)=2.4(+1.2/-0.8)x10^14 cm^-2. The derived 12C/13C abundance ratio in the C3 molecules is 20.5(4.2), which is in agreement with the elemental ratio of 20, typically observed in SgrB2(M). However, we find the N(13CCC) / N(C13CC) ratio to be 1.2(0.1), which is shifted from the statistically expected value of 2. We propose that the discrepant abundance ratio arises due to the lower zero-point energy of C13CC which makes position exchange reaction converting 13CCC to C13CC energetically favorable.


title: L\'evy flights for light in ordered lasers

abstract: L\'evy flights for light have been demonstrated in disordered systems with and without optical gain, and remained unobserved in ordered ones. In the present letter, we investigate, numerically and experimentally, L\'evy flights for light in ordered systems due to an ordered (conventional) laser. The statistical analysis was performed on the intensity fluctuations of the output spectra upon repeated identical experimental realizations. We found out that the optical gain and the mirrors reflectivity are critical parameters governing the fluctuation statistics. We identified L\'evy regimes for gain around the laser threshold, and Gaussian-L\'evy-Gaussian crossovers were unveiling when increasing the gain from below to above the threshold. The experimental results were corroborated by Monte Carlo simulations, and the fluctuations were associated to a Langevin noise source that takes into account the randomness of the spontaneous emission, which seeds the laser emission and can cause large fluctuations of the output spectra from shot-to-shot under identical experimental realizations.


title: Reinforcing an Image Caption Generator Using Off-Line Human Feedback

abstract: Human ratings are currently the most accurate way to assess the quality of an image captioning model, yet most often the only used outcome of an expensive human rating evaluation is a few overall statistics over the evaluation dataset. In this paper, we show that the signal from instance-level human caption ratings can be leveraged to improve captioning models, even when the amount of caption ratings is several orders of magnitude less than the caption training data. We employ a policy gradient method to maximize the human ratings as rewards in an off-policy reinforcement learning setting, where policy gradients are estimated by samples from a distribution that focuses on the captions in a caption ratings dataset. Our empirical evidence indicates that the proposed method learns to generalize the human raters' judgments to a previously unseen set of images, as judged by a different set of human judges, and additionally on a different, multi-dimensional side-by-side human evaluation procedure.


title: Cubic surfaces as Pfaffians

abstract: We prove that every cubic surface in $\mathbb{C}[x,y,z,t]$ is Pfaffian. A constructive proof is given.


title: An Efficient Parametric Linear Programming Solver and Application to Polyhedral Projection

abstract: Polyhedral projection is a main operation of the polyhedron abstract domain.It can be computed via parametric linear programming (PLP), which is more efficient than the classic Fourier-Motzkin elimination method.In prior work, PLP was done in arbitrary precision rational arithmetic.In this paper, we present an approach where most of the computation is performed in floating-point arithmetic, then exact rational results are reconstructed.We also propose a workaround for a difficulty that plagued previous attempts at using PLP for computations on polyhedra: in general the linear programming problems are degenerate, resulting in redundant computations and geometric descriptions.


title: Estimating Time-Varying Applied Current in the Hodgkin-Huxley Model

abstract: The classic Hodgkin-Huxley model is widely used for understanding the electrophysiological dynamics of a single neuron. While applying a constant current to the system results in a single voltage spike, it is possible to produce more interesting dynamics by applying time-varying currents, which may not be experimentally measurable. The aim of this work is to estimate time-varying applied currents of different deterministic forms given noisy voltage data. In particular, we utilize an augmented ensemble Kalman filter with parameter tracking to estimate four different deterministic applied currents, analyzing how the model dynamics change in each case. We test the efficiency of the parameter tracking algorithm in this setting by exploring the effects of changing the standard deviation of the parameter drift and the frequency of data available on the resulting time-varying applied current estimates and related uncertainty.


title: A multi-material topology optimization algorithm based on the topological derivative

abstract: We present a level-set based topology optimization algorithm for design optimization problems involving an arbitrary number of different materials, where the evolution of a design is solely guided by topological derivatives. Our method can be seen as an extension of the algorithm that was introduced in (Amstutz, Andrae 2006) for two materials to the case of an arbitrary number $M$ of materials. We represent a design that consists of multiple materials by means of a vector-valued level set function which maps into $\mathbb R^{M-1}$. We divide the space $\mathbb R^{M-1}$ into $M$ sectors, each corresponding to one material, and establish conditions for local optimality of a design based on certain generalized topological derivatives. The optimization algorithm consists in a fixed point iteration striving to reach this optimality condition. Like the two-material version of the algorithm, also our method possesses a nucleation mechanism such that it is not necessary to start with a perforated initial design. We show numerical results obtained by applying the algorithm to an academic example as well as to the compliance minimization in linearized elasticity.


title: Atmospheric Characterization and Further Orbital Modeling of $\kappa$ And b

abstract: We present $\kappa$ Andromeda b's photometry and astrometry taken with Subaru/SCExAO+HiCIAO and Keck/NIRC2, combined with recently published SCExAO/CHARIS low-resolution spectroscopy and published thermal infrared photometry to further constrain the companion's atmospheric properties and orbit. $\kappa$ And b's Y/Y-K colors are redder than field dwarfs, consistent with its youth and lower gravity. Empirical comparisons of its Y-band photometry and CHARIS spectrum to a large spectral library of isolated field dwarfs reaffirm the conclusion from Currie et al. (2018) that it likely has a low gravity but admit a wider range of most plausible spectral types (L0-L2). Our gravitational classification also suggests that the best-fit objects for $\kappa$ And b may have lower gravity than those previously reported. Atmospheric models lacking dust/clouds fail to reproduce its entire 1--4.7 $\mu m$ spectral energy distribution, cloudy atmosphere models with temperatures of $\sim$ 1700--2000 $K$ better match $\kappa$ And b data. Most well-fitting model comparisons favor 1700--1900 $K$, a surface gravity of log(g) $\sim$ 4--4.5, and a radius of 1.3--1.6\,$R_{\rm Jup}$; the best-fit model (DRIFT-Phoenix) yields the coolest and lowest-gravity values: $T_{\rm eff}$=1700 K and $\log g$=4.0. An update to $\kappa$ And b's orbit with ExoSOFT using new astrometry spanning seven years reaffirms its high eccentricity ($0.77\pm0.08$). We consider a scenario where unseen companions are responsible for scattering $\kappa$ And b to a wide separation and high eccentricity. If three planets, including $\kappa$ And b, were born with coplanar orbits and one of them was ejected by gravitational scattering, a potential inner companion with mass $\gtrsim10M_{\rm Jup}$ could be located at $\lesssim$ 25 au.


title: Low-energy isoscalar dipole response of heavy nuclei within kinetic model

abstract: The low-energy isoscalar dipole response of heavy spherical nuclei is studied by using a semiclassical model, based on the solution of the linearized Vlasov kinetic equation for finite Fermi systems. In this translation-invariant model the excitations of the center of mass motion are exactly separated from the internal ones. The low-energy dipole strength function displays three resonance structures in the energy region up to 15 MeV. Calculations of the velocity fields associated with the resonance structures at the centroid energies show a vortex (toroidal) character of two overlying resonances, while the origin of the lowest isoscalar dipole resonance structure is related to the dipole single-particle excitations. Its centroid energy is close to the minimum energy of the dipole single-particle spectrum. The main toroidal resonance gives a qualitative description of the low-energy isoscalar dipole resonance observed in heavy spherical nuclei.


title: Neutron Star QPOs from Oscillating, Precessing Hot, Thick Flow

abstract: Across black hole (BH) and neutron star (NS) low-mass X-ray binaries (LMXBs), there appears to be some correlation between certain high- and low-frequency quasi-periodic oscillations (QPOs). In a previous paper, we showed that for BH LMXBs, this could be explained by the simultaneous oscillation and precession of a hot, thick, torus-like corona. In the current work, we extend this idea to NS LMXBs by associating the horizontal branch oscillations (HBO) with precession and the upper-kiloHertz (ukHz) QPO with vertical epicyclic motion. For the Atoll source 4U 1608-52, the model can match many distinct, simultaneous observations of the HBO and ukHz QPO by varying the inner and outer radius of the torus, while maintaining fixed values for the mass (M_{NS}) and spin (a_*) of the neutron star. The best fit values are M_{NS} = 1.38 \pm 0.03 M_\odot and a_* = 0.325 \pm 0.005. By combining these constraints with the measured spin frequency, we are able to obtain an estimate for the moment of inertia of I_{NS} = 1.40 \pm 0.02 \times 10^{45} g cm^2, which places constraints on the equation of state. The model is unable to fit the lower-kHz QPO, but evidence suggests that QPO may be associated with the boundary layer between the accretion flow and the neutron star surface, which is not treated in this work.


title: Controlling False Discovery Rate Using Gaussian Mirrors

abstract: Simultaneously finding multiple influential variables and controlling the false discovery rate (FDR) for linear regression models is a fundamental problem. We here propose the Gaussian Mirror (GM) method, which creates for each predictor variable a pair of mirror variables by adding and subtracting a randomly generated Gaussian perturbation, and proceeds with a certain regression method, such as the ordinary least-square or the Lasso (the mirror variables can also be created after selection). The mirror variables naturally lead to test statistics effective for controlling the FDR. Under a mild assumption on the dependence among the covariates, we show that the FDR can be controlled at any designated level asymptotically. We also demonstrate through extensive numerical studies that the GM method is more powerful than many existing methods for selecting relevant variables subject to FDR control, especially for cases when the covariates are highly correlated and the influential variables are not overly sparse.


title: Speech Sentiment Analysis via Pre-trained Features from End-to-end ASR Models

abstract: In this paper, we propose to use pre-trained features from end-to-end ASR models to solve speech sentiment analysis as a down-stream task. We show that end-to-end ASR features, which integrate both acoustic and text information from speech, achieve promising results. We use RNN with self-attention as the sentiment classifier, which also provides an easy visualization through attention weights to help interpret model predictions. We use well benchmarked IEMOCAP dataset and a new large-scale speech sentiment dataset SWBD-sentiment for evaluation. Our approach improves the-state-of-the-art accuracy on IEMOCAP from 66.6% to 71.7%, and achieves an accuracy of 70.10% on SWBD-sentiment with more than 49,500 utterances.


title: An Innovative Approach to Addressing Childhood Obesity: A Knowledge-Based Infrastructure for Supporting Multi-Stakeholder Partnership Decision-Making in Quebec, Canada

abstract: The purpose of this paper is to describe and analyze the development of a knowledge-based infrastructure to support MSP decision-making processes. The paper emerged from a study to define specifications for a knowledge-based infrastructure to provide decision support for community-level MSPs in the Canadian province of Quebec. As part of the study, a process assessment was conducted to understand the needs of communities as they collect, organize, and analyze data to make decisions about their priorities. The result of this process is a portrait, which is an epidemiological profile of health and nutrition in their community. Portraits inform strategic planning and development of interventions and are used to assess the impact of interventions. Our key findings indicate ambiguities and disagreement among MSP decision-makers regarding causal relationships between actions and outcomes, and the relevant data needed for making decisions. MSP decision-makers expressed a desire for easy-to-use tools that facilitate the collection, organization, synthesis, and analysis of data, to enable decision-making in a timely manner. Findings inform conceptual modeling and ontological analysis to capture the domain knowledge and specify relationships between actions and outcomes. This modeling and analysis provide the foundation for an ontology, encoded using OWL 2 Web Ontology Language. The ontology is developed to provide semantic support for the MSP process, defining objectives, strategies, actions, indicators, and data sources. In the future, software interacting with the ontology can facilitate interactive browsing by decision-makers in the MSP in the form of concepts, instances, relationships, and axioms. Our ontology also facilitates the integration and interpretation of community data and can help in managing semantic interoperability between different knowledge sources.


title: Geometric stochastic analysis on path spaces

abstract: An approach to analysis on path spaces of Riemannian manifolds is described. The spaces are furnished with `Brownian motion' measure which lies on continuous paths, though differentiation is restricted to directions given by tangent paths of finite energy. An introduction describes the background for paths on ${\mathbb R}^m$ and Malliavin calculus. For manifold valued paths the approach is to use `It\^o' maps of suitable stochastic differential equations as charts . `Suitability' involves the connection determined by the stochastic differential equation. Some fundamental open problems concerning the calculus and the resulting `Laplacian' are described. A theory for more general diffusion measures is also briefly indicated. The same method is applied as an approach to getting over the fundamental difficulty of defining exterior differentiation as a closed operator, with success for one \& two forms leading to a Hodge -Kodaira operator and decomposition for such forms. Finally there is a brief description of some related results for loop spaces.


title: Mixture survival models methodology: an application to cancer immunotherapy assessment in clinical trials

abstract: Progress in immunotherapy revolutionized the treatment landscape for advanced lung cancer, raising survival expectations beyond those that were historically anticipated with this disease. In the present study, we describe the methods for the adjustment of mixture parametric models of two populations for survival analysis in the presence of long survivors. A methodology is proposed in several five steps: first, it is proposed to use the multimodality test to decide the number of subpopulations to be considered in the model, second to adjust simple parametric survival models and mixture distribution models, to estimate the parameters and to select the best model fitted the data, finally, to test the hypotheses to compare the effectiveness of immunotherapies in the context of randomized clinical trials. The methodology is illustrated with data from a clinical trial that evaluates the effectiveness of the therapeutic vaccine CIMAvaxEGF vs the best supportive care for the treatment of advanced lung cancer. The mixture survival model allows estimating the presence of a subpopulation of long survivors that is 44% for vaccinated patients. The differences between the treated and control group were significant in both subpopulations (population of short-term survival: p = 0.001, the population of long-term survival: p = 0.0002). For cancer therapies, where a proportion of patients achieves long-term control of the disease, the heterogeneity of the population must be taken into account. Mixture parametric models may be more suitable to detect the effectiveness of immunotherapies compared to standard models.


title: Lecture Notes on Spin Geometry

abstract: We review the Atiyah-Singer Index theorem and some applications. Only basic knowledge of differential geometry and Lie groups is required.


title: Local wellposedness of the modified KP-I equations in periodic setting with small initial data

abstract: We prove local well-posedness of partially periodic and periodic modified KP-I equations, namely for $\partial_t u+(-1)^{\frac{l+1}{2}}\partial^l_x u-\partial_x^{-1}\partial_y^2 u+u^2\partial_x u=0$ in the anisotropic Sobolev space $H^{s,s}(\mathbb{R}\times \mathbb{T})$ if $l=3$ and $s>2$, in $H^{s,s}(\mathbb{T}\times \mathbb{T})$ if $l=3$ and $s>\frac{19}{8}$, and in $H^{s,s}(\mathbb{R}\times \mathbb{T})$ if $l=5$ and $s>\frac{5}{2}$. All three results require the initial data to be small.


title: Critical exponents for the valence-bond-solid transition in lattice quantum electrodynamics

abstract: Recent sign-problem-free quantum Monte Carlo simulations of (2+1)-dimensional lattice quantum electrodynamics (QED$_3$) with $N_f$ flavors of fermions on the square lattice have found evidence of continuous quantum phase transitions between a critical phase and a gapped valence-bond-solid (VBS) phase for flavor numbers $N_f=4$, $6$, and $8$. We derive the critical theory for these transitions, the chiral $O(2)$ QED$_3$-Gross-Neveu model, and show that the latter is equivalent to the gauged Nambu--Jona-Lasinio model. Using known large-$N_f$ results for the latter, we estimate the order parameter anomalous dimension and the correlation length exponent for the transitions mentioned above. We obtain large-$N_f$ results for the dimensions of fermion bilinear operators, in both the gauged and ungauged chiral $O(2)$ Gross-Neveu models, which respectively describe the long-distance power-law decay of two-particle correlation functions at the VBS transition in lattice QED$_3$ and the Kekul\'e-VBS transition for correlated fermions on the honeycomb lattice.


title: Geo-clustered chronic affinity: pathways from socio-economic disadvantages to health disparities

abstract: Our objective was to develop and test a new concept (affinity) analogous to multimorbidity of chronic conditions for individuals at census tract level in Memphis, TN. The use of affinity will improve the surveillance of multiple chronic conditions and facilitate the design of effective interventions. We used publicly available chronic condition data (Center for Disease Control and Prevention 500 Cities project), socio-demographic data (US Census Bureau), and demographic data (Environmental Systems Research Institute). A geo-distinctive pattern of clustered chronic affinity associated with socio-economic deprivation wasobserved. Statistical results confirmed that neighborhoods with higher rates of crime, poverty, and unemploy-ment were associated with an increased likelihood of having a higher affinity among major chronic conditions.With the inclusion of smoking in the model, however, only the crime prevalence was statistically significantlyassociated with the chronic affinity. Chronic affinity disadvantages were disproportionately accumulated in socially disadvantagedareas. We showed links between commonly co-observed chronic diseases at the population level and systemat-ically explored the complexity of affinity and socio-economic disparities. Our affinity score, based on publiclyavailable datasets, served as a surrogate for multimorbidity at the population level, which may assist policy-makers and public health planners to identify urgent hot spots for chronic disease and allocate clinical, medicaland healthcare resources efficiently.


title: Character expansion of Kac-Moody correction factors

abstract: A correction factor naturally arises in the theory of p-adic Kac--Moody groups. In this paper, we expand the correction factor into a sum of irreducible characters of the underlying Kac--Moody algebra. We derive a formula for the coefficients, which lie in the ring of power series with integral coefficients. In the case that the Weyl group is a universal Coxeter group, we show that the coefficients are actually polynomials.


title: Poisson-Minibatching for Gibbs Sampling with Convergence Rate Guarantees

abstract: Gibbs sampling is a Markov chain Monte Carlo method that is often used for learning and inference on graphical models. Minibatching, in which a small random subset of the graph is used at each iteration, can help make Gibbs sampling scale to large graphical models by reducing its computational cost. In this paper, we propose a new auxiliary-variable minibatched Gibbs sampling method, {\it Poisson-minibatching Gibbs}, which both produces unbiased samples and has a theoretical guarantee on its convergence rate. In comparison to previous minibatched Gibbs algorithms, Poisson-minibatching Gibbs supports fast sampling from continuous state spaces and avoids the need for a Metropolis-Hastings correction on discrete state spaces. We demonstrate the effectiveness of our method on multiple applications and in comparison with both plain Gibbs and previous minibatched methods.


title: Spectral swaps in a two-dimensional neutrino ring model

abstract: Neutrinos emitted deep within a supernova explosion experience a self-induced index of refraction. In the stationary, one-dimensional (1D) supernova "bulb model", this self-induced refraction can lead to a collective flavor transformation which is coherent among different neutrino momentum modes. Such collective oscillations can produce partial swaps of the energy spectra of different neutrino species as the neutrinos stream away from the proto-neutron star. However, it has been demonstrated that the spatial symmetries (such as the spherical symmetry in the bulb model) can be broken spontaneously by collective neutrino oscillations in multi-dimensional models. Using a stationary, 2D neutrino ring model we demonstrate that there exist two limiting scenarios where collective oscillations may occur. In one limit, the collective flavor transformation begins at a radius with relatively high neutrino densities and develops small-scale flavor structures. The loss of the spatial correlation in the neutrino flavor field results in similar (average) energy spectra for the anti-neutrinos of almost all energies and the neutrinos of relatively high energies. In the other limit, the flavor transformation starts at a radius where the neutrino densities are smaller (e.g., due to the suppression of the high matter density near the proto-neutron star). Although the spatial symmetry is broken initially, it is restored as the neutrino densities decrease, and the neutrinos of different flavors partially swap their energy spectra as in the 1D bulb model. This finding may have interesting ramifications in other aspects of supernova physics.


title: Continuous and discrete abstractions for planning, applied to ship docking

abstract: We propose a hierarchical control framework for the synthesis of correct-by-construction controllers for nonlinear control-affine systems with respect to reach-avoid-stay specifications. We first create a low-dimensional continuous abstraction of the system and use Sum-of-Squares (SOS) programming to obtain a low-level controller ensuring a bounded error between the two models. We then create a discrete abstraction of the continuous abstraction and use formal methods to synthesize a controller satisfying the specifications shrunk by the obtained error bound. Combining both controllers finally solves the main control problem on the initial system. This two-step framework allows the discrete abstraction methods to deal with higher-dimensional systems which may be computationally expensive without the prior continuous abstraction. The main novelty of the proposed SOS continuous abstraction is that it allows the error between abstract and concrete models to explicitly depend on the control input of the abstract model, which offers more freedom in the choice of the continuous abstraction model and provides lower error bounds than when only the states of both models are considered. This approach is illustrated on the docking problem of a marine vessel.


title: Cosmic ray transport in starburst galaxies

abstract: Starburst galaxies are efficient $\gamma$-ray producers, because their high supernova rates generate copious cosmic ray (CR) protons, and their high gas densities act as thick targets off which these protons can produce neutral pions and thence $\gamma$-rays. In this paper we present a first-principles calculation of the mechanisms by which CRs propagate through such environments, combining astrochemical models with analysis of turbulence in weakly ionised plasma. We show that CRs cannot scatter off the strong large-scale turbulence found in starbursts, because efficient ion-neutral damping prevents such turbulence from cascading down to the scales of CR gyroradii. Instead, CRs stream along field lines at a rate determined by the competition between streaming instability and ion-neutral damping, leading to transport via a process of field line random walk. This results in an effective diffusion coefficient that is nearly energy-independent up to CR energies of $\sim 1$ TeV. We apply our computed diffusion coefficient to a simple model of CR escape and loss, and show that the resulting $\gamma$-ray spectra are in good agreement with the observed spectra of the starbursts NGC 253, M82, and Arp 220. In particular, our model reproduces these galaxies' relatively hard GeV $\gamma$-ray spectra and softer TeV spectra without the need for any fine-tuning of advective escape times or the shape of the CR injection spectrum.


title: Interval Reachability Analysis using Second-Order Sensitivity

abstract: We propose a new approach to compute an interval over-approximation of the finite time reachable set for a large class of nonlinear systems. This approach relies on the notions of sensitivity matrices, which are the partial derivatives representing the variations of the system trajectories in response to variations of the initial states. Using interval arithmetics, we first over-approximate the possible values of the second-order sensitivity at the final time of the reachability problem. Then we exploit these bounds and the evaluation of the first-order sensitivity matrices at a few sampled initial states to obtain an over-approximation of the first-order sensitivity, which is in turn used to over-approximate the reachable set of the initial system. Unlike existing methods relying only on the first-order sensitivity matrix, this new approach provides guaranteed over-approximations of the first-order sensitivity and can also provide such over-approximations with an arbitrary precision by increasing the number of samples.


title: TMI: Thermodynamic inference of data manifolds

abstract: The Gibbs-Boltzmann distribution offers a physically interpretable way to massively reduce the dimensionality of high dimensional probability distributions where the extensive variables are `features' and the intensive variables are `descriptors'. However, not all probability distributions can be modeled using the Gibbs-Boltzmann form. Here, we present TMI: TMI, {\bf T}hermodynamic {\bf M}anifold {\bf I}nference; a thermodynamic approach to approximate a collection of arbitrary distributions. TMI simultaneously learns from data intensive and extensive variables and achieves dimensionality reduction through a multiplicative, positive valued, and interpretable decomposition of the data. Importantly, the reduced dimensional space of intensive parameters is not homogeneous. The Gibbs-Boltzmann distribution defines an analytically tractable Riemannian metric on the space of intensive variables allowing us to calculate geodesics and volume elements. We discuss the applications of TMI with multiple real and artificial data sets. Possible extensions are discussed as well.


title: Effects of Differential Privacy and Data Skewness on Membership Inference Vulnerability

abstract: Membership inference attacks seek to infer the membership of individual training instances of a privately trained model. This paper presents a membership privacy analysis and evaluation system, called MPLens, with three unique contributions. First, through MPLens, we demonstrate how membership inference attack methods can be leveraged in adversarial machine learning. Second, through MPLens, we highlight how the vulnerability of pre-trained models under membership inference attack is not uniform across all classes, particularly when the training data itself is skewed. We show that risk from membership inference attacks is routinely increased when models use skewed training data. Finally, we investigate the effectiveness of differential privacy as a mitigation technique against membership inference attacks. We discuss the trade-offs of implementing such a mitigation strategy with respect to the model complexity, the learning task complexity, the dataset complexity and the privacy parameter settings. Our empirical results reveal that (1) minority groups within skewed datasets display increased risk for membership inference and (2) differential privacy presents many challenging trade-offs as a mitigation technique to membership inference risk.


title: Crystallization of Cuprous Oxide Thin Films by Continuous-Wave Laser Diode with Micro-Chevron Laser Beam ({\mu}-CLB)

abstract: Crystallization of thin film materials by exploiting laser induced crystallization has been advancing for the past four decades. This unique thin film technique has been predominantly used in processing thin film materials made of a single chemical element; however, harnessing this technique to extend its use for thin film materials containing multiple chemical elements (e.g., metal oxides) unlocks applications currently not accessible. In this study, laser crystallization of a Cu2O strip was demonstrated. A continuous-wave laser diode with a micrometer-scale chevron-shaped beam profile (micro chevron laser beam) was used to crystallize CuO thin films covered with an amorphous carbon (a-C) cap layer, deposited on fused silica substrates. Electron backscatter diffraction, Raman spectroscopy, photoluminescence spectroscopy, and UV-Vis spectroscopy were used to investigate the crystallinity and optical properties of the Cu2O thin films revealing their unique characteristics associated with the crystallization process.


title: Multi-model mimicry for model selection according to generalised goodness-of-fit criteria

abstract: Multi-model mimicry (MMM) is a flexible model selection technique for comparison of multiple, non-nested models on any desired goodness-of-fit criteria. Applicable to any set of candidate models that are 1) able to be fit to observed data, 2) can simulate new sets of data under the models, and 3) have a metric by which a dataset's goodness-of-fit to the model can be calculated, MMM has a much broader range of applicability than many standard model selection techniques. This manuscript highlights the previous literature whilst presenting the theoretical framework underpinning MMM. The scope of applicability is broadened through presentation of generalised criteria for comparison and the effectiveness of the method is demonstrated. Clear instruction for the application of MMM and the classification techniques required for model selection are also included.


title: Is density functional theory accurate for lytic polysaccharide monooxygenase enzymes?

abstract: The lytic polysaccharide monooxygenase (LPMO) enzymes boost polysaccharide depolymerization through oxidative chemistry, which has fueled the hope for more energy-efficient production of biofuel. We have recently proposed a mechanism for the oxidation of the polysaccharide substrate (Hedeg{\aa}rd & Ryde, Chem. Sci. 2018, 9, 3866). In this mechanism, complexes with superoxide, oxyl, as well as hydroxyl (i.e. [CuO2]+, [CuO]+ and [CuOH]2+) cores were involved. These complexes can have both singlet and triplet spin states, and both spin-states may be important for how LPMOs function during catalytic turnover. Previous calculations on LPMOs have exclusively been based on density functional theory (DFT). However, different DFT functionals are known to display large differences for spin-state splittings in transition-metal complexes, and this has also been an issue for LPMOs. In this paper, we study the accuracy of DFT for spin-state splittings in superoxide, oxyl, and hydroxyl intermediates involved in LPMO turnover. As reference we employ multiconfigurational perturbation theory (CASPT2).


title: Beyond Synthetic Noise: Deep Learning on Controlled Noisy Labels

abstract: Performing controlled experiments on noisy data is essential in understanding deep learning across noise levels. Due to the lack of suitable datasets, previous research has only examined deep learning on controlled synthetic label noise, and real-world label noise has never been studied in a controlled setting. This paper makes three contributions. First, we establish the first benchmark of controlled real-world label noise from the web. This new benchmark enables us to study the web label noise in a controlled setting for the first time. The second contribution is a simple but effective method to overcome both synthetic and real noisy labels. We show that our method achieves the best result on our dataset as well as on two public benchmarks (CIFAR and WebVision). Third, we conduct the largest study by far into understanding deep neural networks trained on noisy labels across different noise levels, noise types, network architectures, and training settings. The data and code are released at the following link: http://www.lujiang.info/cnlw.html


title: Verbal Programming of Robot Behavior

abstract: Home robots may come with many sophisticated built-in abilities, however there will always be a degree of customization needed for each user and environment. Ideally this should be accomplished through one-shot learning, as collecting the large number of examples needed for statistical inference is tedious. A particularly appealing approach is to simply explain to the robot, via speech, what it should be doing. In this paper we describe the ALIA cognitive architecture that is able to effectively incorporate user-supplied advice and prohibitions in this manner. The functioning of the implemented system on a small robot is illustrated by an associated video.


title: WildMix Dataset and Spectro-Temporal Transformer Model for Monoaural Audio Source Separation

abstract: Monoaural audio source separation is a challenging research area in machine learning. In this area, a mixture containing multiple audio sources is given, and a model is expected to disentangle the mixture into isolated atomic sources. In this paper, we first introduce a challenging new dataset for monoaural source separation called WildMix. WildMix is designed with the goal of extending the boundaries of source separation beyond what previous datasets in this area would allow. It contains diverse in-the-wild recordings from 25 different sound classes, combined with each other using arbitrary composition policies. Source separation often requires modeling long-range dependencies in both temporal and spectral domains. To this end, we introduce a novel trasnformer-based model called Spectro-Temporal Transformer (STT). STT utilizes a specialized encoder, called Spectro-Temporal Encoder (STE). STE highlights temporal and spectral components of sources within a mixture, using a self-attention mechanism. It subsequently disentangles them in a hierarchical manner. In our experiments, STT swiftly outperforms various previous baselines for monoaural source separation on the challenging WildMix dataset.


title: MIMAMO Net: Integrating Micro- and Macro-motion for Video Emotion Recognition

abstract: Spatial-temporal feature learning is of vital importance for video emotion recognition. Previous deep network structures often focused on macro-motion which extends over long time scales, e.g., on the order of seconds. We believe integrating structures capturing information about both micro- and macro-motion will benefit emotion prediction, because human perceive both micro- and macro-expressions. In this paper, we propose to combine micro- and macro-motion features to improve video emotion recognition with a two-stream recurrent network, named MIMAMO (Micro-Macro-Motion) Net. Specifically, smaller and shorter micro-motions are analyzed by a two-stream network, while larger and more sustained macro-motions can be well captured by a subsequent recurrent network. Assigning specific interpretations to the roles of different parts of the network enables us to make choice of parameters based on prior knowledge: choices that turn out to be optimal. One of the important innovations in our model is the use of interframe phase differences rather than optical flow as input to the temporal stream. Compared with the optical flow, phase differences require less computation and are more robust to illumination changes. Our proposed network achieves state of the art performance on two video emotion datasets, the OMG emotion dataset and the Aff-Wild dataset. The most significant gains are for arousal prediction, for which motion information is intuitively more informative. Source code is available at https://github.com/wtomin/MIMAMO-Net.


title: ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoring

abstract: We improve the recently-proposed "MixMatch" semi-supervised learning algorithm by introducing two new techniques: distribution alignment and augmentation anchoring. Distribution alignment encourages the marginal distribution of predictions on unlabeled data to be close to the marginal distribution of ground-truth labels. Augmentation anchoring feeds multiple strongly augmented versions of an input into the model and encourages each output to be close to the prediction for a weakly-augmented version of the same input. To produce strong augmentations, we propose a variant of AutoAugment which learns the augmentation policy while the model is being trained. Our new algorithm, dubbed ReMixMatch, is significantly more data-efficient than prior work, requiring between $5\times$ and $16\times$ less data to reach the same accuracy. For example, on CIFAR-10 with 250 labeled examples we reach $93.73\%$ accuracy (compared to MixMatch's accuracy of $93.58\%$ with $4{,}000$ examples) and a median accuracy of $84.92\%$ with just four labels per class. We make our code and data open-source at https://github.com/google-research/remixmatch.


title: Possible quantum paramagnetism in compressed Sr$_2$IrO$_4$

abstract: The effect of compression on the magnetic ground state of Sr$_2$IrO$_4$ is studied with x-ray resonant techniques in the diamond anvil cell. The weak interlayer exchange coupling between square-planar 2D IrO$_2$ layers is readily modified upon compression, with a crossover between magnetic structures around 7 GPa mimicking the effect of an applied magnetic field at ambient pressure. Higher pressures drive an order-disorder magnetic phase transition with no magnetic order detected above 17-20 GPa. The persistence of strong exchange interactions between $\mathrm{J_{eff}}=1/2$ magnetic moments within the insulating IrO$_2$ layers up to at least 35 GPa points to a highly frustrated magnetic state in compressed Sr$_2$IrO$_4$ opening the door for realization of novel quantum paramagnetic phases driven by extended $5d$ orbitals with entangled spin and orbital degrees of freedom.


title: LATTE: Latent Type Modeling for Biomedical Entity Linking

abstract: Entity linking is the task of linking mentions of named entities in natural language text, to entities in a curated knowledge-base. This is of significant importance in the biomedical domain, where it could be used to semantically annotate a large volume of clinical records and biomedical literature, to standardized concepts described in an ontology such as Unified Medical Language System (UMLS). We observe that with precise type information, entity disambiguation becomes a straightforward task. However, fine-grained type information is usually not available in biomedical domain. Thus, we propose LATTE, a LATent Type Entity Linking model, that improves entity linking by modeling the latent fine-grained type information about mentions and entities. Unlike previous methods that perform entity linking directly between the mentions and the entities, LATTE jointly does entity disambiguation, and latent fine-grained type learning, without direct supervision. We evaluate our model on two biomedical datasets: MedMentions, a large scale public dataset annotated with UMLS concepts, and a de-identified corpus of dictated doctor's notes that has been annotated with ICD concepts. Extensive experimental evaluation shows our model achieves significant performance improvements over several state-of-the-art techniques.


title: Are Noisy Sentences Useless for Distant Supervised Relation Extraction?

abstract: The noisy labeling problem has been one of the major obstacles for distant supervised relation extraction. Existing approaches usually consider that the noisy sentences are useless and will harm the model's performance. Therefore, they mainly alleviate this problem by reducing the influence of noisy sentences, such as applying bag-level selective attention or removing noisy sentences from sentence-bags. However, the underlying cause of the noisy labeling problem is not the lack of useful information, but the missing relation labels. Intuitively, if we can allocate credible labels for noisy sentences, they will be transformed into useful training data and benefit the model's performance. Thus, in this paper, we propose a novel method for distant supervised relation extraction, which employs unsupervised deep clustering to generate reliable labels for noisy sentences. Specifically, our model contains three modules: a sentence encoder, a noise detector and a label generator. The sentence encoder is used to obtain feature representations. The noise detector detects noisy sentences from sentence-bags, and the label generator produces high-confidence relation labels for noisy sentences. Extensive experimental results demonstrate that our model outperforms the state-of-the-art baselines on a popular benchmark dataset, and can indeed alleviate the noisy labeling problem.


title: Learning Multi-level Dependencies for Robust Word Recognition

abstract: Robust language processing systems are becoming increasingly important given the recent awareness of dangerous situations where brittle machine learning models can be easily broken with the presence of noises. In this paper, we introduce a robust word recognition framework that captures multi-level sequential dependencies in noised sentences. The proposed framework employs a sequence-to-sequence model over characters of each word, whose output is given to a word-level bi-directional recurrent neural network. We conduct extensive experiments to verify the effectiveness of the framework. The results show that the proposed framework outperforms state-of-the-art methods by a large margin and they also suggest that character-level dependencies can play an important role in word recognition.


title: Free motion around black holes with discs or rings: between integrability and chaos -- VI. The Melnikov method

abstract: Motivated by black holes surrounded by accretion structures, we consider in this series static and axially symmetric black holes "perturbed" gravitationally as being encircled by a thin disc or a ring. In previous papers, we employed several different methods to detect, classify and evaluate chaos which can occur, due to the presence of the additional source, in time-like geodesic motion. Here we apply the Melnikov-integral method which is able to recognize how stable and unstable manifolds behave along the perturbed homoclinic orbit. Since the method standardly works for systems with one degree of freedom, we first suggest its modification applicable to two degrees of freedom (which is the our case), starting from a suitable canonical transformation of the corresponding Hamiltonian. The Melnikov function reveals that, after the perturbation, the asymptotic manifolds tend to split and intersect, consistently with the chaos found by other methods in the previous papers.


title: Quantum simulation of quantum relativistic diffusion via quantum walks

abstract: Two models are first presented, of one-dimensional discrete-time quantum walk (DTQW) with temporal noise on the internal degree of freedom (i.e., the coin): (i) a model with both a coin-flip and a phase-flip channel, and (ii) a model with random coin unitaries. It is then shown that both these models admit a common limit in the spacetime continuum, namely, a Lindblad equation with Dirac-fermion Hamiltonian part and, as Lindblad jumps, a chirality flip and a chirality-dependent phase flip, which are two of the three standard error channels for a two-level quantum system. This, as one may call it, Dirac Lindblad equation, provides a model of quantum relativistic spatial diffusion, which is evidenced both analytically and numerically. This model of spatial diffusion has the intriguing specificity of making sense only with original unitary models which are relativistic in the sense that they have chirality, on which the noise is introduced: The diffusion arises via the by-construction (quantum) coupling of chirality to the position. For a particle with vanishing mass, the model of quantum relativistic diffusion introduced in the present work, reduces to the well-known telegraph equation, which yields propagation at short times, diffusion at long times, and exhibits no quantumness. Finally, the results are extended to temporal noises which depend smoothly on position.


title: Minority Voter Distributions and Partisan Gerrymandering

abstract: Many people believe that it is disadvantageous for members aligning with a minority party to cluster in cities, as this makes it easier for the majority party to gerrymander district boundaries to diminish the representation of the minority. We examine this effect by exhaustively computing the average representation for every possible $5\times 5$ grid of population placement and district boundaries. We show that, in fact, it is advantageous for the minority to arrange themselves in clusters, as it is positively correlated with representation. We extend this result to more general cases by considering the dual graph of districts, and we also propose and analyze metaheuristic algorithms that allow us to find strong lower bounds for maximum expected representation.


title: Multiple Points of Gaussian Random Fields

abstract: This paper is concerned with the existence of multiple points of Gaussian random fields. Under the framework of Dalang et al. (2017), we prove that, for a wide class of Gaussian random fields, multiple points do not exist in critical dimensions. The result is applicable to fractional Brownian sheets and the solutions of systems of stochastic heat and wave equations.


title: Gravitational waves from SGRs and AXPs as fast-spinning white dwarfs

abstract: Gravitational waves (GWs) emission due to magnetic deformation mechanism is applied for Soft Gamma Repeaters (SGRs) and Anomalous X-Ray Pulsars(AXPs), described as fast-spinning and magnetized white dwarfs (WDs). The emission is caused by the asymmetry around the rotation axis of the star generated by its own intense magnetic field. Thus, for the first time in the literature, it is estimated the GWs counterpart for SGRs/AXPs described as WD pulsars. We find that some SGRs/AXPs can be observed by the space detectors BBO and DECIGO. In particular, 1E 1547.0-5408 and SGR 1806-20 could be detected in 1 year of observation, whereas SGR 1900+14, CXOU J171405.7-381031, Swift J1834.9-0846 and SGR 1627-41 could be observed with a 5-year observation time. We also found that SGRs/AXPs as highly magnetized neutron stars are far below the sensitivity curves of BBO and DECIGO. This result indicates that a possible detection of continuous GWs originated from these objects would corroborate the WD pulsar model.


title: Quenching factor of Gamow-Teller and spin dipole giant resonances

abstract: Gamow-Teller (GT) and spin-dipole (SD) strength distributions of four doubly magic nuclei $^{48}$Ca, $^{90}$Zr, $^{132}$Sn and $^{208}$Pb are studied by the self-consistent Hartree-Fock plus random phase approximation (RPA) method. The Skyrme forces SAMi and SAMi-T without/with tensor interactions are adopted in our calculations. The calculated strengths are compared with available experimental data. The RPA results of GT and SD strengths of all four nuclei show fine agreement with observed GT and SD resonances in energy. A small GT peak below the main GT resonance is better described by the Skyrme interaction SAMi-T with the tensor terms. The quenching factors for GT and SD are extracted from the comparisons between RPA results and experimental strengths. It is pointed out that the quenching effect on experimental SD peaks is somewhat modest compared with that on GT peaks in the four nuclei.


title: Leveraging Sensing at the Infrastructure for mmWave Communication

abstract: Vehicle-to-everything (V2X) communication in the mmWave band is one way to achieve high data-rates for applications like infotainment, cooperative perception, and augmented reality assisted driving etc. MmWave communication relies on large antennas arrays, and configuring these arrays poses high training overhead. In this article, we motivate the use of infrastructure mounted sensors (which will be part of future smart cities) for mmWave communication. We provide numerical and measurement results to demonstrate that information from these infrastructure sensors reduces the mmWave array configuration overhead. Finally, we outline future research directions to help materialize the use of infrastructure sensors for mmWave communication.


title: Ricci Flow Singularity for Triaxial Bianchi IX Metric

abstract: In this work, we are going to find sufficient conditions on the initial triaxial Bianchi IX metric on some 4-dimensional manifolds foliated by homogeneous S3 for a Type I singularity to occur when it is flowed under the Ricci flow. This work generalises the study on rotationally symmetric manifolds done by Angenent and Isenberg as well as the work of Isenberg, Knopf, and Sesum, in which they introduced some ansatz for the problem setup.


title: An Alternative Cross Entropy Loss for Learning-to-Rank

abstract: Listwise learning-to-rank methods form a powerful class of ranking algorithms that are widely adopted in applications such as information retrieval. These algorithms learn to rank a set of items by optimizing a loss that is a function of the entire set -- as a surrogate to a typically non-differentiable ranking metric. Despite their empirical success, existing listwise methods are based on heuristics and remain theoretically ill-understood. In particular, none of the empirically successful loss functions are related to ranking metrics. In this work, we propose a cross entropy-based learning-to-rank loss function that is theoretically sound, is a convex bound on NDCG -- a popular ranking metric -- and is consistent with NDCG under learning scenarios common in information retrieval. Furthermore, empirical evaluation of an implementation of the proposed method with gradient boosting machines on benchmark learning-to-rank datasets demonstrates the superiority of our proposed formulation over existing algorithms in quality and robustness.


title: An algebraic reduction of Hedetniemi's conjecture

abstract: For a graph $G$, let $\chi (G)$ denote the chromatic number. In graph theory, the following famous conjecture posed by Hedetniemi has been studied: For two graphs $G$ and $H$, $\chi (G\times H)=\min\{\chi (G),\chi (H)\}$, where $G \times H$ is the tensor product of $G$ and $H$. In this paper, we give a reduction of Hedetniemi's conjecture to an inclusion relation problem on ideals of polynomial rings, and we demonstrate computational experiments for partial solutions of Hedetniemi's conjecture along such a strategy using Gr\"{o}bner basis.


title: A Comparative Evaluation of SGM Variants (including a New Variant, tMGM) for Dense Stereo Matching

abstract: Our goal here is threefold: [1] To present a new dense-stereo matching algorithm, tMGM, that by combining the hierarchical logic of tSGM with the support structure of MGM achieves 6-8\% performance improvement over the baseline SGM (these performance numbers are posted under tMGM-16 in the Middlebury Benchmark V3 ); and [2] Through an exhaustive quantitative and qualitative comparative study, to compare how the major variants of the SGM approach to dense stereo matching, including the new tMGM, perform in the presence of: (a) illumination variations and shadows, (b) untextured or weakly textured regions, (c) repetitive patterns in the scene in the presence of large stereo rectification errors. [3] To present a novel DEM-Sculpting approach for estimating initial disparity search bounds for multi-date satellite stereo pairs. Based on our study, we have found that tMGM generally performs best with respect to all these data conditions. Both tSGM and MGM improve the density of stereo disparity maps and combining the two in tMGM makes it possible to accurately estimate the disparities at a significant number of pixels that would otherwise be declared invalid by SGM. The datasets we have used in our comparative evaluation include the Middlebury2014, KITTI2015, and ETH3D datasets and the satellite images over the San Fernando area from the MVS Challenge dataset.


title: Joint Learning of Answer Selection and Answer Summary Generation in Community Question Answering

abstract: Community question answering (CQA) gains increasing popularity in both academy and industry recently. However, the redundancy and lengthiness issues of crowdsourced answers limit the performance of answer selection and lead to reading difficulties and misunderstandings for community users. To solve these problems, we tackle the tasks of answer selection and answer summary generation in CQA with a novel joint learning model. Specifically, we design a question-driven pointer-generator network, which exploits the correlation information between question-answer pairs to aid in attending the essential information when generating answer summaries. Meanwhile, we leverage the answer summaries to alleviate noise in original lengthy answers when ranking the relevancy degrees of question-answer pairs. In addition, we construct a new large-scale CQA corpus, WikiHowQA, which contains long answers for answer selection as well as reference summaries for answer summarization. The experimental results show that the joint learning method can effectively address the answer redundancy issue in CQA and achieves state-of-the-art results on both answer selection and text summarization tasks. Furthermore, the proposed model is shown to be of great transferring ability and applicability for resource-poor CQA tasks, which lack of reference answer summaries.


title: Debiased Inverse-Variance Weighted Estimator in Two-Sample Summary-Data Mendelian Randomization

abstract: Mendelian randomization (MR) has become a popular approach to study the effect of a modifiable exposure on an outcome by using genetic variants as instrumental variables. A challenge in MR is that each genetic variant explains a relatively small proportion of variance in the exposure and there are many such variants, a setting known as many weak instruments. To this end, we provide a theoretical characterization of the statistical properties of two popular estimators in MR, the inverse-variance weighted (IVW) estimator and the IVW estimator with screened instruments using an independent selection dataset, under many weak instruments. We then propose a debiased IVW estimator, a simple modification of the IVW estimator, that is robust to many weak instruments and doesn't require screening. Additionally, we present two instrument selection methods to improve the efficiency of the new estimator when a selection dataset is available. An extension of the debiased IVW estimator to handle balanced horizontal pleiotropy is also discussed. We conclude by demonstrating our results in simulated and real datasets.


title: Role of Element-Specific Damping on the Ultrafast, Helicity-Independent All-Optical Switching Dynamics in Amorphous (Gd,Tb)Co Thin Films

abstract: Ultrafast control of the magnetization in ps timescales by fs laser pulses offers an attractive avenue for applications such as fast magnetic devices for logic and memory. However, ultrafast helicity-independent all-optical switching (HI-AOS) of the magnetization has thus far only been observed in Gd-based, ferrimagnetic amorphous (\textit{a}-) rare earth-transition metal (\textit{a}-RE-TM) systems, and a comprehensive understanding of the reversal mechanism remains elusive. Here, we report HI-AOS in ferrimagnetic \textit{a}-Gd$_{22-x}$Tb$_x$Co$_{78}$ thin films, from x = 0 to x = 18, and elucidate the role of Gd in HI-AOS in \textit{a}-RE-TM alloys and multilayers. Increasing Tb content results in increasing perpendicular magnetic anisotropy and coercivity, without modifying magnetization density, and slower remagnetization rates and higher critical fluences for switching but still shows picosecond HI-AOS. Simulations of the atomistic spin dynamics based on the two-temperature model reproduce these results qualitatively and predict that the lower damping on the RE sublattice arising from the small spin-orbit coupling of Gd (with $L = 0$) is instrumental for the faster dynamics and lower critical fluences of the Gd-rich alloys. Annealing \textit{a}-Gd$_{10}$Tb$_{12}$Co$_{78}$ leads to slower dynamics which we argue is due to an increase in damping. These simulations strongly indicate that acounting for element-specific damping is crucial in understanding HI-AOS phenomena. The results suggest that engineering the element specific damping of materials can open up new classes of materials that exhibit low-energy, ultrafast HI-AOS.


title: Measuring Uncertainty through Bayesian Learning of Deep Neural Network Structure

abstract: Bayesian neural networks (BNNs) augment deep networks with uncertainty quantification by Bayesian treatment of the network weights. However, such models face the challenge of Bayesian inference in a high-dimensional and usually over-parameterized space. This paper investigates a new line of Bayesian deep learning by performing Bayesian inference on network structure. Instead of building structure from scratch inefficiently, we draw inspirations from neural architecture search to represent the network structure. We then develop an efficient stochastic variational inference approach which unifies the learning of both network structure and weights. Empirically, our method exhibits competitive predictive performance while preserving the benefits of Bayesian principles across challenging scenarios. We also provide convincing experimental justification for our modeling choice.


title: Coulomb focusing in retrapped ionization with near-circularly polarized laser field

abstract: The full three-dimensional photoelectron momentum distributions of argon are measured in intense near-circularly polarized laser fields. We observed that the transverse momentum distribution of ejected electrons by 410-nm near-circularly polarized field is unexpectedly narrowed with increasing laser intensity, which is contrary to the conventional rules predicted by adiabatic theory. By analyzing the momentum-resolved angular momentum distribution measured experimentally and the corresponding trajectories of ejected electrons semiclassically, the narrowing can be attributed to a temporary trapping and thereby focusing of a photoelectron by the atomic potential in a quasibound state. With the near-circularly polarized laser field, the strong Coulomb interaction with the rescattering electrons is avoided, thus the Coulomb focusing in the retrapped process is highlighted. We believe that these findings will facilitate understanding and steering electron dynamics in the Coulomb coupled system.


title: Optimal Taxes in Atomic Congestion Games

abstract: How can we design mechanisms to promote efficient use of shared resources? Here, we answer this question in relation to the well-studied class of atomic congestion games, used to model a variety of problems, including traffic routing. Within this context, a methodology for designing tolling mechanisms that minimize the system inefficiency (price of anarchy) exploiting solely local information is so far missing in spite of the scientific interest. In this manuscript we resolve this problem through a tractable linear programming formulation that applies to and beyond polynomial congestion games. When specializing our approach to the polynomial case, we obtain tight values for the optimal price of anarchy and corresponding tolls, uncovering an unexpected link with load balancing games. We also derive optimal tolling mechanisms that are constant with the congestion level, generalizing the results of Caragiannis et al. [ACM Transactions on Algorithms, 2010] to polynomial congestion games and beyond. Finally, we apply our techniques to compute the efficiency of the marginal cost mechanism. Surprisingly, optimal tolling mechanism using only local information perform closely to existing mechanism that utilize global information [Bil\`o and Vinci, ACM Transactions on Economics and Computation, 2019], while the marginal cost mechanism, known to be optimal in the continuous-flow model, has lower efficiency than that encountered levying no toll. All results are tight for pure Nash equilibria, and extend to coarse correlated equilibria.


title: Multi-Objective Multi-Agent Planning for Jointly Discovering and Tracking Mobile Object

abstract: We consider the challenging problem of online planning for a team of agents to autonomously search and track a time-varying number of mobile objects under the practical constraint of detection range limited onboard sensors. A standard POMDP with a value function that either encourages discovery or accurate tracking of mobile objects is inadequate to simultaneously meet the conflicting goals of searching for undiscovered mobile objects whilst keeping track of discovered objects. The planning problem is further complicated by misdetections or false detections of objects caused by range limited sensors and noise inherent to sensor measurements. We formulate a novel multi-objective POMDP based on information theoretic criteria, and an online multi-object tracking filter for the problem. Since controlling multi-agent is a well known combinatorial optimization problem, assigning control actions to agents necessitates a greedy algorithm. We prove that our proposed multi-objective value function is a monotone submodular set function; consequently, the greedy algorithm can achieve a (1-1/e) approximation for maximizing the submodular multi-objective function.


title: First on-sky demonstration of an integrated-photonic nulling-interferometer: The GLINT instrument

abstract: The characterisation of exoplanets is critical to understanding planet diversity and formation, their atmospheric composition and the potential for life. This endeavour is greatly enhanced when light from the planet can be spatially separated from that of the host star. One potential method is nulling interferometry, where the contaminating starlight is removed via destructive interference. The GLINT instrument is a photonic nulling interferometer with novel capabilities that has now been demonstrated in on-sky testing. The instrument fragments the telescope pupil into sub-apertures that are injected into waveguides within a single-mode photonic chip. Here, all requisite beam splitting, routing and recombination is performed using integrated photonic components. We describe the design, construction and laboratory testing of our GLINT pathfinder instrument. We then demonstrate the efficacy of this method on sky at the Subaru Telescope, achieving a null-depth precision on sky of $\sim10^{-4}$ and successfully determining the angular diameter of stars (via their null-depth measurements) to milli-arcsecond accuracy. A statistical method for analysing such data is described, along with an outline of the next steps required to deploy this technique for cutting-edge science.


title: Vacuum instability in a constant inhomogeneous electric field. A new example of exact nonperturbative calculations

abstract: Basic quantum processes (such as particle creation, reflection, and transmission on the corresponding Klein steps) caused by inverse-square electric fields are calculated. These results represent a new example of exact nonperturbative calculations in the framework of QED. The inverse-square electric field is time-independent, inhomogeneous in the $x$-direction, and is inversely proportional to $x$ squared. We find exact solutions of the Dirac and Klein-Gordon equations with such a field and construct corresponding in- and out-states. With the help of these states and using the techniques developed in the framework of QED with $x$-electric potential steps, we calculate characteristics of the vacuum instability, such as differential and total mean numbers of particles created from the vacuum and vacuum-to-vacuum transition probabilities. We study the vacuum instability for two particular backgrounds: for fields widely stretches over the $x$-axis (small-gradient configuration) and for the fields sharply concentrates near the origin $x=0$ (sharp-gradient configuration). We compare exact results with ones calculated numerically. Finally, we consider the electric field configuration, composed by inverse-square fields and by an $x$-independent electric field between them to study the role of growing and decaying processes in the vacuum instability.


title: Leveraging Special-Purpose Hardware for Local Search Heuristics

abstract: As we approach the physical limits predicted by Moore's law, a variety of specialized hardware is emerging to tackle specialized tasks in different domains. Within combinatorial optimization, adiabatic quantum computers, CMOS annealers, and optical parametric oscillators are few of the emerging specialized hardware technology aimed at solving optimization problems. In terms of mathematical framework, the Ising optimization model unifies all of these emerging special-purpose hardware. In other words, they are all designed to solve optimization problems expressed in the Ising model or equivalently as a quadratic unconstrained binary optimization model. Due to variety of constraints specific to each type of hardware, they usually suffer from a major challenge: the number of variables that the hardware can manage to solve is very limited. Given that large-scale practical problems, including problems in operations research, combinatorial scientific computing, data science and network science require significantly more variables to model than these devices provide, we are likely to witness that cloud-based deployments of these devices will be available for parallel and shared access. Thus hybrid techniques in combination with both hardware and software must be developed to utilize these technologies. Local search meta-heuristics is one of the approaches to tackle large scale problems. However, a general optimization step within local search is not traditionally formulated in the Ising form. In this work, we propose a new meta-heuristic to model local search in the Ising form for the special-purpose hardware devices. As such, we demonstrate that our method takes the limitations of the Ising model and current hardware into account, utilizes a given hardware more efficiently compared to previous approaches, while also producing high quality solutions compared to other well-known meta-heuristics.


title: Machine learning for protein folding and dynamics

abstract: Many aspects of the study of protein folding and dynamics have been affected by the recent advances in machine learning. Methods for the prediction of protein structures from their sequences are now heavily based on machine learning tools. The way simulations are performed to explore the energy landscape of protein systems is also changing as force-fields are started to be designed by means of machine learning methods. These methods are also used to extract the essential information from large simulation datasets and to enhance the sampling of rare events such as folding/unfolding transitions. While significant challenges still need to be tackled, we expect these methods to play an important role on the study of protein folding and dynamics in the near future. We discuss here the recent advances on all these fronts and the questions that need to be addressed for machine learning approaches to become mainstream in protein simulation.

categories: physics.bio-ph physics.chem-ph q-bio.BM stat.ML


title: Zero-Resource Cross-Lingual Named Entity Recognition

abstract: Recently, neural methods have achieved state-of-the-art (SOTA) results in Named Entity Recognition (NER) tasks for many languages without the need for manually crafted features. However, these models still require manually annotated training data, which is not available for many languages. In this paper, we propose an unsupervised cross-lingual NER model that can transfer NER knowledge from one language to another in a completely unsupervised way without relying on any bilingual dictionary or parallel data. Our model achieves this through word-level adversarial learning and augmented fine-tuning with parameter sharing and feature augmentation. Experiments on five different languages demonstrate the effectiveness of our approach, outperforming existing models by a good margin and setting a new SOTA for each language pair.


title: Facility Location Problem with Capacity Constraints: Algorithmic and Mechanism Design Perspectives

abstract: We consider the facility location problem in the one-dimensional setting where each facility can serve a limited number of agents from the algorithmic and mechanism design perspectives. From the algorithmic perspective, we prove that the corresponding optimization problem, where the goal is to locate facilities to minimize either the total cost to all agents or the maximum cost of any agent is NP-hard. However, we show that the problem is fixed-parameter tractable, and the optimal solution can be computed in polynomial time whenever the number of facilities is bounded, or when all facilities have identical capacities. We then consider the problem from a mechanism design perspective where the agents are strategic and need not reveal their true locations. We show that several natural mechanisms studied in the uncapacitated setting either lose strategyproofness or a bound on the solution quality for the total or maximum cost objective. We then propose new mechanisms that are strategyproof and achieve approximation guarantees that almost match the lower bounds.


title: Crowd Density Forecasting by Modeling Patch-based Dynamics

abstract: Forecasting human activities observed in videos is a long-standing challenge in computer vision, which leads to various real-world applications such as mobile robots, autonomous driving, and assistive systems. In this work, we present a new visual forecasting task called crowd density forecasting. Given a video of a crowd captured by a surveillance camera, our goal is to predict how that crowd will move in future frames. To address this task, we have developed the patch-based density forecasting network (PDFN), which enables forecasting over a sequence of crowd density maps describing how crowded each location is in each video frame. PDFN represents a crowd density map based on spatially overlapping patches and learns density dynamics patch-wise in a compact latent space. This enables us to model diverse and complex crowd density dynamics efficiently, even when the input video involves a variable number of crowds that each move independently. Experimental results with several public datasets demonstrate the effectiveness of our approach compared with state-of-the-art forecasting methods.


title: When Does Non-Orthogonal Tensor Decomposition Have No Spurious Local Minima?

abstract: We study the optimization problem for decomposing $d$ dimensional fourth-order Tensors with $k$ non-orthogonal components. We derive \textit{deterministic} conditions under which such a problem does not have spurious local minima. In particular, we show that if $\kappa = \frac{\lambda_{max}}{\lambda_{min}} < \frac{5}{4}$, and incoherence coefficient is of the order $O(\frac{1}{\sqrt{d}})$, then all the local minima are globally optimal. Using standard techniques, these conditions could be easily transformed into conditions that would hold with high probability in high dimensions when the components are generated randomly. Finally, we prove that the tensor power method with deflation and restarts could efficiently extract all the components within a tolerance level $O(\kappa \sqrt{k\tau^3})$ that seems to be the noise floor of non-orthogonal tensor decomposition.