title: GADMM: Fast and Communication Efficient Framework for Distributed Machine Learning

abstract: When the data is distributed across multiple servers, lowering the communication cost between the servers (or workers) while solving the distributed learning problem is an important problem and is the focus of this paper. In particular, we propose a fast, and communication-efficient decentralized framework to solve the distributed machine learning (DML) problem. The proposed algorithm, Group Alternating Direction Method of Multipliers (GADMM) is based on the Alternating Direction Method of Multipliers (ADMM) framework. The key novelty in GADMM is that it solves the problem in a decentralized topology where at most half of the workers are competing for the limited communication resources at any given time. Moreover, each worker exchanges the locally trained model only with two neighboring workers, thereby training a global model with a lower amount of communication overhead in each exchange. We prove that GADMM converges to the optimal solution for convex loss functions, and numerically show that it converges faster and more communication-efficient than the state-of-the-art communication-efficient algorithms such as the Lazily Aggregated Gradient (LAG) and dual averaging, in linear and logistic regression tasks on synthetic and real datasets. Furthermore, we propose Dynamic GADMM (D-GADMM), a variant of GADMM, and prove its convergence under the time-varying network topology of the workers.


title: Closed subsets of a CAT(0) 2-complex are intrinsically CAT(0)

abstract: Let k be at most 0, and let X be a locally-finite CAT(k) polyhedral 2-complex X, each face with constant curvature k. Let E be a closed, rectifiably-connected subset of X with trivial first singular homology. We show that E, under the induced path metric, is a complete CAT(k) space.


title: Solution of Stokes flow in complex nonsmooth 2D geometries via a linear-scaling high-order adaptive integral equation scheme

abstract: We present a fast, high-order accurate and adaptive boundary integral scheme for solving the Stokes equations in complex---possibly nonsmooth---geometries in two dimensions. The key ingredient is a set of panel quadrature rules capable of evaluating weakly-singular, nearly-singular and hyper-singular integrals to high accuracy. Near-singular integral evaluation, in particular, is done using an extension of the scheme developed in J.~Helsing and R.~Ojala, {\it J. Comput. Phys.} {\bf 227} (2008) 2899--2921. The boundary of the given geometry is ``panelized'' automatically to achieve user-prescribed precision. We show that this adaptive panel refinement procedure works well in practice even in the case of complex geometries with large number of corners. In one example, for instance, a model 2D vascular network with 378 corners required less than 200K discretization points to obtain a 9-digit solution accuracy.


title: Intrinsic Smallness

abstract: Recent work in computability theory has focused on various notions of asymptotic computability, which capture the idea of a set being "almost computable." One potentially upsetting result is that all four notions of asymptotic computability admit "almost computable" sets in every Turing degree via coding tricks, contradicting the notion that "almost computable" sets should be computationally close to the computable sets. In response, Astor introduced the notion of intrinsic density: a set has defined intrinsic density if its image under any computable permutation has the same asymptotic density. Furthermore, Astor also introduced various notions of intrinsic computation in which the standard coding tricks cannot be used to embed intrinsically computable sets in every Turing degree. Our goal is to study the sets which are intrinsically small, i.e. those that have intrinsic density zero. We begin by studying which computable functions preserve intrinsic smallness. We also show that intrinsic smallness and hyperimmunity are computationally independent notions of smallness, i.e. any hyperimmune degree contains a Turing-equivalent hyperimmune set which is "as large as possible" and therefore not intrinsically small. Our discussion concludes by relativizing the notion of intrinsic smallness and discussing intrinsic computability as it relates to our study of intrinsic smallness.


title: Superconducting phase transitions in disordered NbTiN films

abstract: The suppression of superconductivity in disordered systems is a fundamental problem of condensed matter physics. Here we investigate the superconducting niobium-titanium-nitride (Nb_{1-x}Ti_{x}N) thin films grown by atomic layer deposition (ALD) where disorder is controlled by the slight tuning of the ALD process parameters. We observe the smooth crossover from the disorder-driven superconductor-normal metal transition (often reffered to as fermionic mechanism) to the case where bosonic mechanism dominates and increasing disorder leads to formation of metal with Cooper pairing. We show that, in moderately disordered films, the transition to zero-resistance state occurs in a full agreement with the conventional theories of superconducting fluctuations and Berezinskii-Kosterlitz-Thouless transition. However, the critically disordered films violate this accord showing low-temperature features possibly indicating the Bose metal phase. We show that it is the interrelation between film's sheet resistance in the maximum, R_{max}, of the resistive curve R(T) and R_q = h/4e^2 that distinguishes between these two behaviors. We reveal the characteristic features in magnetoresistance of the critically disordered films with R_{max} > R_q


title: Learning Digital Circuits: A Journey Through Weight Invariant Self-Pruning Neural Networks

abstract: Recently, in the paper "Weight Agnostic Neural Networks" Gaier & Ha utilized architecture search to find networks where the topology completely encodes the knowledge. However, architecture search in topology space is expensive. We use the existing framework of binarized networks to find performant topologies by constraining the weights to be either, zero or one. We show that such topologies achieve performance similar to standard networks while pruning more than 99% weights. We further demonstrate that these topologies can perform tasks using constant weights without any explicit tuning. Finally, we discover that in our setup each neuron acts like a NOR gate, virtually learning a digital circuit. We demonstrate the efficacy of our approach on computer vision datasets.


title: Shearing in the space of adelic lattices

abstract: In this notes we show how a problem regarding continued fractions of rational numbers, lead to several phenomena in number theory and dynamics, and eventually to the problem of shearing of divergent diagonal orbits in the space of adelic lattices. Finding these ideas quite interesting, the first half of these notes is about explaining theses ideas, the intuition and motivation behind them, and the second contains the details and proofs.


title: Anomalous protein kinetics on low-fouling surfaces

abstract: In this work, protein-surface interactions were probed in terms of adsorption and desorption of a model protein, bovine serum albumin, on a low-fouling surface with single-molecule localization microscopy. Single-molecule experiments enable precise determination of both adsorption and desorption rates. Strikingly the experimental data show anomalous desorption kinetics, evident as a surface dwell time that exhibits a power-law distribution, i.e. a heavy-tailed rather than the expected exponential distribution. As a direct consequence of this heavy-tailed distribution, the average desorption rate depends upon the time scale of the experiment and the protein surface concentration does not reach equilibrium. Further analysis reveals that the observed anomalous desorption emerges due to the reversible formation of a small fraction of soluble protein multimers (small oligomers), such that each one desorbs from the surface with a different rate. The overall kinetics can be described by a series of elementary reactions, yielding simple scaling relations that predict experimental observations. This work reveals a mechanistic origin for anomalous desorption kinetics that can be employed to interpret observations where low-protein fouling surfaces eventually foul when in long-term contact with protein solutions. The work also provides new insights that can be used to define design principles for non-fouling surfaces and to predict their performance.


title: On Polar Magnetic Field Reversal in Solar Cycles 21, 22, 23, and 24

abstract: The Sun's polar magnetic fields change their polarity near the maximum of sunspot activity. We analyzed the polarity reversal epochs in Solar Cycles 21 to 24. There was a triple reversal in the N-hemisphere in Solar Cycle 24 and single reversals in the rest of cases. Epochs of the polarity reversal from measurements of the Wilcox Solar Observatory (WSO) are compared with ones when the reversals were completed in the N- and S-hemispheres. The reversal times were compared with hemispherical sunspot activity and with the Heliospheric Current Sheet (HCS) tilts, too. It was found that reversals occurred at the epoch of the sunspot activity maximum in Cycles 21 and 23, and after the corresponding maxima in Cycles 22 and 24, and one-two years after maximal HCS tilts calculated in WSO. Reversals in Solar Cycles 21, 22, 23, and 24 were completed first in the N-hemisphere and then in the S-hemisphere after 0.6, 1.1, 0.7, and 0.9 years, respectively. The polarity inversion in the near-polar latitude range \pm(55-90)^\circ occurred from 0.5 to 2.0 years earlier that the times when the reversals were completed in corresponding hemisphere. Using the maximal smoothed WSO polar field as precursor we estimated that amplitude of Solar Cycle 25 will reach 116 \pm 12 in values of smoothed monthly sunspot numbers and will be comparable with the current cycle amplitude equaled to 116.4.


title: How Relevant is the Turing Test in the Age of Sophisbots?

abstract: Popular culture has contemplated societies of thinking machines for generations, envisioning futures from utopian to dystopian. These futures are, arguably, here now-we find ourselves at the doorstep of technology that can at least simulate the appearance of thinking, acting, and feeling. The real question is: now what?


title: Learning from Multi-User Activity Trails for B2B Ad Targeting

abstract: Online purchase decisions in organizations can go through a complex journey with multiple agents involved in the decision making process. Depending on the product being purchased, and the organizational structure, the process may involve employees who first conduct market research, and then influence decision makers who place the online purchase order. In such cases, the online activity trail of a single individual in the organization may only provide partial information for predicting purchases (conversions). To refine conversion prediction for business-to-business (B2B) products using online activity trails, we introduce the notion of relevant users in an organization with respect to a given B2B advertiser, and leverage the collective activity trails of such relevant users to predict conversions. In particular, our notion of relevant users is tied to a seed list of relevant activities for a B2B advertiser, and we propose a method using distributed activity representations to build such a seed list. Experiments using data from Yahoo Gemini demonstrate that the proposed methods can improve conversion prediction AUC by 8.8%, and provide an interpretable advertiser specific list of activities useful for B2B ad targeting.


title: Can Umbral and $q$-calculus be merged?

abstract: The $q$-calculus is reformulated in terms of the umbral calculus and of the associated operational formalism. We show that new and interesting elements emerge from such a restyling. The proposed technique is applied to a different formulations of $q$ special functions, to the derivation of integrals involving ordinary and $q$-functions and to the study of $q$-special functions and polynomials.


title: Distributed finite-time termination for consensus algorithm in switching topologies

abstract: In this article, we present a finite time stopping criterion for consensus algorithms in networks with dynamic communication topology. Recent results provide asymptotic convergence to the consensus algorithm. However, the asymptotic convergence of these algorithms pose a challenge in the practical settings where the response from agents is required in finite time. To this end, we propose a Maximum-Minimum protocol which propagates the global maximum and minimum values of agent states (while running consensus algorithm) in the network. We establish that global maximum and minimum values are strictly monotonic even for a dynamic topology and can be utilized to distributively ascertain the closeness to convergence in finite time. We show that each node can have access to the global maximum and minimum by running the proposed Maximum-Minimum protocol and use it as a finite time stopping criterion for the otherwise asymptotic consensus algorithm. The practical utility of the algorithm is illustrated through experiments where each agent is instantiated by a NodeJS socket.io server.


title: Model construction and a possibility of cuprate-like pairing in a new d9 nickelate superconductor (Nd,Sr)NiO2

abstract: Effective models are constructed for a newly discovered superconductor (Nd,Sr)NiO2, which has been considered as a possible nickelate analogue of the cuprates owing to the d9 electron configuration. Estimation of the effective interaction, which turns out to require a multiorbital model that takes account of all the orbitals involved on the Fermi surface, shows that the effective interactions are significantly larger than in the cuprates. A fluctuation exchange study for the model indicates that dx2-y2-wave superconductivity is likely to occur as in the cuprates, where the transition temperature in the nickelate can be lower from the cuprates due to the larger interaction and narrower bandwidth.


title: Investigating Sprawl using AIC and Recursive Partitioning Trees: A Machine Learning Approach to Assessing the Association between Poverty and Commute Time

abstract: Sprawl, according to Glaeser and Kahn, is the 21st century phenomenon that some people are not dependent on city-living due to automobiles and therefore can live outside public transportation spheres and cities. This is usually seen as pleasant and accompanied by improved qualities of life, but as they addressed, the problem remains that sprawl causes loss of jobs for those who cannot afford luxurious alternatives but only inferior substitutes (Glaeser and Kahn 2004). Therefore, through our question, we hope to suggest that sprawl has occurred in the U.S. and poverty is one of the consequences.


title: A short proof of Boundary Harnack Inequality

abstract: We give a direct analytic proof of the classical Boundary Harnack inequality for solutions to linear uniformly elliptic equations in either divergence or non-divergence form.


title: Geometric non-commutative geometry

abstract: In a recent paper, the authors proved that no spin foliation on a compact enlargeable manifold with Hausdorff homotopy graph admits a metric of positive scalar curvature on its leaves. This result extends groundbreaking results of Lichnerowicz, Gromov and Lawson, and Connes on the non-existence of metrics of positive scalar curvature. In this paper we review in more detail the material needed for the proof of our theorem and we extend our non-existence results to non-compact manifolds of bounded geometry. We also give a first obstruction result for the existence of metric with (not necessarily uniform) leafwise PSC in terms of the A-hat class in Haefliger cohomology.


title: Lattice investigation of an inhomogeneous phase of the 2+1-dimensional Gross-Neveu model in the limit of infinitely many flavors

abstract: We investigate the phase structure of the 2+1-dimensional Gross-Neveu model in the large-Nf limit, where Nf denotes the number of fermion flavors. We discuss two different fermion representations and their implication on the interpretation of a discrete symmetry of the action. We present numerical results, which indicate the existence of an inhomogeneous phase similar as in the 1+1-dimensional Gross-Neveu model.


title: Two-layer Coded Channel Access with Collision Resolution: Design and Analysis

abstract: We propose a two-layer coding architecture for communication of multiple users over a shared slotted medium enabling joint collision resolution and decoding. Each user first encodes its information bits with an outer code for reliability, and then transmits these coded bits with possible repetitions over transmission time slots of the access channel. The transmission patterns are dictated by the inner collision-resolution code and collisions with other users' transmissions may occur. We analyze two types of codes for the outer layer: long-blocklength LDPC codes, and short-blocklength algebraic codes. With LDPC codes, a density evolution analysis enables joint optimization of both outer and inner code parameters for maximum throughput. With algebraic codes, we invoke a similar analysis by approximating their average erasure correcting capability while assuming a large number of active transmitters. The proposed low-complexity schemes operate at a significantly smaller gap to capacity than the state of the art. Our schemes apply both to a multiple access scenario where number of users within a frame is known a priori, and to a random access scenario where that number is known only to the decoder. In the latter case, we optimize an outage probability due to the variability in user activity.


title: Counterfactual Risk Assessments, Evaluation, and Fairness

abstract: Algorithmic risk assessments are increasingly used to help humans make decisions in high-stakes settings, such as medicine, criminal justice and education. In each of these cases, the purpose of the risk assessment tool is to inform actions, such as medical treatments or release conditions, often with the aim of reducing the likelihood of an adverse event such as hospital readmission or recidivism. Problematically, most tools are trained and evaluated on historical data in which the outcomes observed depend on the historical decision-making policy. These tools thus reflect risk under the historical policy, rather than under the different decision options that the tool is intended to inform. Even when tools are constructed to predict risk under a specific decision, they are often improperly evaluated as predictors of the target outcome. Focusing on the evaluation task, in this paper we define counterfactual analogues of common predictive performance and algorithmic fairness metrics that we argue are better suited for the decision-making context. We introduce a new method for estimating the proposed metrics using doubly robust estimation. We provide theoretical results that show that only under strong conditions can fairness according to the standard metric and the counterfactual metric simultaneously hold. Consequently, fairness-promoting methods that target parity in a standard fairness metric may --- and as we show empirically, do --- induce greater imbalance in the counterfactual analogue. We provide empirical comparisons on both synthetic data and a real world child welfare dataset to demonstrate how the proposed method improves upon standard practice.


title: Note on the Power-2 Limb Darkening Law

abstract: Recently there has been a renewed interest in the power-2 limb darkening law for modeling exoplanet transits. This law provides a better match to the intensities generated by spherical stellar atmosphere models than other 2-parameter laws. To help facilitate a wider use of the power-2 law we correct a minor error and, expanding on previous work, suggest a parametrization that can improve the sampling required by some numerical methods such as MCMC.


title: Eternal Inflation in Swampy Landscapes

abstract: The much-discussed swampland conjectures suggest significant constraints on the properties of string theory landscape and on the nature of the multiverse that this landscape can support. The conjectures are especially constraining for models of inflation; in particular, they exclude the existence of de Sitter (dS) vacua. If the conjectures are false and dS vacua do exist, it still appears that their construction in string theory requires a fair amount of fine-tuning, so they may be vastly outnumbered by AdS vacua. Here we explore the multiverse structure suggested by these considerations. We consider two scenarios: (i) a landscape where dS vacua are rare and (ii) a landscape where dS vacua do not exist and the dS potential maxima and saddle points are not flat enough to allow for the usual hilltop inflation, even though slow-roll inflation is possible on the slopes of the potential. We argue that in both scenarios inflation is eternal and all parts of the landscape that can support inflation get represented in the multiverse. The spacetime structure of the multiverse in such models is nontrivial and is rather different from the standard picture.


title: Regular and relational categories: Revisiting 'Cartesian bicategories I'

abstract: Regular logic is the fragment of first order logic generated by $=$, $\top$, $\wedge$, and $\exists$. A key feature of this logic is that it is the minimal fragment required to express composition of binary relations; another is that it is the internal logic of regular categories. The link between these two facts is that in any regular category, one may construct a notion of binary relation using jointly-monic spans; this results in what is known as the bicategory of relations of the regular category. In this paper we provide a direct axiomatization of bicategories of relations, which we term relational po-categories, reinterpreting the earlier work of Carboni and Walters along these lines. Our main contribution is an explicit proof that the 2-category of regular categories is equivalent to that of relational po-categories. Throughout, we emphasize the graphical nature of relational po-categories.


title: ATLAS Probe: Breakthrough Science of Galaxy Evolution, Cosmology, Milky Way, and the Solar System

abstract: ATLAS (Astrophysics Telescope for Large Area Spectroscopy) is a concept for a NASA probe-class space mission. It is the spectroscopic follow-up mission to WFIRST, boosting its scientific return by obtaining deep NIR & MIR slit spectroscopy for most of the galaxies imaged by the WFIRST High Latitude Survey at z>0.5. ATLAS will measure accurate and precise redshifts for ~200M galaxies out to z=7 and beyond, and deliver spectra that enable a wide range of diagnostic studies of the physical properties of galaxies over most of cosmic history. ATLAS and WFIRST together will produce a definitive 3D map of the Universe over 2000 sq deg. ATLAS Science Goals are: (1) Discover how galaxies have evolved in the cosmic web of dark matter from cosmic dawn through the peak era of galaxy assembly. (2) Discover the nature of cosmic acceleration. (3) Probe the Milky Way's dust-enshrouded regions, reaching the far side of our Galaxy. (4) Discover the bulk compositional building blocks of planetesimals formed in the outer Solar System. These flow down to the ATLAS Scientific Objectives: (1A) Trace the relation between galaxies and dark matter with less than 10% shot noise on relevant scales at 1<z<7. (1B) Probe the physics of galaxy evolution at 1<z<7. (2) Obtain definitive measurements of dark energy and tests of General Relativity. (3) Measure the 3D structure and stellar content of the inner Milky Way to a distance of 25 kpc. (4) Detect and quantify the composition of 3,000 planetesimals in the outer Solar System. ATLAS is a 1.5m telescope with a FoV of 0.4 sq deg, and uses Digital Micro-mirror Devices (DMDs) as slit selectors. It has a spectroscopic resolution of R = 1000, and a wavelength range of 1-4 microns. ATLAS has an unprecedented spectroscopic capability based on DMDs, with a spectroscopic multiplex factor ~6,000. ATLAS is designed to fit within the NASA probe-class space mission cost envelope.

categories: astro-ph.IM astro-ph.CO astro-ph.GA astro-ph.SR


title: Singular Nonsymmetric Macdonald Polynomials and Quasistaircases

abstract: Singular nonsymmetric Macdonald polynomials are constructed by use of the representation theory of the Hecke algebras of the symmetric groups. These polynomials are labeled by quasistaircase partitions and are associated to special parameter values $(q,t)$. For $N$ variables, there are singular polynomials for any pair of positive integers $m$ and $n$, with $2\leq n\leq N$, and parameters values $(q,t)$ satisfying $q^{a}t^{b}=1$ exactly when $a=rm$ and $b=rn$, for some integer $r$. The coefficients of nonsymmetric Macdonald polynomials with respect to the basis of monomials $\big\{ x^{\alpha}\big\}$ are rational functions of $q$ and $t$. In this paper, we present the construction of subspaces of singular nonsymmetric Macdonald polynomials specialized to particular values of $(q,t)$. The key part of this construction is to show the coefficients have no poles at the special values of $(q,t)$. Moreover, this subspace of singular Macdonald polynomials for the special values of the parameters is an irreducible module for the Hecke algebra of type $A_{N-1}$.


title: Bayesian Uncertainty Quantification for Systems Biology Models Parameterized Using Qualitative Data

abstract: Motivation: Recent work has demonstrated the feasibility of using non-numerical, qualitative data to parameterize mathematical models. However, uncertainty quantification (UQ) of such parameterized models has remained challenging because of a lack of a statistical interpretation of the objective functions used in optimization. Results: We formulated likelihood functions suitable for performing Bayesian UQ using qualitative data or a combination of qualitative and quantitative data. To demonstrate the resulting UQ capabilities, we analyzed a published model for IgE receptor signaling using synthetic qualitative and quantitative datasets. Remarkably, estimates of parameter values derived from the qualitative data were nearly as consistent with the assumed ground-truth parameter values as estimates derived from the lower throughput quantitative data. These results provide further motivation for leveraging qualitative data in biological modeling. Availability: The likelihood functions presented here are implemented in a new release of PyBioNetFit, an open-source application for analyzing SBML- and BNGL-formatted models, available online at www.github.com/lanl/PyBNF.


title: Robust Online Video Super-Resolution Using an Efficient Alternating Projections Scheme

abstract: Video super-resolution reconstruction (SRR) algorithms attempt to reconstruct high-resolution (HR) video sequences from low-resolution observations. Although recent progress in video SRR has significantly improved the quality of the reconstructed HR sequences, it remains challenging to design SRR algorithms that achieve good quality and robustness at a small computational complexity, being thus suitable for online applications. In this paper, we propose a new adaptive video SRR algorithm that achieves state-of-the-art performance at a very small computational cost. Using a nonlinear cost function constructed considering characteristics of typical innovation outliers in natural image sequences and an edge-preserving regularization strategy, we achieve state-of-the-art reconstructed image quality and robustness. This cost function is optimized using a specific alternating projections strategy over non-convex sets that is able to converge in a very few iterations. An accurate and very efficient approximation for the projection operations is also obtained using tools from multidimensional multirate signal processing. This solves the slow convergence issue of stochastic gradient-based methods while keeping a small computational complexity. Simulation results with both synthetic and real image sequences show that the performance of the proposed algorithm is similar or better than state-of-the-art SRR algorithms, while requiring only a small fraction of their computational cost.


title: Small Energy Gap Revealed in CrBr3 by Scanning Tunneling Spectroscopy

abstract: CrBr$_{3}$ is a layered van der Waals material with magnetic ordering down to the 2D limit. For decades, based on optical measurements, it is believed that the energy gap of CrBr$_{3}$ is in the range of 1.68-2.1 eV. However, controversial results have indicated that the band gap of CrBr$_{3}$ is possibly smaller than that. An unambiguous determination of the energy gap is critical to the correct interpretations of the experimental results of CrBr$_{3}$. Here, we present the scanning tunneling microscopy and spectroscopy (STM/S) results of CrBr$_{3}$ thin and thick flakes exfoliated onto pyropytic graphite (HOPG) surfaces and density functional theory (DFT) calculations to reveal the small energy gap (peak-to-peak energy gap to be 0.57 eV $\pm$ 0.04 eV; or the onset signal energy gap to be 0.29 $\pm$ 0.05 eV from dI/dV spectra). Atomic resolution topography images show the defect-free crystal structure and the dI/dV spectra exhibit multiple peak features measured at 77 K. The conduction band - valence band peak pairs in the multi-peak dI/dV spectrum agree very well with all reported optical transitions. STM topography images of mono- and bi-layer CrBr$_{3}$ flakes exhibit edge degradation due to short air exposure (~15 min) during sample transfer. The unambiguously determined small energy gap settles the controversy and is the key in better understanding CrBr$_{3}$ and similar materials.


title: Monitoring radio galaxies at TeV energies with HAWC

abstract: With an instantaneous field of view of 2 sr and a duty cycle > 95%, the High Altitude Water Cherenkov (HAWC) Gamma-Ray Observatory is a perfect instrument for monitoring variable TeV sources. Because radio galaxies are a type of Active Galactic Nuclei (AGN) with their jets misaligned with respect to our line of sight, they may help us to probe the physics of very-high-energy (VHE) emission processes in these objects. Three out of four radio galaxies that have been detected at TeV energies by other facilities are located within the field of view of the HAWC Observatory: M87, NGC 1275, and 3C 264. A search for TeV gamma rays at their locations yields no statistically significant excess of counts. We present corresponding upper limits for each radio galaxy and light curves covering 3 years of data taken with HAWC.


title: A Koopman-based framework for forecasting the spatiotemporal evolution of chaotic dynamics with nonlinearities modeled as exogenous forcings

abstract: We introduce a data-driven method and shows its skills for spatiotemporal prediction of high-dimensional chaotic dynamics and turbulence. The method is based on a finite-dimensional approximation of the Koopman operator where the observables are vector-valued and delay-embedded, and the nonlinearities are treated as external forcings. The predictive capabilities of the method are demonstrated for well-known prototypes of chaos such as the Kuramoto-Sivashinsky equation and Lorenz-96 system, for which the data-driven predictions are accurate for several Lyapunov timescales. Similar performance is seen for two-dimensional lid-driven cavity flows at high Reynolds numbers.


title: Data Capsule: A New Paradigm for Automatic Compliance with Data Privacy Regulations

abstract: The increasing pace of data collection has led to increasing awareness of privacy risks, resulting in new data privacy regulations like General data Protection Regulation (GDPR). Such regulations are an important step, but automatic compliance checking is challenging. In this work, we present a new paradigm, Data Capsule, for automatic compliance checking of data privacy regulations in heterogeneous data processing infrastructures. Our key insight is to pair up a data subject's data with a policy governing how the data is processed. Specified in our formal policy language: PrivPolicy, the policy is created and provided by the data subject alongside the data, and is associated with the data throughout the life-cycle of data processing (e.g., data transformation by data processing systems, data aggregation of multiple data subjects' data). We introduce a solution for static enforcement of privacy policies based on the concept of residual policies, and present a novel algorithm based on abstract interpretation for deriving residual policies in PrivPolicy. Our solution ensures compliance automatically, and is designed for deployment alongside existing infrastructure. We also design and develop PrivGuard, a reference data capsule manager that implements all the functionalities of Data Capsule paradigm.


title: Searches for neutrinos from fast radio bursts with IceCube

abstract: Although IceCube has discovered a diffuse astrophysical neutrino flux, the underlying sources of these neutrinos remain unknown. Transient astrophysical objects, such as fast radio bursts (FRBs), could explain a large percentage of the measured flux. We present the analysis techniques of IceCube searches for MeV to TeV neutrinos from FRBs. As no significant correlation between IceCube neutrinos and FRBs has been found, we present the first limit on MeV neutrino emission from FRBs and the most constraining limits for neutrinos with GeV to TeV energies. We also describe the prospects for future IceCube neutrino searches coinciding with FRB detections from next generation radio interferometers.


title: Contact Inertial Odometry: Collisions are your Friends

abstract: Autonomous exploration of unknown environments with aerial vehicles remains a challenge, especially in perceptually degraded conditions. Dust, fog, or a lack of visual or LiDAR-based features results in severe difficulties for state estimation algorithms, which failure can be catastrophic. In this work, we show that it is indeed possible to navigate in such conditions without any exteroceptive sensing by exploiting collisions instead of treating them as constraints. To this end, we present a novel contact-based inertial odometry (CIO) algorithm: it uses estimated external forces with the environment to detect collisions and generate pseudo-measurements of the robot velocity, enabling autonomous flight. To fully exploit this method, we first perform modeling of a hybrid ground and aerial vehicle which can withstand collisions at moderate speeds, for which we develop an external wrench estimation algorithm. Then, we present our CIO algorithm and develop a reactive planner and control law which encourage exploration by bouncing off obstacles. All components of this framework are validated in hardware experiments and we demonstrate that a quadrotor can traverse a cluttered environment using an IMU only. This work can be used on drones to recover from visual inertial odometry failure or on micro-drones that do not have the payload capacity to carry cameras, LiDARs or powerful computers.


title: Sequential Learning of Convolutional Features for Effective Text Classification

abstract: Text classification has been one of the major problems in natural language processing. With the advent of deep learning, convolutional neural network (CNN) has been a popular solution to this task. However, CNNs which were first proposed for images, face many crucial challenges in the context of text processing, namely in their elementary blocks: convolution filters and max pooling. These challenges have largely been overlooked by the most existing CNN models proposed for text classification. In this paper, we present an experimental study on the fundamental blocks of CNNs in text categorization. Based on this critique, we propose Sequential Convolutional Attentive Recurrent Network (SCARN). The proposed SCARN model utilizes both the advantages of recurrent and convolutional structures efficiently in comparison to previously proposed recurrent convolutional models. We test our model on different text classification datasets across tasks like sentiment analysis and question classification. Extensive experiments establish that SCARN outperforms other recurrent convolutional architectures with significantly less parameters. Furthermore, SCARN achieves better performance compared to equally large various deep CNN and LSTM architectures.


title: An SOS counterexample to an inequality of symmetric functions

abstract: It is known that differences of symmetric functions corresponding to various bases are nonnegative on the nonnegative orthant exactly when the partitions defining them are comparable in dominance order. The only exception is the case of homogeneous symmetric functions where it is only known that dominance of the partitions implies nonnegativity of the corresponding difference of symmetric functions. It was conjectured by Cuttler, Greene, and Skandera in 2011 that the converse also holds, as in the cases of the monomial, elementary, power-sum, and Schur bases. In this paper we provide a counterexample, showing that homogeneous symmetric functions break the pattern. We use semidefinite programming to find an explicit sums of squares decomposition of the polynomial $H_{44} - H_{521}$ as a sum of 41 squares. This rational certificate of nonnegativity disproves the conjecture, since a polynomial which is a sum of squares cannot be negative, and since the partitions 44 and 521 are incomparable in dominance order.


title: Enhancements for Audio-only Diarization Systems

abstract: In this paper two different approaches to enhance the performance of the most challenging component of a Speaker Diarization system are presented, i.e. the speaker clustering part. A processing step is proposed enhancing the input features with a temporal smoothing process combined with nonlinear filtering. We, also, propose improvements on the Deep Embedded Clustering (DEC) algorithm -- a nonlinear feature transformation. The performance of these enhancements is compared with different clustering algorithms, such as the UISRNN, k-Means, Spectral clustering and x-Means. The evaluation is held on three different tasks, i.e. the AMI, DIHARD and an internal meeting transcription task. The proposed approaches assume a known number of speakers and time segmentations for the audio files. Since, we focus only on the clustering component of diarization for this work, the segmentation provided is assumed perfect. Finally, we present how supervision, in the form of given speaker profiles, can further improve the overall diarization performance. The proposed enhancements yield substantial relative improvements in all 3 tasks, with 20\% in AMI and 19\% better than the best diarization system for DIHARD task, when the number of speakers is known.


title: A Distributed Algorithm for High-Dimension Convex Quadratically Constrained Quadratic Programs

abstract: We propose a Jacobi-style distributed algorithm to solve convex, quadratically constrained quadratic programs (QCQPs), which arise from a broad range of applications. While small to medium-sized convex QCQPs can be solved efficiently by interior-point algorithms, large-scale problems pose significant challenges to traditional algorithms that are mainly designed to be implemented on a single computing unit. The exploding volume of data (and hence, the problem size), however, may overwhelm any such units. In this paper, we propose a distributed algorithm for general, non-separable, large-scale convex QCQPs, using a novel idea of predictor-corrector primal-dual update with an adaptive step size. The algorithm enables distributed storage of data as well as parallel distributed computing. We establish the conditions for the proposed algorithm to converge to a global optimum, and implement our algorithm on a computer cluster with multiple nodes using Message Passing Interface (MPI). The numerical experiments are conducted on data sets of various scales from different applications, and the results show that our algorithm exhibits favorable scalability for solving large-scale problems.


title: Cloudy with high chance of DBMS: A 10-year prediction for Enterprise-Grade ML

abstract: Machine learning (ML) has proven itself in high-value web applications such as search ranking and is emerging as a powerful tool in a much broader range of enterprise scenarios including voice recognition and conversational understanding for customer support, autotuning for videoconferencing, intelligent feedback loops in large-scale sysops, manufacturing and autonomous vehicle management, complex financial predictions, just to name a few. Meanwhile, as the value of data is increasingly recognized and monetized, concerns about securing valuable data and risks to individual privacy have been growing. Consequently, rigorous data management has emerged as a key requirement in enterprise settings. How will these trends (ML growing popularity, and stricter data governance) intersect? What are the unmet requirements for applying ML in enterprise settings? What are the technical challenges for the DB community to solve? In this paper, we present our vision of how ML and database systems are likely to come together, and early steps we take towards making this vision a reality.


title: Amplitude and Phase Noise of Magnons

abstract: The low-frequency amplitude and phase noise spectra of magnetization waves, i.e. magnons, was measured in the yttrium iron garnet (YIG) waveguides. This type of noise, which originates from the fluctuations of the physical properties of the YIG crystals, has to be taken into account in the design of YIG-based RF generators and magnonic devices for data processing, sensing and imaging applications. It was found that the amplitude noise level of magnons depends strongly on the power level, increasing sharply at the on-set of nonlinear dissipation. The noise spectra of both the amplitude and phase noise have the Lorentzian shape with the characteristic frequencies below 100 Hz.


title: Thermalization and Sub-Poissonian Density Fluctuations in a Degenerate Molecular Fermi Gas

abstract: We observe thermalization in the production of a degenerate Fermi gas of polar ${}^{40}\text{K}{}^{87}\text{Rb}$ molecules. By measuring the atom--dimer elastic scattering cross section near the Feshbach resonance, we show that Feshbach molecules rapidly reach thermal equilibrium with both parent atomic species. Equilibrium is essentially maintained through coherent transfer to the ground state. Sub-Poissonian density fluctuations in Feshbach and ground-state molecules are measured, giving an independent characterization of degeneracy and directly probing the molecular Fermi--Dirac distribution.


title: Impact of Galactic Interactions on the Evolution of the Far-Infrared-Radio Correlation

abstract: A strong correlation has been known to exist between the far-infrared (FIR) and radio emission of the star-forming galaxies. Observations have shown that although scatter is present, this correlation holds over a range of redshifts and does not evolve. However, there has been a number of more recent observations, especially in higher redshift surveys, indicating the opposite. The question that then presents itself is - what is driving this evolution? In this work we explore the possibility that the answer might be hiding in galactic interactions and revealed by morphology. We present a number of models based on the evolving number of galaxies of different morphological types, some of which could potentially explain observed trends and scatter in general. Furthermore, we analyze a small sample of 34 submillimeter galaxies whose observations have been published and morphology classified. In this sample we look at the FIR-radio correlation separately in galaxies of different morphological types. We find that, while for both disk and irregular star-forming galaxies there are hints of evolution of this correlation with redshift, where this evolution appears to be stronger in irregular galaxies, due to low number statistics, both samples are also consistent with no evolution, making it at this point, difficult to discriminate between models. However, when analysis was performed on the combined sample, evolving and decreasing trend was indeed found, indicating, that evolution should be expected in at least one of the morphological types.


title: Keep Calm and Switch On! Preserving Sentiment and Fluency in Semantic Text Exchange

abstract: In this paper, we present a novel method for measurably adjusting the semantics of text while preserving its sentiment and fluency, a task we call semantic text exchange. This is useful for text data augmentation and the semantic correction of text generated by chatbots and virtual assistants. We introduce a pipeline called SMERTI that combines entity replacement, similarity masking, and text infilling. We measure our pipeline's success by its Semantic Text Exchange Score (STES): the ability to preserve the original text's sentiment and fluency while adjusting semantic content. We propose to use masking (replacement) rate threshold as an adjustable parameter to control the amount of semantic change in the text. Our experiments demonstrate that SMERTI can outperform baseline models on Yelp reviews, Amazon reviews, and news headlines.


title: Deep Plug-and-Play Prior for Parallel MRI Reconstruction

abstract: Fast data acquisition in Magnetic Resonance Imaging (MRI) is vastly in demand and scan time directly depends on the number of acquired k-space samples. Conventional MRI reconstruction methods for fast MRI acquisition mostly relied on different regularizers which represent analytical models of sparsity. However, recent data-driven methods based on deep learning has resulted in promising improvements in image reconstruction algorithms. In this paper, we propose a deep plug-and-play prior framework for parallel MRI reconstruction problems which utilize a deep neural network (DNN) as an advanced denoiser within an iterative method. This, in turn, enables rapid acquisition of MR images with improved image quality. The proposed method was compared with the reconstructions using the clinical gold standard GRAPPA method. Our results with undersampled data demonstrate that our method can deliver considerably higher quality images at high acceleration factors in comparison to clinical gold standard method for MRI reconstructions. Our proposed reconstruction enables an increase in acceleration factor, and a reduction in acquisition time while maintaining high image quality.


title: Gaussian Process Estimation of Transition Redshift

abstract: This paper aims to put constraints on the transition redshift $z_t$, which determines the onset of cosmic acceleration, in cosmological-model independent frameworks. In order to do that, we use the non-parametric Gaussian Process method with $H(z)$ and SNe Ia data. The deceleration parameter reconstruction from $H(z)$ data yields $z_t=0.59^{+0.12}_{-0.11}$. The reconstruction from SNe Ia data assumes spatial flatness and yields $z_t=0.683^{+0.11}_{-0.082}$. These results were found with a Gaussian kernel and we show that they are consistent with two other kernel choices.


title: Automatically Inferring Gender Associations from Language

abstract: In this paper, we pose the question: do people talk about women and men in different ways? We introduce two datasets and a novel integration of approaches for automatically inferring gender associations from language, discovering coherent word clusters, and labeling the clusters for the semantic concepts they represent. The datasets allow us to compare how people write about women and men in two different settings - one set draws from celebrity news and the other from student reviews of computer science professors. We demonstrate that there are large-scale differences in the ways that people talk about women and men and that these differences vary across domains. Human evaluations show that our methods significantly outperform strong baselines.


title: The antitriangular factorization of skew-symmetric matrices

abstract: In this paper we develop algorithms for orthogonal similarity transformations of skew-symmetric matrices to simpler forms. The first algorithm is similar to the algorithm for the block antitriangular factorization of symmetric matrices, but in the case of skew-symmetric matrices, an antitriangular form is always obtained. Moreover, a simple two-sided permutation of the antitriangular form transforms the matrix into a multi-arrowhead matrix. In addition, we show that the block antitriangular form of the skew-Hermitian matrices has the same structure as the block antitriangular form of the symmetric matrices.


title: Accurate and efficient DFT-based diabatization for hole and electron transfer using absolutely localized molecular orbitals

abstract: Diabatic states and the couplings between them are important for quantifying, elucidating, and predicting the rates and mechanisms of many chemical and biochemical processes. Here, we propose and investigate approaches to accurately compute diabatic couplings from density functional theory (DFT) using absolutely localized molecular orbitals (ALMOs). ALMOs provide an appealing approach to generate variationally optimized diabatic states and obtain their associated forces that allows for the relaxation of the donor and acceptor orbitals in a way that is internally consistent in how the method treats both the donor and acceptor states. Here, we show that one can obtain more accurate electronic couplings between ALMO-based diabats by employing the symmetrized transition density matrix to evaluate the exchange-correlation contribution. We demonstrate that this approach yields accurate results in comparison to other commonly used DFT-based diabatization methods across a wide array of electron and hole transfer processes occurring in systems ranging from conjugated organic molecules, such as thiophene and pentacene, to DNA base pairs. We also show that this approach yields accurate diabatic couplings even when combined with lower tiers of the DFT hierarchy, opening the door to combining it with quantum dynamics approaches to provide an ab initio treatment of nonadiabatic processes in the condensed phase.


title: Pump-Depletion Dynamics and Saturation of Stimulated Brillouin Scattering in Shock Ignition Relevant Experiments

abstract: As an alternative inertial confinement fusion scheme with predicted high energy gain and more robust designs, shock ignition requires a strong converging shock driven by a shaped pulse with a high-intensity spike at the end to ignite a pre-compressed fusion capsule. Understanding nonlinear laser-plasma instabilities in shock ignition conditions is crucial to assess and improve the laser-shock energy coupling. Recent experiments conducted on the OMEGA-EP laser facility have for the first time demonstrated that such instabilities can $\sim$100\% deplete the first 0.5 ns of the high-intensity laser pump. Analysis of the observed laser-generated blast wave suggests that this pump-depletion starts at 0.01--0.02 critical density and progresses to 0.1--0.2 critical density. This pump-depletion is also confirmed by the time-resolved stimulated Raman backscattering spectra. The dynamics of the pump-depletion can be explained by the breaking of ion-acoustic waves in stimulated Brillouin scattering. Such strong pump-depletion would inhibit the collisional laser energy absorption but may benefit the generation of hot electrons with moderate temperatures for electron shock ignition [Shang et al. Phys. Rev. Lett. 119 195001 (2017)].


title: Significance of Gravitational Nonlinearities on the Dynamics of Disk Galaxies

abstract: The discrepancy between the visible mass in galaxies or galaxy clusters, and that inferred from their dynamics is well known. The prevailing solution to this problem is dark matter. Here we show that a different approach, one that conforms to both the current Standard Model of Particle Physics and General Relativity, explains the recently observed tight correlation between the galactic baryonic mass and its observed acceleration. Using direct calculations based on General Relativity's Lagrangian, and parameter-free galactic models, we show that the nonlinear effects of General Relativity make baryonic matter alone sufficient to explain this observation.


title: Boundary Term in the Gravitational Action is the Heat Content of the Null surfaces

abstract: The Einstein-Hilbert Lagrangian has no well-defined variational derivative with respect to the metric. This issue has to be tackled by adding a suitable surface term to the action, which is a peculiar feature of gravity. We also know that null surfaces in spacetime exhibit (observer-dependent) thermodynamic features. This suggests a possible thermodynamic interpretation of the boundary term when the boundary is a null surface. For timelike/spacelike surfaces it is easy to construct the boundary term but there are some subtleties in the case of the null surface. The correct form of boundary term for null surfaces was obtained recently from first principles. We show that this surface term, as well as its variation, have direct thermodynamic interpretation in terms of a heat density of null surfaces. The implications of the result are discussed.


title: VST-A: A Foundationally Sound Annotation Verifier

abstract: Program verifiers for imperative languages such as C may be annotation-based, in which assertions and invariants are put into source files and then checked, or tactic-based, where proof scripts separate from programs are interactively developed in a proof assistant such as Coq. Annotation verifiers have been more automated and convenient, but some interactive verifiers have richer assertion languages and formal proofs of soundness. We present VST-A, an annotation verifier that uses the rich assertion language of VST, leverages the formal soundness proof of VST, but allows users to describe functional correctness proofs intuitively by inserting assertions. VST-A analyzes control flow graphs, decomposes every C function into control flow paths between assertions, and reduces program verification problems into corresponding straightline Hoare triples. Compared to existing foundational program verification tools like VST and Iris, in VST-A, such decompositions and reductions are allowed to be nonstructural, which makes VST-A more flexible to use. VST-A's decomposition and reduction is defined in Coq, proved sound in Coq, and computed in a call-by-value way in Coq. The soundness proof for reduction is totally logical, independent of the complicated semantic model (and soundness proof) of VST's Hoare triple. Because of the rich assertion language, not all reduced proof goals can be automatically checked, but the system allows users to prove residual proof goals using the full power of the Coq proof assistant.


title: (Male, Bachelor) and (Female, Ph.D) have different connotations: Parallelly Annotated Stylistic Language Dataset with Multiple Personas

abstract: Stylistic variation in text needs to be studied with different aspects including the writer's personal traits, interpersonal relations, rhetoric, and more. Despite recent attempts on computational modeling of the variation, the lack of parallel corpora of style language makes it difficult to systematically control the stylistic change as well as evaluate such models. We release PASTEL, the parallel and annotated stylistic language dataset, that contains ~41K parallel sentences (8.3K parallel stories) annotated across different personas. Each persona has different styles in conjunction: gender, age, country, political view, education, ethnic, and time-of-writing. The dataset is collected from human annotators with solid control of input denotation: not only preserving original meaning between text, but promoting stylistic diversity to annotators. We test the dataset on two interesting applications of style language, where PASTEL helps design appropriate experiment and evaluation. First, in predicting a target style (e.g., male or female in gender) given a text, multiple styles of PASTEL make other external style variables controlled (or fixed), which is a more accurate experimental design. Second, a simple supervised model with our parallel text outperforms the unsupervised models using nonparallel text in style transfer. Our dataset is publicly available.


title: Strong convergence of an adaptive time-stepping Milstein method for SDEs with monotone coefficients

abstract: We introduce an explicit adaptive Milstein method for stochastic differential equations (SDEs) with no commutativity condition. The drift and diffusion are separately locally Lipschitz and together satisfy a monotone condition. This method relies on a class of path-bounded time-stepping strategies which work by reducing the stepsize as solutions approach the boundary of a sphere, invoking a backstop method in the event that the timestep becomes too small. We prove that such schemes are strongly $L_2$ convergent of order one. This order is inherited by an explicit adaptive Euler-Maruyama scheme in the additive noise case. Moreover we show that the probability of using the backstop method at any step can be made arbitrarily small. We compare our method to other fixed-step Milstein variants on a range of test problems.


title: Small and Practical BERT Models for Sequence Labeling

abstract: We propose a practical scheme to train a single multilingual sequence labeling model that yields state of the art results and is small and fast enough to run on a single CPU. Starting from a public multilingual BERT checkpoint, our final model is 6x smaller and 27x faster, and has higher accuracy than a state-of-the-art multilingual baseline. We show that our model especially outperforms on low-resource languages, and works on codemixed input text without being explicitly trained on codemixed examples. We showcase the effectiveness of our method by reporting on part-of-speech tagging and morphological prediction on 70 treebanks and 48 languages.


title: Implicit Hari--Zimmermann algorithm for the generalized SVD on the GPUs

abstract: A parallel, blocked, one-sided Hari--Zimmermann algorithm for the generalized singular value decomposition (GSVD) of a real or a complex matrix pair $(F,G)$ is here proposed, where $F$ and $G$ have the same number of columns, and are both of the full column rank. The algorithm targets either a single graphics processing unit (GPU), or a cluster of those, performs all non-trivial computation exclusively on the GPUs, requires the minimal amount of memory to be reasonably expected, scales acceptably with the increase of the number of GPUs available, and guarantees the reproducible, bitwise identical output of the runs repeated over the same input and with the same number of GPUs.


title: Knowledge Enhanced Attention for Robust Natural Language Inference

abstract: Neural network models have been very successful at achieving high accuracy on natural language inference (NLI) tasks. However, as demonstrated in recent literature, when tested on some simple adversarial examples, most of the models suffer a significant drop in performance. This raises the concern about the robustness of NLI models. In this paper, we propose to make NLI models robust by incorporating external knowledge to the attention mechanism using a simple transformation. We apply the new attention to two popular types of NLI models: one is Transformer encoder, and the other is a decomposable model, and show that our method can significantly improve their robustness. Moreover, when combined with BERT pretraining, our method achieves the human-level performance on the adversarial SNLI data set.


title: Painlev\'{e} VI, Painlev\'{e} III and the Hankel Determinant Associated with a Degenerate Jacobi Unitary Ensemble

abstract: This paper studies the Hankel determinant generated by a perturbed Jacobi weight, which is closely related to the largest and smallest eigenvalue distribution of the degenerate Jacobi unitary ensemble. By using the ladder operator approach for the orthogonal polynomials, we find that the logarithmic derivative of the Hankel determinant satisfies a nonlinear second-order differential equation, which turns out to be the Jimbo-Miwa-Okamoto $\sigma$-form of the Painlev\'{e} VI equation by a translation transformation. We also show that, after a suitable double scaling, the differential equation is reduced to the Jimbo-Miwa-Okamoto $\sigma$-form of the Painlev\'{e} III. In the end, we obtain the asymptotic behavior of the Hankel determinant as $t\rightarrow1^{-}$ and $t\rightarrow0^{+}$ in two important cases, respectively.


title: Your Smart Home Can't Keep a Secret: Towards Automated Fingerprinting of IoT Traffic with Neural Networks

abstract: The IoT (Internet of Things) technology has been widely adopted in recent years and has profoundly changed the people's daily lives. However, in the meantime, such a fast-growing technology has also introduced new privacy issues, which need to be better understood and measured. In this work, we look into how private information can be leaked from network traffic generated in the smart home network. Although researchers have proposed techniques to infer IoT device types or user behaviors under clean experiment setup, the effectiveness of such approaches become questionable in the complex but realistic network environment, where common techniques like Network Address and Port Translation (NAPT) and Virtual Private Network (VPN) are enabled. Traffic analysis using traditional methods (e.g., through classical machine-learning models) is much less effective under those settings, as the features picked manually are not distinctive any more. In this work, we propose a traffic analysis framework based on sequence-learning techniques like LSTM and leveraged the temporal relations between packets for the attack of device identification. We evaluated it under different environment settings (e.g., pure-IoT and noisy environment with multiple non-IoT devices). The results showed our framework was able to differentiate device types with a high accuracy. This result suggests IoT network communications pose prominent challenges to users' privacy, even when they are protected by encryption and morphed by the network gateway. As such, new privacy protection methods on IoT traffic need to be developed towards mitigating this new issue.


title: Generating Personalized Recipes from Historical User Preferences

abstract: Existing approaches to recipe generation are unable to create recipes for users with culinary preferences but incomplete knowledge of ingredients in specific dishes. We propose a new task of personalized recipe generation to help these users: expanding a name and incomplete ingredient details into complete natural-text instructions aligned with the user's historical preferences. We attend on technique- and recipe-level representations of a user's previously consumed recipes, fusing these 'user-aware' representations in an attention fusion layer to control recipe text generation. Experiments on a new dataset of 180K recipes and 700K interactions show our model's ability to generate plausible and personalized recipes compared to non-personalized baselines.


title: Generation of 14.0W of single frequency light at 770 nm by intracavity frequency doubling

abstract: We present a continuous, narrow-linewidth, tunable laser system that outputs up to 14.0 W at 770 nm. The light is generated by frequency doubling 18.8 W of light from a 1540 nm fiber amplifier that is seeded by a single mode diode laser achieving >74% conversion efficiency. We utilize a Lithium Triborate Crystal in an enhancement ring cavity. The low intensity noise and narrow linewidth of the 770 nm output are suitable for cold atom experiments.


title: Behavior Gated Language Models

abstract: Most current language modeling techniques only exploit co-occurrence, semantic and syntactic information from the sequence of words. However, a range of information such as the state of the speaker and dynamics of the interaction might be useful. In this work we derive motivation from psycholinguistics and propose the addition of behavioral information into the context of language modeling. We propose the augmentation of language models with an additional module which analyzes the behavioral state of the current context. This behavioral information is used to gate the outputs of the language model before the final word prediction output. We show that the addition of behavioral context in language models achieves lower perplexities on behavior-rich datasets. We also confirm the validity of the proposed models on a variety of model architectures and improve on previous state-of-the-art models with generic domain Penn Treebank Corpus.


title: Subgroups of $SL_2(\mathbb{Z})$ characterized by certain continued fraction representations

abstract: For positive integers $u$ and $v$, let $L_u=\begin{bmatrix} 1 & 0 \\ u & 1 \end{bmatrix}$ and $R_v=\begin{bmatrix} 1 & v \\ 0 & 1 \end{bmatrix}$. Let $S_{u,v}$ be the monoid generated by $L_u$ and $R_v$, and $G_{u,v}$ be the group generated by $L_u$ and $R_v$. In this paper we expand on a characterization of matrices $M=\begin{bmatrix}a & b \\c & d\end{bmatrix}$ in $S_{k,k}$ and $G_{k,k}$ when $k\geq 2$ given by Esbelin and Gutan to $S_{u,v}$ when $u,v\geq 2$ and $G_{u,v}$ when $u,v\geq 3$. We give a simple algorithmic way of determining if $M$ is in $G_{u,v}$ using a recursive function and the short continued fraction representation of $b/d$.


title: Giving BERT a Calculator: Finding Operations and Arguments with Reading Comprehension

abstract: Reading comprehension models have been successfully applied to extractive text answers, but it is unclear how best to generalize these models to abstractive numerical answers. We enable a BERT-based reading comprehension model to perform lightweight numerical reasoning. We augment the model with a predefined set of executable 'programs' which encompass simple arithmetic as well as extraction. Rather than having to learn to manipulate numbers directly, the model can pick a program and execute it. On the recent Discrete Reasoning Over Passages (DROP) dataset, designed to challenge reading comprehension models, we show a 33% absolute improvement by adding shallow programs. The model can learn to predict new operations when appropriate in a math word problem setting (Roy and Roth, 2015) with very few training examples.


title: Harmonic 2-forms and positively curved 4-manifolds

abstract: We prove that if a compact Riemannian 4-manifold with positive sectional curvature satisfies a Kato type inequality, then it is definite. We also discuss some new insights for compact Riemannian 4-manifolds of positive sectional curvature.


title: Quantity doesn't buy quality syntax with neural language models

abstract: Recurrent neural networks can learn to predict upcoming words remarkably well on average; in syntactically complex contexts, however, they often assign unexpectedly high probabilities to ungrammatical words. We investigate to what extent these shortcomings can be mitigated by increasing the size of the network and the corpus on which it is trained. We find that gains from increasing network size are minimal beyond a certain point. Likewise, expanding the training corpus yields diminishing returns; we estimate that the training corpus would need to be unrealistically large for the models to match human performance. A comparison to GPT and BERT, Transformer-based models trained on billions of words, reveals that these models perform even more poorly than our LSTMs in some constructions. Our results make the case for more data efficient architectures.


title: Energy Clustering for Unsupervised Person Re-identification

abstract: Due to the high cost of data annotation in supervised learning for person re-identification (Re-ID) methods, unsupervised learning becomes more attractive in the real world. The Bottom-up Clustering (BUC) approach based on hierarchical clustering serves as one promising unsupervised clustering method. One key factor of BUC is the distance measurement strategy. Ideally, the distance measurement should consider both inter-cluster and intra-cluster distance of all samples. However, BUC uses the minimum distance, only considers a pair of the nearest sample between two clusters and ignores the diversity of other samples in clusters. To solve this problem, we propose to use the energy distance to evaluate both the inter-cluster and intra-cluster distance in hierarchical clustering(E-cluster), and use the sum of squares of deviations(SSD) as a regularization term to further balance the diversity and similarity of energy distance evaluation. We evaluate our method on large scale re-ID datasets, including Market-1501, DukeMTMC-reID and MARS. Extensive experiments show that our method obtains significant improvements over the state-of-the-art unsupervised methods, and even better than some transfer learning methods.


title: Domain Wall Enabled Steep Slope Switching in MoS$_2$ Transistors Towards Hysteresis-Free Operation

abstract: The device concept of ferroelectric-based negative capacitance (NC) transistors offers a promising route for achieving energy-efficient logic applications that can outperform the conventional semiconductor technology, while viable operation mechanisms remain a central topic of debate. In this work, we report steep slope switching in MoS$_2$ transistors back-gated by single-layer polycrystalline PbZr$_{0.35}$Ti$_{0.65}$O$_3$. The devices exhibit current on/off ratios up to 8$\times$10$^6$ within an ultra-low gate voltage window of $V_g$ = $\pm$0.5 V and subthreshold swing (SS) as low as 9.7 mV decade$^{-1}$ at room temperature, transcending the 60 mV decade$^{-1}$ Boltzmann limit without involving additional dielectric layers. Theoretical modeling reveals the dominant role of the metastable polar states within domain walls in enabling the NC mode, which is corroborated by the relation between SS and domain wall density. Our findings shed light on a hysteresis-free mechanism for NC operation, providing a simple yet effective material strategy for developing low-power 2D nanoelectronics.


title: Towards Learning Affine-Invariant Representations via Data-Efficient CNNs

abstract: In this paper we propose integrating a priori knowledge into both design and training of convolutional neural networks (CNNs) to learn object representations that are invariant to affine transformations (i.e., translation, scale, rotation). Accordingly we propose a novel multi-scale maxout CNN and train it end-to-end with a novel rotation-invariant regularizer. This regularizer aims to enforce the weights in each 2D spatial filter to approximate circular patterns. In this way, we manage to handle affine transformations in training using convolution, multi-scale maxout, and circular filters. Empirically we demonstrate that such knowledge can significantly improve the data-efficiency as well as generalization and robustness of learned models. For instance, on the Traffic Sign data set and trained with only 10 images per class, our method can achieve 84.15% that outperforms the state-of-the-art by 29.80% in terms of test accuracy.


title: Water-resistant carbon nanotube based strain sensor for monitoring structural integrity

abstract: Monitoring structural integrity during and after extreme events such as an earthquake or a tsunami is a mundane yet important task that still awaits a workable solution. Currently available stress sensors are not sufficiently robust and are affected by humidity. Insufficient information about crack formation preceding structural failure increases risk during rescue operations significantly. Designing durable stress sensors that are not affected by harsh and changing environment and do not fail under catastrophic conditions is a fundamental challenge. To address this problem, we developed a stress sensor based on creased single-walled carbon nanotubes (SWCNTs) encapsulated in a non-fluorinated superhydrophobic coating. The creased SWCNT film was fabricated and integrated in polydimethylsiloxane (PDMS) to provide a highly linear response under elastic deformation. The non-fluorinated water-repellent coating was fabricated by spray-coating the film with nanosilica particles, providing water resistance during elastic deformation. The compact design and superior water resistance of the sensor, along with its appealing linearity and large stretchability, demonstrates the scalability of this approach for fabricating efficient strain sensors for applications in infrastructure and robotic safety management as well as advanced wearable sensors.


title: Statistical Inferences of Linear Forms for Noisy Matrix Completion

abstract: We introduce a flexible framework for making inferences about general linear forms of a large matrix based on noisy observations of a subset of its entries. In particular, under mild regularity conditions, we develop a universal procedure to construct asymptotically normal estimators of its linear forms through double-sample debiasing and low-rank projection whenever an entry-wise consistent estimator of the matrix is available. These estimators allow us to subsequently construct confidence intervals for and test hypotheses about the linear forms. Our proposal was motivated by a careful perturbation analysis of the empirical singular spaces under the noisy matrix completion model which might be of independent interest. The practical merits of our proposed inference procedure are demonstrated on both simulated and real-world data examples.

categories: math.ST cs.IT cs.LG math.IT stat.ML stat.TH


title: Bose-Einstein condensation of triplons close to the quantum critical point in the quasi-one-dimensional spin-$1/2$ antiferromagnet NaVOPO$_4$

abstract: Structural and magnetic properties of a quasi-one-dimensional spin-$1/2$ compound NaVOPO$_4$ are explored by x-ray diffraction, magnetic susceptibility, high-field magnetization, specific heat, electron spin resonance, and $^{31}$P nuclear magnetic resonance measurements, as well as complementary \textit{ab initio} calculations. Whereas magnetic susceptibility of NaVOPO$_4$ may be compatible with the gapless uniform spin chain model, detailed examination of the crystal structure reveals a weak alternation of the exchange couplings with the alternation ratio $\alpha\simeq 0.98$ and the ensuing zero-field spin gap $\Delta_{0}/k_{\rm B} \simeq 2.4$~K directly probed by field-dependent magnetization measurements. No long-range order is observed down to 50\,mK in zero field. However, applied fields above the critical field $H_{c1}\simeq 1.6$\,T give rise to a magnetic ordering transition with the phase boundary $T_{\rm N} \propto {(H - H_{\rm c1})^{\frac{1}{\phi}}}$, where $\phi \simeq 1.8$ is close to the value expected for Bose-Einstein condensation of triplons. With its weak alternation of the exchange couplings and small spin gap, NaVOPO$_4$ lies close to the quantum critical point.


title: Asymptotic dynamics of three-dimensional bipolar ultrashort electromagnetic pulses in an array of semiconductor carbon nanotubes

abstract: We study the propagation of three-dimensional bipolar ultrashort electromagnetic pulses in an array of semiconductor carbon nanotubes at times much longer than the pulse duration, yet still shorter than the relaxation time in the system. The interaction of the electromagnetic field with the electronic subsystem of the medium is described by means of Maxwell's equations, taking into account the field inhomogeneity along the nanotube axis beyond the approximation of slowly varying amplitudes and phases. A model is proposed for the analysis of the dynamics of an electromagnetic pulse in the form of an effective equation for the vector potential of the field. Our numerical analysis demonstrates the possibility of a satisfactory description of the evolution of the pulse field at large times by means of a three-dimensional generalization of the sine-Gordon and double sine-Gordon equations.


title: From perception to control: an autonomous driving system for a formula student driverless car

abstract: This paper introduces the autonomous system of the "Smart Shark II" which won the Formula Student Autonomous China (FSAC) Competition in 2018. In this competition, an autonomous racecar is required to complete autonomously two laps of unknown track. In this paper, the author presents the self-driving software structure of this racecar which ensure high vehicle speed and safety. The key components ensure a stable driving of the racecar, LiDAR-based and Vision-based cone detection provide a redundant perception; the EKF-based localization offers high accuracy and high frequency state estimation; perception results are accumulated in time and space by occupancy grid map. After getting the trajectory, a model predictive control algorithm is used to optimize in both longitudinal and lateral control of the racecar. Finally, the performance of an experiment based on real-world data is shown.


title: Discovery of an unusually compact lensed Lyman Break Galaxy from the Hyper Suprime-Cam Survey

abstract: We report the serendipitous discovery of HSC J0904$-$0102, a quadruply-lensed Lyman break galaxy (LBG) in the Survey of Gravitationally-lensed Objects in Hyper Suprime-Cam Imaging (SuGOHI). Owing to its point-like appearance, the source was thought to be a lensed active galactic nucleus. We obtained follow-up spectroscopic data with the Gemini Multi-Object Spectrographs on the Gemini South Telescope, which confirmed this to be a lens system. The deflecting foreground galaxy is a typical early-type galaxy at a high redshift of $z_{\ell} = 0.957$ with stellar velocity dispersion $\sigma_v=259\pm56$ km~s$^{-1}$. The lensed source is identified as an LBG at $z_{\rm s} = 3.403$, based on the sharp drop bluewards of Ly$\alpha$ and other absorption features. A simple lens mass model for the system, assuming a singular isothermal ellipsoid, yields an Einstein radius of $\theta_{\rm Ein} = 1. 23^{\prime\prime}$ and a total mass within the Einstein radius of $M_{\rm Ein} = (5.55\pm 0.24) \times 10^{11}M_{\odot}$ corresponding to a velocity dispersion of $\sigma_{\rm SIE}= 283\pm 3$ km~s$^{-1}$, which is in good agreement with the value derived spectroscopically. The most isolated lensed LBG image has a magnification of $\sim 6.5$. In comparison with other lensed LBGs and typical $z\sim4$ LBG populations, HSC J0904$-$0102 is unusually compact, an outlier at $>2\sigma$ confidence. Together with a previously discovered SuGOHI lens, HSC J1152$+$0047, that is similarly compact, we believe that the HSC Survey is extending LBG studies down to smaller galaxy sizes.


title: A Semantics-Assisted Video Captioning Model Trained with Scheduled Sampling

abstract: Given the features of a video, recurrent neural networks can be used to automatically generate a caption for the video. Existing methods for video captioning have at least three limitations. First, semantic information has been widely applied to boost the performance of video captioning models, but existing networks often fail to provide meaningful semantic features. Second, the Teacher Forcing algorithm is often utilized to optimize video captioning models, but during training and inference, different strategies are applied to guide word generation, leading to poor performance. Third, current video captioning models are prone to generate relatively short captions that express video contents inappropriately. Toward resolving these three problems, we suggest three corresponding improvements. First of all, we propose a metric to compare the quality of semantic features, and utilize appropriate features as input for a semantic detection network (SDN) with adequate complexity in order to generate meaningful semantic features for videos. Then, we apply a scheduled sampling strategy that gradually transfers the training phase from a teacher-guided manner toward a more self-teaching manner. Finally, the ordinary logarithm probability loss function is leveraged by sentence length so that the inclination of generating short sentences is alleviated. Our model achieves better results than previous models on the YouTube2Text dataset and is competitive with the previous best model on the MSR-VTT dataset.


title: HM-NAS: Efficient Neural Architecture Search via Hierarchical Masking

abstract: The use of automatic methods, often referred to as Neural Architecture Search (NAS), in designing neural network architectures has recently drawn considerable attention. In this work, we present an efficient NAS approach, named HM- NAS, that generalizes existing weight sharing based NAS approaches. Existing weight sharing based NAS approaches still adopt hand-designed heuristics to generate architecture candidates. As a consequence, the space of architecture candidates is constrained in a subset of all possible architectures, making the architecture search results sub-optimal. HM-NAS addresses this limitation via two innovations. First, HM-NAS incorporates a multi-level architecture encoding scheme to enable searching for more flexible network architectures. Second, it discards the hand-designed heuristics and incorporates a hierarchical masking scheme that automatically learns and determines the optimal architecture. Compared to state-of-the-art weight sharing based approaches, HM-NAS is able to achieve better architecture search performance and competitive model evaluation accuracy. Without the constraint imposed by the hand-designed heuristics, our searched networks contain more flexible and meaningful architectures that existing weight sharing based NAS approaches are not able to discover.


title: Improved pion mean fields and masses of singly heavy baryons

abstract: A singly heavy baryon can be viewed as $N_c-1$ ($N_c$ as the number of colors) light valence quarks bound by the pion mean fields that are created by the presence of the $N_c-1$ valence quarks self-consistently, while the heavy quark inside a singly heavy baryon is regarded as a static color source. We investigate how the pion mean fields are created by the presence of $N_c$, $N_c-1$, and $N_c-2$ light valence quarks, which correspond to the systems of light baryons, singly heavy baryons, and doubly heavy baryons. As the number of color decreases from $N_c$ to $N_c-1$, the pion mean fields undergo changes. As a result, the valence-quark contributions to the moments of inertia of the soliton become larger than the case of the $N_c$ valence quarks, whereas the sea-quark contributions decrease systematically. On the other hand, the presence of the $N_c-2$ valence quarks is not enough to produce the strong pion mean fields, which leads to the fact that the classical soliton can not be formed. It indicates that the pion mean-field approach is not suitable to describe doubly heavy baryons. We show that the mass spectra of the singly heavy baryons are better described by the improved pion mean fields, compared with the previous work in which the pion mean fields are assumed to be intact with $N_c$ varied.


title: Learning with Noisy Labels for Sentence-level Sentiment Classification

abstract: Deep neural networks (DNNs) can fit (or even over-fit) the training data very well. If a DNN model is trained using data with noisy labels and tested on data with clean labels, the model may perform poorly. This paper studies the problem of learning with noisy labels for sentence-level sentiment classification. We propose a novel DNN model called NetAb (as shorthand for convolutional neural Networks with Ab-networks) to handle noisy labels during training. NetAb consists of two convolutional neural networks, one with a noise transition layer for dealing with the input noisy labels and the other for predicting 'clean' labels. We train the two networks using their respective loss functions in a mutual reinforcement manner. Experimental results demonstrate the effectiveness of the proposed model.


title: Detecting floodwater on roadways from image data with handcrafted features and deep transfer learning

abstract: Detecting roadway segments inundated due to floodwater has important applications for vehicle routing and traffic management decisions. This paper proposes a set of algorithms to automatically detect floodwater that may be present in an image captured by mobile phones or other types of optical cameras. For this purpose, image classification and flood area segmentation methods are developed. For the classification task, we used Local Binary Patterns (LBP), Histogram of Oriented Gradients (HOG) and pre-trained deep neural network (VGG-16) as feature extractors and trained logistic regression, k-nearest neighbors, and decision tree classifiers on the extracted features. Pre-trained VGG-16 network with logistic regression classifier outperformed all other methods. For the flood area segmentation task, we investigated superpixel based methods and Fully Convolutional Neural Network (FCN). Similar to the classification task, we trained logistic regression and k-nearest neighbors classifiers on the superpixel areas and compared that with an end-to-end trained FCN. Conditional Random Fields (CRF) method was applied after both segmentation methods to post-process coarse segmentation results. FCN offered the highest scores in all metrics; it was followed by superpixel-based logistic regression and then superpixel-based KNN.


title: A Logic-Driven Framework for Consistency of Neural Models

abstract: While neural models show remarkable accuracy on individual predictions, their internal beliefs can be inconsistent across examples. In this paper, we formalize such inconsistency as a generalization of prediction error. We propose a learning framework for constraining models using logic rules to regularize them away from inconsistency. Our framework can leverage both labeled and unlabeled examples and is directly compatible with off-the-shelf learning schemes without model redesign. We instantiate our framework on natural language inference, where experiments show that enforcing invariants stated in logic can help make the predictions of neural models both accurate and consistent.


title: Intense boundary emission destroys normal radio-frequency plasma sheath

abstract: Plasma sheath is the non-neutral space charge region that isolates bulk plasma from boundary. Radio-frequency (RF) sheathes are formed when applying RF voltage to electrodes. Generally, applied bias is mainly consumed by RF sheath which shields external field. Here we report first evidence that intense boundary emission destroys normal RF sheath and establishes a novel type of RF plasma where external bias is consumed by bulk plasma instead of sheath. Ions are naturally confined while plasma electrons are unobstructed, generating strong RF current in entire plasma, combined with unique particle and energy balance. Proposed model offers possibility for ion erosion mitigation of plasma-facing component. It also inspires technics for reaction rate control in plasma processing and wave mode conversion.


title: A new family of homogeneous Einstein manifolds based on symplectic triple systems

abstract: For each simple symplectic triple system over the real numbers, the standard enveloping Lie algebra and the algebra of inner derivations of the triple provide a reductive pair related to a semi-Riemannian homogeneous manifold. It is proved that this is an Einstein manifold.


title: Scattering of electronic waves in square and triangular lattice half-planes with monoatomic step

abstract: Scattering of electronic waves in square and triangular lattice half-planes by a step on the surface is analyzed using the nearest-neighbour tight binding approximation. The changes in lattice spacing and the transfer integral between nearest-neighbor sites near the surface are ignored. A standard application of the discrete Wiener-Hopf method leads to an exact solution of the scattering problem associated with incidence from the `bulk'. A far-field approximation of electronic wavefunction, as well as its graphical comparison with a numerical solution, are also provided. Natural applications and possible extensions are based on the bulk Brillouin zone for two dimensional lattice planes as well as surface energy bands for fcc crystals.


title: A decision problem for bank branch site selection: A GIS Mapping perspective with Maximal Covering Location Problem: A case study of Isfahan, Iran

abstract: One of the most significant decision-making processes is the site selection. If the site correctly selected, the access for the best customers as well as the greatest market potential would be guaranteed. Bank branch optimal location is one of the most significant strategic issues in the competitive market especially for private banks because of the global competition and high customer expectations. This study presents a Geographic Information System (GIS) based model for locating suitable sites for making new branches by using data sources. Also, Maximal Covering Location Problem (MCLP) was used to select branches that the maximum demand might be reached within a pre-specified target travel time. The model was implemented for Ansar bank in Isfahan, Iran. The criteria were restricted through demographic attributes, competition, transportation, flexibility and cost in GIS mapping approach. Finally, the results illustrated the efficiency and applicability of the proposed integrated method.


title: Evaluating Pronominal Anaphora in Machine Translation: An Evaluation Measure and a Test Suite

abstract: The ongoing neural revolution in machine translation has made it easier to model larger contexts beyond the sentence-level, which can potentially help resolve some discourse-level ambiguities such as pronominal anaphora, thus enabling better translations. Unfortunately, even when the resulting improvements are seen as substantial by humans, they remain virtually unnoticed by traditional automatic evaluation measures like BLEU, as only a few words end up being affected. Thus, specialized evaluation measures are needed. With this aim in mind, we contribute an extensive, targeted dataset that can be used as a test suite for pronoun translation, covering multiple source languages and different pronoun errors drawn from real system translations, for English. We further propose an evaluation measure to differentiate good and bad pronoun translations. We also conduct a user study to report correlations with human judgments.


title: Large Effects of Particle Size Heterogeneity on Dynamic Saltation Threshold

abstract: Reliably predicting the geomorphology and climate of planetary bodies requires knowledge of the dynamic threshold wind shear velocity below which saltation transport ceases. Here we measure this threshold in a wind tunnel for four well-sorted and two poorly sorted sand beds by visual means and by a method that exploits a regime shift in the behavior of the surface roughness caused by momentum transfer from the wind to the saltating particles. For our poorly sorted sands, we find that these measurement methods yield different threshold values because, at the smaller visual threshold, relatively coarse particles do not participate in saltation. We further find that both methods yield threshold values that are much larger (60--250\%) for our poorly sorted sands than for our well-sorted sands with similar median particle diameter. In particular, even a rescaling of the dynamic saltation threshold based on the 90th percentile particle diameter rather than the median diameter cannot fully capture this difference, suggesting that relatively very coarse particles have a considerable control on the dynamic threshold. Similar findings were previously reported for water-driven sediment transport. Our findings have important implications for quantitative predictions of saltation transport-related geophysical processes, such as dust aerosol emission.


title: Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmark

abstract: Substantial efforts have been devoted more recently to presenting various methods for object detection in optical remote sensing images. However, the current survey of datasets and deep learning based methods for object detection in optical remote sensing images is not adequate. Moreover, most of the existing datasets have some shortcomings, for example, the numbers of images and object categories are small scale, and the image diversity and variations are insufficient. These limitations greatly affect the development of deep learning based object detection methods. In the paper, we provide a comprehensive review of the recent deep learning based object detection progress in both the computer vision and earth observation communities. Then, we propose a large-scale, publicly available benchmark for object DetectIon in Optical Remote sensing images, which we name as DIOR. The dataset contains 23463 images and 192472 instances, covering 20 object classes. The proposed DIOR dataset 1) is large-scale on the object categories, on the object instance number, and on the total image number; 2) has a large range of object size variations, not only in terms of spatial resolutions, but also in the aspect of inter- and intra-class size variability across objects; 3) holds big variations as the images are obtained with different imaging conditions, weathers, seasons, and image quality; and 4) has high inter-class similarity and intra-class diversity. The proposed benchmark can help the researchers to develop and validate their data-driven methods. Finally, we evaluate several state-of-the-art approaches on our DIOR dataset to establish a baseline for future research.


title: Scraping Social Media Photos Posted in Kenya and Elsewhere to Detect and Analyze Food Types

abstract: Monitoring population-level changes in diet could be useful for education and for implementing interventions to improve health. Research has shown that data from social media sources can be used for monitoring dietary behavior. We propose a scrape-by-location methodology to create food image datasets from Instagram posts. We used it to collect 3.56 million images over a period of 20 days in March 2019. We also propose a scrape-by-keywords methodology and used it to scrape ~30,000 images and their captions of 38 Kenyan food types. We publish two datasets of 104,000 and 8,174 image/caption pairs, respectively. With the first dataset, Kenya104K, we train a Kenyan Food Classifier, called KenyanFC, to distinguish Kenyan food from non-food images posted in Kenya. We used the second dataset, KenyanFood13, to train a classifier KenyanFTR, short for Kenyan Food Type Recognizer, to recognize 13 popular food types in Kenya. The KenyanFTR is a multimodal deep neural network that can identify 13 types of Kenyan foods using both images and their corresponding captions. Experiments show that the average top-1 accuracy of KenyanFC is 99% over 10,400 tested Instagram images and of KenyanFTR is 81% over 8,174 tested data points. Ablation studies show that three of the 13 food types are particularly difficult to categorize based on image content only and that adding analysis of captions to the image analysis yields a classifier that is 9 percent points more accurate than a classifier that relies only on images. Our food trend analysis revealed that cakes and roasted meats were the most popular foods in photographs on Instagram in Kenya in March 2019.


title: Discriminants of Fields Generated by Polynomials of Given Height

abstract: We obtain upper bounds for the number of monic irreducible polynomials over $\mathbb Z$ of a fixed degree $n$ and a growing height $H$ for which the field generated by one of its roots has a given discriminant. We approach it via counting square-free parts of polynomial discriminants via two complementing approaches. In turn, this leads to a lower bound on the number of distinct discriminants of fields generated by roots of polynomials of degree $n$ and height at most $H$. We also give an upper bound for the number of trinomials of bounded height with given square-free part of the discriminant, improving previous results of I. E. Shparlinski (2010).


title: Modeling Graph Structure in Transformer for Better AMR-to-Text Generation

abstract: Recent studies on AMR-to-text generation often formalize the task as a sequence-to-sequence (seq2seq) learning problem by converting an Abstract Meaning Representation (AMR) graph into a word sequence. Graph structures are further modeled into the seq2seq framework in order to utilize the structural information in the AMR graphs. However, previous approaches only consider the relations between directly connected concepts while ignoring the rich structure in AMR graphs. In this paper we eliminate such a strong limitation and propose a novel structure-aware self-attention approach to better modeling the relations between indirectly connected concepts in the state-of-the-art seq2seq model, i.e., the Transformer. In particular, a few different methods are explored to learn structural representations between two concepts. Experimental results on English AMR benchmark datasets show that our approach significantly outperforms the state of the art with 29.66 and 31.82 BLEU scores on LDC2015E86 and LDC2017T10, respectively. To the best of our knowledge, these are the best results achieved so far by supervised models on the benchmarks.


title: EntEval: A Holistic Evaluation Benchmark for Entity Representations

abstract: Rich entity representations are useful for a wide class of problems involving entities. Despite their importance, there is no standardized benchmark that evaluates the overall quality of entity representations. In this work, we propose EntEval: a test suite of diverse tasks that require nontrivial understanding of entities including entity typing, entity similarity, entity relation prediction, and entity disambiguation. In addition, we develop training techniques for learning better entity representations by using natural hyperlink annotations in Wikipedia. We identify effective objectives for incorporating the contextual information in hyperlinks into state-of-the-art pretrained language models and show that they improve strong baselines on multiple EntEval tasks.