title: VAEM: a Deep Generative Model for Heterogeneous Mixed Type Data

abstract: Deep generative models often perform poorly in real-world applications due to the heterogeneity of natural data sets. Heterogeneity arises from data containing different types of features (categorical, ordinal, continuous, etc.) and features of the same type having different marginal distributions. We propose an extension of variational autoencoders (VAEs) called VAEM to handle such heterogeneous data. VAEM is a deep generative model that is trained in a two stage manner such that the first stage provides a more uniform representation of the data to the second stage, thereby sidestepping the problems caused by heterogeneous data. We provide extensions of VAEM to handle partially observed data, and demonstrate its performance in data generation, missing data prediction and sequential feature selection tasks. Our results show that VAEM broadens the range of real-world applications where deep generative models can be successfully deployed.


title: Generalisation Guarantees for Continual Learning with Orthogonal Gradient Descent

abstract: In Continual Learning settings, deep neural networks are prone to Catastrophic Forgetting. Orthogonal Gradient Descent was proposed to tackle the challenge. However, no theoretical guarantees have been proven yet. We present a theoretical framework to study Continual Learning algorithms in the Neural Tangent Kernel regime. This framework comprises closed form expression of the model through tasks and proxies for Transfer Learning, generalisation and tasks similarity. In this framework, we prove that OGD is robust to Catastrophic Forgetting then derive the first generalisation bound for SGD and OGD for Continual Learning. Finally, we study the limits of this framework in practice for OGD and highlight the importance of the Neural Tangent Kernel variation for Continual Learning with OGD.


title: Spatio-Temporal Tensor Sketching via Adaptive Sampling

abstract: Mining massive spatio-temporal data can help a variety of real-world applications such as city capacity planning, event management, and social network analysis. The tensor representation can be used to capture the correlation between space and time and simultaneously exploit the latent structure of the spatial and temporal patterns in an unsupervised fashion. However, the increasing volume of spatio-temporal data has made it prohibitively expensive to store and analyze using tensor factorization. In this paper, we propose SkeTenSmooth, a novel tensor factorization framework that uses adaptive sampling to compress the tensor in a temporally streaming fashion and preserves the underlying global structure. SkeTenSmooth adaptively samples incoming tensor slices according to the detected data dynamics. Thus, the sketches are more representative and informative of the tensor dynamic patterns. In addition, we propose a robust tensor factorization method that can deal with the sketched tensor and recover the original patterns. Experiments on the New York City Yellow Taxi data show that SkeTenSmooth greatly reduces the memory cost and outperforms random sampling and fixed rate sampling method in terms of retaining the underlying patterns.


title: Assessing the accuracy of the GENIE event generator with electron-scattering data

abstract: Precision neutrino oscillation experiments of the future---of which DUNE is a prime example---require reliable event generator tools. The 1--4 GeV energy regime, in which DUNE will operate, is marked by the transition from the low-energy nuclear physics domain to that of perturbative QCD, resulting in rich and highly complex physics. Given this complexity, it is important to establish a validation procedure capable of disentangling the physical processes and testing each of them individually. Here, we demonstrate the utility of this approach by benchmarking the GENIE generator, currently used by all Fermilab-based experiments, against a broad set of inclusive electron-scattering data. This comparison takes advantage of the fact that, while electron-nucleus and neutrino-nucleus processes share a lot of common physics, electron scattering gives one access to precisely known beam energies and scattering kinematics. Exploring the kinematic parameter range relevant to DUNE in this manner, we observe patterns of large discrepancies between the generator and data. These discrepancies are most prominent in the pion-producing regimes and are present not only in medium-sized nuclei, including argon, but also in deuterium and hydrogen targets, indicating mismodeled hadronic physics. Several directions for possible improvement are discussed.


title: Eulerian Gaussian beams for high frequency wave propagation in inhomogeneous media of arbitrary anisotropy

abstract: We present the Eulerian Gaussian beam method in anisotropic media. We derive kinematic and dynamic ray tracing equations based on the level set theory and Eulerian theory using the anisotropic eikonal equation. Compared with the traditional anisotropic Gaussian beam method using ray-centered coordinates, the anisotropic Eulerian Gaussian beam method derived in this work has the following three advantages: (1) it can handle the problem of calculating the distance from the imaging point to the beam point more easily; (2) it allows the travel time and amplitude to be distributed uniformly within the actual computational domain without interpolation; (3) it can handle late arrivals, both theoretically and in calculations, due entirely to ray tracing in the phase space.


title: Light Commands: Laser-Based Audio Injection Attacks on Voice-Controllable Systems

abstract: We propose a new class of signal injection attacks on microphones by physically converting light to sound. We show how an attacker can inject arbitrary audio signals to a target microphone by aiming an amplitude-modulated light at the microphone's aperture. We then proceed to show how this effect leads to a remote voice-command injection attack on voice-controllable systems. Examining various products that use Amazon's Alexa, Apple's Siri, Facebook's Portal, and Google Assistant, we show how to use light to obtain control over these devices at distances up to 110 meters and from two separate buildings. Next, we show that user authentication on these devices is often lacking, allowing the attacker to use light-injected voice commands to unlock the target's smartlock-protected front doors, open garage doors, shop on e-commerce websites at the target's expense, or even unlock and start various vehicles connected to the target's Google account (e.g., Tesla and Ford). Finally, we conclude with possible software and hardware defenses against our attacks.


title: How to Count Triangles, without Seeing the Whole Graph

abstract: Triangle counting is a fundamental problem in the analysis of large graphs. There is a rich body of work on this problem, in varying streaming and distributed models, yet all these algorithms require reading the whole input graph. In many scenarios, we do not have access to the whole graph, and can only sample a small portion of the graph (typically through crawling). In such a setting, how can we accurately estimate the triangle count of the graph? We formally study triangle counting in the {\em random walk} access model introduced by Dasgupta et al (WWW '14) and Chierichetti et al (WWW '16). We have access to an arbitrary seed vertex of the graph, and can only perform random walks. This model is restrictive in access and captures the challenges of collecting real-world graphs. Even sampling a uniform random vertex is a hard task in this model. Despite these challenges, we design a provable and practical algorithm, TETRIS, for triangle counting in this model. TETRIS is the first provably sublinear algorithm (for most natural parameter settings) that approximates the triangle count in the random walk model, for graphs with low mixing time. Our result builds on recent advances in the theory of sublinear algorithms. The final sample built by TETRIS is a careful mix of random walks and degree-biased sampling of neighborhoods. Empirically, TETRIS accurately counts triangles on a variety of large graphs, getting estimates within 5\% relative error by looking at 3\% of the number of edges.


title: Density power divergence for general integer-valued time series with multivariate exogenous covariate

abstract: In this article, we study a robust estimation method for a general class of integer-valued time series models. The conditional distribution of the process belongs to a broad class of distribution and unlike classical autoregressive framework, the conditional mean of the process also depends on some multivariate exogenous covariate. We derive a robust inference procedure based on the minimum density power divergence. Under certain regularity conditions, we establish that the proposed estimator is consistent and asymptotically normal. Simulation experiments are conducted to illustrate the empirical performances of the estimator. An application to the number of transactions per minute for the stock Ericsson B is also provided.


title: On-shell mediator dark matter models and the Xenon1T anomaly

abstract: We present a dark matter model to explain the excess events in the electron recoil data recently reported by the Xenon1T experiment. In our model, dark matter $\chi$ annihilates into a pair of on-shell particles $\phi$ which subsequently decay into $\psi \psi$ final state; $\psi$ interacts with electron to generate the observed excess events. Due to the mass hierarchy, the velocity of $\psi$ can be rather large and can have an extended distribution, which provides a good fit to the electron recoil energy spectrum. We estimated the flux of $\psi$ from dark matter annihilations in the galaxy and further determined the interaction cross section which is sizable but small enough to allow $\psi$ to penetrate the rocks to reach the underground labs.


title: Prediction of short time qubit readout via measurement of the next quantum jump of a coupled damped driven harmonic oscillator

abstract: The dynamics of the next quantum jump for a qubit [two level system] coupled to a readout resonator [damped driven harmonic oscillator] is calculated. A quantum mechanical treatment of readout resonator reveals non exponential short time behavior which could facilitate detection of the state of the qubit faster than the resonator lifetime.


title: Dynamics of resonances for 0th order pseudodifferential operators

abstract: We study the dynamics of resonances of analytic perturbations of 0th order pseudodifferential operators $P(s)$. In particular, we prove a Fermi golden rule for resonances of $P(s)$ at embedded eigenvalues of $P=P(0)$. We also study the dynamics of eigenvalues of $P(t)=P+it\Delta$ as the eigenvalues converge to simple eigenvalues of $P$. The 0th order pseudodifferential operators we consider satisfy natural dynamical assumptions and are used as microlocal models of internal waves.


title: Fully-heavy tetraquark states and their evidences in the LHC observations

abstract: Stimulated by the exciting progress on the observations of the fully-charmed tetraquarks at LHC, we carry out a combined analysis of the mass spectra and fall-apart decays of the $1S$-, $2S$-, and $1P$-wave $cc\bar{c}\bar{c}$ states in a nonrelativistic quark model (NRQM). It is found that the $X(6600)$ structure observed in the di-$J/\psi$ invariant mass spectrum can be explained by the $1S$-wave state $T_{(4c)0^{++}}(6550)$. This structure may also bear some feed-down effects from the higher $2S$ and/or $1P$ tetraquark states. The $X(6900)$ structure observed in both the di-$J/\psi$ and $J/\psi \psi(2S)$ channels can be naturally explained by the $2S$-wave state $T_{(4c)0^{++}}(6957)$. The small shoulder structure around $6.2-6.4$ GeV observed at CMS and ATLAS may be due to the feed-down effects from some $1P$-wave states with $C=-1$ and/or some $2S$-wave states with $J^{PC}=0^{++}$. Other decay channels are implied in such a scenario and they can be investigated by future experimental analyses. Considering the large discovery potential at LHC, we also present predictions for the $bb\bar{b}\bar{b}$ states which can be searched for in the future.


title: A Probabilistic Framework for Optimizing Real-time Decisions in Humanitarian Aid Delivery Systems

abstract: This paper presents a computationally efficient model for optimizing real-time decisions in humanitarian aid delivery systems. Our formulation models a hierarchical system and is a mixed integer, probabilistic, non-linear and non-concave optimization problem. The proposed model considers the costs and probabilistic nature of transfer times and maximizes the reliability of the system using the available budget. We account for late deliveries using a nonlinear penalty function. We also propose an algorithm that uses a directed acyclic graph to deal with the discrete variables in tandem with a homotopy method for optimizing the continuous variables. We then offer a pruning method to eliminate the cost inefficiencies in the system. The effectiveness of formulation is examined in some numerical examples under progress.


title: Invariant subspace problem for rank-one perturbations: the quantitative version

abstract: We show that for any bounded operator $T$ acting on infinite dimensional, complex Banach space, and for any $\varepsilon>0$, there exists an operator $F$ of rank at most one and norm smaller than $\varepsilon$ such that $T+F$ has an invariant subspace of infinite dimension and codimension. A version of this result was proved in \cite{T19} under additional spectral conditions for $T$ or $T^*$. This solves in full generality the quantitative version of the invariant subspace problem for rank-one perturbations.


title: A Novel Epidemiological Approach to Geographically Mapping Population Dry Eye Disease in the United States through Google Trends

abstract: Dry eye disease (DED) affects approximately half of the United States population. DED is characterized by dryness on the corena surface due to a variety of causes. This study fills the spatiotemporal gaps in DED epidemiology by using Google Trends as a novel epidemiological tool for geographically mapping DED in relation to environmental risk factors. We utilized Google Trends to extract DED-related queries estimating user intent from 2004-2019 in the United States. We incorporated national climate data to generate heat maps comparing geographic, temporal, and environmental relationships of DED. Multi-variable regression models were constructed to generate quadratic forecasts predicting DED and control searches. Our results illustrated the upward trend, seasonal pattern, environmental influence, and spatial relationship of DED search volume across US geography. Localized patches of DED interest were visualized along the coastline. There was no significant difference in DED queries across US census regions. Regression model 1 predicted DED searches over time (R^2=0.97) with significant predictors being control queries (p=0.0024), time (p=0.001), and seasonality (Winter p=0.0028; Spring p<0.001; Summer p=0.018). Regression model 2 predicted DED queries per state (R^2=0.49) with significant predictors being temperature (p=0.0003) and coastal zone (p=0.025). Importantly, temperature, coastal status, and seasonality were stronger risk factors of DED searches than humidity, sunshine, pollution, or region as clinical literature may suggest. Our work paves the way for future exploration of geographic information systems for locating DED and other diseases via online search query metrics.


title: Effect of lattice inhomogeneity on collapsed phases of semi-stiff ISAW polymers

abstract: We investigate semi-stiff interacting self-avoiding walks on the square lattice with random impurities. The walks are simulated using the flatPERM algorithm and the inhomogeneity is realised as a random fraction of the lattice that is unavailable to the walks. We calculate several thermodynamic and metric quantities to map out the phase diagram and look at how the amount of disorder affects the properties of each phase. On a homogeneous lattice this model has an extended phase and two distinct collapsed phases, globular and crystalline, which differ in the anisotropy of the walks. By adding impurities to the lattice we notice a degree of swelling of the walks for all phases that is commensurate with the fraction of the lattice that is removed. Importantly, the crystal phase disappears with the addition of impurities for sufficiently long walks. For finite length walks we demonstrate that competition between the size of the average spaces free of impurities and the size of the collapsed polymer describes the crossover between the homogeneous lattice and the impurity dominated situation.


title: Searching for anisotropy in the distribution of binary black hole mergers

abstract: The standard model of cosmology is underpinned by the assumption of the statistical isotropy of the Universe. Observations of the cosmic microwave background, galaxy distributions, and supernovae, among other media, support the assumption of isotropy at scales $\gtrsim 100$\,Mpc. The recent detections of gravitational waves from merging stellar-mass binary black holes provide a new probe of anisotropy; complementary and independent of all other probes of the matter distribution in the Universe. We present an analysis using a spherical harmonic model to determine the level of anisotropy in the first LIGO/Virgo transient catalog. We find that the ten binary black hole mergers within the first transient catalog are consistent with an isotropic distribution. We carry out a study of simulated events to assess the prospects for future probes of anisotropy. Within a single year of operation, third-generation gravitational-wave observatories will probe anisotropies with an angular scale of $\sim36^\circ$ at the level of $\lesssim0.1\%$.


title: End-to-End Memristive HTM System for Pattern Recognition and Sequence Prediction

abstract: Neuromorphic systems that learn and predict from streaming inputs hold significant promise in pervasive edge computing and its applications. In this paper, a neuromorphic system that processes spatio-temporal information on the edge is proposed. Algorithmically, the system is based on hierarchical temporal memory that inherently offers online learning, resiliency, and fault tolerance. Architecturally, it is a full custom mixed-signal design with an underlying digital communication scheme and analog computational modules. Therefore, the proposed system features reconfigurability, real-time processing, low power consumption, and low-latency processing. The proposed architecture is benchmarked to predict on real-world streaming data. The network's mean absolute percentage error on the mixed-signal system is 1.129X lower compared to its baseline algorithm model. This reduction can be attributed to device non-idealities and probabilistic formation of synaptic connections. We demonstrate that the combined effect of Hebbian learning and network sparsity also plays a major role in extending the overall network lifespan. We also illustrate that the system offers 3.46X reduction in latency and 77.02X reduction in power consumption when compared to a custom CMOS digital design implemented at the same technology node. By employing specific low power techniques, such as clock gating, we observe 161.37X reduction in power consumption.


title: On the multicanonical systems of quasi-elliptic surfaces

abstract: We consider the multicanonical systems $\vert mK_{S}\vert$ of quasi-elliptic surfaces with Kodaira dimension $1$ in characteristic 2. We show that for any $m \geq 6$ $\vert mK_{S}\vert$ gives the structure of quasi-elliptic fiber space, and 6 is the best possible number to give the structure for any such surfaces.


title: Galkin's lower bound conjecture holds for the Grassmannian

abstract: Let Gr$(k,n)$ be the Grassmannian. The quantum multiplication by the first Chern class $c_1({\rm Gr}(k,n))$ induces an endomorphism $\hat c_1$ of the finite-dimensional vector space $\mathrm{QH}^*({\rm Gr}(k,n))_{|q=1}$ specialized at $q=1$. Our main result is a case that a conjecture by Galkin holds. It states that the largest real eigenvalue of $\hat{c}_1$ is greater than or equal to $\dim {\rm Gr}(k,n)$+1 with equality if and only if Gr$(k,n)=\mathbb{P}^{n-1}$.


title: Generalized neck analysis of harmonic maps from surfaces

abstract: In this paper, we study the behavior of a sequence of harmonic maps from surfaces with uniformly bounded energy on the generalized neck domain. The generalized neck domain is a union of ghost bubbles and annular neck domains, which connects non-trivial bubbles. An upper bound of the energy density is proved and we use it to study the limit of the nullity and index of the sequence.


title: Quantum-enhanced data classification with a variational entangled sensor network

abstract: Variational quantum circuits (VQCs) built upon noisy intermediate-scale quantum (NISQ) hardware, in conjunction with classical processing, constitute a promising architecture for quantum simulations, classical optimization, and machine learning. However, the required VQC depth to demonstrate a quantum advantage over classical schemes is beyond the reach of available NISQ devices. Supervised learning assisted by an entangled sensor network (SLAEN) is a distinct paradigm that harnesses VQCs trained by classical machine-learning algorithms to tailor multipartite entanglement shared by sensors for solving practically useful data-processing problems. Here, we report the first experimental demonstration of SLAEN and show an entanglement-enabled reduction in the error probability for classification of multidimensional radio-frequency signals. Our work paves a new route for quantum-enhanced data processing and its applications in the NISQ era.


title: A Mid-infrared Flare in the Active Galaxy MCG-02-04-026: Dust Echo of a Nuclear Transient Event

abstract: We report the discovery of a mid-infrared (MIR) flare using WISE data in the center of the nearby Seyfert 1.9 galaxy MCG-02-04-026. The MIR flare began in the first half of 2014, peaked around the end of 2015, and faded in 2017. During these years, energy more than $7\times10^{50}$ erg was released in the infrared, and the flare's MIR color was generally turning red. We detected neither optical nor ultraviolet (UV) variation corresponding to the MIR flare based on available data. We explained the MIR flare using a dust echo model in which the radiative transfer is involved. The MIR flare can be well explained as thermal reradiation from dust heated by UV-optical photons of a primary nuclear transient event. Although the transient event was not seen directly due to dust obscuration, we can infer that it may produce a total energy of at least $\sim10^{51}$ erg, most of which was released in less than $\sim$3 years. The nature of the transient event could be a stellar tidal disruption event by the central supermassive black hole (SMBH), or a sudden enhancement of the existing accretion flow onto the SMBH, or a supernova which was particularly bright.


title: Global small analytic solutions of MHD boundary layer equations

abstract: In this paper, we prove the global existence and the large time decay estimate of solutions to the two-dimensional MHD boundary layer equations with small initial data, which is analytical in the tangential variable. The main idea of the proof is motivated by that of \cite{PZ5}. The additional difficulties are: 1. there appears the magnetic field; 2. the far field here depends on the tangential variable; 3. the Reynolds number is different from magnetic Reynolds number. In particular, we solved an open question in \cite{XY19} concerning the large time existence of analytical solutions to the MHD boundary layer equations.


title: Bubble coalescence in worm-like micellar solutions

abstract: Surfactants in aqueous solutions self-assemble in the presence of salt, to form long, flexible worm-like micelles (WLM). WLM solutions exhibit viscoelastic properties and are used in many applications, such as for cosmetic products, drag reduction and hydraulic fracturing. The dynamics of bubbles in WLM solutions are important considerations for the stability of many of these products. In this manuscript, we investigate the thin film drainage dynamics leading up to the coalescence of bubbles in WLM solutions. The salts and surfactant type and concentrations were chosen so as to have the viscoelastic properties of the tested WLM solutions span over two orders of magnitude in moduli and relaxation times. The various stages in drainage and coalescence - the formation of a thick region at the apex - a dimple, the thinning and washout of this dimple and the final stages of drainage before rupture, are modified by the viscoelasticity of the wormlike micellar solutions. As a result of the unique viscoelastic properties of the WLM solutions, we also observe a number of interesting fluid dynamic phenomena during the drainage process including elastic recoil, thin film ripping and single-step terminal drainage.


title: The distances to molecular clouds in the fourth Galactic quadrant

abstract: Distance measurements to molecular clouds are essential and important. We present directly measured distances to 169 molecular clouds in the fourth quadrant of the Milky Way. Based on the near-infrared photometry from the Two Micron All Sky Survey and the Vista Variables in the Via Lactea Survey, we select red clump stars in the overlapping directions of the individual molecular clouds and infer the bin averaged extinction values and distances to these stars. We track the extinction versus distance profiles of the sightlines toward the clouds and fit them with Gaussian dust distribution models to find the distances to the clouds. We have obtained distances to 169 molecular clouds selected from Rice et al. The clouds range in distances between 2 and 11 kpc from the Sun. The typical internal uncertainties in the distances are less than 5 per cent and the systematic uncertainty is about 7 per cent. The catalogue presented in this work is one of the largest homogeneous catalogues of distant molecular clouds with the direct measurement of distances. Based on the catalogue, we have tested different spiral arm models from the literature.


title: Exploiting Weight Redundancy in CNNs: Beyond Pruning and Quantization

abstract: Pruning and quantization are proven methods for improving the performance and storage efficiency of convolutional neural networks (CNNs). Pruning removes near-zero weights in tensors and masks weak connections between neurons in neighbouring layers. Quantization reduces the precision of weights by replacing them with numerically similar values that require less storage. In this paper, we identify another form of redundancy in CNN weight tensors, in the form of repeated patterns of similar values. We observe that pruning and quantization both tend to drastically increase the number of repeated patterns in the weight tensors. We investigate several compression schemes to take advantage of this structure in CNN weight data, including multiple forms of Huffman coding, and other approaches inspired by block sparse matrix formats. We evaluate our approach on several well-known CNNs and find that we can achieve compaction ratios of 1.4x to 3.1x in addition to the saving from pruning and quantization.


title: A sparse code increases the speed and efficiency of neuro-dynamic programming for optimal control tasks with correlated inputs

abstract: Sparse codes in neuroscience have been suggested to offer certain computational advantages over other neural representations of sensory data. To explore this viewpoint, a sparse code is used to represent natural images in an optimal control task solved with neuro-dynamic programming, and its computational properties are investigated. The central finding is that when feature inputs to a linear network are correlated, an over-complete sparse code increases the memory capacity of the network in an efficient manner beyond that possible for any complete code with the same-sized input, and also increases the speed of learning the network weights. A complete sparse code is found to maximise the memory capacity of a linear network by decorrelating its feature inputs to transform the design matrix of the least-squares problem to one of full rank. It also conditions the Hessian matrix of the least-squares problem, thereby increasing the rate of convergence to the optimal network weights. Other types of decorrelating codes would also achieve this. However, an over-complete sparse code is found to be approximately decorrelated, extracting a larger number of approximately decorrelated features from the same-sized input, allowing it to efficiently increase memory capacity beyond that possible for any complete code: a 2.25 times over-complete sparse code is shown to at least double memory capacity compared with a complete sparse code using the same input. This is used in sequential learning to store a potentially large number of optimal control tasks in the network, while catastrophic forgetting is avoided using a partitioned representation, yielding a cost-to-go function approximator that generalizes over the states in each partition. Sparse code advantages over dense codes and local codes are also discussed.


title: Understanding the origin of extreme events in El Ni\~{n}o-Southern Oscillation

abstract: We investigate a low-dimensional slow-fast model to understand the dynamical origin of El Ni\~no-Southern Oscillation. A close inspection of the system dynamics using several bifurcation plots reveals that a sudden large expansion of the attractor occurs at a critical system parameter via a type of interior crisis. This interior crisis evolves through merging of a cascade of period-doubling and period-adding bifurcations that leads to the origin of occasional amplitude-modulated extremely large events. More categorically, a situation similar to homoclinic chaos arises near the critical point, however, atypical global instability evolves as a channel-like structure in phase space of the system that modulates variability of amplitude and return time of the occasional large events and makes a difference from the homoclinic chaos. The slow-fast timescale of the low-dimensional model plays an important role on the onset of occasional extremely large events. Such extreme events are characterized by their heights when they exceed a threshold level measured by a mean-excess function. The probability density of events' height displays multimodal distribution with an upper-bounded tail. We identify the dependence structure of interevent intervals to understand the predictability of return time of such extreme events using autoregressive integrated moving average model and box plot analysis.


title: A polynomial-time algorithm for learning nonparametric causal graphs

abstract: We establish finite-sample guarantees for a polynomial-time algorithm for learning a nonlinear, nonparametric directed acyclic graphical (DAG) model from data. The analysis is model-free and does not assume linearity, additivity, independent noise, or faithfulness. Instead, we impose a condition on the residual variances that is closely related to previous work on linear models with equal variances. Compared to an optimal algorithm with oracle knowledge of the variable ordering, the additional cost of the algorithm is linear in the dimension $d$ and the number of samples $n$. Finally, we compare the proposed algorithm to existing approaches in a simulation study.


title: Emerging Biometrics: Deep Inference and Other Computational Intelligence

abstract: This paper aims at identifying emerging computational intelligence trends for the design and modeling of complex biometric-enabled infrastructure and systems. Biometric-enabled systems are evolving towards deep learning and deep inference using the principles of adaptive computing, - the front tides of the modern computational intelligence domain. Therefore, we focus on intelligent inference engines widely deployed in biometrics. Computational intelligence applications that cover a wide spectrum of biometric tasks using physiological and behavioral traits are chosen for illustration. We highlight the technology gaps that must be addressed in future generations of biometric systems. The reported approaches and results primarily address the researchers who work towards developing the next generation of intelligent biometric-enabled systems.


title: Hippo: Taming Hyper-parameter Optimization of Deep Learning with Stage Trees

abstract: Hyper-parameter optimization is crucial for pushing the accuracy of a deep learning model to its limits. A hyper-parameter optimization job, referred to as a study, involves numerous trials of training a model using different training knobs, and therefore is very computation-heavy, typically taking hours and days to finish. We observe that trials issued from hyper-parameter optimization algorithms often share common hyper-parameter sequence prefixes. Based on this observation, we propose Hippo, a hyper-parameter optimization system that removes redundancy in the training process to reduce the overall amount of computation significantly. Instead of executing each trial independently as in existing hyper-parameter optimization systems, Hippo breaks down the hyper-parameter sequences into stages and merges common stages to form a tree of stages (called a stage-tree), then executes a stage once per tree on a distributed GPU server environment. Hippo is applicable to not only single studies, but multi-study scenarios as well, where multiple studies of the same model and search space can be formulated as trees of stages. Evaluations show that Hippo's stage-based execution strategy outperforms trial-based methods such as Ray Tune for several models and hyper-parameter optimization algorithms, reducing GPU-hours and end-to-end training time significantly.


title: On a theorem of Grove and Searle

abstract: A theorem of Grove and Searle directly establishes that positive curvature 2d manifolds M with effective circular symmetry group of dimension 8 or less have positive Euler characteristic X(M): the fixed point set N consists of even dimensional positive curvature manifolds and has the Euler characteristic X(N)=X(M). It is not empty by Berger. If N has a co-dimension 2 component, Grove-Searle forces M to be in { RP^2d,S^2d,CP^d }. By Frankel, there can be not two codimension 2 cases. In the remaining cases, Gauss-Bonnet-Chern forces all to have positive Euler characteristic. This simple proof does not quite reach the record 10 or less which uses methods of Wilking but it motivates to analyze the structure of fixed point components N and in particular to look at positive curvature manifolds which admit a U(1) or SU(2) symmetry with connected or almost connected fixed point set N. They have amazing geodesic properties: the fixed point manifold N agrees with the caustic of each of its points and the geodesic flow is integrable. In full generality, the Lefschetz fixed point property X(N)=X(M) and Frankel's dimension theorem dim(M) is less than dim(A) + dim(B) for two different connectivity components A,B of N produce already heavy constraints in building up M from smaller components. It is possible that S^2d, RP^2d, CP^d, HP^d, OP^2, W^6,E^6,W^12,W^24 are actually a complete list of even-dimensional positive curvature manifolds admitting a continuum symmetry. Aside from the projective spaces, the Euler characteristic of the known cases is always 1,2 or 6, where the jump from 2 to 6 happened with the Wallach or Eschenburg manifolds W^6,E^6 which have four fixed point components N=S^2 + S^2 + S^0, the only known case which are not of the Grove-Searle form N=N_1 or N=N_1 + p} with connected N_1.


title: A stripped-companion origin for Be stars: clues from the putative black holes HR 6819 and LB-1

abstract: HR 6819 is a bright ($V=5.36$), blue star recently proposed to be a triple containing a detached black hole (BH). We show that the system is a binary and does not contain a BH. Using spectral decomposition, we disentangle the observed composite spectra into two components: a rapidly rotating Be star and a slowly rotating B star with low surface gravity $(\log g \approx 2.75)$. Both stars show periodic radial velocity (RV) variability, but the RV semi-amplitude of the B star's orbit is $K_{\rm B}= (62.7 \pm 1)\,\rm km\,s^{-1}$, while that of the Be star is only $K_{\rm Be} = (4.5\pm 2)\,\rm km\,s^{-1}$. This implies that the B star is less massive by at least a factor of 10. The surface abundances of the B star bear imprints of CNO burning. We argue that the B star is a bloated, recently stripped helium star with mass $\approx 0.5\,M_{\odot}$ that is currently contracting to become a hot subdwarf. The orbital motion of the Be star obviates the need for a BH to explain the B star's motion. A stripped-star model reproduces the observed luminosity of the system, while a normal star with the B star's temperature and gravity would be more than 10 times too luminous. HR 6819 and the binary LB-1 probably formed through similar channels. We use MESA models to investigate their evolutionary history, finding that they likely formed from intermediate-mass ($3-7\,M_{\odot}$) primaries stripped by slightly lower-mass secondaries and are progenitors to Be + sdOB binaries such as $\phi$ Persei. The lifetime of their current evolutionary phase is on average $2\times 10^5$ years, of order half a percent of the total lifetime of the Be phase. This implies that many Be stars have hot subdwarf and white dwarf companions, and that a substantial fraction ($20-100\%$) of field Be stars form through accretion of material from a binary companion.


title: Toward the biological model of the hippocampus as the successor representation agent

abstract: The hippocampus is an essential brain region for spatial memory and learning. Recently, a theoretical model of the hippocampus based on temporal difference (TD) learning has been published. Inspired by the successor representation (SR) learning algorithms, which decompose value function of TD learning into reward and state transition, they argued that the rate of firing of CA1 place cells in the hippocampus represents the probability of state transition. This theory, called predictive map theory, claims that the hippocampus representing space learns the probability of transition from the current state to the future state. The neural correlates of expecting the future state are the firing rates of the CA1 place cells. This explanation is plausible for the results recorded in behavioral experiments, but it is lacking the neurobiological implications. Modifying the SR learning algorithm added biological implications to the predictive map theory. Similar with the simultaneous needs of information of the current and future state in the SR learning algorithm, the CA1 place cells receive two inputs from CA3 and entorhinal cortex. Mathematical transformation showed that the SR learning algorithm is equivalent to the heterosynaptic plasticity rule. The heterosynaptic plasticity phenomena in CA1 were discussed and compared with the modified SR update rule. This study attempted to interpret the TD algorithm as the neurobiological mechanism occurring in place learning, and to integrate the neuroscience and artificial intelligence approaches in the field.


title: From the Black-Karasinski to the Verhulst model to accommodate the unconventional Fed's policy

abstract: In this paper, we argue that some of the most popular short-term interest models have to be revisited and modified to reflect current market conditions better. In particular, we propose a modification of the popular Black-Karasinski model, which is widely used by practitioners for modeling interest rates, credit, and commodities. Our adjustment gives rise to the stochastic Verhulst model, which is well-known in the population dynamics and epidemiology as a logistic model. We demonstrate that the Verhulst model's dynamics are well suited to the current economic environment and the Fed's actions. Besides, we derive new integral equations for the zero-coupon bond prices for both the BK and Verhulst models. For the BK model for small maturities up to 2 years, we solve the corresponding integral equation by using the reduced differential transform method. For the Verhulst integral equation, under some mild assumptions, we find the closed-form solution. Numerical examples show that computationally our approach is significantly more efficient than the standard finite difference method.


title: Electron-phonon coupling superconductivity in 2D orthorhombic MB6 (M=Mg, Ca) and hexagonal MB6 (M=Mg, Ca, Sc, Ti, Sr, Y)

abstract: Combining crystal structure search and first-principles calculations, we report a series of two-dimensional (2D) metal borides including orthorhombic (ort-) MB6 (M=Mg, Ca) and hexagonal (hex-) MB6 (M=Mg, Ca, Sc, Ti, Sr, Y). Then, we investigate their geometrical structures, bonding properties, electronic structures, mechanical properties, phonon dispersions, thermal stability, dynamic stability, electron-phonon coupling (EPC), superconducting properties and so on. Our ab initio molecular dynamics simulation results show that these MB6 can maintain their original configurations up to 700/1000 K, indicating their excellent thermal stability. All their elastic constants satisfy the Born mechanically stable criteria and no visible imaginary frequencies are observed in their phonon dispersions. The EPC results show that these 2D MB6 are all intrinsic phonon-mediated superconductors with the superconducting transition temperature (Tc??) in the range of 2.2-21.3 K. Among them, the highest Tc (21.3 K) appears in hex-CaB6, whose EPC constant () is 0.94. By applying tensile/compressive strains on ort-/hex-CaB6, we find that the compressive strain can obviously soften the acoustic phonon branch and enhance the EPC as well as Tc. The Tc of the hex-CaB6 can be increased from 21.3 K to 28 K under compressive strain of 3%. These findings enrich the database of 2D superconductors and should stimulate experimental synthesizing and characterizing of 2D superconducting metal borides.


title: Fast Preprocessing for Optimal Orthogonal Range Reporting and Range Successor with Applications to Text Indexing

abstract: Under the word RAM model, we design three data structures that can be constructed in $O(n\sqrt{\lg n})$ time over $n$ points in an $n \times n$ grid. The first data structure is an $O(n\lg^{\epsilon} n)$-word structure supporting orthogonal range reporting in $O(\lg\lg n+k)$ time, where $k$ denotes output size and $\epsilon$ is an arbitrarily small constant. The second is an $O(n\lg\lg n)$-word structure supporting orthogonal range successor in $O(\lg\lg n)$ time, while the third is an $O(n\lg^{\epsilon} n)$-word structure supporting sorted range reporting in $O(\lg\lg n+k)$ time. The query times of these data structures are optimal when the space costs must be within $O(n\ polylog\ n)$ words. Their exact space bounds match those of the best known results achieving the same query times, and the $O(n\sqrt{\lg n})$ construction time beats the previous bounds on preprocessing. Previously, among 2d range search structures, only the orthogonal range counting structure of Chan and P\v{a}tra\c{s}cu (SODA 2010) and the linear space, $O(\lg^{\epsilon} n)$ query time structure for orthogonal range successor by Belazzougui and Puglisi (SODA 2016) can be built in the same $O(n\sqrt{\lg n})$ time. Hence our work is the first that achieve the same preprocessing time for optimal orthogonal range reporting and range successor. We also apply our results to improve the construction time of text indexes.


title: ELF: An Early-Exiting Framework for Long-Tailed Classification

abstract: The natural world often follows a long-tailed data distribution where only a few classes account for most of the examples. This long-tail causes classifiers to overfit to the majority class. To mitigate this, prior solutions commonly adopt class rebalancing strategies such as data resampling and loss reshaping. However, by treating each example within a class equally, these methods fail to account for the important notion of example hardness, i.e., within each class some examples are easier to classify than others. To incorporate this notion of hardness into the learning process, we propose the EarLy-exiting Framework(ELF). During training, ELF learns to early-exit easy examples through auxiliary branches attached to a backbone network. This offers a dual benefit-(1) the neural network increasingly focuses on hard examples, since they contribute more to the overall network loss; and (2) it frees up additional model capacity to distinguish difficult examples. Experimental results on two large-scale datasets, ImageNet LT and iNaturalist'18, demonstrate that ELF can improve state-of-the-art accuracy by more than 3 percent. This comes with the additional benefit of reducing up to 20 percent of inference time FLOPS. ELF is complementary to prior work and can naturally integrate with a variety of existing methods to tackle the challenge of long-tailed distributions.


title: Temperature- and Polarization- Dependent Optical Properties of Single Si2Te3 Nanoplates

abstract: We report a combined experimental and computational study of the optical properties of individual silicon telluride (Si2Te3) nanoplates. The p-type semiconductor Si2Te3 has a unique layered crystal structure with hexagonal closed-packed Te sublattices and Si-Si dimers occupying octahedral intercalation sites. The orientation of the silicon dimers leads to unique optical and electronic properties. Two-dimensional Si2Te3 nanoplates with thicknesses of hundreds of nanometers and lateral sizes of tens of micrometers are synthesized by a chemical vapor deposition technique. At temperatures below 150 K, the Si2Te3 nanoplates exhibit a direct band structure with a band gap energy of 2.394 eV at 7 K and an estimated free exciton binding energy of 150 meV. Polarized reflection measurements at different temperatures show anisotropy in the absorption coefficient due to an anisotropic orientation of the silicon dimers, which is in excellent agreement with theoretical calculations of the dielectric functions. Polarized Raman measurements of single Si2Te3 nanoplates at different temperatures reveal various vibrational modes, which agree with density functional perturbation theory calculations. The unique structural and optical properties of nanostructured Si2Te3 hold great potential applications in optoelectronics and chemical sensing.


title: Inference of chromospheric plasma parameters on the Sun

abstract: The solar chromosphere can be observed well through strong absorption lines. We infer the physical parameters of chromospheric plasmas from these lines using a multilayer spectral inversion. This is a new technique of spectral inversion. We assume that the atmosphere consists of a finite number of layers. In each layer the absorption profile is constant and the source function varies with optical depth with a constant gradient. Specifically, we consider a three-layer model of radiative transfer where the lowest layer is identified with the photosphere and the two upper layers are identified with the chromosphere. The absorption profile in the photosphere is described by a Voigt function, and the profile in the chromosphere by a Gaussian function. This three-layer model is fully specified by 13 parameters. Four parameters can be fixed to prescribed values, and one parameter can be determined from the analysis of a satellite photospheric line. The remaining 8 parameters are determined from a constrained least-squares fitting. We applied the multilayer spectral inversion to the spectral data of the H$\alpha$ and the Ca II 854.21 nm lines taken in a quiet region by the Fast Imaging Solar Spectrograph (FISS) of the Goode Solar Telescope (GST). We find that our model successfully fits most of the observed profiles and produces regular maps of the model parameters. The combination of the inferred Doppler widths of the two lines yields reasonable estimates of temperature and nonthermal speed in the chromosphere. We conclude that our multilayer inversion is useful to infer chromospheric plasma parameters on the Sun.


title: Electrically switchable hidden spin polarization in antiferroelectric crystals

abstract: Hidden spin polarization (HSP) emerges in centrosymmetric crystals where visible spin splittings in the real space can be observed because of the lack of inversion symmetry in each local sector. Starting from tight-binding models, we introduce nonsymmorphic antiferroelectric (AFE) crystals as a new class of functional materials that can exhibit strong local spin polarization. Such AFE crystals can be basically classified as in-plane and out-of-plane AFE configurations, and can be reversibly switched to the ferroelectric phase by an electric field to manifest global spin splittings, enabling a nonvolatile electrical control of spin-dependent properties. Based on first-principle calculations, we predict the realization of strong HSP in the AFE phase of a newly-discovered two-dimensional materials, quintuple-layer (QL) LiBiO$_2$. Furthermore, the spontaneous electric polarization ($\sim$ 0.3 nC/m) and the transition barrier as well as the tunable spin polarization of QL-LiBiO$_2$ are discussed.


title: Discrete-phase-randomized measurement-device-independent quantum key distribution

abstract: Measurement-device-independent quantum key distribution removes all detector-side attacks in quantum cryptography, and in the meantime doubles the secure distance. The source side, however, is still vulnerable to various attacks. In particular, the continuous phase randomization assumption on the source side is normally not fulfilled in experimental implementation and may potentially open a loophole. In this work, we first show that indeed there are loopholes for imperfect phase randomization in measurement-device-independent quantum key distribution by providing a concrete attack. Then we propose a discrete-phase-randomized measurement-device-independent quantum key distribution protocol as a solution to close this source-side loophole.


title: Constrained Combinatorial Optimization with Reinforcement Learning

abstract: This paper presents a framework to tackle constrained combinatorial optimization problems using deep Reinforcement Learning (RL). To this end, we extend the Neural Combinatorial Optimization (NCO) theory in order to deal with constraints in its formulation. Notably, we propose defining constrained combinatorial problems as fully observable Constrained Markov Decision Processes (CMDP). In that context, the solution is iteratively constructed based on interactions with the environment. The model, in addition to the reward signal, relies on penalty signals generated from constraint dissatisfaction to infer a policy that acts as a heuristic algorithm. Moreover, having access to the complete state representation during the optimization process allows us to rely on memory-less architectures, enhancing the results obtained in previous sequence-to-sequence approaches. Conducted experiments on the constrained Job Shop and Resource Allocation problems prove the superiority of the proposal for computing rapid solutions when compared to classical heuristic, metaheuristic, and Constraint Programming (CP) solvers.


title: Polyacrylonitrile/Graphene Nanocomposite: Towards the Next Generation of Carbon Fibers

abstract: Carbon Fibers (CFs) are the key solution for the future lightweight vehicle with enhanced fuel efficiency and reduced emissions owing to their ultrahigh strength to weight ratio. However, the high cost of the current dominant PAN-based CFs hinders their application. The use of low-cost alternative precursors may overcome this issue. Unfortunately, low-cost CFs derived from cheaper single component precursors suffer from poor mechanical properties. Developing composite CFs by adding nanoadditives is very promising for low-cost CFs. Therefore, a fundamental understanding of carbonization condition impacts and polymer/additives conversion mechanisms during whole CF production are essential to develop low-cost CFs. In this work, we have demonstrated how the carbonization temperature affects the PAN/graphene CFs properties by performing a series of ReaxFF based molecular dynamics simulations. We found that graphene edges along with the nitrogen and oxygen functional groups have a catalytic role and act as seeds for the graphitic structure growth. Our MD simulations unveil that the addition of the graphene to PAN precursor modifies all-carbon membered rings in CFs and enhances the alignments of 6-member carbon rings in carbonization which leads to superior mechanical properties compare to PAN-based CFs. These ReaxFF simulation results are validates by experimental structural and mechanical characterizations. Interestingly, mechanical characterizations indicate that PAN/graphene CFs carbonized at 1250 C demonstrate 90.9% increase in strength and 101.9% enhancement in Young's modulus compare to the PAN-based CFs carbonized at 1500 C. The superior mechanical properties of PAN/graphene CFs at lower carbonization temperatures offers a path to both energy savings and cost reduction by decreasing the carbonization temperature and could provide key insights for the development of low-cost CFs.


title: Bayesian Quadrature Optimization for Probability Threshold Robustness Measure

abstract: In many product development problems, the performance of the product is governed by two types of parameters called design parameter and environmental parameter. While the former is fully controllable, the latter varies depending on the environment in which the product is used. The challenge of such a problem is to find the design parameter that maximizes the probability that the performance of the product will meet the desired requisite level given the variation of the environmental parameter. In this paper, we formulate this practical problem as active learning (AL) problems and propose efficient algorithms with theoretically guaranteed performance. Our basic idea is to use Gaussian Process (GP) model as the surrogate model of the product development process, and then to formulate our AL problems as Bayesian Quadrature Optimization problems for probabilistic threshold robustness (PTR) measure. We derive credible intervals for the PTR measure and propose AL algorithms for the optimization and level set estimation of the PTR measure. We clarify the theoretical properties of the proposed algorithms and demonstrate their efficiency in both synthetic and real-world product development problems.


title: Optimal design of a bilayer for the highest thermal resistance: A lesson learned from the shells of snails from hydrothermal extreme environment

abstract: Inspired by the unique design of the shells of snails inhabiting the deep-sea hydrothermal environment, here we theoretically study the temperature response of a bilayer to an external thermal impulse. A semi-analytical solution to the temperature field in the bilayer is obtained, allowing us to assess the peak temperature that occurs on the inner wall as a quantitative indicator of the thermal resistance of the bilayer. The structural determining factors of the thermal resistance of a bilayer are then investigated by examining the effects of the stacking sequence and volume fractions of the constitutive layers on the peak temperature on the inner wall. Our results indicate that the stacking sequence of the two layers in a bilayer, as well as their volume fractions, play important roles in determining the thermal resistance. For two layers with given materials, there exists an optimal stacking sequence and thickness ratio giving rise to the best thermal resistance. The results of our work not only account for the unique laminated design of the snail shells from hydrothermal environments but also provide practical guidelines for the design of multilayer thermal barriers in engineering.


title: COVID-19 Image Data Collection: Prospective Predictions Are the Future

abstract: Across the world's coronavirus disease 2019 (COVID-19) hot spots, the need to streamline patient diagnosis and management has become more pressing than ever. As one of the main imaging tools, chest X-rays (CXRs) are common, fast, non-invasive, relatively cheap, and potentially bedside to monitor the progression of the disease. This paper describes the first public COVID-19 image data collection as well as a preliminary exploration of possible use cases for the data. This dataset currently contains hundreds of frontal view X-rays and is the largest public resource for COVID-19 image and prognostic data, making it a necessary resource to develop and evaluate tools to aid in the treatment of COVID-19. It was manually aggregated from publication figures as well as various web based repositories into a machine learning (ML) friendly format with accompanying dataloader code. We collected frontal and lateral view imagery and metadata such as the time since first symptoms, intensive care unit (ICU) status, survival status, intubation status, or hospital location. We present multiple possible use cases for the data such as predicting the need for the ICU, predicting patient survival, and understanding a patient's trajectory during treatment. Data can be accessed here: https://github.com/ieee8023/covid-chestxray-dataset


title: Global Image Sentiment Transfer

abstract: Transferring the sentiment of an image is an unexplored research topic in the area of computer vision. This work proposes a novel framework consisting of a reference image retrieval step and a global sentiment transfer step to transfer sentiments of images according to a given sentiment tag. The proposed image retrieval algorithm is based on the SSIM index. The retrieved reference images by the proposed algorithm are more content-related against the algorithm based on the perceptual loss. Therefore can lead to a better image sentiment transfer result. In addition, we propose a global sentiment transfer step, which employs an optimization algorithm to iteratively transfer sentiment of images based on feature maps produced by the Densenet121 architecture. The proposed sentiment transfer algorithm can transfer the sentiment of images while ensuring the content structure of the input image intact. The qualitative and quantitative experiments demonstrate that the proposed sentiment transfer framework outperforms existing artistic and photorealistic style transfer algorithms in making reliable sentiment transfer results with rich and exact details.


title: The decaying and scattering properties of the $d^*$(2380) hexaquark Bose Einstein Condensate dark matter

abstract: Recently, a study has shown that the Bose Einstein Condensates formed by the $d^*$(2380) hexaquarks ($d^*$(2380)-BECs) can be thermally produced in the early universe and they are stable enough to be a competitive candidate of dark matter. Searching for the decaying signature of $d^*$(2380)-BECs is a possible way to verify this dark matter model. In this article, we discuss the scattering and decaying properties of the $d^*$(2380)-BECs and we show that the decay rate of the $d^*$(2380)-BECs is correlated with the TeV cosmic-ray flux. The predicted average decay rate in our Galaxy is several orders of magnitude larger than the current observed upper limit. Therefore, it would be very difficult for us to search for the decaying signature of the $d^*$(2380)-BEC dark matter model. Nevertheless, the size of the $d^*$(2380)-BECs may be large enough to have self-interaction so that we can possibly detect them in the future.


title: Students Need More Attention: BERT-based AttentionModel for Small Data with Application to AutomaticPatient Message Triage

abstract: Small and imbalanced datasets commonly seen in healthcare represent a challenge when training classifiers based on deep learning models. So motivated, we propose a novel framework based on BioBERT (Bidirectional Encoder Representations from Transformers forBiomedical TextMining). Specifically, (i) we introduce Label Embeddings for Self-Attention in each layer of BERT, which we call LESA-BERT, and (ii) by distilling LESA-BERT to smaller variants, we aim to reduce overfitting and model size when working on small datasets. As an application, our framework is utilized to build a model for patient portal message triage that classifies the urgency of a message into three categories: non-urgent, medium and urgent. Experiments demonstrate that our approach can outperform several strong baseline classifiers by a significant margin of 4.3% in terms of macro F1 score. The code for this project is publicly available at \url{https://github.com/shijing001/text_classifiers}.


title: NOVAS: Non-convex Optimization via Adaptive Stochastic Search for End-to-End Learning and Control

abstract: In this work we propose the use of adaptive stochastic search as a building block for general, non-convex optimization operations within deep neural network architectures. Specifically, for an objective function located at some layer in the network and parameterized by some network parameters, we employ adaptive stochastic search to perform optimization over its output. This operation is differentiable and does not obstruct the passing of gradients during backpropagation, thus enabling us to incorporate it as a component in end-to-end learning. We study the proposed optimization module's properties and benchmark it against two existing alternatives on a synthetic energy-based structured prediction task, and further showcase its use in stochastic optimal control applications.


title: Computational Enhancement of Molecularly Targeted Contrast-Enhanced Ultrasound: Application to Human Breast Tumor Imaging

abstract: Molecularly targeted contrast enhanced ultrasound (mCEUS) is a clinically promising approach for early cancer detection through targeted imaging of VEGFR2 (KDR) receptors. We have developed computational enhancement techniques for mCEUS tailored to address the unique challenges of imaging contrast accumulation in humans. These techniques utilize dynamic analysis to distinguish molecularly bound contrast agent from other contrast-mode signal sources, enabling analysis of contrast agent accumulation to be performed during contrast bolus arrival when the signal due to molecular binding is strongest. Applied to the 18 human patient examinations of the first-in-human molecular ultrasound breast lesion study, computational enhancement improved the ability to differentiate between pathology-proven lesion and pathology-proven normal tissue in real-world human examination conditions that involved both patient and probe motion, with improvements in contrast ratio between lesion and normal tissue that in most cases exceed an order of magnitude (10x). Notably, computational enhancement eliminated a false positive result in which tissue leakage signal was misinterpreted by radiologists to be contrast agent accumulation.


title: On a Transmission Problem Related to Models of Electrocardiology

abstract: We a generalization of transmission problems for elliptic matrix operators related to the mathematical models of cardiology. We indicate sufficient conditions providing that the approach elaborated for scalar elliptic operators is still valid in this much more general situation.


title: On filings of $\partial(V\times \mathbb{D})$

abstract: We show that any symplectically aspherical/Calabi-Yau filling of $Y:=\partial(V\times \mathbb{D})$ has vanishing symplectic cohomology for any Liouville domain $V$. In particular, we make no topological requirement on the filling and $c_1(V)$ can be nonzero. Moreover, we show that for any symplectically aspherical/Calabi-Yau filling $W$ of $Y$, the interior $\mathring{W}$ is diffeomorphic to the interior of $V\times \mathbb{D}$ if $\pi_1(Y)$ is abelian and $\dim V\ge 4$. And $W$ is diffeomorphic to $V\times \mathbb{D}$ if moreover the Whitehead group of $\pi_1(Y)$ is trivial.


title: You shall not pass: Mitigating SQL Injection Attacks on Legacy Web Applications

abstract: SQL injection (SQLi) attacks pose a significant threat to the security of web applications. Existing approaches do not support object-oriented programming that renders these approaches unable to protect the real-world web apps such as Wordpress, Joomla, or Drupal against SQLi attacks. We propose a novel hybrid static-dynamic analysis for PHP web applications that limits each PHP function for accessing the database. Our tool, SQLBlock, reduces the attack surface of the vulnerable PHP functions in a web application to a set of query descriptors that demonstrate the benign functionality of the PHP function. We implement SQLBlock as a plugin for MySQL and PHP. Our approach does not require any modification to the web app. W evaluate SQLBlock on 11 SQLi vulnerabilities in Wordpress, Joomla, Drupal, Magento, and their plugins. We demonstrate that SQLBlock successfully prevents all 11 SQLi exploits with negligible performance overhead (i.e., a maximum of 3% on a heavily-loaded web server)


title: Spin transport in a lateral spin valve with a suspended Cu channel

abstract: We study spin transport through a suspended Cu channel by an electrical non-local 4-terminal measurement for future spin mechanics applications. A magnetoresistance due to spin transport through the suspended Cu channel is observed, and its magnitude is comparable to that of a conventional fixed Cu lateral spin valve. The spin diffusion length in the suspended Cu channel is estimated to be 340 nm at room temperature from the spin signal dependence on the distance between the ferromagnetic injector and detector electrodes. This value is found to be slightly shorter than in a fixed Cu. The decrease in the spin diffusion length in the suspended Cu channel is attributed to an increase in spin scattering originating from naturally oxidized Cu at the bottom of the Cu channel.


title: Partially Information Coupled Duo-Binary Turbo Codes

abstract: Partially information coupled turbo codes (PIC-TCs) is a class of spatially coupled turbo codes that can approach the BEC capacity while keeping the encoding and decoding architectures of the underlying component codes unchanged. However, PIC-TCs have significant rate loss compared to its component rate-1/3 turbo code, and the rate loss increases with the coupling ratio. To absorb the rate loss, in this paper, we propose the partially information coupled duo-binary turbo codes (PIC-dTCs). Given a rate-1/3 turbo code as the benchmark, we construct a duo-binary turbo code by introducing one extra input to the benchmark code. Then, parts of the information sequence from the original input are coupled to the extra input of the succeeding code blocks. By looking into the graph model of PIC-dTC ensembles, we derive the exact density evolution equations of the PIC-dTC ensembles, and compute their belief propagation decoding thresholds on the binary erasure channel. Simulation results verify the correctness of our theoretical analysis, and also show significant error performance improvement over the uncoupled rate-1/3 turbo codes and existing designs of spatially coupled turbo codes.


title: Modeling Lost Information in Lossy Image Compression

abstract: Lossy image compression is one of the most commonly used operators for digital images. Most recently proposed deep-learning-based image compression methods leverage the auto-encoder structure, and reach a series of promising results in this field. The images are encoded into low dimensional latent features first, and entropy coded subsequently by exploiting the statistical redundancy. However, the information lost during encoding is unfortunately inevitable, which poses a significant challenge to the decoder to reconstruct the original images. In this work, we propose a novel invertible framework called Invertible Lossy Compression (ILC) to largely mitigate the information loss problem. Specifically, ILC introduces an invertible encoding module to replace the encoder-decoder structure to produce the low dimensional informative latent representation, meanwhile, transform the lost information into an auxiliary latent variable that won't be further coded or stored. The latent representation is quantized and encoded into bit-stream, and the latent variable is forced to follow a specified distribution, i.e. isotropic Gaussian distribution. In this way, recovering the original image is made tractable by easily drawing a surrogate latent variable and applying the inverse pass of the module with the sampled variable and decoded latent features. Experimental results demonstrate that with a new component replacing the auto-encoder in image compression methods, ILC can significantly outperform the baseline method on extensive benchmark datasets by combining with the existing compression algorithms.


title: Self-Knowledge Distillation with Progressive Refinement of Targets

abstract: The generalization capability of deep neural networks has been substantially improved by applying a wide spectrum of regularization methods, e.g., restricting function space, injecting randomness during training, augmenting data, etc. In this work, we propose a simple yet effective regularization method named progressive self-knowledge distillation (PS-KD), which progressively distills a model's own knowledge to soften hard targets (i.e., one-hot vectors) during training. Hence, it can be interpreted within a framework of knowledge distillation as a student becomes a teacher itself. Specifically, targets are adjusted adaptively by combining the ground-truth and past predictions from the model itself. We show that PS-KD provides an effect of hard example mining by rescaling gradients according to difficulty in classifying examples. The proposed method is applicable to any supervised learning tasks with hard targets and can be easily combined with existing regularization methods to further enhance the generalization performance. Furthermore, it is confirmed that PS-KD achieves not only better accuracy, but also provides high quality of confidence estimates in terms of calibration as well as ordinal ranking. Extensive experimental results on three different tasks, image classification, object detection, and machine translation, demonstrate that our method consistently improves the performance of the state-of-the-art baselines. The code is available at https://github.com/lgcnsai/PS-KD-Pytorch.


title: MultiImport: Inferring Node Importance in a Knowledge Graph from Multiple Input Signals

abstract: Given multiple input signals, how can we infer node importance in a knowledge graph (KG)? Node importance estimation is a crucial and challenging task that can benefit a lot of applications including recommendation, search, and query disambiguation. A key challenge towards this goal is how to effectively use input from different sources. On the one hand, a KG is a rich source of information, with multiple types of nodes and edges. On the other hand, there are external input signals, such as the number of votes or pageviews, which can directly tell us about the importance of entities in a KG. While several methods have been developed to tackle this problem, their use of these external signals has been limited as they are not designed to consider multiple signals simultaneously. In this paper, we develop an end-to-end model MultiImport, which infers latent node importance from multiple, potentially overlapping, input signals. MultiImport is a latent variable model that captures the relation between node importance and input signals, and effectively learns from multiple signals with potential conflicts. Also, MultiImport provides an effective estimator based on attentive graph neural networks. We ran experiments on real-world KGs to show that MultiImport handles several challenges involved with inferring node importance from multiple input signals, and consistently outperforms existing methods, achieving up to 23.7% higher NDCG@100 than the state-of-the-art method.


title: A remark on periods of periodic sequences modulo $m$

abstract: Let $\{G_n\}$ be a periodic sequence of integers modulo $m$ and let $\{SG_n\}$ be the partial sum sequence defined by $SG_n:= \sum_{k=0}^nG_k $ (mod $m$). We give a formula for the period of $\{SG_n\}$. We also show that for a generalized Fibonacci sequence $F(a,b)_n$ such that $F(a,b)_0=a$ and $F(a,b)_1=b$, we have $$S^i F(a,b)_n = S^{i-1}F(a,b)_{n+2}-{n+i \choose i-2}a-{n+i \choose i-1} b$$ where $S^i F(a,b)_n $ is the i-th partial sum sequence successively defined by $S^i F(a,b)_n := \sum_{k=0}^n S^{i-1}F(a,b)_k$. This is a generalized version of the well-known formula $$\sum_{k=0}^n F_k = F_{n+2} -1$$ of the Fibonacci sequence $F_n$.


title: Superheating fields of semi-infinite superconductors and layered superconductors in the diffusive limit: structural optimization based on the microscopic theory

abstract: We investigate the superheating fields $H_{sh}$ of semi-infinite superconductors and layered superconductors in the diffusive limit by using the well-established quasiclassical Green's function formalism of the BCS theory. The coupled Maxwell-Usadel equations are self-consistently solved to obtain the spatial distributions of the magnetic field, screening current density, penetration depth, and pair potential. We find the superheating field of a semi-infinite superconductor in the diffusive limit is given by $H_{sh} = 0.795 H_{c0}$ at the temperature $T \to 0$. Here $H_{c0}$ is the thermodynamic critical-field at the zero temperature. Also, we evaluate $H_{sh}$ of layered superconductors in the diffusive limit as functions of the layer thicknesses ($d$) and identify the optimum thickness that maximizes $H_{sh}$ for various materials combinations. Qualitative interpretation of $H_{sh}(d)$ based on the London approximation is also discussed. The results of this work can be used to improve the performance of superconducting rf resonant cavities for particle accelerators.


title: MaskIt: Masking for efficient utilization of incomplete public datasets for training deep learning models

abstract: A major challenge in training deep learning models is the lack of high quality and complete datasets. In the paper, we present a masking approach for training deep learning models from a publicly available but incomplete dataset. For example, city of Hamburg, Germany maintains a list of trees along the roads, but this dataset does not contain any information about trees in private homes and parks. To train a deep learning model on such a dataset, we mask the street trees and aerial images with the road network. Road network used for creating the mask is downloaded from OpenStreetMap, and it marks the area where the training data is available. The mask is passed to the model as one of the inputs and it also coats the output. Our model learns to successfully predict trees only in the masked region with 78.4% accuracy.


title: Efficient text generation of user-defined topic using generative adversarial networks

abstract: This study focused on efficient text generation using generative adversarial networks (GAN). Assuming that the goal is to generate a paragraph of a user-defined topic and sentimental tendency, conventionally the whole network has to be re-trained to obtain new results each time when a user changes the topic. This would be time-consuming and impractical. Therefore, we propose a User-Defined GAN (UD-GAN) with two-level discriminators to solve this problem. The first discriminator aims to guide the generator to learn paragraph-level information and sentence syntactic structure, which is constructed by multiple-LSTMs. The second one copes with higher-level information, such as the user-defined sentiment and topic for text generation. The cosine similarity based on TF-IDF and length penalty are adopted to determine the relevance of the topic. Then, the second discriminator is re-trained with the generator if the topic or sentiment for text generation is modified. The system evaluations are conducted to compare the performance of the proposed method with other GAN-based ones. The objective results showed that the proposed method is capable of generating texts with less time than others and the generated text is related to the user-defined topic and sentiment. We will further investigate the possibility of incorporating more detailed paragraph information such as semantics into text generation to enhance the result.


title: Did the lockdown curb the spread of COVID-19 infection rate in India: A data-driven analysis

abstract: In order to analyze the effectiveness of three successive nationwide lockdown enforced in India, we present a data-driven analysis of four key parameters, reducing the transmission rate, restraining the growth rate, flattening the epidemic curve and improving the health care system. These were quantified by the consideration of four different metrics, namely, reproduction rate, growth rate, doubling time and death to recovery ratio. The incidence data of the COVID-19 (during the period of 2nd March 2020 to 31st May 2020) outbreak in India was analyzed for the best fit to the epidemic curve, making use of the exponential growth, the maximum likelihood estimation, sequential Bayesian method and estimation of time-dependent reproduction. The best fit (based on the data considered) was for the time-dependent approach. Accordingly, this approach was used to assess the impact on the effective reproduction rate. The period of pre-lockdown to the end of lockdown 3, saw a $45\%$ reduction in the rate of effective reproduction rate. During the same period the growth rate reduced from $393\%$ during the pre-lockdown to $33\%$ after lockdown 3, accompanied by the average doubling time increasing form $4$-$6$ days to $12$-$14$ days. Finally, the death-to-recovery ratio dropped from $0.28$ (pre-lockdown) to $0.08$ after lockdown 3. In conclusion, all the four metrics considered to assess the effectiveness of the lockdown, exhibited significant favourable changes, from the pre-lockdown period to the end of lockdown 3. Analysis of the data in the post-lockdown period with these metrics will provide greater clarity with regards to the extent of the success of the lockdown.


title: Near-Optimal Reinforcement Learning with Self-Play

abstract: This paper considers the problem of designing optimal algorithms for reinforcement learning in two-player zero-sum games. We focus on self-play algorithms which learn the optimal policy by playing against itself without any direct supervision. In a tabular episodic Markov game with $S$ states, $A$ max-player actions and $B$ min-player actions, the best existing algorithm for finding an approximate Nash equilibrium requires $\tilde{\mathcal{O}}(S^2AB)$ steps of game playing, when only highlighting the dependency on $(S,A,B)$. In contrast, the best existing lower bound scales as $\Omega(S(A+B))$ and has a significant gap from the upper bound. This paper closes this gap for the first time: we propose an optimistic variant of the \emph{Nash Q-learning} algorithm with sample complexity $\tilde{\mathcal{O}}(SAB)$, and a new \emph{Nash V-learning} algorithm with sample complexity $\tilde{\mathcal{O}}(S(A+B))$. The latter result matches the information-theoretic lower bound in all problem-dependent parameters except for a polynomial factor of the length of each episode. In addition, we present a computational hardness result for learning the best responses against a fixed opponent in Markov games---a learning objective different from finding the Nash equilibrium.


title: Probability Distribution of Velocity Circulation in Three Dimensional Turbulence

abstract: We elaborate the statistical field theory of Turbulence suggested in the previous paper \cite{M20a}. We clarify and simplify the basic Energy pumping equation of that theory and study mathematical properties of singular field configuration (instanton) which determine the tails of PDF for the velocity circulation around large loop $C$ in isotropic turbulence at highest Reynolds numbers. Explicit analytic solution is found for the Clebsch instanton in an Euler equation for a planar loop circulation problem. This solution for vorticity is has a term proportional to a delta function in normal direction to the minimal surface bounded by the loop. The smoothing of $\delta$ functions in the vorticity in the full Navier-Stokes equations is investigated and exponential profile of smoothed singularity is found. The PDF for circulation is now an infinite sum of decreasing exponential terms $\EXP{- n |w|}\sqrt{\frac{n}{|w|}}$, with $ w = \frac{\Gamma}{\Gamma_0[C]}$, and $ \Gamma_0[C] \sim \sqrt{A_C} $ with minimal area $A_C$. The leading term fits with adjusted $R^2 = 0.9999$ the PDF tail found in DNS over more than six orders of magnitude. The area dependence of the ratio of the circulation moments $M_8/M_6$ fits with adjusted $R^2=0.9996$ the DNS in inertial range of square loop sizes from $100 $ to $500$ Kolmogorov scales. Thus, our theory explains DNS with high degree or confidence. For a flat loop we derive two-dimensional integral equation for the dependence of the scale $\Gamma_0[C] $ of circulation as a function of the shape of the loop (aspect ratio for rectangular loop

categories: hep-th cond-mat.stat-mech nlin.CD nlin.PS physics.flu-dyn


title: Feature Alignment and Restoration for Domain Generalization and Adaptation

abstract: For domain generalization (DG) and unsupervised domain adaptation (UDA), cross domain feature alignment has been widely explored to pull the feature distributions of different domains in order to learn domain-invariant representations. However, the feature alignment is in general task-ignorant and could result in degradation of the discrimination power of the feature representation and thus hinders the high performance. In this paper, we propose a unified framework termed Feature Alignment and Restoration (FAR) to simultaneously ensure high generalization and discrimination power of the networks for effective DG and UDA. Specifically, we perform feature alignment (FA) across domains by aligning the moments of the distributions of attentively selected features to reduce their discrepancy. To ensure high discrimination, we propose a Feature Restoration (FR) operation to distill task-relevant features from the residual information and use them to compensate for the aligned features. For better disentanglement, we enforce a dual ranking entropy loss constraint in the FR step to encourage the separation of task-relevant and task-irrelevant features. Extensive experiments on multiple classification benchmarks demonstrate the high performance and strong generalization of our FAR framework for both domain generalization and unsupervised domain adaptation.


title: QTRAN++: Improved Value Transformation for Cooperative Multi-Agent Reinforcement Learning

abstract: QTRAN is a multi-agent reinforcement learning (MARL) algorithm capable of learning the largest class of joint-action value functions up to date. However, despite its strong theoretical guarantee, it has shown poor empirical performance in complex environments, such as Starcraft Multi-Agent Challenge (SMAC). In this paper, we identify the performance bottleneck of QTRAN and propose a substantially improved version, coined QTRAN++. Our gains come from (i) stabilizing the training objective of QTRAN, (ii) removing the strict role separation between the action-value estimators of QTRAN, and (iii) introducing a multi-head mixing network for value transformation. Through extensive evaluation, we confirm that our diagnosis is correct, and QTRAN++ successfully bridges the gap between empirical performance and theoretical guarantee. In particular, QTRAN++ newly achieves state-of-the-art performance in the SMAC environment. The code will be released.


title: Superpolynomial Lower Bounds for Learning One-Layer Neural Networks using Gradient Descent

abstract: We prove the first superpolynomial lower bounds for learning one-layer neural networks with respect to the Gaussian distribution using gradient descent. We show that any classifier trained using gradient descent with respect to square-loss will fail to achieve small test error in polynomial time given access to samples labeled by a one-layer neural network. For classification, we give a stronger result, namely that any statistical query (SQ) algorithm (including gradient descent) will fail to achieve small test error in polynomial time. Prior work held only for gradient descent run with small batch sizes, required sharp activations, and applied to specific classes of queries. Our lower bounds hold for broad classes of activations including ReLU and sigmoid. The core of our result relies on a novel construction of a simple family of neural networks that are exactly orthogonal with respect to all spherically symmetric distributions.


title: Laser stabilisation to neutral Yb in a discharge with polarization enhanced frequency modulation spectroscopy

abstract: Isotope selective optical excitation of atoms is important for experiments with neutral atoms, metrology, and work with trapped ions, including quantum information processing. Polarization-enhanced absorption spectroscopy is used to frequency stabilise a tunable external cavity laser diode system at 398.9 nm for isotope selective photoionization of neutral Yb atoms. This spectroscopy technique is used to measure isotope resolved dispersive features from transitions within a see through configuration Ytterbium hollow-cathode discharge lamp. This Doppler-free dichroic polarization spectroscopy is realised by retro-reflecting a laser beam through the discharge and analysing the polarization dependent absorption with balanced detection. The spectroscopy signal is recovered using lock-in detection of frequency modulation induced by current modulation of the external cavity laser diode. Here, we show the use of polarization-enhanced absorption spectroscopy for isotope selectively loading of $^{171}$Yb$^+$, $^{172}$Yb$^+$, or $^{174}$Yb$^+$ ions into an RF Paul trap.


title: CLUB: A Contrastive Log-ratio Upper Bound of Mutual Information

abstract: Mutual information (MI) minimization has gained considerable interests in various machine learning tasks. However, estimating and minimizing MI in high-dimensional spaces remains a challenging problem, especially when only samples, rather than distribution forms, are accessible. Previous works mainly focus on MI lower bound approximation, which is not applicable to MI minimization problems. In this paper, we propose a novel Contrastive Log-ratio Upper Bound (CLUB) of mutual information. We provide a theoretical analysis of the properties of CLUB and its variational approximation. Based on this upper bound, we introduce a MI minimization training scheme and further accelerate it with a negative sampling strategy. Simulation studies on Gaussian distributions show the reliable estimation ability of CLUB. Real-world MI minimization experiments, including domain adaptation and information bottleneck, demonstrate the effectiveness of the proposed method. The code is at https://github.com/Linear95/CLUB.


title: Sound Event Localization and Detection Using Activity-Coupled Cartesian DOA Vector and RD3net

abstract: Our systems submitted to the DCASE2020 task~3: Sound Event Localization and Detection (SELD) are described in this report. We consider two systems: a single-stage system that solve sound event localization~(SEL) and sound event detection~(SED) simultaneously, and a two-stage system that first handles the SED and SEL tasks individually and later combines those results. As the single-stage system, we propose a unified training framework that uses an activity-coupled Cartesian DOA vector~(ACCDOA) representation as a single target for both the SED and SEL tasks. To efficiently estimate sound event locations and activities, we further propose RD3Net, which incorporates recurrent and convolution layers with dense skip connections and dilation. To generalize the models, we apply three data augmentation techniques: equalized mixture data augmentation~(EMDA), rotation of first-order Ambisonic~(FOA) singals, and multichannel extension of SpecAugment. Our systems demonstrate a significant improvement over the baseline system.


title: Towards Better Performance and More Explainable Uncertainty for 3D Object Detection of Autonomous Vehicles

abstract: In this paper, we propose a novel form of the loss function to increase the performance of LiDAR-based 3d object detection and obtain more explainable and convincing uncertainty for the prediction. The loss function was designed using corner transformation and uncertainty modeling. With the new loss function, the performance of our method on the val split of KITTI dataset shows up to a 15% increase in terms of Average Precision (AP) comparing with the baseline using simple L1 Loss. In the study of the characteristics of predicted uncertainties, we find that generally more accurate prediction of the bounding box is usually accompanied by lower uncertainty. The distribution of corner uncertainties agrees on the distribution of the point cloud in the bounding box, which means the corner with denser observed points has lower uncertainty. Moreover, our method also learns the constraint from the cuboid geometry of the bounding box in uncertainty prediction. Finally, we propose an efficient Bayesian updating method to recover the uncertainty for the original parameters of the bounding boxes which can help to provide probabilistic results for the planning module.


title: Determination of the Electronic Localized-to-Extended-State Transition Point around the Metal-to-Insulator Transition Region of Fluid Mercury Using the Framework of Multifractal Analysis

abstract: The metal-to-insulator transition and the presence of the disorder induced localization of electronic orbitals of fluid mercury (f-Hg) were investigated. The electronic structure of f-Hg was simulated by means of ab initio molecular dynamics. To see the behavior of the simulation size dependency of the electronic orbital, systems with different number of atoms were simulated. The size dependency of the multifractal measure of the electronic orbitals reversed with decreasing the density, which suggests there exists the extended-to-localized-state transition near the metal-to-insulator transition region of f-Hg.


title: Dynamics of transposable elements generates structure and symmetries in genetic sequences

abstract: Genetic sequences are known to possess non-trivial composition together with symmetries in the frequencies of their components. Recently, it has been shown that symmetry and structure are hierarchically intertwined in DNA, suggesting a common origin for both features. However, the mechanism leading to this relationship is unknown. Here we investigate a biologically motivated dynamics for the evolution of genetic sequences. We show that a metastable (long-lived) regime emerges in which sequences have symmetry and structure interlaced in a way that matches that of extant genomes.


title: Overlook: Differentially Private Exploratory Visualization for Big Data

abstract: Data exploration systems that provide differential privacy must manage a privacy budget that measures the amount of privacy lost across multiple queries. One effective strategy to manage the privacy budget is to compute a one-time private synopsis of the data, to which users can make an unlimited number of queries. However, existing systems using synopses are built for offline use cases, where a set of queries is known ahead of time and the system carefully optimizes a synopsis for it. The synopses that these systems build are costly to compute and may also be costly to store. We introduce Overlook, a system that enables private data exploration at interactive latencies for both data analysts and data curators. The key idea in Overlook is a virtual synopsis that can be evaluated incrementally, without extra space storage or expensive precomputation. Overlook simply executes queries using an existing engine, such as a SQL DBMS, and adds noise to their results. Because Overlook's synopses do not require costly precomputation or storage, data curators can also use Overlook to explore the impact of privacy parameters interactively. Overlook offers a rich visual query interface based on the open source Hillview system. Overlook achieves accuracy comparable to existing synopsis-based systems, while offering better performance and removing the need for extra storage.


title: New Hybrid Textures for Neutrino Mass Matrices

abstract: We perform a systematic investigation of the texture structures of Majorana neutrino mass matrix $M_{\nu}$ having two texture zeros and an equality between two nonzero matrix elements, in the light of recent neutrino oscillation data. Among forty-two possible textures, it is found that only eight textures are compatible with the current experimental data at 3$\sigma$ C.L. Out of these phenomenologically viable textures, six follow normal mass ordering while remaining two satisfy the inverted mass ordering of neutrino mass spectrum. In the numerical analysis, we carry out a scan over the possible space of all viable patterns. We present the implications of each allowed patterns for three mixing angles (solar, reactor and atmospheric), leptonic CP-violation, neutrino mass scale and the neutrinoless double beta decay indicating strong correlations between oscillation parameters. The symmetry realization of one of the viable textures is also presented.


title: Online Handbook of Argumentation for AI: Volume 1

abstract: This volume contains revised versions of the papers selected for the first volume of the Online Handbook of Argumentation for AI (OHAAI). Previously, formal theories of argument and argument interaction have been proposed and studied, and this has led to the more recent study of computational models of argument. Argumentation, as a field within artificial intelligence (AI), is highly relevant for researchers interested in symbolic representations of knowledge and defeasible reasoning. The purpose of this handbook is to provide an open access and curated anthology for the argumentation research community. OHAAI is designed to serve as a research hub to keep track of the latest and upcoming PhD-driven research on the theory and application of argumentation in all areas related to AI.


title: Sampling hypergraphs with given degrees

abstract: There is a well-known connection between hypergraphs and bipartite graphs, obtained by treating the incidence matrix of the hypergraph as the biadjacency matrix of a bipartite graph. We use this connection to describe and analyse a rejection sampling algorithm for sampling simple uniform hypergraphs with a given degree sequence. Our algorithm uses, as a black box, an algorithm $\mathcal{A}$ for sampling bipartite graphs with given degrees, uniformly or nearly uniformly, in (expected) polynomial time. The expected runtime of the hypergraph sampling algorithm depends on the (expected) runtime of the bipartite graph sampling algorithm $\mathcal{A}$, and the probability that a uniformly random bipartite graph with given degrees corresponds to a simple hypergraph. We give some conditions on the hypergraph degree sequence which guarantee that this probability is bounded below by a positive constant.


title: Sensitivity analysis of Wasserstein distributionally robust optimization problems

abstract: We consider sensitivity of a generic stochastic optimization problem to model uncertainty. We take a non-parametric approach and capture model uncertainty using Wasserstein balls around the postulated model. We provide explicit formulae for the first order correction to both the value function and the optimizer and further extend our results to optimization under linear constraints. We present applications to statistics, machine learning, mathematical finance and uncertainty quantification. In particular, we provide explicit first-order approximation for square-root LASSO regression coefficients and deduce coefficient shrinkage compared to the ordinary least squares regression. We consider robustness of call option pricing and deduce a new Black-Scholes sensitivity, a non-parametric version of the so-called Vega. We also compute sensitivities of optimized certainty equivalents in finance and propose measures to quantify robustness of neural networks to adversarial examples.

categories: math.OC math.PR math.ST q-fin.MF stat.TH


title: The space of sections of a smooth function

abstract: Given a compact manifold $X$ with boundary and a submersion $f : X \rightarrow Y$ whose restriction to the boundary of $X$ has isolated critical points with distinct critical values and where $Y$ is $[0,1]$ or $S^1$, the connected components of the space of sections of $f$ are computed from $\pi_0$ and $\pi_1$ of the fibers of $f$. This computation is then leveraged to provide new results on a smoothed version of the evasion path problem for mobile sensor networks: From the time-varying homology of the covered region and the time-varying cup-product on cohomology of the boundary, a necessary and sufficient condition for existence of an evasion path and a lower bound on the number of homotopy classes of evasion paths are computed. No connectivity assumptions are required.


title: Bayesian Neural Networks: An Introduction and Survey

abstract: Neural Networks (NNs) have provided state-of-the-art results for many challenging machine learning tasks such as detection, regression and classification across the domains of computer vision, speech recognition and natural language processing. Despite their success, they are often implemented in a frequentist scheme, meaning they are unable to reason about uncertainty in their predictions. This article introduces Bayesian Neural Networks (BNNs) and the seminal research regarding their implementation. Different approximate inference methods are compared, and used to highlight where future research can improve on current methods.