title: Non-commutative double-sided continued fractions

abstract: We study double-sided continued fractions whose coefficients are non-commuting symbols. We work within the formal approach of the Mal'cev-Neumann series and free division rings. We start with presenting the analogs of the standard results from the theory of continued fractions, including their (right and left) simple fractions decomposition, the Euler-Minding summation formulas, and the relations between nominators and denominators of the simple fraction decompositions. We also transfer to the non-commutative double-sided setting the standard description of the continued fractions in terms of $2\times 2$ matrices presenting also a weak version of the Serret theorem. The equivalence transformations between the double continued fractions are described, including also the transformation from generic such fractions to their simplest form. Then we give the description of the double-sided continued fractions within the theory of quasideterminants and we present the corresponding version of the $LR$ and $qd$-algorithms. We study also (strictly and ultimately) periodic double-sided non-commutative continued fractions and we give the corresponding version of the Euler theorem. Finally we present a weak version of the Galois theorem and we give its relation to the non-commutative KP map, recently studied in the theory of discrete integrable systems.


title: Analytic Continuation of Noisy Data Using Adams Bashforth ResNet

abstract: We propose a data-driven learning framework for the analytic continuation problem in numerical quantum many-body physics. Designing an accurate and efficient framework for the analytic continuation of imaginary time using computational data is a grand challenge that has hindered meaningful links with experimental data. The standard Maximum Entropy (MaxEnt)-based method is limited by the quality of the computational data and the availability of prior information. Also, the MaxEnt is not able to solve the inversion problem under high level of noise in the data. Here we introduce a novel learning model for the analytic continuation problem using a Adams-Bashforth residual neural network (AB-ResNet). The advantage of this deep learning network is that it is model independent and, therefore, does not require prior information concerning the quantity of interest given by the spectral function. More importantly, the ResNet-based model achieves higher accuracy than MaxEnt for data with higher level of noise. Finally, numerical examples show that the developed AB-ResNet is able to recover the spectral function with accuracy comparable to MaxEnt where the noise level is relatively small.


title: What Syntactic Structures block Dependencies in RNN Language Models?

abstract: Recurrent Neural Networks (RNNs) trained on a language modeling task have been shown to acquire a number of non-local grammatical dependencies with some success. Here, we provide new evidence that RNN language models are sensitive to hierarchical syntactic structure by investigating the filler--gap dependency and constraints on it, known as syntactic islands. Previous work is inconclusive about whether RNNs learn to attenuate their expectations for gaps in island constructions in particular or in any sufficiently complex syntactic environment. This paper gives new evidence for the former by providing control studies that have been lacking so far. We demonstrate that two state-of-the-art RNN models are are able to maintain the filler--gap dependency through unbounded sentential embeddings and are also sensitive to the hierarchical relationship between the filler and the gap. Next, we demonstrate that the models are able to maintain possessive pronoun gender expectations through island constructions---this control case rules out the possibility that island constructions block all information flow in these networks. We also evaluate three untested islands constraints: coordination islands, left branch islands, and sentential subject islands. Models are able to learn left branch islands and learn coordination islands gradiently, but fail to learn sentential subject islands. Through these controls and new tests, we provide evidence that model behavior is due to finer-grained expectations than gross syntactic complexity, but also that the models are conspicuously un-humanlike in some of their performance characteristics.


title: Cross validation approaches for penalized Cox regression

abstract: Cross validation is commonly used for selecting tuning parameters in penalized regression, but its use in penalized Cox regression models has received relatively little attention in the literature. Due to its partial likelihood construction, carrying out cross validation for Cox models is not straightforward, and there are several potential approaches for implementation. Here, we propose two new cross-validation methods for Cox regression and compare them to approaches that have been proposed elsewhere. Our proposed approach of cross-validating the linear predictors seems to offer an attractive balance of performance and numerical stability. We illustrate these advantages using simulated data as well as using them to analyze data from a high-dimensional study of survival in lung cancer patients.


title: Three dimensions, two microscopes, one code: automatic differentiation for x-ray nanotomography beyond the depth of focus limit

abstract: Conventional tomographic reconstruction algorithms assume that one has obtained pure projection images, involving no within-specimen diffraction effects nor multiple scattering. Advances in x-ray nanotomography are leading towards the violation of these assumptions, by combining the high penetration power of x-rays which enables thick specimens to be imaged, with improved spatial resolution which decreases the depth of focus of the imaging system. We describe a reconstruction method where multiple scattering and diffraction effects in thick samples are modeled by multislice propagation, and the 3D object function is retrieved through iterative optimization. We show that the same proposed method works for both full-field microscopy, and for coherent scanning techniques like ptychography. Our implementation utilizes the optimization toolbox and the automatic differentiation capability of the open-source deep learning package TensorFlow, which demonstrates a much straightforward way to solve optimization problems in computational imaging, and endows our program great flexibility and portability.


title: Towards Bit-Width-Independent Proofs in SMT Solvers

abstract: Many SMT solvers implement efficient SAT-based procedures for solving fixed-size bit-vector formulas. These approaches, however, cannot be used directly to reason about bit-vectors of symbolic bit-width. To address this shortcoming, we propose a translation from bit-vector formulas of non-fixed bit-width to formulas in a logic supported by SMT solvers that includes non-linear integer arithmetic, uninterpreted functions, and universal quantification. While this logic is undecidable, this approach can still solve many formulas by capitalizing on advancements in SMT solving for non-linear arithmetic and universally quantified formulas. We provide several case studies in which we have applied this approach with promising results, including the bit-width independent verification of invertibility conditions, compiler optimizations, and bit-vector rewrites.


title: Laboratory-based X-ray Absorption Spectroscopy on a Working Pouch Cell Battery at Industrially-Relevant Charging Rates

abstract: Li-ion battery (LIB) research has continuing importance for the entire range of applications from consumer products to vehicle electrification and grid stabilization. In many cases, standard electrochemical methods only provide an overall voltage or specific capacity, giving an inadequate description of parallel redox processes or chemical gradients at the particle and pack level. X-ray absorption fine structure (XAFS) is frequently used to augment bulk electrochemical data, as it provides element-specific changes in oxidation state and local atomic structure. Such microscopic descriptors are crucial for elucidating charge transfer and structural changes associated with bonding or site mixing, two key factors in evaluating state of charge and modes of cell failure. However, the impact of XAFS on LIB research has been significantly constrained by a logistical barrier: contemporary XAFS work is performed almost exclusively at synchrotron x-ray light sources, where beamtime is infrequent and experiment time-frames are limited. Here we show that modern laboratory based XAFS can not only be applied to, e.g., characterization of ex situ LIB electrode materials, but can also be used for operando studies at industrially-relevant charging rates in a standard pouch cell preparation. Such capability enables accelerated discovery of new materials and improved operation modes for LIBs.


title: Speckle interferometry at SOAR in 2018

abstract: The results of speckle interferometric observations at the 4.1 m Southern Astrophysical Research Telescope (SOAR) in 2018 are given, totaling 3097 measurements of 2427 resolved pairs with separations from 11 mas to 5.9" (median 0.15", magnitude difference up to 7 mag) and non-resolutions of 624 targets. This work continues our long-term speckle program. Its main goal is to monitor orbital motion of close binaries, including members of high-order hierarchies and Hipparcos pairs in the solar neighborhood. Also, pre-main-sequence stars in the Orion OB1 association were surveyed, resolving 26 out of 118 targets. In addition, we report discovery of 35 new companions among field visual multiples (some of which are likely optical) and first-time resolutions of another 31 pairs. By combining the measurements given here with the published ones, we computed 76 orbits for the first time and updated orbital elements of 34 visual binaries. Their periods range from 0.65 to 1100 years, and their quality varies from first tentative solutions of grade 5 to accurate elements of grades 1 and 2. Finally, a list of 53 spurious pairs discovered by various techniques and unresolved at SOAR


title: N-BEATS: Neural basis expansion analysis for interpretable time series forecasting

abstract: We focus on solving the univariate times series point forecasting problem using deep learning. We propose a deep neural architecture based on backward and forward residual links and a very deep stack of fully-connected layers. The architecture has a number of desirable properties, being interpretable, applicable without modification to a wide array of target domains, and fast to train. We test the proposed architecture on several well-known datasets, including M3, M4 and TOURISM competition datasets containing time series from diverse domains. We demonstrate state-of-the-art performance for two configurations of N-BEATS for all the datasets, improving forecast accuracy by 11% over a statistical benchmark and by 3% over last year's winner of the M4 competition, a domain-adjusted hand-crafted hybrid between neural network and statistical time series models. The first configuration of our model does not employ any time-series-specific components and its performance on heterogeneous datasets strongly suggests that, contrarily to received wisdom, deep learning primitives such as residual blocks are by themselves sufficient to solve a wide range of forecasting problems. Finally, we demonstrate how the proposed architecture can be augmented to provide outputs that are interpretable without considerable loss in accuracy.


abstract: This is the translation of Euler's Latin textbook Institutiones calculi differentialis cum eius usu in analysi finitorum ac doctrina serierum (second volume) into English.


title: Magnetic field mixing and splitting of bright and dark excitons in monolayer MoSe2

abstract: Monolayers of semiconducting transition metal dichalcogenides (TMDCs) with unique spin-valley contrasting properties and remarkably strong excitonic effects continue to be a subject of intense research interests. These model 2D semiconductors feature two fundamental intravalley excitons species - optically accessible ' bright' excitons with anti-parallel spins and optically inactive 'dark' excitons with parallel spins. For applications exploiting radiative recombination of bright excitons or long lifetime dark excitons, it is essential to understand the radiative character of the exciton ground state and establish the energy separation between the lowest energy bright and dark excitons. Here, we report a direct spectroscopic measure of dark excitons in monolayer MoSe$_2$ encapsulated in hexagonal boron nitride. By applying strong in-plane magnetic field, we induce mixing and splitting of bright and dark exciton branches, which enables an accurate spectroscopic determination of their energies. We confirm the bright character of the exciton ground state separated by a 1.5~meV gap from the higher energy dark exciton state, much smaller compared to the previous theoretical expectations. These findings provide critical information for further improvement of the accurate theoretical description of TMDCs electronic structure.


title: Adiabatic and Radiative Cooling of Relativistic Electrons Applied to Synchrotron Spectra and Light-Curves of Gamma-Ray Burst Pulses

abstract: We investigate the adiabatic and radiative (synchrotron and inverse-Compton) cooling of relativistic electrons whose injected/initial distribution with energy is a power-law above a typical energy $\gamma_i$. Analytical and numerical results are presented for the cooling-tail and the cooled-injected distribution that develop below and above the typical energy of injected electrons, for the evolution of the peak-energy $E_p$ of the synchrotron emission spectrum, and for the pulse shape resulting from an episode of electron injection. The synchrotron emission calculated numerically is compared with the spectrum and shape of Gamma-Ray Burst (GRB) pulses. Both adiabatic and radiative cooling processes lead to a softening of the pulse spectrum, and both types of cooling processes lead to pulses peaking earlier and lasting shorter at higher energy, quantitatively consistent with observations. For adiabatic-dominated electron cooling, a power-law injection rate $R_i$ suffices to explain the observed power-law GRB low-energy spectra. Synchrotron-dominated cooling leads to power-law cooling-tails that yield the synchrotron standard slope alpha = -3/2 provided that $R_i \sim B^2$, which is exactly the expectation if the magnetic field is a constant fraction of the post-shock energy density. Increasing (decreasing) $R_i$ and decreasing (increasing) B(t) lead to slopes alpha harder (softer, respectively) than the standard value and to non--power-law (curved) cooling-tails. Inverse-Compton cooling yields four values for the slope alpha but, as for synchrotron, other $R_i$ or B histories yield a wider range of slopes and curved low-energy spectra. Feedback between the power-law segments that develop below and above the typical injected electron leads to a synchrotron spectrum with many breaks above and below the usual 10 keV-1 MeV observing range.


title: Towards a Multiphysics Model for Tumor Response to Combined-Hyperthermia-Radiotherapy Treatment

abstract: We develop a multiphysics-based model to predict the response of localized tumors to combined-hyperthermia-radiotherapy (CHR) treatment. This procedure combines hyperthermia (tumor heating) with standard radiotherapy to improve efficacy of the overall treatment. In addition to directly killing tumor cells, tumor heating amends several parameters within the tumor microenvironment. This leads to radiosensitization, which improves the performance of radiotherapy while reducing the side-effects of excess radiation in the surrounding normal tissue. Existing tools to model this kind of treatment consider each of the physics separately. The model presented in this paper accounts for the synergy between hyperthermia and radiotherapy providing a more realistic and holistic approach to simulate CHR treatment. Our model couples radiation transport and heat-transfer with cell population dynamics.


title: Localization versus subradiance in three-dimensional scattering of light

abstract: We study the scattering modes of light in a three-dimensional disordered medium, in the scalar approximation and above the critical density for Anderson localization. Localized modes represent a minority of the total number of modes, even well above the threshold density, whereas spatially extended subradiant modes predominate. For specific energy ranges however, almost all modes are localized, yet adjusting accordingly the probe frequency does not allow to address these only in the regime accessible numerically. Finally, their lifetime is observed to be dominated by finite-size effects, and more specifically by the ratio of the localization length to their distance to the system boundaries.


title: Recovery and convergence rate of the Frank-Wolfe Algorithm for the m-EXACT-SPARSE Problem

abstract: We study the properties of the Frank-Wolfe algorithm to solve the m-EXACT-SPARSE reconstruction problem, where a signal y must be expressed as a sparse linear combination of a predefined set of atoms, called dictionary. We prove that when the signal is sparse enough with respect to the coherence of the dictionary, then the iterative process implemented by the Frank-Wolfe algorithm only recruits atoms from the support of the signal, that is the smallest set of atoms from the dictionary that allows for a perfect reconstruction of y. We also prove that under this same condition, there exists an iteration beyond which the algorithm converges exponentially.


title: Overt visual attention on rendered 3D objects

abstract: This work covers multiple aspects of overt visual attention on 3D renders: measurement, projection, visualization, and application to studying the influence of material appearance on looking behaviour. In the scope of this work, we ran an eye-tracking experiment in which the observers are presented with animations of rotating 3D objects. The objects were rendered to simulate different metallic appearance, particularly smooth (glossy), rough (matte), and coated gold. The eye-tracking results illustrate how material appearance itself influences the observer's attention, while all the other parameters remain unchanged. In order to make visualization of the attention maps more natural and also make the analysis more accurate, we develop a novel technique of projection of gaze fixations on the 3D surface of the figure itself, instead of the conventional 2D plane of the screen. The proposed methodology will be useful for further studies of attention and saliency in the computer graphics domain.


title: Low-dose ionizing radiation exposure during pregnancy induces behavioral impairment and lower weight gain in adult rats

abstract: Low-dose ionizing radiation may induce far-reaching consequences in human, especially regarding intrauterine development. Many studies have documented that the risks of in utero irradiation remain controversial and no effect is reported at doses below 50 mGy. Animal models are often used to clarify the non-fully understood impact of intrauterine irradiation and allow the manipulation of several experimental setups, making possible the analysis of a wide range of end points. We investigated the impact of in utero low-dose X-ray irradiation on postnatal development in rat offspring through a set of well-established behavioral parameters and weight gain. To investigate the hypothesis of postnatal behavioral and physiological alterations due to prenatal low-dose ionizing radiation we exposed pregnant Wistar to 15 mGy of X-rays on gestational days 8 and 15 and control mothers. This low-dose value into diagnostic range can be achieved in a single radiological exam. Four male animals were select from each litter. At infant age, eye-opening test and negative geotaxis tests were performed. Animals were tested at postnatal ages 30 and 70 days in open field, elevated plus-maze, and hole board tests. We evaluated the weight gain of all animals throughout the experiment. The results presented differences between irradiated and non-irradiated animals. Exposed animals presented lower weight gain in adult life, impairment in central nervous system since infant phase, behavioral alterations persisting into later life, and motor coordination impairment. Effects at doses under 100 mGy have not been reported, however, the present study demonstrate that 15 mGy intrauterine exposure was able to generate deleterious effects.


title: Numerical simulations for the energy-supercritical nonlinear wave equation

abstract: We carry out numerical simulations of the defocusing energy-supercritical nonlinear wave equation for a range of spherically-symmetric initial conditions. We demonstrate numerically that the critical Sobolev norm of solutions remains bounded in time. This lends support to conditional scattering results that have been recently established for nonlinear wave equations.


title: Regula Sub-rosa: Latent Backdoor Attacks on Deep Neural Networks

abstract: Recent work has proposed the concept of backdoor attacks on deep neural networks (DNNs), where misbehaviors are hidden inside "normal" models, only to be triggered by very specific inputs. In practice, however, these attacks are difficult to perform and highly constrained by sharing of models through transfer learning. Adversaries have a small window during which they must compromise the student model before it is deployed. In this paper, we describe a significantly more powerful variant of the backdoor attack, latent backdoors, where hidden rules can be embedded in a single "Teacher" model, and automatically inherited by all "Student" models through the transfer learning process. We show that latent backdoors can be quite effective in a variety of application contexts, and validate its practicality through real-world attacks against traffic sign recognition, iris identification of lab volunteers, and facial recognition of public figures (politicians). Finally, we evaluate 4 potential defenses, and find that only one is effective in disrupting latent backdoors, but might incur a cost in classification accuracy as tradeoff.


title: Geometric Wavelet Scattering Networks on Compact Riemannian Manifolds

abstract: The Euclidean scattering transform was introduced nearly a decade ago to improve the mathematical understanding of convolutional neural networks. Inspired by recent interest in geometric deep learning, which aims to generalize convolutional neural networks to manifold and graph-structured domains, we define a geometric scattering transform on manifolds. Similar to the Euclidean scattering transform, the geometric scattering transform is based on a cascade of wavelet filters and pointwise nonlinearities. It is invariant to local isometries and stable to certain types of diffeomorphisms. Empirical results demonstrate its utility on several geometric learning tasks. Our results generalize the deformation stability and local translation invariance of Euclidean scattering, and demonstrate the importance of linking the used filter structures to the underlying geometry of the data.


title: The microscopic Einstein-de Haas effect

abstract: The Einstein-de Haas (EdH) effect, where the spin angular momentum of electrons is transferred to the mechanical angular momentum of atoms, was established experimentally in 1915. While a semi-classical explanation of the effect exists, modern electronic structure methods have not yet been applied to modelling the phenomenon. In this paper we investigate its microscopic origins by means of a non-collinear tight-binding model of an $\textrm{O}_2$ dimer, which includes the effects of spin-orbit coupling, coupling to an external magnetic field, and vector Stoner exchange. By varying an external magnetic field in the presence of spin-orbit coupling, a torque can be generated on the dimer, validating the presence of the EdH effect. Avoided energy level crossings and the rate of change of magnetic field determine the evolution of the spin. We find also that the torque exerted on the nuclei by the electrons in a time-varying $B$ field is not only due to the EdH effect. Other contributions arise from field-induced changes in the electronic orbital angular momentum and from the direct action of the Faraday electric field associated with the time-varying magnetic field.


title: Population Estimates for Electromagnetically-Distinguishable Supermassive Binary Black Holes

abstract: Distinguishing the photon output of an accreting supermassive black hole binary system from that of a single supermassive black hole accreting at the same rate is intrinsically difficult because the majority of the light emerges from near the ISCOs of the black holes. However, there are two possible signals that can distinctively mark binaries, both arising from the gap formed in circumbinary accretion flows inside approximately twice the binary separation. One of these is a "notch" cut into the thermal spectra of these systems in the IR/optical/UV, the other a periodically-varying excess hard X-ray luminosity whose period is of order the binary orbital period. Using data from detailed galaxy evolution simulations, we estimate the distribution function in mass, mass ratio, and accretion rate for accreting supermassive black hole binaries as a function of redshift and then transform this distribution function into predicted source counts for these two potential signals. At flux levels >~10^{-13}~erg~cm^{-2}~s^{-1}, there may be ~O(10^2) such systems in the sky, mostly in the redshift range ~0.5 < z < ~1. Roughly 10% should have periods short enough (<~5~yr) to detect the X-ray modulation; this is also the period range accessible to PTA observations.


title: Monoidal networks

abstract: In this paper we define and study the notion of a monoidal network, which consists of a commutative ring $R$ and a collection of groups $\Gamma_I$, indexed by the ideals of $R$, with $\Gamma_I$ acting on the quotient $R/I$ and satisfying a certain lifting condition. The examination of these objects is largely motivated by, and initially arose from, the study of the union-closed sets conjecture. This connection is made precise and other aspects of these structures are investigated.


title: Additive Noise Annealing and Approximation Properties of Quantized Neural Networks

abstract: We present a theoretical and experimental investigation of the quantization problem for artificial neural networks. We provide a mathematical definition of quantized neural networks and analyze their approximation capabilities, showing in particular that any Lipschitz-continuous map defined on a hypercube can be uniformly approximated by a quantized neural network. We then focus on the regularization effect of additive noise on the arguments of multi-step functions inherent to the quantization of continuous variables. In particular, when the expectation operator is applied to a non-differentiable multi-step random function, and if the underlying probability density is differentiable (in either classical or weak sense), then a differentiable function is retrieved, with explicit bounds on its Lipschitz constant. Based on these results, we propose a novel gradient-based training algorithm for quantized neural networks that generalizes the straight-through estimator, acting on noise applied to the network's parameters. We evaluate our algorithm on the CIFAR-10 and ImageNet image classification benchmarks, showing state-of-the-art performance on AlexNet and MobileNetV2 for ternary networks.


title: A Call for Prudent Choice of Subword Merge Operations in Neural Machine Translation

abstract: Most neural machine translation systems are built upon subword units extracted by methods such as Byte-Pair Encoding (BPE) or wordpiece. However, the choice of number of merge operations is generally made by following existing recipes. In this paper, we conduct a systematic exploration on different numbers of BPE merge operations to understand how it interacts with the model architecture, the strategy to build vocabularies and the language pair. Our exploration could provide guidance for selecting proper BPE configurations in the future. Most prominently: we show that for LSTM-based architectures, it is necessary to experiment with a wide range of different BPE operations as there is no typical optimal BPE configuration, whereas for Transformer architectures, smaller BPE size tends to be a typically optimal choice. We urge the community to make prudent choices with subword merge operations, as our experiments indicate that a sub-optimal BPE configuration alone could easily reduce the system performance by 3-4 BLEU points.


title: Analytical study on phase transition of shape memory alloy wire under uniaxial tension

abstract: This paper considers the stress-induced phase transitions of shape memory alloy slender cylinder, and analytically studies the phase transition process and the associated instability. A three-dimensional (3D) phenomenological model with an internal variable is adopted, which is simplified to a 1D system of two strains in three regions (austenite, martensite and phase transition regions). Suitable boundary conditions and interface conditions are proposed. Theoretically, it is a free boundary problem, as the position and shape of phase interfaces are unknown. We then focus on planar interfaces (which are energetically favored), and a symmetric case when phase transition occurs in the middle. For given applied stress, two-region solutions, three-region solutions and the connecting solutions between them are obtained analytically or semi-analytically, including many period-k solutions. Two-region solutions show that phase transition does not take place at one point, but simultaneously in a small region. The width of phase transition region is found analytically, revealing the roles of the material and geometrical parameters. Three-region solutions represent localized inhomogeneous deformations in experiments, and capture that the stress stays almost at the Maxwell stress during propagation of transformation front. For displacement-controlled process, the transition process is demonstrated by the stress-strain curve, which captures the stress drop/rise and the transition from homogeneous deformations to period-1 localized inhomogeneous deformations. When the radius is smaller than a critical value (given by material constants), the stress drop is very sharp due to transition of solutions in a snap-back bifurcation. These features show good agreement with experimental observations and shed light on the difficulties of numerical simulations.


title: Cloud-AC-OPF: Model Reduction Technique for Multi-Scenario Optimal Power Flow via Chance-Constrained Optimization

abstract: Many practical planning and operational applications in power systems require simultaneous consideration of a large number of operating conditions or Multi-Scenario AC-Optimal Power Flow (MS-AC-OPF) solution. However, when the number of exogenously prescribed conditions is large, solving the problem as a collection of single AC-OPFs may be time-consuming or simply intractable computationally. In this paper, we suggest a model reduction approach, coined Cloud-AC-OPF, which replaces a collection of samples by their compact representation in terms of mean and standard deviation. Instead of determining an optimal generation dispatch for each sample individually, we parametrize the generation dispatch as an affine function. The Cloud-AC-OPF is mathematically similar to a generalized Chance-Constrained AC-OPF (CC-AC-OPF) of the type recently discussed in the literature, but conceptually different as it discusses applications to long-term planning. We further propose a tractable formulation and implementation, and illustrate our construction on the example of 30-bus IEEE model.


title: Tight Linear Convergence Rate of ADMM for Decentralized Optimization

abstract: The present paper considers leveraging network topology information to improve the convergence rate of ADMM for decentralized optimization, where networked nodes work collaboratively to minimize the objective. Such problems can be solved efficiently using ADMM via decomposing the objective into easier subproblems. Properly exploiting network topology can significantly improve the algorithm performance. Hybrid ADMM explores the direction of exploiting node information by taking into account node centrality but fails to utilize edge information. This paper fills the gap by incorporating both node and edge information and provides a novel convergence rate bound for decentralized ADMM that explicitly depends on network topology. Such a novel bound is attainable for certain class of problems, thus tight. The explicit dependence further suggests possible directions to optimal design of edge weights to achieve the best performance. Numerical experiments show that simple heuristic methods could achieve better performance, and also exhibits robustness to topology changes.


title: A Polynomial-Based Approach for Architectural Design and Learning with Deep Neural Networks

abstract: In this effort we propose a novel approach for reconstructing multivariate functions from training data, by identifying both a suitable network architecture and an initialization using polynomial-based approximations. Training deep neural networks using gradient descent can be interpreted as moving the set of network parameters along the loss landscape in order to minimize the loss functional. The initialization of parameters is important for iterative training methods based on descent. Our procedure produces a network whose initial state is a polynomial representation of the training data. The major advantage of this technique is from this initialized state the network may be improved using standard training procedures. Since the network already approximates the data, training is more likely to produce a set of parameters associated with a desirable local minimum. We provide the details of the theory necessary for constructing such networks and also consider several numerical examples that reveal our approach ultimately produces networks which can be effectively trained from our initialized state to achieve an improved approximation for a large class of target functions.


title: Compress-Store on Blockchain: A Decentralized Data Processing and Immutable Storage for Multimedia Streaming

abstract: Decentralization for data storage is a challenging problem for blockchain-based solutions as the blocksize plays the key role for scalability. In addition, specific requirements of multimedia data calls for various changes in the blockchain technology internals. Considering one of the most popular applications of secure multimedia streaming, i.e., video surveillance, it is not clear how to judiciously encode incentivization, immutability and compression into a viable ecosystem. In this study, we provide a genuine scheme that achieves this encoding for a video surveillance application. The proposed scheme provides a novel integration of data compression, immutable off-chain data storage using a new consensus protocol namely, Proof-of-WorkStore (PoWS) in order to enable fully useful work to be performed by the miner nodes of the network. The proposed idea is the first step towards achieving greener application of blockchain-based environment to the video storage business that utilizes system resources efficiently.


title: Exact Imaging of Extended Targets Using Multistatic Interferometric Measurements

abstract: In this paper, we present a novel approach that can exactly recover extended targets in wave-based multistatic interferometric imaging, based on Generalized Wirtinger Flow (GWF) theory [1]. Interferometric imaging is a generalization of phase retrieval, which arises from cross-correlation of measurements from pairs of receivers in multistatic configuration. Unlike standard Wirtinger Flow, GWF theory guarantees exact recovery for arbitrary lifted forward models that satisfy the restricted isometry property over rank-1, positive semi-definite (PSD) matrices with a sufficiently small restricted isometry constant (RIC). To this end, we design a deterministic, lifted forward model for interferometric multistatic radar satisfying the exact recovery conditions of the GWF theory. Our results quantify a lower limit on the pixel spacing and the minimal sample complexity for exact multistatic radar imaging via GWF. We provide a numerical study of our RIC and pixel spacing bounds, which shows that GWF can achieve exact recovery with super-resolution. While our primary interest lies in radar imaging, our method is also applicable to other multistatic wave-based imaging problems such as those arising in acoustics and geophysics.


title: Recognizing pro-R closures of regular languages

abstract: Given a regular language L, we effectively construct a unary semigroup that recognizes the topological closure of L in the free unary semigroup relative to the variety of unary semigroups generated by the pseudovariety R of all finite R-trivial semigroups. In particular, we obtain a new effective solution of the separation problem of regular languages by R-languages.


title: Heavy ion physics at CMS and ATLAS: hard probes

abstract: Hard probes are indispensable tools to study the hot and dense quark-gluon matter created in ultra-relativistic heavy ion collisions. These probes are created in the collision itself with a small cross section, and they serve as indicators of various properties of the medium, such as temperature, viscosity, energy density, transport coefficients. Hard probes measured by the CMS and ATLAS experiments at the LHC include highly energetic jets and charged particles, quarkonium states, and electroweak gauge bosons. An overview of those recent experimental results will be given that represent the path towards high-precision measurements, even in the challenging, high-multiplicity environment created by colliding heavy ions.


title: Uniform a priori estimates for positive solutions of higher order Lane-Emden equations in $\mathbb{R}^n$

abstract: In this paper, we study the existence of uniform a priori estimates for positive solutions to Navier problems of higher order Lane-Emden equations \begin{equation*} (-\Delta)^{m}u(x)=u^{p}(x), \qquad \,\, x\in\Omega \end{equation*} for all large exponents $p$, where $\Omega\subset\mathbb{R}^{n}$ is a star-shaped or strictly convex bounded domain with $C^{2m-2}$ boundary, $n\geq4$ and $2\leq m\leq\frac{n}{2}$. Our results extend those of previous authors for second order $m=1$ to general higher order cases $m\geq2$.


title: Quantum Kinetic Theory of Spin Polarization of Massive Quarks in Perturbative QCD: Leading Log

abstract: We present the quantum kinetic equation for spin polarization of massive quarks in leading log order of perturbative QCD, which describes time evolution of the spin density matrix in momentum space of a massive quark interacting with a background QCD plasma. We find that the time evolution operator of the spin density matrix, or the quantum kinetic collision terms, are universally of order $\alpha_s^2\log(1/\alpha_s)$ in terms of the QCD coupling constant $\alpha_s=g^2/(4\pi)$. Our quantum kinetic equation is valid for an arbitrary quark mass $m\gg m_D\sim gT$, where $m_D$ is the Debye mass, and can be used to study relaxation dynamics of spin polarization of massive quarks in perturbative QCD regime.


title: Debiasing Word Embeddings Improves Multimodal Machine Translation

abstract: In recent years, pretrained word embeddings have proved useful for multimodal neural machine translation (NMT) models to address the shortage of available datasets. However, the integration of pretrained word embeddings has not yet been explored extensively. Further, pretrained word embeddings in high dimensional spaces have been reported to suffer from the hubness problem. Although some debiasing techniques have been proposed to address this problem for other natural language processing tasks, they have seldom been studied for multimodal NMT models. In this study, we examine various kinds of word embeddings and introduce two debiasing techniques for three multimodal NMT models and two language pairs -- English-German translation and English-French translation. With our optimal settings, the overall performance of multimodal models was improved by up to +1.93 BLEU and +2.02 METEOR for English-German translation and +1.73 BLEU and +0.95 METEOR for English-French translation.


title: First-principles study of metal-graphene edge contact for ballistic Josephson junction

abstract: Edge-contacted superconductor-graphene-superconductor Josephson junction have been utilized to realize topological superconductivity, which have shown superconducting signatures in the quantum Hall regime. We perform the first-principles calculations to interpret electronic couplings at the superconductor-graphene edge contacts by investigating various aspects in hybridization of molybdenum d orbitals and graphene $\pi$ orbitals. We also reveal that interfacial oxygen defects play an important role in determining the doping type of graphene near the interface.


title: Decentralized Bayesian Learning over Graphs

abstract: We propose a decentralized learning algorithm over a general social network. The algorithm leaves the training data distributed on the mobile devices while utilizing a peer to peer model aggregation method. The proposed algorithm allows agents with local data to learn a shared model explaining the global training data in a decentralized fashion. The proposed algorithm can be viewed as a Bayesian and peer-to-peer variant of federated learning in which each agent keeps a "posterior probability distribution" over a global model parameters. The agent update its "posterior" based on 1) the local training data and 2) the asynchronous communication and model aggregation with their 1-hop neighbors. This Bayesian formulation allows for a systematic treatment of model aggregation over any arbitrary connected graph. Furthermore, it provides strong analytic guarantees on converge in the realizable case as well as a closed form characterization of the rate of convergence. We also show that our methodology can be combined with efficient Bayesian inference techniques to train Bayesian neural networks in a decentralized manner. By empirical studies we show that our theoretical analysis can guide the design of network/social interactions and data partitioning to achieve convergence.


title: Group-theoretic classification of superconducting states of Strontium Ruthenate

abstract: The possible superconducting states of strontium ruthenate (Sr$_2$RuO$_4$) are organized into irreducible representations of the point group $D_{4h}$, with a special emphasis on nodes occurring within the superconducting gap. Our analysis covers the cases with and without spin-orbit coupling and takes into account the possibility of inter-orbital pairing within a three-band, tight-binding description of Sr$_2$RuO$_4$. No dynamical treatment if performed: we are confining ourselves to a group-theoretical analysis. The case of uniaxial deformations, under which the point group symmetry is reduced to $D_{2h}$, is also covered. It turns out that nodal lines, in particular equatorial nodal lines, occur in most representations. We also highlight some results specific to multiorbital superconductivity. Among other things, we find that odd inter-orbital pairing allows to combine singlet and triplet superconductivity whithin the same irreducible representation, that pure inter-orbital superconductivity leads to nodal surfaces and that the notion of nodes imposed by symmetry is not clearly defined.


title: A Deep Learning Wireless Transceiver with Fully Learned Modulation and Synchronization

abstract: In this paper, we present a deep learning based wireless transceiver. We describe in detail the corresponding artificial neural network architecture, the training process, and report on excessive over-the-air measurement results. We employ the end-to-end training approach with an autoencoder model that includes a channel model in the middle layers as previously proposed in the literature. In contrast to other state-of-the-art results, our architecture supports learning time synchronization without any manually designed signal processing operations. Moreover, the neural transceiver has been tested over the air with an implementation in software defined radio. Our experimental results for the implemented single antenna system demonstrate a raw bit-rate of 0.5 million bits per second. This exceeds results from comparable systems presented in the literature and suggests the feasibility of high throughput deep learning transceivers.


title: Meshfree Methods on Manifolds for Hydrodynamic Flows on Curved Surfaces: A Generalized Moving Least-Squares (GMLS) Approach

abstract: We utilize generalized moving least squares (GMLS) to develop meshfree techniques for discretizing hydrodynamic flow problems on manifolds. We use exterior calculus to formulate incompressible hydrodynamic equations in the Stokesian regime and handle the divergence-free constraints via a generalized vector potential. This provides less coordinate-centric descriptions and enables the development of efficient numerical methods and splitting schemes for the fourth-order governing equations in terms of a system of second-order elliptic operators. Using a Hodge decomposition, we develop methods for manifolds having spherical topology. We show the methods exhibit high-order convergence rates for solving hydrodynamic flows on curved surfaces. The methods also provide general high-order approximations for the metric, curvature, and other geometric quantities of the manifold and associated exterior calculus operators. The approaches also can be utilized to develop high-order solvers for other scalar-valued and vector-valued problems on manifolds.

categories: math.NA cond-mat.soft cs.CE cs.CG cs.NA q-bio.QM


title: On the calculation of covariant expressions for Dirac bilinears

abstract: In this article, various approaches to calculate covariant expressions for the bilinears of Dirac spinors are presented. For this purpose, algebraic equations defining Dirac spinors are discussed. Following that, a covariant approach for spacetime parameterization is presented and the equations defining Dirac spinors are written fully in terms of Lorentz scalars. After presenting how the tensorial bilinears can be reduced to combinations of scalar bilinears with appropriate Lorentz structures, a covariant recipe for the calculation of scalar bilinears is provided.


title: The link between E-B polarization modes and gas column density from interstellar dust emission

abstract: The analysis of the Planck polarization E and B mode power spectra of interstellar dust emission at 353 GHz recently raised new questions on the impact of Galactic foregrounds to the detection of the polarization of the Cosmic Microwave Background (CMB) and on the physical properties of the interstellar medium (ISM). In the diffuse ISM a clear E-B asymmetry is observed, with twice as much power in E modes than in B modes; as well as a positive correlation between the total power, T, and both E and B modes, presently interpreted in terms of the link between the structure of interstellar matter and that of the Galactic magnetic field. In this paper we aim at extending the Planck analysis of the high-latitude sky to low Galactic latitude, investigating the correlation between the TEB power spectra with the gas column density from the diffuse ISM to molecular clouds. We divide the sky between Galactic latitude |b|>5 deg and |b|<60 deg in 552 circular patches and we study the cross-correlations between the TEB power spectra and the column density of each patch using the latest release of the Planck polarization data. We find that the B-to-E power ratio (BB/EE) and the TE correlation ratio (rTE) depend on column density. While the former increases going from the diffuse ISM to molecular clouds in the Gould Belt, the latter decreases. This systematic variation must be related to actual changes in ISM properties. The data show significant scatter about this mean trend. The variations of BB/EE and rTE are observed to be anti-correlated for all column densities. In the diffuse ISM, the variance of these two ratios is consistent with a stochastic non-Gaussian model in which the values of BB/EE and rTE are fixed. We finally discuss the dependencies of TB and EB with column density, which are however hampered by instrumental noise.


title: Accelerating Distributed Optimization via Fixed-time Convergent Flows: Extensions to Non-convex Functions and Consistent Discretization

abstract: Distributed optimization has gained significant attention in recent years, primarily fueled by the availability of a large amount of data and privacy-preserving requirements. This paper presents a fixed-time convergent optimization algorithm for solving a potentially non-convex optimization problem using a first-order multi-agent system. Each agent in the network can access only its private objective function, while local information exchange is permitted between the neighbors. The proposed optimization algorithm combines a fixed-time convergent distributed parameter estimation scheme with a fixed-time distributed consensus scheme as its solution methodology. The results are presented under the assumption that the team objective function is strongly convex, as opposed to the common assumptions in the literature requiring each of the local objective functions to be strongly convex. The results extend to the class of possibly non-convex team objective functions satisfying only the Polyak-\L ojasiewicz (PL) inequality. It is also shown that the proposed continuous-time scheme, when discretized using Euler's method, leads to consistent discretization, i.e., the fixed-time convergence behavior is preserved under discretization. Numerical examples comprising large-scale distributed linear regression and training of neural networks corroborate our theoretical analysis.


title: Hyperrigidity of C*-correspondences

abstract: We show that hyperrigidity for a C*-correspondence $(A,X)$ is equivalent to non-degeneracy of the left action of the Katsura ideal $\mathcal{J}_X$ on $X$. Due to the work of Katsoulis and Ramsey, our result shows that if $G$ is a locally compact group acting on $(A,X)$ and the Katsura ideal $\mathcal{J}_X$ acts on $X$ non-degenerately then the Hao-Ng isomorphism problem for reduced crossed products has a positive solution and the Hao-Ng isomorphism problem for full crossed products has a partial solution.


title: A view of Estimation of Distribution Algorithms through the lens of Expectation-Maximization

abstract: We show that a large class of Estimation of Distribution Algorithms, including, but not limited to, Covariance Matrix Adaption, can be written as a Monte Carlo Expectation-Maximization algorithm, and as exact EM in the limit of infinite samples. Because EM sits on a rigorous statistical foundation and has been thoroughly analyzed, this connection provides a new coherent framework with which to reason about EDAs.


title: Ab initio limits of atomic nuclei

abstract: We predict the limits of existence of atomic nuclei, the proton and neutron drip lines, from the light through medium-mass regions. Starting from a chiral two- and three-nucleon interaction with good saturation properties, we use the valence-space in-medium similarity renormalization group to calculate ground-state and separation energies from helium to iron, nearly 700 isotopes in total. We use the available experimental data to quantify the theoretical uncertainties for our ab initio calculations towards the drip lines. Where the drip lines are known experimentally, our predictions are consistent within the estimated uncertainty. For the neutron-rich sodium to chromium isotopes, we provide predictions to be tested at rare-isotope beam facilities.


title: Hidden outlier noise and its mitigation

abstract: In addition to ever-present thermal noise, various communication and sensor systems can contain significant amounts of interference with outlier (e.g. impulsive) characteristics. Such outlier noise can be efficiently mitigated in real-time using intermittently nonlinear filters. Depending on the noise nature and composition, improvements in the quality of the signal of interest will vary from "no harm" to substantial. In this paper, we explain in detail why the underlying outlier nature of interference often remains obscured, discussing the many challenges and misconceptions associated with state-of-art analog and/or digital nonlinear mitigation techniques, especially when addressing complex practical interference scenarios. We then focus on the methodology and tools for real-time outlier noise mitigation, demonstrating how the "excess band" observation of outlier noise enables its efficient in-band mitigation. We introduce the basic real-time nonlinear components that are used for outlier noise filtering, and provide examples of their implementation. We further describe complementary nonlinear filtering arrangements for wide- and narrow-band outlier noise reduction, providing several illustrations of their performance and the effect on channel capacity. Finally, we outline "effectively analog" digital implementations of these filtering structures, discuss their broader applications, and comment on the ongoing development of the platform for their demonstration and testing.


title: Efficiently Estimating Erdos-Renyi Graphs with Node Differential Privacy

abstract: We give a simple, computationally efficient, and node-differentially-private algorithm for estimating the parameter of an Erdos-Renyi graph---that is, estimating p in a G(n,p)---with near-optimal accuracy. Our algorithm nearly matches the information-theoretically optimal exponential-time algorithm for the same problem due to Borgs et al. (FOCS 2018). More generally, we give an optimal, computationally efficient, private algorithm for estimating the edge-density of any graph whose degree distribution is concentrated on a small interval.


title: Bayesian Tensorized Neural Networks with Automatic Rank Selection

abstract: Tensor decomposition is an effective approach to compress over-parameterized neural networks and to enable their deployment on resource-constrained hardware platforms. However, directly applying tensor compression in the training process is a challenging task due to the difficulty of choosing a proper tensor rank. In order to achieve this goal, this paper proposes a Bayesian tensorized neural network. Our Bayesian method performs automatic model compression via an adaptive tensor rank determination. We also present approaches for posterior density calculation and maximum a posteriori (MAP) estimation for the end-to-end training of our tensorized neural network. We provide experimental validation on a fully connected neural network, a CNN and a residual neural network where our work produces $7.4\times$ to $137\times$ more compact neural networks directly from the training.


title: Robust learning with implicit residual networks

abstract: In this effort, we propose a new deep architecture utilizing residual blocks inspired by implicit discretization schemes. As opposed to the standard feed-forward networks, the outputs of the proposed implicit residual blocks are defined as the fixed points of the appropriately chosen nonlinear transformations. We show that this choice leads to the improved stability of both forward and backward propagations, has a favorable impact on the generalization power and allows to control the robustness of the network with only a few hyperparameters. In addition, the proposed reformulation of ResNet does not introduce new parameters and can potentially lead to a reduction in the number of required layers due to improved forward stability. Finally, we derive the memory-efficient training algorithm, propose a stochastic regularization technique and provide numerical results in support of our findings.


title: Correntropy Based Robust Decomposition of Neuromodulations

abstract: Neuromodulations as observed in the extracellular electrical potential recordings obtained from Electroencephalograms (EEG) manifest as organized, transient patterns that differ statistically from their featureless noisy background. Leveraging on this statistical dissimilarity, we propose a noniterative robust classification algorithm to isolate, in time, these neuromodulations from the temporally disorganized but structured background activity while simultaneously incorporating temporal sparsity of the events. Specifically, we exploit the ability of correntropy to asses higher - order moments as well as imply the degree of similarity between two random variables in the joint space regulated by the kernel bandwidth. We test our algorithm on DREAMS Sleep Spindle Database and further elaborate on the hyperparameters introduced. Finally, we compare the performance of the algorithm with two algorithms designed on similar ideas; one of which is a quick, simple norm based technique while the other parallels the state-of-the-art Robust Principal Component Analysis (RPCA) to achieve classification. The algorithm is able to match the performance of the state-of-the-art techniques while saving tremendously on computation time and complexity.


title: Asymptotic Improvements to Quantum Circuits via Qutrits

abstract: Quantum computation is traditionally expressed in terms of quantum bits, or qubits. In this work, we instead consider three-level qu$trits$. Past work with qutrits has demonstrated only constant factor improvements, owing to the $\log_2(3)$ binary-to-ternary compression factor. We present a novel technique using qutrits to achieve a logarithmic depth (runtime) decomposition of the Generalized Toffoli gate using no ancilla--a significant improvement over linear depth for the best qubit-only equivalent. Our circuit construction also features a 70x improvement in two-qudit gate count over the qubit-only equivalent decomposition. This results in circuit cost reductions for important algorithms like quantum neurons and Grover search. We develop an open-source circuit simulator for qutrits, along with realistic near-term noise models which account for the cost of operating qutrits. Simulation results for these noise models indicate over 90% mean reliability (fidelity) for our circuit construction, versus under 30% for the qubit-only baseline. These results suggest that qutrits offer a promising path towards scaling quantum computation.


title: Multi-Model Investigative Exploration of Social Media Data with boutique: A Case Study in Public Health

abstract: We present our experience with a data science problem in Public Health, where researchers use social media (Twitter) to determine whether the public shows awareness of HIV prevention measures offered by Public Health campaigns. To help the researcher, we develop an investigative exploration system called boutique that allows a user to perform a multi-step visualization and exploration of data through a dashboard interface. Unique features of boutique includes its ability to handle heterogeneous types of data provided by a polystore, and its ability to use computation as part of the investigative exploration process. In this paper, we present the design of the boutique middleware and walk through an investigation process for a real-life problem.


title: On the product dimension of clique factors

abstract: The product dimension of a graph $G$ is the minimum possible number of proper vertex colorings of $G$ so that for every pair $u,v$ of non-adjacent vertices there is at least one coloring in which $u$ and $v$ have the same color. What is the product dimension $Q(s,r)$ of the vertex disjoint union of $r$ cliques, each of size $s$? Lov\'asz, Ne\v{s}et\v{r}il and Pultr proved in 1980 that for $s=2$ it is $(1+o(1)) \log_2 r$ and raised the problem of estimating this function for larger values of $s$. We show that for every fixed $s$, the answer is still $(1+o(1)) \log_2 r$ where the $o(1)$ term tends to $0$ as $r$ tends to infinity, but the problem of determining the asymptotic behavior of $Q(s,r)$ when $s$ and $r$ grow together remains open. The proof combines linear algebraic tools with the method of Gargano, K\"orner, and Vaccaro on Sperner capacities of directed graphs.


title: Fully Hyperbolic Convolutional Neural Networks

abstract: Convolutional Neural Networks (CNN) have recently seen tremendous success in various computer vision tasks. However, their application to problems with high dimensional input and output, such as high-resolution image and video segmentation or 3D medical imaging, has been limited by various factors. Primarily, in the training stage, it is necessary to store network activations for back propagation. In these settings, the memory requirements associated with storing activations can exceed what is feasible with current hardware, especially for problems in 3D. Motivated by the propagation of signals over physical networks, that are governed by the hyperbolic Telegraph equation, in this work we introduce a fully conservative hyperbolic network for problems with high dimensional input and output. We introduce a coarsening operation that allows completely reversible CNNs by using a learnable Discrete Wavelet Transform and its inverse to both coarsen and interpolate the network state and change the number of channels. We show that fully reversible networks are able to achieve results comparable to the state of the art in 4D time-lapse hyper spectral image segmentation and full 3D video segmentation, with a much lower memory footprint that is a constant independent of the network depth. We also extend the use of such networks to Variational Auto Encoders with high resolution input and output.


title: Generative Latent Flow

abstract: In this work, we propose the Generative Latent Flow (GLF), an algorithm for generative modeling of the data distribution. GLF uses an Auto-encoder (AE) to learn latent representations of the data, and a normalizing flow to map the distribution of the latent variables to that of simple i.i.d noise. In contrast to some other Auto-encoder based generative models, which use various regularizers that encourage the encoded latent distribution to match the prior distribution, our model explicitly constructs a mapping between these two distributions, leading to better density matching while avoiding over regularizing the latent variables. We compare our model with several related techniques, and show that it has many relative advantages including fast convergence, single stage training and minimal reconstruction trade-off. We also study the relationship between our model and its stochastic counterpart, and show that our model can be viewed as a vanishing noise limit of VAEs with flow prior. Quantitatively, under standardized evaluations, our method achieves state-of-the-art sample quality among AE based models on commonly used datasets, and is competitive with GANs' benchmarks.


title: Designing a Symbolic Intermediate Representation for Neural Surface Realization

abstract: Generated output from neural NLG systems often contain errors such as hallucination, repetition or contradiction. This work focuses on designing a symbolic intermediate representation to be used in multi-stage neural generation with the intention of reducing the frequency of failed outputs. We show that surface realization from this intermediate representation is of high quality and when the full system is applied to the E2E dataset it outperforms the winner of the E2E challenge. Furthermore, by breaking out the surface realization step from typically end-to-end neural systems, we also provide a framework for non-neural content selection and planning systems to potentially take advantage of semi-supervised pretraining of neural surface realization models.


title: Entanglement entropy and superselection sectors I. Global symmetries

abstract: Some quantum field theories show, in a fundamental or an effective manner, an alternative between a loss of duality for algebras of operators corresponding to complementary regions, or a loss of additivity. In this latter case, the algebra contains some operator that is not generated locally, in the former, the entropies of complementary regions do not coincide. Typically, these features are related to the incompleteness of the operator content of the theory, or, in other words, to the existence of superselection sectors. We review some aspects of the mathematical literature on superselection sectors aiming attention to the physical picture and focusing on the consequences for entanglement entropy (EE). For purposes of clarity, the whole discussion is divided into two parts according to the superselection sectors classification: The present part I is devoted to superselection sectors arising from global symmetries, and the forthcoming part II will consider those arising from local symmetries. Under this perspective, here restricted to global symmetries, we study in detail different cases such as models with finite and Lie group symmetry as well as with spontaneous symmetry breaking or excited states. We illustrate the general results with simple examples. As an important application, we argue the features of holographic entanglement entropy correspond to a picture of a sub-theory with a large number of superselection sectors and suggest some ways in which this identification could be made more precise.


title: GAN2GAN: Generative Noise Learning for Blind Denoising with Single Noisy Images

abstract: We tackle a challenging blind image denoising problem, in which only single distinct noisy images are available for training a denoiser, and no information about noise is known, except for it being zero-mean, additive, and independent of the clean image. In such a setting, which often occurs in practice, it is not possible to train a denoiser with the standard discriminative training or with the recently developed Noise2Noise (N2N) training; the former requires the underlying clean image for the given noisy image, and the latter requires two independently realized noisy image pair for a clean image. To that end, we propose GAN2GAN (Generated-Artificial-Noise to Generated-Artificial-Noise) method that first learns a generative model that can 1) simulate the noise in the given noisy images and 2) generate a rough, noisy estimates of the clean images, then 3) iteratively trains a denoiser with subsequently synthesized noisy image pairs (as in N2N), obtained from the generative model. In results, we show the denoiser trained with our GAN2GAN achieves an impressive denoising performance on both synthetic and real-world datasets for the blind denoising setting; it almost approaches the performance of the standard discriminatively-trained or N2N-trained models that have more information than ours, and it significantly outperforms the recent baseline for the same setting, \textit{e.g.}, Noise2Void, and a more conventional yet strong one, BM3D. The official code of our method is available at https://github.com/csm9493/GAN2GAN.


title: High Redshift Obscured Quasars and the Need for Optical to NIR, Massively Multiplexed, Spectroscopic Facilities

abstract: Most bulge-dominated galaxies host black holes with masses that tightly correlate with the masses of their bulges. This may indicate that the black holes may regulate galaxy growth or vice versa, or that they may grow in lock-step. The quest to understand how, when, and where those black-holes formed motivates much of extragalactic astronomy. Here we focus on a population of galaxies with active black holes in their nuclei (active galactic nuclei or AGN), that are fully or partially hidden by dust and gas: the emission from the broad line region is either completely or partially obscured with a visual extinction of 1 or above. This limit, though not yet precise, appears to be the point at which the populations of AGN may evolve differently. We highlight the importance of finding and studying those dusty AGN at redshifts between 1 and 3, the epoch when the universe may have gone through its most dramatic changes. We emphasize the need for future large multiplexed spectroscopic instruments that can perform dedicated surveys in the optical and NIR to pin down the demographics of such objects and study their reddening properties, star-formation histories, and excitation conditions. These key studies will shed light on the role of black holes in galaxy evolution during the epoch of peak growth activity.


title: Finding new routes for integrating Multi-Agent Systems using Apache Camel

abstract: In Multi-Agent Systems (MAS) there are two main models of interaction: among agents, and between agents and the environment. Although there are studies considering these models, there is no practical tool to afford the interaction with external entities with both models. This paper presents a proposal for such a tool based on the Apache Camel framework by designing two new components, namely camel-jason and camel-artifact. By means of these components, an external entity is modelled according to its nature, i.e., whether it is autonomous or non-autonomous, interacting with the MAS respectively as an agent or an artifact. It models coherently external entities whereas Camel provides interoperability with several communication protocols.


title: Traveling-Wave Solutions to the Nonlinear Double Degenerate Parabolic Equation of Turbulent Filtration with Absorption

abstract: In this paper we prove the existence of finite traveling-wave type solutions to the nonlinear double degenerate parabolic equation of turbulent filtration with absorption.


title: Reconstruction of the Cosmic Equation of State for High Redshift

abstract: We investigate the possibilities of reconstructing the cosmic equation of state (EoS) for high redshift. In order to obtain general results, we use two model-independent approaches. The first reconstructs the EoS using comoving distance and the second makes use of the Hubble parameter data. To implement the first method, we use a recent set of Gamma-Ray Bursts (GRBs) measures. To implement the second method, we generate simulated data using the Sandage-Loeb ($SL$) effect; for the fiducial model, we use the $\Lambda CDM$ model. In both cases, the statistical analysis is conducted through the Gaussian processes (non-parametric). In general, we demonstrate that this methodology for reconstructing the EoS using a non-parametric method plus a model-independent approach works appropriately due to the feasibility of calculation and the ease of introducing a priori information ($H_ {0}$ and $\Omega_{m0}$). In the near future, following this methodology with a higher number of high quality data will help obtain strong restrictions for the EoS.


title: Safely and Quickly Deploying New Features with a Staged Rollout Framework Using Sequential Test and Adaptive Experimental Design

abstract: During the rapid development cycle for Internet products (websites and mobile apps), new features are developed and rolled out to users constantly. Features with code defects or design flaws can cause outages and significant degradation of user experience. The traditional method of code review and change management can be time-consuming and error-prone. In order to make the feature rollout process safe and fast, this paper proposes a methodology for rolling out features in an automated way using an adaptive experimental design. Under this framework, a feature is gradually ramped up from a small proportion of users to a larger population based on real-time evaluation of the performance of important metrics. If there are any regression detected during the ramp-up step, the ramp-up process stops and the feature developer is alerted. There are two main algorithm components powering this framework: 1) a continuous monitoring algorithm - using a variant of the sequential probability ratio test (SPRT) to monitor the feature performance metrics and alert feature developers when a metric degradation is detected, 2) an automated ramp-up algorithm - deciding when and how to ramp up to the next stage with larger sample size. This paper presents one monitoring algorithm and three ramping up algorithms including time-based, power-based, and risk-based (a Bayesian approach) schedules. These algorithms are evaluated and compared on both simulated data and real data. There are three benefits provided by this framework for feature rollout: 1) for defective features, it can detect the regression early and reduce negative effect, 2) for healthy features, it rolls out the feature quickly, 3) it reduces the need for manual intervention via the automation of the feature rollout process.


title: On the Constructive Truth and Falsity in Peano Arithmetic

abstract: Recently, Artemov [4] offered the notion of constructive consistency for Peano Arithmetic and generalized it to constructive truth and falsity in the spirit of Brouwer-Heyting-Kolmogorov semantics and its formalization, the Logic of Proofs. In this paper, we provide a complete description of constructive truth and falsity for Friedman's constant fragment of Peano Arithmetic. For this purpose, we generalize the constructive falsity to n-constructive falsity where n is any positive natural number. We also establish similar classification results for constructive truth and n-constructive falsity of Friedman's formulas. Then, we discuss `extremely' independent sentences in the sense that they are classically true but %unprovable in Peano Arithmetic neither constructively true nor n-constructive false for any n.


title: Canonical lifts and $\delta$-structures

abstract: We extend the Serre-Tate theory of canonical lifts of ordinary abelian varieties to arbitrary unpolarised families of ordinary abelian varieties parameterised by a $p$-adic formal scheme $S$. We show that the canonical lift is the unique lift to $W(S)$ which admits a $\delta$-structure in the sense of Joyal, Buium, and Bousfield. We prove analogous statements for families of ordinary $p$-groups and $p$-divisible groups.


title: Variational Inference for Sparse Gaussian Process Modulated Hawkes Process

abstract: The Hawkes process (HP) has been widely applied to modeling self-exciting events including neuron spikes, earthquakes and tweets. To avoid designing parametric triggering kernel and to be able to quantify the prediction confidence, the non-parametric Bayesian HP has been proposed. However, the inference of such models suffers from unscalability or slow convergence. In this paper, we aim to solve both problems. Specifically, first, we propose a new non-parametric Bayesian HP in which the triggering kernel is modeled as a squared sparse Gaussian process. Then, we propose a novel variational inference schema for model optimization. We employ the branching structure of the HP so that maximization of evidence lower bound (ELBO) is tractable by the expectation-maximization algorithm. We propose a tighter ELBO which improves the fitting performance. Further, we accelerate the novel variational inference schema to linear time complexity by leveraging the stationarity of the triggering kernel. Different from prior acceleration methods, ours enjoys higher efficiency. Finally, we exploit synthetic data and two large social media datasets to evaluate our method. We show that our approach outperforms state-of-the-art non-parametric frequentist and Bayesian methods. We validate the efficiency of our accelerated variational inference schema and practical utility of our tighter ELBO for model selection. We observe that the tighter ELBO exceeds the common one in model selection.


title: Fair Resource Allocation in Federated Learning

abstract: Federated learning involves training statistical models in massive, heterogeneous networks. Naively minimizing an aggregate loss function in such a network may disproportionately advantage or disadvantage some of the devices. In this work, we propose q-Fair Federated Learning (q-FFL), a novel optimization objective inspired by fair resource allocation in wireless networks that encourages a more fair (specifically, a more uniform) accuracy distribution across devices in federated networks. To solve q-FFL, we devise a communication-efficient method, q-FedAvg, that is suited to federated networks. We validate both the effectiveness of q-FFL and the efficiency of q-FedAvg on a suite of federated datasets with both convex and non-convex models, and show that q-FFL (along with q-FedAvg) outperforms existing baselines in terms of the resulting fairness, flexibility, and efficiency.


title: Cold Case: The Lost MNIST Digits

abstract: Although the popular MNIST dataset [LeCun et al., 1994] is derived from the NIST database [Grother and Hanaoka, 1995], the precise processing steps for this derivation have been lost to time. We propose a reconstruction that is accurate enough to serve as a replacement for the MNIST dataset, with insignificant changes in accuracy. We trace each MNIST digit to its NIST source and its rich metadata such as writer identifier, partition identifier, etc. We also reconstruct the complete MNIST test set with 60,000 samples instead of the usual 10,000. Since the balance 50,000 were never distributed, they enable us to investigate the impact of twenty-five years of MNIST experiments on the reported testing performances. Our results unambiguously confirm the trends observed by Recht et al. [2018, 2019]: although the misclassification rates are slightly off, classifier ordering and model selection remain broadly reliable. We attribute this phenomenon to the pairing benefits of comparing classifiers on the same digits.


title: PTrix: Efficient Hardware-Assisted Fuzzing for COTS Binary

abstract: Despite its effectiveness in uncovering software defects, American Fuzzy Lop (AFL), one of the best grey-box fuzzers, is inefficient when fuzz-testing source-unavailable programs. AFL's binary-only fuzzing mode, QEMU-AFL, is typically 2-5X slower than its source-available fuzzing mode. The slowdown is largely caused by the heavy dynamic instrumentation. Recent fuzzing techniques use Intel Processor Tracing (PT), a light-weight tracing feature supported by recent Intel CPUs, to remove the need of dynamic instrumentation. However, we found that these PT-based fuzzing techniques are even slower than QEMU-AFL when fuzzing real-world programs, making them less effective than QEMU-AFL. This poor performance is caused by the slow extraction of code coverage information from highly compressed PT traces. In this work, we present the design and implementation of PTrix, which fully unleashes the benefits of PT for fuzzing via three novel techniques. First, PTrix introduces a scheme to highly parallel the processing of PT trace and target program execution. Second, it directly takes decoded PT trace as feedback for fuzzing, avoiding the expensive reconstruction of code coverage information. Third, PTrix maintains the new feedback with stronger feedback than edge-based code coverage, which helps reach new code space and defects that AFL may not. We evaluated PTrix by comparing its performance with the state-of-the-art fuzzers. Our results show that, given the same amount of time, PTrix achieves a significantly higher fuzzing speed and reaches into code regions missed by the other fuzzers. In addition, PTrix identifies 35 new vulnerabilities in a set of previously well-fuzzed binaries, showing its ability to complement existing fuzzers.


title: Maximal Free-Space Concentration of Electromagnetic Waves

abstract: We derive upper bounds to free-space concentration of electromagnetic waves, mapping out the limits to maximum intensity for any spot size and optical beam-shaping device. For sub-diffraction-limited optical beams, our bounds suggest the possibility for orders-of-magnitude intensity enhancements compared to existing demonstrations, and we use inverse design to discover metasurfaces operating near these new limits. We also demonstrate that our bounds may surprisingly describe maximum concentration defined by a wide variety of metrics. Our bounds require no assumptions about symmetry, scalar waves, or weak scattering, instead relying primarily on the transformation of a quadratic program via orthogonal-projection methods. The bounds and inverse-designed structures presented here can be useful for applications from imaging to 3D printing.


title: Learning to Reason in Large Theories without Imitation

abstract: In this paper, we demonstrate how to do automated theorem proving in the presence of a large knowledge base of potential premises without learning from human proofs. We suggest an exploration mechanism that mixes in additional premises selected by a tf-idf (term frequency-inverse document frequency) based lookup in a deep reinforcement learning scenario. This helps with exploring and learning which premises are relevant for proving a new theorem. Our experiments show that the theorem prover trained with this exploration mechanism outperforms provers that are trained only on human proofs. It approaches the performance of a prover trained by a combination of imitation and reinforcement learning. We perform multiple experiments to understand the importance of the underlying assumptions that make our exploration approach work, thus explaining our design choices.


title: TurboNet: A Model-driven DNN Decoder Based on Max-Log-MAP Algorithm for Turbo Code

abstract: This paper presents TurboNet, a novel model-driven deep learning (DL) architecture for turbo decoding that combines DL with the traditional max-log-maximum a posteriori (MAP) algorithm. To design TurboNet, we unfold the original iterative structure for turbo decoding and replace each iteration by a deep neural network (DNN) decoding unit. In particular, the DNN decoding unit is obtained by parameterizing the max-log-MAP algorithm rather than replace the whole decoder with a black box fully connected DNN architecture. With the proposed architecture, the parameters can be efficiently learned from training data, and thus TurboNet learns to appropriately use systematic and parity information to offer higher error correction capabilities and decrease computational complexity compared with existing methods. Furthermore, simulation results prove TurboNet's superiority in signal-to-noise ratio generalizations.


title: Computing the Laplacian spectrum of linear octagonal-quadrilateral networks and its applications

abstract: Let Ln denote linear octagonal-quadrilateral networks. In this paper, we aim to firstly investigate the Laplacian spectrum on the basis of Laplacian polynomial of Ln. Then, by applying the relationship between the coefficients and roots of the polynomials, the Kirchhoff index and the complexity are determined.


title: On constructions and properties of $(n,m)$-functions with maximal number of bent components

abstract: For any positive integers $n=2k$ and $m$ such that $m\geq k$, in this paper we show the maximal number of bent components of any $(n,m)$-functions is equal to $2^{m}-2^{m-k}$, and for those attaining the equality, their algebraic degree is at most $k$. It is easily seen that all $(n,m)$-functions of the form $G(x)=(F(x),0)$ with $F(x)$ being any vectorial bent $(n,k)$-function, have the maximum number of bent components. Those simple functions $G$ are called trivial in this paper. We show that for a power $(n,n)$-function, it has such large number of bent components if and only if it is trivial under a mild condition. We also consider the $(n,n)$-function of the form $F^{i}(x)=x^{2^{i}}h({\rm Tr}^{n}_{e}(x))$, where $h: \mathbb{F}_{2^{e}} \rightarrow \mathbb{F}_{2^{e}}$, and show that $F^{i}$ has such large number if and only if $e=k$, and $h$ is a permutation over $\mathbb{F}_{2^{k}}$. It proves that all the previously known nontrivial such functions are subclasses of the functions $F^{i}$. Based on the Maiorana-McFarland class, we present constructions of large numbers of $(n,m)$-functions with maximal number of bent components for any integer $m$ in bivariate representation. We also determine the differential spectrum and Walsh spectrum of the constructed functions. It is found that our constructions can also provide new plateaued vectorial functions.


title: Construction of genuine multipartite entangled states

abstract: Genuine multipartite entanglement is of great importance in quantum information, especially from the experimental point of view. Nevertheless, it is difficult to construct genuine multipartite entangled states systematically, because the genuine multipartite entanglement is unruly. We propose another product based on the Kronecker product in this paper. The Kronecker product is a common product in quantum information with good physical interpretation. We mainly investigate whether the proposed product of two genuine multipartite entangled states is still a genuine entangled one. We understand the entanglement of the proposed product better by characterizing the entanglement of the Kronecker product. Then we show the proposed product is a genuine multipartite entangled state in two cases. The results provide a systematical method to construct genuine multipartite entangled states of more parties.


title: A Kernel Loss for Solving the Bellman Equation

abstract: Value function learning plays a central role in many state-of-the-art reinforcement-learning algorithms. Many popular algorithms like Q-learning do not optimize any objective function, but are fixed-point iterations of some variant of Bellman operator that is not necessarily a contraction. As a result, they may easily lose convergence guarantees, as can be observed in practice. In this paper, we propose a novel loss function, which can be optimized using standard gradient-based methods without risking divergence. The key advantage is that its gradient can be easily approximated using sampled transitions, avoiding the need for double samples required by prior algorithms like residual gradient. Our approach may be combined with general function classes such as neural networks, on either on- or off-policy data, and is shown to work reliably and effectively in several benchmarks.


title: On Obtaining Sharp Bounds of the Rate of Convergence for a Class of Continuous-Time Markov Chains

abstract: We study inhomogeneous continuous-time weakly ergodic Markov chains with a finite state space. We introduce the notion of a Markov chain with the regular structure of an infinitesimal matrix and study the sharp upper bounds on the rate of convergence for such class of Markov chains.


title: Constructing vectorial bent functions via second-order derivatives

abstract: Let $n$ be an even positive integer, and $m<n$ be one of its positive divisors. In this paper, inspired by a nice work of Tang et al. on constructing large classes of bent functions from known bent functions [27, IEEE TIT, 63(10): 6149-6157, 2017], we consider the construction of vectorial bent and vectorial plateaued $(n,m)$-functions of the form $H(x)=G(x)+g(x)$, where $G(x)$ is a vectorial bent $(n,m)$-function, and $g(x)$ is a Boolean function over $\mathbb{F}_{2^{n}}$. We find an efficient generic method to construct vectorial bent and vectorial plateaued functions of this form by establishing a link between the condition on the second-order derivatives and the key condition given by [27]. This allows us to provide (at least) three new infinite families of vectorial bent functions with high algebraic degrees. New vectorial plateaued $(n,m+t)$-functions are also obtained ($t\geq 0$ depending on $n$ can be taken as a very large number), two classes of which have the maximal number of bent components.


title: Black hole shadow as a standard ruler in cosmology

abstract: Advancements in the black hole shadow observations may allow us not only to investigate physics in the strong gravity regime, but also to use them in cosmological studies. In this paper, we propose to use the shadow of supermassive black holes as a standard ruler for cosmological applications assuming the black hole mass can be determined independently. First, observations at low redshift distances can be used to constrain the Hubble constant independently. Secondly, the angular size of shadows of high redshift black holes is increased due to cosmic expansion and may also be reachable with future observations. This would allow us to probe the cosmic expansion history for the redshift range elusive to other distance measurements. Additionally, shadow can be used to estimate the mass of black holes at high redshift, assuming that cosmology is known.


title: Enhancing Adversarial Defense by k-Winners-Take-All

abstract: We propose a simple change to existing neural network structures for better defending against gradient-based adversarial attacks. Instead of using popular activation functions (such as ReLU), we advocate the use of k-Winners-Take-All (k-WTA) activation, a C0 discontinuous function that purposely invalidates the neural network model's gradient at densely distributed input data points. The proposed k-WTA activation can be readily used in nearly all existing networks and training methods with no significant overhead. Our proposal is theoretically rationalized. We analyze why the discontinuities in k-WTA networks can largely prevent gradient-based search of adversarial examples and why they at the same time remain innocuous to the network training. This understanding is also empirically backed. We test k-WTA activation on various network structures optimized by a training method, be it adversarial training or not. In all cases, the robustness of k-WTA networks outperforms that of traditional networks under white-box attacks.


title: Observation of quantum depletion in a nonequilibrium exciton-polariton condensate

abstract: The property of superfluidity, first discovered in liquid 4He, is closely related to Bose-Einstein condensation (BEC) of interacting bosons. However, even at zero temperature, when one would expect the whole bosonic quantum liquid to become condensed, a fraction of it is excited into higher momentum states via interparticle interactions and quantum fluctuations -- the phenomenon of quantum depletion. Quantum depletion of weakly interacting atomic BECs in thermal equilibrium is well understood theoretically but is difficult to measure. This is even more challenging in driven-dissipative systems such as exciton-polariton condensates(photons coupled to electron-hole pairs in a semiconductor), since their nonequilibrium nature is predicted to suppress quantum depletion. Here, we observe quantum depletion of an optically trapped high-density exciton-polariton condensate by directly detecting the spectral branch of elementary excitations populated by this process. Analysis of the population of this branch in momentum space shows that quantum depletion of an exciton-polariton condensate can closely follow or strongly deviate from the equilibrium Bogoliubov theory, depending on the fraction of matter (exciton) in an exciton-polariton. Our results reveal the effects of exciton-polariton interactions beyond the mean-field description and call for a deeper understanding of the relationship between equilibrium and nonequilibrium BECs.


title: Abelian subgroups, nilpotent subgroups, and the largest character degree of a finite group

abstract: Let $H$ be an abelian subgroup of a finite group $G$ and $\pi$ the set of prime divisors of $|H|$. We prove that $|H O_{\pi}(G)/ O_{\pi}(G)|$ is bounded above by the largest character degree of $G$. A similar result is obtained when $H$ is nilpotent.


title: A general q-expansion formula based on matrix inversions and its applications

abstract: In this paper, by use of matrix inversions, we establish a general $q$-expansion formula of arbitrary formal power series $F(z)$ with respect to the base $$\left\{z^n\frac{(az:q)_n}{(bz:q)_n}\bigg|n=0,1,2\cdots\right\}.$$ Some concrete expansion formulas and their applications to $q$-series identities are presented, including Carlitz's $q$-expansion formula, a new partial theta function identity and a coefficient identity of Ramanujan's ${}_1\psi_1$ summation formula as special cases.


title: Semi-supervised Learning with Contrastive Predicative Coding

abstract: Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark tasks. However, many of them have thus far been either inflexible, inefficient or non-scalable. This paper explores recently developed contrastive predictive coding technique to improve discriminative power of deep learning models when a large portion of labels are absent. Two models, cpc-SSL and a class conditional variant~(ccpc-SSL) are presented. They effectively exploit the unlabeled data by extracting shared information between different parts of the (high-dimensional) data. The proposed approaches are inductive, and scale well to very large datasets like ImageNet, making them good candidates in real-world large scale applications.


title: SuperCaptioning: Image Captioning Using Two-dimensional Word Embedding

abstract: Language and vision are processed as two different modal in current work for image captioning. However, recent work on Super Characters method shows the effectiveness of two-dimensional word embedding, which converts text classification problem into image classification problem. In this paper, we propose the SuperCaptioning method, which borrows the idea of two-dimensional word embedding from Super Characters method, and processes the information of language and vision together in one single CNN model. The experimental results on Flickr30k data shows the proposed method gives high quality image captions. An interactive demo is ready to show at the workshop.


title: Covering by homothets and illuminating convex bodies

abstract: The paper is devoted to coverings by translative homothets and illuminations of convex bodies. For a given positive number $\alpha$ and a convex body $B$, $g_{\alpha}(B)$ is the infimum of $\alpha$-powers of finitely many homothety coefficients less than 1 such that there is a covering of $B$ by translative homothets with these coefficients. $h_{\alpha}(B)$ is the minimal number of directions such that the boundary of $B$ can be illuminated by this number of directions except for a subset whose Hausdorff dimension is less than $\alpha$. In this paper, we prove that $g_{\alpha}(B)\leq h_{\alpha}(B)$, find upper and lower bounds for both numbers, and discuss several general conjectures. In particular, we show that $h_{\alpha} (B) > 2^{d-\alpha}$ for almost all $\alpha$ and $d$ when $B$ is the $d$-dimensional cube, thus disproving the conjecture from Research Problems in Discrete Geometry by Brass, Moser, and Pach.


title: Transferable Cost-Aware Security Policy Implementation for Malware Detection Using Deep Reinforcement Learning

abstract: Malware detection is an ever-present challenge for all organizational gatekeepers, who must maintain high detection rates while minimizing interruptions to the organization's workflow. To improve detection rates, organizations often deploy an ensemble of detectors. While effective, this approach is computationally expensive, since every file - even clear-cut cases - needs to be analyzed by all detectors. Moreover, with an ever-increasing number of files to process, the use of ensembles may incur unacceptable processing times and costs (e.g., cloud resources). In this study, we propose SPIREL, a reinforcement learning-based method for cost-effective malware detection. Our method enables organizations to directly associate costs to correct/incorrect classification, computing resources and run-time, and then dynamically establishes a security policy. This security policy is then implemented, and for each inspected file, a different set of detectors is assigned and a different detection threshold is set. Our evaluation on two malware domains- Portable Executable (PE) and Android Application Package (APK)files - shows that SPIREL is both accurate and extremely resource-efficient: the proposed method either outperforms the best performing baselines while achieving a modest improvement in efficiency, or reduces the required running time by ~80% while decreasing the accuracy and F1-score by only 0.5%. We also show that our approach is both highly transferable across different datasets and adaptable to changes in individual detector performance.


title: Bandwidth-Efficient Transaction Relay for Bitcoin

abstract: Bitcoin is a top-ranked cryptocurrency that has experienced huge growth and survived numerous attacks. The protocols making up Bitcoin must therefore accommodate the growth of the network and ensure security. Security of the Bitcoin network depends on connectivity between the nodes. Higher connectivity yields better security. In this paper we make two observations: (1) current connectivity in the Bitcoin network is too low for optimal security; (2) at the same time, increasing connectivity will substantially increase the bandwidth used by the transaction dissemination protocol, making it prohibitively expensive to operate a Bitcoin node. Half of the total bandwidth needed to operate a Bitcoin node is currently used to just announce transactions. Unlike block relay, transaction dissemination has received little attention in prior work. We propose a new transaction dissemination protocol, Erlay, that not only reduces the bandwidth consumption by 40% assuming current connectivity, but also keeps the bandwidth use almost constant as the connectivity increases. In contrast, the existing protocol increases the bandwidth consumption linearly with the number of connections. By allowing more connections at a small cost, Erlay improves the security of the Bitcoin network. And, as we demonstrate, Erlay also hardens the network against attacks that attempt to learn the origin node of a transaction. Erlay is currently being investigated by the Bitcoin community for future use with the Bitcoin protocol.