title: Stochastic thermodynamics of an electron-spin-resonance quantum dot system

abstract: We present a stochastic thermodynamics analysis of an electron-spin-resonance pumped quantum dot device in the Coulomb-blocked regime, where a pure spin current is generated without an accompanying net charge current. Based on a generalized quantum master equation beyond secular approximation, quantum coherences are accounted for in terms of an effective average spin in the Floquet basis. Elegantly, this effective spin undergoes a precession about an effective magnetic field, which originates from the non-secular treatment and energy renormalization. It is shown that the interaction between effective spin and effective magnetic field may have the dominant roles to play in both energy transport and irreversible entropy production. In the stationary limit, the energy and entropy balance relations are also established based on the theory of counting statistics.


title: Quadratic fields with a class group of large 3-rank

abstract: We prove that there are >>X^{1/30}/(log X) imaginary quadratic number fields with an ideal class group of 3-rank at least 5 and discriminant bounded in absolute value by X. This improves on an earlier result of Craig, who proved the infinitude of imaginary quadratic fields with an ideal class group of 3-rank at least 4. The proofs rely on constructions of Mestre for j-invariant 0 elliptic curves of large Mordell-Weil rank, and a method of the first author and Gillibert for constructing torsion in ideal class groups of number fields from rational torsion in Jacobians of curves. We also consider analogous questions concerning rational 3-torsion in hyperelliptic Jacobians.


title: The Quantum Illumination Story

abstract: Superposition and entanglement, the quintessential characteristics of quantum physics, have been shown to provide communication, computation, and sensing capabilities that go beyond what classical physics will permit. It is natural, therefore, to explore their application to radar, despite the fact that decoherence---caused by the loss and noise encountered in radar sensing---destroys these fragile quantum properties. This paper tells the story of "quantum illumination", an entanglement-based approach to quantum radar, from its inception to its current understanding. Remarkably, despite loss and noise that destroy its initial entanglement, quantum illumination does offer a target-detection performance improvement over a classical radar of the same transmitted energy. A realistic assessment of that improvement's utility, however, shows that its value is severely limited. Nevertheless, the fact that entanglement can be of value on an entanglement-breaking channel---the meta-lesson of the quantum illumination story---should spur continued research on quantum radar.


title: Hierarchical Clustering with Hard-batch Triplet Loss for Person Re-identification

abstract: For most unsupervised person re-identification (re-ID), people often adopt unsupervised domain adaptation (UDA) method. UDA often train on the labeled source dataset and evaluate on the target dataset, which often focuses on learning differences between the source dataset and the target dataset to improve the generalization of the model. Base on these, we explore how to make use of the similarity of samples to conduct a fully unsupervised method which just trains on the unlabeled target dataset. Concretely, we propose a hierarchical clustering-guided re-ID (HCR) method. We use hierarchical clustering to generate pseudo labels and use these pseudo labels as monitors to conduct the training. In order to exclude hard examples and promote the convergence of the model, We use PK sampling in each iteration, which randomly selects a fixed number of samples from each cluster for training. We evaluate our model on Market-1501, DukeMTMC-reID and MSMT17. Results show that HCR gets the state-of-the-arts and achieves 55.3% mAP on Market-1501 and 46.8% mAP on DukeMTMC-reID. Our code will be released soon.


title: Memeify: A Large-Scale Meme Generation System

abstract: Interest in the research areas related to meme propagation and generation has been increasing rapidly in the last couple of years. Meme datasets available online are either specific to a context or contain no class information. Here, we prepare a large-scale dataset of memes with captions and class labels. The dataset consists of 1.1 million meme captions from 128 classes. We also provide reasoning for the existence of broad categories, called "themes" across the meme dataset; each theme consists of multiple meme classes. Our generation system uses a trained state-of-the-art transformer-based model for caption generation by employing an encoder-decoder architecture. We develop a web interface, called Memeify for users to generate memes of their choice, and explain in detail, the working of individual components of the system. We also perform a qualitative evaluation of the generated memes by conducting a user study. A link to the demonstration of the Memeify system is https://youtu.be/P_Tfs0X-czs.


title: Gr\"{o}bner bases and syzygy theorem for direct product of principal ideal rings

abstract: In this paper we give versions of Hilbert's syzygy theorem for finitely generated modules over polynomial rings over direct product of principal ideal rings.


title: Deep convolutional autoencoder for cryptocurrency market analysis

abstract: This study attempts to analyze patterns in cryptocurrency markets using a special type of deep neural networks, namely a convolutional autoencoder. The method extracts the dominant features of market behavior and classifies the 40 studied cryptocurrencies into several classes for twelve 6-month periods starting from 15th May 2013. Transitions from one class to another with time are related to the maturement of cryptocurrencies. In speculative cryptocurrency markets, these findings have potential implications for investment and trading strategies.


title: Linear Temporal Logic Satisfaction in Adversarial Environments using Secure Control Barrier Certificates

abstract: This paper studies the satisfaction of a class of temporal properties for cyber-physical systems (CPSs) over a finite-time horizon in the presence of an adversary, in an environment described by discrete-time dynamics. The temporal logic specification is given in safe-LTL_F, a fragment of linear temporal logic over traces of finite length. The interaction of the CPS with the adversary is modeled as a two-player zero-sum discrete-time dynamic stochastic game with the CPS as defender. We formulate a dynamic programming based approach to determine a stationary defender policy that maximized the probability of satisfaction of a safe-LTL_F formula over a finite time-horizon under any stationary adversary policy. We introduce secure control barrier certificates (S-CBCs), a generalization of barrier certificates and control barrier certificates that accounts for the presence of an adversary, and use S-CBCs to provide a lower bound on the above satisfaction probability. When the dynamics of the evolution of the system state has a specific underlying structure, we present a way to determine an S-CBC as a polynomial in the state variables using sum-of-squares optimization. An illustrative example demonstrates our approach.


title: Long-term Joint Scheduling for Urban Traffic

abstract: Recently, the traffic congestion in modern cities has become a growing worry for the residents. As presented in Baidu traffic report, the commuting stress index has reached surprising 1.973 in Beijing during rush hours, which results in longer trip time and increased vehicular queueing. Previous works have demonstrated that by reasonable scheduling, e.g, rebalancing bike-sharing systems and optimized bus transportation, the traffic efficiency could be significantly improved with little resource consumption. However, there are still two disadvantages that restrict their performance: (1) they only consider single scheduling in a short time, but ignoring the layout after first reposition, and (2) they only focus on the single transport. However, the multi-modal characteristics of urban public transportation are largely under-exploited. In this paper, we propose an efficient and economical multi-modal traffic scheduling scheme named JLRLS based on spatio -temporal prediction, which adopts reinforcement learning to obtain optimal long-term and joint schedule. In JLRLS, we combines multiple transportation to conduct scheduling by their own characteristics, which potentially helps the system to reach the optimal performance. Our implementation of an example by PaddlePaddle is available at https://github.com/bigdata-ustc/Long-term-Joint-Scheduling, with an explaining video at https://youtu.be/t5M2wVPhTyk.


title: Task-Informed Fidelity Management for Speeding Up Robotics Simulation

abstract: Simulators are an important tool in robotics that is used to develop robot software and generate synthetic data for machine learning algorithms. Faster simulation can result in better software validation and larger amounts of data. Previous efforts for speeding up simulators have been performed at the level of simulator building blocks, and robot systems. Our key insight, motivating this work, is that further speedups can be obtained at the level of the robot task. Building on the observation that not all parts of a scene need to be simulated in high fidelity at all times, our approach is to toggle between high- and low-fidelity states for scene objects in a task-informed manner. Our contribution is a framework for speeding up robot simulation by exploiting task knowledge. The framework is agnostic to the underlying simulator, and preserves simulation fidelity. As a case study, we consider a complex material-handling task. For the associated simulation, which contains many of the characteristics that make robot simulation slow, we achieve a speedup that can be up to three times faster than high fidelity without compromising on the quality of the results. We also demonstrate that faster simulation allows us to train better policies for performing the task at hand in a short period of time. A video summarizing our contributions can be found at https://youtu.be/PEzypDyqc3o .


title: Dipolar cation accumulation at interfaces of perovskite light emitting solar cells

abstract: Ionic migration in organo-halide perovskites plays an important role in operation of perovskite based solar cells and light emitting diodes. Despite the ionic migration being a reversible process, it often leads to worsening of perovskite based device performance, hysteresis in current-voltage characteristics, and phase segregation in mixed halide perovskites being as the most harmful effect. The reason is in dynamical band structure changes, which controllable engineering would solve one of the biggest challenges for development of light-emitting solar cells. Here we demonstrate controllable band bending due to migration of both cation and anion ions in mixed halide perovskite devices. The band structure rearrangement is demonstrated in light emitting solar cells based on the perovskite with organic cations methylammonium (MA+) and formamidinium (FA+), possessing non-zero dipole momentum of 2.29 and 0.21 Debye, respectively, and with PEDOT:PSS and C60 transport layers having a high barrier of 0.8 eV for charge injection. Under applied external voltage MA+ and FA+ cations move towards the electron transport layer and form a dipole layer at the perovskite/electron transport interface, which lowers threshold voltage for electroluminescence down to 1.7 V for MAPbBr2I and 2.6 V for FAPbBr2I, whereas monohalide perovskite MAPbBr3 does not demonstrate such behavior. This ability to in-situ change the device band structure paves the way developing of dual-functional devices based on simple design. It also makes mixed halide perovskites more flexible than mono halides ones for developing different optoelectronic devices without the use of special types of work function modifying transport materials.


title: Non-Local ConvLSTM for Video Compression Artifact Reduction

abstract: Video compression artifact reduction aims to recover high-quality videos from low-quality compressed videos. Most existing approaches use a single neighboring frame or a pair of neighboring frames (preceding and/or following the target frame) for this task. Furthermore, as frames of high quality overall may contain low-quality patches, and high-quality patches may exist in frames of low quality overall, current methods focusing on nearby peak-quality frames (PQFs) may miss high-quality details in low-quality frames. To remedy these shortcomings, in this paper we propose a novel end-to-end deep neural network called non-local ConvLSTM (NL-ConvLSTM in short) that exploits multiple consecutive frames. An approximate non-local strategy is introduced in NL-ConvLSTM to capture global motion patterns and trace the spatiotemporal dependency in a video sequence. This approximate strategy makes the non-local module work in a fast and low space-cost way. Our method uses the preceding and following frames of the target frame to generate a residual, from which a higher quality frame is reconstructed. Experiments on two datasets show that NL-ConvLSTM outperforms the existing methods.


title: Canonical identification at infinity for Ricci-flat manifolds

abstract: We give a natural way to identify between two scales, potentially arbitrarily far apart, in a non-compact Ricci-flat manifold with Euclidean volume growth when a tangent cone at infinity has smooth cross section. The identification map is given as the gradient flow of a solution to an elliptic equation.


title: Modelling heterogeneous distributions with an Uncountable Mixture of Asymmetric Laplacians

abstract: In regression tasks, aleatoric uncertainty is commonly addressed by considering a parametric distribution of the output variable, which is based on strong assumptions such as symmetry, unimodality or by supposing a restricted shape. These assumptions are too limited in scenarios where complex shapes, strong skews or multiple modes are present. In this paper, we propose a generic deep learning framework that learns an Uncountable Mixture of Asymmetric Laplacians (UMAL), which will allow us to estimate heterogeneous distributions of the output variable and shows its connections to quantile regression. Despite having a fixed number of parameters, the model can be interpreted as an infinite mixture of components, which yields a flexible approximation for heterogeneous distributions. Apart from synthetic cases, we apply this model to room price forecasting and to predict financial operations in personal bank accounts. We demonstrate that UMAL produces proper distributions, which allows us to extract richer insights and to sharpen decision-making.


title: On the Linear Independence of Finite Wavelet Systems Generated by Schwartz Functions or Functions with certain behavior at infinity

abstract: One of the motivations to state HRT conjecture on the linear independence of finite Gabor systems was the fact that there are linearly dependent Finite Wavelet Systems (FWS). Meanwhile, there are also many examples of linearly independent FWS, some of which are presented in this paper. We prove the linear independence of every three point FWS generated by a nonzero Schwartz function and with any number of points if the FWS is generated by a nonzero Schwartz function, for which the absolute value of the Fourier transform is decreasing at infinity. We also prove the linear independence of any FWS generated by a nonzero square integrable function, for which the Fourier transform has certain behavior at infinity. Such a function can be any square integrable function that is a linear complex combination of real valued rational and exponential functions.


title: Global methods for the symplectic type of congruences between elliptic curves

abstract: We describe a systematic investigation into the existence of congruences between the mod $p$ torsion modules of elliptic curves defined over $\mathbb{Q}$, including methods to determine the symplectic type of such congruences. We classify the existence and symplectic type of mod $p$ congruences between twisted elliptic curves over number fields, giving global symplectic criteria that apply in situations where the available local methods may fail. We report on the results of applying our methods for all primes $p\ge7$ to the elliptic curves in the LMFDB database, which currently includes all elliptic curves of conductor less than ${500000}$. We also show that while such congruences exist for each $p\le17$, there are none for $p \geq 19$ in the database, in line with a strong form of the Frey-Mazur conjecture.


title: Relic Density of Asymmetric Dark Matter with Sommerfeld enhancement

abstract: We investigate the evolution of the abundance of the asymmetric thermal Dark Matter when its annihilation rate at chemical decoupling is boosted by the Sommerfeld enhancement. We perform the detailed analysis of the effect of $s$-- and $p$--wave Sommerfeld enhanced annihilation cross section on the relic abundances of asymmetric Dark Matter particle and anti--particle both in numerical and analytical way. The constraints on the coupling and asymmetric factor are given by using the observational data of the relic density of Dark Matter.


title: Tearing instability in Alfv\'en and kinetic-Alfv\'en turbulence

abstract: Recently, it has been realized that magnetic plasma turbulence and magnetic field reconnection are inherently related phenomena. Turbulent fluctuations generate regions of a sheared magnetic field that become unstable to the tearing instability and reconnection, thus modifying turbulence at the corresponding scales. In this contribution, we give a brief discussion of some recent results on tearing-mediated magnetic turbulence. We illustrate the main ideas of this rapidly developing field of study by concentrating on two important examples -- magnetohydrodynamic Alfv\'en turbulence and small-scale kinetic-Alfv\'en turbulence. Due to various potential applications of these phenomena in space physics and astrophysics, we specifically try not to overload the text by heavy analytical derivations, but rather present a qualitative discussion accessible to a non-expert in the theories of turbulence and reconnection.


title: Generation of digital patients for the simulation of tuberculosis with UISS-TB

abstract: EC funded STriTuVaD project aims to test, through a phase IIb clinical trial, two of the most advanced therapeutic vaccines against tuberculosis. In parallel, we have extended the Universal Immune System Simulator to include all relevant determinants of such clinical trial, to establish its predictive accuracy against the individual patients recruited in the trial, to use it to generate digital patients and predict their response to the HRT being tested, and to combine them to the observations made on physical patients using a new in silico-augmented clinical trial approach that uses a Bayesian adaptive design. This approach, where found effective could drastically reduce the cost of innovation in this critical sector of public healthcare. One of the most challenging task is to develop a methodology to reproduce biological diversity of the subjects that have to be simulated, i.e., provide an appropriate strategy for the generation of libraries of digital patients. This has been achieved through the the creation of the initial immune system repertoire in a stochastic way, and though the identification of a "vector of features" that combines both biological and pathophysiological parameters that personalize the digital patient to reproduce the physiology and the pathophysiology of the subject.


title: Robots as Actors in a Film: No War, A Robot Story

abstract: Will the Third World War be fought by robots? This short film is a light-hearted comedy that aims to trigger an interesting discussion and reflexion on the terrifying killer-robot stories that increasingly fill us with dread when we read the news headlines. The fictional scenario takes inspiration from current scientific research and describes a future where robots are asked by humans to join the war. Robots are divided, sparking protests in robot society... will robots join the conflict or will they refuse to be employed in human warfare? Food for thought for engineers, roboticists and anyone imagining what the upcoming robot revolution could look like. We let robots pop on camera to tell a story, taking on the role of actors playing in the film, instructed through code on how to "act" for each scene.


title: MOD: A Deep Mixture Model with Online Knowledge Distillation for Large Scale Video Temporal Concept Localization

abstract: In this paper, we present and discuss a deep mixture model with online knowledge distillation (MOD) for large-scale video temporal concept localization, which is ranked 3rd in the 3rd YouTube-8M Video Understanding Challenge. Specifically, we find that by enabling knowledge sharing with online distillation, fintuning a mixture model on a smaller dataset can achieve better evaluation performance. Based on this observation, in our final solution, we trained and fintuned 12 NeXtVLAD models in parallel with a 2-layer online distillation structure. The experimental results show that the proposed distillation structure can effectively avoid overfitting and shows superior generalization performance. The code is publicly available at: https://github.com/linrongc/solution_youtube8m_v3


title: Phase slip statistics of a single isolated flux-biased superconducting ring

abstract: We describe measurements of the thermally-activated transitions between fluxoid states of a single isolated superconducting ring. We compare these measurements with theoretical predictions in which all of the relevant parameters are determined via independent characterization of the same ring. This no-free-parameters comparison shows qualitative agreement over a wide range of temperatures. We discuss possible origins for the remaining discrepancies between the data and theory, in particular the choice of model for the superconducting order parameter's damping.


title: A new look at the fractional Poisson problem via the Logarithmic Laplacian

abstract: We analyze the $s$-dependence of solutions $u_s$ to the family of fractional Poisson problems $(-\Delta)^s u =f$ in $\Omega$, $u \equiv 0$ on $\mathbb{R}^N\setminus \Omega$ in an open bounded set $\Omega \subset \mathbb{R}^N$, $s \in (0,1)$. In the case where $\Omega$ is of class $C^2$ and $f \in C^{\alpha}(\bar{\Omega})$ for some $\alpha>0$, we show that the map $(0,1) \to L^\infty(\Omega)$, $s\mapsto u_s$ is of class $C^1$, and we characterize the derivative $\partial_s u_s$ in terms of the logarithmic Laplacian of $f$. As a corollary, we derive pointwise monotonicity properties of the solution map $s \mapsto u_s$ under suitable assumptions on $f$ and $\Omega$. Moreover, we derive explicit bounds for the corresponding Green operator on arbitrary bounded domains which are new even for the case $s=1$, i.e., for the local Dirichlet problem $-\Delta u = f$ in $\Omega$, $u \equiv 0$ on $\partial \Omega$.


title: Protecting Personal Data using Smart Contracts

abstract: Decentralized Online Social Networks (DOSNs) have been proposed as an alternative solution to the current centralized Online Social Networks (OSNs). Online Social Networks are based on centralized architecture (e.g., Facebook, Twitter, or Google+), while DOSNs do not have a service provider that acts as central authority and users have more control over their information. Several DOSNs have been proposed during the last years. However, the decentralization of the OSN requires efficient solutions for protecting the privacy of users, and to evaluate the trust between users. Blockchain represents a disruptive technology which has been applied to several fields, among these also to Social Networks. In this paper, we propose a manageable, user-driven and auditable access control framework for DOSNs using blockchain technology. In the proposed approach, the blockchain is used as a support for the definition of privacy policies. The resource owner uses the public key of the subject to define flexible role-based access control policies, while the private key associated with the subject's Ethereum account is used to decrypt the private data once access permission is validated on the blockchain. We evaluate our solution by exploiting the Rinkeby Ethereum testnet to deploy the smart contract, and to evaluate its performance. Experimental results show the feasibility of the proposed scheme in achieving auditable and user-driven access control via smart contract deployed on the Blockchain.


title: Induced Inflection-Set Keyword Search in Speech

abstract: We investigate the problem of searching for a lexeme-set in speech by searching for its inflectional variants. Experimental results indicate how lexeme-set search performance changes with the number of hypothesized inflections, while ablation experiments highlight the relative importance of different components in the lexeme-set search pipeline and the value of using curated inflectional paradigms. We provide a recipe and evaluation set for the community to use as an extrinsic measure of the performance of inflection generation approaches.


title: Linear Schr\"odinger equation with an almost periodic potential

abstract: We study the reducibility of a Linear Schr\"odinger equation subject to a small unbounded almost-periodic perturbation which is analytic in time and space. Under appropriate assumptions on the smallness, analiticity and on the frequency of the almost-periodic perturbation, we prove that such an equation is reducible to constant coefficients via an analytic almost-periodic change of variables. This implies control of both Sobolev and Analytic norms for the solution of the corresponding Schr\"odinger equation for all times.


title: Relaxing the aquaporin crystal structure in a membrane with surface vibrational spectroscopy

abstract: High-resolution structural information on membrane proteins is essential for understanding cell biology and for structure-based design of new medical drugs and drug delivery strategies. X-ray diffraction (XRD) can provide {\AA}ngstrom-level information about the structure of membrane proteins. Ideally protein structures should be solved in environments as close to the original biological context as possible. However, it is virtually impossible to crystallize proteins within the complex environment of a biological membrane. Instead, membrane proteins are typically transferred from their native membrane environment into detergent micelles, chemically stabilized and crystallized, all of which can compromise the conformation. This makes it imperative to develop alternative high-resolution techniques which are compatible with biological conditions. Here, we describe how a combina-tion of surface-sensitive vibrational spectroscopy in model membranes and molecular dynamics simulations can account for the native membrane environment. We observe the structure of glycerol facilitator channel (GlpF), an aquaporin membrane channel finely tuned to selectively transport water and glycerol molecules across the membrane barrier. We find subtle but significant differences between the XRD structure and the in-ferred in situ structure of GlpF.


title: Pata Zamfirescu Type Fixed-Disc Results with a Proximal Application

abstract: This paper is concerning to the geometric study of fixed points of a self-mapping on a metric space. We establish new generalized contractive conditions which ensure that a self-mapping has a fixed disc or a fixed circle. We introduce the notion of a best proximity circle and explore some proximal contractions for a non-self-mapping as an application. Necessary illustrative examples are presented to highlight the importance of the obtained results.


title: Finite descent obstruction for Hilbert modular varieties

abstract: Let $S$ be a finite set of primes. We prove that a form of finite Galois descent obstruction is the only obstruction to the existence of $\mathbb{Z}_{S}$-points on integral models of Hilbert modular varieties, extending a result of D.Helm and F.Voloch about modular curves. Let $L$ be a totally real field. Under (a special case of) the absolute Hodge conjecture and a weak Serre's conjecture for mod $\ell$ representations of the absolute Galois group of $L$, we prove that the same holds also for the $\mathcal{O}_{L,S}$-points.


title: A New Solution to the Rhoades' Open Problem with an Application

abstract: We give a new solution to the Rhoades' open problem on the discontinuity at fixed point via the notion of an $S$-metric. To do this, we inspire with the notion of a Zamfirescu mapping. Also, we consider a recent problem called the "fixed-circle problem" and propose a new solution to this problem as an application of our technique.


title: Existence of stationary stochastic Burgers evolutions on $\mathbf{R}^2$ and $\mathbf{R}^3$

abstract: We prove that the stochastic Burgers equation on $\mathbf{R}^{d}$, $d<4$, forced by gradient noise that is white in time and smooth in space, admits spacetime-stationary solutions. These solutions are thus the gradients of solutions to the KPZ equation on $\mathbf{R}^{d}$ with stationary gradients. The proof works by proving tightness of the time-averaged laws of the solutions in an appropriate weighted space.


title: TreeCaps: Tree-Structured Capsule Networks for Program Source Code Processing

abstract: Program comprehension is a fundamental task in software development and maintenance processes. Software developers often need to understand a large amount of existing code before they can develop new features or fix bugs in existing programs. Being able to process programming language code automatically and provide summaries of code functionality accurately can significantly help developers to reduce time spent in code navigation and understanding, and thus increase productivity. Different from natural language articles, source code in programming languages often follows rigid syntactical structures and there can exist dependencies among code elements that are located far away from each other through complex control flows and data flows. Existing studies on tree-based convolutional neural networks (TBCNN) and gated graph neural networks (GGNN) are not able to capture essential semantic dependencies among code elements accurately. In this paper, we propose novel tree-based capsule networks (TreeCaps) and relevant techniques for processing program code in an automated way that encodes code syntactical structures and captures code dependencies more accurately. Based on evaluation on programs written in different programming languages, we show that our TreeCaps-based approach can outperform other approaches in classifying the functionalities of many programs.


title: Structure-preserving diagonalization of matrices in indefinite inner product spaces

abstract: In this work some results on the structure-preserving diagonalization of selfadjoint and skewadjoint matrices in indefinite inner product spaces are presented. In particular, necessary and sufficient conditions on the symplectic diagonalizability of (skew)-Hamiltonian matrices and the perplectic diagonalizability of per(skew)-Hermitian matrices are provided. Assuming the structured matrix at hand is additionally normal, it is shown that any symplectic or perplectic diagonalization can always be constructed to be unitary. As a consequence of this fact, the existence of a unitary, structure-preserving diagonalization is equivalent to the existence of a specially structured additive decomposition of such matrices. The implications of this decomposition are illustrated by several examples.


title: Asynchronous Decentralized SGD with Quantized and Local Updates

abstract: Decentralized optimization is emerging as a viable alternative for scalable distributed machine learning, but also introduces new challenges in terms of synchronization costs. To this end, several communication-reduction techniques, such as non-blocking communication, quantization, and local steps, have been explored in the decentralized setting. Due to the complexity of analyzing optimization in such a relaxed setting, this line of work often assumes \emph{global} communication rounds, which require additional synchronization. In this paper, we consider decentralized optimization in the simpler, but harder to analyze, \emph{asynchronous gossip} model, in which communication occurs in discrete, randomly chosen pairings among nodes. Perhaps surprisingly, we show that a variant of SGD called \emph{SwarmSGD} still converges in this setting, even if \emph{non-blocking communication}, \emph{quantization}, and \emph{local steps} are all applied \emph{in conjunction}, and even if the node data distributions and underlying graph topology are both \emph{heterogenous}. Our analysis is based on a new connection with multi-dimensional load-balancing processes. We implement this algorithm and deploy it in a super-computing environment, showing that it can outperform previous decentralized methods in terms of end-to-end training time, and that it can even rival carefully-tuned large-batch SGD for certain tasks.


title: Spectral Power Parameter Estimation of Random Sources with Binary Sampled Signals

abstract: This paper investigates the problem of estimating the spectral power parameters of random analog sources using numerical measurements acquired with minimum digitization complexity. Therefore, spectral analysis has to be performed with binary samples of the analog sensor output. Under the assumption that the structure of the spectral power density of the analog sources is given, we investigate the achievable accuracy for power level estimation with likelihood-oriented processing. The discussion addresses the intractability of the likelihood with multivariate hard-limited samples by exploiting advances on probabilistic modeling and statistical processing of hard-limited multivariate Gaussian data. In addition to estimation-theoretic performance analysis, the results are verified by running an iterative likelihood-oriented algorithm with synthetic binary data for two exemplary sensing setups.


title: Sage: Parallel Semi-Asymmetric Graph Algorithms for NVRAMs

abstract: Non-volatile main memory (NVRAM) technologies provide an attractive set of features for large-scale graph analytics, including byte-addressability, low idle power, and improved memory-density. NVRAM systems today have an order of magnitude more NVRAM than traditional memory (DRAM). NVRAM systems could therefore potentially allow very large graph problems to be solved on a single machine, at a modest cost. However, a significant challenge in achieving high performance is in accounting for the fact that NVRAM writes can be much more expensive than NVRAM reads. In this paper, we propose an approach to parallel graph analytics using the Parallel Semi-Asymmetric Model (PSAM), in which the graph is stored as a read-only data structure (in NVRAM), and the amount of mutable memory is kept proportional to the number of vertices. Similar to the popular semi-external and semi-streaming models for graph analytics, the PSAM approach assumes that the vertices of the graph fit in a fast read-write memory (DRAM), but the edges do not. In NVRAM systems, our approach eliminates writes to the NVRAM, among other benefits. To experimentally study this new setting, we develop Sage, a parallel semi-asymmetric graph engine with which we implement provably-efficient (and often work-optimal) PSAM algorithms for over a dozen fundamental graph problems. We experimentally study Sage using a 48-core machine on the largest publicly-available real-world graph (the Hyperlink Web graph with over 3.5 billion vertices and 128 billion edges) equipped with Optane DC Persistent Memory, and show that Sage outperforms the fastest prior systems designed for NVRAM. Importantly, we also show that Sage nearly matches the fastest prior systems running solely in DRAM, by effectively hiding the costs of repeatedly accessing NVRAM versus DRAM.


title: Extreme Primordial Black Holes

abstract: We present a formalism for calculating the probability distribution of the most massive primordial black holes (PBHs) expected within an observational volume. We show how current observational upper bounds on the fraction of PBHs in dark matter translate to constraints on extreme masses of primordial black holes. We demonstrate the power of our formalism via a case study, and argue that our formalism can be used to produce extreme-value distributions for a wide range of PBH formation theories.


title: Flow of Hagedorn singularities and phase transitions in large $N$ gauge theories

abstract: We investigate the singularity structure of the $(-1)^F$ graded partition function in QCD with $n_f \geq 1$ massive adjoint fermions in the large-$N$ limit. Here, $F$ is fermion number and $N$ is the number of colors. The large $N$ partition function is made reliably calculable by taking space to be a small three-sphere $S^3$. Singularites in the graded partition function are related to phase transitions and to Hagedorn behavior in the $(-1)^F$-graded density of states. We study the flow of the singularities in the complex "inverse temperature" $\beta$ plane as a function of the quark mass. This analysis is a generalization of the Lee-Yang-Fisher-type analysis for a theory which is always in the thermodynamic limit thanks to the large $N$ limit. We identify two distinct mechanisms for the appearance of physical Hagedorn singularities and center-symmetry changing phase transitions at real positive $\beta$, inflow of singularities from the $\beta=0$ point, and collisions of complex conjugate pairs of singularities.


title: Small mass nanopteron traveling waves in mass-in-mass lattices with cubic FPUT potential

abstract: The mass-in-mass (MiM) lattice consists of an infinite chain of identical beads that are both nonlinearly coupled to their nearest neighbors and linearly coupled to a distinct resonator particle; it serves as a prototypical model of wave propagation in granular crystals and metamaterials. We study traveling waves in an MiM lattice whose bead interaction is governed by the cubic Fermi-Pasta-Ulam-Tsingou potential and whose resonator mass is small compared to the bead mass. Excluding a countable number of "antiresonance" resonator masses accumulating at 0, we prove the existence of nanopteron traveling waves in this small mass limit. The profiles of these waves consist of the superposition of an exponentially localized core and a small amplitude periodic oscillation that itself is a traveling wave profile for the lattice. Our arguments use functional analytic techniques originally developed by Beale for a capillary-gravity water wave problem and recently employed in a number of related nanopteron constructions in diatomic Fermi-Pasta-Ulam-Tsingou lattices.


title: Electronic Preparatory Test for Mathematics Undergraduates: Implementation, Results and Correlations

abstract: We present a study of the implementation of the Electronic Preparatory Test for beginning undergraduates reading mathematics. The Test comprises two elements: diagnostic and self-learning. The diagnostic element identifies gaps in the background knowledge, whilst the self-learning element guides students through an upcoming material. The Test lends itself to an early identification of weak and strong students coming from a wide range of background, allowing follow-ups to be made on a topic-specific basis. The results from the Tests, collected over three years, correlate positively with end-of-year examination results. We show that such a Preparatory Test can be a better predictor of success in the first-year examination in comparison with university entry qualifications alone.


title: Base Change Along the Frobenius Endomorphism and the Gorenstein Property

abstract: Let $R$ be a local ring of positive characteristic and $X$ a complex with nonzero finitely generated homology and finite injective dimension. We prove that if derived base change of $X$ via the Frobenius (or more generally, via a contracting) endomorphism has finite injective dimension then $R$ is Gorenstein.


title: Inherent Weight Normalization in Stochastic Neural Networks

abstract: Multiplicative stochasticity such as Dropout improves the robustness and generalizability of deep neural networks. Here, we further demonstrate that always-on multiplicative stochasticity combined with simple threshold neurons are sufficient operations for deep neural networks. We call such models Neural Sampling Machines (NSM). We find that the probability of activation of the NSM exhibits a self-normalizing property that mirrors Weight Normalization, a previously studied mechanism that fulfills many of the features of Batch Normalization in an online fashion. The normalization of activities during training speeds up convergence by preventing internal covariate shift caused by changes in the input distribution. The always-on stochasticity of the NSM confers the following advantages: the network is identical in the inference and learning phases, making the NSM suitable for online learning, it can exploit stochasticity inherent to a physical substrate such as analog non-volatile memories for in-memory computing, and it is suitable for Monte Carlo sampling, while requiring almost exclusively addition and comparison operations. We demonstrate NSMs on standard classification benchmarks (MNIST and CIFAR) and event-based classification benchmarks (N-MNIST and DVS Gestures). Our results show that NSMs perform comparably or better than conventional artificial neural networks with the same architecture.


title: Complete scalar-flat K\"{a}hler metrics on affine algebraic manifolds

abstract: Let $(X,L_{X})$ be an $n$-dimensional polarized manifold. Let $D$ be a smooth hypersurface defined by a holomorphic section of $L_{X}$. We prove that if $D$ has a constant positive scalar curvature K\"{a}hler metric, $X \setminus D$ admits a complete scalar-flat K\"{a}hler metric, under the following three conditions: (i) $n \geq 6$ and there is no nonzero holomorphic vector field on $X$ vanishing on $D$, (ii) an average of a scalar curvature on $D$ denoted by $\hat{S}_{D}$ satisfies the inequality $0 < 3 \hat{S}_{D} < n(n-1)$, (iii) there are positive integers $l(>n),m$ such that the line bundle $K_{X}^{-l} \otimes L_{X}^{m}$ is very ample and the ratio $m/l$ is sufficiently small.


title: Quantum Simulation of Hyperbolic Space with Circuit Quantum Electrodynamics: From Graphs to Geometry

abstract: We show how quantum many-body systems on hyperbolic lattices with nearest-neighbor hopping and local interactions can be mapped onto quantum field theories in continuous negatively curved space. The underlying lattices have recently been realized experimentally with superconducting resonators and therefore allow for a table-top quantum simulation of quantum physics in curved background. Our mapping provides a computational tool to determine observables of the discrete system even for large lattices, where exact diagonalization fails. As an application and proof of principle we quantitatively reproduce the ground state energy, spectral gap, and correlation functions of the noninteracting lattice system by means of analytic formulas on the Poincar\'{e} disk, and show how conformal symmetry emerges for large lattices. This sets the stage for studying interactions and disorder on hyperbolic graphs in the future. Importantly, our analysis reveals that even relatively small discrete hyperbolic lattices emulate the continuous geometry of negatively curved space, and thus can be used to experimentally resolve fundamental open problems at the interface of interacting many-body systems, quantum field theory in curved space, and quantum gravity.

categories: quant-ph cond-mat.mes-hall gr-qc hep-th math-ph math.MP


title: Hausdorff dimension of random limsup sets of balls in the unit cube

abstract: The Hausdorff dimension of the set of points that are covered infinitely many times by a sequence of randomly distributed balls in the unit cube can be expressed in terms of the sizes of the balls. This note presents a new proof of the formula.


title: Formalising perfectoid spaces

abstract: Perfectoid spaces are sophisticated objects in arithmetic geometry introduced by Peter Scholze in 2012. We formalised enough definitions and theorems in topology, algebra and geometry to define perfectoid spaces in the Lean theorem prover. This experiment confirms that a proof assistant can handle complexity in that direction, which is rather different from formalising a long proof about simple objects. It also confirms that mathematicians with no computer science training can become proficient users of a proof assistant in a relatively short period of time. Finally, we observe that formalising a piece of mathematics that is a trending topic boosts the visibility of proof assistants amongst pure mathematicians.


title: L-series and homomorphisms of number fields

abstract: While the zeta function does not determine a number field uniquely, the $L$-series of a well-chosen Dirichlet character does. Moreover, isomorphisms between two number fields are in natural bijection with $L$-series preserving isomorphisms of $l$-torsion subgroups of the Dirichlet character groups. We extend this by showing that homomorphisms between number fields are in natural bijection with group homomorphisms between $l$-torsion subgroups of the Dirichlet character groups abiding a divisibility condition on the $L$-series when $l$ is sufficiently large.


title: Multi-Resolution Overlapping Stripes Network for Person Re-Identification

abstract: This paper addresses the person re-identification (PReID) problem by combining global and local information at multiple feature resolutions with different loss functions. Many previous studies address this problem using either part-based features or global features. In case of part-based representation, the spatial correlation between these parts is not considered, while global-based representation are not sensitive to spatial variations. This paper presents a part-based model with a multi-resolution network that uses different level of features. The output of the last two conv blocks is then partitioned horizontally and processed in pairs with overlapping stripes to cover the important information that might lie between parts. We use different loss functions to combine local and global information for classification. Experimental results on a benchmark dataset demonstrate that the presented method outperforms the state-of-the-art methods.


title: Pump depletion and hot electron generation in long density scale length plasma with shock ignition high intensity laser

abstract: Two-dimension Particle-in-cell simulations for laser plasma interaction with laser intensity of $10^{16} W/cm^2$, plasma density range of 0.01-0.28$n_c$ and scale length of $230 -330 \mu m$ showed significant pump depletion of the laser energy due to stimulated Raman scattering (SRS) and stimulated Brillouin scattering (SBS) in the low density region ($n_e=0.01-0.2 n_c$). The simulations identified hot electrons generated by SRS in the low density region with moderate energy and by two-plasmon-decay (TPD) near $n_e=0.25n_c$ with higher energy. The overall hot electron temperature (46 keV) and conversion efficiency (3%) were consistent with the experiment measurements. The simulations also showed artificially reducing SBS would lead to stronger SRS and a softer hot electron spectrum.


title: Leveraging Auxiliary Text for Deep Recognition of Unseen Visual Relationships

abstract: One of the most difficult tasks in scene understanding is recognizing interactions between objects in an image. This task is often called visual relationship detection (VRD). We consider the question of whether, given auxiliary textual data in addition to the standard visual data used for training VRD models, VRD performance can be improved. We present a new deep model that can leverage additional textual data. Our model relies on a shared text--image representation of subject-verb-object relationships appearing in the text, and object interactions in images. Our method is the first to enable recognition of visual relationships missing in the visual training data and appearing only in the auxiliary text. We test our approach on two different text sources: text originating in images and text originating in books. We test and validate our approach using two large-scale recognition tasks: VRD and Scene Graph Generation. We show a surprising result: Our approach works better with text originating in books, and outperforms the text originating in images on the task of unseen relationship recognition. It is comparable to the model which utilizes text originating in images on the task of seen relationship recognition.


title: GrappaNet: Combining Parallel Imaging with Deep Learning for Multi-Coil MRI Reconstruction

abstract: Magnetic Resonance Image (MRI) acquisition is an inherently slow process which has spurred the development of two different acceleration methods: acquiring multiple correlated samples simultaneously (parallel imaging) and acquiring fewer samples than necessary for traditional signal processing methods (compressed sensing). Both methods provide complementary approaches to accelerating the speed of MRI acquisition. In this paper, we present a novel method to integrate traditional parallel imaging methods into deep neural networks that is able to generate high quality reconstructions even for high acceleration factors. The proposed method, called GrappaNet, performs progressive reconstruction by first mapping the reconstruction problem to a simpler one that can be solved by a traditional parallel imaging methods using a neural network, followed by an application of a parallel imaging method, and finally fine-tuning the output with another neural network. The entire network can be trained end-to-end. We present experimental results on the recently released fastMRI dataset and show that GrappaNet can generate higher quality reconstructions than competing methods for both $4\times$ and $8\times$ acceleration.


title: Weakly Supervised Multi-Task Learning for Cell Detection and Segmentation

abstract: Cell detection and segmentation is fundamental for all downstream analysis of digital pathology images. However, obtaining the pixel-level ground truth for single cell segmentation is extremely labor intensive. To overcome this challenge, we developed an end-to-end deep learning algorithm to perform both single cell detection and segmentation using only point labels. This is achieved through the combination of different task orientated point label encoding methods and a multi-task scheduler for training. We apply and validate our algorithm on PMS2 stained colon rectal cancer and tonsil tissue images. Compared to the state-of-the-art, our algorithm shows significant improvement in cell detection and segmentation without increasing the annotation efforts.


title: A simple measure of conditional dependence

abstract: We propose a coefficient of conditional dependence between two random variables $Y$ and $Z$ given a set of other variables $X_1,\ldots,X_p$, based on an i.i.d. sample. The coefficient has a long list of desirable properties, the most important of which is that under absolutely no distributional assumptions, it converges to a limit in $[0,1]$, where the limit is $0$ if and only if $Y$ and $Z$ are conditionally independent given $X_1,\ldots,X_p$, and is $1$ if and only if $Y$ is equal to a measurable function of $Z$ given $X_1,\ldots,X_p$. Moreover, it has a natural interpretation as a nonlinear generalization of the familiar partial $R^2$ statistic for measuring conditional dependence by regression. Using this statistic, we devise a new variable selection algorithm, called Feature Ordering by Conditional Independence (FOCI), which is model-free, has no tuning parameters, and is provably consistent under sparsity assumptions. A number of applications to synthetic and real datasets are worked out.

categories: math.ST cs.IT math.IT math.PR stat.ME stat.TH


title: Zero-Error Capacity of Multiple Access Channels via Nonstochastic Information

abstract: The problem of characterising the zero-error capacity region for multiple access channels even in the noiseless case has remained an open problem for over three decades. Motivated by this challenging question, a recently developed theory of nonstochastic information is applied to characterise the zero-error capacity region for the case of two correlated transmitters. Unlike previous contributions, this analysis does not assume that the blocklength is asymptotically large. Finally, a new notion of nonstochastic information is proposed for a noncooperative problem involving three agents. These results are preliminary steps towards understanding information flows in worst-case distributed estimation and control problems.


title: Deep Learning Models for Digital Pathology

abstract: Histopathology images; microscopy images of stained tissue biopsies contain fundamental prognostic information that forms the foundation of pathological analysis and diagnostic medicine. However, diagnostics from histopathology images generally rely on a visual cognitive assessment of tissue slides which implies an inherent element of interpretation and hence subjectivity. Access to digitized histopathology images enabled the development of computational systems aiming at reducing manual intervention and automating parts of pathologists' workflow. Specifically, applications of deep learning to histopathology image analysis now offer opportunities for better quantitative modeling of disease appearance and hence possibly improved prediction of disease aggressiveness and patient outcome. However digitized histopathology tissue slides are unique in a variety of ways and come with their own set of computational challenges. In this survey, we summarize the different challenges facing computational systems for digital pathology and provide a review of state-of-the-art works that developed deep learning-based solutions for the predictive modeling of histopathology images from a detection, stain normalization, segmentation, and tissue classification perspective. We then discuss the challenges facing the validation and integration of such deep learning-based computational systems in clinical workflow and reflect on future opportunities for histopathology derived image measurements and better predictive modeling.


title: Ultra-relativistic astrophysics using multi-messenger observations of double neutron stars with LISA and the SKA

abstract: Recent work highlights that tens of Galactic double neutron stars are likely to be detectable in the millihertz band of the space-based gravitational-wave observatory, LISA. Kyutoku and Nishino point out that some of these binaries might be detectable as radio pulsars using the Square Kilometer Array (SKA). We point out that the joint LISA+SKA detection of a $f_\text{gw}\gtrsim$1 mHz binary, corresponding to a binary period of $\lesssim$400 s, would enable precision measurements of ultra-relativistic phenomena. We show that, given plausible assumptions, multi-messenger observations of ultra-relativistic binaries can be used to constrain the neutron star equation of state with remarkable fidelity. It may be possible to measure the mass-radius relation with a precision of $\approx$0.2% after 10 yr of observations with the SKA. Such a measurement would be roughly an order of magnitude more precise than possible with other proposed observations. We summarize some of the other remarkable science made possible with multi-messenger observations of millihertz binaries, and discuss the prospects for the detection of such objects.


title: Comparison of Accuracy and Scalability of Gauss-Newton and Alternating Least Squares for CP Decomposition

abstract: Alternating least squares is the most widely used algorithm for CP tensor decomposition. However, alternating least squares may exhibit slow or no convergence, especially when high accuracy is required. An alternative approach is to regard CP decomposition as a nonlinear least squares problem and employ Newton-like methods. Direct solution of linear systems involving an approximated Hessian is generally expensive. However, recent advancements have shown that use of an implicit representation of the linear system makes these methods competitive with alternating least squares. We provide the first parallel implementation of a Gauss-Newton method for CP decomposition, which iteratively solves linear least squares problems at each Gauss-Newton step. In particular, we leverage a formulation that employs tensor contractions for implicit matrix-vector products within the conjugate gradient method. The use of tensor contractions enables us to employ the Cyclops library for distributed-memory tensor computations to parallelize the Gauss-Newton approach with a high-level Python implementation. In addition, we propose a regularization scheme for Gauss-Newton method to improve convergence properties without any additional cost. We study the convergence of variants of the Gauss-Newton method relative to ALS for finding exact CP decompositions as well as approximate decompositions of real-world tensors. We evaluate the performance of sequential and parallel versions of both approaches, and study the parallel scalability on the Stampede2 supercomputer.


title: High-dimensional sample covariance matrices with Curie-Weiss entries

abstract: We study the limiting spectral distribution of sample covariance matrices $XX^T$, where $X$ are $p\times n$ random matrices with correlated entries, for the cases $p/n\to y\in [0,\infty)$. If $y>0$, we obtain the Mar\v{c}enko-Pastur distribution and in the case $y=0$ the semicircle distribution (after appropriate rescaling). The entries we consider are Curie-Weiss spins, which are correlated random signs, where the degree of the correlation is governed by an inverse temperature $\beta>0$. The model exhibits a phase transition at $\beta=1$. The correlation between any two entries decays at a rate of $O(np)$ for $\beta \in (0,1)$, $O(\sqrt{np}$) for $\beta=1$, and for $\beta>1$ the correlation does not vanish in the limit. In our proofs we use Stieltjes transforms and concentration of random quadratic forms.


title: Tetraneutron resonance in the presence of a dineutron

abstract: Background: Several previous studies provided contradicting results for the four-neutron system, some claiming the existence of a 0+ near-threshold resonance, others denying presence of any observable resonant states. Purpose: Since most of the studies employed enhanced two-neutron interactions to follow the evolution of an artificially bound state into a continuum one, we examine several enhancement schemes that produce a bound dineutron as well. Methods: We study the four-neutron system by solving exact four-particle equations. By varying the interaction enhancement factor we calculate two-dineutron scattering phase shifts and cross sections. Results: When the same enhancement factor is used in all partial waves, a bound tetraneutron emerges together with a strongly bound dineutron. Furthermore, such a 0+ tetraneutron evolves not into a resonance but into a virtual state. Weak enhancement of S waves together with strongly enhanced higher waves is needed for the emergence of the resonant state. Anyhow the resonant behavior disappears well before reaching the physical interaction strength. Conclusions: The interaction enhancement scheme using the same factor for all waves, employed in several previous works, is misleading for the search of 0+ resonance as only a virtual state can emerge. Evolution of a bound tetraneutron into a resonance via an intermediate virtual state is possible with strong enhancement of higher two-neutron waves.


title: Finite groups of bimeromorphic selfmaps of uniruled K\"ahler threefolds

abstract: We classify uniruled compact K\"ahler threefolds whose groups of bimeromorphic selfmaps do not have Jordan property.


title: Structured Controller Parameter Tuning for Power Systems

abstract: Reliable and secure operation of power systems becomes increasingly challenging as the share of volatile generation rises, leading to largely changing dynamics. Typically, the architecture and structure of controllers in power systems, such as voltage controllers of power generators, are fixed during the design and buildup of the network. As replacing existing controllers is often undesired and challenging, setpoint adjustments, as well as tuning of the controller parameters, are possibilities to counteract large disturbances and changing dynamics. We present an approach for fast and computationally efficient adaptation of parameters of structured controllers based on H-infinity optimization, also referred to as structured H-infinity controller synthesis, tailored towards power systems. Conditions are established that guarantee that the approach leads to stability.The results are verified in a testbed microgrid consisting of six inverters and a load bank, as well as simulation studies. The proposed method improves the system robustness, as well as the time-response to step disturbances and allows structured controller tuning even for large networks.


title: CXPlain: Causal Explanations for Model Interpretation under Uncertainty

abstract: Feature importance estimates that inform users about the degree to which given inputs influence the output of a predictive model are crucial for understanding, validating, and interpreting machine-learning models. However, providing fast and accurate estimates of feature importance for high-dimensional data, and quantifying the uncertainty of such estimates remain open challenges. Here, we frame the task of providing explanations for the decisions of machine-learning models as a causal learning task, and train causal explanation (CXPlain) models that learn to estimate to what degree certain inputs cause outputs in another machine-learning model. CXPlain can, once trained, be used to explain the target model in little time, and enables the quantification of the uncertainty associated with its feature importance estimates via bootstrap ensembling. We present experiments that demonstrate that CXPlain is significantly more accurate and faster than existing model-agnostic methods for estimating feature importance. In addition, we confirm that the uncertainty estimates provided by CXPlain ensembles are strongly correlated with their ability to accurately estimate feature importance on held-out data.


abstract: Using high-resolution player tracking data made available by the National Football League (NFL) for their 2019 Big Data Bowl competition, we introduce the Expected Hypothetical Completion Probability (EHCP), a objective framework for evaluating plays. At the heart of EHCP is the question "on a given passing play, did the quarterback throw the pass to the receiver who was most likely to catch it?" To answer this question, we first built a Bayesian non-parametric catch probability model that automatically accounts for complex interactions between inputs like the receiver's speed and distances to the ball and nearest defender. While building such a model is, in principle, straightforward, using it to reason about a hypothetical pass is challenging because many of the model inputs corresponding to a hypothetical are necessarily unobserved. To wit, it is impossible to observe how close an un-targeted receiver would be to his nearest defender had the pass been thrown to him instead of the receiver who was actually targeted. To overcome this fundamental difficulty, we propose imputing the unobservable inputs and averaging our model predictions across these imputations to derive EHCP. In this way, EHCP can track how the completion probability evolves for each receiver over the course of a play in a way that accounts for the uncertainty about missing inputs.


title: Counting embedded curves in symplectic 6-manifolds

abstract: Based on computations of Pandharipande, Zinger proved that the Gopakumar-Vafa BPS invariants $\mathrm{BPS}_{A,g}(X,\omega)$ for primitive Calabi-Yau classes and arbitrary Fano classes $A$ on a symplectic $6$-manifold $(X,\omega)$ agree with the signed count $n_{A,g}(X,\omega)$ of embedded $J$-holomorphic curves representing $A$ and of genus $g$ for a generic almost complex structure $J$ compatible with $\omega$. Zinger's proof of the invariance of $n_{A,g}(X,\omega)$ is indirect, as it relies on Gromov--Witten theory. In this article we give a direct proof of the invariance of $n_{A,g}(X,\omega)$. Furthermore, we prove that $n_{A,g}(X,\omega) = 0$ for $g \gg 1$, thus proving the Gopakumar-Vafa finiteness conjecture for primitive Calabi-Yau classes and arbitrary Fano classes.


title: Electron-phonon Coupling and Kohn Anomaly due to the Floating 2D Electronic Bands on the Surface of ZrSiS

abstract: ZrSiS, an intriguing candidate of topological nodal line semimetals, was discovered to have exotic surface floating two-dimensional (2D) electrons [Phys. Rev. X 7, 041073 (2017)], which are likely to interact with surface phonons. Here, we reveal a prominent Kohn anomaly in a surface phonon branch by mapping out the surface phonon dispersions of ZrSiS using high-resolution electron energy loss spectroscopy. Theoretical analysis via an electron-phonon coupling (EPC) model attributes the strong renormalization of the surface phonon branch to the interactions with the surface floating 2D electrons. With the random phase approximation, we calculate the phonon self-energy and evaluate the mode-specific EPC constant by fitting the experimental data. The EPC picture provided here may be important for potential applications of topological nodal line semimetals.


title: Cilkmem: Algorithms for Analyzing the Memory High-Water Mark of Fork-Join Parallel Programs

abstract: Software engineers designing recursive fork-join programs destined to run on massively parallel computing systems must be cognizant of how their program's memory requirements scale in a many-processor execution. Although tools exist for measuring memory usage during one particular execution of a parallel program, such tools cannot bound the worst-case memory usage over all possible parallel executions. This paper introduces Cilkmem, a tool that analyzes the execution of a deterministic Cilk program to determine its $p$-processor memory high-water mark (MHWM), which is the worst-case memory usage of the program over \emph{all possible} $p$-processor executions. Cilkmem employs two new algorithms for computing the $p$-processor MHWM. The first algorithm calculates the exact $p$-processor MHWM in $O(T_1 \cdot p)$ time, where $T_1$ is the total work of the program. The second algorithm solves, in $O(T_1)$ time, the approximate threshold problem, which asks, for a given memory threshold $M$, whether the $p$-processor MHWM exceeds $M/2$ or whether it is guaranteed to be less than $M$. Both algorithms are memory efficient, requiring $O(p \cdot D)$ and $O(D)$ space, respectively, where $D$ is the maximum call-stack depth of the program's execution on a single thread. Our empirical studies show that Cilkmem generally exhibits low overheads. Across ten application benchmarks from the Cilkbench suite, the exact algorithm incurs a geometric-mean multiplicative overhead of $1.54$ for $p=128$, whereas the approximation-threshold algorithm incurs an overhead of $1.36$ independent of $p$. In addition, we use Cilkmem to reveal and diagnose a previously unknown issue in a large image-alignment program contributing to unexpectedly high memory usage under parallel executions.


title: On lifting invariant probability measures

abstract: In this note we study when an invariant probability measure lifts to an invariant measure. Consider a standard Borel space $X$, a Borel probability measure $\mu$ on $X$, a Borel map $T \colon X \to X$ preserving $\mu$, a compact metric space $Y$, a continuous map $S\colon Y \to Y$, and a Borel surjection $p \colon Y \to X$ with $p\circ S = T \circ p$. We prove that if fibers of $p$ are compact then $\mu$ lifts to an $S$-invariant measure on $Y$.


title: Minimizing a Sum of Clipped Convex Functions

abstract: We consider the problem of minimizing a sum of clipped convex functions; applications include clipped empirical risk minimization and clipped control. While the problem of minimizing the sum of clipped convex functions is NP-hard, we present some heuristics for approximately solving instances of these problems. These heuristics can be used to find good, if not global, solutions and appear to work well in practice. We also describe an alternative formulation, based on the perspective transformation, which makes the problem amenable to mixed-integer convex programming and yields computationally tractable lower bounds. We illustrate one of our heuristic methods by applying it to various examples and use the perspective transformation to certify that the solutions are relatively close to the global optimum. This paper is accompanied by an open-source implementation.


title: Disentangling synchrony from serial dependency in paired event time series

abstract: Quantifying synchronization phenomena based on the timing of events has recently attracted a great deal of interest in various disciplines such as neuroscience or climatology. A multitude of similarity measures has been proposed for this purpose, including Event Synchronization (ES) and Event Coincidence Analysis (ECA) as two widely applicable examples. While ES defines synchrony in a data adaptive local way that does not distinguish between different time scales, ECA requires selecting a specific scale for analysis. In this paper, we use slightly modified versions of both ES and ECA that address previous issues with respect to proper normalization and boundary treatment, which are particularly relevant for short time series with low temporal resolution. By numerically studying threshold crossing events in coupled autoregressive processes, we identify a practical limitation of ES when attempting to study synchrony between serially dependent event sequences exhibiting event clustering in time. Practical implications of this observation are demonstrated for the case of functional network representations of climate extremes based on both ES and ECA, while no marked differences between both measures are observed for the case of epileptic electroencephalogram (EEG) data. Our findings suggest that careful event detection along with diligent preprocessing is recommended when applying ES while less crucial for ECA. Despite the lack of a general modus operandi for both event definition and detection of synchronization, we suggest ECA as a widely robust method, especially for time resolved synchronization analyses of event time series from various disciplines.


title: The Penrose inequality and positive mass theorem with charge for manifolds with asymptotically cylindrical ends

abstract: We establish the charged Penrose inequality for time symmetric initial data sets having an outermost minimal surface boundary and finitely many asymptotically cylindrical ends, with an appropriate rigidity statement. This is accomplished by a doubling argument based on the work of Weinstein and Yamada, and a subsequent application of the ordinary charged Penrose inequality as established by Khuri, Weinstein, and Yamada. Furthermore, the techniques used in the aforementioned proof allow for the proof of the positive mass theorem with charge for such manifolds.


title: Experiments in machine learning of alpha-decay half-lives

abstract: Artificial neural networks are trained by a standard backpropagation learning algorithm with regularization to model and predict the systematics of -decay of heavy and superheavy nuclei. This approach to regression is implemented in two alternative modes: (i) construction of a statistical global model based solely on available experimental data for alpha-decay half-lives, and (ii) modeling of the {\it residuals} between the predictions of state-of-the-art phenomenological model (specifically, the effective liquid-drop model (ELDM)) and experiment. Analysis of the results provide insights on the strengths and limitations of this application of machine learning (ML) to exploration of the nuclear landscape in regions beyond the valley of stability.


title: A Case for Quantifying Statistical Robustness of Specialized Probabilistic AI Accelerators

abstract: Statistical machine learning often uses probabilistic algorithms, such as Markov Chain Monte Carlo (MCMC), to solve a wide range of problems. Many accelerators are proposed using specialized hardware to address sampling inefficiency, the critical performance bottleneck of probabilistic algorithms. These accelerators usually improve the hardware efficiency by using some approximation techniques, such as reducing bit representation, truncating small values to zero, or simplifying the Random Number Generator (RNG). Understanding the influence of these approximations on result quality is crucial to meeting the quality requirements of real applications. Although a common approach is to compare the end-point result quality using community-standard benchmarks and metrics, we claim a probabilistic architecture should provide some measure (or guarantee) of statistical robustness. This work takes a first step towards quantifying the statistical robustness of specialized hardware MCMC accelerators by proposing three pillars of statistical robustness: sampling quality, convergence diagnostic, and goodness of fit. Each pillar has at least one quantitative metric without the need to know the ground truth data. We apply this method to analyze the statistical robustness of an MCMC accelerator proposed by previous work, with some modifications, as a case study. The method also applies to other probabilistic accelerators and can be used in design space exploration.


title: Influence of quantum fluctuations on the superfluid critical velocity of a one-dimensional Bose gas

abstract: The mean-field Gross-Pitaevskii equation with repulsive interactions exhibits frictionless flow when stirred by an obstacle below a critical velocity. Here we go beyond the mean-field approximation to examine the influence of quantum fluctuations on this threshold behaviour in a one-dimensional Bose gas in a ring. Using the truncated Wigner approximation, we perform simulations of ensembles of trajectories where the Bose gas is stirred with a repulsive obstacle below the mean-field critical velocity. We observe the probabilistic formation of grey solitons which subsequently decay, leading to an increase in the momentum of the fluid. The formation of the first soliton leads to a soliton cascade, such that the fluid rapidly accelerates to minimise the speed difference with the obstacle. We measure the initial rate of momentum transfer, and relate it to macroscopic tunnelling between quantised flow states in the ring.


title: Motivic Donaldson-Thomas Invariants of Parabolic Higgs Bundles and Parabolic Connections on a Curve

abstract: Let $X$ be a smooth projective curve over a field of characteristic zero and let $D$ be a non-empty set of rational points of $X$. We calculate the motivic classes of moduli stacks of semistable parabolic bundles with connections on $(X,D)$ and motivic classes of moduli stacks of semistable parabolic Higgs bundles on $(X,D)$. As a by-product we give a criteria for non-emptiness of these moduli stacks, which can be viewed as a version of the Deligne-Simpson problem.

categories: math.AG hep-th math-ph math.KT math.MP math.SG


title: Description of a multifocal arrangement of asymmetric Kummer-beam optical vortices

abstract: In this work, an analytic expression is derived for the optical field generated by an off-axis Gaussian beam diffracted by a Discrete Vortex-Producing Lens. With this system, a multifocal arrangement of asymmetric optical vortices is obtained whose topological charge values change with the position along the optical axis. This scheme allows obtaining a principal asymmetric vortex corresponding with the topological charge value of the phase mask and secondary ones with different charges. With the analytical expression, the effects induced by the discretization and misalignment on the irradiance and phase of each vortex can be simultaneously studied. A signal-to-noise ratio expression is derived to verify if the noise of the multifocal system might affect importantly the optical vortices of interest. Finally, we proposed new metrics to measure the off-axis displacement using the phase of the vortex. We concluded that noise is not a problem, then a Discrete Vortex-Producing Lens can be used as a continuous Spiral Phase Plate with the bonus that secondary optical vortices can be used in the same way as principal optical vortices.


title: On pseudo-Anosov autoequivalences

abstract: Motivated by results of Thurston, we prove that any autoequivalence of a triangulated category induces a filtration by triangulated subcategories, provided the existence of Bridgeland stability conditions. The filtration is given by the exponential growth rate of masses under iterates of the autoequivalence, and only depends on the choice of a connected component of the stability manifold. We then propose a new definition of pseudo-Anosov autoequivalences, and prove that our definition is more general than the one previously proposed by Dimitrov, Haiden, Katzarkov, and Kontsevich. We construct new examples of pseudo-Anosov autoequivalences on the derived categories of quintic Calabi-Yau threefolds and quiver Calabi-Yau categories. Finally, we prove that certain pseudo-Anosov autoequivalences on quiver 3-Calabi-Yau categories act hyperbolically on the space of Bridgeland stability conditions.


title: Hyperfine Structure and Coherent Dynamics of Rare Earth Spins Explored with Electron-Nuclear Double Resonance at Sub-Kelvin Temperatures

abstract: An experimental platform of ultralow-temperature pulsed ENDOR (electron-nuclear double resonance) spectroscopy is constructed for the bulk materials. Coherent property of the coupled electron and nuclear spins of the rare-earth (RE) dopants in a crystal (143Nd3+:Y2SiO5) is investigated from 100 mK to 6 K. At the lowest working temperatures, two-pulse-echo coherence time exceeding 2 ms and 40 ms are achieved for the electron and nuclear spins, while the electronic Zeeman and hyperfine population lifetimes are more than 15 s and 10 min. With the aid of the near-unity electron spin polarization at 100 mK, the complete hyperfine level structure with 16 energy levels is measured using ENDOR technique without the assistance of the reconstructed spin Hamiltonian. These results demonstrate the suitability of the deeply cooled paramagnetic RE-doped solids for memory components aimed for quantum communication and quantum computation. The developed experimental platform is expected to be a powerful tool for paramagnetic materials from various research fields.


title: The trans-Planckian censorship conjecture from the swampland distance conjecture

abstract: Starting from the swampland distance conjecture, and using the species bound for a large number of weakly-coupled particles, we give a derivation of the recently proposed trans-Planckian censorship conjecture. Our argument demonstrates how a quantum gravity principle requires that trans-Planckian quantum fluctuations should never cross the Hubble horizon. We also comment on how logarithmic corrections to the de-Sitter conjecture arise naturally from such an approach when one relaxes the requirement of traversing parametrically large distances on field space.


title: On the Parameterized Complexity of Sparsest Cut and Small-set Expansion Problems

abstract: We present a parameterized dichotomy for the \textsc{$k$-Sparsest Cut} problem in weighted and unweighted versions. In particular, we show that the weighted \textsc{$k$-Sparsest Cut} problem is NP-hard for every $k\geq 3$ even on graphs with bounded vertex cover number. Also, the unweighted \textsc{$k$-Sparsest Cut} problem is W[1]-hard when parameterized by the three combined parameters tree-depth, feedback vertex set number, and $k$. On the positive side, we show that unweighted \textsc{$k$-Sparsest Cut} problem is FPT when parameterized by the vertex cover number and $k$, and when $k$ is fixed, it is FPT with respect to the treewidth. Moreover, we show that the generalized version \textsc{$k$-Small-Set Expansion} problem is FPT when parameterized by $k$ and the maximum degree of the graph, though it is W[1]-hard for each of these parameters separately.


title: Task-Oriented Language Grounding for Language Input with Multiple Sub-Goals of Non-Linear Order

abstract: In this work, we analyze the performance of general deep reinforcement learning algorithms for a task-oriented language grounding problem, where language input contains multiple sub-goals and their order of execution is non-linear. We generate a simple instructional language for the GridWorld environment, that is built around three language elements (order connectors) defining the order of execution: one linear - "comma" and two non-linear - "but first", "but before". We apply one of the deep reinforcement learning baselines - Double DQN with frame stacking and ablate several extensions such as Prioritized Experience Replay and Gated-Attention architecture. Our results show that the introduction of non-linear order connectors improves the success rate on instructions with a higher number of sub-goals in 2-3 times, but it still does not exceed 20%. Also, we observe that the usage of Gated-Attention provides no competitive advantage against concatenation in this setting. Source code and experiments' results are available at https://github.com/vkurenkov/language-grounding-multigoal


title: The $k$-adjacency operators and adjacency Jacobi matrix on distance-regular graphs

abstract: We deal in this work with a class of graphs, namely, the class of distance-regular graphs, in which on the basis of $k$-adjacency operators, the adjacency operator $A$ of a distance-regular graph is identified as a Jacobi matrix. To get so, the set of the $k$-adjacency operators is recognized as a canonical basis in a certain Hilbert space, where the spectrum of the Jacobi matrix coincides with the support of the measure of $A$. The obtained identification permits a deeper spectral analysis of the graph. The finite-dimensional case is addressed by means of the extension theory of nondensely defined, symmetric linear operators.


title: Universal Fourier expansions of Bianchi modular forms

abstract: We generalize Merel's work on universal Fourier expansions to Bianchi modular forms over Euclidean imaginary quadratic fields, under the assumption of the nondegeneracy of a pairing between Bianchi modular forms and Bianchi modular symbols. Among the key inputs is a computation of the action of Hecke operators on Manin symbols, and building upon the Heilbronn-Merel matrices constructed by Mohamed.


title: Thermal History of the Early Universe and Primordial Gravitational Waves from Induced Scalar Perturbations

abstract: We study the induced primordial gravitational waves (GW) coming from the effect of scalar perturbation on the tensor perturbation at the second order of cosmological perturbation theory. We use the evolution of the standard model degrees of freedom with respect to temperature in the early Universe to compute the induced gravitational waves bakcground. Our result shows that the spectrum of the induced GW is affected differently by the standard model degrees of freedom than the GW coming from first order tensor perturbation. This phenomenon is due to the presence of scalar perturbations as a source for tensor perturbations and it is effective around the quark gluon deconfinement and electroweak transition. In case of considering a scalar spectral index larger than one at small scales or a non-Gaussian curvature power spectrum this effect can be observed by gravitational wave observatories.


title: Dual Instrumental Variable Regression

abstract: We present a novel algorithm for non-linear instrumental variable (IV) regression, DualIV, which simplifies traditional two-stage methods via a dual formulation. Inspired by problems in stochastic programming, we show that two-stage procedures for non-linear IV regression can be reformulated as a convex-concave saddle-point problem. Our formulation enables us to circumvent the first-stage regression which is a potential bottleneck in real-world applications. We develop a simple kernel-based algorithm with an analytic solution based on this formulation. Empirical results show that we are competitive to existing, more complicated algorithms for non-linear instrumental variable regression.


title: Chatter Diagnosis in Milling Using Supervised Learning and Topological Features Vector

abstract: Chatter detection has become a prominent subject of interest due to its effect on cutting tool life, surface finish and spindle of machine tool. Most of the existing methods in chatter detection literature are based on signal processing and signal decomposition. In this study, we use topological features of data simulating cutting tool vibrations, combined with four supervised machine learning algorithms to diagnose chatter in the milling process. Persistence diagrams, a method of representing topological features, are not easily used in the context of machine learning, so they must be transformed into a form that is more amenable. Specifically, we will focus on two different methods for featurizing persistence diagrams, Carlsson coordinates and template functions. In this paper, we provide classification results for simulated data from various cutting configurations, including upmilling and downmilling, in addition to the same data with some added noise. Our results show that Carlsson Coordinates and Template Functions yield accuracies as high as 96% and 95%, respectively. We also provide evidence that these topological methods are noise robust descriptors for chatter detection.


title: Conditional Expectation Propagation

abstract: Expectation propagation (EP) is a powerful approximate inference algorithm. However, a critical barrier in applying EP is that the moment matching in message updates can be intractable. Handcrafting approximations is usually tricky, and lacks generalizability. Importance sampling is very expensive. While Laplace propagation provides a good solution, it has to run numerical optimizations to find Laplace approximations in every update, which is still quite inefficient. To overcome these practical barriers, we propose conditional expectation propagation (CEP) that performs conditional moment matching given the variables outside each message, and then takes expectation w.r.t the approximate posterior of these variables. The conditional moments are often analytical and much easier to derive. In the most general case, we can use (fully) factorized messages to represent the conditional moments by quadrature formulas. We then compute the expectation of the conditional moments via Taylor approximations when necessary. In this way, our algorithm can always conduct efficient, analytical fixed point iterations. Experiments on several popular models for which standard EP is available or unavailable demonstrate the advantages of CEP in both inference quality and computational efficiency.


title: SENSE: a Shared Encoder Network for Scene-flow Estimation

abstract: We introduce a compact network for holistic scene flow estimation, called SENSE, which shares common encoder features among four closely-related tasks: optical flow estimation, disparity estimation from stereo, occlusion estimation, and semantic segmentation. Our key insight is that sharing features makes the network more compact, induces better feature representations, and can better exploit interactions among these tasks to handle partially labeled data. With a shared encoder, we can flexibly add decoders for different tasks during training. This modular design leads to a compact and efficient model at inference time. Exploiting the interactions among these tasks allows us to introduce distillation and self-supervised losses in addition to supervised losses, which can better handle partially labeled real-world data. SENSE achieves state-of-the-art results on several optical flow benchmarks and runs as fast as networks specifically designed for optical flow. It also compares favorably against the state of the art on stereo and scene flow, while consuming much less memory.


title: Distance approximation using Isolation Forests

abstract: This work briefly explores the possibility of approximating spatial distance (alternatively, similarity) between data points using the Isolation Forest method envisioned for outlier detection. The logic is similar to that of isolation: the more similar or closer two points are, the more random splits it will take to separate them. The separation depth between two points can be standardized in the same way as the isolation depth, transforming it into a distance metric that is limited in range, centered, and in compliance with the axioms of distance. This metric presents some desirable properties such as being invariant to the scales of variables or being able to account for non-linear relationships between variables, which other metrics such as Euclidean or Mahalanobis distance do not. Extensions to the Isolation Forest method are also proposed for handling categorical variables and missing values, resulting in a more generalizable and robust metric.


title: The Quo Vadis submission at Traffic4cast 2019

abstract: We describe the submission of the Quo Vadis team to the Traffic4cast competition, which was organized as part of the NeurIPS 2019 series of challenges. Our system consists of a temporal regression module, implemented as $1\times1$ 2d convolutions, augmented with spatio-temporal biases. We have found that using biases is a straightforward and efficient way to include seasonal patterns and to improve the performance of the temporal regression model. Our implementation obtains a mean squared error of $9.47\times 10^{-3}$ on the test data, placing us on the eight place team-wise. We also present our attempts at incorporating spatial correlations into the model; however, contrary to our expectations, adding this type of auxiliary information did not benefit the main system. Our code is available at https://github.com/danoneata/traffic4cast.


title: Neighbor connectivity of $k$-ary $n$-cubes

abstract: The neighbor connectivity of a graph $G$ is the least number of vertices such that removing their closed neighborhoods from $G$ results in a graph that is disconnected, complete or empty. If a~graph is used to model the topology of an interconnection network, this means that the failure of a network node causes failures of all its neighbors. We completely determine the neighbor connectivity of $k$-ary $n$-cubes for all $n\ge1$ and $k\ge2$.


title: Homogeneous Higgs and co-Higgs bundles on Hermitian symmetric spaces

abstract: We define homogeneous principal Higgs and co-Higgs bundles over irreducible Hermitian symmetric spaces of compact type. We provide a classification for each type of object up to isomorphism, which in each case can be interpreted as defining a moduli space.


title: Thieves on Sesame Street! Model Extraction of BERT-based APIs

abstract: We study the problem of model extraction in natural language processing, in which an adversary with only query access to a victim model attempts to reconstruct a local copy of that model. Assuming that both the adversary and victim model fine-tune a large pretrained language model such as BERT (Devlin et al. 2019), we show that the adversary does not need any real training data to successfully mount the attack. In fact, the attacker need not even use grammatical or semantically meaningful queries: we show that random sequences of words coupled with task-specific heuristics form effective queries for model extraction on a diverse set of NLP tasks, including natural language inference and question answering. Our work thus highlights an exploit only made feasible by the shift towards transfer learning methods within the NLP community: for a query budget of a few hundred dollars, an attacker can extract a model that performs only slightly worse than the victim model. Finally, we study two defense strategies against model extraction---membership classification and API watermarking---which while successful against naive adversaries, are ineffective against more sophisticated ones.


title: Training ASR models by Generation of Contextual Information

abstract: Supervised ASR models have reached unprecedented levels of accuracy, thanks in part to ever-increasing amounts of labelled training data. However, in many applications and locales, only moderate amounts of data are available, which has led to a surge in semi- and weakly-supervised learning research. In this paper, we conduct a large-scale study evaluating the effectiveness of weakly-supervised learning for speech recognition by using loosely related contextual information as a surrogate for ground-truth labels. For weakly supervised training, we use 50k hours of public English social media videos along with their respective titles and post text to train an encoder-decoder transformer model. Our best encoder-decoder models achieve an average of 20.8% WER reduction over a 1000 hours supervised baseline, and an average of 13.4% WER reduction when using only the weakly supervised encoder for CTC fine-tuning. Our results show that our setup for weak supervision improved both the encoder acoustic representations as well as the decoder language generation abilities.


title: Multitask Learning For Different Subword Segmentations In Neural Machine Translation

abstract: In Neural Machine Translation (NMT) the usage of subwords and characters as source and target units offers a simple and flexible solution for translation of rare and unseen words. However, selecting the optimal subword segmentation involves a trade-off between expressiveness and flexibility, and is language and dataset-dependent. We present Block Multitask Learning (BMTL), a novel NMT architecture that predicts multiple targets of different granularities simultaneously, removing the need to search for the optimal segmentation strategy. Our multi-task model exhibits improvements of up to 1.7 BLEU points on each decoder over single-task baseline models with the same number of parameters on datasets from two language pairs of IWSLT15 and one from IWSLT19. The multiple hypotheses generated at different granularities can be combined as a post-processing step to give better translations, which improves over hypothesis combination from baseline models while using substantially fewer parameters.


title: Sound Event Recognition in a Smart City Surveillance Context

abstract: Due to the growing demand for improving surveillance capabilities in smart cities, systems need to be developed to provide better monitoring capabilities to competent authorities, agencies responsible for strategic resource management, and emergency call centers. This work assumes that, as a complementary monitoring solution, the use of a system capable of detecting the occurrence of sound events, performing the Sound Events Recognition (SER) task, is highly convenient. In order to contribute to the classification of such events, this paper explored several classifiers over the SESA dataset, composed of audios of three hazard classes (gunshots, explosions, and sirens) and a class of casual sounds that could be misinterpreted as some of the other sounds. The best result was obtained by SGD, with an accuracy of 72.13% with 6.81 ms classification time, reinforcing the viability of such an approach.


title: Input-Cell Attention Reduces Vanishing Saliency of Recurrent Neural Networks

abstract: Recent efforts to improve the interpretability of deep neural networks use saliency to characterize the importance of input features to predictions made by models. Work on interpretability using saliency-based methods on Recurrent Neural Networks (RNNs) has mostly targeted language tasks, and their applicability to time series data is less understood. In this work we analyze saliency-based methods for RNNs, both classical and gated cell architectures. We show that RNN saliency vanishes over time, biasing detection of salient features only to later time steps and are, therefore, incapable of reliably detecting important features at arbitrary time intervals. To address this vanishing saliency problem, we propose a novel RNN cell structure (input-cell attention), which can extend any RNN cell architecture. At each time step, instead of only looking at the current input vector, input-cell attention uses a fixed-size matrix embedding, each row of the matrix attending to different inputs from current or previous time steps. Using synthetic data, we show that the saliency map produced by the input-cell attention RNN is able to faithfully detect important features regardless of their occurrence in time. We also apply the input-cell attention RNN on a neuroscience task analyzing functional Magnetic Resonance Imaging (fMRI) data for human subjects performing a variety of tasks. In this case, we use saliency to characterize brain regions (input features) for which activity is important to distinguish between tasks. We show that standard RNN architectures are only capable of detecting important brain regions in the last few time steps of the fMRI data, while the input-cell attention model is able to detect important brain region activity across time without latter time step biases.


title: A proof of the contractibility of the 2-operad defined via the twisted tensor product

abstract: In our recent papers [Sh1,2], we introduced a {\it twisted tensor product} of dg categories, and provided, in terms of it, {\it a contractible 2-operad $\mathcal{O}$}, acting on the category of small dg categories, in which the "natural transformations" are derived. We made use of some homotopy theory developed in [To] to prove the contractibility of the 2-operad $\mathcal{O}$. The contractibility is an important issue, in vein of the theory of Batanin [Ba1,2], according to which an action of a contractible $n$-operad on $C$ makes $C$ a weak $n$-category. In this short note, we provide a new elementary proof of the contractibility of the 2-operad $\mathcal{O}$. The proof is based on a direct computation, and is independent from the homotopy theory of dg categories (in particular, it is independent from [To] and from Theorem 2.4 of [Sh1]).