title: Halo: Learning Semantics-Aware Representations for Cross-Lingual Information Extraction

abstract: Cross-lingual information extraction (CLIE) is an important and challenging task, especially in low resource scenarios. To tackle this challenge, we propose a training method, called Halo, which enforces the local region of each hidden state of a neural model to only generate target tokens with the same semantic structure tag. This simple but powerful technique enables a neural model to learn semantics-aware representations that are robust to noise, without introducing any extra parameter, thus yielding better generalization in both high and low resource settings.


title: The Sounds of Cyber Threats

abstract: The Internet enables users to access vast resources, but it can also expose users to harmful cyber-attacks. This paper investigates human factors issues concerning the use of sounds in a cyber-security domain. It describes a methodology, referred to as sonification, to effectively design and develop auditory cyber-security threat indicators to warn users about cyber-attacks. A case study is presented, along with the results, of various types of usability testing with a number of Internet users who are visually impaired. The paper concludes with a discussion of future steps to enhance this work.


title: Multiple Causal Inference with Latent Confounding

abstract: Causal inference from observational data requires assumptions. These assumptions range from measuring confounders to identifying instruments. Traditionally, causal inference assumptions have focused on estimation of effects for a single treatment. In this work, we construct techniques for estimation with multiple treatments in the presence of unobserved confounding. We develop two assumptions based on shared confounding between treatments and independence of treatments given the confounder. Together, these assumptions lead to a confounder estimator regularized by mutual information. For this estimator, we develop a tractable lower bound. To recover treatment effects, we use the residual information in the treatments independent of the confounder. We validate on simulations and an example from clinical medicine.


title: Rayleigh scattering of twisted light by hydrogenlike ions

abstract: The elastic Rayleigh scattering of twisted light and, in particular, the polarization (transfer) of the scattered photons have been analyzed within the framework of second-order perturbation theory and Dirac's relativistic equation. Special attention was paid hereby to the scattering on three different atomic targets: single atoms, a mesoscopic (small) target, and a macroscopic (large) target, which are all centered with regard to the beam axis. Detailed calculations of the polarization Stokes parameters were performed for C^{5+} ions and for twisted Bessel beams. It is shown that the polarization of scattered photons is sensitive to the size of an atomic target and to the helicity, the opening angle, and the projection of the total angular momentum of the incident Bessel beam. These computations indicate more that the Stokes parameters of the (Rayleigh) scattered twisted light may significantly differ from their behaviour for an incident plane-wave radiation.


title: Multiple Treatments with Strategic Interaction

abstract: We develop an empirical framework to identify and estimate the effects of treatments on outcomes of interest when the treatments are the result of strategic interaction (e.g., bargaining, oligopolistic entry, peer effects). We consider a model where agents play a discrete game with complete information whose equilibrium actions (i.e., binary treatments) determine a post-game outcome in a nonseparable model with endogeneity. Due to the simultaneity in the first stage, the model as a whole is incomplete and the selection process fails to exhibit the conventional monotonicity. Without imposing parametric restrictions or large support assumptions, this poses challenges in recovering treatment parameters. To address these challenges, we first establish a monotonic pattern of the equilibria in the first-stage game in terms of the number of treatments selected. Based on this finding, we derive bounds on the average treatment effects (ATEs) under nonparametric shape restrictions and the existence of excluded exogenous variables. We show that instrument variation that compensates strategic substitution helps solve the multiple equilibria problem. We apply our method to data on airlines and air pollution in cities in the U.S. We find that (i) the causal effect of each airline on pollution is positive, and (ii) the effect is increasing in the number of firms but at a decreasing rate.


title: Quantum-spin-Hall insulator with a large gap: single-layer 1T' WSe$_2$

abstract: Two-dimensional (2D) topological insulators (TIs) are promising platforms for low-dissipation spintronic devices based on the quantum spin Hall (QSH) effect, but experimental realization of such systems with a large band gap suitable for room-temperature applications has proven difficult. Here, we report the successful growth on bilayer graphene of a quasi-freestanding WSe$_2$ single layer with the 1T' structure that does not exist in the bulk form of WSe$_2$. Using angle-resolved photoemission spectroscopy (ARPES) and scanning tunneling microscopy/spectroscopy (STM/STS), we observed a gap of 129 meV in the 1T' layer and an in-gap edge state located near the layer boundary. The system's 2D TI characters are confirmed by first-principles calculations. The observed gap diminishes with doping by Rb adsorption, ultimately leading to an insulator-semimetal transition. The discovery of this large-gap 2D TI with a tunable band gap opens up opportunities for developing advanced nanoscale systems and quantum devices.


title: Gaia DR2 reveals a very massive runaway star ejected from R136

abstract: A previous spectroscopic study identified the very massive O2 III star VFTS 16 in the Tarantula Nebula as a runaway star based on its peculiar line-of-sight velocity. We use the Gaia DR2 catalog to measure the relative proper motion of VFTS 16 and nearby bright stars to test if this star might have been ejected from the central cluster, R136, via dynamical ejection. We find that the position angle and magnitude of the relative proper motion (0.338 +/- 0.046 mas/yr, or approximately 80 +\- 11 km/s) of VFTS 16 are consistent with ejection from R136 approximately 1.5 +/- 0.2 Myr ago, very soon after the cluster was formed. There is some tension with the presumed age of VFTS 16 that, from published stellar parameters, cannot be greater than 0.9 +0.3/-0.2 Myr. Older ages for this star would appear to be prohibited due to the absence of He I lines in its optical spectrum, since this sets a firm lower limit on its effective temperature. The dynamical constraints may imply an unusual evolutionary history for this object, perhaps indicating it is a merger product. Gaia DR2 also confirms that another very massive star in the Tarantula Nebula, VFTS 72 (alias BI253; O2 III-V(n)((f*)), is also a runaway on the basis of its proper motion as measured by Gaia. While its tangential proper motion (0.392 +/-0.062 mas/yr or 93 +/-15 km/s) would be consistent with dynamical ejection from R136 approximately 1 Myr ago, its position angle is discrepant with this direction at the 2$\sigma$ level. From their Gaia DR2 proper motions we conclude that the two ~100 solar mass O2 stars, VFTS 16 and VFTS72, are fast runaway stars, with space velocities of around 100 km/s relative to R136 and the local massive star population. The dynamics of VFTS16 are consistent with it having been ejected from R136, and this star therefore sets a robust lower limit on the age of the central cluster of ~1.3 Myr.


title: The limit shape of convex hull peeling

abstract: We prove that the convex peeling of a random point set in dimension d approximates motion by the 1/(d + 1) power of Gaussian curvature. We use viscosity solution theory to interpret the limiting partial differential equation. We use the Martingale method to solve the cell problem associated to convex peeling. Our proof follows the program of Armstrong-Cardaliaguet for homogenization of geometric motions, but with completely different ingredients.


title: Bernoulli shifts with bases of equal entropy are isomorphic

abstract: We prove that if $G$ is a countably infinite group and $(L, \lambda)$ and $(K, \kappa)$ are probability spaces having equal Shannon entropy, then the Bernoulli shifts $G \curvearrowright (L^G, \lambda^G)$ and $G \curvearrowright (K^G, \kappa^G)$ are isomorphic. This extends Ornstein's famous isomorphism theorem to all countably infinite groups. Our proof builds on a slightly weaker theorem by Lewis Bowen in 2011 that required both $\lambda$ and $\kappa$ have at least $3$ points in their support. We furthermore produce finitary isomorphisms in the case where both $L$ and $K$ are finite.


title: Human Aspects and Perception of Privacy in Relation to Personalization

abstract: The concept of privacy is inherently intertwined with human attitudes and behaviours, as most computer systems are primarily designed for human use. Especially in the case of Recommender Systems, which feed on information provided by individuals, their efficacy critically depends on whether or not information is externalized, and if it is, how much of this information contributes positively to their performance and accuracy. In this paper, we discuss the impact of several factors on users' information disclosure behaviours and privacy-related attitudes, and how users of recommender systems can be nudged into making better privacy decisions for themselves. Apart from that, we also address the problem of privacy adaptation, i.e. effectively tailoring Recommender Systems by gaining a deeper understanding of people's cognitive decision-making process.


title: On profitability of selfish mining

abstract: We review the so called selfish mining strategy in the Bitcoin network and compare its profitability to honest mining.We build a rigorous profitability model for repetition games. The time analysis of the attack has been ignored in the previous literature based on a Markov model,but is critical. Using martingale's techniques and Doob Stopping Time Theorem we compute the expected duration of attack cycles. We discover a remarkable property of the bitcoin network: no strategy is more profitable than the honest strategy before a difficulty adjustment. So selfish mining can only become profitable afterwards, thus it is an attack on the difficulty adjustment algorithm. We propose an improvement of Bitcoin protocol making it immune to selfish mining attacks. We also study miner's attraction to selfish mining pools. We calculate the expected duration time before profit for the selfish miner, a computation that is out of reach by the previous Markov models.


title: The origin of the modulation of the radio emission from the solar corona by a fast magnetoacoustic wave

abstract: Observational detection of quasi-periodic drifting fine structures in a type III radio burst associated with a solar flare SOL2015-04-16T11:22, with Low Frequency Array, is presented. Although similar modulations of the type III emission have been observed before and were associated with the plasma density fluctuations, the origin of those fluctuations was unknown. Analysis of the striae of the intensity variation in the dynamic spectrum allowed us to reveal two quasi-oscillatory components. The shorter component has the apparent wavelength of $\sim2$ Mm, phase speed of $\sim657$ km s$^{-1}$, which gives the oscillation period of $\sim3$ s, and the relative amplitude of $\sim0.35$%. The longer component has the wavelength of $\sim12$ Mm, and relative amplitude of $\sim5.1$%. The short frequency range of the detection does not allow us to estimate its phase speed. However, the properties of the shorter oscillatory component allowed us to interpret it as a fast magnetoacoustic wave guided by a plasma non-uniformity along the magnetic field outwards from the Sun. The assumption that the intensity of the radio emission is proportional to the amount of plasma in the emitting volume allowed us to show that the superposition of the plasma density modulation by a fast wave and a longer-wavelength oscillation of an unspecified nature could readily reproduce the fine structure of the observed dynamic spectrum. The observed parameters of the fast wave give the absolute value of the magnetic field in the emitting plasma of $\sim1.1$ G which is consistent with the radial magnetic field model.


title: Weighted batch means estimators in Markov chain Monte Carlo

abstract: This paper proposes a family of weighted batch means variance estimators, which are computationally efficient and can be conveniently applied in practice. The focus is on Markov chain Monte Carlo simulations and estimation of the asymptotic covariance matrix in the Markov chain central limit theorem, where conditions ensuring strong consistency are provided. Finite sample performance is evaluated through auto-regressive, Bayesian spatial-temporal, and Bayesian logistic regression examples, where the new estimators show significant computational gains with a minor sacrifice in variance compared with existing methods.


title: Communication with Crystal-Free Radios

abstract: We consider a communication channel where there is no common clock between the transmitter and the receiver. This is motivated by the recent interest in building system-on-chip radios for Internet of Things applications, which cannot rely on crystal oscillators for accurate timing. We identify two types of clock uncertainty in such systems: timing jitter, which occurs at a time scale faster than the communication duration (or equivalently blocklength); and clock drift, which occurs at a slower time scale. We study the zero-error capacity under both types of timing imperfections, and obtain optimal zero-error codes for some cases. Our results show that, as opposed to common practice, in the presence of clock drift it is highly suboptimal to try to learn and track the clock frequency at the receiver; rather, one can design codes that come close to the performance of perfectly synchronous communication systems without any clock synchronization at the receiver.


title: Insights on unconventional superconductivity in HfV$_2$Ga$_4$ and ScV$_2$Ga$_4$ from first principles electronic structure calculations

abstract: The HfV$_2$Ga$_4$ compound was recently reported to exhibit unusual bulk superconducting properties, with the possibility of multiband behavior. To gain insight into its properties, we performed ab-initio electronic structure calculations based on the Density Functional Theory (DFT). Our results show that the density of states at the Fermi energy is mainly composed by V--$d$ states. The McMillan formula predicts a superconducting critical temperature ($T_{c}$) of approximately $3.9\,$K, in excellent agreement with the experimental value at $4.1\,$K, indicating that superconductivity in this new compound may be explained by the electron-phonon mechanism. Calculated valence charge density maps clearly show directional bonding between Hf and V atoms with 1D highly populated V-chains, and some ionic character between Hf--Ga and V--Ga bonds. Finally, we have shown that there are electrons occupying two distinct bands at the Fermi level, with different characters, which supports experimental indications of possible multiband superconductivity. Based on the results, we propose the study of a related compound, ScV$_2$Ga$_4$, showing that it has similar electronic properties, but probably with a higher $T_c$ than HfV$_2$Ga$_4$.


title: Optimizing state change detection in functional temporal networks through dynamic community detection

abstract: Dynamic community detection provides a coherent description of network clusters over time, allowing one to track the growth and death of communities as the network evolves. However, modularity maximization, a popular method for performing multilayer community detection, requires the specification of an appropriate null model as well as resolution and interlayer coupling parameters. Importantly, the ability of the algorithm to accurately detect community evolution is dependent on the choice of these parameters. In functional temporal networks, where evolving communities reflect changing functional relationships between network nodes, it is especially important that the detected communities reflect any state changes of the system. Here, we present analytical work suggesting that a uniform null model provides improved sensitivity to the detection of small evolving communities in temporal correlation networks. We then propose a method for increasing the sensitivity of modularity maximization to state changes in nodal dynamics by modeling self-identity links between layers based on the self-similarity of the network nodes between layers. This method is more appropriate for functional temporal networks from both a modeling and mathematical perspective, as it incorporates the dynamic nature of network nodes. We motivate our method based on applications in neuroscience where network nodes represent neurons and functional edges represent similarity of firing patterns in time. Finally, we show that in simulated data sets of neuronal spike trains, updating interlayer links based on the firing properties of the neurons provides superior community detection of evolving network structure when group of neurons change their firing properties over time.


title: Anti-regular graphs with loops and their spectrum

abstract: We characterize the graphs with loops whose degree sequences have no repeated values and find their adjacency spectrum. In the case of simple graphs, such graphs are called anti-regular graphs and are examples of threshold graphs. The spectrum is found by using the known relationship between tridiagonal matrices and orthogonal polynomials.


title: Transformations of High-Level Synthesis Codes for High-Performance Computing

abstract: Spatial computing architectures promise a major stride in performance and energy efficiency over the traditional load/store devices currently employed in large scale computing systems. The adoption of high-level synthesis (HLS) from languages such as C++ and OpenCL has greatly increased programmer productivity when designing for such platforms. While this has enabled a wider audience to target spatial computing architectures, the optimization principles known from traditional software design are no longer sufficient to implement high-performance codes, due to fundamentally distinct aspects of hardware design, such as programming for deep pipelines, distributed memory resources, and scalable routing. To alleviate this, we present a collection of optimizing transformations for HLS, targeting scalable and efficient architectures for high-performance computing (HPC) applications. We systematically identify classes of transformations (pipelining, scalability, and memory), the characteristics of their effect on the HLS code and the resulting hardware (e.g., increasing data reuse or resource consumption), and the objectives that each transformation can target (e.g., resolve interface contention, or increase parallelism). We show how these can be used to efficiently exploit pipelining, on-chip distributed fast memory, and on-chip dataflow, allowing for massively parallel architectures. To quantify the effect of various transformations, we cover the optimization process of a sample set of HPC kernels, provided as open source reference codes. We aim to establish a common toolbox to guide both performance engineers and compiler engineers in tapping into the performance potential offered by spatial computing architectures using HLS.


title: Measuring and regularizing networks in function space

abstract: To optimize a neural network one often thinks of optimizing its parameters, but it is ultimately a matter of optimizing the function that maps inputs to outputs. Since a change in the parameters might serve as a poor proxy for the change in the function, it is of some concern that primacy is given to parameters but that the correspondence has not been tested. Here, we show that it is simple and computationally feasible to calculate distances between functions in a $L^2$ Hilbert space. We examine how typical networks behave in this space, and compare how parameter $\ell^2$ distances compare to function $L^2$ distances between various points of an optimization trajectory. We find that the two distances are nontrivially related. In particular, the $L^2/\ell^2$ ratio decreases throughout optimization, reaching a steady value around when test error plateaus. We then investigate how the $L^2$ distance could be applied directly to optimization. We first propose that in multitask learning, one can avoid catastrophic forgetting by directly limiting how much the input/output function changes between tasks. Secondly, we propose a new learning rule that constrains the distance a network can travel through $L^2$-space in any one update. This allows new examples to be learned in a way that minimally interferes with what has previously been learned. These applications demonstrate how one can measure and regularize function distances directly, without relying on parameters or local approximations like loss curvature.


title: Circuits, Bond Graphs, and Signal-Flow Diagrams: A Categorical Perspective

abstract: We use the framework of "props" to study electrical circuits, signal-flow diagrams, and bond graphs. A prop is a strict symmetric monoidal category where the objects are natural numbers, with the tensor product of objects given by addition. In this approach, electrical circuits make up the morphisms in a prop, as do signal-flow diagrams, and bond graphs. A network, such as an electrical circuit, with $m$ inputs and $n$ outputs is a morphism from $m$ to $n$, while putting networks together in series is composition, and setting them side by side is tensoring. Here we work out the details of this approach for various kinds of electrical circuits, then signal-flow diagrams, and then bond graphs. Each kind of network corresponds to a mathematically natural prop. We also describe the "behavior" of electrical circuits, bond graphs, and signal-flow diagrams using morphisms between props. To assign a behavior to a network we "black box" the network, which forgets its inner workings and records only the relation it imposes between inputs and outputs. The process of black-boxing a network then corresponds to a morphism between props. Interestingly, there are two different behaviors for any bond graph, related by a natural transformation. To achieve all of this we first prove some foundational results about props. These results let us describe any prop in terms of generators and equations, and also define morphisms of props by naming where the generators go and checking that relevant equations hold. Technically, the key tools are the Rosebrugh--Sabadini--Walters result relating circuits to special commutative Frobenius monoids, the monadic adjunction between props and signatures, and a result saying which symmetric monoidal categories are equivalent to props.


title: Seat Allocation and Seat Bias under the Jefferson--D'Hondt Method

abstract: We prove that under the Jefferson--D'Hondt method of apportionment, given certain distributional assumptions regarding mean rounding residuals, as well as absence of correlations between party vote shares, district sizes (in votes), and multipliers, the seat share of each relevant party is an affine function of the aggregate vote share, the number of relevant parties, and the mean district magnitude. We further show that the first of those assumptions follows approximately from more general ones regarding smoothness, vanishing at the extremes, and total variation of the density of the distribution of vote shares. We also discuss how our main result differs from the simple generalization of the single-district asymptotic seat bias formulae, and how it can be used to derive an estimate of the natural threshold and certain properties thereof.


title: Reconfigurable Mid-Infrared Hyperbolic Metasurfaces using Phase-Change Materials

abstract: Metasurfaces offer the potential to control light propagation at the nanoscale for applications in both free-space and surface-confined geometries. Existing metasurfaces frequently utilize metallic polaritonic elements with high absorption losses, and/or fixed geometrical designs that serve a single function. Here we overcome these limitations by demonstrating a reconfigurable hyperbolic metasurface comprising of a heterostructure of isotopically enriched hexagonal boron nitride (hBN) in direct contact with the phase-change material (PCM) vanadium dioxide (VO2). Spatially localized metallic and dielectric domains in VO2 change the wavelength of the hyperbolic phonon polaritons (HPhPs) supported in hBN by a factor 1.6 at 1450cm-1. This induces in-plane launching, refraction and reflection of HPhPs in the hBN, proving reconfigurable control of in-plane HPhP propagation at the nanoscale15. These results exemplify a generalizable framework based on combining hyperbolic media and PCMs in order to design optical functionalities such as resonant cavities, beam steering, waveguiding and focusing with nanometric control.


title: The rapid growth phase of supermassive black holes

abstract: We investigate the rapid growth phase of supermassive black holes (BHs) within the hydrodynamical cosmological \eagle simulation. This non-linear phase of BH growth occurs within $\sim$$L_{*}$ galaxies, embedded between two regulatory states of the galaxy host: in sub $L_{*}$ galaxies efficient stellar feedback regulates the gas inflow onto the galaxy and significantly reduces the growth of the central BH, while in galaxies more massive than $L_{*}$ efficient AGN feedback regulates the gas inflow onto the galaxy and curbs further non-linear BH growth. We find evolving critical galaxy and halo mass scales at which rapid BH growth begins. Galaxies in the low-redshift Universe transition into the rapid BH growth phase in haloes that are approximately an order of magnitude more massive than their high-redshift counterparts (\M{200} $\approx 10^{12.4}$~\Msol at $z \approx 0$ decreasing to \M{200} $\approx 10^{11.2}$~\Msol at $z \approx 6$). Instead, BHs enter the rapid growth phase at a fixed critical halo virial temperature ($T_{\mathrm{vir}} \approx 10^{5.6}$~K). We additionally show that major galaxy--galaxy interactions ($\mu \geq \frac{1}{4}$, where $\mu$ is the stellar mass ratio) play a substantial role in triggering the rapid growth phase of BHs in the low-redshift Universe, whilst potentially having a lower influence at high redshift. Approximately 40\% of BHs that initiate the rapid BH growth phase at $z \approx 0$ do so within $\pm 0.5$ dynamical times of a major galaxy--galaxy merger, a fourfold increase above what is expected from the background merger rate. We find that minor mergers ($\frac{1}{10} \leq \mu < \frac{1}{4}$) have a substantially lower influence in triggering the rapid growth phase at all epochs.


title: Shape Optimization of Wave Energy Converters for Broadband Directional Incident Waves

abstract: Here, through a systematic methodology and the use of high performance computing, we calculate the optimum shape for a wave energy converter under the action of incident waves of (i) monochromatic unidirectional, (ii) monochromatic directional, (iii) polychromatic unidirectional and (iv) polychromatic directional (with both directional symmetry and asymmetry). As a benchmark for our study, without loss of generality, we consider a submerged planar pressure differential wave energy converter, and use Genetic Algorithm to search through a wide range of shapes. A new parametric description of absorber shape based on Fourier decomposition of geometrical shapes is introduced, and for each shape hydrodynamic coefficients are calculated, optimum power take-o? parameters are obtained, and overall efficiency is determined. We show that an optimum geometry of the absorber plate can absorb a significantly higher energy (in some cases a few times higher) when compared to a circular shape of the same area. Specifically, for a unidirectional incident wave, the optimum shape, as expected, is obtained to be the most elongated shape. For directional incident waves, a butterfly-shape is the optimum geometry whose details depend on not only the amplitude and direction of incident wave components, but also the relative phases of those components. For the latter effect, we find an optimally averaged profile through a statistical analysis. Keywords: Wave energy conversion, Shape optimization


title: Concentration of Measure and Large Random Matrices with an application to Sample Covariance Matrices

abstract: The present work provides an original framework for random matrix analysis based on revisiting the concentration of measure theory from a probabilistic point of view. By providing various notions of vector concentration ($q$-exponential, linear, Lipschitz, convex), a set of elementary tools is laid out that allows for the immediate extension of classical results from random matrix theory involving random concentrated vectors in place of vectors with independent entries. These findings are exemplified here in the context of sample covariance matrices but find a large range of applications in statistical learning and beyond, thanks to the broad adaptability of our hypotheses.


title: Data-Efficient Hierarchical Reinforcement Learning

abstract: Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and on-policy training, making them difficult to apply in real-world scenarios. In this paper, we study how we can develop HRL algorithms that are general, in that they do not make onerous additional assumptions beyond standard RL algorithms, and efficient, in the sense that they can be used with modest numbers of interaction samples, making them suitable for real-world problems such as robotic control. For generality, we develop a scheme where lower-level controllers are supervised with goals that are learned and proposed automatically by the higher-level controllers. To address efficiency, we propose to use off-policy experience for both higher and lower-level training. This poses a considerable challenge, since changes to the lower-level behaviors change the action space for the higher-level policy, and we introduce an off-policy correction to remedy this challenge. This allows us to take advantage of recent advances in off-policy model-free RL to learn both higher- and lower-level policies using substantially fewer environment interactions than on-policy algorithms. We term the resulting HRL agent HIRO and find that it is generally applicable and highly sample-efficient. Our experiments show that HIRO can be used to learn highly complex behaviors for simulated robots, such as pushing objects and utilizing them to reach target locations, learning from only a few million samples, equivalent to a few days of real-time interaction. In comparisons with a number of prior HRL methods, we find that our approach substantially outperforms previous state-of-the-art techniques.


title: Character-based Neural Networks for Sentence Pair Modeling

abstract: Sentence pair modeling is critical for many NLP tasks, such as paraphrase identification, semantic textual similarity, and natural language inference. Most state-of-the-art neural models for these tasks rely on pretrained word embedding and compose sentence-level semantics in varied ways; however, few works have attempted to verify whether we really need pretrained embeddings in these tasks. In this paper, we study how effective subword-level (character and character n-gram) representations are in sentence pair modeling. Though it is well-known that subword models are effective in tasks with single sentence input, including language modeling and machine translation, they have not been systematically studied in sentence pair modeling tasks where the semantic and string similarities between texts matter. Our experiments show that subword models without any pretrained word embedding can achieve new state-of-the-art results on two social media datasets and competitive results on news data for paraphrase identification.


title: Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generation

abstract: Generating long and coherent reports to describe medical images poses challenges to bridging visual patterns with informative human linguistic descriptions. We propose a novel Hybrid Retrieval-Generation Reinforced Agent (HRGR-Agent) which reconciles traditional retrieval-based approaches populated with human prior knowledge, with modern learning-based approaches to achieve structured, robust, and diverse report generation. HRGR-Agent employs a hierarchical decision-making procedure. For each sentence, a high-level retrieval policy module chooses to either retrieve a template sentence from an off-the-shelf template database, or invoke a low-level generation module to generate a new sentence. HRGR-Agent is updated via reinforcement learning, guided by sentence-level and word-level rewards. Experiments show that our approach achieves the state-of-the-art results on two medical report datasets, generating well-balanced structured sentences with robust coverage of heterogeneous medical report contents. In addition, our model achieves the highest detection accuracy of medical terminologies, and improved human evaluation performance.


title: Collimation, Acceleration and Recollimation Shock in the Jet of Gamma-Ray-emitting Radio-Loud Narrow-Line Seyfert 1 Galaxy 1H 0323+342

abstract: We investigated the detailed radio structure of the jet of 1H 0323+342 using high-resolution multi-frequency Very Long Baseline Array observations. This source is known as the nearest $\gamma$-ray emitting radio-loud narrow-line Seyfert 1 (NLS1) galaxy. We discovered that the morphology of the inner jet is well characterized by a parabolic shape, indicating the jet being continuously collimated near the jet base. On the other hand, we found that the jet expands more rapidly at larger scales, resulting in a conical-like shape. The location of the "collimation break" is coincident with a bright quasi-stationary feature at 7 mas from core (corresponding to a deprojected distance of the order of $\sim$100pc), where the jet width locally contracts together with highly polarized signals, suggesting a recollimation shock. We found that the collimation region is coincident with the region where the jet speed gradually accelerates, suggesting the coexistence of the jet acceleration and collimation zone, ending up with the recollimation shock, which could be a potential site of high-energy $\gamma$-ray flares detected by the Fermi-LAT. Remarkably, these observational features of the 1H 0323+342 jet are overall very similar to those of the nearby radio galaxy M87 and HST-1 as well as some blazars, suggesting that a common jet formation mechanism might be at work. Based on the similarity of the jet profile between the two sources, we also briefly discuss the mass of the central black hole of 1H 0323+342, which is also still highly controversial on this source and NLS1s in general.


title: Lassoing Eigenvalues

abstract: The properties of penalized sample covariance matrices depend on the choice of the penalty function. In this paper, we introduce a class of non-smooth penalty functions for the sample covariance matrix, and demonstrate how this method results in a grouping of the estimated eigenvalues. We refer to this method as "lassoing eigenvalues" or as the "elasso".


title: Inverse Problem Instabilities in Large-Scale Plasma Modelling

abstract: Our understanding of physical systems generally depends on our ability to match complex computational modelling with measured experimental outcomes. However, simulations with large parameter spaces suffer from inverse problem instabilities, where similar simulated outputs can map back to very different sets of input parameters. While of fundamental importance, such instabilities are seldom resolved due to the intractably large number of simulations required to comprehensively explore parameter space. Here we show how Bayesian machine learning can be used to address inverse problem instabilities, and apply it to two popular experimental diagnostics in plasma physics. We find that the extraction of information from measurements simply on the basis of agreement with simulations is unreliable, and leads to a significant underestimation of uncertainties. We describe how to statistically quantify the effect of unstable inverse models, and describe an approach to experimental design that mitigates its impact.


title: Empirical Software Engineering: From Discipline to Interdiscipline

abstract: Empirical software engineering has received much attention in recent years and coined the shift from a more design-science-driven engineering discipline to an insight-oriented, and theory-centric one. Yet, we still face many challenges, among which some increase the need for interdisciplinary research. This is especially true for the investigation of human-centric aspects of software engineering. Although we can already observe an increased recognition of the need for more interdisciplinary research in (empirical) software engineering, such research configurations come with challenges barely discussed from a scientific point of view. In this position paper, we critically reflect upon the epistemological setting of empirical software engineering and elaborate its configuration as an Interdiscipline. In particular, we (1) elaborate a pragmatic view on empirical research for software engineering reflecting a cyclic process for knowledge creation, (2) motivate a path towards symmetrical interdisciplinary research, and (3) adopt five rules of thumb from other interdisciplinary collaborations in our field before concluding with new emerging challenges. This shall support stopping to treating empirical software engineering as a developing discipline moving towards a paradigmatic stage of normal science, but as a configuration of symmetric interdisciplinary teams and research methods.


title: Compression of Deep Convolutional Neural Networks under Joint Sparsity Constraints

abstract: We consider the optimization of deep convolutional neural networks (CNNs) such that they provide good performance while having reduced complexity if deployed on either conventional systems utilizing spatial-domain convolution or lower complexity systems designed for Winograd convolution. Furthermore, we explore the universal quantization and compression of these networks. In particular, the proposed framework produces one compressed model whose convolutional filters can be made sparse either in the spatial domain or in the Winograd domain. Hence, one compressed model can be deployed universally on any platform, without need for re-training on the deployed platform, and the sparsity of its convolutional filters can be exploited for further complexity reduction in either domain. To get a better compression ratio, the sparse model is compressed in the spatial domain which has a less number of parameters. From our experiments, we obtain $24.2\times$, $47.7\times$ and $35.4\times$ compressed models for ResNet-18, AlexNet and CT-SRCNN, while their computational cost is also reduced by $4.5\times$, $5.1\times$ and $23.5\times$, respectively.


title: Anchored Bayesian Gaussian Mixture Models

abstract: Finite mixtures are a flexible modeling tool for irregularly shaped densities and samples from heterogeneous populations. When modeling with mixtures using an exchangeable prior on the component features, the component labels are arbitrary and are indistinguishable in posterior analysis. This makes it impossible to attribute any meaningful interpretation to the marginal posterior distributions of the component features. We propose a model in which a small number of observations are assumed to arise from some of the labeled component densities. The resulting model is not exchangeable, allowing inference on the component features without post-processing. Our method assigns meaning to the component labels at the modeling stage and can be justified as a data-dependent informative prior on the labelings. We show that our method produces interpretable results, often (but not always) similar to those resulting from relabeling algorithms, with the added benefit that the marginal inferences originate directly from a well specified probability model rather than a post hoc manipulation. We provide asymptotic results leading to practical guidelines for model selection that are motivated by maximizing prior information about the class labels and demonstrate our method on real and simulated data.


title: Work, heat and entropy production along quantum trajectories

abstract: Quantum open systems evolve according to completely positive, trace preserving maps acting on the density operator, which can equivalently be unraveled in term of so-called quantum trajectories. These stochastic sequences of pure states correspond to the actual dynamics of the quantum system during single realizations of an experiment in which the system's environment is monitored. In this chapter, we present an extension of stochastic thermodynamics to the case of open quantum systems, which builds on the analogy between the quantum trajectories and the trajectories in phase space of classical stochastic thermodynamics. We analyze entropy production, work and heat exchanges at the trajectory level, identifying genuinely quantum contributions due to decoherence induced by the environment. We present three examples: the thermalization of a quantum system, the fluorescence of a driven qubit and the continuous monitoring of a qubit's observable.


title: Deep Energy Estimator Networks

abstract: Density estimation is a fundamental problem in statistical learning. This problem is especially challenging for complex high-dimensional data due to the curse of dimensionality. A promising solution to this problem is given here in an inference-free hierarchical framework that is built on score matching. We revisit the Bayesian interpretation of the score function and the Parzen score matching, and construct a multilayer perceptron with a scalable objective for learning the energy (i.e. the unnormalized log-density), which is then optimized with stochastic gradient descent. In addition, the resulting deep energy estimator network (DEEN) is designed as products of experts. We present the utility of DEEN in learning the energy, the score function, and in single-step denoising experiments for synthetic and high-dimensional data. We also diagnose stability problems in the direct estimation of the score function that had been observed for denoising autoencoders.


title: The reaction coordinate mapping in quantum thermodynamics

abstract: We present an overview of the reaction coordinate approach to handling strong system-reservoir interactions in quantum thermodynamics. This technique is based on incorporating a collective degree of freedom of the reservoir (the reaction coordinate) into an enlarged system Hamiltonian (the supersystem), which is then treated explicitly. The remaining residual reservoir degrees of freedom are traced out in the usual perturbative manner. The resulting description accurately accounts for strong system-reservoir coupling and/or non-Markovian effects over a wide range of parameters, including regimes in which there is a substantial generation of system-reservoir correlations. We discuss applications to both discrete stroke and continuously operating heat engines, as well as perspectives for additional developments. In particular, we find narrow regimes where strong coupling is not detrimental to the performance of continuously operating heat engines.


title: geomstats: a Python Package for Riemannian Geometry in Machine Learning

abstract: We introduce geomstats, a python package that performs computations on manifolds such as hyperspheres, hyperbolic spaces, spaces of symmetric positive definite matrices and Lie groups of transformations. We provide efficient and extensively unit-tested implementations of these manifolds, together with useful Riemannian metrics and associated Exponential and Logarithm maps. The corresponding geodesic distances provide a range of intuitive choices of Machine Learning loss functions. We also give the corresponding Riemannian gradients. The operations implemented in geomstats are available with different computing backends such as numpy, tensorflow and keras. We have enabled GPU implementation and integrated geomstats manifold computations into keras deep learning framework. This paper also presents a review of manifolds in machine learning and an overview of the geomstats package with examples demonstrating its use for efficient and user-friendly Riemannian geometry.


title: AxTrain: Hardware-Oriented Neural Network Training for Approximate Inference

abstract: The intrinsic error tolerance of neural network (NN) makes approximate computing a promising technique to improve the energy efficiency of NN inference. Conventional approximate computing focuses on balancing the efficiency-accuracy trade-off for existing pre-trained networks, which can lead to suboptimal solutions. In this paper, we propose AxTrain, a hardware-oriented training framework to facilitate approximate computing for NN inference. Specifically, AxTrain leverages the synergy between two orthogonal methods---one actively searches for a network parameters distribution with high error tolerance, and the other passively learns resilient weights by numerically incorporating the noise distributions of the approximate hardware in the forward pass during the training phase. Experimental results from various datasets with near-threshold computing and approximation multiplication strategies demonstrate AxTrain's ability to obtain resilient neural network parameters and system energy efficiency improvement.


title: Effect of Social Media on Opinion Formation

abstract: In this work, we investigate the effect of social media on the process of opinion formation in a human population. This effect is modeled as an external field in the dynamics of the two-dimensional Sznajd model with a probability P for an agent to follow the social media. We investigate the evolution of magnetization, the distribution of decision time and the average relaxation time in the presence of the external field. Our results suggest that the average relaxation time on the lattice of size L follows a power law, where the exponent depends on the probability P. We also show that phase transition between two distinct states of the system decreases for any initial distribution of the opinions as the probability P is increasing. For a critical point of P ~ 0.18, no phase transition is observed and the system evolves to a dictatorship regardless of the initial distribution of the opinions in the population.


title: AgileNet: Lightweight Dictionary-based Few-shot Learning

abstract: The success of deep learning models is heavily tied to the use of massive amount of labeled data and excessively long training time. With the emergence of intelligent edge applications that use these models, the critical challenge is to obtain the same inference capability on a resource-constrained device while providing adaptability to cope with the dynamic changes in the data. We propose AgileNet, a novel lightweight dictionary-based few-shot learning methodology which provides reduced complexity deep neural network for efficient execution at the edge while enabling low-cost updates to capture the dynamics of the new data. Evaluations of state-of-the-art few-shot learning benchmarks demonstrate the superior accuracy of AgileNet compared to prior arts. Additionally, AgileNet is the first few-shot learning approach that prevents model updates by eliminating the knowledge obtained from the primary training. This property is ensured through the dictionaries learned by our novel end-to-end structured decomposition, which also reduces the memory footprint and computation complexity to match the edge device constraints.


title: A note on the extreme points of the cone of quasiconvex quadratic forms with orthotropic symmetry

abstract: We study the extreme points of the cone of quasiconvex quadratic forms with linear elastic orthotropic symmetry. We prove that if the determinant of the acoustic matrix of the associated forth order tensor of the quadratic form is an extremal polynomial, then the quadratic form is an extreme point of the cone in the same symmetry class. The extremality of polynomials and quadratic forms here is understood in classical convex analysis sense.


title: Learning Safe Policies with Expert Guidance

abstract: We propose a framework for ensuring safe behavior of a reinforcement learning agent when the reward function may be difficult to specify. In order to do this, we rely on the existence of demonstrations from expert policies, and we provide a theoretical framework for the agent to optimize in the space of rewards consistent with its existing knowledge. We propose two methods to solve the resulting optimization: an exact ellipsoid-based method and a method in the spirit of the "follow-the-perturbed-leader" algorithm. Our experiments demonstrate the behavior of our algorithm in both discrete and continuous problems. The trained agent safely avoids states with potential negative effects while imitating the behavior of the expert in the other states.


title: Intriguing behavior when testing the impact of quotation marks usage in Google search results

abstract: Internet research on search engine quality and validity of results demand much concern. Thus, the focus in our study has been to measure the impact of quotation marks usage on the internet search outputs in terms of google search outcomes distributions, through Benford Law. The current paper is focused on applying a Benford Law analysis on two related types of internet searches distinguished by the usage or absence of quotation marks. Both search results values are assumed as variables. We found that the first digit of outcomes does not follow the Benford Law first digit of numbers in the case of searching text without quotation marks. Unexpectedly, the Benford Law is obeyed when quotation marks are used, even if the variability of search outcomes is considerably reduced. By studying outputs demonstrating influences of (apparently at first) "details", in using a search engine, the authors are able to further warn the users concerning the validity of such outputs.


title: Learning long-range spatial dependencies with horizontal gated-recurrent units

abstract: Progress in deep learning has spawned great successes in many engineering applications. As a prime example, convolutional neural networks, a type of feedforward neural networks, are now approaching -- and sometimes even surpassing -- human accuracy on a variety of visual recognition tasks. Here, however, we show that these neural networks and their recent extensions struggle in recognition tasks where co-dependent visual features must be detected over long spatial ranges. We introduce the horizontal gated-recurrent unit (hGRU) to learn intrinsic horizontal connections -- both within and across feature columns. We demonstrate that a single hGRU layer matches or outperforms all tested feedforward hierarchical baselines including state-of-the-art architectures which have orders of magnitude more free parameters. We further discuss the biological plausibility of the hGRU in comparison to anatomical data from the visual cortex as well as human behavioral data on a classic contour detection task.


title: Low cognitive reflection predicts honesty for men but not for women

abstract: Previous experiments have explored the effects of gender and cognitive reflection on dishonesty separately. To the best of our knowledge, no studies have investigated potential interactions between these two factors. Exploring this interaction is important because previous work found that males tend to be both more deliberative than females. Therefore, it is possible that the gender effect on dishonesty is moderated by cognitive reflection. Here we report a large online experiment (N = 766) where subjects first have a chance to lie for their benefit and then take a Cognitive Reflection Test (CRT). We find a significant interaction between gender and CRT score such that lack of deliberation promotes honesty for men but not for women. Additional analyses highlight that this effect is mainly driven by men whose answers in the CRT are neither intuitive nor deliberative, who happen to be particularly honest in our deception game.


title: The initial structure of chondrule dust rims I: electrically neutral grains

abstract: In order to characterize the early growth of fine-grained dust rims (FGRs) that commonly surround chondrules, we perform numerical simulations of dust accretion onto chondrule surfaces. We employ a Monte Carlo algorithm to simulate the collision of dust monomers having radii between 0.5 and 10 $\mu$m with chondrules whose radii are between 500 and 1000 $\mu$m, in 100-$\mu$m increments. The collisions are driven by Brownian motion and solar nebula turbulence. After each collision, the colliding particles either stick at the point of contact, roll or bounce. We limit accretion of dust monomers (and in some cases, dust aggregates) to a small patch of the chondrule surface, for computational expediency. We model the morphology of the dust rim and the trajectory of the dust particle, which are not considered in most of the previous works. Radial profiles of FGR porosity show that rims formed in weak turbulence are more porous (with a porosity of 60-74\%) than rims formed in stronger turbulence (with a porosity of 52-60\%). The lower end of each range corresponds to large chondrules and the upper end to small chondrules, meaning that the chondrule size also has an impact on FGR porosity. The thickness of FGRs depends linearly on chondrule radius, and the slope of this linear dependency increases with time, and decreases with the turbulence strength. The porosity of FGRs formed by dust aggregates is $\sim 20\%$ on average greater than that of FGRs formed by single monomers. In general, the relatively high porosities that we obtain are consistent with those calculated by previous authors from numerical simulations, as well as with initial FGR porosities inferred from laboratory measurements of rimmed chondrule samples and rimmed chondrule analogs.


title: Self-Attention Generative Adversarial Networks

abstract: In this paper, we propose the Self-Attention Generative Adversarial Network (SAGAN) which allows attention-driven, long-range dependency modeling for image generation tasks. Traditional convolutional GANs generate high-resolution details as a function of only spatially local points in lower-resolution feature maps. In SAGAN, details can be generated using cues from all feature locations. Moreover, the discriminator can check that highly detailed features in distant portions of the image are consistent with each other. Furthermore, recent work has shown that generator conditioning affects GAN performance. Leveraging this insight, we apply spectral normalization to the GAN generator and find that this improves training dynamics. The proposed SAGAN achieves the state-of-the-art results, boosting the best published Inception score from 36.8 to 52.52 and reducing Frechet Inception distance from 27.62 to 18.65 on the challenging ImageNet dataset. Visualization of the attention layers shows that the generator leverages neighborhoods that correspond to object shapes rather than local regions of fixed shape.


title: Continuum Model for Nanoscale Multiphase Flows

abstract: We propose a nonlocal model for surface tension. This model, in combination with the Landau-Lifshitz-Navier-Stokes equations, describes mesoscale features of the multiphase flow, including the static (pressure) tensor and curvature dependence of surface tension. The nonlocal model is obtained in the form of an integral of a molecular-force-like function added into the momentum conservation equation. We present an analytical steady-state solution for fluid pressure at the fluid-fluid interface and numerical Smoothed Particle Hydrodynamics solutions that reveal the mesoscopic features of the proposed model.


title: The Swarmathon: An Autonomous Swarm Robotics Competition

abstract: The Swarmathon is a swarm robotics programming challenge that engages college students from minority-serving institutions in NASA's Journey to Mars. Teams compete by programming a group of robots to search for, pick up, and drop off resources in a collection zone. The Swarmathon produces prototypes for robot swarms that would collect resources on the surface of Mars. Robots operate completely autonomously with no global map, and each team's algorithm must be sufficiently flexible to effectively find resources from a variety of unknown distributions. The Swarmathon includes Physical and Virtual Competitions. Physical competitors test their algorithms on robots they build at their schools; they then upload their code to run autonomously on identical robots during the three day competition in an outdoor arena at Kennedy Space Center. Virtual competitors complete an identical challenge in simulation. Participants mentor local teams to compete in a separate High School Division. In the first 2 years, over 1,100 students participated. 63% of students were from underrepresented ethnic and racial groups. Participants had significant gains in both interest and core robotic competencies that were equivalent across gender and racial groups, suggesting that the Swarmathon is effectively educating a diverse population of future roboticists.


title: Bandit-Based Monte Carlo Optimization for Nearest Neighbors

abstract: The celebrated Monte Carlo method estimates an expensive-to-compute quantity by random sampling. Bandit-based Monte Carlo optimization is a general technique for computing the minimum of many such expensive-to-compute quantities by adaptive random sampling. The technique converts an optimization problem into a statistical estimation problem which is then solved via multi-armed bandits. We apply this technique to solve the problem of high-dimensional $k$-nearest neighbors, developing an algorithm which we prove is able to identify exact nearest neighbors with high probability. We show that under regularity assumptions on a dataset of $n$ points in $d$-dimensional space, the complexity of our algorithm scales logarithmically with the dimension of the data as $O\left((n+d)\log^2 \left(\frac{nd}{\delta}\right)\right)$ for error probability $\delta$, rather than linearly as in exact computation requiring $O(nd)$. We corroborate our theoretical results with numerical simulations, showing that our algorithm outperforms both exact computation and state-of-the-art algorithms such as kGraph, NGT, and LSH on real datasets.

categories: cs.LG cs.DS cs.IT math.IT stat.CO stat.ML


title: Teaching Multiple Concepts to a Forgetful Learner

abstract: How can we help a forgetful learner learn multiple concepts within a limited time frame? While there have been extensive studies in designing optimal schedules for teaching a single concept given a learner's memory model, existing approaches for teaching multiple concepts are typically based on heuristic scheduling techniques without theoretical guarantees. In this paper, we look at the problem from the perspective of discrete optimization and introduce a novel algorithmic framework for teaching multiple concepts with strong performance guarantees. Our framework is both generic, allowing the design of teaching schedules for different memory models, and also interactive, allowing the teacher to adapt the schedule to the underlying forgetting mechanisms of the learner. Furthermore, for a well-known memory model, we are able to identify a regime of model parameters where our framework is guaranteed to achieve high performance. We perform extensive evaluations using simulations along with real user studies in two concrete applications: (i) an educational app for online vocabulary teaching; and (ii) an app for teaching novices how to recognize animal species from images. Our results demonstrate the effectiveness of our algorithm compared to popular heuristic approaches.


title: A Class of Spatially Correlated Self-Exciting Models

abstract: The statistical modeling of multivariate count data observed on a space-time lattice has generally focused on using a hierarchical modeling approach where space-time correlation structure is placed on a continuous, latent, process. The count distribution is then assumed to be conditionally independent given the latent process. However, in many real-world applications, especially in the modeling of criminal or terrorism data, the conditional independence between the count distributions is inappropriate. In this manuscript we propose a class of models that capture spatial variation and also account for the possibility of data model dependence. The resulting model allows both data model dependence, or self-excitation, as well as spatial dependence in a latent structure. We demonstrate how second-order properties can be used to characterize the spatio-temporal process and how misspecificaiton of error may inflate self-excitation in a model. Finally, we give an algorithm for efficient Bayesian inference for the model demonstrating its use in capturing the spatio-temporal structure of burglaries in Chicago from 2010-2015.


title: Measurement-wise Occlusion in Multi-object Tracking

abstract: Handling object interaction is a fundamental challenge in practical multi-object tracking, even for simple interactive effects such as one object temporarily occluding another. We formalize the problem of occlusion in tracking with two different abstractions. In object-wise occlusion, objects that are occluded by other objects do not generate measurements. In measurement-wise occlusion, a previously unstudied approach, all objects may generate measurements but some measurements may be occluded by others. While the relative validity of each abstraction depends on the situation and sensor, measurement-wise occlusion fits into probabilistic multi-object tracking algorithms with much looser assumptions on object interaction. Its value is demonstrated by showing that it naturally derives a popular approximation for lidar tracking, and by an example of visual tracking in image space.


title: Confinement of the Crab Nebula with tangled magnetic field by its supernova remnant

abstract: A pulsar wind is a relativistic outflow dominated by Poynting energy at its base. Based on the standard ideal magnetohydrodynamic (MHD) model of pulsar wind nebulae (PWNe) with the ordered magnetic field, the observed slow expansion $v_{\rm PWN} \ll c$ requires the wind to be dominated by kinetic energy at the upstream of its termination shock, which conflicts with the pulsar wind theory ($\sigma$-problem). In this paper, we extend the standard model of PWNe by phenomenologically taking into account conversion of the ordered to turbulent magnetic field and dissipation of the turbulent magnetic field. Disordering of the magnetic structure is inferred from the recent three-dimensional relativistic ideal MHD simulations, while magnetic dissipation is a non-ideal MHD effect requiring a finite resistivity. We apply this model to the Crab Nebula and find that the conversion effect is important for the flow deceleration, while the dissipation effect is not. Even for Poynting-dominated pulsar wind, we obtain the Crab Nebula's $v_{\rm PWN}$ by adopting a finite conversion time-scale of $\sim 0.3$ yr. Magnetic dissipation primarily affects the synchrotron radiation properties. Any values of the pulsar wind magnetization $\sigma_{\rm w}$ are allowed within the present model of the PWN dynamics alone, and even a small termination shock radius of $\ll 0.1$ pc reproduces the observed dynamical features of the Crab Nebula. In order to establish a high-$\sigma_{\rm w}$ model of PWNe, it is important to extend the present model by taking into account the broadband spectrum and its spacial profiles.


title: Rotating halo traced by the K giant stars from LAMOST and Gaia

abstract: With the help of Gaia DR2, we are able to obtain the full 6-D phase space information for stars from LAMOST DR5. With high precision of position, velocity, and metallicity, the rotation of the local stellar halo is presented using the K giant stars with [Fe/H]$<-1$ dex within 4 kpc from the Sun. By fitting the rotational velocity distribution with three Gaussian components, stellar halo, disk, and a counter-rotating hot population, we find that the local halo progradely rotates with $V_T=+27^{+4}_{-5}$ km s$^{-1}$ providing the local standard of rest velocity of $V_{LSR}=232$ km s$^{-1}$. Meanwhile, we obtain the dispersion of rotational velocity is $\sigma_{T}=72^{+4}_{-4}$ km s$^{-1}$. Although the rotational velocity strongly depends on the choice of $V_{LSR}$, the trend of prograde rotation is substantial even when $V_{LSR}$ is set at as low as 220 km s$^{-1}$. Moreover, we derive the rotation for subsamples with different metallicities and find that the rotational velocity is essentially not correlated with [Fe/H]. This may hint a secular evolution origin of the prograde rotation. It shows that the metallicity of the progradely rotating halo is peaked within -1.9$<$[Fe/H]$<$-1.6 without considering the selection effect. We also find a small fraction of counter-rotating stars with larger dispersion and lower metallicity. Finally, the disk component rotates with $V_T=+182^{+6}_{-6}$ km s$^{-1}$ and $\sigma_T=45^{+3}_{-3}$ km s$^{-1}$, which is quite consistent with the metal-weak thick disk population.


title: Robust Gradient Descent via Moment Encoding with LDPC Codes

abstract: This paper considers the problem of implementing large-scale gradient descent algorithms in a distributed computing setting in the presence of {\em straggling} processors. To mitigate the effect of the stragglers, it has been previously proposed to encode the data with an erasure-correcting code and decode at the master server at the end of the computation. We, instead, propose to encode the second-moment of the data with a low density parity-check (LDPC) code. The iterative decoding algorithms for LDPC codes have very low computational overhead and the number of decoding iterations can be made to automatically adjust with the number of stragglers in the system. We show that for a random model for stragglers, the proposed moment encoding based gradient descent method can be viewed as the stochastic gradient descent method. This allows us to obtain convergence guarantees for the proposed solution. Furthermore, the proposed moment encoding based method is shown to outperform the existing schemes in a real distributed computing setup.


title: Verifiable Reinforcement Learning via Policy Extraction

abstract: While deep reinforcement learning has successfully solved many challenging control tasks, its real-world applicability has been limited by the inability to ensure the safety of learned policies. We propose an approach to verifiable reinforcement learning by training decision tree policies, which can represent complex policies (since they are nonparametric), yet can be efficiently verified using existing techniques (since they are highly structured). The challenge is that decision tree policies are difficult to train. We propose VIPER, an algorithm that combines ideas from model compression and imitation learning to learn decision tree policies guided by a DNN policy (called the oracle) and its Q-function, and show that it substantially outperforms two baselines. We use VIPER to (i) learn a provably robust decision tree policy for a variant of Atari Pong with a symbolic state space, (ii) learn a decision tree policy for a toy game based on Pong that provably never loses, and (iii) learn a provably stable decision tree policy for cart-pole. In each case, the decision tree policy achieves performance equal to that of the original DNN policy.


title: Guided Feature Transformation (GFT): A Neural Language Grounding Module for Embodied Agents

abstract: Recently there has been a rising interest in training agents, embodied in virtual environments, to perform language-directed tasks by deep reinforcement learning. In this paper, we propose a simple but effective neural language grounding module for embodied agents that can be trained end to end from scratch taking raw pixels, unstructured linguistic commands, and sparse rewards as the inputs. We model the language grounding process as a language-guided transformation of visual features, where latent sentence embeddings are used as the transformation matrices. In several language-directed navigation tasks that feature challenging partial observability and require simple reasoning, our module significantly outperforms the state of the art. We also release XWorld3D, an easy-to-customize 3D environment that can potentially be modified to evaluate a variety of embodied agents.


title: $K^*$ mesons with hidden charm arising from $KX(3872)$ and $KZ_c(3900)$ dynamics

abstract: Inspired by the recent discovery of the pentaquark states $P_c(4450)$ and $P_c(4380)$, which can be viewed as excited nucleon states with hidden charm, we study the three-body interaction of a kaon and a pair of $D\bar{D}^*$ in isospin 0 and 1. We show that the two body interactions stringently constrained by the existence of the $D_{s0}^*(2317)$, $D^*_{s1}(2460)$, $X(3872)$, and $Z_c(3900)$, which are widely believed to contain large $DK$, $D^* K$, and $D\bar{D}^*$ components, inevitably lead to the existence of a heavy $K^*$ meson with hidden charm. Concrete coupled channel three-body calculations yield its mass and width as $(4307\pm 2)- i (9\pm 2)$ MeV with $I(J^P)=1/2(1^-)$. This state, if found experimentally, definitely cannot be accommodated in a $q\bar{q}$ picture, and therefore presents a clear case of an exotic hadron.


title: Large Scale computation of Means and Clusters for Persistence Diagrams using Optimal Transport

abstract: Persistence diagrams (PDs) are now routinely used to summarize the underlying topology of complex data. Despite several appealing properties, incorporating PDs in learning pipelines can be challenging because their natural geometry is not Hilbertian. Indeed, this was recently exemplified in a string of papers which show that the simple task of averaging a few PDs can be computationally prohibitive. We propose in this article a tractable framework to carry out standard tasks on PDs at scale, notably evaluating distances, estimating barycenters and performing clustering. This framework builds upon a reformulation of PD metrics as optimal transport (OT) problems. Doing so, we can exploit recent computational advances: the OT problem on a planar grid, when regularized with entropy, is convex can be solved in linear time using the Sinkhorn algorithm and convolutions. This results in scalable computations that can stream on GPUs. We demonstrate the efficiency of our approach by carrying out clustering with diagrams metrics on several thousands of PDs, a scale never seen before in the literature.


title: Storage and Memory Characterization of Data Intensive Workloads for Bare Metal Cloud

abstract: As the cost-per-byte of storage systems dramatically decreases, SSDs are finding their ways in emerging cloud infrastructure. Similar trend is happening for main memory subsystem, as advanced DRAM technologies with higher capacity, frequency and number of channels are deploying for cloud-scale solutions specially for non-virtualized environment where cloud subscribers can exactly specify the configuration of underling hardware. Given the performance sensitivity of standard workloads to the memory hierarchy parameters, it is important to understand the role of memory and storage for data intensive workloads. In this paper, we investigate how the choice of DRAM (high-end vs low-end) impacts the performance of Hadoop, Spark, and MPI based Big Data workloads in the presence of different storage types on bare metal cloud. Through a methodical experimental setup, we have analyzed the impact of DRAM capacity, operating frequency, the number of channels, storage type, and scale-out factors on the performance of these popular frameworks. Based on micro-architectural analysis, we classified data-intensive workloads into three groups namely I/O bound, compute bound, and memory bound. The characterization results show that neither DRAM capacity, frequency, nor the number of channels play a significant role on the performance of all studied Hadoop workloads as they are mostly I/O bound. On the other hand, our results reveal that iterative tasks (e.g. machine learning) in Spark and MPI are benefiting from a high-end DRAM in particular high frequency and large number of channels, as they are memory or compute bound. Our results show that using SSD PCIe cannot shift the bottleneck from storage to memory, while it can change the workload behavior from I/O bound to compute bound.


title: Symmetry protected topological phases in two-orbital SU(4) fermionic atoms

abstract: We study one-dimensional systems of two-orbital SU(4) fermionic cold atoms. In particular, we focus on an SU(4) spin model [named SU(4) $e$-$g$ spin model] that is realized in a low-energy state in the Mott insulator phase at the filling $n_g=3, n_e=1$ ($n_g, n_e$: numbers of atoms in ground and excited states, respectively). Our numerical study with the infinite-size density matrix renormalization group shows that the ground state of SU(4) $e$-$g$ spin model is a nontrivial symmetry protected topological (SPT) phase protected by $Z_4 \times Z_4$ symmetry. Specifically, we find that the ground state belongs to an SPT phase with the topological index $2\in\mathbb{Z}_4$ and show sixfold degenerate edge states. This is topologically distinct from SPT phases with the index $1\in\mathbb{Z}_4$ that are realized in the SU(4) bilinear model and the SU(4) Affleck-Kennedy-Lieb-Tasaki (AKLT) model. We explore the phase diagram of SU(4) spin models including $e$-$g$ spin model, bilinear-biquadratic model, and AKLT model, and identify that antisymmetrization effect in neighboring spins (that we quantify with Casimir operators) is the driving force of the phase transitions. Furthermore, we demonstrate by using the matrix product state how the $\mathbb{Z}_4$ SPT state with six edge states appears in the SU(4) $e$-$g$ spin model.


title: Spectral lower bounds for the quantum chromatic number of a graph

abstract: The quantum chromatic number, $\chi_q(G)$, of a graph $G$ was originally defined as the minimal number of colors necessary in a quantum protocol in which two provers that cannot communicate with each other but share an entangled state can convince an interrogator with certainty that they have a coloring of the graph. We use an equivalent purely combinatorial definition of $\chi_q(G)$ to prove that many spectral lower bounds for the chromatic number, $\chi(G)$, are also lower bounds for $\chi_q(G)$. This is achieved using techniques from linear algebra called pinching and twirling. We illustrate our results with some examples.


title: Time dilation in the oscillating decay laws of moving two-mass unstable quantum states

abstract: The decay of a moving system is studied in case the system is initially prepared in a two-mass unstable quantum state. The survival probability $\mathcal{P}_p(t)$ is evaluated over short and long times in the reference frame where the unstable system moves with constant linear momentum $p$. The mass distribution densities of the two mass states are tailored as power laws with powers $\alpha_1$ and $\alpha_2$ near the non-vanishing lower bounds $\mu_{0,1}$ and $\mu_{0,2}$ of the mass spectra, respectively. If the powers $\alpha_1$ and $\alpha_2$ differ, the long-time survival probability $\mathcal{P}_p(t)$ exhibits a dominant inverse-power-law decay and is approximately related to the survival probability at rest $\mathcal{P}_0(t)$ by a time dilation. The corresponding scaling factor $\chi_{p,k}$ reads $\sqrt{1+p^2/\mu_{0,k}^2}$, the power $\alpha_k$ being the lower of the powers $\alpha_1$ and $\alpha_2$. If the two powers coincide and the lower bounds $\mu_{0,1}$ and $\mu_{0,2}$ differ, the scaling relation is lost and damped oscillations of the survival probability $\mathcal{P}_p(t)$ appear over long times. By changing reference frame, the period $T_0$ of the oscillations at rest transforms in the longer period $T_p$ according to a factor which is the weighted mean of the scaling factors of each mass, with non-normalized weights $\mu_{0,1}$ and $\mu_{0,2}$.


title: Maximum Causal Tsallis Entropy Imitation Learning

abstract: In this paper, we propose a novel maximum causal Tsallis entropy (MCTE) framework for imitation learning which can efficiently learn a sparse multi-modal policy distribution from demonstrations. We provide the full mathematical analysis of the proposed framework. First, the optimal solution of an MCTE problem is shown to be a sparsemax distribution, whose supporting set can be adjusted. The proposed method has advantages over a softmax distribution in that it can exclude unnecessary actions by assigning zero probability. Second, we prove that an MCTE problem is equivalent to robust Bayes estimation in the sense of the Brier score. Third, we propose a maximum causal Tsallis entropy imitation learning (MCTEIL) algorithm with a sparse mixture density network (sparse MDN) by modeling mixture weights using a sparsemax distribution. In particular, we show that the causal Tsallis entropy of an MDN encourages exploration and efficient mixture utilization while Boltzmann Gibbs entropy is less effective. We validate the proposed method in two simulation studies and MCTEIL outperforms existing imitation learning methods in terms of average returns and learning multi-modal policies.


title: Explicit Exponential Rosenbrock Methods and their Application in Visual Computing

abstract: We introduce a class of explicit exponential Rosenbrock methods for the time integration of large systems of stiff differential equations. Their application with respect to simulation tasks in the field of visual computing is discussed where these time integrators have shown to be very competitive compared to standard techniques. In particular, we address the simulation of elastic and nonelastic deformations as well as collision scenarios focusing on relevant aspects like stability and energy conservation, large stiffnesses, high fidelity and visual accuracy.


title: Prediction of the second peak in the afterglow of GW170817

abstract: We performed calculations of the late radio and X-ray afterglow of GRB/GW170817 in the cocoon-jet paradigm, predicting the appearance of a second peak in the afterglow light curve ~ one-three years after the explosion. The model assumes that the prompt emission and early afterglows originate from a cocoon generated during break-out of the delayed magnetically powered jet. As the jet breaks out from the torus-generated wind, a nearly isotropic mildly relativistic outflow is generated; at the same time the primary jet accelerates to high Lorentz factors and avoids detection. As the fast jet slows down, it should become visible to the off-axis observer. Thus, the model has a clear prediction: the X-ray and radio afterglows should first experience a decay, as the cocoon slows down, followed by a rebrightening when the primary jet starts emitting toward an observer.


title: Extinction time of the logistic process

abstract: The logistic birth and death process is perhaps the simplest stochastic population model that has both density-dependent reproduction, and a phase transition, and a lot can be learned about the process by studying its extinction time, $\tau_n$, as a function of system size $n$. A number of existing results describe the scaling of $\tau_n$ as $n\to\infty$, for various choices of reproductive rate $r_n$ and initial population $X_n(0)$ as a function of $n$. We collect and complete this picture, obtaining a complete classification of all sequences $(r_n)$ and $(X_n(0))$ for which there exist rescaling parameters $(s_n)$ and $(t_n)$ such that $(\tau_n-t_n)/s_n$ converges in distribution as $n\to\infty$, and identifying the limits in each case.


title: Reducing Parameter Space for Neural Network Training

abstract: For neural networks (NNs) with rectified linear unit (ReLU) or binary activation functions, we show that their training can be accomplished in a reduced parameter space. Specifically, the weights in each neuron can be trained on the unit sphere, as opposed to the entire space, and the threshold can be trained in a bounded interval, as opposed to the real line. We show that the NNs in the reduced parameter space are mathematically equivalent to the standard NNs with parameters in the whole space. The reduced parameter space shall facilitate the optimization procedure for the network training, as the search space becomes (much) smaller. We demonstrate the improved training performance using numerical examples.


title: Tame block algebras of Hecke algebras of classical type

abstract: We classify tame block algebras of Hecke algebras of classical type over an algebraically closed field of odd characteristic.


title: Nearest neighbor density functional estimation from inverse Laplace transform

abstract: A new approach to $L_2$-consistent estimation of a general density functional using $k$-nearest neighbor distances is proposed, where the functional under consideration is in the form of the expectation of some function $f$ of the densities at each point. The estimator is designed to be asymptotically unbiased, using the convergence of the normalized volume of a $k$-nearest neighbor ball to a Gamma distribution in the large-sample limit, and naturally involves the inverse Laplace transform of a scaled version of the function $f.$ Some instantiations of the proposed estimator recover existing $k$-nearest neighbor based estimators of Shannon and R\'enyi entropies and Kullback--Leibler and R\'enyi divergences, and discover new consistent estimators for many other functionals such as logarithmic entropies and divergences. The $L_2$-consistency of the proposed estimator is established for a broad class of densities for general functionals, and the convergence rate in mean squared error is established as a function of the sample size for smooth, bounded densities.

categories: math.ST cs.IT math.IT stat.ME stat.ML stat.TH


title: Equivalent matrices up to permutations

abstract: Given two $k\times n$ matrices $A$ and $B$, we describe a couple of methods to solve the matrix equation $XA=BY$, where $X$ is an invertible $k\times k$ matrix, and $Y$ is an $n\times n$ permutation matrix, both of which we want to determine. We are interested in pursuing those techniques that have algebraic geometric flavor. An application to solving such a matrix equation comes from the cryptanalysis of McEliece cryptosystem. By using codewords of minimum weight of a linear code, in concordance with these methods of solving $XA=BY$, we present an efficient way to determine the entire encryption keys for the McEliece cryptosystems built on Reed-Solomon codes.


title: In-orbit performance and calibration of the Hard X-ray Imager onboard Hitomi (ASTRO-H)

abstract: The Hard X-ray Imager (HXI) onboard Hitomi (ASTRO-H) is an imaging spectrometer covering hard X-ray energies of 5-80 keV. Combined with the hard X-ray telescope, it enables imaging spectroscopy with an angular resolution of $1^\prime.7$ half-power diameter, in a field of view of $9^\prime\times9^\prime$. The main imager is composed of 4 layers of Si detectors and 1 layer of CdTe detector, stacked to cover wide energy band up to 80 keV, surrounded by an active shield made of BGO scintillator to reduce the background. The HXI started observations 12 days before the Hitomi loss, and successfully obtained data from G21.5$-$0.9, Crab and blank sky. Utilizing these data, we calibrate the detector response and study properties of in-orbit background. The observed Crab spectra agree well with a powerlaw model convolved with the detector response, within 5% accuracy. We find that albedo electrons in specified orbit strongly affect the background of Si top layer, and establish a screening method to reduce it. The background level over the full field of view after all the processing and screening is as low as the pre-flight requirement of $1$-$3\times10^{-4}$ counts s$^{-1}$ cm$^{-2}$ keV$^{-1}$.


title: Success Probability of Grant-Free Random Access with Massive MIMO

abstract: Massive MIMO opens up new avenues for enabling highly efficient random access (RA) by offering abundance of spatial degrees of freedom. In this paper, we investigate the grant-free RA with massive MIMO and derive the analytic expressions of success probability of the grant-free RA for conjugate beamforming and zero-forcing beamforming techniques.With the derived analytic expressions, we further shed light on the impact of system parameters on the success probability. Simulation results verify the accuracy of the analyses. It is confirmed that the grant-free RA with massive MIMO is an attractive RA technique with low signaling overhead that could simultaneously accommodate a number of RA users, which is multiple times the number of RA channels, with close-to-one success probability. In addition, when the number of antennas in massive MIMO is sufficiently large, we show that the number of orthogonal preambles would dominate the success probability.


title: Weak topological conjugacy via character of recurrence on impulsive dynamical systems

abstract: In the present paper, we define the concept of weak topological conjugacy and we establish sufficient conditions to obtain this kind of topological conjugacy between two limit sets. We use the character of recurrence to obtain the results.


title: How To Solve Moral Conundrums with Computability Theory

abstract: Various moral conundrums plague population ethics: the Non-Identity Problem, the Procreation Asymmetry, the Repugnant Conclusion, and more. I argue that the aforementioned moral conundrums have a structure neatly accounted for, and solved by, some ideas in computability theory. I introduce a mathematical model based on computability theory and show how previous arguments pertaining to these conundrums fit into the model. This paper proceeds as follows. First, I do a very brief survey of the history of computability theory in moral philosophy. Second, I follow various papers, and show how their arguments fit into, or don't fit into, our model. Third, I discuss the implications of our model to the question why the human race should or should not continue to exist. Finally, I show that our model may be interpreted according to a Confucian-Taoist moral principle.


title: A three-sphere microswimmer in a structured fluid

abstract: We discuss the locomotion of a three-sphere microswimmer in a viscoelastic structured fluid characterized by typical length and time scales. We derive a general expression to link the average swimming velocity to the sphere mobilities. In this relationship, a viscous contribution exists when the time-reversal symmetry is broken, whereas an elastic contribution is present when the structural symmetry of the microswimmer is broken. As an example of a structured fluid, we consider a polymer gel, which is described by a "two-fluid" model. We demonstrate in detail that the competition between the swimmer size and the polymer mesh size gives rise to the rich dynamics of a three-sphere microswimmer.


title: A Solvable High-Dimensional Model of GAN

abstract: We present a theoretical analysis of the training process for a single-layer GAN fed by high-dimensional input data. The training dynamics of the proposed model at both microscopic and macroscopic scales can be exactly analyzed in the high-dimensional limit. In particular, we prove that the macroscopic quantities measuring the quality of the training process converge to a deterministic process characterized by an ordinary differential equation (ODE), whereas the microscopic states containing all the detailed weights remain stochastic, whose dynamics can be described by a stochastic differential equation (SDE). This analysis provides a new perspective different from recent analyses in the limit of small learning rate, where the microscopic state is always considered deterministic, and the contribution of noise is ignored. From our analysis, we show that the level of the background noise is essential to the convergence of the training process: setting the noise level too strong leads to failure of feature recovery, whereas setting the noise too weak causes oscillation. Although this work focuses on a simple copy model of GAN, we believe the analysis methods and insights developed here would prove useful in the theoretical understanding of other variants of GANs with more advanced training algorithms.

categories: cs.LG cond-mat.dis-nn cs.IT math.IT stat.ML


title: CT-X: an efficient continuous-time quantum Monte Carlo impurity solver in Kondo Regime

abstract: In the present paper, we present an efficient continuous-time quantum Monte Carlo impurity solver with high acceptance rate at low temperature for multi-orbital quantum impurity models with general interaction. In this hybridization expansion impurity solver, the imaginary time evolution operator for the high energy multiplets, which decays very rapidly with the imaginary time, is approximated by a probability normalized $\delta$-function. As the result, the virtual charge fluctuations of $f^{n}\rightarrow f^{n\pm1}$ are well included on the same footing without applying Schrieffer-Wolff transformation explicitly. As benchmarks, our algorithm perfectly reproduces the results for both Coqblin-Schriffeer and Kondo lattice models obtained by CT-J method developed by Otsuki {\it et al}. Furthermore, it allows capturing low energy physics of heavy-fermion materials directly without fitting the exchange coupling $J$ in the Kondo model.


title: Fractal Measures and Nonlinear Dynamics of Overcontact Binaries

abstract: Overcontact binary stars are systems of two stars where the component stars are in contact with each other. This implies that they share a common envelope of gas. In this work we seek signatures of nonlinearity and chaos in these stars by using time series analysis techniques. We use three main techniques, namely the correlation dimension,f (\alpha) spectrum and the bicoherence. The former two are calculated from the reconstructed dynamics, while the latter is calculated from the Fourier transforms of the time series of intensity variations(light curves) of these stars. Our dataset consists of data from 463 overcontact binary stars in the Kepler field of view [1]. Our analysis indicates nonlinearity and signatures of chaos in almost all the light curves. We also explore whether the underlying nonlinear properties of the stars are related to their physical properties like fill-out-factor, a measure of the extend of contact between the components of an overcontact binary system . We observe that significant correlations exist between the fill out factor and the nonlinear quantifiers. This correlation is more pronounced in specific subcategories constructed based on the mass ratios and effective temperatures of the binaries. The correlations observed can be indicative of variations in the nonlinear properties of the star as it ages. We believe that this study relating nonlinear and astrophysical properties of binary stars is the first of its kind and is an important starting point for such studies in other astrophysical objects displaying nonlinear dynamical behaviour.


title: Controlling Personality-Based Stylistic Variation with Neural Natural Language Generators

abstract: Natural language generators for task-oriented dialogue must effectively realize system dialogue actions and their associated semantics. In many applications, it is also desirable for generators to control the style of an utterance. To date, work on task-oriented neural generation has primarily focused on semantic fidelity rather than achieving stylistic goals, while work on style has been done in contexts where it is difficult to measure content preservation. Here we present three different sequence-to-sequence models and carefully test how well they disentangle content and style. We use a statistical generator, Personage, to synthesize a new corpus of over 88,000 restaurant domain utterances whose style varies according to models of personality, giving us total control over both the semantic content and the stylistic variation in the training data. We then vary the amount of explicit stylistic supervision given to the three models. We show that our most explicit model can simultaneously achieve high fidelity to both semantic and stylistic goals: this model adds a context vector of 36 stylistic parameters as input to the hidden state of the encoder at each time step, showing the benefits of explicit stylistic supervision, even when the amount of training data is large.


title: Learning sentence embeddings using Recursive Networks

abstract: Learning sentence vectors that generalise well is a challenging task. In this paper we compare three methods of learning phrase embeddings: 1) Using LSTMs, 2) using recursive nets, 3) A variant of the method 2 using the POS information of the phrase. We train our models on dictionary definitions of words to obtain a reverse dictionary application similar to Felix et al. [1]. To see if our embeddings can be transferred to a new task we also train and test on the rotten tomatoes dataset [2]. We train keeping the sentence embeddings fixed as well as with fine tuning.


title: Tame the flexibility of circle patterns

abstract: This paper proves a deformation circle pattern theorem, which gives a complete description of those circle patterns with interstices in terms of the combinatorial type, the exterior intersections angles and the conformal structures of interstices. As results, the surface version of Rivin's theorem and the approximation property of packable surfaces are obtained.


title: Opening the black box of deep learning

abstract: The great success of deep learning shows that its technology contains profound truth, and understanding its internal mechanism not only has important implications for the development of its technology and effective application in various fields, but also provides meaningful insights into the understanding of human brain mechanism. At present, most of the theoretical research on deep learning is based on mathematics. This dissertation proposes that the neural network of deep learning is a physical system, examines deep learning from three different perspectives: microscopic, macroscopic, and physical world views, answers multiple theoretical puzzles in deep learning by using physics principles. For example, from the perspective of quantum mechanics and statistical physics, this dissertation presents the calculation methods for convolution calculation, pooling, normalization, and Restricted Boltzmann Machine, as well as the selection of cost functions, explains why deep learning must be deep, what characteristics are learned in deep learning, why Convolutional Neural Networks do not have to be trained layer by layer, and the limitations of deep learning, etc., and proposes the theoretical direction and basis for the further development of deep learning now and in the future. The brilliance of physics flashes in deep learning, we try to establish the deep learning technology based on the scientific theory of physics.


title: Improved Algorithms for Collaborative PAC Learning

abstract: We study a recent model of collaborative PAC learning where $k$ players with $k$ different tasks collaborate to learn a single classifier that works for all tasks. Previous work showed that when there is a classifier that has very small error on all tasks, there is a collaborative algorithm that finds a single classifier for all tasks and has $O((\ln (k))^2)$ times the worst-case sample complexity for learning a single task. In this work, we design new algorithms for both the realizable and the non-realizable setting, having sample complexity only $O(\ln (k))$ times the worst-case sample complexity for learning a single task. The sample complexity upper bounds of our algorithms match previous lower bounds and in some range of parameters are even better than previous algorithms that are allowed to output different classifiers for different tasks.