title: Sharp, Smooth, and Oscillatory Traveling Waves of Degenerate Diffusion Equation with Delay

abstract: We consider the non-monotone degenerate diffusion equation with time delay. Different from the linear diffusion equation, the degenerate equation allows for semi-compactly supported traveling waves. In particular, we discover sharp-oscillating waves with sharp edges and non-decaying oscillations. The degenerate diffusion and the effect of time delay cause us essential difficulties. We show the existence for both sharp and smooth traveling wave solutions. Furthermore, we prove the oscillating properties of the waves for large wave speeds and large time delay. Since the existing approaches are not applicable, we develop a new technique to show the existence of the sharp, smooth and oscillatory traveling waves.


title: Machine learning approaches for analyzing and enhancing molecular dynamics simulations

abstract: Molecular dynamics (MD) has become a powerful tool for studying biophysical systems, due to increasing computational power and availability of software. Although MD has made many contributions to better understanding these complex biophysical systems, there remain methodological difficulties to be surmounted. First, how to make the deluge of data generated in running even a microsecond long MD simulation human comprehensible. Second, how to efficiently sample the underlying free energy surface and kinetics. In this short perspective, we summarize machine learning based ideas that are solving both of these limitations, with a focus on their key theoretical underpinnings and remaining challenges.


title: The Hyperboloidal Numerical Evolution of a Good-Bad-Ugly Wave Equation

abstract: One method for the numerical treatment of future null-infinity is to decouple coordinates from the tensor basis and choose each in a careful manner. This dual-frame approach is hampered by logarithmically divergent terms that appear in a naive choice of evolved variables. Here we consider a system of wave equations that satisfy the weak-null condition and serve as a model system with similar nonlinearities to those present in the Einstein field equations in generalized harmonic gauge. We show that these equations can be explicitly regularized by a nonlinear change of variables. Working in spherical symmetry, a numerical implementation of this model using compactified hyperboloidal slices is then presented. Clean convergence is found for the regularized system. Although more complicated, it is expected that general relativity can be treated similarly.


title: Work done on a single-particle gas during an adiabatic compression/expansion process

abstract: We compute the average work done by an external agent, driving a piston at constant speed, over a single particle gas going through an adiabatic compression and expansion process. To do so, we get the analytical expression relating the number of collisions between the piston and the particle with the position of the piston during the process. The ergodicity breaking of the system during the process is identified as the source of its irreversibility. In addition, we observe that by using particular initial distributions for the state of the particle, it is possible to preclude the possibility of a net energy transfer from the agent to the particle during the process.


title: Variational Approach of Critical Sharp Front Speeds in Density-dependent Diffusion Model with Time Delay

abstract: For the classical reaction diffusion equation, the priori speed of fronts is determined exactly in the pioneering paper (R.D. Benguria and M.C. Depassier, {\em Commun. Math. Phys.} 175:221--227, 1996) by variational characterization method. In this paper, we model the dispersal process using a density-dependent diffusion equation with time delay. We show the existence and uniqueness of sharp critical fronts, where the sharp critical front is $C^1$-smooth when the diffusion degeneracy is weaker with $1<m<2$, and the sharp critical front is non-$C^1$-smooth (piecewise smooth) when the diffusion degeneracy is stronger with $m\ge 2$. We give a new variational approach for the critical wave speed and investigate how the time delay affects the propagation mechanism of fronts. Our results provide some interesting insight into the dynamics of critical traveling wave.


title: Challenges of Designing and Developing Tangible Interfaces for Mental Well-being

abstract: Mental well-being technologies possess many qualities that give them the potential to help people receive assessment and treatment who may otherwise not receive help due to fear of stigma or lack of resources. The combination of advances in sensors, microcontrollers and machine learning is leading to the emergence of dedicated tangible interfaces to monitor and promote positive mental well-being. However, there are key technical, ergonomic and aesthetic challenges to be overcome in order to make these interfaces effective and respond to users' needs. In this paper, the barriers to develop mental well-being tangible interfaces are discussed by identifying and examining the recent technological challenges machine learning, sensors, microcontrollers and batteries create.User-oriented challenges that face the development of mental well-being technologies are then considered ranging from user engagement during co-design and trials to ethical and privacy concerns.


title: Searches for gluinos and squarks

abstract: Despite the great success of the Standard Model, it still does not explain Dark Matter, matter/antimatter asymmetry and it does not unite the electroweak and the strong forces. As a possible solution, the theory of Supersymmetry was proposed. In this paper, three searches for strong production Supersymmetry are presented. The data correspond to a total integrated luminosity of 137 fb$^{-1}$ at a center-of-mass energy of 13 TeV, recorded at the Large Hadron Collider during the years 2015-2018. There has been no significant excess observed relative to the Standard Model predictions. The data gave the following best 95\% exclusion limits for the masses of squarks and gluinos: 2250 GeV, 1260 GeV and 1225 GeV which are obtained from the inclusive search for gluinos, bottom squarks and top squarks, respectively. The search for disappearing tracks extends the gluino mass limit to as much as 2460 GeV, and the neutralino mass limit to as much as 2000 GeV.


title: Finding Design Opportunities for Smartness in Consumer Packaged Goods

abstract: This study attempts to understand the use of Consumer Packaged Goods (CPG) in practice to obtain insights to develop design interventions that bring the CPGs into the Internet of Things. Our ultimate aim is to equip CPGs with a layer of smartness so that CPGs could collect information about their use and provide extra services and functionalities. With a practice perspective we developed an assemblage of methods to analyze and represent how people use CPGs. We chose cooking as our practice case and use an auto-ethnographic data sample to demonstrate the application of our methods. Despite the early stage of our study, our methods provide ways to get an understanding of how CPGs are used in practice and an opening to establish opportunities for design interventions.


title: Alexander's Wholeness as the Scientific Foundation of Sustainable Urban Design and Planning

abstract: As Christopher Alexander conceived and defined through his life's work - The Nature of Order - wholeness is a recursive structure that recurs in space and matter and is reflected in human minds and cognition. Based on the definition of wholeness, a mathematical model of wholeness, together with its topological representation, has been developed, and it is able to address not only why a structure is beautiful, but also how much beauty the structure has. Given the circumstance, this paper is attempted to argue for the wholeness as the scientific foundation of sustainable urban design and planning, with the help of the mathematical model and topological representation. We start by introducing the wholeness as a mathematical structure of physical space that pervasively exists in our surroundings, along with two fundamental laws - scaling law and Tobler's law - that underlie the 15 properties for characterizing and making living structures. We argue that urban design and planning can be considered to be wholeness-extending processes, guided by two design principles of differentiation and adaptation, to transform a space - in a piecemeal fashion - into a living or more living structure. We further discuss several other urban design theories and how they can be justified by and placed within the theory of wholeness. With the wholeness as the scientific foundation, urban design can turn into a rigorous science with creation of living structures as the primary aim. Keywords: Beauty, life, scaling law, adaptation, differentiation, and organic world view


title: Cosmological attractors to general relativity and spontaneous scalarization with disformal coupling

abstract: The canonical scalar-tensor theory model which exhibits spontaneous scalarization in the strong-gravity regime of neutron stars has long been known to predict a cosmological evolution for the scalar field which generically results in severe violations of present-day Solar System constraints on deviations from general relativity. We study if this tension can be alleviated by generalizing this model to include a disformal coupling between the scalar field $\varphi$ and matter, where the Jordan frame metric ${\tilde g}_{\mu\nu}$ is related to the Einstein frame one $g_{\mu\nu}$ by ${\tilde g}_{\mu\nu}=A(\varphi)^2 (g_{\mu\nu}+\Lambda\, \partial_\mu \varphi \, \partial_\nu\varphi)$. We find that this broader theory admits a late-time attractor mechanism towards general relativity. However, the existence of this attractor requires a value of disformal scale of the order $\Lambda\gtrsim H_0^{-2}$, where $H_0$ is the Hubble parameter of today, which is much larger than the scale relevant for spontaneous scalarization of neutron stars $\Lambda \sim R_s^{2}$ with $R_s (\sim 10^{-22} H_0^{-1})$ being the typical radius of these stars. The large values of $\Lambda$ necessary for the attractor mechanism (i) suppress spontaneous scalarization altogether inside neutron stars and (ii) induce ghost instabilities on scalar field fluctuations, thus preventing a resolution of the tension. We argue that the problem arises because our disformal coupling involves a dimensionful parameter.


title: Living Structure Down to Earth and Up to Heaven: Christopher Alexander

abstract: Discovered by Christopher Alexander, living structure is a physical phenomenon, through which the quality of the built environment or artifacts can be judged objectively. It bears two distinguished properties just like a tree: "far more small things than large ones" across all scales, and "more or less similar things" on each scale. As a physical phenomenon, and mathematical concept, living structure is essentially empirical, discovered and developed from miniscule observation in nature- and human-made things, and it affects our daily lives in some substantial ways, such as where to put a table or a flower vase in a room, helping us to make beautiful things and environments. Living structure is not only empirical, but also philosophical and visionary, enabling us to see the world and space in more meaningful ways. This paper is intended to defend living structure as a physical phenomenon, clarifying some common questions and misgivings surrounding Alexander's design thoughts, such as the objective or structural nature of beauty, building styles advocated by Alexander, and mysterious nature of his concepts. We first illustrate living structure - essentially organized complexity, as advocated by the late Jane Jacobs (1916-2006) - that is governed by two fundamental laws (scaling law and Tobler's law), and generated in some step by step fashion by two design principles (differentiation and adaptation) through the 15 structural properties. We then verify why living structure is primarily empirical, drawing evidence from Alexander's own work, as well as our case studies applied to the Earth's surface including cities, streets, and buildings, and two logos. Before reaching conclusions, we concentrate on the most mysterious part of Alexander's work - the hypothesized "I" - as a substance that pervasively exists everywhere, in order to make better sense of living structure in our minds.


title: Morphological transitions in supercritical generalized percolation and moving interfaces in media with frozen randomness

abstract: We consider the growth of clusters in disordered media at zero temperature, as exemplified by supercritical generalized percolation and by the random field Ising model. We show that the morphology of such clusters and of their surfaces can be of different types: They can be standard compact clusters with rough or smooth surfaces, but there exists also a completely different "spongy" phase. Clusters in the spongy phase are `compact' as far as the size-mass relation M ~ R^D is concerned (with D the space dimension), but have an outer surface (or `hull') whose fractal dimension is also D and which is indeed dense in the interior of the entire cluster. This behavior is found in all dimensions D >= 3. Slightly supercritical clusters can be of either type in $D=3$, while they are always spongy in D >= 4. Possible consequences for the applicability of KPZ (Kardar-Parisi-Zhang) scaling to interfaces in media with frozen randomness are studied in detail.


title: A Phase Shift Deep Neural Network for High Frequency Approximation and Wave Problems

abstract: In this paper, we propose a phase shift deep neural network (PhaseDNN), which provides a uniform wideband convergence in approximating high frequency functions and solutions of wave equations. The PhaseDNN makes use of the fact that common DNNs often achieve convergence in the low frequency range first, and a series of moderately-sized DNNs are constructed and trained for selected high frequency ranges. With the help of phase shifts in the frequency domain, each of the DNNs will be trained to approximate the function's higher frequency content over a specific range at the the speed of convergence as in the low frequency range. As a result, the proposed PhaseDNN is able to convert high frequency learning to low frequency one, allowing a uniform learning to wideband functions. The PhaseDNN will then be applied to find the solution of high frequency wave equations in inhomogeneous media through both differential and integral equation formulations with least square residual loss functions. Numerical results have demonstrated the capability of the PhaseDNN in learning high frequency functions and oscillatory solutions of interior and exterior Helmholtz equations.


title: ALCNN: Attention-based Model for Fine-grained Demand Inference of Dock-less Shared Bike in New Cities

abstract: In recent years, dock-less shared bikes have been widely spread across many cities in China and facilitate people's lives. However, at the same time, it also raises many problems about dock-less shared bike management due to the mismatching between demands and real distribution of bikes. Before deploying dock-less shared bikes in a city, companies need to make a plan for dispatching bikes from places having excessive bikes to locations with high demands for providing better services. In this paper, we study the problem of inferring fine-grained bike demands anywhere in a new city before the deployment of bikes. This problem is challenging because new city lacks training data and bike demands vary by both places and time. To solve the problem, we provide various methods to extract discriminative features from multi-source geographic data, such as POI, road networks and nighttime light, for each place. We utilize correlation Principle Component Analysis (coPCA) to deal with extracted features of both old city and new city to realize distribution adaption. Then, we adopt a discrete wavelet transform (DWT) based model to mine daily patterns for each place from fine-grained bike demand. We propose an attention based local CNN model, \textbf{ALCNN}, to infer the daily patterns with latent features from coPCA with multiple CNNs for modeling the influence of neighbor places. In addition, ALCNN merges latent features from multiple CNNs and can select a suitable size of influenced regions. The extensive experiments on real-life datasets show that the proposed approach outperforms competitive methods.


title: Study on the Behavior of Weakly Nonlinear Water Waves in the Presence of Random Wind Forcing

abstract: Specific solutions of the nonlinear Schr\"odinger equation, such as the Peregrine breather, are considered to be prototypes of extreme or freak waves in the oceans. An important question is, whether these solutions also exist in the presence of gusty wind. Using the method of multiple scales, a nonlinear Schr\"odinger equation is obtained for the case of wind forced weakly nonlinear deep water waves. Thereby, the wind forcing is modeled as a stochastic process. This leads to a stochastic nonlinear Schr\"odinger equation, which is calculated for different wind regimes. For the case of wind forcing which is either random in time or random in space, it is shown that breather type solutions such as the Peregrine breather occur even in strong gusty wind conditions.

categories: nlin.PS cs.NA math-ph math.MP math.NA physics.flu-dyn


title: Extending the Message Passing Interface (MPI) with User-Level Schedules

abstract: Composability is one of seven reasons for the long-standing and continuing success of MPI. Extending MPI by composing its operations with user-level operations provides useful integration with the progress engine and completion notification methods of MPI. However, the existing extensibility mechanism in MPI (generalized requests) is not widely utilized and has significant drawbacks. MPI can be generalized via scheduled communication primitives, for example, by utilizing implementation techniques from existing MPI-3 nonblocking collectives and from forthcoming MPI-4 persistent and partitioned APIs. Non-trivial schedules are used internally in some MPI libraries; but, they are not accessible to end-users. Message-based communication patterns can be built as libraries on top of MPI. Such libraries can have comparable implementation maturity and potentially higher performance than MPI library code, but do not require intimate knowledge of the MPI implementation. Libraries can provide performance-portable interfaces that cross MPI implementation boundaries. The ability to compose additional user-defined operations using the same progress engine benefits all kinds of general purpose HPC libraries. We propose a definition for MPI schedules: a user-level programming model suitable for creating persistent collective communication composed with new application-specific sequences of user-defined operations managed by MPI and fully integrated with MPI progress and completion notification. The API proposed offers a path to standardization for extensible communication schedules involving user-defined operations. Our approach has the potential to introduce event-driven programming into MPI (beyond the tools interface), although connecting schedules with events comprises future work. Early performance results described here are promising and indicate strong overlap potential.


title: Improved Schemes for Episodic Memory-based Lifelong Learning

abstract: Current deep neural networks can achieve remarkable performance on a single task. However, when the deep neural network is continually trained on a sequence of tasks, it seems to gradually forget the previous learned knowledge. This phenomenon is referred to as \textit{catastrophic forgetting} and motivates the field called lifelong learning. Recently, episodic memory based approaches such as GEM \cite{lopez2017gradient} and A-GEM \cite{chaudhry2018efficient} have shown remarkable performance. In this paper, we provide the first unified view of episodic memory based approaches from an optimization's perspective. This view leads to two improved schemes for episodic memory based lifelong learning, called MEGA-I and MEGA-II. MEGA-I and MEGA-II modulate the balance between old tasks and the new task by integrating the current gradient with the gradient computed on the episodic memory. Notably, we show that GEM and A-GEM are degenerate cases of MEGA-I and MEGA-II which consistently put the same emphasis on the current task, regardless of how the loss changes over time. Our proposed schemes address this issue by using novel loss-balancing updating rules, which drastically improve the performance over GEM and A-GEM. Extensive experimental results show that the proposed schemes significantly advance the state-of-the-art on four commonly used lifelong learning benchmarks, reducing the error by up to 18\%.


title: FreeLB: Enhanced Adversarial Training for Natural Language Understanding

abstract: Adversarial training, which minimizes the maximal risk for label-preserving input perturbations, has proved to be effective for improving the generalization of language models. In this work, we propose a novel adversarial training algorithm, FreeLB, that promotes higher invariance in the embedding space, by adding adversarial perturbations to word embeddings and minimizing the resultant adversarial risk inside different regions around input samples. To validate the effectiveness of the proposed approach, we apply it to Transformer-based models for natural language understanding and commonsense reasoning tasks. Experiments on the GLUE benchmark show that when applied only to the finetuning stage, it is able to improve the overall test scores of BERT-base model from 78.3 to 79.4, and RoBERTa-large model from 88.5 to 88.8. In addition, the proposed approach achieves state-of-the-art single-model test accuracies of 85.44\% and 67.75\% on ARC-Easy and ARC-Challenge. Experiments on CommonsenseQA benchmark further demonstrate that FreeLB can be generalized and boost the performance of RoBERTa-large model on other tasks as well. Code is available at \url{https://github.com/zhuchen03/FreeLB .


title: A Multimodal Alerting System for Online Class Quality Assurance

abstract: Online 1 on 1 class is created for more personalized learning experience. It demands a large number of teaching resources, which are scarce in China. To alleviate this problem, we build a platform (marketplace), i.e., \emph{Dahai} to allow college students from top Chinese universities to register as part-time instructors for the online 1 on 1 classes. To warn the unqualified instructors and ensure the overall education quality, we build a monitoring and alerting system by utilizing multimodal information from the online environment. Our system mainly consists of two key components: banned word detector and class quality predictor. The system performance is demonstrated both offline and online. By conducting experimental evaluation of real-world online courses, we are able to achieve 74.3\% alerting accuracy in our production environment.


title: An Automated Vehicle (AV) like Me? The Impact of Personality Similarities and Differences between Humans and AVs

abstract: To better understand the impacts of similarities and dissimilarities in human and AV personalities we conducted an experimental study with 443 individuals. Generally, similarities in human and AV personalities led to a higher perception of AV safety only when both were high in specific personality traits. Dissimilarities in human and AV personalities also yielded a higher perception of AV safety, but only when the AV was higher than the human in a particular personality trait.


title: Generic Framework of Knowledge-Based Learning: Designing and Deploying of Web Application

abstract: Learning technology was used as standalone software to install in a particular system, which needs to buy learning software of a particular subject. It was costly and difficult to search CD/DVD of the particular program in the market. Nowadays the trend of learning is changed and people are learning via the internet and it is known as Electronic Learning (E-learning). Several e-learning web applications are available which are providing more stuff about students and it fulfills requirements. The aim of this paper is to present a well structured, user-friendly framework with the web application for e-learning, which does not need any subscription. The experiment was conducted with 691 students and teachers, the result shows 91.98% of participants were satisfied with the proposed E-learning system.


title: Simulation of humpback whale bubble-net feeding models

abstract: Humpback whales can generate intricate bubbly regions, called bubble nets, via their blowholes. They appear to exploit these bubble nets for feeding via loud vocalizations. A fully-coupled phase-averaging approach is used to model the flow, bubble dynamics, and corresponding acoustics. A previously hypothesized waveguiding mechanism is assessed for varying acoustic frequencies and net void fractions. Reflections within the bubbly region result in observable waveguiding for only a small range of flow parameters. A configuration of multiple whales surrounding and vocalizing towards an annular bubble net is also analyzed. For a range of flow parameters the bubble net keeps its core region substantially quieter than the exterior. This approach appears more viable, though it relies upon the cooperation of multiple whales. A spiral bubble net configuration that circumvents this requirement is also investigated. The acoustic wave behaviors in the spiral interior vary qualitatively with the vocalization frequency and net void fraction. The competing effects of vocalization guiding and acoustic attenuation are quantified. Low void fraction cases allow low-frequency waves to partially escape the spiral region, with the remaining vocalizations still exciting the net interior. Higher void fraction nets appear preferable, guiding even low-frequency vocalizations while still maintaining a quiet net interior.


title: An ergodic theorem for quantum processes with applications to matrix product states

abstract: Any discrete quantum process is represented by a sequence of quantum channels. We consider ergodic quantum processes obtained by a map that takes the points along the trajectory of a discrete ergodic dynamical system to the space of quantum channels. Under natural irreducibility conditions, we obtain a theorem showing that the state under such a process converges exponentially fast to an ergodic sequence depending on the process, but independent of the initial state. As an application, we describe the thermodynamic limit of ergodic matrix product states and prove that the 2-point correlations of local observables in such states decay exponentially with their distance in the bulk.

categories: quant-ph cond-mat.str-el math-ph math.MP


title: Interstellar formamide (NH$_2$CHO), a key prebiotic precursor

abstract: Formamide (NH$_2$CHO) has been identified as a potential precursor of a wide variety of organic compounds essential to life, and many biochemical studies propose it likely played a crucial role in the context of the origin of life on our planet. The detection of formamide in comets, which are believed to have --at least partially-- inherited their current chemical composition during the birth of the Solar System, raises the question whether a non-negligible amount of formamide may have been exogenously delivered onto a very young Earth about four billion years ago. A crucial part of the effort to answer this question involves searching for formamide in regions where stars and planets are forming today in our Galaxy, as this can shed light on its formation, survival, and chemical re-processing along the different evolutionary phases leading to a star and planetary system like our own. The present review primarily addresses the chemistry of formamide in the interstellar medium, from the point of view of (i) astronomical observations, (ii) experiments, and (iii) theoretical calculations. While focusing on just one molecule, this review also more generally reflects the importance of joining efforts across multiple scientific disciplines in order to make progress in the highly interdisciplinary science of astrochemistry.


title: Controlling bubble coalescence in metallic foams: A simple phase field-based approach

abstract: The phase-field method is used as a basis to develop a strictly mass conserving, yet simple, model for simulation of two-phase flow. The model is aimed to be applied for the study of structure evolution in metallic foams. In this regard, the critical issue is to control the rate of bubble coalescence compared to concurrent processes such as their rearrangement due to fluid motion. In the present model, this is achieved by tuning the interface energy as a free parameter. The model is validated by a number of benchmark tests. First, stability of a two dimensional bubble is investigated by the Young-Laplace law for different values of the interface energy. Then, the coalescence of two bubbles is simulated until the system reaches equilibrium with a circular shape. To address the major capability of the present model for the formation of foam structure, the bubble coalescence is simulated for various values of interface energy in order to slow down the merging process. These simulations are repeated in the presence of a rotational flow to highlight the fact that the model allows to suppress the coalescence process compared to the motion of bubbles relative to each other.


title: Robust Field-Only Surface Integral Equations: Scattering from a Perfect Electric Conductor

abstract: A robust field-only boundary integral formulation of electromagnetics is derived without the use of surface currents that appear in the Stratton-Chu formulation. For scattering by a perfect electrical conductor (PEC), the components of the electric field are obtained directly from surface integral equation solutions of three scalar Helmholtz equations for the field components. The divergence-free condition is enforced via a boundary condition on the normal component of the field and its normal derivative. Field values and their normal derivatives at the surface of the PEC are obtained directly from surface integral equations that do not contain divergent kernels. Consequently, high-order elements with fewer degrees of freedom can be used to represent surface features to a higher precision than the traditional planar elements. This theoretical framework is illustrated with numerical examples that provide further physical insight into the role of the surface curvature in scattering problems.


title: Rapid mixing of a Markov chain for an exponentially weighted aggregation estimator

abstract: The Metropolis-Hastings method is often used to construct a Markov chain with a given $\pi$ as its stationary distribution. The method works even if $\pi$ is known only up to an intractable constant of proportionality. Polynomial time convergence results for such chains (rapid mixing) are hard to obtain for high dimensional probability models where the size of the state space potentially grows exponentially with the model dimension. In a Bayesian context, Yang, Wainwright, and Jordan (2016) (=YWJ) used the path method to prove rapid mixing for high dimensional linear models. This paper proposes a modification of the YWJ approach that simplifies the theoretical argument and improves the rate of convergence. The new approach is illustrated by an application to an exponentially weighted aggregation estimator.


title: Variance-Reduced Decentralized Stochastic Optimization with Gradient Tracking--Part I: GT-SAGA

abstract: In this paper, we study decentralized empirical risk minimization problems, where the goal is to minimize a finite-sum of smooth and strongly-convex functions available over a network of nodes. In this Part I, we propose \textbf{\texttt{GT-SAGA}}, a decentralized stochastic first-order algorithm based on gradient tracking \cite{DSGT_Pu,DSGT_Xin} and a variance-reduction technique called SAGA \cite{SAGA}. We develop the convergence analysis and the iteration complexity of this algorithm. We further demonstrate various trade-offs and discuss scenarios in which \textbf{\texttt{GT-SAGA}} achieves superior performance (in terms of the number of local gradient computations required) with respect to existing decentralized schemes. In Part II \cite{GT_SVRG} of this two-part paper, we develop and analyze \textbf{\texttt{GT-SVRG}}, a decentralized gradient tracking based implementation of SVRG \cite{SVRG}, another well-known variance-reduction technique.


title: Quantum information processing with closely-spaced diamond color centers in strain and magnetic fields

abstract: Electron and nuclear spins of diamond nitrogen-vacancy (NV) centers are good candidates for quantum information processing as they have long coherence time and can be initialized and read out optically. However, creating a large number of coherently coupled and individually addressable NV centers for quantum computing has been a big challenge. Here we propose methods to use high-density diamond NV centers coupled by spin-spin interaction with an average separation on the order of 10 nm for quantum computing. We propose to use a strain gradient to encode the position information of each NV center in the energy level of its excited electron orbital state, which causes a shift of its optical transition frequency. With such strain encoding, more than 100 closely-packed NV centers below optical diffraction limit can be read out individually by resonant optical excitation. A magnetic gradient will be used to shift the electron spin resonant (ESR) frequencies of NV centers. Therefore, the spin state of each NV center can be individually manipulated and different NV centers can be selectively coupled. A universal set of quantum operations for two-qubit and three-qubit system is introduced by careful design of external drives. Moreover, entangled states with multiple qubits can be created by this protocol, which is a major step towards quantum information processing with solid-state spins.


title: Random walks on dense graphs and graphons

abstract: Graph-limit theory focuses on the convergence of sequences of graphs when the number of nodes becomes arbitrarily large. This framework defines a continuous version of graphs allowing for the study of dynamical systems on very large graphs, where classical methods would become computationally intractable. Through an approximation procedure, the standard system of coupled ordinary differential equations is replaced by a nonlocal evolution equation on the unit interval. In this work, we adopt this methodology to explore the continuum limit of random walks, a popular model for diffusion on graphs. We focus on two classes of processes on dense weighted graph, in discrete and in continuous time, whose dynamics are encoded in the transition matrix and the random-walk Laplacian. We also show that previous works on the discrete heat equation, associated to the combinatorial Laplacian, fall within the scope of our approach. Finally, we apply the spectral theory of operators to characterize the relaxation time of the process in the continuum limit.


title: Grothendieck-topological Group Objects

abstract: In analogy with the classical theory of topological groups, for finitely complete categories enriched with Grothendieck topologies, we provide the concepts of localized G-topological space, initial Grothendieck topologies and continuous morphisms, in order to obtain the concepts of G-topological monoid and G-topological group objects.


title: Linear and Range Counting under Metric-based Local Differential Privacy

abstract: Local differential privacy (LDP) enables private data sharing and analytics without the need for a trusted data collector. Error-optimal primitives (for, e.g., estimating means and item frequencies) under LDP have been well studied. For analytical tasks such as range queries, however, the best known error bound is dependent on the domain size of private data, which is potentially prohibitive. This deficiency is inherent as LDP protects the same level of indistinguishability between any pair of private data values for each data downer. In this paper, we utilize an extension of $\epsilon$-LDP called Metric-LDP or $E$-LDP, where a metric $E$ defines heterogeneous privacy guarantees for different pairs of private data values and thus provides a more flexible knob than $\epsilon$ does to relax LDP and tune utility-privacy trade-offs. We show that, under such privacy relaxations, for analytical workloads such as linear counting, multi-dimensional range counting queries, and quantile queries, we can achieve significant gains in utility. In particular, for range queries under $E$-LDP where the metric $E$ is the $L^1$-distance function scaled by $\epsilon$, we design mechanisms with errors independent on the domain sizes; instead, their errors depend on the metric $E$, which specifies in what granularity the private data is protected. We believe that the primitives we design for $E$-LDP will be useful in developing mechanisms for other analytical tasks, and encourage the adoption of LDP in practice.


title: A $U(1)_{X}$ extension to the SM with three families and Peccei Quinn symmetry

abstract: We propose a non-universal $U(1)_{X}$ extension to the Standard Model with three families and an additional global anomala Peccei-Quinn (PQ) symmetry. The breaking of the former allows us to give masses to the exotic fermionic sector and the later generates the necessary zeros in the mass matrices to explain the fermionic mass hierarchy. In addition, the large energy scale associated with the spontaneously breaking (SSB) of the PQ symmetry provides a solution to the strong CP-problem and an axion that could be a possible dark matter candidate. Also, the SSB allows to generate right-handed neutrino masses, so the active neutrinos acquire $eV$-mass values due to the see-saw mechanism implementation.


title: Adiabatic electron charge transfer between two quantum dots in presence of 1/f noise

abstract: Controlled adiabatic transfer of a single electron through a chain of quantum dots has been recently achieved in GaAs and Si/SiGe based quantum dots, opening prospects for turning stationary spin qubits into mobile ones, and solving in this way the problem of long-distance communication between quantum registers in a scalable quantum computing architecture based on quantum dots. We consider theoretically the process of such an electron transfer between two tunnel-coupled quantum dots, focusing on control by slowly varying the detuning of energy levels in the dots. We take into account the fluctuations in detuning caused by $1/f$-type noise that is ubiquitous in semiconductor nanostructures, and analyze their influence on probability of successful transfer of an electron in a spin eigenstate. With numerical and analytical calculations we show that probability of electron not being transferred due to $1/f^\beta$ noise in detuning is $\propto \sigma^2 t^{\beta-1}/v$, where $\sigma$ characterizes the noise amplitude, $t$ is the interdot tunnel coupling, and $v$ is the detuning sweep rate. Interestingly, this means that the noise-induced errors in charge transfer are independent of $t$ for $1/f$ noise. For realistic parameters taken from experiments on silicon-based quantum dots, we obtain the minimal probability of charge transfer failure between a pair of dots is limited by $1/f$ noise in detuning to be the on order of $0.01$. This means that in order to reliably transfer charges across many quantum dots, charge noise in the devices should be further suppressed, or tunnel couplings should be increased, in order to allow for faster transfer (and less exposure to noise), while not triggering the deterministic Landau-Zener excitation.


title: Boundary-element method to analyze acoustic scattering from a coupled swimbladder-fish body configuration

abstract: A model for computing acoustic scattering by a swimbladdered fish with coupling to surrounding fish tissue that is assumed to behave as a homogeneous fluid, is presented. Mathematically, this corresponds to considering the problem of two penetrable scatterers immersed in a homogeneous medium, one of which is wholly embedded in the other. The model is formulated in the frame of boundary integral equations whose solution is achieved using the Boundary Element Method (BEM) for a planar triangle mesh. The numerical implementation is verified against benchmark solutions reported in the literature. The model is then applied to a specimen of \textit{Merluccius hubbsi}, whose morphometry was determined by CT scanning, for evaluating its forward and backscattering responses. From the acoustic scattering viewpoint, the swimbladder is considered as a gas-filled object while the flesh constituting the fish body acts like a weak scatterer. The numerical results suggest the swimbladder and the fish body responses, when fully coupled, can lead to substantial differences with respect to the simplified models normally in use in the area of aquatic ecosystem research.


title: Non-unique connection between bulk topological invariants and surface physics

abstract: At the heart of the study of topological insulators lies a fundamental dichotomy: topological invariants are defined in infinite systems, but surface states as their main footprint only exist in finite systems. In the slab geometry, namely infinite in two planar directions and finite in the perpendicular direction, the 2D topological invariant was shown to display three different types of behaviour. The perpendicular Dirac velocity turns out to be a critical control parameter discerning between different qualitative situations. When it is zero, the three types of behaviour extrapolate to the three 3D topologically distinct phases: trivial, weak and strong topological insulators. We show analytically that the boundaries between types of behaviour are topological phase transitions of particular significance since they allow to predict the 3D topological invariants from finite-thickness transitions. When the perpendicular Dirac velocity is not zero, we identify a new phase with surface states but no band inversion at any finite thickness, disentangling these two concepts which are closely linked in 3D. We also show that at zero perpendicular Dirac velocity the system is gapless in the 3D bulk and therefore not a topological insulating state, even though the slab geometry extrapolates to the 3D topological phases. Finally, in a parameter regime with strong dispersion perpendicular to the surface of the slab, we encounter the unusual case that the slab physics displays non-trivial phases with surface states but nevertheless extrapolates to a 3D trivial state.


title: Robust and Adaptive Sequential Submodular Optimization

abstract: Emerging applications of control, estimation, and machine learning, ranging from target tracking to decentralized model fitting, pose resource constraints that limit which of the available sensors, actuators, or data can be simultaneously used across time. Therefore, many researchers have proposed solutions within discrete optimization frameworks where the optimization is performed over finite sets. By exploiting notions of discrete convexity, such as submodularity, the researchers have been able to provide scalable algorithms with provable suboptimality bounds. In this paper, we consider such problems but in adversarial environments, where in every step a number of the chosen elements in the optimization is removed due to failures/attacks. Specifically, we consider for the first time a sequential version of the problem that allows us to observe the failures and adapt, while the attacker also adapts to our response. We call the novel problem Robust Sequential submodular Maximization (RSM). Generally, the problem is computationally hard and no scalable algorithm is known for its solution. However, in this paper we propose Robust and Adaptive Maximization (RAM), the first scalable algorithm. RAM runs in an online fashion, adapting in every step to the history of failures. Also, it guarantees a near-optimal performance, even against any number of failures among the used elements. Particularly, RAM has both provable per-instance a priori bounds and tight and/or optimal a posteriori bounds. Finally, we demonstrate RAM's near-optimality in simulations across various application scenarios, along with its robustness against several failure types, from worst-case to random.


title: bamlss: A Lego Toolbox for Flexible Bayesian Regression (and Beyond)

abstract: Over the last decades, the challenges in applied regression and in predictive modeling have been changing considerably: (1) More flexible model specifications are needed as big(ger) data become available, facilitated by more powerful computing infrastructure. (2) Full probabilistic modeling rather than predicting just means or expectations is crucial in many applications. (3) Interest in Bayesian inference has been increasing both as an appealing framework for regularizing or penalizing model estimation as well as a natural alternative to classical frequentist inference. However, while there has been a lot of research in all three areas, also leading to associated software packages, a modular software implementation that allows to easily combine all three aspects has not yet been available. For filling this gap, the R package bamlss is introduced for Bayesian additive models for location, scale, and shape (and beyond). At the core of the package are algorithms for highly-efficient Bayesian estimation and inference that can be applied to generalized additive models (GAMs) or generalized additive models for location, scale, and shape (GAMLSS), also known as distributional regression. However, its building blocks are designed as "Lego bricks" encompassing various distributions (exponential family, Cox, joint models, ...), regression terms (linear, splines, random effects, tensor products, spatial fields, ...), and estimators (MCMC, backfitting, gradient boosting, lasso, ...). It is demonstrated how these can be easily recombined to make classical models more flexible or create new custom models for specific modeling challenges.


title: Device-Independent Secret Sharing and a Stronger Form of Bell Nonlocality

abstract: Bell nonlocality, the fact that local hidden variable models cannot reproduce the correlations obtained by measurements on entangled states, is a cornerstone in our modern understanding of quantum theory. Apart from its fundamental implications, nonlocality is also at the core of device-independent quantum information processing, which successful implementation is achieved without precise knowledge of the physical apparatus. Here we show that a stronger form of Bell nonlocality, for which even nonlocal hidden variable models cannot reproduce the quantum predictions, allows for the device-independent implementation of secret sharing, a paradigmatic communication protocol where a secret split amidst many possibly untrusted parts can only be decoded if they collaborate among themselves.


title: Probabilistic Modeling of Deep Features for Out-of-Distribution and Adversarial Detection

abstract: We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametric probability distributions once training is completed. At inference, the likelihoods of the deep features w.r.t the previously learnt distributions are calculated and used to derive uncertainty estimates that can discriminate in-distribution samples from OOD samples. We explore the use of two classes of multivariate distributions for modeling the deep features - Gaussian and Gaussian mixture - and study the trade-off between accuracy and computational complexity. We demonstrate benefits of our approach on image features by detecting OOD images and adversarially-generated images, using popular DNN architectures on MNIST and CIFAR10 datasets. We show that more precise modeling of the feature distributions result in significantly improved detection of OOD and adversarial samples; up to 12 percentage points in AUPR and AUROC metrics. We further show that our approach remains extremely effective when applied to video data and associated spatio-temporal features by detecting adversarial samples on activity classification tasks using UCF101 dataset, and the C3D network. To our knowledge, our methodology is the first one reported for reliably detecting white-box adversarial framing, a state-of-the-art adversarial attack for video classifiers.


title: A Renormalization-Group Study of Interacting Bose-Einstein Condensates: II. Anomalous Dimension $\eta$ for $d\lesssim 4$ at Finite Temperatures

abstract: We study the anomalous dimension $\eta$ of homogeneous interacting single-component Bose-Einstein condensates at finite temperatures for $d\lesssim 4$ dimensions. This $\eta$ is defined in terms of the one-particle density matrix $\rho({\bf r})\equiv \langle \hat\psi^\dagger({\bf r}_1)\hat\psi({\bf r}_1+{\bf r})\rangle$ through its asymptotic behavior $\rho({\bf r})\rightarrow N_{\bf 0}/V+C r^{-d+2-\eta}$ for $r\rightarrow \infty$, where $N_{\bf 0}/V$ is the condensate density and $C$ is a constant. It is shown that the anomalous dimension is given by $\eta=0.181\epsilon^2$ to the leading order in $\epsilon\equiv d-4$. The change of the prefactor $0.181$ from the value $0.02$ at the transition point of the ${\rm O}(2)$ symmetric $\phi^4$ model is attributed to the emergence of three-point vertices and the anomalous Green's function when $N_{\bf 0}$ acquires a finite value.


title: A note on three-fold branched covers of $S^4$

abstract: We show that any 4-manifold admitting a $(g;k_1,k_2,0)$-trisection is an irregular 3-fold cover of the 4-sphere whose branching set is a surface in $S^4$, smoothly embedded except for one singular point which is the cone on a link. A 4-manifold admits such a trisection if and only if it has a handle decomposition with no 1-handles; it is conjectured that all simply-connected 4-manifolds have this property.


title: Asymptotics of eigenvalues of the zero-range perturbation of the discrete bilaplacian

abstract: We consider the family $$ \hat {\bf h}_\mu:=\hat\varDelta\hat \varDelta - \mu \hat {\bf v},\qquad\mu\in\mathbb{R}, $$ of discrete Schr\"odinger-type operators in one-dimensional lattice $\mathbb{Z}$, where $\hat \varDelta$ is the discrete Laplacian and $\hat{\bf v}$ is of zero-range. We prove that for any $\mu\ne0$ the discrete spectrum of $\hat {\bf h}_\mu$ is a singleton $\{e(\mu)\},$ and $e(\mu)<0$ for $\mu>0$ and $e(\mu)>4$ for $\mu<0.$ Moreover, we study the properties of $e(\mu)$ as a function of $\mu,$ in particular, we find the asymptotics of $e(\mu)$ as $\mu\searrow0$ and $\mu\nearrow0.$


title: Residual Networks Behave Like Boosting Algorithms

abstract: We show that Residual Networks (ResNet) is equivalent to boosting feature representation, without any modification to the underlying ResNet training algorithm. A regret bound based on Online Gradient Boosting theory is proved and suggests that ResNet could achieve Online Gradient Boosting regret bounds through neural network architectural changes with the addition of a shrinkage parameter in the identity skip-connections and using residual modules with max-norm bounds. Through this relation between ResNet and Online Boosting, novel feature representation boosting algorithms can be constructed based on altering residual modules. We demonstrate this through proposing decision tree residual modules to construct a new boosted decision tree algorithm and demonstrating generalization error bounds for both approaches; relaxing constraints within BoostResNet algorithm to allow it to be trained in an out-of-core manner. We evaluate convolution ResNet with and without shrinkage modifications to demonstrate its efficacy, and demonstrate that our online boosted decision tree algorithm is comparable to state-of-the-art offline boosted decision tree algorithms without the drawback of offline approaches.


title: Single-modal and Multi-modal False Arrhythmia Alarm Reduction using Attention-based Convolutional and Recurrent Neural Networks

abstract: This study proposes a deep learning model that effectively suppresses the false alarms in the intensive care units (ICUs) without ignoring the true alarms using single- and multimodal biosignals. Most of the current work in the literature are either rule-based methods, requiring prior knowledge of arrhythmia analysis to build rules, or classical machine learning approaches, depending on hand-engineered features. In this work, we apply convolutional neural networks to automatically extract time-invariant features, an attention mechanism to put more emphasis on the important regions of the input segmented signal(s) that are more likely to contribute to an alarm, and long short-term memory units to capture the temporal information presented in the signal segments. We trained our method efficiently using a two-step training algorithm (i.e., pre-training and fine-tuning the proposed network) on the dataset provided by the PhysioNet computing in cardiology challenge 2015. The evaluation results demonstrate that the proposed method obtains better results compared to other existing algorithms for the false alarm reduction task in ICUs. The proposed method achieves a sensitivity of 93.88% and a specificity of 92.05% for the alarm classification, considering three different signals. In addition, our experiments for 5 separate alarm types leads significant results, where we just consider a single-lead ECG (e.g., a sensitivity of 90.71%, a specificity of 88.30%, an AUC of 89.51 for alarm type of Ventricular Tachycardia arrhythmia)


title: The Occupation Kernel Method for Nonlinear System Identification

abstract: This manuscript presents a novel approach to nonlinear system identification leveraging densely defined Liouville operators and a new "kernel" function that represents an integration functional over a reproducing kernel Hilbert space (RKHS) dubbed an occupation kernel. The manuscript thoroughly explores the concept of occupation kernels in the contexts of RKHSs of continuous functions, and establishes Liouville operators over RKHS where several dense domains are found for specific examples of this unbounded operator. The combination of these two concepts allow for the embedding of a dynamical system into a RKHS, where function theoretic tools may be leveraged for the examination of such systems. This framework allows for trajectories of a nonlinear dynamical system to be treated as a fundamental unit of data for nonlinear system identification routine. The approach to nonlinear system identification is demonstrated to identify parameters of a dynamical system accurately, while also exhibiting a certain robustness to noise.


title: MONET: Debiasing Graph Embeddings via the Metadata-Orthogonal Training Unit

abstract: Are Graph Neural Networks (GNNs) fair? In many real world graphs, the formation of edges is related to certain node attributes (e.g. gender, community, reputation). In this case, standard GNNs using these edges will be biased by this information, as it is encoded in the structure of the adjacency matrix itself. In this paper, we show that when metadata is correlated with the formation of node neighborhoods, unsupervised node embedding dimensions learn this metadata. This bias implies an inability to control for important covariates in real-world applications, such as recommendation systems. To solve these issues, we introduce the Metadata-Orthogonal Node Embedding Training (MONET) unit, a general model for debiasing embeddings of nodes in a graph. MONET achieves this by ensuring that the node embeddings are trained on a hyperplane orthogonal to that of the node metadata. This effectively organizes unstructured embedding dimensions into an interpretable topology-only, metadata-only division with no linear interactions. We illustrate the effectiveness of MONET though our experiments on a variety of real world graphs, which shows that our method can learn and remove the effect of arbitrary covariates in tasks such as preventing the leakage of political party affiliation in a blog network, and thwarting the gaming of embedding-based recommendation systems.


title: Markov Chain Monte Carlo Methods for Estimating Systemic Risk Allocations

abstract: We propose a novel framework of estimating systemic risk measures and risk allocations based on Markov chain Monte Carlo (MCMC) methods. We consider a class of allocations whose jth component can be written as some risk measure of the jth conditional marginal loss distribution given the so-called crisis event. By considering a crisis event as an intersection of linear constraints, this class of allocations covers, for example, conditional Value-at-Risk (CoVaR), conditional expected shortfall (CoES), VaR contributions, and range VaR (RVaR) contributions as special cases. For this class of allocations, analytical calculations are rarely available, and numerical computations based on Monte Carlo (MC) methods often provide inefficient estimates due to the rare-event character of the crisis events. We propose an MCMC estimator constructed from a sample path of a Markov chain whose stationary distribution is the conditional distribution given the crisis event. Efficient constructions of Markov chains, such as Hamiltonian Monte Carlo and Gibbs sampler, are suggested and studied depending on the crisis event and the underlying loss distribution. The efficiency of the MCMC estimators is demonstrated in a series of numerical experiments.


title: Data consistency networks for (calibration-less) accelerated parallel MR image reconstruction

abstract: We present simple reconstruction networks for multi-coil data by extending deep cascade of CNN's and exploiting the data consistency layer. In particular, we propose two variants, where one is inspired by POCSENSE and the other is calibration-less. We show that the proposed approaches are competitive relative to the state of the art both quantitatively and qualitatively.


title: Bayesian Pseudo Posterior Mechanism under Asymptotic Differential Privacy

abstract: We propose a Bayesian pseudo posterior mechanism to generate record-level synthetic databases equipped with an $(\epsilon,\delta)-$ probabilistic differential privacy (pDP) guarantee, where $\delta$ denotes the probability that any observed database exceeds $\epsilon$. The pseudo posterior mechanism employs a data record-indexed, risk-based weight vector with weight values $\in [0, 1]$ that surgically downweight the likelihood contributions for high-risk records for model estimation and the generation of record-level synthetic data for public release. The pseudo posterior synthesizer constructs a weight for each data record using the Lipschitz bound for that record under a log-pseudo likelihood utility function that generalizes the exponential mechanism (EM) used to construct a formally private data generating mechanism. By selecting weights to remove likelihood contributions with non-finite log-likelihood values, we guarantee a finite local privacy guarantee for our pseudo posterior mechanism at every sample size. Our results may be applied to \emph{any} synthesizing model envisioned by the data disseminator in a computationally tractable way that only involves estimation of a pseudo posterior distribution for parameters, $\theta$, unlike recent approaches that use naturally-bounded utility functions implemented through the EM. We specify mild conditions that guarantee the asymptotic contraction of $\delta$ to $0$ over the space of databases. We illustrate our pseudo posterior mechanism on the sensitive family income variable from the Consumer Expenditure Surveys database published by the U.S. Bureau of Labor Statistics. We show that utility is better preserved in the synthetic data for our pseudo posterior mechanism as compared to the EM, both estimated using the same non-private synthesizer, due to our use of targeted downweighting.


title: Spatial resolution, noise and information in the computational-imaging era

abstract: Imaging is an important means by which information is gathered regarding the physical world. Spatial resolution and signal-to-noise ratio are underpinning concepts. There is a paucity of rigorous definitions for these quantities, which are general enough to be useful in a broad range of imaging problems, while being also sufficiently specific to enable precise quantitative evaluation of the relevant properties of imaging systems. This is particularly true for many modern forms of imaging that include digital processing of the acquired imaging data as an integral step leading to final images presented to an end-user. Here, both the well-known historical definitions of spatial resolution and some more recent approaches suitable for many forms of modern computational imaging are discussed. An intrinsic duality of spatial resolution and signal-to-noise exists in almost all types of imaging, with the related uncertainty relationship determining a trade-off between the two quantities. Examples are presented with applications to super-resolution imaging, inline holography and ghost imaging.

categories: physics.optics eess.IV physics.app-ph physics.ins-det physics.pop-ph


title: Optimal Safe Controller Synthesis: A Density Function Approach

abstract: This paper considers the synthesis of optimal safe controllers based on density functions. We present an algorithm for robust constrained optimal control synthesis using the duality relationship between the density function and the value function. The density function follows the Liouville equation and is the dual of the value function, which satisfies Bellman's optimality principle. Thanks to density functions, constraints over the distribution of states, such as safety constraints, can be posed straightforwardly in an optimal control problem. The constrained optimal control problem is then solved with a primal-dual algorithm. This formulation is extended to the case with external disturbances, and we show that the robust constrained optimal control can be solved with a modified primal-dual algorithm. We apply this formulation to the problem of finding the optimal safe controller that minimizes the cumulative intervention. An adaptive cruise control (ACC) example is used to demonstrate the efficacy of the proposed, wherein we compare the result of the density function approach with the conventional control barrier function (CBF) method.


title: Manifold Oblique Random Forests: Towards Closing the Gap on Convolutional Deep Networks

abstract: Decision forests (Forests), in particular random forests and gradient boosting trees, have demonstrated state-of-the-art accuracy compared to other methods in many supervised learning scenarios. In particular, Forests dominate other methods in tabular data, that is, when the feature space is unstructured, so that the signal is invariant to a permutation of the feature indices. However, in structured data lying on a manifold (such as images, text, and speech) deep networks (Networks), specifically convolutional deep networks (ConvNets), tend to outperform Forests. We conjecture that at least part of the reason for this is that the input to Networks is not simply the feature magnitudes, but also their indices. In contrast, naive Forest implementations fail to explicitly consider feature indices. A recently proposed Forest approach demonstrates that Forests, for each node, implicitly sample a random matrix from some specific distribution. These Forests, like some classes of Networks, learn by partitioning the feature space into convex polytopes corresponding to linear functions. We build on that approach and show that one can choose distributions in a manifold-aware fashion to incorporate feature locality. We demonstrate the empirical performance on data whose features live on three different manifolds: a torus, images, and time-series. Moreover, we demonstrate its strength in multivariate simulated settings and also show superiority in predicting surgical outcome in epilepsy patients and predicting movement direction from raw stereotactic EEG data from non-motor brain regions. In all simulations and real data, Manifold Oblique Random Forest (MORF) algorithm outperforms approaches that ignore feature space structure and challenges the performance of ConvNets. Moreover, MORF runs fast and maintains interpretability and theoretical justification.


title: Deep Learning for RF Signal Classification in Unknown and Dynamic Spectrum Environments

abstract: Dynamic spectrum access (DSA) benefits from detection and classification of interference sources including in-network users, out-network users, and jammers that may all coexist in a wireless network. We present a deep learning based signal (modulation) classification solution in a realistic wireless network setting, where 1) signal types may change over time; 2) some signal types may be unknown for which there is no training data; 3) signals may be spoofed such as the smart jammers replaying other signal types; and 4) different signal types may be superimposed due to the interference from concurrent transmissions. For case 1, we apply continual learning and train a Convolutional Neural Network (CNN) using an Elastic Weight Consolidation (EWC) based loss. For case 2, we detect unknown signals via outlier detection applied to the outputs of convolutional layers using Minimum Covariance Determinant (MCD) and k-means clustering methods. For case 3, we extend the CNN structure to capture phase shifts due to radio hardware effects to identify the spoofing signal sources. For case 4, we apply blind source separation using Independent Component Analysis (ICA) to separate interfering signals. We utilize the signal classification results in a distributed scheduling protocol, where in-network (secondary) users employ signal classification scores to make channel access decisions and share the spectrum with each other while avoiding interference with out-network (primary) users and jammers. Compared with benchmark TDMA-based schemes, we show that distributed scheduling constructed upon signal classification results provides major improvements to in-network user throughput and out-network user success ratio.


title: Not quite black holes at LIGO

abstract: We provide more evidence of not quite black holes at LIGO. We update and streamline our previous search strategy and apply it to the ten black hole merger events and the one neutron star merger event. The strategy is aimed at the evenly spaced resonance spectrum expected from not quite black holes, given that at low frequencies the radial wave equation describes the modes of a stretched 1D cavity. We describe various indications of the self-consistency of the apparent signals across all events in the context of a simple theoretical model. The merger with the largest final mass, spin and redshift, GW170729, provides additional interesting support.


title: Kojima-1Lb Is a Mildly Cold Neptune around the Brightest Microlensing Host Star

abstract: We report the analysis of additional multiband photometry and spectroscopy and new adaptive optics (AO) imaging of the nearby planetary microlensing event TCP J05074264+2447555 (Kojima-1), which was discovered toward the Galactic anticenter in 2017 (Nucita et al.). We confirm the planetary nature of the light-curve anomaly around the peak while finding no additional planetary feature in this event. We also confirm the presence of apparent blending flux and the absence of significant parallax signal reported in the literature. The AO image reveals no contaminating sources, making it most likely that the blending flux comes from the lens star. The measured multiband lens flux, combined with a constraint from the microlensing model, allows us to narrow down the previously unresolved mass and distance of the lens system. We find that the primary lens is a dwarf on the K/M boundary (0.581 \pm 0.033 M_sun) located at 505 \pm 47 pc and the companion (Kojima-1Lb) is a Neptune-mass planet (20.0 \pm 2.0 M_earth) with a semi-major axis of 1.08 ^{+0.62}_{-0.18} au. This orbit is a few times smaller than those of typical microlensing planets and is comparable to the snow-line location at young ages. We calculate that the a priori detection probability of Kojima-1Lb is only \sim 35%, which may imply that Neptunes are common around the snow line, as recently suggested by the transit and radial velocity techniques. The host star is the brightest among the microlensing planetary systems (Ks = 13.7), offering a great opportunity to spectroscopically characterize this system, even with current facilities.


title: Multipole Analysis of Radio Continuum Images of Supernova Remnants: Comparison of Type Ia and Core Collapse

abstract: A multipole expansion analysis is applied to 1420 MHz radio continuum images of supernova remnants (SNRs) in order to compare Type Ia and core collapse (CC) SNRs. Because the radio synchrotron emission is produced at the outer shock between the SNR and the ISM, we are investigating whether the ISM interaction of SNRs is different between Type Ia and CC SNRs. This is in contrast to previous investigations, which have shown that Type Ia and CC SNRs have different asymmetries in the X-ray emission from their ejecta. The sample consists of 19 SNRs which have been classified as either Type Ia or CC. The quadrupole and octupole moments normalized to their monopole moments (total emission) are used as a measure of asymmetry of the emission. A broad range (by a factor of ~1000) is found for both quadrupole and octupole normalized moments. The strongest correlation we find is that large quadrupole moments are associated with large octupole moments, indicating that both serve as similar indicators of asymmetry. The other correlation we find is that both moments increase with SNR age or radius. This indicates that interstellar medium structure is a strong contributor to asymmetries in the radio emission from SNRs. This does not seem to apply to molecular clouds, because we find that association of a SNR with a molecular cloud is not correlated with larger quadrupole or octupole moments.


title: Function Preserving Projection for Scalable Exploration of High-Dimensional Data

abstract: We present function preserving projections (FPP), a scalable linear projection technique for discovering interpretable relationships in high-dimensional data. Conventional dimension reduction methods aim to maximally preserve the global and/or local geometric structure of a dataset. However, in practice one is often more interested in determining how one or multiple user-selected response function(s) can be explained by the data. To intuitively connect the responses to the data, FPP constructs 2D linear embeddings optimized to reveal interpretable yet potentially non-linear patterns of the response functions. More specifically, FPP is designed to (i) produce human-interpretable embeddings; (ii) capture non-linear relationships; (iii) allow the simultaneous use of multiple response functions; and (iv) scale to millions of samples. Using FPP on real-world datasets, one can obtain fundamentally new insights about high-dimensional relationships in large-scale data that could not be achieved using existing dimension reduction methods.


title: Collective motion of driven semiflexible filaments tuned by soft repulsion and stiffness

abstract: In active matter systems, self-propelled particles can self-organize to undergo collective motion, leading to persistent dynamical behavior out of equilibrium. In cells, cytoskeletal filaments and motor proteins self-organize into complex structures important for cell mechanics, motility, and division. Collective dynamics of cytoskeletal systems can be reconstituted using filament gliding experiments, in which cytoskeletal filaments are propelled by surface-bound motor proteins. These experiments have observed diverse dynamical states, including flocks, polar streams, and single-filament spirals. Recent experiments with microtubules and kinesin motor proteins found that the collective behavior of filaments can be tuned by altering the concentration of the crowding macromolecule methylcellulose in solution. Increasing the methycellulose concentration reduced filament crossing, promoted alignment, and led to a transition from active, isotropically oriented filaments to locally aligned polar streams. This emergence of collective motion is typically explained as an increase in alignment interactions by Vicsek-type models of active polar particles. However, it is not yet understood how steric interactions and bending stiffness modify the collective behavior of active filaments. We use simulations of driven filaments with tunable soft repulsion and rigidity in order to better understand how the interplay between filament flexibility and steric effects can lead to different active dynamic states. We find that increasing filament stiffness decreases the probability of filament alignment, yet increases collective motion and long-range order, in contrast to the assumptions of a Vicsek-type model. In addition to repulsion and driving, tuning filament stiffness can promote collective behavior, and controls the transition between active isotropic filaments, locally aligned flocks, and polar streams.


title: Unit panel nodes detection by CNN on FAST reflector

abstract: The 500-meter Aperture Spherical Radio Telescope(FAST) has an active reflector. During the observation, the reflector will be deformed into a paraboloid of 300-meters. To improve its surface accuracy, we propose a scheme for photogrammetry to measure the positions of 2226 nodes on the reflector. And the way to detect the nodes in the photos is the key problem in photogrammetry. This paper applies Convolutional Neural Network(CNN) with candidate regions to detect the nodes in the photos. The experiment results show a high recognition rate of 91.5%, which is much higher than the recognition rate of traditional edge detection.


title: Planet and star synergy at high spectral resolution. A rationale for the characterisation of exoplanet atmospheres. I. The Infrared

abstract: Context. Spectroscopy of exoplanet atmospheres at high resolving powers is rapidly gaining popularity to measure the presence of atomic and molecular species. While this technique is robust against contaminant absorption in the Earth's atmosphere, the non stationary stellar spectrum creates a non-negligible source of noise that can alter or even prevent detection. Aims. We aim at using three-dimensional stellar simulations to directly remove the signature of the star from observations, and prior to cross correlation with templates for the planet's atmosphere Methods. We compute synthetic spectra from 3D simulations of stellar convection and we couple them with an analytical model reproducing the correct geometry of a transiting exoplanet. We apply the method to HD 189733, and analyse transmission and emission spectroscopy of its hosted exoplanet. In addition, we analyse emission spectroscopy of the non transiting exoplanet 51 Pegasi b. Results. We find a significant improvement in the planet detectability when removing the stellar spectrum with our method. We show that the method is superior to a simple parametrisation of the stellar line profile or to the use of one-dimensional stellar models. This is due to the intrinsic treatment of convection, which allows us to correctly reproduce asymmetric spectral lines, and model center-to-limb variation and Rossiter-McLaughlin effect. In the case of 51 Pegasi b, we succeed at confirming a previous tentative detection of the planet's K-band spectrum due to the improved suppression of stellar residuals. Future high-resolution observations will benefit from the synergy with stellar spectroscopy, and can be used to test the correct modelling of physical processes in stellar atmospheres. We highlight key improvements in modelling techniques and knowledge of opacity sources to extend this work to shorter wavelengths and later-type stars.


title: Simultaneous core partitions with nontrivial common divisor

abstract: A tremendous amount of research has been done in the last two decades on $(s,t)$-core partitions when $s$ and $t$ are positive integers with no common divisor. Here we change perspective slightly and explore properties of $(s,t)$-core and $(\bar{s},\bar{t})$-core partitions for $s$ and $t$ with nontrivial common divisor $g$. We begin by revisiting work by D. Aukerman, D. Kane and L. Sze on $(s,t)$-core partitions for nontrivial $g$ before obtaining a generating function for the number of $(\bar{s},\bar{t})$-core partitions of $n$ under the same conditions. Our approach, using the $g$-core, $g$-quotient and bar-analogues, allows for new results on $t$-cores and self-conjugate $t$-cores that are {\it not} $g$-cores and $\bar{t}$-cores that are {\it not} $\bar{g}$-cores, thus strengthening positivity results of K. Ono and A. Granville, J. Baldwin et. al., and I. Kiming. We then detail a new bijection between self-conjugate $(s,t)$-core and $(\bar{s},\bar{t})$-core partitions for $s$ and $t$ odd with odd, nontrivial common divisor $g$. Here the core-quotient construction fits remarkably well with certain lattice-path labelings due to B. Ford, H. Mai, and L. Sze and C. Bessenrodt and J. Olsson. Along the way we give a new proof of a correspondence of J. Yang between self-conjugate $t$-core and $\bar{t}$-core partitions when $t$ is odd and positive. We end by noting $(s,t)$-core and $(\bar{s}, \bar{t})$-core partitions inherit Ramanujan-type congruences from those of $g$-core and $\bar{g}$-core partitions.


title: Rheology of active polar emulsions: from linear to unidirectional and unviscid flow, and intermittent viscosity

abstract: The rheological behaviour of an emulsion made of an active polar component and an isotropic passive fluid is studied by lattice Boltzmann methods. Different flow regimes are found by varying the values of shear rate and extensile activity (occurring, e.g., in microtubule-motor suspensions). By increasing activity, a first transition occurs from linear flow regime to spontaneous persistent unidirectional macro-scale flow, followed by another transition either to (low shear) intermittent flow regime with coexistence of states with positive, negative, and vanishing apparent viscosity, or to (high shear) symmetric shear thinning regime. The different behaviours can be explained in terms of the dynamics of the polarization field close to the walls. A maximum entropy production principle selects the most likely states in the intermittent regime.


title: Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation Systems

abstract: Embedding representations power machine intelligence in many applications, including recommendation systems, but they are space intensive -- potentially occupying hundreds of gigabytes in large-scale settings. To help manage this outsized memory consumption, we explore mixed dimension embeddings, an embedding layer architecture in which a particular embedding vector's dimension scales with its query frequency. Through theoretical analysis and systematic experiments, we demonstrate that using mixed dimensions can drastically reduce the memory usage, while maintaining and even improving the ML performance. Empirically, we show that the proposed mixed dimension layers improve accuracy by 0.1% using half as many parameters or maintain it using 16X fewer parameters for click-through rate prediction task on the Criteo Kaggle dataset.


title: A fast, complete, point cloud based loop closure for LiDAR odometry and mapping

abstract: This paper presents a loop closure method to correct the long-term drift in LiDAR odometry and mapping (LOAM). Our proposed method computes the 2D histogram of keyframes, a local map patch, and uses the normalized cross-correlation of the 2D histograms as the similarity metric between the current keyframe and those in the map. We show that this method is fast, invariant to rotation, and produces reliable and accurate loop detection. The proposed method is implemented with careful engineering and integrated into the LOAM algorithm, forming a complete and practical system ready to use. To benefit the community by serving a benchmark for loop closure, the entire system is made open source on Github


title: Differential Privacy for Evolving Almost-Periodic Datasets with Continual Linear Queries: Application to Energy Data Privacy

abstract: For evolving datasets with continual reports, the composition rule for differential privacy (DP) dictates that the scale of DP noise must grow linearly with the number of the queries, or that the privacy budget must be split equally between all the queries, so that the privacy budget across all the queries remains bounded and consistent with the privacy guarantees. To avoid this drawback of DP, we consider datasets containing almost periodic time series, composed of periodic components and noisy variations on top that are independent across periods. Our interest in these datasets is motivated by that, for reporting on private periodic time series, we do not need to divide the privacy budget across the entire, possibly infinite, horizon. Instead, for periodic time series, we generate DP reports for the first period and report the same DP reports periodically. In practice, however, exactly periodic time series do not exist as the data always contains small variations due to random or uncertain events. For instance, the energy consumption of a household may repeat the same daily pattern with slight variations due to minor changes to the habits of the individuals. The underlying periodic pattern is a function of the private information of the households. It might be desired to protect the privacy of households by not leaking information about the recurring patterns while the individual daily variations are almost noise-like with little to no privacy concerns (depending on the situation). Motivated by this, we define DP for almost periodic datasets and develop a Laplace mechanism for responding to linear queries. We provide statistical tools for testing the validity of almost periodicity assumption. We use multiple energy datasets containing smart-meter measurements of households to validate almost periodicity assumption. We generate DP aggregate reports and investigate their utility.

categories: cs.CR cs.IT cs.SY eess.SY math.IT math.OC


title: LAVAE: Disentangling Location and Appearance

abstract: We propose a probabilistic generative model for unsupervised learning of structured, interpretable, object-based representations of visual scenes. We use amortized variational inference to train the generative model end-to-end. The learned representations of object location and appearance are fully disentangled, and objects are represented independently of each other in the latent space. Unlike previous approaches that disentangle location and appearance, ours generalizes seamlessly to scenes with many more objects than encountered in the training regime. We evaluate the proposed model on multi-MNIST and multi-dSprites data sets.


title: Duality of Lusztig and RTT integral forms of $U_v(L\mathfrak{sl}_n)$

abstract: We show that the Lusztig integral form is dual to the RTT integral form of the type A quantum loop algebra with respect to the new Drinfeld pairing, by utilizing the shuffle algebra realization of the former and the PBWD bases of the latter obtained in arXiv:1808.09536.


title: Coarse geometry and Callias quantisation

abstract: Consider a proper, isometric action by a unimodular, locally compact group $G$ on a complete Riemannian manifold $M$. For equivariant elliptic operators that are invertible outside a cocompact subset of $M$, we show that a localised index in the $K$-theory of the maximal group $C^*$-algebra of $G$ is well-defined. The approach is based on the use of maximal versions of equivariant localised Roe algebras, and many of the technical arguments in this paper are used to handle the ways in which they differ from their reduced versions. By using the maximal group $C^*$-algebra instead of its reduced counterpart, we can apply the trace given by integration over $G$ to recover an index defined earlier by the last two authors, and developed further by Braverman, in terms of sections invariant under the group action. As a very special case, this allows one to refine numerical obstructions to positive scalar curvature on a noncompact $\operatorname{Spin}$ manifold $X$ defined via Callias index theory, to obstructions in the $K$-theory of the maximal $C^*$-algebra of the fundamental group $\pi_1(X)$. As a motivating application in another direction, we prove a version of Guillemin and Sternberg's quantisation commutes with reduction principle for equivariant indices of $\operatorname{Spin}^c$ Callias-type operators.


title: Determination of properties of protoneutron stars toward black hole formation via gravitational wave observations

abstract: We examine the frequencies of the fundamental ($f$-) and the gravity ($g_i$-) mode in gravitational waves from accreting protoneutron stars (PNSs) toward black hole formation. For this purpose, we analyze numerical results of gravitational collapse of massive stars for two different progenitors with three equations of state. We adopt profiles of central objects obtained from the numerical simulations by solving general relativistic neutrino-radiation hydrodynamics under the spherical symmetry. Using a series of snapshots as a static configuration at each time step, we solve the eigenvalue problem to determine the specific frequencies of gravitational waves from the evolving PNSs with accretion from core bounce to black hole formation by the relativistic Cowling approximation. We find that the frequency of the $f$-mode gravitational waves can be expressed as a function of the average density of the PNS at each time step almost independently of the progenitor models in accord with the previous studies on ordinary PNSs. We also find that the ratio of the $g_1$-mode frequency to the $f$-mode frequency is insensitive to the progenitor, but strongly depends on the compactness of the PNSs. Having a simultaneous observation of the $f$- and $g_1$-mode gravitational waves, it would provide the information of the average density and compactness of PNS, which can reconstruct the evolution of mass and radius of the PNSs as a constraint on the equation of state at high densities. Furthermore, we show that the highest average density of the PNS with the maximum mass can be estimated with the detection of the $f$-mode gravitational waves together with the help of the neutrino observations.


title: Generating Fault-Tolerant Cluster States from Crystal Structures

abstract: Measurement-based quantum computing (MBQC) is a promising alternative to traditional circuit-based quantum computing predicated on the construction and measurement of cluster states. Recent work has demonstrated that MBQC provides a more general framework for fault-tolerance that extends beyond foliated quantum error-correcting codes. We systematically expand on that paradigm, and use combinatorial tiling theory to study and construct new examples of fault-tolerant cluster states derived from crystal structures. Included among these is a robust self-dual cluster state requiring only degree-3 connectivity. We benchmark several of these cluster states in the presence of circuit-level noise, and find a variety of promising candidates whose performance depends on the specifics of the noise model. By eschewing the distinction between data and ancilla, this malleable framework lays a foundation for the development of creative and competitive fault-tolerance schemes beyond conventional error-correcting codes.


title: The VHE SED modelling of Markarian 501 in 2009

abstract: The high energy blazar, Markarian 501 was observed as a part of multi-instrument and multiwavelength campaign spanning the whole electromagnetic spectrum for 4.5 months during March 15 to August 1, 2009. On May 1, Whipple 10m telescope observed a very strong $\gamma$-ray flare in a time interval of about 0.5 h. Apart from this flare, high state and low state emissions were also observed by Whipple, VERITAS and MAGIC telescopes. Using the photohadronic model and accounting for the absorption of the extragalactic background light (EBL) to these very high energy $\gamma$-rays, excellent fits are obtained for the observed spectra. We have shown that the intrinsic spectrum for low state emission is flat, however, for high and very high states this is a power-law with slowly increasing exponent.


title: Optimal Tolling for Heterogeneous Traffic Networks with Mixed Autonomy

abstract: When people pick routes to minimize their travel time, the total experienced delay, or social cost, may be significantly greater than if people followed routes assigned to them by a social planner. This effect is accentuated when human drivers share roads with autonomous vehicles. When routed optimally, autonomous vehicles can make traffic networks more efficient, but when acting selfishly, the introduction of autonomous vehicles can actually worsen congestion. We seek to mitigate this effect by influencing routing choices via tolling. We consider a network of parallel roads with affine latency functions that are heterogeneous, meaning that the increase in capacity due to to the presence of autonomous vehicles may vary from road to road. We show that if human drivers and autonomous users have the same tolls, the social cost may be arbitrarily worse than when optimally routed. We then prove qualities of the optimal routing and use them to design tolls that are guaranteed to minimize social cost at equilibrium. To the best of our knowledge, this is the first tolling scheme that yields a unique socially optimal equilibrium for parallel heterogeneous network with affine latency functions.


title: A Mean-Field Theory for Kernel Alignment with Random Features in Generative and Discriminative Models

abstract: We propose a novel supervised learning method to optimize the kernel in the maximum mean discrepancy generative adversarial networks (MMD GANs), and the kernel support vector machines (SVMs). Specifically, we characterize a distributionally robust optimization problem to compute a good distribution for the random feature model of Rahimi and Recht. Due to the fact that the distributional optimization is infinite dimensional, we consider a Monte-Carlo sample average approximation (SAA) to obtain a more tractable finite dimensional optimization problem. We subsequently leverage a particle stochastic gradient descent (SGD) method to solve the derived finite dimensional optimization problem. Based on a mean-field analysis, we then prove that the empirical distribution of the interactive particles system at each iteration of the SGD follows the path of the gradient descent flow on the Wasserstein manifold. We also establish the non-asymptotic consistency of the finite sample estimator. We evaluate our kernel learning method for the hypothesis testing problem by evaluating the kernel MMD statistics, and show that our learning method indeed attains better power of the test for larger threshold values compared to an untrained kernel. Moreover, our empirical evaluation on benchmark data-sets shows the advantage of our kernel learning approach compared to alternative kernel learning methods.


title: Model Imitation for Model-Based Reinforcement Learning

abstract: Model-based reinforcement learning (MBRL) aims to learn a dynamic model to reduce the number of interactions with real-world environments. However, due to estimation error, rollouts in the learned model, especially those of long horizons, fail to match the ones in real-world environments. This mismatching has seriously impacted the sample complexity of MBRL. The phenomenon can be attributed to the fact that previous works employ supervised learning to learn the one-step transition models, which has inherent difficulty ensuring the matching of distributions from multi-step rollouts. Based on the claim, we propose to learn the transition model by matching the distributions of multi-step rollouts sampled from the transition model and the real ones via WGAN. We theoretically show that matching the two can minimize the difference of cumulative rewards between the real transition and the learned one. Our experiments also show that the proposed Model Imitation method can compete or outperform the state-of-the-art in terms of sample complexity and average return.


title: DisCo: Physics-Based Unsupervised Discovery of Coherent Structures in Spatiotemporal Systems

abstract: Extracting actionable insight from complex unlabeled scientific data is an open challenge and key to unlocking data-driven discovery in science. Complementary and alternative to supervised machine learning approaches, unsupervised physics-based methods based on behavior-driven theories hold great promise. Due to computational limitations, practical application on real-world domain science problems has lagged far behind theoretical development. We present our first step towards bridging this divide - DisCo - a high-performance distributed workflow for the behavior-driven local causal state theory. DisCo provides a scalable unsupervised physics-based representation learning method that decomposes spatiotemporal systems into their structurally relevant components, which are captured by the latent local causal state variables. Complex spatiotemporal systems are generally highly structured and organize around a lower-dimensional skeleton of coherent structures, and in several firsts we demonstrate the efficacy of DisCo in capturing such structures from observational and simulated scientific data. To the best of our knowledge, DisCo is also the first application software developed entirely in Python to scale to over 1000 machine nodes, providing good performance along with ensuring domain scientists' productivity. We developed scalable, performant methods optimized for Intel many-core processors that will be upstreamed to open-source Python library packages. Our capstone experiment, using newly developed DisCo workflow and libraries, performs unsupervised spacetime segmentation analysis of CAM5.1 climate simulation data, processing an unprecedented 89.5 TB in 6.6 minutes end-to-end using 1024 Intel Haswell nodes on the Cori supercomputer obtaining 91% weak-scaling and 64% strong-scaling efficiency.


title: Distributed Control of Linear Multi-Channel Systems

abstract: A solution is given to the basic distributed feedback control problem for a multi-channel linear system assuming only that the system is jointly controllable, jointly observable and has an associated neighbor graph which is strongly connected. The solution is an observer-based control system which is implemented in a distributed manner. Using these ideas, a solution is also given to the distributed set-point control problem for a multi-channel linear system in which each and every agent with access to the system is able to independently adjust its controlled output to any desired set-point value. An example is given to briefly illustrate how network transmission delays might be dealt with.


title: Pre-train, Interact, Fine-tune: A Novel Interaction Representation for Text Classification

abstract: Text representation can aid machines in understanding text. Previous work on text representation often focuses on the so-called forward implication, i.e., preceding words are taken as the context of later words for creating representations, thus ignoring the fact that the semantics of a text segment is a product of the mutual implication of words in the text: later words contribute to the meaning of preceding words. We introduce the concept of interaction and propose a two-perspective interaction representation, that encapsulates a local and a global interaction representation. Here, a local interaction representation is one that interacts among words with parent-children relationships on the syntactic trees and a global interaction interpretation is one that interacts among all the words in a sentence. We combine the two interaction representations to develop a Hybrid Interaction Representation (HIR). Inspired by existing feature-based and fine-tuning-based pretrain-finetuning approaches to language models, we integrate the advantages of feature-based and fine-tuning-based methods to propose the Pre-train, Interact, Fine-tune (PIF) architecture. We evaluate our proposed models on five widely-used datasets for text classification tasks. Our ensemble method, outperforms state-of-the-art baselines with improvements ranging from 2.03% to 3.15% in terms of error rate. In addition, we find that, the improvements of PIF against most state-of-the-art methods is not affected by increasing of the length of the text.


title: Unsupervised Domain Adaptation through Self-Supervision

abstract: This paper addresses unsupervised domain adaptation, the setting where labeled training data is available on a source domain, but the goal is to have good performance on a target domain with only unlabeled data. Like much of previous work, we seek to align the learned representations of the source and target domains while preserving discriminability. The way we accomplish alignment is by learning to perform auxiliary self-supervised task(s) on both domains simultaneously. Each self-supervised task brings the two domains closer together along the direction relevant to that task. Training this jointly with the main task classifier on the source domain is shown to successfully generalize to the unlabeled target domain. The presented objective is straightforward to implement and easy to optimize. We achieve state-of-the-art results on four out of seven standard benchmarks, and competitive results on segmentation adaptation. We also demonstrate that our method composes well with another popular pixel-level adaptation method.