title: Private Knowledge Transfer via Model Distillation with Generative Adversarial Networks

abstract: The deployment of deep learning applications has to address the growing privacy concerns when using private and sensitive data for training. A conventional deep learning model is prone to privacy attacks that can recover the sensitive information of individuals from either model parameters or accesses to the target model. Recently, differential privacy that offers provable privacy guarantees has been proposed to train neural networks in a privacy-preserving manner to protect training data. However, many approaches tend to provide the worst case privacy guarantees for model publishing, inevitably impairing the accuracy of the trained models. In this paper, we present a novel private knowledge transfer strategy, where the private teacher trained on sensitive data is not publicly accessible but teaches a student to be publicly released. In particular, a three-player (teacher-student-discriminator) learning framework is proposed to achieve trade-off between utility and privacy, where the student acquires the distilled knowledge from the teacher and is trained with the discriminator to generate similar outputs as the teacher. We then integrate a differential privacy protection mechanism into the learning procedure, which enables a rigorous privacy budget for the training. The framework eventually allows student to be trained with only unlabelled public data and very few epochs, and hence prevents the exposure of sensitive training data, while ensuring model utility with a modest privacy budget. The experiments on MNIST, SVHN and CIFAR-10 datasets show that our students obtain the accuracy losses w.r.t teachers of 0.89%, 2.29%, 5.16%, respectively with the privacy bounds of (1.93, 10^-5), (5.02, 10^-6), (8.81, 10^-6). When compared with the existing works \cite{papernot2016semi,wang2019private}, the proposed work can achieve 5-82% accuracy loss improvement.


title: Nonnegativity-Enforced Gaussian Process Regression

abstract: Gaussian Process (GP) regression is a flexible non-parametric approach to approximate complex models. In many cases, these models correspond to processes with bounded physical properties. Standard GP regression typically results in a proxy model which is unbounded for all temporal or spacial points, and thus leaves the possibility of taking on infeasible values. We propose an approach to enforce the physical constraints in a probabilistic way under the GP regression framework. In addition, this new approach reduces the variance in the resulting GP model.


title: Parallel/distributed implementation of cellular training for generative adversarial neural networks

abstract: Generative adversarial networks (GANs) are widely used to learn generative models. GANs consist of two networks, a generator and a discriminator, that apply adversarial learning to optimize their parameters. This article presents a parallel/distributed implementation of a cellular competitive coevolutionary method to train two populations of GANs. A distributed memory parallel implementation is proposed for execution in high performance/supercomputing centers. Efficient results are reported on addressing the generation of handwritten digits (MNIST dataset samples). Moreover, the proposed implementation is able to reduce the training times and scale properly when considering different grid sizes for training.


title: TuiGAN: Learning Versatile Image-to-Image Translation with Two Unpaired Images

abstract: An unsupervised image-to-image translation (UI2I) task deals with learning a mapping between two domains without paired images. While existing UI2I methods usually require numerous unpaired images from different domains for training, there are many scenarios where training data is quite limited. In this paper, we argue that even if each domain contains a single image, UI2I can still be achieved. To this end, we propose TuiGAN, a generative model that is trained on only two unpaired images and amounts to one-shot unsupervised learning. With TuiGAN, an image is translated in a coarse-to-fine manner where the generated image is gradually refined from global structures to local details. We conduct extensive experiments to verify that our versatile method can outperform strong baselines on a wide variety of UI2I tasks. Moreover, TuiGAN is capable of achieving comparable performance with the state-of-the-art UI2I models trained with sufficient data.


title: Graph Highway Networks

abstract: Graph Convolution Networks (GCN) are widely used in learning graph representations due to their effectiveness and efficiency. However, they suffer from the notorious over-smoothing problem, in which the learned representations of densely connected nodes converge to alike vectors when many (>3) graph convolutional layers are stacked. In this paper, we argue that there-normalization trick used in GCN leads to overly homogeneous information propagation, which is the source of over-smoothing. To address this problem, we propose Graph Highway Networks(GHNet) which utilize gating units to automatically balance the trade-off between homogeneity and heterogeneity in the GCN learning process. The gating units serve as direct highways to maintain heterogeneous information from the node itself after feature propagation. This design enables GHNet to achieve much larger receptive fields per node without over-smoothing and thus access to more of the graph connectivity information. Experimental results on benchmark datasets demonstrate the superior performance of GHNet over GCN and related models.


title: Nonparametric Bayesian inference of discretely observed diffusions

abstract: We consider the problem of the Bayesian inference of drift and diffusion coefficient functions in a stochastic differential equation given discrete observations of a realisation of its solution. We give conditions for the well-posedness and stable approximations of the posterior measure. These conditions in particular allow for priors with unbounded support. Our proof relies on the explicit construction of transition probability densities using the parametrix method for general parabolic equations. We then study an application of these results in inferring the rates of Birth-and-Death processes.


title: Bergman metric on the symmetrized bidisc and its consequences

abstract: On the symmetrized bidisc G2 with the Bergman metric, the holomorphic sectional curvature is negatively pinched and the holomorphic bisectional curvature is not. The consequences in invariant metrics are provided.


title: On the convexity number of the complementary prism of a tree

abstract: A set of vertices $S$ of a graph $G$ is a (geodesic)convex set, if $S$ contains all the vertices belonging to any shortest path connecting between two vertices of $S$. The cardinality of maximum proper convex set of $G$ is called the convexity number, con$(G)$ of $G$. The complementary prism $G\bar{G}$ of $G$ is obtained from the disjoint union of $G$ and its complement $\bar{G}$ by adding the edges of a perfect matching between them. In this work, we examine the convex sets of the complementary prism of a tree and derive formulas for the convexity numbers of the complementary prisms of all trees.


title: Double photoionization of propylene oxide: a coincidence study of the ejection of a pair of valence-shell electrons

abstract: Propylene oxide, a favorite target of experimental and theoretical studies of circular dichroism, was recently discovered in interstellar space, further amplifying the attention to its role in the current debate on protobiological homochirality. In the present work, a photoelectron-photoion-photoion coincidence technique, using an ion-imaging detector and tunable synchrotron radiation in the 18.0-37.0 eV energy range, permits: (i)-to observe six double-ionization fragmentation channels, their relative yields being accounted for about two-thirds by the couple (C2H4+, CH2O+), one-fifth by (C2H3+, CH3O+); (ii)-to measure thresholds for their openings as a function of photon energy; (iii)-to unravel a pronounced bimodality for a kinetic-energy-released distribution, fingerprint of competitive non-adiabatic mechanisms.


title: Minimizing Age-of-Information for Fog Computing-supported Vehicular Networks with Deep Q-learning

abstract: Connected vehicular network is one of the key enablers for next generation cloud/fog-supported autonomous driving vehicles. Most connected vehicular applications require frequent status updates and Age of Information (AoI) is a more relevant metric to evaluate the performance of wireless links between vehicles and cloud/fog servers. This paper introduces a novel proactive and data-driven approach to optimize the driving route with a main objective of guaranteeing the confidence of AoI. In particular, we report a study on three month measurements of a multi-vehicle campus shuttle system connected to cloud/fog servers via a commercial LTE network. We establish empirical models for AoI in connected vehicles and investigate the impact of major factors on the performance of AoI. We also propose a Deep Q-Learning Netwrok (DQN)-based algorithm to decide the optimal driving route for each connected vehicle with maximized confidence level. Numerical results show that the proposed approach can lead to a significant improvement on the AoI confidence for various types of services supported.


title: CNN2Gate: Toward Designing a General Framework for Implementation of Convolutional Neural Networks on FPGA

abstract: Convolutional Neural Networks (CNNs) have a major impact on our society because of the numerous services they provide. On the other hand, they require considerable computing power. To satisfy these requirements, it is possible to use graphic processing units (GPUs). However, high power consumption and limited external IOs constrain their usability and suitability in industrial and mission-critical scenarios. Recently, the number of researches that utilize FPGAs to implement CNNs are increasing rapidly. This is due to the lower power consumption and easy reconfigurability offered by these platforms. Because of the research efforts put into topics such as architecture, synthesis and optimization, some new challenges are arising to integrate such hardware solutions to high-level machine learning software libraries. This paper introduces an integrated framework (CNN2Gate) that supports compilation of a CNN model for an FPGA target. CNN2Gate exploits the OpenCL synthesis workflow for FPGAs offered by commercial vendors. CNN2Gate is capable of parsing CNN models from several popular high-level machine learning libraries such as Keras, Pytorch, Caffe2 etc. CNN2Gate extracts computation flow of layers, in addition to weights and biases and applies a "given" fixed-point quantization. Furthermore, it writes this information in the proper format for OpenCL synthesis tools that are then used to build and run the project on FPGA. CNN2Gate performs design-space exploration using a reinforcement learning agent and fits the design on different FPGAs with limited logic resources automatically. This paper reports results of automatic synthesis and design-space exploration of AlexNet and VGG-16 on various Intel FPGA platforms. CNN2Gate achieves a latency of 205 ms for VGG-16 and 18 ms for AlexNet on the FPGA.


title: Data Dieting in GAN Training

abstract: We investigate training Generative Adversarial Networks, GANs, with less data. Subsets of the training dataset can express empirical sample diversity while reducing training resource requirements, e.g. time and memory. We ask how much data reduction impacts generator performance and gauge the additive value of generator ensembles. In addition to considering stand-alone GAN training and ensembles of generator models, we also consider reduced data training on an evolutionary GAN training framework named Redux-Lipizzaner. Redux-Lipizzaner makes GAN training more robust and accurate by exploiting overlapping neighborhood-based training on a spatial 2D grid. We conduct empirical experiments on Redux-Lipizzaner using the MNIST and CelebA data sets.


title: Exploring Extended Reality with ILLIXR: A New Playground for Architecture Research

abstract: As we enter the era of domain-specific architectures, systems researchers must understand the requirements of emerging application domains. Augmented and virtual reality (AR/VR) or extended reality (XR) is one such important domain. This paper presents ILLIXR, the first open source end-to-end XR system (1) with state-of-the-art components, (2) integrated with a modular and extensible multithreaded runtime, (3) providing an OpenXR compliant interface to XR applications (e.g., game engines), and (4) with the ability to report (and trade off) several quality of experience (QoE) metrics. We analyze performance, power, and QoE metrics for the complete ILLIXR system and for its individual components. Our analysis reveals several properties with implications for architecture and systems research. These include demanding performance, power, and QoE requirements, a large diversity of critical tasks, inter-dependent execution pipelines with challenges in scheduling and resource management, and a large tradeoff space between performance/power and human perception related QoE metrics. ILLIXR and our analysis have the potential to propel new directions in architecture and systems research in general, and impact XR in particular. ILLIXR is open-source and available at https://illixr.github.io


title: On the Ethics of Building AI in a Responsible Manner

abstract: The AI-alignment problem arises when there is a discrepancy between the goals that a human designer specifies to an AI learner and a potential catastrophic outcome that does not reflect what the human designer really wants. We argue that a formalism of AI alignment that does not distinguish between strategic and agnostic misalignments is not useful, as it deems all technology as un-safe. We propose a definition of a strategic-AI-alignment and prove that most machine learning algorithms that are being used in practice today do not suffer from the strategic-AI-alignment problem. However, without being careful, today's technology might lead to strategic misalignment.


title: Query-Focused EHR Summarization to Aid Imaging Diagnosis

abstract: Electronic Health Records (EHRs) provide vital contextual information to radiologists and other physicians when making a diagnosis. Unfortunately, because a given patient's record may contain hundreds of notes and reports, identifying relevant information within these in the short time typically allotted to a case is very difficult. We propose and evaluate models that extract relevant text snippets from patient records to provide a rough case summary intended to aid physicians considering one or more diagnoses. This is hard because direct supervision (i.e., physician annotations of snippets relevant to specific diagnoses in medical records) is prohibitively expensive to collect at scale. We propose a distantly supervised strategy in which we use groups of International Classification of Diseases (ICD) codes observed in 'future' records as noisy proxies for 'downstream' diagnoses. Using this we train a transformer-based neural model to perform extractive summarization conditioned on potential diagnoses. This model defines an attention mechanism that is conditioned on potential diagnoses (queries) provided by the diagnosing physician. We train (via distant supervision) and evaluate variants of this model on EHR data from Brigham and Women's Hospital in Boston and MIMIC-III (the latter to facilitate reproducibility). Evaluations performed by radiologists demonstrate that these distantly supervised models yield better extractive summaries than do unsupervised approaches. Such models may aid diagnosis by identifying sentences in past patient reports that are clinically relevant to a potential diagnosis.


title: A formalism for magnon gravitational wave detectors

abstract: In order to detect high frequency gravitational waves, we need a new detection method. In this paper, we develop a formalism for a gravitational wave detector using magnons in a cavity. Using Fermi normal coordinates and taking the non-relativistic limit, we obtain a Hamiltonian for magnons in gravitational wave backgrounds. Given the Hamiltonian, we show how to use the magnons for detecting high frequency gravitational waves. Furthermore, as a demonstration of the magnon gravitational wave detector, we give upper limits on GHz gravitational waves by utilizing known results of magnon experiments for an axion dark matter search.


title: Adversarial Genetic Programming for Cyber Security: A Rising Application Domain Where GP Matters

abstract: Cyber security adversaries and engagements are ubiquitous and ceaseless. We delineate Adversarial Genetic Programming for Cyber Security, a research topic that, by means of genetic programming (GP), replicates and studies the behavior of cyber adversaries and the dynamics of their engagements. Adversarial Genetic Programming for Cyber Security encompasses extant and immediate research efforts in a vital problem domain, arguably occupying a position at the frontier where GP matters. Additionally, it prompts research questions around evolving complex behavior by expressing different abstractions with GP and opportunities to reconnect to the Machine Learning, Artificial Life, Agent-Based Modeling and Cyber Security communities. We present a framework called RIVALS which supports the study of network security arms races. Its goal is to elucidate the dynamics of cyber networks under attack by computationally modeling and simulating them.


title: Characterization of classes of graphs with large general position number

abstract: Getting inspired by the famous no-three-in-line problem and by the general position subset selection problem from discrete geometry, the same is introduced into graph theory as follows. A set $S$ of vertices in a graph $G$ is a general position set if no element of $S$ lies on a geodesic between any two other elements of $S$. The cardinality of a largest general position set is the general position number ${\rm gp}(G)$ of $G.$ In \cite{ullas-2016} graphs $G$ of order $n$ with ${\rm gp}(G)$ $\in \{2, n, n-1\}$ were characterized. In this paper, we characterize the classes of all connected graphs of order $n\geq 4$ with the general position number $n-2.$


title: A Mathematical Model of Local and Global Attention in Natural Scene Viewing

abstract: Understanding the decision process underlying gaze control is an important question in cognitive neuroscience with applications in diverse fields ranging from psychology to computer vision. The decision for choosing an upcoming saccade target can be framed as a selection process between two states: Should the observer further inspect the information near the current gaze position (local attention) or continue with exploration of other patches of the given scene (global attention)? Here we propose and investigate a mathematical model motivated by switching between these two attentional states during scene viewing. The model is derived from a minimal set of assumptions that generates realistic eye movement behavior. We implemented a Bayesian approach for model parameter inference based on the model's likelihood function. In order to simplify the inference, we applied data augmentation methods that allowed the use of conjugate priors and the construction of an efficient Gibbs sampler. This approach turned out to be numerically efficient and permitted fitting interindividual differences in saccade statistics. Thus, the main contribution of our modeling approach is two--fold; first, we propose a new model for saccade generation in scene viewing. Second, we demonstrate the use of novel methods from Bayesian inference in the field of scan path modeling.


title: State-Only Imitation Learning for Dexterous Manipulation

abstract: Modern model-free reinforcement learning methods have recently demonstrated impressive results on a number of problems. However, complex domains like dexterous manipulation remain a challenge due to the high sample complexity. To address this, current approaches employ expert demonstrations in the form of state-action pairs, which are difficult to obtain for real-world settings such as learning from videos. In this paper, we move toward a more realistic setting and explore state-only imitation learning. To tackle this setting, we train an inverse dynamics model and use it to predict actions for state-only demonstrations. The inverse dynamics model and the policy are trained jointly. Our method performs on par with state-action approaches and considerably outperforms RL alone. By not relying on expert actions, we are able to learn from demonstrations with different dynamics, morphologies, and objects. Videos available at https://people.eecs.berkeley.edu/~ilija/soil .


title: Malle's Conjecture for $G \times A$, with $G = S_3, S_4, S_5$

abstract: We prove Malle's conjecture for $G \times A$, with $G=S_3, S_4, S_5$ and $A$ an abelian group. This builds upon work of the fourth author, who proved this result with restrictions on the primes dividing $A$.


title: The nodal set of solutions to some nonlocal sublinear problems

abstract: We study the nodal set of solutions to equations of the form $$ (-\Delta)^s u = \lambda_+ (u_+)^{q-1} - \lambda_- (u_-)^{q-1}\quad\text{in $B_1$}, $$ where $\lambda_+,\lambda_->0, q \in [1,2)$, and $u_+$ and $u_-$ are respectively the positive and negative part of $u$. This collection of nonlinearities includes the unstable two-phase membrane problem $q=1$ as well as sublinear equations for $1<q<2$. We initially prove the validity of the strong unique continuation property and the finiteness of the vanishing order, in order to implement a blow-up analysis of the nodal set. As in the local case $s=1$, we prove that the admissible vanishing orders can not exceed the critical value $k_q= 2s/(2- q)$. Moreover, we study the regularity of the nodal set and we prove a stratification result. Ultimately, for those parameters such that $k_q< 1$, we prove a remarkable difference with the local case: solutions can only vanish with order $k_q$ and the problem admits one dimensional solutions. Our approach is based on the validity of either a family of Almgren-type or a 2-parameter family of Weiss-type monotonicity formulas, according to the vanishing order of the solution.


title: Structure-preserving neural networks

abstract: We develop a method to learn physical systems from data that employs feedforward neural networks and whose predictions comply with the first and second principles of thermodynamics. The method employs a minimum amount of data by enforcing the metriplectic structure of dissipative Hamiltonian systems in the form of the so-called General Equation for the Non-Equilibrium Reversible-Irreversible Coupling, GENERIC [M. Grmela and H.C Oettinger (1997). Dynamics and thermodynamics of complex fluids. I. Development of a general formalism. Phys. Rev. E. 56 (6): 6620-6632]. The method does not need to enforce any kind of balance equation, and thus no previous knowledge on the nature of the system is needed. Conservation of energy and dissipation of entropy in the prediction of previously unseen situations arise as a natural by-product of the structure of the method. Examples of the performance of the method are shown that include conservative as well as dissipative systems, discrete as well as continuous ones.


title: On the growth rate of geodesic chords

abstract: We show that every forward complete Finsler manifold of infinite fundamental group and not homotopy-equivalent to $S^1$ has infinitely many geometrically distinct geodesics joining any given pair of points $p$ and $q$. In the special case in which $\beta_1(M;\mathbb{Z})\geq 1$ and $M$ is closed, the number of geometrically distinct geodesics between two points grows at least logarithmically.


title: Survey on entropy-type invariants of sub-exponential growth in dynamical systems

abstract: Measure-theoretic and topological entropy are classical invariants in the theory of dynamical systems. There are several recently developed entropy type invariants for systems of sub-exponential growth: sequence entropy, slow entropy, Kakutani invariants, scaled entropy, entropy dimensions and entropy convergence rate. They measure the complexity of zero entropy systems by different approaches. These new invariants and corresponding new theories have many applications and interesting properties. This survey paper gives a comprehensive exposition of the slow entropy theory and also discusses some related topics.


title: Computing Local Sensitivities of Counting Queries with Joins

abstract: Local sensitivity of a query Q given a database instance D, i.e. how much the output Q(D) changes when a tuple is added to D or deleted from D, has many applications including query analysis, outlier detection, and in differential privacy. However, it is NP-hard to find local sensitivity of a conjunctive query in terms of the size of the query, even for the class of acyclic queries. Although the complexity is polynomial when the query size is fixed, the naive algorithms are not efficient for large databases and queries involving multiple joins. In this paper, we present a novel approach to compute local sensitivity of counting queries involving join operations by tracking and summarizing tuple sensitivities -- the maximum change a tuple can cause in the query result when it is added or removed. We give algorithms for the sensitivity problem for full acyclic join queries using join trees, that run in polynomial time in both the size of the database and query for an interesting sub-class of queries, which we call 'doubly acyclic queries' that include path queries, and in polynomial time in combined complexity when the maximum degree in the join tree is bounded. Our algorithms can be extended to certain non-acyclic queries using generalized hypertree decompositions. We evaluate our approach experimentally, and show applications of our algorithms to obtain better results for differential privacy by orders of magnitude.


title: Models of Nonlinear Acoustics Viewed as Approximations of the Kuznetsov Equation

abstract: We relate together different models of non linear acoustic in thermo-ellastic media as the Kuznetsov equation, the Westervelt equation, the Khokhlov-Zabolotskaya-Kuznetsov (KZK) equation and the Nonlinear Progressive wave Equation (NPE) and estimate the time during which the solutions of these models keep closed in the L 2 norm. The KZK and NPE equations are considered as paraxial approximations of the Kuznetsov equation. The Westervelt equation is obtained as a nonlinear approximation of the Kuznetsov equation. Aiming to compare the solutions of the exact and approximated systems in found approximation domains the well-posedness results (for the Kuznetsov equation in a half-space with periodic in time initial and boundary data) are obtained.


title: Bifurcations in curved duct flow based on a simplified Dean model

abstract: We present a minimal model of an incompressible flow in square duct subject to a slight curvature. Using a Poincar\'e-like section we identify stationary, periodic, aperiodic and chaotic regimes, depending on the unique control parameter of the problem: the Dean number (De). Aside from representing a simple, yet rich, dynamical system the present simplified model is also representative of the full problem, reproducing quite accurately the bifurcation points observed in the literature. We analyse the bifurcation diagram from De = 0 (no curvature) to De = 500, observing a periodic segment followed by two separate chaotic regions. The phase diagram of the flow in the periodic regime shows the presence of two symmetric steady states, the system oscillates around these solutions following a heteroclinic cycle. In the appendix some quantitative results are provided for validation purposes, as well as the python code used for the numerical solution of the Navier-Stokes equations.


title: Nontrivial Pure Zero-Scattering Regime Delivered by a Hybrid Anapole State

abstract: The ability to manipulate electric and magnetic components of light at the nanoscale delivered by dielectric and semiconductor components is paving the way towards novel types of sources and nanoantennae with exceptional electromagnetic signatures, flexible and tunable metasurface architectures, enhanced light harvesting structures, etc. Recently, the anapoles states arising from the destructive interference of basic multipoles and their toroidal counterparts have been widely exploited to cancel radiation from an individual scattering channel of isolated nanoresonators, while displaying nontrivial near fields. As such, anapole states have been claimed to correspond to non-radiating sources. Nevertheless, these states are commonly found together with high order multipole moments featuring non-zero overall far-field. In this paper, we theoretically and experimentally demonstrate a fully non-scattering state governed by a novel 4-fold hybrid anapole with all the dominant multipoles suppressed by their corresponding toroidal (retarded) terms, i.e. a dark analogue of the superscattering effect. This invisibility state, however, allows for non-trivial near-field maps enabled by the unique interplay of the resonant Mie-like and Fabry-Perot modes as demonstrated by the quasi-normal modal expansion. Moreover, the hybrid anapole state is shown to be protected; the spectral position of the non-scattering point remains unperturbed in the presence of a substrate with significantly high refractive index. We experimentally verify our novel effect by means of dark field measurements of the scattering response of individual nanocylinders. The results are of high demand for efficient sensing and Raman scattering setups with enhanced signal-to-noise ratio, highly transmissive metasurfaces for phase manipulation, holograms, and a large span of linear and non-linear applications in dielectric nanophotonics.


title: Revealing the single electron pocket of FeSe in a single orthorhombic domain

abstract: We measure the electronic structure of FeSe from within individual orthorhombic domains. Enabled by an angle-resolved photoemission spectroscopy beamline with a highly focused beamspot (nano-ARPES), we identify clear stripe-like orthorhombic domains in FeSe with a length scale of approximately 1-5~$\mu$m. Our photoemission measurements of the Fermi surface and band structure within individual domains reveal a single electron pocket at the Brillouin zone corner. This result provides clear evidence for a one-electron pocket electronic structure of FeSe, observed without the application of uniaxial strain, and calls for further theoretical insight into this unusual Fermi surface topology. Our results also showcase the potential of nano-ARPES for the study of correlated materials with local domain structures.


title: Coupling between waveguides and microresonators: the local approach

abstract: Coupling between optical microresonators and waveguides is a critical characteristic of resonant photonic devices with complex behavior that is not well understood. When the characteristic variation length of the microresonator modes is much larger than the waveguide width, local coupling parameters emerge that are independent of the resonator mode distributions and offer a simplified description of coupling behavior. We develop a robust numerical-fitting-based methodology for experimental determination of the local coupling parameters in all coupling regimes and demonstrate their characterization along a microfiber waveguide coupled to an elongated bottle microresonator.


title: Residual Shuffle-Exchange Networks for Fast Processing of Long Sequences

abstract: Attention is a commonly used mechanism in sequence processing, but it is of O(n^2) complexity which prevents its application to long sequences. The recently introduced neural Shuffle-Exchange network offers a computation-efficient alternative, enabling the modelling of long-range dependencies in O(n log n) time. The model, however, is quite complex, involving a sophisticated gating mechanism derived from the Gated Recurrent Unit. In this paper, we present a simple and lightweight variant of the Shuffle-Exchange network, which is based on a residual network employing GELU and Layer Normalization. The proposed architecture not only scales to longer sequences but also converges faster and provides better accuracy. It surpasses the Shuffle-Exchange network on the LAMBADA language modelling task and achieves state-of-the-art performance on the MusicNet dataset for music transcription while being efficient in the number of parameters. We show how to combine the improved Shuffle-Exchange network with convolutional layers, establishing it as a useful building block in long sequence processing applications.


title: The ICSCREAM methodology: Identification of penalizing configurations in computer experiments using screening and metamodel -- Applications in thermal-hydraulics

abstract: In the framework of risk assessment in nuclear accident analysis, best-estimatecomputer codes, associated to a probabilistic modeling of the uncertain input variables,are used to estimate safety margins. A first step in such uncertainty quantificationstudies is often to identify the critical configurations (or penalizing, in thesense of a prescribed safety margin) of several input parameters (called ``scenarioinputs''), under the uncertainty on the other input parameters. However, the largeCPU-time cost of most of the computer codes used in nuclear engineering, as theones related to thermal-hydraulic accident scenario simulations, involve to develophighly efficient strategies. This work focuses on machine learning algorithms bythe way of the metamodel-based approach (i.e., a mathematical model which is fittedon a small-size sample of simulations). To achieve it with a very large numberof inputs, a specific and original methodology, called ICSCREAM (Identificationof penalizing Configurations using SCREening And Metamodel), is proposed. Thescreening of influential inputs is based on an advanced global sensitivity analysistool (HSIC importance measures). A Gaussian process metamodel is then sequentiallybuilt and used to estimate, within a Bayesian framework, the conditionalprobabilities of exceeding a high-level threshold, according to the scenario inputs.The efficiency of this methodology is illustrated on two high-dimensional (arounda hundred inputs) thermal-hydraulic industrial cases simulating an accident of primarycoolant loss in a pressurized water reactor. For both use cases, the studyfocuses on the peak cladding temperature (PCT) and critical configurations aredefined by exceeding the 90%-quantile of PCT. In both cases, the ICSCREAMmethodology allows to estimate, by using only around one thousand of code simulations,the impact of the scenario inputs and their critical areas of values.


title: Connection Between the Shadow Radius and Quasinormal Modes in Rotating Spacetimes

abstract: Based on the geometric-optics correspondence between the parameters of a quasinormal mode and the conserved quantities along geodesics, we propose an equation to calculate the typical shadow radius for asymptotically flat and rotating black holes when viewed from the equatorial plane given by \begin{equation}\notag \bar{R}_s=\frac{\sqrt{2}}{2}\left(\sqrt{\frac{ r_0^{+}}{f'(r)|_{r_0^{+}}}}+\sqrt{\frac{ r_0^{-}}{f'(r)|_{r_0^{-}}}}\right), \end{equation} with $r_0^{\pm}$ being the radius of circular null geodesics for the corresponding mode. Furthermore we have explicitly related the shadow radius to the real part of QNMs in the eikonal regime corresponding to the prograde and retrograde mode, respectively. As a particular example, we have computed the typical black hole shadow radius for some well known black hole solutions including the Kerr black hole, Kerr-Newman black hole and higher dimensional black hole solutions described by the Myers-Perry black hole.


title: Magneto-Seebeck coefficient and Nernst coefficient of hot and dense hadron gas

abstract: We discuss the thermoelectric effect of hot and dense hadron gas within the framework of the hadron resonance gas model. Using the relativistic Boltzmann equation within the relaxation time approximation we estimate the Seebeck coefficient of the hot and dense hadronic medium with a gradient in temperature and baryon chemical potential. The hadronic medium in this calculation is modeled by the hadron resonance gas (HRG) model with hadrons and their resonances up to a mass cutoff $\Lambda\sim 2.6$ GeV. We also extend the formalism of the thermoelectric effect for a nonvanishing magnetic field. The presence of magnetic field also leads to a Hall type thermoelectric coefficient (Nernst coefficient) for the hot and dense hadronic matter apart from a magneto-Seebeck coefficient. We find that generically in the presence of a magnetic field Seebeck coefficient decreases while the Nernst coefficient increases with the magnetic field. At higher temperature and/or baryon chemical potential these coefficients approach to their values at vanishing magnetic field.


title: Exploration with Limited Memory: Streaming Algorithms for Coin Tossing, Noisy Comparisons, and Multi-Armed Bandits

abstract: Consider the following abstract coin tossing problem: Given a set of $n$ coins with unknown biases, find the most biased coin using a minimal number of coin tosses. This is a common abstraction of various exploration problems in theoretical computer science and machine learning and has been studied extensively over the years. In particular, algorithms with optimal sample complexity (number of coin tosses) have been known for this problem for quite some time. Motivated by applications to processing massive datasets, we study the space complexity of solving this problem with optimal number of coin tosses in the streaming model. In this model, the coins are arriving one by one and the algorithm is only allowed to store a limited number of coins at any point -- any coin not present in the memory is lost and can no longer be tossed or compared to arriving coins. Prior algorithms for the coin tossing problem with optimal sample complexity are based on iterative elimination of coins which inherently require storing all the coins, leading to memory-inefficient streaming algorithms. We remedy this state-of-affairs by presenting a series of improved streaming algorithms for this problem: we start with a simple algorithm which require storing only $O(\log{n})$ coins and then iteratively refine it further and further, leading to algorithms with $O(\log\log{(n)})$ memory, $O(\log^*{(n)})$ memory, and finally a one that only stores a single extra coin in memory -- the same exact space needed to just store the best coin throughout the stream. Furthermore, we extend our algorithms to the problem of finding the $k$ most biased coins as well as other exploration problems such as finding top-$k$ elements using noisy comparisons or finding an $\epsilon$-best arm in stochastic multi-armed bandits, and obtain efficient streaming algorithms for these problems.


title: Geomstats: A Python Package for Riemannian Geometry in Machine Learning

abstract: We introduce Geomstats, an open-source Python toolbox for computations and statistics on nonlinear manifolds, such as hyperbolic spaces, spaces of symmetric positive definite matrices, Lie groups of transformations, and many more. We provide object-oriented and extensively unit-tested implementations. Among others, manifolds come equipped with families of Riemannian metrics, with associated exponential and logarithmic maps, geodesics and parallel transport. Statistics and learning algorithms provide methods for estimation, clustering and dimension reduction on manifolds. All associated operations are vectorized for batch computation and provide support for different execution backends, namely NumPy, PyTorch and TensorFlow, enabling GPU acceleration. This paper presents the package, compares it with related libraries and provides relevant code examples. We show that Geomstats provides reliable building blocks to foster research in differential geometry and statistics, and to democratize the use of Riemannian geometry in machine learning applications. The source code is freely available under the MIT license at \url{geomstats.ai}.


title: Test-Time Adaptable Neural Networks for Robust Medical Image Segmentation

abstract: Convolutional Neural Networks (CNNs) work very well for supervised learning problems when the training dataset is representative of the variations expected to be encountered at test time. In medical image segmentation, this premise is violated when there is a mismatch between training and test images in terms of their acquisition details, such as the scanner model or the protocol. Remarkable performance degradation of CNNs in this scenario is well documented in the literature. To address this problem, we design the segmentation CNN as a concatenation of two sub-networks: a relatively shallow image normalization CNN, followed by a deep CNN that segments the normalized image. We train both these sub-networks using a training dataset, consisting of annotated images from a particular scanner and protocol setting. Now, at test time, we adapt the image normalization sub-network for \emph{each test image}, guided by an implicit prior on the predicted segmentation labels. We employ an independently trained denoising autoencoder (DAE) in order to model such an implicit prior on plausible anatomical segmentation labels. We validate the proposed idea on multi-center Magnetic Resonance imaging datasets of three anatomies: brain, heart and prostate. The proposed test-time adaptation consistently provides performance improvement, demonstrating the promise and generality of the approach. Being agnostic to the architecture of the deep CNN, the second sub-network, the proposed design can be utilized with any segmentation network to increase robustness to variations in imaging scanners and protocols. Our code is available at: \url{https://github.com/neerakara/test-time-adaptable-neural-networks-for-domain-generalization}.


title: Dynamic Control of Nonequilibrium Metal-Insulator Transitions

abstract: We demonstrate a first order metal-insulator phase transition in the repulsive, fully frustrated, single-band Hubbard model as a function of the coupling to a fermion bath. Time dependent manipulation of the bath coupling allows switching between metallic and insulating states both across the phase transition and within the coexistence region. We propose a simple nanoelectronic device for experimentally realizing dynamic control of the bath coupling. Analysis of the device characteristics shows that it can act as a two-terminal memristor.


title: Quantifying the non-equilibrium activity of an active colloid

abstract: Active matter systems exhibit rich emergent behavior due to constant injection and dissipation of energy at the level of individual agents. Since these systems are far from equilibrium, their dynamics and energetics cannot be understood using the framework of equilibrium statistical mechanics. Recent developments in stochastic thermodynamics extend classical concepts of work, heat, and energy dissipation to fluctuating non-equilibrium systems. We use recent advances in experiment and theory to study the non-thermal dissipation of individual light-activated self-propelled colloidal particles. We focus on characterizing the transition from thermal to non-thermal fluctuations and show that energy dissipation rates on the order of $\sim k_BT/$s are measurable from finite time series data.


title: Predicting human-generated bitstreams using classical and quantum models

abstract: A school of thought contends that human decision making exhibits quantum-like logic. While it is not known whether the brain may indeed be driven by actual quantum mechanisms, some researchers suggest that the decision logic is phenomenologically non-classical. This paper develops and implements an empirical framework to explore this view. We emulate binary decision-making using low width, low depth, parameterized quantum circuits. Here, entanglement serves as a resource for pattern analysis in the context of a simple bit-prediction game. We evaluate a hybrid quantum-assisted machine learning strategy where quantum processing is used to detect correlations in the bitstreams while parameter updates and class inference are performed by classical post-processing of measurement results. Simulation results indicate that a family of two-qubit variational circuits is sufficient to achieve the same bit-prediction accuracy as the best traditional classical solution such as neural nets or logistic autoregression. Thus, short of establishing a provable "quantum advantage" in this simple scenario, we give evidence that the classical predictability analysis of a human-generated bitstream can be achieved by small quantum models.


title: Random perturbation of sparse graphs

abstract: In the model of randomly perturbed graphs we consider the union of a deterministic graph $\mathcal{G}_\alpha$ with minimum degree $\alpha n$ and the binomial random graph $\mathbb{G}(n,p)$. This model was introduced by Bohman, Frieze, and Martin and for Hamilton cycles their result bridges the gap between Dirac's theorem and the results by Pos\'{a} and Kor\v{s}unov on the threshold in $\mathbb{G}(n,p)$. In this note we extend this result in $\mathcal{G}_\alpha \cup \mathbb{G}(n,p)$ to sparser graphs with $\alpha=o(1)$. More precisely, for any $\varepsilon>0$ and $\alpha \colon \mathbb{N} \mapsto (0,1)$ we show that a.a.s. $\mathcal{G}_\alpha \cup \mathbb{G}(n,\beta /n)$ is Hamiltonian, where $\beta = -(6 + \varepsilon) \log(\alpha)$. If $\alpha>0$ is a fixed constant this gives the aforementioned result by Bohman, Frieze, and Martin and if $\alpha=O(1/n)$ the random part $\mathbb{G}(n,p)$ is sufficient for a Hamilton cycle. We also discuss embeddings of bounded degree trees and other spanning structures in this model, which lead to interesting questions on almost spanning embeddings into $\mathbb{G}(n,p)$.


title: Efficient determination of solid-state phase equilibrium with the Mutli-Cell Monte Carlo method

abstract: Building on our previously introduced Multi-cell Monte Carlo (MC)^2 method for modeling phase coexistence, this paper provides important improvements for efficient determination of phase equilibria in solids. The (MC)^2 method uses multiple cells, representing possible phases. Mass transfer between cells is modeled virtually by solving the mass balance equation after the composition of each cell is changed arbitrarily. However, searching for the minimum free energy during this process poses a practical problem. The solution to the mass balance equation is not unique away from equilibrium and consequently the algorithm is in risk of getting trapped in nonequilibrium solutions. Therefore, a proper stopping condition for (MC)^2 is currently lacking. In this work, we introduce a consistency check via a predictor-corrector algorithm to penalize solutions that do not satisfy a necessary condition for equivalence of chemical potentials and steer the system towards finding equilibrium. The most general acceptance criteria for (MC)^2 is derived starting from the isothermic-isobaric Gibbs Ensemble for mixtures. Using this ensemble, translational MC moves are added to include vibrational excitations as well as volume MC moves to ensure the condition of constant pressure and temperature entirely with a MC approach, without relying on any other method for relaxation of these degrees of freedom. As a proof of concept the method is applied to two binary alloys with miscibility gaps and a model quaternary alloy, using classical interatomic potentials.


title: Fisher Discriminant Triplet and Contrastive Losses for Training Siamese Networks

abstract: Siamese neural network is a very powerful architecture for both feature extraction and metric learning. It usually consists of several networks that share weights. The Siamese concept is topology-agnostic and can use any neural network as its backbone. The two most popular loss functions for training these networks are the triplet and contrastive loss functions. In this paper, we propose two novel loss functions, named Fisher Discriminant Triplet (FDT) and Fisher Discriminant Contrastive (FDC). The former uses anchor-neighbor-distant triplets while the latter utilizes pairs of anchor-neighbor and anchor-distant samples. The FDT and FDC loss functions are designed based on the statistical formulation of the Fisher Discriminant Analysis (FDA), which is a linear subspace learning method. Our experiments on the MNIST and two challenging and publicly available histopathology datasets show the effectiveness of the proposed loss functions.


title: Deterministic Models in Epidemiology: From Modeling to Implementation

abstract: The abrupt outbreak and transmission of biological diseases has always been a long-time concern of humankind. For long, mathematical modeling has served as a simple and yet efficient tool to investigate, predict, and control spread of communicable diseases through individuals. A myriad of works on epidemic models and their variants have been reported in the literature. For better prediction of the dynamics of a particular disease, it is important to adopt the most suitable model. In this paper, we study some of the widely-appreciated deterministic epidemic models in which the population is divided into compartments based on the health status of each individual. In particular, we provide a demographic classification of such models and study each of them in terms of mathematical formulation, near equilibrium point stability properties, and disease outbreak threshold conditions (basic reproduction ratio). Furthermore, we discuss the various influential factors that need to be considered during epidemic modeling. The main objective of this article is to provide a basic understanding of the mathematical complexity incurred in deterministic epidemic models with the aid of graphical illustrations obtained through implementation.


title: An Overview of Federated Deep Learning Privacy Attacks and Defensive Strategies

abstract: With the increased attention and legislation for data-privacy, collaborative machine learning (ML) algorithms are being developed to ensure the protection of private data used for processing. Federated learning (FL) is the most popular of these methods, which provides privacy preservation by facilitating collaborative training of a shared model without the need to exchange any private data with a centralized server. Rather, an abstraction of the data in the form of a machine learning model update is sent. Recent studies showed that such model updates may still very well leak private information and thus more structured risk assessment is needed. In this paper, we analyze existing vulnerabilities of FL and subsequently perform a literature review of the possible attack methods targetingFL privacy protection capabilities. These attack methods are then categorized by a basic taxonomy. Additionally, we provide a literature study of the most recent defensive strategies and algorithms for FL aimed to overcome these attacks. These defensive strategies are categorized by their respective underlying defence principle. The paper concludes that the application of a single defensive strategy is not enough to provide adequate protection to all available attack methods.


title: A Short Note on Analyzing Sequence Complexity in Trajectory Prediction Benchmarks

abstract: The analysis and quantification of sequence complexity is an open problem frequently encountered when defining trajectory prediction benchmarks. In order to enable a more informative assembly of a data basis, an approach for determining a dataset representation in terms of a small set of distinguishable prototypical sub-sequences is proposed. The approach employs a sequence alignment followed by a learning vector quantization (LVQ) stage. A first proof of concept on synthetically generated and real-world datasets shows the viability of the approach.


title: A note on the geometry of figurate numbers

abstract: We give a short proof of the formula $n^p=\sum_{\ell=0}^{p-1} (-1)^{\ell} c_{p,\ell} F^{p-\ell}_n$, where $F^{p-\ell}_n$ is the figurate number and $c_{p,\ell}$ is the number of $(p-\ell)$-dimensional facets of $p$-dimensional simplices obtained by cutting the $p$-dimensional cube.


title: Quantum Criticality and Dynamical Kondo Effect in an SU(2) Anderson Lattice Model

abstract: Metallic quantum criticality often develops in strongly correlated systems with local effective degrees of freedom. In this work, we consider an Anderson lattice model with SU(2) symmetry. The model is treated by the extended dynamical mean-field theory (EDMFT) in combination with a continuous-time quantum Monte Carlo method. We demonstrate a continuous quantum phase transition, establish the ensuing quantum critical point to be of a Kondo-destruction type, and determine the anomalous scaling properties. We connect the continuous nature of the transition to a dynamical Kondo effect, which we characterize in terms of a local entanglement entropy and related properties. This effect elucidates the unusual behavior of quantum critical heavy fermion systems.


title: A Private and Finite-Time Algorithm for Solving a Distributed System of Linear Equations

abstract: This paper studies a system of linear equations, denoted as $Ax = b$, which is horizontally partitioned (rows in $A$ and $b$) and stored over a network of $m$ devices connected in a fixed directed graph. We design a fast distributed algorithm for solving such a partitioned system of linear equations, that additionally, protects the privacy of local data against an honest-but-curious adversary that corrupts at most $\tau$ nodes in the network. First, we present TITAN, privaTe fInite Time Average coNsensus algorithm, for solving a general average consensus problem over directed graphs, while protecting statistical privacy of private local data against an honest-but-curious adversary. Second, we propose a distributed linear system solver that involves each agent/devices computing an update based on local private data, followed by private aggregation using TITAN. Finally, we show convergence of our solver to the least squares solution in finite rounds along with statistical privacy of local linear equations against an honest-but-curious adversary provided the graph has weak vertex-connectivity of at least $\tau+1$. We perform numerical experiments to validate our claims and compare our solution to the state-of-the-art methods by comparing computation, communication and memory costs.


title: Freeze-out and thermalization in relativistic heavy ion collisions

abstract: High energy heavy-ion collisions in laboratory produce a form of matter that can test Quantum Chromodynamics (QCD), the theory of strong interactions, at high temperatures. One of the exciting possibilities is the existence of thermodynamically distinct states of QCD, particularly a phase of de-confined quarks and gluons. An important step in establishing this new state of QCD is to demonstrate that the system has attained thermal equilibrium. We present a test of thermal equilibrium by checking that the mean hadron yields produced in the small impact parameter collisions as well as grand canonical fluctuations of conserved quantities give consistent temperature and baryon chemical potential for the last scattering surface. This consistency for moments up to third order of the net-baryon number, charge, and strangeness is a key step in the proof that the QCD matter produced in heavy-ion collision attains thermal equilibrium. It is a clear indication for the first time, using fluctuation observables, that a femto-scale system attains thermalization. The study also indicates that the relaxation time scales for the system are comparable to or smaller than the life time of the fireball.


title: Orthant probabilities and the attainment of maxima on a vertex of a simplex

abstract: We calculate bounds for orthant probabilities for the equicorrelated multivariate normal distribution and use these bounds to show the following: for degree $k>4$, the probability that a $k$-homogeneous polynomial in $n$ variables attains a relative maximum on a vertex of the $n$-dimensional simplex tends to one as the dimension $n$ grows. The bounds we obtain for the orthant probabilities are tight up to $\log(n)$ factors.


title: On the Factors Influencing the Choices of Weekly Telecommuting Frequencies of Post-secondary Students in Toronto

abstract: The paper presents an empirical investigation of telecommuting frequency choices by post-secondary students in Toronto. It uses a dataset collected through a large-scale travel survey conducted on post-secondary students of four major universities in Toronto and it employs multiple alternative econometric modelling techniques for the empirical investigation. Results contribute on two fronts. Firstly, it presents empirical investigations of factors affecting telecommuting frequency choices of post-secondary students that are rare in literature. Secondly, it identifies better a performing econometric modelling technique for modelling telecommuting frequency choices. Empirical investigation clearly reveals that telecommuting for school related activities is prevalent among post-secondary students in Toronto. Around 80 percent of 0.18 million of the post-secondary students of the region, who make roughly 36,000 trips per day, also telecommute at least once a week. Considering that large numbers of students need to spend a long time travelling from home to campus with around 33 percent spending more than two hours a day on travelling, telecommuting has potential to enhance their quality of life. Empirical investigations reveal that car ownership and living farther from the campus have similar positive effects on the choice of higher frequency of telecommuting. Students who use a bicycle for regular travel are least likely to telecommute, compared to those using transit or a private car.


title: Big Bang Nucleosynthesis and Entropy Evolution in $f(R,T)$ Gravity

abstract: The present article is devoted to constrain the model parameter $\chi$ for the $f(R,T)= R + \chi T$ gravity model by employing the constraints coming from big bang nucleosynthesis. We solve the field equations and constrain $\chi$ in the range $-0.14 \kappa^{2} \leq \chi \leq 0.84 \kappa^{2}$ (where $\kappa^{2} = \frac{8 \pi G}{c^{4}}$) from the primordial abundances of light elements such as helium-4, deuterium and lithium-7. We found the abundances of helium-4 and deuterium agrees with theoretical predictions, however the lithium problem persists for the $f(R,T)$ gravity model. We also investigate the evolution of entropy for the constrained parameter space of $\chi$ for the radiation and dust universe. We report that entropy is constant when $\chi = 0$ for the radiation dominated universe, whereas for the dust universe, entropy increases with time. We finally use the constraints to show that $\chi$ has negligible influence on the cold dark matter annihilation cross section.


title: Risk-Constrained Linear-Quadratic Regulators

abstract: We propose a new risk-constrained reformulation of the standard Linear Quadratic Regulator (LQR) problem. Our framework is motivated by the fact that the classical (risk-neutral) LQR controller, although optimal in expectation, might be ineffective under relatively infrequent, yet statistically significant (risky) events. To effectively trade between average and extreme event performance, we introduce a new risk constraint, which explicitly restricts the total expected predictive variance of the state penalty by a user-prescribed level. We show that, under rather minimal conditions on the process noise (i.e., finite fourth-order moments), the optimal risk-aware controller can be evaluated explicitly and in closed form. In fact, it is affine relative to the state, and is always internally stable regardless of parameter tuning. Our new risk-aware controller: i) pushes the state away from directions where the noise exhibits heavy tails, by exploiting the third-order moment (skewness) of the noise; ii) inflates the state penalty in riskier directions, where both the noise covariance and the state penalty are simultaneously large. The properties of the proposed risk-aware LQR framework are also illustrated via indicative numerical examples.


title: Machine Learning in Artificial Intelligence: Towards a Common Understanding

abstract: The application of "machine learning" and "artificial intelligence" has become popular within the last decade. Both terms are frequently used in science and media, sometimes interchangeably, sometimes with different meanings. In this work, we aim to clarify the relationship between these terms and, in particular, to specify the contribution of machine learning to artificial intelligence. We review relevant literature and present a conceptual framework which clarifies the role of machine learning to build (artificial) intelligent agents. Hence, we seek to provide more terminological clarity and a starting point for (interdisciplinary) discussions and future research.


title: GGA-MG: Generative Genetic Algorithm for Music Generation

abstract: Music Generation (MG) is an interesting research topic that links the art of music and Artificial Intelligence (AI). The goal is to train an artificial composer to generate infinite, fresh, and pleasurable musical pieces. Music has different parts such as melody, harmony, and rhythm. In this paper, we propose a Generative Genetic Algorithm (GGA) to produce a melody automatically. The main GGA uses a Long Short-Term Memory (LSTM) recurrent neural network as the objective function, which should be trained by a spectrum of bad-to-good melodies. These melodies have to be provided by another GGA with a different objective function. Good melodies have been provided by CAMPINs collection. We have considered the rhythm in this work, too. The experimental results clearly show that the proposed GGA method is able to generate eligible melodies with natural transitions and without rhythm error.


title: Towards Robust Crowdsourcing-Based Localization: A Fingerprinting Accuracy Indicator Enhanced Wireless/Magnetic/Inertial Integration Approach

abstract: The next-generation internet of things (IoT) systems have an increasingly demand on intelligent localization which can scale with big data without human perception. Thus, traditional localization solutions without accuracy metric will greatly limit vast applications. Crowdsourcing-based localization has been proven to be effective for mass-market location-based IoT applications. This paper proposes an enhanced crowdsourcing-based localization method by integrating inertial, wireless, and magnetic sensors. Both wireless and magnetic fingerprinting accuracy are predicted in real time through the introduction of fingerprinting accuracy indicators (FAI) from three levels (i.e., signal, geometry, and database). The advantages and limitations of these FAI factors and their performances on predicting location errors and outliers are investigated. Furthermore, the FAI-enhanced extended Kalman filter (EKF) is proposed, which improved the dead-reckoning (DR)/WiFi, DR/Magnetic, and DR/WiFi/Magnetic integrated localization accuracy by 30.2 %, 19.4 %, and 29.0 %, and reduced the maximum location errors by 41.2 %, 28.4 %, and 44.2 %, respectively. These outcomes confirm the effectiveness of the FAI-enhanced EKF on improving both accuracy and reliability of multi-sensor integrated localization using crowdsourced data.


title: Dimensional Reduction, Extended Topological Field Theories and Orbifoldization

abstract: We prove a decomposition formula for the dimensional reduction of an extended topological field theory that arises as an orbifold of an equivariant topological field theory. Our decomposition formula can be expressed in terms of a categorification of the integral with respect to groupoid cardinality. The application of our result to topological field theories of Dijkgraaf-Witten type proves a recent conjecture of Qiu-Wang.


title: Orthogonal Over-Parameterized Training

abstract: The inductive bias of a neural network is largely determined by the architecture and the training algorithm. To achieve good generalization, how to effectively train a neural network is of great importance. We propose a novel orthogonal over-parameterized training (OPT) framework that can provably minimize the hyperspherical energy which characterizes the diversity of neurons on a hypersphere. By maintaining the minimum hyperspherical energy during training, OPT can greatly improve the empirical generalization. Specifically, OPT fixes the randomly initialized weights of the neurons and learns an orthogonal transformation that applies to these neurons. We consider multiple ways to learn such an orthogonal transformation, including unrolling orthogonalization algorithms, applying orthogonal parameterization, and designing orthogonality-preserving gradient descent. For better scalability, we propose the stochastic OPT which performs orthogonal transformation stochastically for partial dimensions of neurons. Interestingly, OPT reveals that learning a proper coordinate system for neurons is crucial to generalization. We provide some insights on why OPT yields better generalization. Extensive experiments validate the superiority of OPT over the standard training.


title: Photo-acoustic dual-frequency comb spectroscopy

abstract: Photo-acoustic spectroscopy (PAS) is one of the most sensitive non-destructive analysis techniques for gases, fluids and solids. It can operate background-free at any wavelength and is applicable to microscopic and even non-transparent samples. Extension of PAS to broadband wavelength coverage is a powerful tool, though challenging to implement without sacrifice of wavelength resolution and acquisition speed. Here, we show that the unmatched precision, speed and wavelength coverage of dual-frequency comb spectroscopy (DCS) can be combined with the advantages of photo-acoustic detection. Acoustic wave interferograms are generated in the sample by dual-comb absorption and detected by a microphone. As an example, weak gas absorption features are precisely and rapidly sampled; long-term coherent averaging further increases the sensitivity. This novel approach of photo-acoustic dual-frequency comb spectroscopy generates unprecedented opportunities for rapid and sensitive multi-species molecular analysis across all wavelengths of light.


title: Rethinking the Trigger of Backdoor Attack

abstract: Backdoor attack intends to inject hidden backdoor into the deep neural networks (DNNs), such that the prediction of the infected model will be maliciously changed if the hidden backdoor is activated by the attacker-defined trigger, while it performs well on benign samples. Currently, most of existing backdoor attacks adopted the setting of \emph{static} trigger, $i.e.,$ triggers across the training and testing images follow the same appearance and are located in the same area. In this paper, we revisit this attack paradigm by analyzing the characteristics of the static trigger. We demonstrate that such an attack paradigm is vulnerable when the trigger in testing images is not consistent with the one used for training. We further explore how to utilize this property for backdoor defense, and discuss how to alleviate such vulnerability of existing attacks.


title: Fault-Tolerant Weighted Union-Find Decoding on the Toric Code

abstract: Quantum error correction requires decoders that are both accurate and efficient. To this end, union-find decoding has emerged as a promising candidate for error correction on the surface code. In this work, we benchmark a weighted variant of the union-find decoder on the toric code under circuit-level depolarizing noise. This variant preserves the almost-linear time complexity of the original while significantly increasing the performance in the fault-tolerance setting. In this noise model, weighting the union-find decoder increases the threshold from 0.38% to 0.62%, compared to an increase from 0.65% to 0.72% when weighting a matching decoder. Further assuming quantum non-demolition measurements, weighted union-find decoding achieves a threshold of 0.76% compared to the 0.90% threshold when matching. We additionally provide comparisons of timing as well as low error rate behavior.


title: Calculating dimension of triangulated categories: path algebras, their tensor powers and orbifold projective lines

abstract: This is a companion paper of arXiv:1901.09461, where different notions of dimension for triangulated categories are discussed. Here we compute dimensions for some examples of triangulated categories and thus illustrate and motivate material from loc. cit. Our examples include path algebras of finite ordered quivers, orbifold projective lines, some tensor powers of path algebras in Dynkin quivers of type A and categories, generated by an exceptional pair.


title: Binary Black Hole Information Loss Paradox & Future Prospects

abstract: Various techniques to tackle the black hole information paradox have been proposed. A new way out to tackle the paradox is via the use of a pseudo-density operator. This approach has successfully dealt with the problem with a two qubit entangle system for a single black hole. In this paper, we present the interaction with a binary black hole system by using an arrangement of the three qubit system of Greenberger Horne Zeilinger (GHZ) state. We show that our results are in excellent agreement with the theoretical value. We have also studied the interaction between the two black holes by considering the correlation between the qubits in the binary black hole system. The results depict a complete agreement with the proposed model. In addition to the verification, we also propose how modern detection of gravitational waves can be used on our optical setup as an input source, thus bridging the gap with the gravitational wave's observational resources in terms of studying black hole properties with respect to quantum information and entanglement.


title: BLEURT: Learning Robust Metrics for Text Generation

abstract: Text generation has made significant advances in the last few years. Yet, evaluation metrics have lagged behind, as the most popular choices (e.g., BLEU and ROUGE) may correlate poorly with human judgments. We propose BLEURT, a learned evaluation metric based on BERT that can model human judgments with a few thousand possibly biased training examples. A key aspect of our approach is a novel pre-training scheme that uses millions of synthetic examples to help the model generalize. BLEURT provides state-of-the-art results on the last three years of the WMT Metrics shared task and the WebNLG Competition dataset. In contrast to a vanilla BERT-based approach, it yields superior results even when the training data is scarce and out-of-distribution.


title: Learning to Drive Off Road on Smooth Terrain in Unstructured Environments Using an On-Board Camera and Sparse Aerial Images

abstract: We present a method for learning to drive on smooth terrain while simultaneously avoiding collisions in challenging off-road and unstructured outdoor environments using only visual inputs. Our approach applies a hybrid model-based and model-free reinforcement learning method that is entirely self-supervised in labeling terrain roughness and collisions using on-board sensors. Notably, we provide both first-person and overhead aerial image inputs to our model. We find that the fusion of these complementary inputs improves planning foresight and makes the model robust to visual obstructions. Our results show the ability to generalize to environments with plentiful vegetation, various types of rock, and sandy trails. During evaluation, our policy attained 90% smooth terrain traversal and reduced the proportion of rough terrain driven over by 6.1 times compared to a model using only first-person imagery.


title: Geometry and Complexity of Path Integrals in Inhomogeneous CFTs

abstract: In this work we develop the path integral optimization in a class of inhomogeneous 2d CFTs constructed by putting an ordinary CFT on a space with a position dependent metric. After setting up and solving the general optimization problem, we study specific examples, including the M\"obius, SSD and Rainbow deformed CFTs, and analyze path integral geometries and complexity for universal classes of states in these models. We find that metrics for optimal path integrals coincide with particular slices of $AdS_3$ geometries, on which Einstein's equations are equivalent to the condition for minimal path integral complexity. We also find that while leading divergences of path integral complexity remain unchanged, constant contributions are modified in a universal, position dependent manner. Moreover, we analyze entanglement entropies in inhomogeneous CFTs and show that they satisfy Hill's equations, which can be used to extract the energy density consistent with the first law of entanglement. Our findings not only support comparisons between slices of bulk spacetimes and circuits of path integrations, but also demonstrate that path integral geometries and complexity serve as a powerful tool for understanding the interesting physics of inhomogeneous systems.


title: Scalable Active Learning for Object Detection

abstract: Deep Neural Networks trained in a fully supervised fashion are the dominant technology in perception-based autonomous driving systems. While collecting large amounts of unlabeled data is already a major undertaking, only a subset of it can be labeled by humans due to the effort needed for high-quality annotation. Therefore, finding the right data to label has become a key challenge. Active learning is a powerful technique to improve data efficiency for supervised learning methods, as it aims at selecting the smallest possible training set to reach a required performance. We have built a scalable production system for active learning in the domain of autonomous driving. In this paper, we describe the resulting high-level design, sketch some of the challenges and their solutions, present our current results at scale, and briefly describe the open problems and future directions.


title: Geometric flux formula for the gravitational Wilson loop

abstract: Finding diffeomorphism-invariant observables to characterize the properties of gravity and spacetime at the Planck scale is essential for making progress in quantum gravity. The holonomy and Wilson loop of the Levi-Civita connection are potentially interesting ingredients in the construction of quantum curvature observables. Motivated by recent developments in nonperturbative quantum gravity, we establish new relations in three and four dimensions between the holonomy of a finite loop and certain curvature integrals over the surface spanned by the loop. They are much simpler than a gravitational version of the nonabelian Stokes' theorem, but require the presence of totally geodesic surfaces in the manifold, which follows from the existence of suitable Killing vectors. We show that the relations are invariant under smooth surface deformations, due to the presence of a conserved geometric flux.


title: Young Stellar Complexes in the Giant Galaxy UGC 11973

abstract: We present results of the analysis of photometric and spectroscopic observations of the young stellar complexes in the late giant spiral galaxy UGC 11973. Photometric analysis in the UBVRI bands have been carried out for the 13 largest complexes. For one of them, metallicity of the surrounding gas Z = 0.013+-0.005, the mass M = (4.6+-1.6)*10^6 Msun, and the age of the stellar complex t = (2.0+-1.1)*10^6 yr were evaluated, using spectroscopic data. It is shown that all complexes are massive (M >= 1.7*10^5 Msun) stellar groups younger than 3*10^8 yr.


title: Cosmology with the Wide-Field Infrared Survey Telescope -- Synergies with the Rubin Observatory Legacy Survey of Space and Time

abstract: We explore synergies between the space-based Wide-Field Infrared Survey Telescope (WFIRST) and the ground-based Rubin Observatory Legacy Survey of Space and Time (LSST). In particular, we consider a scenario where the currently envisioned survey strategy for WFIRST's High Latitude Survey (HLS), i.e., 2000 square degrees in four narrow photometric bands is altered in favor of a strategy that combines rapid coverage of the LSST area (to full LSST depth) in one band. We find that a 5-month WFIRST survey in the W-band can cover the full LSST survey area providing high-resolution imaging for >95% of the LSST Year 10 gold galaxy sample. We explore a second, more ambitious scenario where WFIRST spends 1.5 years covering the LSST area. For this second scenario we quantify the constraining power on dark energy equation of state parameters from a joint weak lensing and galaxy clustering analysis, and compare it to an LSST-only survey and to the Reference WFIRST HLS survey. Our survey simulations are based on the WFIRST exposure time calculator and redshift distributions from the CANDELS catalog. Our statistical uncertainties account for higher-order correlations of the density field, and we include a wide range of systematic effects, such as uncertainties in shape and redshift measurements, and modeling uncertainties of astrophysical systematics, such as galaxy bias, intrinsic galaxy alignment, and baryonic physics. Assuming the 5-month WFIRST wide scenario, we find a significant increase in constraining power for the joint LSST+WFIRST wide survey compared to LSST Y10 (FoM(Wwide)= 2.4 FoM(LSST)) and compared to LSST+WFIRST HLS (FoM(Wwide)= 5.5 FoM(HLS)).


title: Hierarchy of kinetic freeze-out parameters in low energy heavy-ion collisions

abstract: We study the mass dependent hierarchy of kinetic freeze-out parameters of hadrons in low energy heavy-ion collisions. For this purpose, the transverse momentum and rapidity spectra of the identified hadrons produced in central Pb+Pb collisions, available at SPS energies ranging from $\rm E_{Lab}=20A-158A $ GeV, are analyzed within a generalized non boost-invariant blast wave model. We consider separate simultaneous fits for light hadrons ($\pi^{-}$, $K^{\pm}$) and heavy strange hadrons ($\Lambda$, $\bar{\Lambda}$, $\phi$, $\Xi^{\pm}$, $\Omega^{\pm}$), for which the transverse momentum spectra as well as rapidity spectra are available. We also perform a separate fit to transverse momentum spectra of charmonia ($J/\Psi$, $\Psi'$) at $158A $ GeV collisions. We find a clear mass dependent hierarchy in the fitted kinetic freeze-out parameters. Further, we study the rapidity spectra using analytical Landau flow solution for non-conformal systems. We find that the fitted value of sound velocity in the medium also shows a similar hierarchy.


title: Heuristics for Link Prediction in Multiplex Networks

abstract: Link prediction, or the inference of future or missing connections between entities, is a well-studied problem in network analysis. A multitude of heuristics exist for link prediction in ordinary networks with a single type of connection. However, link prediction in multiplex networks, or networks with multiple types of connections, is not a well understood problem. We propose a novel general framework and three families of heuristics for multiplex network link prediction that are simple, interpretable, and take advantage of the rich connection type correlation structure that exists in many real world networks. We further derive a theoretical threshold for determining when to use a different connection type based on the number of links that overlap with an Erdos-Renyi random graph. Through experiments with simulated and real world scientific collaboration, transportation and global trade networks, we demonstrate that the proposed heuristics show increased performance with the richness of connection type correlation structure and significantly outperform their baseline heuristics for ordinary networks with a single connection type.


title: Cryogenic electro-optic interconnect for superconducting devices

abstract: Encoding information onto optical fields is the backbone of modern telecommunication networks. Optical fibers offer low loss transport and vast bandwidth compared to electrical cables, and are currently also replacing coaxial cables for short-range communications. Optical fibers also exhibit significantly lower thermal conductivity, making optical interconnects attractive for interfacing with superconducting circuits and devices. Yet little is known about modulation at cryogenic temperatures. Here we demonstrate a proof-of-principle experiment, showing that currently employed Ti-doped LiNbO modulators maintain the Pockels coefficient at 3K---a base temperature for classical microwave amplifier circuitry. We realize electro-optical read-out of a superconducting electromechanical circuit to perform both coherent spectroscopy, measuring optomechanically-induced transparency, and incoherent thermometry, encoding the thermomechanical sidebands in an optical signal. Although the achieved noise figures are high, approaches that match the lower-bandwidth microwave signals, use integrated devices or materials with higher EO coefficient, should achieve added noise similar to current HEMT amplifiers, providing a route to parallel readout for emerging quantum or classical computing platforms.


title: Architecting Noisy Intermediate-Scale Trapped Ion Quantum Computers

abstract: Trapped ions (TI) are a leading candidate for building Noisy Intermediate-Scale Quantum (NISQ) hardware. TI qubits have fundamental advantages over other technologies such as superconducting qubits, including high qubit quality, coherence and connectivity. However, current TI systems are small in size, with 5-20 qubits and typically use a single trap architecture which has fundamental scalability limitations. To progress towards the next major milestone of 50-100 qubits, a modular architecture termed the Quantum Charge Coupled Device (QCCD) has been proposed. In a QCCD-based TI device, small traps are connected through ion shuttling. While the basic hardware components for such devices have been demonstrated, building a 50-100 qubit system is challenging because of a wide range of design possibilities for trap sizing, communication topology and gate implementations and the need to match diverse application resource requirements. Towards realizing QCCD systems with 50-100 qubits, we perform an extensive architectural study evaluating the key design choices of trap sizing, communication topology and operation implementation methods. We built a design toolflow which takes a QCCD architecture's parameters as input, along with a set of applications and realistic hardware performance models. Our toolflow maps the applications onto the target device and simulates their execution to compute metrics such as application run time, reliability and device noise rates. Using six applications and several hardware design points, we show that trap sizing and communication topology choices can impact application reliability by up to three orders of magnitude. Microarchitectural gate implementation choices influence reliability by another order of magnitude. From these studies, we provide concrete recommendations to tune these choices to achieve highly reliable and performant application executions.


title: Autonomous Calibration of MEMS Gyros in Consumer Portable Devices

abstract: This paper presents a real-time calibration method for gyro sensors in consumer portable devices. The calibration happens automatically without the need for external equipment or user intervention. Multi-level constraints, including the pseudo-observations, the accelerometer and magnetometer measurements, and the quasi-static attitude updates, are used to make the method reliable and accurate under natural user motions. Walking tests with the Samsung Galaxy S3 and S4 smartphones showed that the method estimate promising calibration results even under challenging motion modes such as dangling and pocket, and in challenging indoor environments with frequent magnetic interferences.


title: Science orbits in the Saturn-Enceladus circular restricted three-body problem with oblate primaries

abstract: This contribution investigates the properties of a category of orbits around Enceladus. In a previous investigation, a set of heteroclinic connections were designed between halo orbits around the equilibrium points L1 and L2 of the circular restricted three-body problem with Saturn and Enceladus as primaries. The geometrical characteristics of those trajectories makes them good candidates as science orbits for the extended observation of the surface of Enceladus: they are highly inclined, they approach the moon and they are maneuver-free. However, the low heights above the surface and the strong perturbing effect of Saturn require a study of the influence of the polar flattening of the primaries. Therefore, those solutions are here reconsidered with a dynamical model that includes the effect of the oblateness of Saturn and Enceladus, separately and in combination. The dynamical equivalents of the halo orbits around the equilibrium points L1 and L2 and their stable and unstable hyperbolic invariant manifolds are obtained in the perturbed models, and maneuver-free heteroclinic connections are identified. A comparison with the corresponding solutions of the unperturbed problem shows that qualitative and quantitative features are not significantly altered in the perturbed model. The results confirm the scientific value of the solutions obtained in the classical circular restricted three-body problem and suggests that the simpler model can be used in a preliminary feasibility analysis.


title: Mismatched Models to Lower Bound the Capacity of Optical Fiber Channels

abstract: A correlated phase-and-additive-noise (CPAN) mismatched model is developed for wavelength division multiplexing over optical fiber channels governed by the nonlinear Schr\"odinger equation. Both the phase and additive noise processes of the CPAN model are Gauss-Markov whereas previous work uses Wiener phase noise and white additive noise. Second order statistics are derived and lower bounds on the capacity are computed by simulations. The CPAN model characterizes nonlinearities better than existing models in the sense that it achieves better information rates. For example, the model gains 0.35 dB in power at the peak data rate when using a single carrier per wavelength. For multiple carriers per wavelength, the model combined with frequency-dependent power allocation gains 0.14 bits/s/Hz in rate and 0.8 dB in power at the peak data rate.


title: Prune2Edge: A Multi-Phase Pruning Pipelines to Deep Ensemble Learning in IIoT

abstract: Most recently, with the proliferation of IoT devices, computational nodes in manufacturing systems IIoT(Industrial-Internet-of-things) and the lunch of 5G networks, there will be millions of connected devices generating a massive amount of data. In such an environment, the controlling systems need to be intelligent enough to deal with a vast amount of data to detect defects in a real-time process. Driven by such a need, artificial intelligence models such as deep learning have to be deployed into IIoT systems. However, learning and using deep learning models are computationally expensive, so an IoT device with limited computational power could not run such models. To tackle this issue, edge intelligence had emerged as a new paradigm towards running Artificial Intelligence models on edge devices. Although a considerable amount of studies have been proposed in this area, the research is still in the early stages. In this paper, we propose a novel edge-based multi-phase pruning pipelines to ensemble learning on IIoT devices. In the first phase, we generate a diverse ensemble of pruned models, then we apply integer quantisation, next we prune the generated ensemble using a clustering-based technique. Finally, we choose the best representative from each generated cluster to be deployed to a distributed IoT environment. On CIFAR-100 and CIFAR-10, our proposed approach was able to outperform the predictability levels of a baseline model (up to 7%), more importantly, the generated learners have small sizes (up to 90% reduction in the model size) that minimise the required computational capabilities to make an inference on the resource-constraint devices.


title: Phase Detection with Neural Networks: Interpreting the Black Box

abstract: Neural networks (NNs) usually hinder any insight into the reasoning behind their predictions. We demonstrate how influence functions can unravel the black box of NN when trained to predict the phases of the one-dimensional extended spinless Fermi-Hubbard model at half-filling. Results provide strong evidence that the NN correctly learns an order parameter describing the quantum transition in this model. We demonstrate that influence functions allow to check that the network, trained to recognize known quantum phases, can predict new unknown ones within the data set. Moreover, we show they can guide physicists in understanding patterns responsible for the phase transition. This method requires no a priori knowledge on the order parameter, has no dependence on the NN's architecture or the underlying physical model, and is therefore applicable to a broad class of physical models or experimental data.


title: Solutions for Subset Sum Problems with Special Digraph Constraints

abstract: The subset sum problem is one of the simplest and most fundamental NP-hard problems in combinatorial optimization. We consider two extensions of this problem: The subset sum problem with digraph constraint (SSG) and subset sum problem with weak digraph constraint (SSGW). In both problems there is given a digraph with sizes assigned to the vertices. Within SSG we want to find a subset of vertices whose total size does not exceed a given capacity and which contains a vertex if at least one of its predecessors is part of the solution. Within SSGW we want to find a subset of vertices whose total size does not exceed a given capacity and which contains a vertex if all its predecessors are part of the solution. SSG and SSGW have been introduced recently by Gourves et al. who studied their complexity for directed acyclic graphs and oriented trees. We show that both problems are NP-hard even on oriented co-graphs and minimal series-parallel digraphs. Further, we provide pseudo-polynomial solutions for SSG and SSGW with digraph constraints given by directed co-graphs and series-parallel digraphs.


title: Giant ratchet magneto-photocurrent in graphene lateral superlattices

abstract: We report on the observation of the magnetic quantum ratchet effect in graphene with a lateral dual-grating top gate (DGG) superlattice. We show that the THz ratchet current exhibits sign-alternating magneto-oscillations due to the Shubnikov-de Haas effect. The amplitude of these oscillations is greatly enhanced as compared to the ratchet effect at zero magnetic field. The direction of the current is determined by the lateral asymmetry which can be controlled by variation of gate potentials in DGG. We also study the dependence of the ratchet current on the orientation of the terahertz electric field (for linear polarization) and on the radiation helicity (for circular polarization). Notably, in the latter case, switching from right- to left-circularly polarized radiation results in an inversion of the photocurrent direction. We demonstrate that most of our observations can be well fitted by the drift-diffusion approximation based on the Boltzmann kinetic equation with the Landau quantization fully encoded in the oscillations of the density of states.


title: Optical frequency combs in quadratically nonlinear resonators

abstract: Optical frequency combs are one of the most remarkable inventions of the last decades. Originally conceived as the spectral counterpart of the train of short pulses emitted by mode-locked lasers, frequency combs have also been subsequently generated in continuously pumped microresonators, through third-order parametric processes. Quite recently, direct generation of optical frequency combs has been demonstrated in continuous-wave laser-pumped optical resonators with a second-order nonlinear medium inside. Here, we presents a concise introduction to such quadratic combs and the physical mechanism that underlies their formation. We mainly review our recent experimental and theoretical work on formation and dynamics of such quadratic frequency combs. We experimentally demonstrated comb generation in two configurations: a cavity for second harmonic generation, where combs are generated both around the pump frequency and its second harmonic, and a degenerate optical parametric oscillator, where combs are generated around the pump frequency and its sub-harmonic. The experiments have been supported by a thorough theoretical analysis, aimed at modelling the dynamics of quadratic combs, both in frequency and time domains, providing useful insights into the physics of this new class of optical frequency comb synthesizers. Quadratic combs establish a new class of efficient frequency comb synthesizers, with unique features, which could enable straightforward access to new spectral regions and stimulate novel applications.


title: Multiclass Classification via Class-Weighted Nearest Neighbors

abstract: We study statistical properties of the k-nearest neighbors algorithm for multiclass classification, with a focus on settings where the number of classes may be large and/or classes may be highly imbalanced. In particular, we consider a variant of the k-nearest neighbor classifier with non-uniform class-weightings, for which we derive upper and minimax lower bounds on accuracy, class-weighted risk, and uniform error. Additionally, we show that uniform error bounds lead to bounds on the difference between empirical confusion matrix quantities and their population counterparts across a set of weights. As a result, we may adjust the class weights to optimize classification metrics such as F1 score or Matthew's Correlation Coefficient that are commonly used in practice, particularly in settings with imbalanced classes. We additionally provide a simple example to instantiate our bounds and numerical experiments.


title: Modular forms, deformation of punctured spheres, and extensions of symmetric tensor representations

abstract: Let~$X=\Po/\Gamma$ be an~$n$-punctured sphere, $n>3$. We introduce and study~$n-3$ deformation operators on the space of modular forms~$M_*(\Gamma)$ based on the classical theory of uniformizing differential equations and accessory parameters. When restricting to modular functions, we recover a construction in Teichm\"uller theory related to the deformation of the complex structure of~$X$. We describe the deformation operators in terms of derivations with respect to Eichler integrals of weight-four cusp forms, and in terms of vector-valued modular forms attached to extensions of symmetric tensor representations.


title: Industrial Forecasting with Exponentially Smoothed Recurrent Neural Networks

abstract: Time series modeling has entered an era of unprecedented growth in the size and complexity of data which require new modeling approaches. While many new general purpose machine learning approaches have emerged, they remain poorly understand and irreconcilable with more traditional statistical modeling approaches. We present a general class of exponential smoothed recurrent neural networks (RNNs) which are well suited to modeling non-stationary dynamical systems arising in industrial applications. In particular, we analyze their capacity to characterize the non-linear partial autocorrelation structure of time series and directly capture dynamic effects such as seasonality and trends. Application of exponentially smoothed RNNs to forecasting electricity load, weather data, and stock prices highlight the efficacy of exponential smoothing of the hidden state for multi-step time series forecasting. The results also suggest that popular, but more complicated neural network architectures originally designed for speech processing, such as LSTMs and GRUs, are likely over-engineered for industrial forecasting and light-weight exponentially smoothed architectures, trained in a fraction of the time, capture the salient features while being superior and more robust than simple RNNs and ARIMA models. Additionally uncertainty quantification of the exponential smoothed recurrent neural networks, provided by Bayesian estimation, is shown to provide improved coverage.


title: Large cliques and independent sets all over the place

abstract: We study the following question raised by Erd\H{o}s and Hajnal in the early 90's. Over all $n$-vertex graphs $G$ what is the smallest possible value of $m$ for which any $m$ vertices of $G$ contain both a clique and an independent set of size $\log n$? We construct examples showing that $m$ is at most $2^{2^{(\log\log n)^{1/2+o(1)}}}$ obtaining a twofold sub-polynomial improvement over the upper bound of about $\sqrt{n}$ coming from the natural guess, the random graph. Our (probabilistic) construction gives rise to new examples of Ramsey graphs, which while having no very large homogenous subsets contain both cliques and independent sets of size $\log n$ in any small subset of vertices. This is very far from being true in random graphs. Our proofs are based on an interplay between taking lexicographic products and using randomness.