title: Magnetic-free traveling-wave nonreciprocal superconducting microwave components

abstract: We propose a design to realize integrated broadband nonreciprocal microwave isolators and circulators using superconducting circuit elements without any magnetic materials. To obtain a broadband response, we develop a waveguide-based design by temporal modulations. The corresponding compact traveling-wave structure is implemented with integrated superconducting composite right-/left-handed transmission lines. The calculations show that the bandwidth of 580 MHz can be realized over a nonreciprocal isolation of 20 dB in reflections. Such on-chip isolators and circulators are useful for cryogenic integrated microwave connections and measurements, such as protecting qubits from the amplified reflected signal in multiplexed readout.


title: The topological Dirac equation of networks and simplicial complexes

abstract: We define the topological Dirac equation describing the evolution of a topological wave function on networks or on simplicial complexes. On networks, the topological wave function describes the dynamics of topological signals or cochains, i.e. dynamical signals defined both on nodes and on links. On simplicial complexes the wave function is also defined on higher-dimensional simplices. Therefore the topological wave function satisfies a relaxed condition of locality as it acquires the same value along simplices of dimension larger than zero. The topological Dirac equation defines eigenstates whose dispersion relation is determined by the spectral properties of the Dirac (or chiral) operator defined on networks and generalized network structures including simplicial complexes and multiplex networks. On simplicial complexes the Dirac equation leads to multiple energy bands. On multiplex networks the topological Dirac equation can be generalized to distinguish between different mutlilinks leading to a natural definition of rotations of the topological spinor. The topological Dirac equation is here initially formulated on a spatial network or simplicial complex for describing the evolution of the topological wave function in continuous time. This framework is also extended to treat the topological Dirac equation on $1+d$ spaces describing a discrete space-time with one temporal dimension and $d$ spatial dimensions with $d\in \{1,2,3\}$. This work includes also the discussion of numerical results obtained by implementing the topological Dirac equation on simplicial complex models and on real simple and multiplex network data.

categories: cond-mat.dis-nn cs.SI gr-qc math-ph math.MP physics.soc-ph


title: Spectral Temporal Graph Neural Network for Trajectory Prediction

abstract: An effective understanding of the contextual environment and accurate motion forecasting of surrounding agents is crucial for the development of autonomous vehicles and social mobile robots. This task is challenging since the behavior of an autonomous agent is not only affected by its own intention, but also by the static environment and surrounding dynamically interacting agents. Previous works focused on utilizing the spatial and temporal information in time domain while not sufficiently taking advantage of the cues in frequency domain. To this end, we propose a Spectral Temporal Graph Neural Network (SpecTGNN), which can capture inter-agent correlations and temporal dependency simultaneously in frequency domain in addition to time domain. SpecTGNN operates on both an agent graph with dynamic state information and an environment graph with the features extracted from context images in two streams. The model integrates graph Fourier transform, spectral graph convolution and temporal gated convolution to encode history information and forecast future trajectories. Moreover, we incorporate a multi-head spatio-temporal attention mechanism to mitigate the effect of error propagation in a long time horizon. We demonstrate the performance of SpecTGNN on two public trajectory prediction benchmark datasets, which achieves state-of-the-art performance in terms of prediction accuracy.


title: Bond-selective interferometric scattering microscopy

abstract: Interferometric scattering microscopy has been a very promising technology for highly sensitive label-free imaging of a broad spectrum of biological nanoparticles from proteins to viruses in a high-throughput manner. Although it can reveal the specimen's size and shape information, the chemical composition is inaccessible in interferometric measurements. Infrared spectroscopic imaging provides chemical specificity based on inherent chemical bond vibrations of specimens but lacks the ability to image and resolve individual nanoparticles due to long infrared wavelengths. Here, we describe a bond-selective interferometric scattering microscope where the mid-infrared induced photothermal signal is detected by a visible beam in a wide-field common-path interferometry configuration. A thin film layered substrate is utilized to reduce the reflected light and provide a reference field for the interferometric detection of the weakly scattered field. A pulsed mid-IR laser is employed to modulate the interferometric signal. Subsequent demodulation via a virtual lock-in camera offers simultaneous chemical information about tens of micro- or nano-particles. The chemical contrast arises from a minute change in the particle's scattered field in consequence of the vibrational absorption at the target molecule. We characterize the system with sub-wavelength polymer beads and highlight biological applications by chemically imaging several microorganisms including Staphylococcus aureus, Escherichia coli, and Candida albicans. A theoretical framework is established to extend bond-selective interferometric scattering microscopy to a broad range of biological micro- and nano-particles.


title: Topics In Rings of Baire one functions and some function rings

abstract: Recently some Mathematician extend the notion of Baire one functions. We give some nice relations between this subring and some nice functions rings on a topological spaces.


title: k-Mixup Regularization for Deep Learning via Optimal Transport

abstract: Mixup is a popular regularization technique for training deep neural networks that improves generalization and increases robustness to certain distribution shifts. It perturbs input training data in the direction of other randomly-chosen instances in the training set. To better leverage the structure of the data, we extend mixup in a simple, broadly applicable way to \emph{$k$-mixup}, which perturbs $k$-batches of training points in the direction of other $k$-batches. The perturbation is done with displacement interpolation, i.e. interpolation under the Wasserstein metric. We demonstrate theoretically and in simulations that $k$-mixup preserves cluster and manifold structures, and we extend theory studying the efficacy of standard mixup to the $k$-mixup case. Our empirical results show that training with $k$-mixup further improves generalization and robustness across several network architectures and benchmark datasets of differing modalities. For the wide variety of real datasets considered, the performance gains of $k$-mixup over standard mixup are similar to or larger than the gains of mixup itself over standard ERM after hyperparameter optimization. In several instances, in fact, $k$-mixup achieves gains in settings where standard mixup has negligible to zero improvement over ERM.


title: Lightweight Dual-channel Target Speaker Separation for Mobile Voice Communication

abstract: Nowadays, there is a strong need to deploy the target speaker separation (TSS) model on mobile devices with a limitation of the model size and computational complexity. To better perform TSS for mobile voice communication, we first make a dual-channel dataset based on a specific scenario, LibriPhone. Specifically, to better mimic the real-case scenario, instead of simulating from the single-channel dataset, LibriPhone is made by simultaneously replaying pairs of utterances from LibriSpeech by two professional artificial heads and recording by two built-in microphones of the mobile. Then, we propose a lightweight time-frequency domain separation model, LSTM-Former, which is based on the LSTM framework with source-to-noise ratio (SI-SNR) loss. For the experiments on Libri-Phone, we explore the dual-channel LSTMFormer model and a single-channel version by a random single channel of Libri-Phone. Experimental result shows that the dual-channel LSTM-Former outperforms the single-channel LSTMFormer with relative 25% improvement. This work provides a feasible solution for the TSS task on mobile devices, playing back and recording multiple data sources in real application scenarios for getting dual-channel real data can assist the lightweight model to achieve higher performance.


title: Normal Subgyrogroups of Certain Gyrogroups

abstract: Suppose that $(T,\star)$ is a groupoid with a left identity such that each element $a\in T$ has a left inverse. Then $T$ is called a \textit{gyrogroup} if and only if $(i)$ there exists a function $gyr:T\times T\longrightarrow Aut(T)$ such that for all $a,b,c\in T$, $a\star(b\star c)= (a\star b)\star gyr[a,b]c$, where $gyr[a,b]c=gyr(a,b)(c)$; and $(ii)$ for all $a,b\in T$, $gyr[a,b]=gyr[a\star b,b]$. In this paper, the structure of normal subgyrogroups of certain gyrogroups are investigated.


title: Paley type inequality on Hardy space in the Dunkl setting

abstract: We investigate $\lambda$-Hilbert transform, $\lambda$-Possion integral and conjugate $\lambda$-Poisson integral on the atomic Hardy space in the Dunkl setting and establish a new version of Paley type inequality which extends the results in \cite{F} and \cite{ZhongKai Li 3}.


title: Generalized Linear One-Way Jumping Finite Automata

abstract: A new discontinuous model of computation called one-way jumping finite automata was defined by H. Chigahara et. al. This model was a restricted version of the model jumping finite automata. These automata read an input symbol-by-symbol and jump only in one direction. A generalized linear one-way jumping finite automaton makes jumps after deleting a substring of an input string and then changes its state. These automata can make sequence of jumps in only one direction on an input string either from left to right or from right to left. We show that newly defined model is powerful than its original counterpart. We define and compare the variants, generalized right linear one-way jumping finite automata and generalized left linear one-way jumping finite automata. We also compare the newly defined models with Chomsky hierarchy. Finally, we explore closure properties of the model.


title: Energy-Based Learning for Cooperative Games, with Applications to Valuation Problems in Machine Learning

abstract: Valuation problems, such as feature interpretation, data valuation and model valuation for ensembles, become increasingly more important in many machine learning applications. Such problems are commonly solved by well-known game-theoretic criteria, such as Shapley value or Banzhaf value. In this work, we present a novel energy-based treatment for cooperative games, with a theoretical justification by the maximum entropy framework. Surprisingly, by conducting variational inference of the energy-based model, we recover various game-theoretic valuation criteria through conducting one-step fixed point iteration for maximizing the mean-field ELBO objective. This observation also verifies the rationality of existing criteria, as they are all attempting to decouple the correlations among the players through the mean-field approach. By running fixed point iteration for multiple steps, we achieve a trajectory of the valuations, among which we define the valuation with the best conceivable decoupling error as the Variational Index. We prove that under uniform initializations, these variational valuations all satisfy a set of game-theoretic axioms. We experimentally demonstrate that the proposed Variational Index enjoys lower decoupling error and better valuation performance on certain synthetic and real-world valuation problems.


title: Approximate controllability of fractional order non-instantaneous impulsive functional evolution equations with state-dependent delay in Banach spaces

abstract: The present paper deals with the control problems governed by fractional non-instantaneous impulsive functional evolution equations with state-dependent delay involving Caputo fractional derivatives in Banach spaces. The main objective of this work is to formulate sufficient conditions for the approximate controllability of the considered system in separable reflexive Banach spaces. We have exploited the resolvent operator technique and Schauder's fixed point theorem in the proofs to achieve this goal. The approximate controllability of linear system is discussed in detail, which lacks in the existing literature. We also provide an example to illustrate the efficiency of the developed results. Moreover, we point out some shortcomings of the existing works in the context of characterization of mild solution and phase space, and approximate controllability of fractional order impulsive systems in Banach spaces.


title: Same State, Different Task: Continual Reinforcement Learning without Interference

abstract: Continual Learning (CL) considers the problem of training an agent sequentially on a set of tasks while seeking to retain performance on all previous tasks. A key challenge in CL is catastrophic forgetting, which arises when performance on a previously mastered task is reduced when learning a new task. While a variety of methods exist to combat forgetting, in some cases tasks are fundamentally incompatible with each other and thus cannot be learnt by a single policy. This can occur, in reinforcement learning (RL) when an agent may be rewarded for achieving different goals from the same observation. In this paper we formalize this "interference" as distinct from the problem of forgetting. We show that existing CL methods based on single neural network predictors with shared replay buffers fail in the presence of interference. Instead, we propose a simple method, OWL, to address this challenge. OWL learns a factorized policy, using shared feature extraction layers, but separate heads, each specializing on a new task. The separate heads in OWL are used to prevent interference. At test time, we formulate policy selection as a multi-armed bandit problem, and show it is possible to select the best policy for an unknown task using feedback from the environment. The use of bandit algorithms allows the OWL agent to constructively re-use different continually learnt policies at different times during an episode. We show in multiple RL environments that existing replay based CL methods fail, while OWL is able to achieve close to optimal performance when training sequentially.


title: A Statistical Analysis Towards Modelling the Fluctuating Torque on Particles in Particle-laden Turbulent Shear Flow

abstract: Dynamics of the particle phase in a particle laden turbulent flow is highly influenced by the fluctuating velocity and vorticity field of the fluid phase. The present work mainly focuses on exploring the possibility of applying a Langevin type of random torque model to predict the rotational dynamics of the particle phase. Towards this objective, direct numerical simulations (DNS) have been carried out for particle laden turbulent shear flow with Reynolds number, $Re_\delta=750$ in presence of sub-Kolmogorov sized inertial particles (Stokes number >>1). The inter-particle and wall-particle interactions have also been considered to be elastic. From the particle equation of rotational motion, we arrive at the expression where the fluctuating angular acceleration fluctuation $\alpha'_i$ of the particle is expressed as the ratio of a linear combination of fluctuating rotational velocities of particle $\omega'_i$ and fluid angular velocity $\Omega'_i$ to the particle rotational relaxation time $\tau_r$. The analysis was done using p.d.f plots and Jensen-Shannon Divergence based method to assess the similarity of the particle net rotational acceleration distribution $f(\alpha'_i)$, with (i) the distributions of particle acceleration component arising from fluctuating fluid angular velocity computed in the particle-Largrangian frame $f(\Omega'_i/\tau_r)_{pl}$, (ii) fluctuating particle angular velocity $f(\omega'_i/\tau_r)_{pl}$, and (iii) the fluid angular velocity $(\Omega'_i/\tau_r)_{e}$, computed in the fluid Eulerian grids. The analysis leads to the conclusion that $f(\alpha'_i)$ can be modeled with a Gaussian white noise using a pre-estimated strength which can be calculated from the temporal correlation of $(\Omega'_i/\tau_r)_{e}$.


title: Time-Optimal Sublinear Algorithms for Matching and Vertex Cover

abstract: We study the problem of estimating the size of maximum matching and minimum vertex cover in sublinear time. Denoting the number of vertices by $n$ and the average degree in the graph by $\bar{d}$, we obtain the following results for both problems: * A multiplicative $(2+\epsilon)$-approximation that takes $\tilde{O}(n/\epsilon^2)$ time using adjacency list queries. * A multiplicative-additive $(2, \epsilon n)$-approximation in $\tilde{O}((\bar{d} + 1)/\epsilon^2)$ time using adjacency list queries. * A multiplicative-additive $(2, \epsilon n)$-approximation in $\tilde{O}(n/\epsilon^{3})$ time using adjacency matrix queries. All three results are provably time-optimal up to polylogarithmic factors culminating a long line of work on these problems. Our main contribution and the key ingredient leading to the bounds above is a new and near-tight analysis of the average query complexity of the randomized greedy maximal matching algorithm which improves upon a seminal result of Yoshida, Yamamoto, and Ito [STOC'09].


title: Learning Routines for Effective Off-Policy Reinforcement Learning

abstract: The performance of reinforcement learning depends upon designing an appropriate action space, where the effect of each action is measurable, yet, granular enough to permit flexible behavior. So far, this process involved non-trivial user choices in terms of the available actions and their execution frequency. We propose a novel framework for reinforcement learning that effectively lifts such constraints. Within our framework, agents learn effective behavior over a routine space: a new, higher-level action space, where each routine represents a set of 'equivalent' sequences of granular actions with arbitrary length. Our routine space is learned end-to-end to facilitate the accomplishment of underlying off-policy reinforcement learning objectives. We apply our framework to two state-of-the-art off-policy algorithms and show that the resulting agents obtain relevant performance improvements while requiring fewer interactions with the environment per episode, improving computational efficiency.


title: Construction and convergence results for stable webs

abstract: We introduce a new metric for collections of aged paths and a robust set of criteria for compactness for a set of collection of aged paths in the topology corresponding to this metric. We show that the distribution of stable webs ($1< \alpha \leq 2$) made up of collections of stable paths is tight in this topology. We then show the weak convergence of appropriately normalized systems of coalescing random walks in the domain of attraction of stable laws for $1 < \alpha \leq 2$ under this metric to the corresponding stable web. We obtain some path results in the brownian case.


title: The Rohingyas of Rakhine State: Social Evolution and History in the Light of Ethnic Nationalism

abstract: Recent event of ousting Rohingyas from Rakhine State by the Tatmadaw provoked worldwide public-and-academic interest in history and social evolution of the Rohingyas, and this is to what the article is devoted. As the existing literature presents a debate over Who are the Rohingyas?, and How legitimate is their claim over Rakhine State?, the paper reinvestigates the issues using a qualitative research method. Compiling a detailed history, the paper finds that Rohingya community developed through historically complicated processes marked by invasions and counter-invasions. The paper argues many people entered Bengal from Arakan before British brought people into Rakhine state. The Rohingyas believe Rakhine State is their ancestral homeland and they developed a sense of Ethnic Nationalism. Their right over Rakhine State is as significant as other groups. The paper concludes that the UN must pursue solution to the crisis and the government should accept the Rohingyas as it did the land or territory.


title: A Gaussian Approximation Potential for Amorphous Si:H

abstract: Hydrogenation of amorphous silicon (a-Si:H) is critical for reducing defect densities, passivating mid-gap states and surfaces, and improving photoconductivity in silicon-based electro-optical devices. Modelling the atomic scale structure of this material is critical to understanding these processes, which in turn is needed to describe c-Si/a-Si:H heterjunctions that are at the heart of the modern solar cells with world record efficiency. Density functional theory (DFT) studies achieve the required high accuracy but are limited to moderate system sizes a hundred atoms or so by their high computational cost. Simulations of amorphous materials in particular have been hindered by this high cost because large structural models are required to capture the medium range order that is characteristic of such materials. Empirical potential models are much faster, but their accuracy is not sufficient to correctly describe the frustrated local structure. Data driven, "machine learned" interatomic potentials have broken this impasse, and have been highly successful in describing a variety of amorphous materials in their elemental phase. Here we extend the Gaussian approximation potential (GAP) for silicon by incorporating the interaction with hydrogen, thereby significantly improving the degree of realism with which amorphous silicon can be modelled. We show that our Si:H GAP enables the simulation of hydrogenated silicon with an accuracy very close to DFT, but with computational expense and run times reduced by several orders of magnitude for large structures. We demonstrate the capabilities of the Si:H GAP by creating models of hydrogenated liquid and amorphous silicon, and showing that their energies, forces and stresses are in excellent agreement with DFT results, and their structure as captured by bond and angle distributions, with both DFT and experiments.


title: Complexity of Modular Circuits

abstract: We study how the complexity of modular circuits computing AND depends on the depth of the circuits and the prime factorization of the modulus they use. In particular our construction of subexponential circuits of depth 2 for AND helps us to classify (modulo Exponential Time Hypothesis) modular circuits with respect to the complexity of their satisfiability. We also study a precise correlation between this complexity and the sizes of modular circuits realizing AND. On the other hand showing that AND can be computed by a polynomial size probabilistic modular circuit of depth 2 (with O(log n) random bits) providing a probabilistic computational model that can not be derandomized. We apply our methods to determine (modulo ETH) the complexity of solving equations over groups of symmetries of regular polygons with an odd number of sides. These groups form a paradigm for some of the remaining cases in characterizing finite groups with respect to the complexity of their equation solving.


title: Neural dSCA: demixing multimodal interaction among brain areas during naturalistic experiments

abstract: Multi-regional interaction among neuronal populations underlies the brain's processing of rich sensory information in our daily lives. Recent neuroscience and neuroimaging studies have increasingly used naturalistic stimuli and experimental design to identify such realistic sensory computation in the brain. However, existing methods for cross-areal interaction analysis with dimensionality reduction, such as reduced-rank regression and canonical correlation analysis, have limited applicability and interpretability in naturalistic settings because they usually do not appropriately 'demix' neural interactions into those associated with different types of task parameters or stimulus features (e.g., visual or audio). In this paper, we develop a new method for cross-areal interaction analysis that uses the rich task or stimulus parameters to reveal how and what types of information are shared by different neural populations. The proposed neural demixed shared component analysis combines existing dimensionality reduction methods with a practical neural network implementation of functional analysis of variance with latent variables, thereby efficiently demixing nonlinear effects of continuous and multimodal stimuli. We also propose a simplifying alternative under the assumptions of linear effects and unimodal stimuli. To demonstrate our methods, we analyzed two human neuroimaging datasets of participants watching naturalistic videos of movies and dance movements. The results demonstrate that our methods provide new insights into multi-regional interaction in the brain during naturalistic sensory inputs, which cannot be captured by conventional techniques.


title: Distant emitters in ultrastrong waveguide QED: Ground-state properties and non-Markovian dynamics

abstract: Starting from the paradigmatic spin-boson model (SBM), we investigate the static and dynamical properties of a system of two distant two-level emitters coupled to a one-dimensional Ohmic waveguide beyond the rotating wave approximation. Employing static and dynamical polaron Ans\"atze we study the effects of finite separation distance on the behavior of the photon-mediated Ising-like interaction, qubit frequency renormalization, ground-state magnetization, and entanglement entropy of the two-qubit system. Based on previous works we derive an effective approximate Hamiltonian for the two-impurity SBM that preserves the excitation-number and thus facilitates the analytical treatment. In particular, it allows us to introduce non-Markovianity arising from delay-feedback effects in two distant emitters in the so-called ultrastrong coupling (USC) regime. We test our results with numerical simulations performed over a discretized circuit-QED model, finding perfect agreement with previous results, and showing interesting dynamical effects arising in ultrastrong waveguide QED with distant emitters. In particular, we revisit the Fermi two-atom problem showing that, in the USC regime, initial correlations yield two different evolutions for symmetric and antisymmetric states even before the emitters become causally connected. Finally, we demonstrate that the collective dynamics, e.g., superradiance or subradiance, are affected not only by the distance between emitters, but also by the coupling, due to significant frequency renormalization. This constitutes another dynamical consequence of the USC regime.


title: Second-order finite difference approximations of the upper-convected time derivative

abstract: In this work, new finite difference schemes are presented for dealing with the upper-convected time derivative in the context of the generalized Lie derivative. The upper-convected time derivative, which is usually encountered in the constitutive equation of the popular viscoelastic models, is reformulated in order to obtain approximations of second-order in time for solving a simplified constitutive equation in one and two dimensions. The theoretical analysis of the truncation errors of the methods takes into account the linear and quadratic interpolation operators based on a Lagrangian framework. Numerical experiments illustrating the theoretical results for the model equation defined in one and two dimensions are included. Finally, the finite difference approximations of second-order in time are also applied for solving a two-dimensional Oldroyd-B constitutive equation subjected to a prescribed velocity field at different Weissenberg numbers.


title: Controller Synthesis for Omega-Regular and Steady-State Specifications

abstract: Given a Markov decision process (MDP) and a linear-time ($\omega$-regular or LTL) specification, the controller synthesis problem aims to compute the optimal policy that satisfies the specification. More recently, problems that reason over the asymptotic behavior of systems have been proposed through the lens of steady-state planning. This entails finding a control policy for an MDP such that the Markov chain induced by the solution policy satisfies a given set of constraints on its steady-state distribution. This paper studies a generalization of the controller synthesis problem for a linear-time specification under steady-state constraints on the asymptotic behavior. We present an algorithm to find a deterministic policy satisfying $\omega$-regular and steady-state constraints by characterizing the solutions as an integer linear program, and experimentally evaluate our approach.


title: Brno Urban Dataset: Winter Extention

abstract: Research on autonomous driving is advancing dramatically and requires new data and techniques to progress even further. To reflect this pressure, we present an extension of our recent work - the Brno Urban Dataset (BUD). The new data focus on winter conditions in various snow-covered environments and feature additional LiDAR and radar sensors for object detection in front of the vehicle. The improvement affects the old data as well. We provide YOLO detection annotations for all old RGB images in the dataset. The detections are further also transferred by our original algorithm into the infra-red (IR) images, captured by the thermal camera. To our best knowledge, it makes this dataset the largest source of machine-annotated thermal images currently available. The dataset is published under MIT license on https://github.com/Robotics-BUT/Brno-Urban-Dataset.


title: Visual Search Asymmetry: Deep Nets and Humans Share Similar Inherent Biases

abstract: Visual search is a ubiquitous and often challenging daily task, exemplified by looking for the car keys at home or a friend in a crowd. An intriguing property of some classical search tasks is an asymmetry such that finding a target A among distractors B can be easier than finding B among A. To elucidate the mechanisms responsible for asymmetry in visual search, we propose a computational model that takes a target and a search image as inputs and produces a sequence of eye movements until the target is found. The model integrates eccentricity-dependent visual recognition with target-dependent top-down cues. We compared the model against human behavior in six paradigmatic search tasks that show asymmetry in humans. Without prior exposure to the stimuli or task-specific training, the model provides a plausible mechanism for search asymmetry. We hypothesized that the polarity of search asymmetry arises from experience with the natural environment. We tested this hypothesis by training the model on augmented versions of ImageNet where the biases of natural images were either removed or reversed. The polarity of search asymmetry disappeared or was altered depending on the training protocol. This study highlights how classical perceptual properties can emerge in neural network models, without the need for task-specific training, but rather as a consequence of the statistical properties of the developmental diet fed to the model. All source code and data are publicly available at https://github.com/kreimanlab/VisualSearchAsymmetry.


title: Denoising Word Embeddings by Averaging in a Shared Space

abstract: We introduce a new approach for smoothing and improving the quality of word embeddings. We consider a method of fusing word embeddings that were trained on the same corpus but with different initializations. We project all the models to a shared vector space using an efficient implementation of the Generalized Procrustes Analysis (GPA) procedure, previously used in multilingual word translation. Our word representation demonstrates consistent improvements over the raw models as well as their simplistic average, on a range of tasks. As the new representations are more stable and reliable, there is a noticeable improvement in rare word evaluations.


title: Symbolic powers of generalized star configurations of hypersurfaces

abstract: We introduce the class of sparse symmetric shifted monomial ideals. These ideals have linear quotients and their Betti numbers are computed. Using this, we prove that the symbolic powers of the generalized star configuration ideal are sequentially Cohen--Macaulay under some mild genericness assumption. With respect to these symbolic powers, we also consider the Harbourne--Huneke containment problem and establish the Demailly-like bound.


title: KupenStack: Kubernetes based Cloud Native OpenStack

abstract: OpenStack is an open-source private cloud used to run VMs and its related cloud services. OpenStack deployment, management, and upgradation require lots of efforts and manual troubleshooting. Also, workloads and services offered by OpenStack cannot self-heal itself on failures. We present KupenStack, a Cloud-Native OpenStack as Code model built on top of Kubernetes stack as Custom Resources. KupenStack is a controller that interacts between Kubernetes and OpenStack and automates complex operations like scaling, LCM, zero-downtime, self-healing, version upgrades, configuration management, and offers OpenStack as a service through code. KupenStack builds cloud-native values like immutable infrastructure, declarative APIs for OpenStack without changing any OpenStack code. If a VM workload goes down for some reason, then KupenStack handles it and automatically spins up a new instance. KupenStack uses OpenStack on Kubernetes deployment for lifecycle management of OpenStack.


title: A local normal form for Hamiltonian actions of compact semisimple Poisson-Lie groups

abstract: The main contribution of this manuscript is a local normal form for Hamiltonian actions of Poisson-Lie groups $K$ on a symplectic manifold equipped with an $AN$-valued moment map, where $AN$ is the dual Poisson-Lie group of $K$. Our proof uses the delinearization theorem of Alekseev which relates a classical Hamiltonian action of $K$ with $\mathfrak{k}^*$-valued moment map to a Hamiltonian action with an $AN$-valued moment map, via a deformation of symplectic structures. We obtain our main result by proving a ``delinearization commutes with symplectic quotients'' theorem which is also of independent interest, and then putting this together with the local normal form theorem for classical Hamiltonian actions wtih $\mathfrak{k}^*$-valued moment maps. A key ingredient for our main result is the delinearization $\mathcal{D}(\omega_{can})$ of the canonical symplectic structure on $T^*K$, so we additionally take some steps toward explicit computations of $\mathcal{D}(\omega_{can})$. In particular, in the case $K=SU(2)$, we obtain explicit formulas for the matrix coefficients of $\mathcal{D}(\omega_{can})$ with respect to a natural choice of coordinates on $T^*SU(2)$.


title: Zeroth-Order Algorithms for Stochastic Distributed Nonconvex Optimization

abstract: In this paper, we consider a stochastic distributed nonconvex optimization problem with the cost function being distributed over $n$ agents having access only to zeroth-order (ZO) information of the cost. This problem has various machine learning applications. As a solution, we propose two distributed ZO algorithms, in which at each iteration each agent samples the local stochastic ZO oracle at two points with a time-varying smoothing parameter. We show that the proposed algorithms achieve the linear speedup convergence rate $\mathcal{O}(\sqrt{p/(nT)})$ for smooth cost functions under the state-dependent variance assumptions which are more general than the commonly used bounded variance and Lipschitz assumptions, and $\mathcal{O}(p/(nT))$ convergence rate when the global cost function additionally satisfies the Polyak--{\L}ojasiewicz (P--{\L}) condition in addition, where $p$ and $T$ are the dimension of the decision variable and the total number of iterations, respectively. To the best of our knowledge, this is the first linear speedup result for distributed ZO algorithms, which enables systematic processing performance improvements by adding more agents. We also show that the proposed algorithms converge linearly under the relative bounded second moment assumptions and the P--{\L} condition. We demonstrate through numerical experiments the efficiency of our algorithms on generating adversarial examples from deep neural networks in comparison with baseline and recently proposed centralized and distributed ZO algorithms.


title: Reflecting (on) the modulo 9 Kanade--Russell (conjectural) identities

abstract: We examine complexity and versatility of five modulo 9 Kanade--Russell identities through their finite (aka polynomial) versions and images under the $q\mapsto1/q$ reflection.


title: Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation

abstract: A critical challenge faced by supervised word sense disambiguation (WSD) is the lack of large annotated datasets with sufficient coverage of words in their diversity of senses. This inspired recent research on few-shot WSD using meta-learning. While such work has successfully applied meta-learning to learn new word senses from very few examples, its performance still lags behind its fully supervised counterpart. Aiming to further close this gap, we propose a model of semantic memory for WSD in a meta-learning setting. Semantic memory encapsulates prior experiences seen throughout the lifetime of the model, which aids better generalization in limited data settings. Our model is based on hierarchical variational inference and incorporates an adaptive memory update rule via a hypernetwork. We show our model advances the state of the art in few-shot WSD, supports effective learning in extremely data scarce (e.g. one-shot) scenarios and produces meaning prototypes that capture similar senses of distinct words.


title: Meta-research on COVID-19: An overview of the early trends

abstract: COVID-19 is having a dramatic impact on research and researchers. The pandemic has underlined the severity of known challenges in research and surfaced new ones, but also accelerated the adoption of innovations and manifested new opportunities. This review considers early trends emerging from meta-research on COVID-19. In particular, it focuses on the following topics: i) mapping COVID-19 research; ii) data and machine learning; iii) research practices including open access and open data, reviewing, publishing and funding; iv) communicating research to the public; v) the impact of COVID-19 on researchers, in particular with respect to gender and career trajectories. This overview finds that most early meta-research on COVID-19 has been reactive and focused on short-term questions, while more recently a shift to consider the long-term consequences of COVID-19 is taking place. Based on these findings, the author speculates that some aspects of doing research during COVID-19 are more likely to persist than others. These include: the shift to virtual for academic events such as conferences; the use of openly accessible pre-prints; the `datafication' of scholarly literature and consequent broader adoption of machine learning in science communication; the public visibility of research and researchers on social and online media.


title: The THDMa revisited

abstract: The THDMa is a new physics model that extends the scalar sector of the Standard Model by an additional doublet as well as a pseudoscalar singlet and allows for mixing between all possible scalar states. In the gauge-eigenbasis, the additional pseudoscalar serves as a portal to the dark sector, with a priori any dark matter spins states. The option where dark matter is fermionic is currently one of the standard benchmarks for the experimental collaborations, and several searches at the LHC constrain the corresponding parameter space. However, most current studies constrain regions in parameter space by setting all but 2 of the 12 free parameters to fixed values. In this work, we perform a generic scan on this model, allowing all parameters to float. We apply all current theoretical and experimental constraints, including bounds from current searches, recent results from B-physics, in particular B_s -> X_s gamma, as well as bounds from astroparticle physics. We identify regions in the parameter space which are still allowed after these have been applied and which might be interesting for an investigation at current and future collider machines.


title: Cosmic expansion parametrization: Implication for curvature and $\text{H}_{0}$ tension

abstract: We propose an analytical parametrization of the comoving distance and Hubble parameter to study the cosmic expansion history beyond the vanilla $\Lambda$CDM model. The parametrization is generalized enough to include the contribution of spatial curvature and to capture the higher redshift behaviors. With this parameterization, we study the late time cosmic behavior and put constraints on the cosmological parameters like present values of Hubble parameter ($H_{0}$), matter energy density parameter ($\Omega_{m0}$), spatial curvature energy density parameter ($\Omega_{k0}$) and baryonic matter energy density parameter ($\Omega_{b0}$) using different combinations data like CMB (Cosmic microwave background), BAO (baryon acoustic oscillation), and SN (Pantheon sample for type Ia supernovae). We also rigorously study the Hubble tension in the framework of late time modification from the standard $\Lambda$CDM model. We find that the late time modification of the cosmic expansion can solve the Hubble tension between CMB $\&$ SHOES (local distance ladder observation for $H_{0}$), between CMB+BAO $\&$ SHOES and between CMB+SN $\&$ SHOES, but the late time modification can not solve the Hubble tension between CMB+BAO+SN and SHOES. That means CMB, BAO, and SN data combined put strong enough constraints on $H_{0}$ (even with varying $\Omega_{k0}$) and on other background cosmological parameters so that the addition of $H_{0}$ prior from SHOES (or from similar other local distance observations) can not significantly pull the $H_{0}$ value towards the corresponding SHOES value.


title: A Review of Machine Learning Classification Using Quantum Annealing for Real-world Applications

abstract: Optimizing the training of a machine learning pipeline helps in reducing training costs and improving model performance. One such optimizing strategy is quantum annealing, which is an emerging computing paradigm that has shown potential in optimizing the training of a machine learning model. The implementation of a physical quantum annealer has been realized by D-Wave systems and is available to the research community for experiments. Recent experimental results on a variety of machine learning applications using quantum annealing have shown interesting results where the performance of classical machine learning techniques is limited by limited training data and high dimensional features. This article explores the application of D-Wave's quantum annealer for optimizing machine learning pipelines for real-world classification problems. We review the application domains on which a physical quantum annealer has been used to train machine learning classifiers. We discuss and analyze the experiments performed on the D-Wave quantum annealer for applications such as image recognition, remote sensing imagery, computational biology, and particle physics. We discuss the possible advantages and the problems for which quantum annealing is likely to be advantageous over classical computation.


title: Extracting Weighted Automata for Approximate Minimization in Language Modelling

abstract: In this paper we study the approximate minimization problem for language modelling. We assume we are given some language model as a black box. The objective is to obtain a weighted finite automaton (WFA) that fits within a given size constraint and which mimics the behaviour of the original model while minimizing some notion of distance between the black box and the extracted WFA. We provide an algorithm for the approximate minimization of black boxes trained for language modelling of sequential data over a one-letter alphabet. By reformulating the problem in terms of Hankel matrices, we leverage classical results on the approximation of Hankel operators, namely the celebrated Adamyan-Arov-Krein (AAK) theory. This allows us to use the spectral norm to measure the distance between the black box and the WFA. We provide theoretical guarantees to study the potentially infinite-rank Hankel matrix of the black box, without accessing the training data, and we prove that our method returns an asymptotically-optimal approximation.


title: The maximum number of 10- and 12-cycles in a planar graph

abstract: For a fixed planar graph $H$, let $\operatorname{\mathbf{N}}_{\mathcal{P}}(n,H)$ denote the maximum number of copies of $H$ in an $n$-vertex planar graph. In the case when $H$ is a cycle, the asymptotic value of $\operatorname{\mathbf{N}}_{\mathcal{P}}(n,C_m)$ is currently known for $m\in\{3,4,5,6,8\}$. In this note, we extend this list by establishing $\operatorname{\mathbf{N}}_{\mathcal{P}}(n,C_{10})\sim(n/5)^5$ and $\operatorname{\mathbf{N}}_{\mathcal{P}}(n,C_{12})\sim(n/6)^6$. We prove this by answering the following question for $m\in\{5,6\}$, which is interesting in its own right: which probability mass $\mu$ on the edges of some clique maximizes the probability that $m$ independent samples from $\mu$ form an $m$-cycle?


title: Genuinely quantum SudoQ and its cardinality

abstract: We expand the quantum variant of the popular game Sudoku by introducing the notion of cardinality of a quantum Sudoku (SudoQ), equal to the number of distinct vectors appearing in the pattern. Our considerations are focused on the genuinely quantum solutions, which are the solutions of size $N^2$ that have cardinality greater than $N^2$, and therefore cannot be reduced to classical counterparts by a unitary transformation. We find the complete parameterization of the genuinely quantum solutions of $4 \times 4$ SudoQ game and establish that in this case the admissible cardinalities are 4, 6, 8 and 16. In particular, a solution with the maximal cardinality equal to 16 is presented. Furthermore, the parametrization enabled us to prove a recent conjecture of Nechita and Pillet for this special dimension. In general, we proved that for any $N$ it is possible to find an $N^2 \times N^2$ SudoQ solution of cardinality $N^4$, which for a prime $N$ is related to a set of $N$ mutually unbiased bases of size $N^2$. Such a construction of $N^4$ different vectors of size $N$ yields a set of $N^3$ orthogonal measurements.


title: Low Budget Active Learning via Wasserstein Distance: An Integer Programming Approach

abstract: Active learning is the process of training a model with limited labeled data by selecting a core subset of an unlabeled data pool to label. The large scale of data sets used in deep learning forces most sample selection strategies to employ efficient heuristics. This paper introduces an integer optimization problem for selecting a core set that minimizes the discrete Wasserstein distance from the unlabeled pool. We demonstrate that this problem can be tractably solved with a Generalized Benders Decomposition algorithm. Our strategy uses high-quality latent features that can be obtained by unsupervised learning on the unlabeled pool. Numerical results on several data sets show that our optimization approach is competitive with baselines and particularly outperforms them in the low budget regime where less than one percent of the data set is labeled.


title: FedNL: Making Newton-Type Methods Applicable to Federated Learning

abstract: Inspired by recent work of Islamov et al (2021), we propose a family of Federated Newton Learn (FedNL) methods, which we believe is a marked step in the direction of making second-order methods applicable to FL. In contrast to the aforementioned work, FedNL employs a different Hessian learning technique which i) enhances privacy as it does not rely on the training data to be revealed to the coordinating server, ii) makes it applicable beyond generalized linear models, and iii) provably works with general contractive compression operators for compressing the local Hessians, such as Top-$K$ or Rank-$R$, which are vastly superior in practice. Notably, we do not need to rely on error feedback for our methods to work with contractive compressors. Moreover, we develop FedNL-PP, FedNL-CR and FedNL-LS, which are variants of FedNL that support partial participation, and globalization via cubic regularization and line search, respectively, and FedNL-BC, which is a variant that can further benefit from bidirectional compression of gradients and models, i.e., smart uplink gradient and smart downlink model compression. We prove local convergence rates that are independent of the condition number, the number of training data points, and compression variance. Our communication efficient Hessian learning technique provably learns the Hessian at the optimum. Finally, we perform a variety of numerical experiments that show that our FedNL methods have state-of-the-art communication complexity when compared to key baselines.


title: Modeling Coordinated vs. P2P Mining: An Analysis of Inefficiency and Inequality in Proof-of-Work Blockchains

abstract: We study efficiency in a proof-of-work blockchain with non-zero latencies, focusing in particular on the (inequality in) individual miners' efficiencies. Prior work attributed differences in miners' efficiencies mostly to attacks, but we pursue a different question: Can inequality in miners' efficiencies be explained by delays, even when all miners are honest? Traditionally, such efficiency-related questions were tackled only at the level of the overall system, and in a peer-to-peer (P2P) setting where miners directly connect to one another. Despite it being common today for miners to pool compute capacities in a mining pool managed by a centralized coordinator, efficiency in such a coordinated setting has barely been studied. In this paper, we propose a simple model of a proof-of-work blockchain with latencies for both the P2P and the coordinated settings. We derive a closed-form expression for the efficiency in the coordinated setting with an arbitrary number of miners and arbitrary latencies, both for the overall system and for each individual miner. We leverage this result to show that inequalities arise from variability in the delays, but that if all miners are equidistant from the coordinator, they have equal efficiency irrespective of their compute capacities. We then prove that, under a natural consistency condition, the overall system efficiency in the P2P setting is higher than that in the coordinated setting. Finally, we perform a simulation-based study to demonstrate that even in the P2P setting delays between miners introduce inequalities, and that there is a more complex interplay between delays and compute capacities.


title: Benjamin-Ono Soliton Dynamics in a slowly varying potential revisited

abstract: The Benjamin Ono equation with a slowly varying potential is $$ \text{(pBO)} \qquad u_t + (Hu_x-Vu + \tfrac12 u^2)_x=0 $$ with $V(x)=W(hx)$, $0< h \ll 1$, and $W\in C_c^\infty(\mathbb{R})$, and $H$ denotes the Hilbert transform. The soliton profile is $$Q_{a,c}(x) = cQ(c(x-a)) \,, \text{ where } Q(x) = \frac{4}{1+x^2}$$ and $a\in \mathbb{R}$, $c>0$ are parameters. For initial condition $u_0(x)$ to (pBO) close to $Q_{0,1}(x)$, it was shown in a previous work by Z. Zhang that the solution $u(x,t)$ to (pBO) remains close to $Q_{a(t),c(t)}(x)$ and approximate parameter dynamics for $(a,c)$ were provided, on a dynamically relevant time scale. In this paper, we prove exact $(a,c)$ parameter dynamics. This is achieved using the basic framework of the previous work by Z. Zhang but adding a local virial estimate for the linearization of (pBO) around the soliton. This is a local-in-space estimate averaged in time, often called a local smoothing estimate, showing that effectively the remainder function in the perturbation analysis is smaller near the soliton than globally in space. A weaker version of this estimate is proved in a paper by Kenig & Martel as part of a "linear Liouville" result, and we have adapted and extended their proof for our application.


title: Zero-shot Task Adaptation using Natural Language

abstract: Imitation learning and instruction-following are two common approaches to communicate a user's intent to a learning agent. However, as the complexity of tasks grows, it could be beneficial to use both demonstrations and language to communicate with an agent. In this work, we propose a novel setting where an agent is given both a demonstration and a description, and must combine information from both the modalities. Specifically, given a demonstration for a task (the source task), and a natural language description of the differences between the demonstrated task and a related but different task (the target task), our goal is to train an agent to complete the target task in a zero-shot setting, that is, without any demonstrations for the target task. To this end, we introduce Language-Aided Reward and Value Adaptation (LARVA) which, given a source demonstration and a linguistic description of how the target task differs, learns to output a reward / value function that accurately describes the target task. Our experiments show that on a diverse set of adaptations, our approach is able to complete more than 95% of target tasks when using template-based descriptions, and more than 70% when using free-form natural language.


title: Forced Variational Integrator Networks for Prediction and Control of Mechanical Systems

abstract: As deep learning becomes more prevalent for prediction and control of real physical systems, it is important that these overparameterized models are consistent with physically plausible dynamics. This elicits a problem with how much inductive bias to impose on the model through known physical parameters and principles to reduce complexity of the learning problem to give us more reliable predictions. Recent work employs discrete variational integrators parameterized as a neural network architecture to learn conservative Lagrangian systems. The learned model captures and enforces global energy preserving properties of the system from very few trajectories. However, most real systems are inherently non-conservative and, in practice, we would also like to apply actuation. In this paper we extend this paradigm to account for general forcing (e.g. control input and damping) via discrete d'Alembert's principle which may ultimately be used for control applications. We show that this forced variational integrator networks (FVIN) architecture allows us to accurately account for energy dissipation and external forcing while still capturing the true underlying energy-based passive dynamics. We show that in application this can result in highly-data efficient model-based control and can predict on real non-conservative systems.


title: Enhancing Taxonomy Completion with Concept Generation via Fusing Relational Representations

abstract: Automatic construction of a taxonomy supports many applications in e-commerce, web search, and question answering. Existing taxonomy expansion or completion methods assume that new concepts have been accurately extracted and their embedding vectors learned from the text corpus. However, one critical and fundamental challenge in fixing the incompleteness of taxonomies is the incompleteness of the extracted concepts, especially for those whose names have multiple words and consequently low frequency in the corpus. To resolve the limitations of extraction-based methods, we propose GenTaxo to enhance taxonomy completion by identifying positions in existing taxonomies that need new concepts and then generating appropriate concept names. Instead of relying on the corpus for concept embeddings, GenTaxo learns the contextual embeddings from their surrounding graph-based and language-based relational information, and leverages the corpus for pre-training a concept name generator. Experimental results demonstrate that GenTaxo improves the completeness of taxonomies over existing methods.


title: Cavity Quantum Electrodynamics Design with Single Photon Emitters in Hexagonal Boron Nitride

abstract: Hexagonal boron nitride (h-BN), a prevalent insulating crystal for dielectric and encapsulation layers in two-dimensional (2D) nanoelectronics and a structural material in 2D nanoelectromechanical systems (NEMS), has also rapidly emerged as a promising platform for quantum photonics with the recent discovery of optically active defect centers and associated spin states. Combined with measured emission characteristics, here we propose and numerically investigate the cavity quantum electrodynamics (cavity-QED) scheme incorporating these defect-enabled single photon emitters (SPEs) in h-BN microdisk resonators. The whispering-gallery nature of microdisks can support multiple families of cavity resonances with different radial and azimuthal mode indices simultaneously, overcoming the challenges in coinciding a single point defect with the maximum electric field of an optical mode both spatially and spectrally. The excellent characteristics of h-BN SPEs, including exceptional emission rate, considerably high Debye-Waller factor, and Fourier transform limited linewidth at room temperature, render strong coupling with the ratio of coupling to decay rates g/max({\gamma},\k{appa}) predicated as high as 500. This study not only provides insight into the emitter-cavity interaction, but also contributes toward realizing h-BN photonic components, such as low-threshold microcavity lasers and high-purity single photon sources, critical for linear optics quantum computing and quantum networking applications.


title: Fortifying Vehicular Security Through Low Overhead Physically Unclonable Functions

abstract: Within vehicles, the Controller Area Network (CAN) allows efficient communication between the electronic control units (ECUs) responsible for controlling the various subsystems. The CAN protocol was not designed to include much support for secure communication. The fact that so many critical systems can be accessed through an insecure communication network presents a major security concern. Adding security features to CAN is difficult due to the limited resources available to the individual ECUs and the costs that would be associated with adding the necessary hardware to support any additional security operations without overly degrading the performance of standard communication. Replacing the protocol is another option, but it is subject to many of the same problems. The lack of security becomes even more concerning as vehicles continue to adopt smart features. Smart vehicles have a multitude of communication interfaces would an attacker could exploit to gain access to the networks. In this work we propose a security framework that is based on physically unclonable functions (PUFs) and lightweight cryptography (LWC). The framework does not require any modification to the standard CAN protocol while also minimizing the amount of additional message overhead required for its operation. The improvements in our proposed framework results in major reduction in the number of CAN frames that must be sent during operation. For a system with 20 ECUs for example, our proposed framework only requires 6.5% of the number of CAN frames that is required by the existing approach to successfully authenticate every ECU.


title: A Method for Locating the Real Roots of the Symbolic Quintic Equation Using Quadratic Equations

abstract: A method is proposed with which the locations of the roots of the monic symbolic quintic polynomial $x^5 + a_4 x^4 + a_3 x^3 + a_2 x^2 + a_1 x + a_0$ can be determined using the roots of two resolvent quadratic polynomials: $q_1(x) = x^2 + a_4 x + a_3$ and $q_2(x) = a_2 x^2 + a_1 x + a_0$, whose coefficients are exactly those of the quintic polynomial. The different cases depend on the coefficients of $q_1(x)$ and $q_2(x)$ and on some specific relationships between them. The method is illustrated with the full analysis of one of the possible cases. Some of the roots of the symbolic quintic equation for this case have their isolation intervals determined and, as this cannot be done for all roots with the help of quadratic equations only, finite intervals containing 1 or 3 roots, or 0 or 2 roots, or, rarely, 0, or 2, or 4 roots of the quintic are identified. Knowing the stationary points of the quintic polynomial, lifts the latter indeterminacy and allows one to find the isolation interval of each of the roots of the quintic. Separately, using the complete root classification of the quintic, one can also lift this indeterminacy. The method also allows to see how variation of the individual coefficients of the quintic affect its roots. No root finding iterations or any numerical approximations are used and no equations of degree higher than 2 are solved.


title: Robust Stochastic Linear Contextual Bandits Under Adversarial Attacks

abstract: Stochastic linear contextual bandit algorithms have substantial applications in practice, such as recommender systems, online advertising, clinical trials, etc. Recent works show that optimal bandit algorithms are vulnerable to adversarial attacks and can fail completely in the presence of attacks. Existing robust bandit algorithms only work for the non-contextual setting under the attack of rewards and cannot improve the robustness in the general and popular contextual bandit environment. In addition, none of the existing methods can defend against attacked context. In this work, we provide the first robust bandit algorithm for stochastic linear contextual bandit setting under a fully adaptive and omniscient attack with sub-linear regret. Our algorithm not only works under the attack of rewards, but also under attacked context. Moreover, it does not need any information about the attack budget or the particular form of the attack. We provide theoretical guarantees for our proposed algorithm and show by experiments that our proposed algorithm improves the robustness against various kinds of popular attacks.


title: Syndicated Bandits: A Framework for Auto Tuning Hyper-parameters in Contextual Bandit Algorithms

abstract: The stochastic contextual bandit problem, which models the trade-off between exploration and exploitation, has many real applications, including recommender systems, online advertising and clinical trials. As many other machine learning algorithms, contextual bandit algorithms often have one or more hyper-parameters. As an example, in most optimal stochastic contextual bandit algorithms, there is an unknown exploration parameter which controls the trade-off between exploration and exploitation. A proper choice of the hyper-parameters is essential for contextual bandit algorithms to perform well. However, it is infeasible to use offline tuning methods to select hyper-parameters in contextual bandit environment since there is no pre-collected dataset and the decisions have to be made in real time. To tackle this problem, we first propose a two-layer bandit structure for auto tuning the exploration parameter and further generalize it to the Syndicated Bandits framework which can learn multiple hyper-parameters dynamically in contextual bandit environment. We derive the regret bounds of our proposed Syndicated Bandits framework and show it can avoid its regret dependent exponentially in the number of hyper-parameters to be tuned. Moreover, it achieves optimal regret bounds under certain scenarios. Syndicated Bandits framework is general enough to handle the tuning tasks in many popular contextual bandit algorithms, such as LinUCB, LinTS, UCB-GLM, etc. Experiments on both synthetic and real datasets validate the effectiveness of our proposed framework.


title: Masking Anstreicher's linx bound for improved entropy bounds

abstract: The maximum-entropy sampling problem is the NP-hard problem of maximizing the (log) determinant of an order-$s$ principle submatrix of a given order $n$ covariance matrix $C$. Exact algorithms are based on a branch-and-bound framework. The problem has wide applicability in spatial statistics, and in particular in environmental monitoring. Probably the best upper bound for the maximum, empirically, is Anstreicher's scaled ``linx'' bound (see [K.M. Anstreicher. Efficient solution of maximum-entropy sampling problems. Oper. Res., 68(6):1826--1835, 2020]). An earlier methodology for potentially improving any upper-bounding method is by masking; i.e. applying the bounding method to $C\circ M$, where $M$ is any correlation matrix. We establish that the linx bound can be improved via masking by an amount that is at least linear in $n$, even when optimal scaling parameters are employed.


title: APMF < APSP? Gomory-Hu Tree for Unweighted Graphs in Almost-Quadratic Time

abstract: We design an $n^{2+o(1)}$-time algorithm that constructs a cut-equivalent (Gomory-Hu) tree of a simple graph on $n$ nodes. This bound is almost-optimal in terms of $n$, and it improves on the recent $\tilde{O}(n^{2.5})$ bound by the authors (STOC 2021), which was the first to break the cubic barrier. Consequently, the All-Pairs Maximum-Flow (APMF) problem has time complexity $n^{2+o(1)}$, and for the first time in history, this problem can be solved faster than All-Pairs Shortest Paths (APSP). We further observe that an almost-linear time algorithm (in terms of the number of edges $m$) is not possible without first obtaining a subcubic algorithm for multigraphs. Finally, we derandomize our algorithm, obtaining the first subcubic deterministic algorithm for Gomory-Hu Tree in simple graphs, showing that randomness is not necessary for beating the $n-1$ times max-flow bound from 1961. The upper bound is $\tilde{O}(n^{2\frac{2}{3}})$ and it would improve to $n^{2+o(1)}$ if there is a deterministic single-pair maximum-flow algorithm that is almost-linear. The key novelty is in using a ``dynamic pivot'' technique instead of the randomized pivot selection that was central in recent works.


title: Sensor Fusion-based GNSS Spoofing Attack Detection Framework for Autonomous Vehicles

abstract: In this study, a sensor fusion based GNSS spoofing attack detection framework is presented that consists of three concurrent strategies for an autonomous vehicle (AV): (i) prediction of location shift, (ii) detection of turns (left or right), and (iii) recognition of motion state (including standstill state). Data from multiple low-cost in-vehicle sensors (i.e., accelerometer, steering angle sensor, speed sensor, and GNSS) are fused and fed into a recurrent neural network model, which is a long short-term memory (LSTM) network for predicting the location shift, i.e., the distance that an AV travels between two consecutive timestamps. We have then combined k-Nearest Neighbors (k-NN) and Dynamic Time Warping (DTW) algorithms to detect turns using data from the steering angle sensor. In addition, data from an AV's speed sensor is used to recognize the AV's motion state including the standstill state. To prove the efficacy of the sensor fusion-based attack detection framework, attack datasets are created for three unique and sophisticated spoofing attacks turn by turn, overshoot, and stop using the publicly available real-world Honda Research Institute Driving Dataset (HDD). Our analysis reveals that the sensor fusion-based detection framework successfully detects all three types of spoofing attacks within the required computational latency threshold.


title: BV analysis of Polyakov and Nambu-Goto theories with boundary

abstract: The Batalin-Vilkovisky data for Polyakov string theory on a manifold with (non-null) boundary is shown to induce compatible Batalin--Fradkin--Vilkovisky data, thus allowing BV-quantisation on manifolds with boundary. On the other hand, the analogous formulation of Nambu--Goto string theory fails to satisfy the needed regularity requirements. As a byproduct, a concise description is given of the reduced phase spaces of both models and their relation, for any target $d$-dimensional Lorentzian manifold.


title: Design of hazard based model and collision avoidance system

abstract: The primary goal of this paper is to examine the motorcyclists' activities during the overtaking period, as well as to develop a model of total overtaking time. For the experimental study, instrumented motorcycles were used to collect data and design an overall overtaking period model. The possibility of death during an attempt to overtake is maximum for people walking on rural roads, mainly identified by a scarcity of pathways and higher speeds of vehicles. It is important to recognize and prototype driver actions during the overtaking moves to set up collision avoidance strategies in order to prevent these collisions, such that device adjustments are acceptable as they occur beyond the comfort zone of the drivers. The purpose of this research is to address both vehicle overtaking movements along urban roads and to develop a collision avoidance system. This research, based on tests performed and instrumented driving information, may lead to the discovery of advanced driver assistance systems, analyzing driver behavior during overtaking. A total of 500 overtaking movements were registered with 50 motorcycles set up with a high-resolution camera and GPS system implemented by 50 professional bikers in India in an undivided one-way road. A technique was developed to collect data explaining the actions of the motorcyclists, based on video and GPS analyses. The overall overtaking period was designed using a risk-based model, which indicates the span of the overtaking based on several coefficients. The proposed model is useful to analyze the behavior during overtaking moves, as well as to develop road and vehicle safety systems to reduce the chances of accidents.


title: Escaping Saddle Points Faster with Stochastic Momentum

abstract: Stochastic gradient descent (SGD) with stochastic momentum is popular in nonconvex stochastic optimization and particularly for the training of deep neural networks. In standard SGD, parameters are updated by improving along the path of the gradient at the current iterate on a batch of examples, where the addition of a ``momentum'' term biases the update in the direction of the previous change in parameters. In non-stochastic convex optimization one can show that a momentum adjustment provably reduces convergence time in many settings, yet such results have been elusive in the stochastic and non-convex settings. At the same time, a widely-observed empirical phenomenon is that in training deep networks stochastic momentum appears to significantly improve convergence time, variants of it have flourished in the development of other popular update methods, e.g. ADAM [KB15], AMSGrad [RKK18], etc. Yet theoretical justification for the use of stochastic momentum has remained a significant open question. In this paper we propose an answer: stochastic momentum improves deep network training because it modifies SGD to escape saddle points faster and, consequently, to more quickly find a second order stationary point. Our theoretical results also shed light on the related question of how to choose the ideal momentum parameter--our analysis suggests that $\beta \in [0,1)$ should be large (close to 1), which comports with empirical findings. We also provide experimental findings that further validate these conclusions.


title: The cohomology of biquotients via a product on the two-sided bar construction

abstract: We compute the Borel equivariant cohomology ring of the left $K$-action on a homogeneous space $G/H$, where $G$ is a connected Lie group, $H$ and $K$ are closed, connected subgroups and $2$ and the torsion primes of the Lie groups are units of the coefficient ring. As a special case, this gives the singular cohomology rings of biquotients $H \backslash G / K$. This depends on a version of the Eilenberg-Moore theorem developed in the appendix, where a novel multiplicative structure on the two-sided bar construction $\mathbf{B}(A',A,A")$ is defined, valid when $A' \leftarrow A \to A"$ is a pair of maps of homotopy Gerstenhaber algebras.


title: Analysis of a semi-augmented mixed finite element method for double-diffusive natural convection in porous media

abstract: In this paper we study a stationary double-diffusive natural convection problem in porous media given by a Navier-Stokes/Darcy type system, for describing the velocity and the pressure, coupled to a vector advection-diffusion equation describing the heat and substance concentration, of a viscous fluid in a porous media with physical boundary conditions. The model problem is rewritten in terms of a first-order system, without the pressure, based on the introduction of the strain tensor and a nonlinear pseudo-stress tensor in the fluid equations. After a variational approach, the resulting weak model is then augmented using appropriate redundant penalization terms for the fluid equations along with a standard primal formulation for the heat and substance concentration. Then, it is rewritten as an equivalent fixed-point problem. Well-posedness and uniqueness results for both the continuous and the discrete schemes are stated, as well as the respective convergence result under certain regularity assumptions combined with the Lax-Milgram theorem, and the Banach and Brouwer fixed-point theorems. In particular, Raviart-Thomas elements of order $k$ are used for approximating the pseudo-stress tensor, piecewise polynomials of degree $ \leq k$ and $\leq k+1$ are utilized for approximating the strain tensor and the velocity, respectively, and the heat and substance concentration are approximated by means of Lagrange finite elements of order $\leq k+1$. Optimal a priori error estimates are derived and confirmed through some numerical examples that illustrate the performance of the proposed semi-augmented mixed-primal scheme.


title: Causal Bandits with Unknown Graph Structure

abstract: In causal bandit problems, the action set consists of interventions on variables of a causal graph. Several researchers have recently studied such bandit problems and pointed out their practical applications. However, all existing works rely on a restrictive and impractical assumption that the learner is given full knowledge of the causal graph structure upfront. In this paper, we develop novel causal bandit algorithms without knowing the causal graph. Our algorithms work well for causal trees, causal forests and a general class of causal graphs. The regret guarantees of our algorithms greatly improve upon those of standard multi-armed bandit (MAB) algorithms under mild conditions. Lastly, we prove our mild conditions are necessary: without them one cannot do better than standard MAB algorithms.


title: Exploring the Disproportion Between Scientific Productivity and Knowledge Amount

abstract: The pursuit of knowledge is the permanent goal of human beings. Scientific literature, as the major medium that carries knowledge between scientists, exhibits explosive growth during the last century. Despite the frequent use of many tangible measures, such as citation, impact factor and g-index, to quantify the influence of papers from different perspectives based on scientific productivity, it has not yet been well understood how the relationship between scientific productivity and knowledge amount turns out to be, i.e., how the knowledge value of papers and knowledge amount vary with development of the discipline. This raises the question of whether high scientific productivity equals large knowledge amount. Here, building on rich literature on academic conferences and journals, we collect 185 million articles covering 19 disciplines published during 1970 to 2020, and establish citation network research area to represent the knowledge flow from the authors of the article being cited to the authors of the articles that cite it under each specific area. As a result, the structure formed during the evolution of each scientific area can implicitly tells how the knowledge flows between nodes and how it behaves as the number of literature (productivity) increases. By leveraging Structural entropy in structured high-dimensional space and Shannon entropy in unstructured probability space, we propose the Quantitative Index of Knowledge (KQI), which is taken as the subtraction between the two types of entropy, to reflect the extent of disorder difference (knowledge amount) caused by structure (order). With the aid of KQI, we find that, although the published literature shows an explosive growth, the amount of knowledge (KQI) contained in it obviously slows down, and there is a threshold after which the growth of knowledge accelerates...


title: Self-Damaging Contrastive Learning

abstract: The recent breakthrough achieved by contrastive learning accelerates the pace for deploying unsupervised training on real-world data applications. However, unlabeled data in reality is commonly imbalanced and shows a long-tail distribution, and it is unclear how robustly the latest contrastive learning methods could perform in the practical scenario. This paper proposes to explicitly tackle this challenge, via a principled framework called Self-Damaging Contrastive Learning (SDCLR), to automatically balance the representation learning without knowing the classes. Our main inspiration is drawn from the recent finding that deep models have difficult-to-memorize samples, and those may be exposed through network pruning. It is further natural to hypothesize that long-tail samples are also tougher for the model to learn well due to insufficient examples. Hence, the key innovation in SDCLR is to create a dynamic self-competitor model to contrast with the target model, which is a pruned version of the latter. During training, contrasting the two models will lead to adaptive online mining of the most easily forgotten samples for the current target model, and implicitly emphasize them more in the contrastive loss. Extensive experiments across multiple datasets and imbalance settings show that SDCLR significantly improves not only overall accuracies but also balancedness, in terms of linear evaluation on the full-shot and few-shot settings. Our code is available at: https://github.com/VITA-Group/SDCLR.


title: Critical Tokunaga model for river networks

abstract: The hierarchical organization and self-similarity in river basins have been topics of extensive research in hydrology and geomorphology starting with the pioneering work of Horton in 1945. Despite significant theoretical and applied advances however, the mathematical origin of and relation among Horton laws for different stream attributes remain unsettled. Here we capitalize on a recently developed theory of random self-similar trees to introduce a one-parametric family of self-similar critical Tokunaga trees that elucidates the origin of Horton laws, Hack's laws, basin fractal dimension, power-law distributions of link attributes, and power-law relations between distinct attributes. The proposed family includes the celebrated Shreve's random topology model and extends to trees that approximate the observed river networks with realistic exponents. The results offer tools to increase our understanding of landscape organization under different hydroclimatic forcings, and to extend scaling relationships useful for hydrologic prediction to resolutions higher that those observed.


title: Distributed Task Allocation in Homogeneous Swarms Using Language Measure Theory

abstract: In this paper, we present algorithms for synthesizing controllers to distribute a group (possibly swarms) of homogeneous robots (agents) over heterogeneous tasks which are operated in parallel. We present algorithms as well as analysis for global and local-feedback-based controller for the swarms. Using ergodicity property of irreducible Markov chains, we design a controller for global swarm control. Furthermore, to provide some degree of autonomy to the agents, we augment this global controller by a local feedback-based controller using Language measure theory. We provide analysis of the proposed algorithms to show their correctness. Numerical experiments are shown to illustrate the performance of the proposed algorithms.


title: PID-GAN: A GAN Framework based on a Physics-informed Discriminator for Uncertainty Quantification with Physics

abstract: As applications of deep learning (DL) continue to seep into critical scientific use-cases, the importance of performing uncertainty quantification (UQ) with DL has become more pressing than ever before. In scientific applications, it is also important to inform the learning of DL models with knowledge of physics of the problem to produce physically consistent and generalized solutions. This is referred to as the emerging field of physics-informed deep learning (PIDL). We consider the problem of developing PIDL formulations that can also perform UQ. To this end, we propose a novel physics-informed GAN architecture, termed PID-GAN, where the knowledge of physics is used to inform the learning of both the generator and discriminator models, making ample use of unlabeled data instances. We show that our proposed PID-GAN framework does not suffer from imbalance of generator gradients from multiple loss terms as compared to state-of-the-art. We also empirically demonstrate the efficacy of our proposed framework on a variety of case studies involving benchmark physics-based PDEs as well as imperfect physics. All the code and datasets used in this study have been made available on this link : https://github.com/arkadaw9/PID-GAN.


title: Learning Topology from Synthetic Data for Unsupervised Depth Completion

abstract: We present a method for inferring dense depth maps from images and sparse depth measurements by leveraging synthetic data to learn the association of sparse point clouds with dense natural shapes, and using the image as evidence to validate the predicted depth map. Our learned prior for natural shapes uses only sparse depth as input, not images, so the method is not affected by the covariate shift when attempting to transfer learned models from synthetic data to real ones. This allows us to use abundant synthetic data with ground truth to learn the most difficult component of the reconstruction process, which is topology estimation, and use the image to refine the prediction based on photometric evidence. Our approach uses fewer parameters than previous methods, yet, achieves the state of the art on both indoor and outdoor benchmark datasets. Code available at: https://github.com/alexklwong/learning-topology-synthetic-data.


title: Non-Hermitian Pseudo-Gaps

abstract: The notion of a band gap is ubiquitous in the characterization of matter. Particularly interesting are pseudo-gaps, which are enigmatic regions of very low density of states that have been linked to novel phenomena like high temperature superconductivity. In this work, we discover a new non-Hermitian mechanism that induces pseudo-gaps when boundaries are introduced in a lattice. It generically occurs due to the interference between two or more asymmetric pumping channels, and possess no analog in Hermitian systems. Mathematically, it can be visualized as being created by divergences of spectral flow in the complex energy plane, analogous to how sharp edges creates divergent electric fields near an electrical conductor. A non-Hermitian pseudo-gap can host symmetry-protected mid-gap modes like ordinary topological gaps, but the mid-gap modes are extended instead of edge-localized, and exhibit extreme sensitivity to symmetry-breaking perturbations. Surprisingly, pseudo-gaps can also host an integer number of edge modes even though the pseudo-bands possess fractional topological windings, or even no well-defined Chern number at all, in the marginal case of a phase transition point. Challenging conventional notions of topological bulk-boundary correspondences and even the very concept of a band, pseudo-gaps post profound implications that extend to many-body settings, such as fractional Chern insulators.


title: About Digital Communication Methods for Visible Light Communication

abstract: The visible light communication (VLC) by LED is one of the important communication methods because LED can work as high speed and VLC sends the information by high flushing LED. We use the pulse wave modulation for the VLC with LED because LED can be controlled easily by the microcontroller, which has the digital output pins. At the pulse wave modulation, deciding the high and low voltage by the middle voltage when the receiving signal level is amplified is equal to deciding it by the threshold voltage without amplification. In this paper, we proposed two methods that adjust the threshold value using counting the slot number and measuring the signal level. The number of signal slots is constant per one symbol when we use Pulse Position Modulation (PPM). If the number of received signal slots per one symbol time is less than the theoretical value, that means the threshold value is higher than the optimal value. If it is more than the theoretical value, that means the threshold value is lower. So, we can adjust the threshold value using the number of received signal slots. At the second proposed method, the average received signal level is not equal to the signal level because there is a ratio between the number of high slots and low slots. So, we can calculate the threshold value from the average received signal level and the slot ratio. We show these performances as real experiments.


title: Causal Abstractions of Neural Networks

abstract: Structural analysis methods (e.g., probing and feature attribution) are increasingly important tools for neural network analysis. We propose a new structural analysis method grounded in a formal theory of causal abstraction that provides rich characterizations of model-internal representations and their roles in input/output behavior. In this method, neural representations are aligned with variables in interpretable causal models, and then interchange interventions are used to experimentally verify that the neural representations have the causal properties of their aligned variables. We apply this method in a case study to analyze neural models trained on Multiply Quantified Natural Language Inference (MQNLI) corpus, a highly complex NLI dataset that was constructed with a tree-structured natural logic causal model. We discover that a BERT-based model with state-of-the-art performance successfully realizes parts of the natural logic model's causal structure, whereas a simpler baseline model fails to show any such structure, demonstrating that BERT representations encode the compositional structure of MQNLI.


title: Modeling Temperature, Frequency, and Strain Effects on the Linear Electro-Optic Coefficients of Ferroelectric Oxides

abstract: An electro-optic modulator offers the function of modulating the propagation of light in a material with electric field and enables seamless connection between electronics-based computing and photonics-based communication. The search for materials with large electro-optic coefficients and low optical loss is critical to increase the efficiency and minimize the size of electro-optic devices. We present a semi-empirical method to compute the electro-optic coefficients of ferroelectric materials by combining first-principles density-functional theory calculations with Landau-Devonshire phenomenological modeling. We apply the method to study the electro-optic constants, also called Pockels coefficients, of three paradigmatic ferroelectric oxides: BaTiO3, LiNbO3, and LiTaO3. We present their temperature-, frequency- and strain-dependent electro-optic tensors calculated using our method. The predicted electro-optic constants agree with the experimental results, where available, and provide benchmarks for experimental verification.


title: Experimental and modeling methodologies for the analysis of water adsorption in food products. A review

abstract: The determination of the isothermal adsorption curves represents a mechanism that allows ob-taining information on the process of adsorption of water in organic and inorganic materials. In addition, it is a measure to be considered when characterizing the physicochemical and structural properties of the materials. We want to present an approach to the state of knowledge about the methods to characterize seeds and materials associated with food products physically and struc-turally, and to relate this knowledge to biophysical processes in these materials. This review considers the papers available since 2001 associated with water adsorption studies on seeds and other food products as well as the approach of different authors to to technical and experimental models and processes that are needed for the development of this topic. From these articles the applied experimental methodologies (obtaining samples, environmental conditions and labor-atory equipment) and the mathematical models used to give physical, chemical and biological meaning to the results were analyzed and discussed, concluding in the methodologies that have best adapted to the advance of the technology for obtaining isothermal curves in the last years.


title: Individually Rational Land and Neighbor Allocation: Impossibility Results

abstract: We consider a setting in which agents are allocated land plots and they have additive preferences over which plot they get and who their neighbor is. Strategyproofness, Pareto optimality, and individual rationality are three fundamental properties in economic design. We present two impossibility results showing that the three properties are incompatible in this context.


title: Joint Design for Simultaneously Transmitting And Reflecting (STAR) RIS Assisted NOMA Systems

abstract: Different from traditional reflection-only reconfigurable intelligent surfaces (RISs), simultaneously transmitting and reflecting RISs (STAR-RISs) represent a novel technology, which extends the half-space coverage to full-space coverage by simultaneously transmitting and reflecting incident signals. STAR-RISs provide new degrees-of-freedom (DoF) for manipulating signal propagation. Motivated by the above, a novel STAR-RIS assisted non-orthogonal multiple access (NOMA) (STAR-RIS-NOMA) system is proposed in this paper. Our objective is to maximize the achievable sum rate by jointly optimizing the decoding order, power allocation coefficients, active beamforming, and transmission and reflection beamforming. However, the formulated problem is non-convex with intricately coupled variables. To tackle this challenge, a suboptimal two-layer iterative algorithm is proposed. Specifically, in the inner-layer iteration, for a given decoding order, the power allocation coefficients, active beamforming, transmission and reflection beamforming are optimized alternatingly. For the outer-layer iteration, the decoding order of NOMA users in each cluster is updated with the solutions obtained from the inner-layer iteration. Moreover, an efficient decoding order determination scheme is proposed based on the equivalent-combined channel gains. Simulation results are provided to demonstrate that the proposed STAR-RIS-NOMA system, aided by our proposed algorithm, outperforms conventional RIS-NOMA and RIS assisted orthogonal multiple access (RIS-OMA) systems.


title: Multilayer Representation and Multiscale Analysis on Data Networks

abstract: The constant increase in the complexity of data networks motivates the search for strategies that make it possible to reduce current monitoring times. This paper shows the way in which multilayer network representation and the application of multiscale analysis techniques, as applied to software-defined networks, allows for the visualization of anomalies from "coarse views of the network topology". This implies the analysis of fewer data, and consequently the reduction of the time that a process takes to monitor the network. The fact that software-defined networks allow for the obtention of a global view of network behavior facilitates detail recovery from affected zones detected in monitoring processes. The method is evaluated by calculating the reduction factor of nodes, checked during anomaly detection, with respect to the total number of nodes in the network.


title: Solar Cycle Dependence of ICME Composition

abstract: Coronal mass ejections (CMEs) are one of the most energetic explosions in the solar atmosphere, and their occurrence rates exhibit obvious solar cycle dependence with more events taking place around solar maximum. Composition of interplanetary CMEs (ICMEs), referring to the charge states and elemental abundances of ions, opens an important avenue to investigate CMEs. In this paper, we conduct a statistical study on the charge states of five elements (Mg, Fe, Si, C, and O) and the relative abundances of six elements (Mg/O, Fe/O, Si/O, C/O, Ne/O, and He/O) within ICMEs from 1998 to 2011, and find that all the ICME compositions possess the solar cycle dependence. All of the ionic charge states and most of the relative elemental abundances are positively correlated with sunspot numbers (SSNs), and only the C/O ratios are inversely correlated with the SSNs. The compositions (except the C/O) increase with the SSNs during the ascending phase (1998--2000 and 2009--2011) and remain elevated during solar maximum and descending phase (2000--2005) compared to solar minimum (2007--2009). The charge states of low-FIP (first ionization potential) elements (Mg, Fe, and Si) and their relative abundances are correlated well, while no clear correlation is observed between the C$^{6+}$/C$^{5+}$ or C$^{6+}$/C$^{4+}$ and C/O. Most interestingly, we find that the Ne/O ratios of ICMEs and slow solar wind have the opposite solar cycle dependence.


title: Exploring the Limits of Out-of-Distribution Detection

abstract: Near out-of-distribution detection (OOD) is a major challenge for deep neural networks. We demonstrate that large-scale pre-trained transformers can significantly improve the state-of-the-art (SOTA) on a range of near OOD tasks across different data modalities. For instance, on CIFAR-100 vs CIFAR-10 OOD detection, we improve the AUROC from 85% (current SOTA) to more than 96% using Vision Transformers pre-trained on ImageNet-21k. On a challenging genomics OOD detection benchmark, we improve the AUROC from 66% to 77% using transformers and unsupervised pre-training. To further improve performance, we explore the few-shot outlier exposure setting where a few examples from outlier classes may be available; we show that pre-trained transformers are particularly well-suited for outlier exposure, and that the AUROC of OOD detection on CIFAR-100 vs CIFAR-10 can be improved to 98.7% with just 1 image per OOD class, and 99.46% with 10 images per OOD class. For multi-modal image-text pre-trained transformers such as CLIP, we explore a new way of using just the names of outlier classes as a sole source of information without any accompanying images, and show that this outperforms previous SOTA on standard vision OOD benchmark tasks.


title: A discrete mean-value theorem for the higher derivatives of the Riemann zeta function

abstract: We show that the $n$th derivative of the Riemann zeta function, when summed over the non-trivial zeros of zeta, is real and positive/negative in the mean for $n$ odd/even, respectively. We show this by giving a full asymptotic expansion of these sums.


title: Possible persistence of multiferroic order down to bilayer limit of van der Waals material NiI$_{2}$

abstract: Realizing a state of matter in two dimensions has repeatedly proven a novel route of discovering new physical phenomena. Van der Waals (vdW) materials have been at the center of these now extensive research activities. They offer a natural way of producing a monolayer of matter simply by mechanical exfoliation. This work demonstrates that the possible multiferroic state with coexisting antiferromagnetic and ferroelectric orders possibly persists down to the bilayer flake of NiI$_{2}$. By exploiting the optical second-harmonic generation technique, both magnitude and direction of the ferroelectric order, arising from the cycloidal spin order, are successfully traced. The possible multiferroic state's transition temperature decreases from 58 K for the bulk to about 20 K for the bilayer. Our observation will spur extensive efforts to demonstrate multi-functionality in vdW materials, which have been tried mostly by using heterostructures of singly ferroic ones until now.


title: Truthful Self-Play

abstract: We present a general framework for evolutionary learning to emergent unbiased state representation without any supervision. Evolutionary frameworks such as self-play converge to bad local optima in case of multi-agent reinforcement learning in non-cooperative partially observable environments with communication due to information asymmetry. Our proposed framework is a simple modification of self-play inspired by mechanism design, also known as {\em reverse game theory}, to elicit truthful signals and make the agents cooperative. The key idea is to add imaginary rewards using the peer prediction method, i.e., a mechanism for evaluating the validity of information exchanged between agents in a decentralized environment. Numerical experiments with predator prey, traffic junction and StarCraft tasks demonstrate that the state-of-the-art performance of our framework.