title: Feasibility study of TPC detector at high luminosity $Z$ pole on the circular collider

abstract: With the development of the circular collider, it is necessary to make accurate physics experimental measurements of particle properties at higher luminosity $Z$ pole. Micro-pattern gaseous detectors (MPGDs), which contain Gaseous Electron Multiplier (GEM) and Micro-mesh gaseous structures (Micromegas), have excellent potential for development as the readout devices of the time projection chamber (TPC) tracker detector. To meet the updated physics requirements of the high luminosity $Z$ from the preliminary concept design report (preCDR) to concept design report (CDR) at the circular electron positron collider (CEPC), In this paper, the space charge distortion of the TPC detector is simulated with the CEPC beam structure. Using the multi-physics simulation software package, the distribution of ion estimated by Geant4 is used as the input for the differential equation, and the relationship between the ion density distribution and electric field in the detector chamber is simulated. These simulation results show that the maximum deviation for Higgs $\mathcal{O}$(25 $\mu$m) meets the performance requirements in CEPC TPC detector at the high luminosity $Z$ pole, while it is still a considerable challenge for $Z$ pole, with the maximum deviation $\mathcal{O}$($>100~\mu$m). According to the previous developments, the cascaded structure of GEM and Micromegas detector has been measured. The new considerations of the detector's requirements were given, the gain needs to be reached to about 2000 with IBF$\times$Gain under 0.1, and IBF means the ions back flow ratio of the detector. The pixel TPC is a potential option to replace the traditional MPGDs with the low gain, low occupancy, and outstanding pattern recognition. Finally, some update parameters and experiments results were compared.


title: Vanishing-spreading dichotomy in a two-species chemotaxis competition system with a free boundary

abstract: Predicting the evolution of expanding population is critical to control biological threats such as invasive species and virus explosion. In this paper, we consider a two species chemotaxis system of parabolic-parabolic-elliptic type with Lotka-Volterra type competition terms and a free boundary. Such a model with a free boundary describes the spreading of new or invasive species subject to the influence of some chemical substances in an environment with a free boundary representing the spreading front. We first find conditions on the parameters which guarantee the global existence and boundedness of classical solutions with nonnegative initial functions. Next, we investigate vanishing-spreading dichotomy scenarios for positive solutions. It is shown that the vanishing-spreading dichotomy in the generalized sense always occurs; that the vanishing spreading dichotomy in the strong sense occurs when the competition between two species is weak-weak competition; and that the vanishing spreading dichotomy in the weak sense occurs when the competition between two species is weak-strong competition.


title: Analytic solution of the two-star model with correlated degrees

abstract: Exponential random graphs are important to model the structure of real-world complex networks. Here we solve the two-star model with degree-degree correlations in the sparse regime. The model constraints the average correlation between the degrees of adjacent nodes (nearest neighbors) and between the degrees at the end-points of two-stars (next nearest neighbors). We compute exactly the network free energy and show that this model undergoes a first-order transition to a condensed phase. For non-negative degree correlations between next nearest neighbors, the degree distribution inside the condensed phase has a single peak at the largest degree, while for negative degree correlations between next nearest neighbors the condensed phase is characterized by a bimodal degree distribution. We calculate the degree assortativities and show they are non-monotonic functions of the model parameters, with a discontinuous behavior at the first-order transition. The first-order critical line terminates at a second-order critical point, whose location in the phase diagram can be accurately determined. Our results can help to develop more detailed models of complex networks with correlated degrees.


title: Neuromorphic Pattern Generation Circuits for Bioelectronic Medicine

abstract: Chronic diseases can greatly benefit from bioelectronic medicine approaches. Neuromorphic electronic circuits present ideal characteristics for the development of brain-inspired low-power implantable processing systems that can be interfaced with biological systems. These circuits, therefore, represent a promising additional tool in the tool-set of bioelectronic medicine. In this paper, we describe the main features of neuromorphic circuits that are ideally suited for continuously monitoring the physiological parameters of the body and interact with them in real-time. We propose examples of computational primitives that can be used for real-time pattern generation and present a neuromorphic implementation of neural oscillators for the generation of sequence activation patterns. We demonstrate the features of such systems with an implementation of a three-phase network that models the dynamics of the respiratory Central Pattern Generator (CPG) and the heart chambers rhythm, and that could be used to build an adaptive pacemaker.


title: Peering Beyond the Gradient Veil with Distributed Auto Differentiation

abstract: Although distributed machine learning has opened up many new and exciting research frontiers, fragmentation of models and data across different machines, nodes, and sites still results in considerable communication overhead, impeding reliable training in real-world contexts. The focus on gradients as the primary shared statistic during training has spawned a number of intuitive algorithms for distributed deep learning; however, gradient-centric training of large deep neural networks (DNNs) tends to be communication-heavy, often requiring additional adaptations such as sparsity constraints, compression, quantization, and more, to curtail bandwidth. We introduce an innovative, communication-friendly approach for training distributed DNNs, which capitalizes on the outer-product structure of the gradient as revealed by the mechanics of auto-differentiation. The exposed structure of the gradient evokes a new class of distributed learning algorithm, which is naturally more communication-efficient than full gradient sharing. Our approach, called distributed auto-differentiation (dAD), builds off a marriage of rank-based compression and the innate structure of the gradient as an outer-product. We demonstrate that dAD trains more efficiently than other state of the art distributed methods on modern architectures, such as transformers, when applied to large-scale text and imaging datasets. The future of distributed learning, we determine, need not be dominated by gradient-centric algorithms.


title: Manifold Topology, Observables and Gauge Group

abstract: The relation between manifold topology, observables and gauge group is clarified on the basis of the classification of the representations of the algebra of observables associated to positions and displacements on the manifold. The guiding, physically motivated, principles are i) locality, i.e. the generating role of the algebras localized in small, topological trivial, regions, ii) diffeomorphism covariance, which guarantees the intrinsic character of the analysis, iii) the exclusion of additional local degrees of freedom with respect to the Schroedinger representation. The locally normal representations of the resulting observable algebra are classified by unitary representations of the fundamental group of the manifold, which actually generate an observable, "topological", subalgebra. The result is confronted with the standard approach based on the introduction of the universal covering ${\tilde{\cal M}}$ of $\cal{M}$ and on the decomposition of $L^2({\tilde{\cal M}})$ according to the spectrum of the fundamental group, which plays the role of a gauge group. It is shown that in this way one obtains all the representations of the observables iff the fundamental group is amenable. The implications on the observability of the Permutation Group in Particle Statistics are discussed.


title: Colourful matchings

abstract: Suppose a committee consisting of three members has to match $n$ candidates to $n$ different positions. Each member of the committee proposes a matching, however the proposed matchings totally disagree, i.e., every candidate is matched to three different positions according to three committee members. All three committee members are very competitive and want to push through as many of their suggestions as possible. Can a committee always find a compromise -- a matching of candidates to positions such that for every committee member a third of all candidates are assigned according to that committee member suggestion? We will consider an asymptotic version of this question and several other variants of similar problem. As an application we will consider an embedding problem -- in particular which configurations large Steiner systems always need to contain.


title: Modeling epigenetic evolutionary algorithms: An approach based on the epigenetic regulation process

abstract: Many biological processes have been the source of inspiration for heuristic methods that generate high-quality solutions to solve optimization and search problems. This thesis presents an epigenetic technique for Evolutionary Algorithms, inspired by the epigenetic regulation process, a mechanism to better understand the ability of individuals to adapt and learn from the environment. Epigenetic regulation comprises biological mechanisms by which small molecules, also known as epigenetic tags, are attached to or removed from a particular gene, affecting the phenotype. Five fundamental elements form the basis of the designed technique: first, a metaphorical representation of Epigenetic Tags as binary strings; second, a layer on chromosome top structure used to bind the tags (the Epigenotype layer); third, a Marking Function to add, remove, and modify tags; fourth, an Epigenetic Growing Function that acts like an interpreter, or decoder of the tags located over the alleles, in such a way that the phenotypic variations can be reflected when evaluating the individuals; and fifth, a tags inheritance mechanism. A set of experiments are performed for determining the applicability of the proposed approach.


title: Random Walks with Erasure: Diversifying Personalized Recommendations on Social and Information Networks

abstract: Most existing personalization systems promote items that match a user's previous choices or those that are popular among similar users. This results in recommendations that are highly similar to the ones users are already exposed to, resulting in their isolation inside familiar but insulated information silos. In this context, we develop a novel recommendation framework with a goal of improving information diversity using a modified random walk exploration of the user-item graph. We focus on the problem of political content recommendation, while addressing a general problem applicable to personalization tasks in other social and information networks. For recommending political content on social networks, we first propose a new model to estimate the ideological positions for both users and the content they share, which is able to recover ideological positions with high accuracy. Based on these estimated positions, we generate diversified personalized recommendations using our new random-walk based recommendation algorithm. With experimental evaluations on large datasets of Twitter discussions, we show that our method based on \emph{random walks with erasure} is able to generate more ideologically diverse recommendations. Our approach does not depend on the availability of labels regarding the bias of users or content producers. With experiments on open benchmark datasets from other social and information networks, we also demonstrate the effectiveness of our method in recommending diverse long-tail items.


title: Rate of escape of conditioned Brownian motion

abstract: We study the norm of the two-dimensional Brownian motion conditioned to stay outside the unit disk at all times. By conditioning the process is changed from barely recurrent to slightly transient. We obtain sharp results on the rate of escape to infinity of the process of future minima: (i) we find an integral test on the function $g$ so that the future minima process drops beyond the barrier $\exp \{ \ln t \times g(\ln \ln t)\}$ at arbitrary large times; (ii) we show that the future minima process exceeds $K \sqrt{ t \times \ln \ln \ln t}$ at arbitrary large times with probability 0 [resp., 1] if $K$ is larger [resp., smaller] than some positive constant. For this, we introduce a renewal structure attached to record times and values. Additional results are given for the long time behavior of the norm.


title: Explicit Bivariate Rate Functions for Large Deviations in AR(1) and MA(1) Processes with Gaussian Innovations

abstract: We investigate large deviations properties for centered stationary AR(1) and MA(1) processes with independent Gaussian innovations, by giving the explicit bivariate rate functions for the sequence of random vectors $(\boldsymbol{S}_n)_{n \in \N} = \left(n^{-1}(\sum_{k=1}^n X_k, \sum_{k=1}^n X_k^2)\right)_{n \in \N}$. In the AR(1) case, we also give the explicit rate function for the bivariate random sequence $(\W_n)_{n \geq 2} = \left(n^{-1}(\sum_{k=1}^n X_k^2, \sum_{k=2}^n X_k X_{k+1})\right)_{n \geq 2}$. Via Contraction Principle, we provide explicit rate functions for the sequences $(n^{-1} \sum_{k=1}^n X_k)_{n \in \N}$, $(n^{-1} \sum_{k=1}^n X_k^2)_{n \geq 2}$ and $(n^{-1} \sum_{k=2}^n X_k X_{k+1})_{n \geq 2}$, as well. In the AR(1) case, we present a new proof for an already known result on the explicit deviation function for the Yule-Walker estimator.


title: Identification of Phase-Locked Loop System From Its Experimental Time Series

abstract: Phase-locked loops (PLLs) are now widely used in communication systems and have been a classic system for more than 60 years. Well-known mathematical models of such systems are constructed in a number of approximations, so questions about how they describe the experimental dynamics qualitatively and quantitatively, and how the accuracy of the model description depends on the behavior mode, remain open. One of the most direct approaches to the verification of any model is its reconstruction from the time series obtained in experiment. If it is possible to fit the model to experimental data and the resulting parameter values are close to the expected values (calculated from the first principles), the quantitative correspondence between the model and the physical object is nearly proved. In this paper, for the first time, the equations of the PLL model with a bandpass filter are reconstructed from the experimental signals of the generator in various modes. The reconstruction showed that the model known in the literature generally describes the experimental dynamics in regular and chaotic regimes. The relative error of parameter estimation is between 2% and 50% for different regimes and parameters. The reconstructed nonlinear function of phase is not harmonic and highly asymmetric in contrary to the model one.


title: Non-Maxwellianity of electron distributions near Earth's magnetopause

abstract: Plasmas in Earth's outer magnetosphere, magnetosheath, and solar wind are essentially collisionless. This means particle distributions are not typically in thermodynamic equilibrium and deviate significantly from Maxwellian distributions. The deviations of these distributions can be further enhanced by plasma processes, such as shocks, turbulence, and magnetic reconnection. Such distributions can be unstable to a wide variety of kinetic plasma instabilities, which in turn modify the electron distributions. In this paper the deviations of the observed electron distributions from a bi-Maxwellian distribution function is calculated and quantified using data from the Magnetospheric Multiscale (MMS) spacecraft. A statistical study from tens of millions of electron distributions shows that the primary source of the observed non-Maxwellianity are electron distributions consisting of distinct hot and cold components in Earth's low-density magnetosphere. This results in large non-Maxwellianities in at low densities. However, after performing a stastical study we find regions where large non-Maxwellianities are observed for a given density. Highly non-Maxwellian distributions are routinely found are Earth's bowshock, in Earth's outer magnetosphere, and in the electron diffusion regions of magnetic reconnection. Enhanced non-Maxwellianities are observed in the turbulent magnetosheath, but are intermittent and are not correlated with local processes. The causes of enhanced non-Maxwellianities are investigated.


title: Complex structure of a proto-brown dwarf

abstract: We present ALMA $^{12}$CO (2-1), $^{13}$CO (2-1), C$^{18}$O (2-1) molecular line observations of a very young proto-brown dwarf system, ISO-OPH 200. We have conducted physical+chemical modelling of the complex internal structure for this system using the core collapse simulations for brown dwarf formation. The model at an age of $\sim$6000 yr can provide a good fit to the observed kinematics, spectra, and reproduce the complex structures seen in the moment maps. Results from modelling indicate that $^{12}$CO emission is tracing an extended ($\sim$1000 au) molecular outflow and a bright shock knot, $^{13}$CO is tracing the outer ($\sim$1000 au) envelope/pseudo-disc, and C$^{18}$O is tracing the inner ($\sim$500 au) pseudo-disc. The source size of $\sim$8.6 au measured in the 873$\mu$m image is comparable to the inner Keplerian disc size predicted by the model. A 3D model structure of ISO-OPH 200 suggests that this system is viewed partially through a wide outflow cavity resulting in a direct view of the outflow and a partial view of the envelope/pseudo-disc. We have argued that ISO-OPH 200 has been mis-classified as a Class Flat object due to the unusual orientation. The various signatures of this system, notably, the young $\sim$616 yr outflow dynamical age and high outflow rate ($\sim$1$\times$10$^{-7}$ M$_{\odot}$ yr$^{-1}$), silicate absorption in the 10$\mu$m mid-infrared spectrum, pristine ISM-like dust in the envelope/disc, comparable sizes of the extended envelope and outflow, indicate that ISO-OPH 200 is an early Class 0 stage system formed in a star-like mechanism via gravitational collapse of a very low-mass core.


title: Trans-Planckian Censorship Conjecture and Early Universe Cosmology

abstract: I review the "Trans-Planckian Censorship Conjecture" (TCC) and its implications for cosmology, in particular for the inflationary universe scenario. Whereas the inflationary scenario is tightly constrained by the TCC, alternative early universe scenarios are not restricted.


title: Control Variate Approximation for DNN Accelerators

abstract: In this work, we introduce a control variate approximation technique for low error approximate Deep Neural Network (DNN) accelerators. The control variate technique is used in Monte Carlo methods to achieve variance reduction. Our approach significantly decreases the induced error due to approximate multiplications in DNN inference, without requiring time-exhaustive retraining compared to state-of-the-art. Leveraging our control variate method, we use highly approximated multipliers to generate power-optimized DNN accelerators. Our experimental evaluation on six DNNs, for Cifar-10 and Cifar-100 datasets, demonstrates that, compared to the accurate design, our control variate approximation achieves same performance and 24% power reduction for a merely 0.16% accuracy loss.


title: Attempted Blind Constrained Descent Experiments

abstract: Blind Descent uses constrained but, guided approach to learn the weights. The probability density function is non-zero in the infinite space of the dimension (case in point: Gaussians and normal probability distribution functions). In Blind Descent paper, some of the implicit ideas involving layer by layer training and filter by filter training (with different batch sizes) were proposed as probable greedy solutions. The results of similar experiments are discussed. Octave (and proposed PyTorch variants) source code of the experiments of this paper can be found at https://github.com/PrasadNR/Attempted-Blind-Constrained-Descent-Experiments-ABCDE- . This is compared against the ABCDE derivatives of the original PyTorch source code of https://github.com/akshat57/Blind-Descent .


title: Two-Sided Weak Submodularity for Matroid Constrained Optimization and Regression

abstract: We study the following problem: Given a variable of interest, we would like to find a best linear predictor for it by choosing a subset of $k$ relevant variables obeying a matroid constraint. This problem is a natural generalization of subset selection problems where it is necessary to spread observations amongst multiple different classes. We derive new, strengthened guarantees for this problem by improving the analysis of the residual random greedy algorithm and by developing a novel distorted local-search algorithm. To quantify our approximation guarantees, we refine the definition of weak submodularity by Das and Kempe and introduce the notion of an upper submodularity ratio, which we connect to the minimum $k$-sparse eigenvalue of the covariance matrix. More generally, we look at the problem of maximizing a set function $f$ with lower and upper submodularity ratio $\gamma$ and $\beta$ under a matroid constraint. For this problem, our algorithms have asymptotic approximation guarantee $1/2$ and $1-e^{-1}$ as the function is closer to being submodular. As a second application, we show that the Bayesian A-optimal design objective falls into our framework, leading to new guarantees for this problem as well.


title: SVRG Meets AdaGrad: Painless Variance Reduction

abstract: Variance reduction (VR) methods for finite-sum minimization typically require the knowledge of problem-dependent constants that are often unknown and difficult to estimate. To address this, we use ideas from adaptive gradient methods to propose AdaSVRG, which is a more robust variant of SVRG, a common VR method. AdaSVRG uses AdaGrad in the inner loop of SVRG, making it robust to the choice of step-size. When minimizing a sum of n smooth convex functions, we prove that a variant of AdaSVRG requires $\tilde{O}(n + 1/\epsilon)$ gradient evaluations to achieve an $O(\epsilon)$-suboptimality, matching the typical rate, but without needing to know problem-dependent constants. Next, we leverage the properties of AdaGrad to propose a heuristic that adaptively determines the length of each inner-loop in AdaSVRG. Via experiments on synthetic and real-world datasets, we validate the robustness and effectiveness of AdaSVRG, demonstrating its superior performance over standard and other "tune-free" VR methods.


title: Time evolution of CO$_2$ ro-vibrational excitation in a nanosecond discharge measured with quantum cascade laser absorption spectroscopy

abstract: CO$_2$ dissociation stimulated by vibrational excitation in non-equilibrium discharges has drawn lots of attention. Ns-discharges are known for their highly non-equilibrium conditions. It is therefore of interest to investigate the CO$_2$ excitation in such discharges. In this paper, we demonstrate the ability for monitoring the time evolution of CO$_2$ ro-vibrational excitation with a well-selected wavelength window around 2289.0 cm$^{-1}$ and a single CW quantum cascade laser (QCL) with both high accuracy and temporal resolution. The rotational and vibrational temperatures for both the symmetric and the asymmetric modes of CO$_2$ in the afterglow of CO$_2$ + He ns-discharge were measured with a temporal resolution of 1.5 $\mu$s. The non-thermal feature and the preferential excitation of the asymmetric stretch mode of CO$_2$ were experimentally observed, with a peak temperature of $T_{v3, max}$ = 966 $\pm$ 1.5 K, $T_{v12, max}$ = 438.4 $\pm$ 1.2 K and $T_{rot}$ = 334.6 $\pm$ 0.6 K reached at 3 $\mu$s after the nanosecond pulse. In the following relaxation process, an exponential decay with a time constant of 69 $\mu$s was observed for the asymmetric stretch (001) state, consistent with the dominant deexcitation mechanism due to VT transfer with He and deexcitation on the wall. Furthermore, a synchronous oscillation of the gas temperature and the total pressure was also observed and can be explained by a two-line thermometry and adiabatic process. The period of the oscillation and its dependence on the gas components is consistent with a standing acoustic wave excited by the ns-discharge.


title: Coxeter's Frieze Patterns Arising from Dyck Paths

abstract: Frieze patterns are defined by objects of a category of Dyck paths, to do that, it is introduced the notion of diamond of Dynkin type An. Such diamonds constitute a tool to build integral frieze patterns.


title: Gyrating solitons in a necklace of optical waveguides

abstract: We consider light pulses in a circular array of $2N$ coupled nonlinear optical waveguides. The waveguides are either hermitian or alternate gain and loss in a $\mathcal{PT}$-symmetric fashion. Simple patterns in the array include a ring of $2N$ pulses travelling abreast, and a breather -- a string of pulses where all even and all odd waveguides flash in turn. In addition, the structure displays solitons gyrating around the necklace by switching from one waveguide to the next. Some of the gyrating solitons are stable while other ones are weakly unstable and evolve into gyrating multiflash strings. By tuning the gain-loss coefficient, the gyration of solitons in a nonhermitian array may be reversed without changing the direction of their translational motion.


title: Fast Entropy Coding for ALICE Run 3

abstract: In LHC Run 3, the upgraded ALICE detector will record Pb-Pb collisions at a rate of 50 kHz usingcontinuous readout. The resulting stream of raw data at 3.5 TB/s has to be processed with a setof lossy and lossless compression and data reduction techniques to a storage data rate of 90 GB/swhile preserving relevant data for physics analysis. This contribution presents a custom losslessdata compression scheme based on entropy coding as the final component in the data reductionchain which has to compress the data rate from 300 GB/s to 90 GB/s. A flexible, multi-processarchitecture for the data compression scheme is proposed that seamlessly interfaces with the datareduction algorithms of earlier stages and allows to use parallel processing in order to keep therequired firm real-time guarantees of the system. The data processed inside the compressionprocess have a structure that allows the use of an rANS entropy coder with more resource efficientstatic distribution tables. Extensions to the rANS entropy coder are introduced to efficientlywork with these static distribution tables and large but sparse source alphabets consisting of upto 25 Bit per symbol. Preliminary performance results show compliance with the firm real-timerequirements while offering close-to-optimal data compression.


title: Projection Filtering with Observed State Increments with Applications in Continuous-Time Circular Filtering

abstract: Angular path integration is the ability of a system to estimate its own heading direction from potentially noisy angular velocity (or increment) observations. Non-probabilistic algorithms for angular path integration, which rely on a summation of these noisy increments, do not appropriately take into account the reliability of such observations, which is essential for appropriately weighing one's current heading direction estimate against incoming information. In a probabilistic setting, angular path integration can be formulated as a continuous-time nonlinear filtering problem (circular filtering) with observed state increments. The circular symmetry of heading direction makes this inference task inherently nonlinear, thereby precluding the use of popular inference algorithms such as Kalman filters, rendering the problem analytically inaccessible. Here, we derive an approximate solution to circular continuous-time filtering, which integrates state increment observations while maintaining a fixed representation through both state propagation and observational updates. Specifically, we extend the established projection-filtering method to account for observed state increments and apply this framework to the circular filtering problem. We further propose a generative model for continuous-time angular-valued direct observations of the hidden state, which we integrate seamlessly into the projection filter. Applying the resulting scheme to a model of probabilistic angular path integration, we derive an algorithm for circular filtering, which we term the circular Kalman filter. Importantly, this algorithm is analytically accessible, interpretable, and outperforms an alternative filter based on a Gaussian approximation.


title: Obfuscated Access and Search Patterns in Searchable Encryption

abstract: Searchable Symmetric Encryption (SSE) allows a data owner to securely outsource its encrypted data to a cloud server while maintaining the ability to search over it and retrieve matched documents. Most existing SSE schemes leak which documents are accessed per query, i.e., the so-called access pattern, and thus are vulnerable to attacks that can recover the database or the queried keywords. Current techniques that fully hide access patterns, such as ORAM or PIR, suffer from heavy communication or computational costs, and are not designed with search capabilities in mind. Recently, Chen et al. (INFOCOM'18) proposed an obfuscation framework for SSE that protects the access pattern in a differentially private way with a reasonable utility cost. However, this scheme leaks the so-called search pattern, i.e., how many times a certain query is performed. This leakage makes the proposal vulnerable to certain database and query recovery attacks. In this paper, we propose OSSE (Obfuscated SSE), an SSE scheme that obfuscates the access pattern independently for each query performed. This in turn hides the search pattern and makes our scheme resistant against attacks that rely on this leakage. Under certain reasonable assumptions, our scheme has smaller communication overhead than ORAM-based SSE. Furthermore, our scheme works in a single communication round and requires very small constant client-side storage. Our empirical evaluation shows that OSSE is highly effective at protecting against different query recovery attacks while keeping a reasonable utility level. Our protocol provides significantly more protection than the proposal by Chen et al.~against some state-of-the-art attacks, which demonstrates the importance of hiding search patterns in designing effective privacy-preserving SSE schemes.


title: Staggered mesh method for correlation energy calculations of solids: Second order M{\o}ller-Plesset perturbation theory

abstract: The calculation of the MP2 correlation energy for extended systems can be viewed as a multi-dimensional integral in the thermodynamic limit, and the standard method for evaluating the MP2 energy can be viewed as a trapezoidal quadrature scheme. We demonstrate that existing analysis neglects certain contributions due to the non-smoothness of the integrand, and may significantly underestimate finite-size errors. We propose a new staggered mesh method, which uses two staggered Monkhorst-Pack meshes for occupied and virtual orbitals, respectively, to compute the MP2 energy. The staggered mesh method circumvents a significant error source in the standard method, in which certain quadrature nodes are always placed on points where the integrand is discontinuous. One significant advantage of the proposed method is that there are no tunable parameters, and the additional numerical effort needed can be negligible compared to the standard MP2 calculation. Numerical results indicate that the staggered mesh method can be particularly advantageous for quasi-1D systems, as well as quasi-2D and 3D systems with certain symmetries.


title: Real zeros of random trigonometric polynomials with dependent coefficients

abstract: We further investigate the relations between the large degree asymptotics of the number of real zeros of random trigonometric polynomials with dependent coefficients and the underlying correlation function. We consider trigonometric polynomials of the form \[ f_n(t):= \frac{1}{\sqrt{n}}\sum_{k=1}^{n}a_k \cos(kt)+b_k\sin(kt), ~x\in [0,2\pi], \] where the sequences $(a_k)_{k\geq 1}$ and $(b_k)_{k\geq 1}$ are two independent copies of a stationary Gaussian process centered with variance one and correlation function $\rho$ with associated spectral measure $\mu_{\rho}$. We focus here on the case where $\mu_{\rho}$ is not purely singular and we denote by $\psi_{\rho}$ its density component with respect to the Lebesgue measure $\lambda$. Quite surprisingly, we show that the asymptotics of the number of real zeros $\mathcal{N}(f_n,[0,2\pi])$ of $f_n$ in $[0,2\pi]$ is not related to the decay of the correlation function $\rho$ but instead to the Lebesgue measure of the vanishing locus of $\psi_{\rho}$. Namely, assuming that $\psi_{\rho}$ is $\mathcal{C}^1$ with H\"older derivative on an open set of full measure, one establishes that \[ \lim_{n \to +\infty} \frac{\mathbb E\left[\mathcal{N}(f_n,[0,2\pi])\right]}{n}= \frac{\lambda(\{\psi_{\rho}=0\})}{\pi \sqrt{2}} + \frac{2\pi - \lambda(\{\psi_{\rho}=0\})}{\pi\sqrt{3}}. \] On the other hand, assuming a sole log-integrability condition on $\psi_{\rho}$, which implies that it is positive almost everywhere, we recover the asymptotics of the independent case, i.e. the limit is $\frac{2}{\sqrt{3}}$. Besides, with further assumptions of regularity and existence of negative moment for $\psi_{\rho}$, we moreover show that the above convergence in expectation can be strengthened to an almost sure convergence.


title: On stochastic heating and its phase-space signatures in low-$\beta$ kinetic turbulence

abstract: We revisit the theory of stochastic heating of ions and investigate its phase-space signatures in kinetic turbulence of relevance to low-$\beta$ portions of the solar wind. We retain a full scale-dependent approach in our treatment, and consider the case in which electric-field fluctuations can be described by a generalized Ohm's law that includes Hall and thermo-electric effects. These two electric-field terms provide the dominant contributions to stochastic ion heating when the ion-Larmor scale is much smaller than the ion skin depth, $\rho_{\mathrm{i}}\ll d_{\mathrm{i}}$, which is the case at $\beta{\ll}1$. Employing well-known spectral scaling laws for Alfv\'en-wave and kinetic-Alfv\'en-wave turbulent fluctuations, we obtain scaling relations characterizing the field-perpendicular particle-energization rate and energy diffusion coefficient associated with stochastic heating in these two regimes. Phase-space signatures of ion heating are then investigated using 3D hybrid-kinetic simulations of continuously driven Alfv\'enic turbulence at low $\beta$. In these simulations, energization of ions parallel to the magnetic field is sub-dominant compared to its perpendicular counterpart ($Q_{\parallel,\mathrm{i}}\ll Q_{\perp,\mathrm{i}}$), and the fraction of turbulent energy that goes into ion heating is ${\approx}75$\% at $\beta_{\mathrm{i}}=0.3$ and ${\approx}40$\% at $\beta_{\mathrm{i}}{\simeq}0.1$. The phase-space signatures of ion energization are consistent with Landau-resonant collisionless damping and a ($\beta$-dependent) combination of ion-cyclotron and stochastic heating. We demonstrate good agreement between our theory and various signatures associated with the stochastic portion of the heating. We discuss the effect of intermittency on stochastic heating and the implications of our work for the interpretation of stochastic heating in solar-wind spacecraft data.


title: The Effectiveness of Subsidies and Tolls in Congestion Games

abstract: Are rewards or penalties more effective in influencing user behavior? This work compares the effectiveness of subsidies and tolls in incentivizing user behavior in congestion games. The predominantly studied method of influencing user behavior in network routing problems is to institute taxes which alter users' observed costs in a manner that causes their self-interested choices to more closely align with a system-level objective. Another conceivable method to accomplish the same goal is to subsidize the users' actions that are preferable from a system-level perspective. We show that, when users behave similarly and predictably, subsidies offer superior performance guarantees to tolls under similar budgetary constraints; however, in the presence of unknown player heterogeneity, subsidies fail to offer the same robustness as tolls.


title: Relying on a rate constraint to reduce Motion Estimation complexity

abstract: This paper proposes a rate-based candidate elimination strategy for Motion Estimation, which is considered one of the main sources of encoder complexity. We build from findings of previous works that show that selected motion vectors are generally near the predictor to propose a solution that uses the motion vector bitrate to constrain the candidate search to a subset of the original search window, resulting in less distortion computations. The proposed method is not tied to a particular search pattern, which makes it applicable to several ME strategies. The technique was tested in the VVC reference software implementation and showed complexity reductions of over 80% at the cost of an average 0.74% increase in BD-Rate with respect to the original TZ Search algorithm in the LDP configuration.


title: A new formula for the $L^p$ norm

abstract: Recently, Brezis, Van Schaftingen and the second author established a new formula for the $\dot{W}^{1,p}$ norm of a function in $C^{\infty}_c(\mathbb{R}^N)$. The formula was obtained by replacing the $L^p(\mathbb{R}^{2N})$ norm in the Gagliardo semi-norm for $\dot{W}^{s,p}(\mathbb{R}^N)$ with a weak-$L^p(\mathbb{R}^{2N})$ quasi-norm and setting $s = 1$. This provides a characterization of such $\dot{W}^{1,p}$ norms, which complements the celebrated Bourgain-Brezis-Mironescu (BBM) formula. In this paper, we obtain an analog for the case $s = 0$. In particular, we present a new formula for the $L^p$ norm of any function in $L^p(\mathbb{R}^N)$, which involves only the measures of suitable level sets, but no integration. This provides a characterization of the norm on $L^p(\mathbb{R}^N)$, which complements a formula by Maz'ya and Shaposhnikova. As a result, by interpolation, we obtain a new embedding of the Triebel-Lizorkin space $F^s_{p,2}(\mathbb{R}^N)$ (i.e. the Bessel potential space $(I-\Delta)^{-s/2} L^p(\mathbb{R}^N)$), as well as its homogeneous counterpart $\dot{F}^s_{p,2}(\mathbb{R}^N)$, for $s \in (0,1)$, $p \in (1,\infty)$.


title: Combinators and the Story of Computation

abstract: We discuss the role of combinators in the development of the modern conception of computation over the course of the past century. We describe how ideas about formalism and mathematical logic led to the introduction of combinators in 1920 as an extension of the discovery of Nand as a basis for basic logic. We then discuss how combinators informed lambda calculus and symbolic computation, and their relationship to the development of practical computation. We finally describe recent views of combinators in terms of the computational universe of possible programs, and a recent approach to the fundamental theory of physics.


title: Brauer Configuration Algebras and Matrix Problems to Categorify Integer Sequences

abstract: Bijections between invariants associated to indecomposable projective modules over some suitable Brauer configuration algebras and invariants associated to solutions of the Kronecker problem and the four subspace problem are used to categorify integer sequences in the sense of Ringel and Fahr. Dimensions of the Brauer configuration algebras and their corresponding centers involved in the different processes are given as well.


title: Generative Speech Coding with Predictive Variance Regularization

abstract: The recent emergence of machine-learning based generative models for speech suggests a significant reduction in bit rate for speech codecs is possible. However, the performance of generative models deteriorates significantly with the distortions present in real-world input signals. We argue that this deterioration is due to the sensitivity of the maximum likelihood criterion to outliers and the ineffectiveness of modeling a sum of independent signals with a single autoregressive model. We introduce predictive-variance regularization to reduce the sensitivity to outliers, resulting in a significant increase in performance. We show that noise reduction to remove unwanted signals can significantly increase performance. We provide extensive subjective performance evaluations that show that our system based on generative modeling provides state-of-the-art coding performance at 3 kb/s for real-world speech signals at reasonable computational complexity.


title: Recovering orthogonal tensors under arbitrarily strong, but locally correlated, noise

abstract: We consider the problem of recovering an orthogonally decomposable tensor with a subset of elements distorted by noise with arbitrarily large magnitude. We focus on the particular case where each mode in the decomposition is corrupted by noise vectors with components that are correlated locally, i.e., with nearby components. We show that this deterministic tensor completion problem has the unusual property that it can be solved in polynomial time if the rank of the tensor is sufficiently large. This is the polar opposite of the low-rank assumptions of typical low-rank tensor and matrix completion settings. We show that our problem can be solved through a system of coupled Sylvester-like equations and show how to accelerate their solution by an alternating solver. This enables recovery even with a substantial number of missing entries, for instance for $n$-dimensional tensors of rank $n$ with up to $40\%$ missing entries.


title: Tension-free Dirac strings and steered magnetic charges in 3D artificial spin ice

abstract: 3D nano-architectures present a new paradigm in modern condensed matter physics with numerous applications in photonics, biomedicine, and spintronics. They are promising for the realisation of 3D magnetic nano-networks for ultra-fast and low-energy data storage. Frustration in these systems can lead to magnetic charges or magnetic monopoles, which can function as mobile, binary information carriers. However, Dirac strings in 2D artificial spin ices bind magnetic charges, while 3D dipolar counterparts require cryogenic temperatures for their stability. Here, we present a micromagnetic study of a highly-frustrated 3D artificial spin ice harboring tension-free Dirac strings with unbound magnetic charges at room temperature. We use micromagnetic simulations to demonstrate that the mobility threshold for magnetic charges is by $\SI{2}{eV}$ lower than their unbinding energy. By applying global magnetic fields, we steer magnetic charges in a given direction omitting unintended switchings. The introduced system paves a way towards 3D magnetic networks for data transport and storage


title: Smart Feasibility Pump: Reinforcement Learning for (Mixed) Integer Programming

abstract: In this work, we propose a deep reinforcement learning (DRL) model for finding a feasible solution for (mixed) integer programming (MIP) problems. Finding a feasible solution for MIP problems is critical because many successful heuristics rely on a known initial feasible solution. However, it is in general NP-hard. Inspired by the feasibility pump (FP), a well-known heuristic for searching feasible MIP solutions, we develop a smart feasibility pump (SFP) method using DRL. In addition to multi-layer perception (MLP), we propose a novel convolution neural network (CNN) structure for the policy network to capture the hidden information of the constraint matrix of the MIP problem. Numerical experiments on various problem instances show that SFP significantly outperforms the classic FP in terms of the number of steps required to reach the first feasible solution. Moreover, the CNN structure works without the projection of the current solution as the input, which saves the computational effort at each step of the FP algorithms to find projections. This highlights the representational power of the CNN structure.


title: Thermal stress modelling of diamond on GaN/III-Nitride membranes

abstract: Diamond heat-spreaders for gallium nitride (GaN) devices currently depend upon a robust wafer bonding process. Bonding-free membrane methods demonstrate potential, however, chemical vapour deposition (CVD) of diamond directly onto a III-nitride (III-N) heterostructure membrane induces significant thermal stresses. In this work, these thermal stresses are investigated using an analytical approach, a numerical model and experimental validation. The thermal stresses are caused by the mismatch in the coefficient of thermal expansion (CTE) between the GaN/III-N stack, silicon (Si) and the diamond from room temperature to CVD growth temperatures. Simplified analytical wafer bow models underestimate the membrane bow for small sizes while numerical models replicate the stresses and bows with increased accuracy using temperature gradients. The largest tensile stress measured using Raman spectroscopy at room temperature was approximately 1.0 $\pm0.2$ GPa while surface profilometry shows membrane bows as large as \SI{58}{\micro\metre}. This large bow is caused by additional stresses from the Si frame in the initial heating phase which are held in place by the diamond and highlights challenges for any device fabrication using contact lithography. However, the bow can be reduced if the membrane is pre-stressed to become flat at CVD temperatures. In this way, a sufficient platform to grow diamond on GaN/III-N structures without wafer bonding can be realised.


title: MUDES: Multilingual Detection of Offensive Spans

abstract: The interest in offensive content identification in social media has grown substantially in recent years. Previous work has dealt mostly with post level annotations. However, identifying offensive spans is useful in many ways. To help coping with this important challenge, we present MUDES, a multilingual system to detect offensive spans in texts. MUDES features pre-trained models, a Python API for developers, and a user-friendly web-based interface. A detailed description of MUDES' components is presented in this paper.


title: Dynamic curriculum learning via data parameters for noise robust keyword spotting

abstract: We propose dynamic curriculum learning via data parameters for noise robust keyword spotting. Data parameter learning has recently been introduced for image processing, where weight parameters, so-called data parameters, for target classes and instances are introduced and optimized along with model parameters. The data parameters scale logits and control importance over classes and instances during training, which enables automatic curriculum learning without additional annotations for training data. Similarly, in this paper, we propose using this curriculum learning approach for acoustic modeling, and train an acoustic model on clean and noisy utterances with the data parameters. The proposed approach automatically learns the difficulty of the classes and instances, e.g. due to low speech to noise ratio (SNR), in the gradient descent optimization and performs curriculum learning. This curriculum learning leads to overall improvement of the accuracy of the acoustic model. We evaluate the effectiveness of the proposed approach on a keyword spotting task. Experimental results show 7.7% relative reduction in false reject ratio with the data parameters compared to a baseline model which is simply trained on the multiconditioned dataset.


title: Semantics and Axiomatization for Stochastic Differential Dynamic Logic

abstract: Building on previous work by Andr\'e Platzer, we present a formal language for Stochastic Differential Dynamic Logic, and define its semantics, axioms and inference rules. Compared to the previous effort, our account of the Stochastic Differential Dynamic Logic follows closer to and is more compatible with the traditional account of the regular Differential Dynamic Logic. We resolve an issue with the well-definedness of the original work's semantics, while showing how to make the logic more expressive by incorporating nondeterministic choice, definite descriptions and differential terms. Definite descriptions necessitate using a three-valued truth semantics. We also give the first Uniform Substitution calculus for Stochastic Differential Dynamic Logic, making it more practical to implement in proof assistants.


title: Quantum control of bosonic modes with superconducting circuits

abstract: Bosonic modes have wide applications in various quantum technologies, such as optical photons for quantum communication, magnons in spin ensembles for quantum information storage and mechanical modes for reversible microwave-to-optical quantum transduction. There is emerging interest in utilizing bosonic modes for quantum information processing, with circuit quantum electrodynamics (circuit QED) as one of the leading architectures. Quantum information can be encoded into subspaces of a bosonic superconducting cavity mode with long coherence time. However, standard Gaussian operations (e.g., beam splitting and two-mode squeezing) are insufficient for universal quantum computing. The major challenge is to introduce additional nonlinear control beyond Gaussian operations without adding significant bosonic loss or decoherence. Here we review recent advances in universal control of a single bosonic code with superconducting circuits, including unitary control, quantum feedback control, driven-dissipative control and holonomic dissipative control. Various approaches to entangling different bosonic modes are also discussed.


title: Joint Characterization of Multiscale Information in High Dimensional Data

abstract: High dimensional data can contain multiple scales of variance. Analysis tools that preferentially operate at one scale can be ineffective at capturing all the information present in this cross-scale complexity. We propose a multiscale joint characterization approach designed to exploit synergies between global and local approaches to dimensionality reduction. We illustrate this approach using Principal Components Analysis (PCA) to characterize global variance structure and t-stochastic neighbor embedding (t-sne) to characterize local variance structure. Using both synthetic images and real-world imaging spectroscopy data, we show that joint characterization is capable of detecting and isolating signals which are not evident from either PCA or t-sne alone. Broadly, t-sne is effective at rendering a randomly oriented low-dimensional map of local clusters, and PCA renders this map interpretable by providing global, physically meaningful structure. This approach is illustrated using imaging spectroscopy data, and may prove particularly useful for other geospatial data given robust local variance structure due to spatial autocorrelation and physical interpretability of global variance structure due to spectral properties of Earth surface materials. However, the fundamental premise could easily be extended to other high dimensional datasets, including image time series and non-image data.


title: Maximizing Marginal Fairness for Dynamic Learning to Rank

abstract: Rankings, especially those in search and recommendation systems, often determine how people access information and how information is exposed to people. Therefore, how to balance the relevance and fairness of information exposure is considered as one of the key problems for modern IR systems. As conventional ranking frameworks that myopically sorts documents with their relevance will inevitably introduce unfair result exposure, recent studies on ranking fairness mostly focus on dynamic ranking paradigms where result rankings can be adapted in real-time to support fairness in groups (i.e., races, genders, etc.). Existing studies on fairness in dynamic learning to rank, however, often achieve the overall fairness of document exposure in ranked lists by significantly sacrificing the performance of result relevance and fairness on the top results. To address this problem, we propose a fair and unbiased ranking method named Maximal Marginal Fairness (MMF). The algorithm integrates unbiased estimators for both relevance and merit-based fairness while providing an explicit controller that balances the selection of documents to maximize the marginal relevance and fairness in top-k results. Theoretical and empirical analysis shows that, with small compromises on long list fairness, our method achieves superior efficiency and effectiveness comparing to the state-of-the-art algorithms in both relevance and fairness for top-k rankings.


title: When Are Solutions Connected in Deep Networks?

abstract: The question of how and why the phenomenon of mode connectivity occurs in training deep neural networks has gained remarkable attention in the research community. From a theoretical perspective, two possible explanations have been proposed: (i) the loss function has connected sublevel sets, and (ii) the solutions found by stochastic gradient descent are dropout stable. While these explanations provide insights into the phenomenon, their assumptions are not always satisfied in practice. In particular, the first approach requires the network to have one layer with order of $N$ neurons ($N$ being the number of training samples), while the second one requires the loss to be almost invariant after removing half of the neurons at each layer (up to some rescaling of the remaining ones). In this work, we improve both conditions by exploiting the quality of the features at every intermediate layer together with a milder over-parameterization condition. More specifically, we show that: (i) under generic assumptions on the features of intermediate layers, it suffices that the last two hidden layers have order of $\sqrt{N}$ neurons, and (ii) if subsets of features at each layer are linearly separable, then no over-parameterization is needed to show the connectivity. Our experiments confirm that the proposed condition ensures the connectivity of solutions found by stochastic gradient descent, even in settings where the previous requirements do not hold.


title: Improved Denoising Diffusion Probabilistic Models

abstract: Denoising diffusion probabilistic models (DDPM) are a class of generative models which have recently been shown to produce excellent samples. We show that with a few simple modifications, DDPMs can also achieve competitive log-likelihoods while maintaining high sample quality. Additionally, we find that learning variances of the reverse diffusion process allows sampling with an order of magnitude fewer forward passes with a negligible difference in sample quality, which is important for the practical deployment of these models. We additionally use precision and recall to compare how well DDPMs and GANs cover the target distribution. Finally, we show that the sample quality and likelihood of these models scale smoothly with model capacity and training compute, making them easily scalable. We release our code at https://github.com/openai/improved-diffusion


title: Effective Cache Apportioning for Performance Isolation Under Compiler Guidance

abstract: With a growing number of cores in modern high-performance servers, effective sharing of the last level cache (LLC) is more critical than ever. The primary agenda of such systems is to maximize performance by efficiently supporting multi-tenancy of diverse workloads. However, this could be particularly challenging to achieve in practice, because modern workloads exhibit dynamic phase behaviour, which causes their cache requirements & sensitivities to vary at finer granularities during execution. Unfortunately, existing systems are oblivious to the application phase behavior, and are unable to detect and react quickly enough to these rapidly changing cache requirements, often incurring significant performance degradation. In this paper, we propose Com-CAS, a new apportioning system that provides dynamic cache allocations for co-executing applications. Com-CAS differs from the existing cache partitioning systems by adapting to the dynamic cache requirements of applications just-in-time, as opposed to reacting, without any hardware modifications. The front-end of Com-CAS consists of compiler-analysis equipped with machine learning mechanisms to predict cache requirements, while the back-end consists of proactive scheduler that dynamically apportions LLC amongst co-executing applications leveraging Intel Cache Allocation Technology (CAT). Com-CAS's partitioning scheme utilizes the compiler-generated information across finer granularities to predict the rapidly changing dynamic application behaviors, while simultaneously maintaining data locality. Our experiments show that Com-CAS improves average weighted throughput by 15% over unpartitioned cache system, and outperforms state-of-the-art partitioning system KPart by 20%, while maintaining the worst individual application completion time degradation to meet various Service-Level Agreement (SLA) requirements.


title: NATOs Mission-Critical Space Capabilities under Threat: Cybersecurity Gaps in the Military Space Asset Supply Chain

abstract: The North Atlantic Treaty Organizations (NATO) public-private Space Asset Supply Chain (SASC) currently exhibits significant cybersecurity gaps. It is well-established that data obtained from space assets is fundamental to NATO, as they allow for the facilitation of its missions, self-defence and effective deterrence of its adversaries. Any hostile cyber operation, suspending control over a space asset, severely impacts both NATO missions and allied Member States national security. This threat is exacerbated by NATOs mostly unregulated cyber SASC. Hence, this thesis answers a twofold research question: a) What are current cybersecurity gaps along NATOs global SASC; and b) How can NATO and its allied Member States gain greater control over such gaps to safeguard the supply of NATO mission-critical information? An ontological field study is carried out by conducting nineteen semi-structured interviews with high-level representatives from relevant public, private and academic organizations. This research was undertaken in collaboration with the NATO Cooperative Cyber Defence Centre of Excellence (CCDCOE) in Tallinn, Estonia. This thesis concludes that current cybersecurity gaps along NATOs SASC are caused by cyber vulnerabilities such as legacy systems or the use of Commercial-Off-the-Shelf (COTS) technology. Inadequate cyber SASC management is caused by hindrances such as misaligned classification levels and significant understaffing. On this basis, NATO should consider two major collaboration initiatives: a) Raising Awareness throughout the whole of the NATO system, and b) Pushing forward the creation of regulation through a standardized security framework on SASC cybersecurity. Doing so would enable NATO and its Member States to recognise cyberthreats to mission-critical data early on along its cyber SASC, and thus increase transparency, responsibility, and liability.


title: Plasmonic Waveguides from Coulomb-Engineered Two-Dimensional Metals

abstract: Coulomb interactions play an essential role in atomically-thin materials. On one hand, they are strong and long-ranged in layered systems due to the lack of environmental screening. On the other hand, they can be efficiently tuned by means of surrounding dielectric materials. Thus all physical properties which decisively depend on the exact structure of the electronic interactions can be in principle efficiently controlled and manipulated from the outside via Coulomb engineering. Here, we show how this concept can be used to create fundamentally new plasmonic waveguides in metallic layered materials. We discuss in detail how dielectrically structured environments can be utilized to non-invasively confine plasmonic excitations in an otherwise homogeneous metallic 2D system by modification of its many-body interactions. We define optimal energy ranges for this mechanism and demonstrate plasmonic confinement within several nanometers. In contrast to conventional functionalization mechanisms, this scheme relies on a purely many-body concept and does not involve any direct modifications to the active material itself.


title: Robust non-parametric mortality and fertility modelling and forecasting: Gaussian process regression approaches

abstract: A rapid decline in mortality and fertility has become major issues in many developed countries over the past few decades. A precise model for forecasting demographic movements is important for decision making in social welfare policies and resource budgeting among the government and many industry sectors. This article introduces a novel non-parametric approach using Gaussian process regression with a natural cubic spline mean function and a spectral mixture covariance function for mortality and fertility modelling and forecasting. Unlike most of the existing approaches in demographic modelling literature, which rely on time parameters to decide the movements of the whole mortality or fertility curve shifting from one year to another over time, we consider the mortality and fertility curves from their components of all age-specific mortality and fertility rates and assume each of them following a Gaussian process over time to fit the whole curves in a discrete but intensive style. The proposed Gaussian process regression approach shows significant improvements in terms of preciseness and robustness compared to other mainstream demographic modelling approaches in the short-, mid- and long-term forecasting using the mortality and fertility data of several developed countries in our numerical experiments.


title: Training a Resilient Q-Network against Observational Interference

abstract: Deep reinforcement learning (DRL) has demonstrated impressive performance in various gaming simulators and real-world applications. In practice, however, a DRL agent may receive faulty observation by abrupt interferences such as black-out, frozen-screen, and adversarial perturbation. How to design a resilient DRL algorithm against these rare but mission-critical and safety-crucial scenarios is an essential yet challenging task. In this paper, we consider a deep q-network (DQN) framework training with an auxiliary task of observational interferences such as artificial noises. Inspired by causal inference for observational interference, we propose a causal inference based DQN algorithm called causal inference Q-network (CIQ). We evaluate the performance of CIQ in several benchmark DQN environments with different types of interferences as auxiliary labels. Our experimental results show that the proposed CIQ method could achieve higher performance and more resilience against observational interferences.


title: A computationally efficient approach for the removal of the phase shift singularity in harmonic resolvent analysis

abstract: The recently introduced harmonic resolvent framework is concerned with the study of the input-output dynamics of nonlinear flows in the proximity of a known time-periodic orbit. These dynamics are governed by the harmonic resolvent operator, which is a linear operator in the frequency domain whose singular value decomposition sheds light on the dominant input-output structures of the flow. Although the harmonic resolvent is a mathematically well-defined operator, the numerical computation of its singular value decomposition requires inverting a matrix that becomes exactly singular as the periodic orbit approaches an exact solution of the nonlinear governing equations. The very poor condition properties of this matrix hinder the convergence of classical Krylov solvers, even in the presence of preconditioners, thereby increasing the computational cost required to perform the harmonic resolvent analysis. In this paper we show that a suitable augmentation of the (nearly) singular matrix removes the singularity, and we provide a lower bound for the smallest singular value of the augmented matrix. We also show that the desired decomposition of the harmonic resolvent can be computed using the augmented matrix, whose improved condition properties lead to a significant speedup in the convergence of classical iterative solvers. We demonstrate this simple, yet effective, computational procedure on the Kuramoto-Sivashinsky equation in the proximity of an unstable time-periodic orbit.


title: Improved Multi-Pass Streaming Algorithms for Submodular Maximization with Matroid Constraints

abstract: We give improved multi-pass streaming algorithms for the problem of maximizing a monotone or arbitrary non-negative submodular function subject to a general $p$-matchoid constraint in the model in which elements of the ground set arrive one at a time in a stream. The family of constraints we consider generalizes both the intersection of $p$ arbitrary matroid constraints and $p$-uniform hypergraph matching. For monotone submodular functions, our algorithm attains a guarantee of $p+1+\varepsilon$ using $O(p/\varepsilon)$-passes and requires storing only $O(k)$ elements, where $k$ is the maximum size of feasible solution. This immediately gives an $O(1/\varepsilon)$-pass $(2+\varepsilon)$-approximation algorithms for monotone submodular maximization in a matroid and $(3+\varepsilon)$-approximation for monotone submodular matching. Our algorithm is oblivious to the choice $\varepsilon$ and can be stopped after any number of passes, delivering the appropriate guarantee. We extend our techniques to obtain the first multi-pass streaming algorithm for general, non-negative submodular functions subject to a $p$-matchoid constraint with a number of passes independent of the size of the ground set and $k$. We show that a randomized $O(p/\varepsilon)$-pass algorithm storing $O(p^3k\log(k)/\varepsilon^3)$ elements gives a $(p+1+\bar{\gamma}+O(\varepsilon))$-approximation, where $\bar{gamma}$ is the guarantee of the best-known offline algorithm for the same problem.


title: Fixing Errors of the Google Voice Recognizer through Phonetic Distance Metrics

abstract: Speech recognition systems for the Spanish language, such as Google's, produce errors quite frequently when used in applications of a specific domain. These errors mostly occur when recognizing words new to the recognizer's language model or ad hoc to the domain. This article presents an algorithm that uses Levenshtein distance on phonemes to reduce the speech recognizer's errors. The preliminary results show that it is possible to correct the recognizer's errors significantly by using this metric and using a dictionary of specific phrases from the domain of the application. Despite being designed for particular domains, the algorithm proposed here is of general application. The phrases that must be recognized can be explicitly defined for each application, without the algorithm having to be modified. It is enough to indicate to the algorithm the set of sentences on which it must work. The algorithm's complexity is $O(tn)$, where $t$ is the number of words in the transcript to be corrected, and $n$ is the number of phrases specific to the domain.


title: WebRED: Effective Pretraining And Finetuning For Relation Extraction On The Web

abstract: Relation extraction is used to populate knowledge bases that are important to many applications. Prior datasets used to train relation extraction models either suffer from noisy labels due to distant supervision, are limited to certain domains or are too small to train high-capacity models. This constrains downstream applications of relation extraction. We therefore introduce: WebRED (Web Relation Extraction Dataset), a strongly-supervised human annotated dataset for extracting relationships from a variety of text found on the World Wide Web, consisting of ~110K examples. We also describe the methods we used to collect ~200M examples as pre-training data for this task. We show that combining pre-training on a large weakly supervised dataset with fine-tuning on a small strongly-supervised dataset leads to better relation extraction performance. We provide baselines for this new dataset and present a case for the importance of human annotation in improving the performance of relation extraction from text found on the web.


title: Percolation thresholds on high dimensional $D_n$ and dense packing lattices

abstract: The site and bond percolation problems are conventionally studied on (hyper)cubic lattices, which afford straightforward numerical treatments. The recent implementation of efficient simulation algorithms for high-dimensional systems now also facilitates the study of $D_n$ root lattices in $n$ dimension as well as $E_8$-related dense packing lattices. Here, we consider the percolation problem on $D_n$ for $n=3$ to $13$ and on $E_8$ relatives for $n=6$ to 9. Precise estimates for both site and bond percolation thresholds obtained from invasion percolation simulations are compared with dimensional series expansion on $D_n$ lattices based on lattice animal enumeration. As expected, the bond percolation threshold rapidly approaches the Bethe lattice limit as $n$ increases for these high-connectivity lattices. Corrections, however, exhibit clear yet unexplained trends. Interestingly, the finite-size scaling exponent for invasion percolation is found to be lattice and percolation-type specific.


title: Community Structure Recovery and Interaction Probability Estimation for Gossip Opinion Dynamics

abstract: We study how to jointly recover the community structure and estimate the interaction probabilities of gossip opinion dynamics. In this process, agents randomly interact pairwise, and there are stubborn agents never changing their states. Such a model illustrates how disagreement and opinion fluctuation arise in a social network. It is assumed that each agent is assigned with one of two community labels, and the agents interact with probabilities depending on their labels. The considered problem is to jointly recover the community labels of the agents and estimate interaction probabilities between the agents, based on a single trajectory of the model. We first study stability and limit theorems of the model, and then propose a joint recovery and estimation algorithm based on a trajectory. It is verified that the community recovery can be achieved in finite time, and the interaction estimator converges almost surely. We derive a sample-complexity result for the recovery, and analyze the estimator's convergence rate. Simulations are presented for illustration of the performance of the proposed algorithm.


title: A Dynamical Analogue of Sen's Theorem

abstract: We study the higher ramification structure of dynamical branch extensions, and propose a connection between the natural dynamical filtration and the filtration arising from the higher ramification groups: each member of the former should, after a linear change of index, coincide with a member of the latter. This is an analogue of Sen's theorem on ramification in $p$-adic Lie extensions. By explicitly calculating the Hasse-Herbrand functions of such branch extensions, we are able to show that this description is accurate for some families of polynomials, in particular post-critically bounded polynomials of $p$-power degree. We apply our results to give a partial answer to a question of Berger (in arXiv:1411.7064) and a partial answer to a question about wild ramification in arboreal extensions of number fields (raised in both arXiv:math/0408170 and arXiv:1511.00194).


title: Convolutional Normalization

abstract: As the deep neural networks are being applied to complex tasks, the size of the networks and architecture increases and their topology becomes more complicated too. At the same time, training becomes slow and at some instances inefficient. This motivated the introduction of various normalization techniques such as Batch Normalization and Layer Normalization. The aforementioned normalization methods use arithmetic operations to compute an approximation statistics (mainly the first and second moments) of the layer's data and use it to normalize it. The aforementioned methods use plain Monte Carlo method to approximate the statistics and such method fails when approximating the statistics whose distribution is complex. Here, we propose an approach that uses weighted sum, implemented using depth-wise convolutional neural networks, to not only approximate the statistics, but to learn the coefficients of the sum.


title: Supernova 1987A: 3D Mixing and light curves for explosion models based on binary-merger progenitors

abstract: Six binary-merger progenitors of Supernova 1987A (SN 1987A) with properties close to those of the blue supergiant Sanduleak -69 202 are exploded by neutrino heating and evolved until long after shock breakout in three dimensions (3D), and continued for light-curve calculations in spherical symmetry. Our results confirm previous findings for single-star progenitors: (1) 3D neutrino-driven explosions with SN 1987A-like energies synthesize Ni-56 masses consistent with the radioactive light-curve tail; (2) hydrodynamic models mix hydrogen inward to minimum velocities below 40 km/s compatible with spectral observations of SN 1987A; and (3) for given explosion energy the efficiency of outward radioactive Ni-56 mixing depends mainly on high growth factors of Rayleigh-Taylor instabilities at the (C+O)/He and He/H composition interfaces and a weak interaction of fast plumes with the reverse shock occurring below the He/H interface. All binary-merger models possess presupernova radii matching the photometric radius of Sanduleak -69 202 and a structure of the outer layers allowing them to reproduce the observed initial luminosity peak in the first about 7 days. Models that mix about 0.5 Msun of hydrogen into the He-shell and exhibit strong outward mixing of Ni-56 with maximum velocities exceeding the 3000 km/s observed for the bulk of ejected Ni-56 have light-curve shapes in good agreement with the dome of the SN 1987A light curve. A comparative analysis of the best representatives of our 3D neutrino-driven explosion models of SN 1987A based on single-star and binary-merger progenitors reveals that only one binary model fulfills all observational constraints, except one.


title: SQAPlanner: Generating Data-Informed Software Quality Improvement Plans

abstract: Software Quality Assurance (SQA) planning aims to define proactive plans, such as defining maximum file size, to prevent the occurrence of software defects in future releases. To aid this, defect prediction models have been proposed to generate insights as the most important factors that are associated with software quality. Such insights that are derived from traditional defect models are far from actionable-i.e., practitioners still do not know what they should do or avoid to decrease the risk of having defects, and what is the risk threshold for each metric. A lack of actionable guidance and risk threshold can lead to inefficient and ineffective SQA planning processes. In this paper, we investigate the practitioners' perceptions of current SQA planning activities, current challenges of such SQA planning activities, and propose four types of guidance to support SQA planning. We then propose and evaluate our AI-Driven SQAPlanner approach, a novel approach for generating four types of guidance and their associated risk thresholds in the form of rule-based explanations for the predictions of defect prediction models. Finally, we develop and evaluate an information visualization for our SQAPlanner approach. Through the use of qualitative survey and empirical evaluation, our results lead us to conclude that SQAPlanner is needed, effective, stable, and practically applicable. We also find that 80% of our survey respondents perceived that our visualization is more actionable. Thus, our SQAPlanner paves a way for novel research in actionable software analytics-i.e., generating actionable guidance on what should practitioners do and not do to decrease the risk of having defects to support SQA planning.


title: Algorithm for Cross-shard Cross-EE Atomic User-level ETH Transfer in Ethereum

abstract: Sharding is a way to address scalability problem in blockchain technologies. Ethereum, a prominent blockchain technology, has included sharding in its roadmap to increase its throughput. The plan is also to include multiple execution environments. We address the problem of atomic cross shard value transfer in the presence of multiple execution environments. We leverage on the proposed Ethereum architecture, more specificially on Beacon chain and crosslinks, and propose a solution on top of the netted-balance approach that was proposed for EE-level atomic \eth transfers. We split a cross-shard transfer into two transactions: a debit and a credit. First, the debit transaction is processed at the source shard. The corresponding credit transaction is processed at the destination shard in a subsequent block. We use {\em netted} shard states as channels to communicate pending credits and pending reverts. We discuss various scenarios of debit failures and credit failures, and show our approach ensures atomicity even in the presence of a Byzantine Block proposer. The benefits of our approach are that we do not use any locks nor impose any constraints on the Block Proposer to select specific transactions. However we inherit the limitation of an expensive operation from the netted-balance approach of querying partial states from all other shards. We also show a bound on the size of such inter-shard state reads.


title: Do NHL goalies get hot in the playoffs? A multilevel logistic regression analysis

abstract: The hot-hand theory posits that an athlete who has performed well in the recent past performs better in the present. We use multilevel logistic regression to test this theory for National Hockey League playoff goaltenders, controlling for a variety of shot-related and game-related characteristics. Our data consists of 48,431 shots for 93 goaltenders in the 2008-2016 playoffs. Using a wide range of shot-based windows to quantify recent save performance, we find no evidence for the hot-hand theory, and some evidence that good recent save performance negatively impacts the next-shot save probability. We use a permutation test to rule out a regression to the mean explanation for our findings.


title: Calibrate Before Use: Improving Few-Shot Performance of Language Models

abstract: GPT-3 can perform numerous tasks when provided a natural language prompt that contains a few training examples. We show that this type of few-shot learning can be unstable: the choice of prompt format, training examples, and even the order of the training examples can cause accuracy to vary from near chance to near state-of-the-art. We demonstrate that this instability arises from the bias of language models towards predicting certain answers, e.g., those that are placed near the end of the prompt or are common in the pre-training data. To mitigate this, we first estimate the model's bias towards each answer by asking for its prediction when given the training prompt and a content-free test input such as "N/A". We then fit calibration parameters that cause the prediction for this input to be uniform across answers. On a diverse set of tasks, this contextual calibration procedure substantially improves GPT-3 and GPT-2's average accuracy (up to 30.0% absolute) and reduces variance across different choices of the prompt.


title: SLIP Walking over Rough Terrain via H-LIP Stepping and Backstepping-Barrier Function Inspired Quadratic Program

abstract: We present an advanced and novel control method to enable actuated Spring Loaded Inverted Pendulum model to walk over rough and challenging terrains. The high-level philosophy is the decoupling of the controls of the vertical and horizontal states. The vertical state is controlled via Backstepping-Barrier Function (BBF) based quadratic programs: a combination of control Lyapunov backstepping and control barrier function, both of which provide inequality constraints on the inputs. The horizontal state is stabilized via Hybrid-Linear Inverted Pendulum (H-LIP) based stepping, which has a closed-form formulation. Therefore, the implementation is computationally-efficient. We evaluate our method in simulation, which demonstrates the aSLIP walking over various terrains, including slopes, stairs, and general rough terrains with uncertainties.


title: To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making

abstract: People supported by AI-powered decision support tools frequently overrely on the AI: they accept an AI's suggestion even when that suggestion is wrong. Adding explanations to the AI decisions does not appear to reduce the overreliance and some studies suggest that it might even increase it. Informed by the dual-process theory of cognition, we posit that people rarely engage analytically with each individual AI recommendation and explanation, and instead develop general heuristics about whether and when to follow the AI suggestions. Building on prior research on medical decision-making, we designed three cognitive forcing interventions to compel people to engage more thoughtfully with the AI-generated explanations. We conducted an experiment (N=199), in which we compared our three cognitive forcing designs to two simple explainable AI approaches and to a no-AI baseline. The results demonstrate that cognitive forcing significantly reduced overreliance compared to the simple explainable AI approaches. However, there was a trade-off: people assigned the least favorable subjective ratings to the designs that reduced the overreliance the most. To audit our work for intervention-generated inequalities, we investigated whether our interventions benefited equally people with different levels of Need for Cognition (i.e., motivation to engage in effortful mental activities). Our results show that, on average, cognitive forcing interventions benefited participants higher in Need for Cognition more. Our research suggests that human cognitive motivation moderates the effectiveness of explainable AI solutions.


title: A comparison of eigenvalue-based algorithms and the generalized Lanczos trust-region algorithm for Solving the trust-region subproblem

abstract: Solving the trust-region subproblem (TRS) plays a key role in numerical optimization and many other applications. Based on a fundamental result that the solution of TRS of size $n$ is mathematically equivalent to finding the rightmost eigenpair of a certain matrix pair of size $2n$, eigenvalue-based methods are promising due to their simplicity. For $n$ large, the implicitly restarted Arnoldi (IRA) and refined Arnoldi (IRRA) algorithms are well suited for this eigenproblem. For a reasonable comparison of overall efficiency of the algorithms for solving TRS directly and eigenvalue-based algorithms, a vital premise is that the two kinds of algorithms must compute the approximate solutions of TRS with (almost) the same accuracy, but such premise has been ignored in the literature. To this end, we establish close relationships between the two kinds of residual norms, so that, given a stopping tolerance for IRA and IRRA, we are able to determine a reliable one that GLTR should use so as to ensure that GLTR and IRA, IRRA deliver the converged approximate solutions with similar accuracy. We also make a convergence analysis on the residual norms by the Generalized Lanczos Trust-Region (GLTR) algorithm for solving TRS directly, the Arnoldi method and the refined Arnoldi method for the equivalent eigenproblem. A number of numerical experiments are reported to illustrate that IRA and IRRA are competitive with GLTR and IRRA outperforms IRA.


title: Joint Design of Radar Waveform and Detector via End-to-end Learning with Waveform Constraints

abstract: The problem of data-driven joint design of transmitted waveform and detector in a radar system is addressed in this paper. We propose two novel learning-based approaches to waveform and detector design based on end-to-end training of the radar system. The first approach consists of alternating supervised training of the detector for a fixed waveform and reinforcement learning of the transmitter for a fixed detector. In the second approach, the transmitter and detector are trained simultaneously. Various operational waveform constraints, such as peak-to-average-power ratio (PAR) and spectral compatibility, are incorporated into the design. Unlike traditional radar design methods that rely on rigid mathematical models with limited applicability, it is shown that radar learning can be robustified by training the detector with synthetic data generated from multiple statistical models of the environment. Theoretical considerations and results show that the proposed methods are capable of adapting the transmitted waveform to environmental conditions while satisfying design constraints.


title: Fortify Machine Learning Production Systems: Detect and Classify Adversarial Attacks

abstract: Production machine learning systems are consistently under attack by adversarial actors. Various deep learning models must be capable of accurately detecting fake or adversarial input while maintaining speed. In this work, we propose one piece of the production protection system: detecting an incoming adversarial attack and its characteristics. Detecting types of adversarial attacks has two primary effects: the underlying model can be trained in a structured manner to be robust from those attacks and the attacks can be potentially filtered out in real-time before causing any downstream damage. The adversarial image classification space is explored for models commonly used in transfer learning.


title: A matheuristic approach for the $b$-coloring problem using integer programming and a multi-start multi-greedy randomized metaheuristic

abstract: Given a graph $G=(V,E)$, the $b$-coloring problem consists in attributing a color to every vertex in $V$ such that adjacent vertices receive different colors, every color has a $b$-vertex, and the number of colors is maximized. A $b$-vertex is a vertex adjacent to vertices colored with all used colors but its own. The $b$-coloring problem is known to be NP-Hard and its optimal solution determines the $b$-chromatic number of $G$, denoted $\chi_b(G)$. This paper presents an integer programming formulation and a very effective multi-greedy randomized heuristic which can be used in a multi-start metaheuristic. In addition, a matheuristic approach is proposed combining the multi-start multi-greedy randomized metaheuristic with a MIP (mixed integer programming) based local search procedure using the integer programming formulation. Computational experiments establish the proposed multi-start metaheuristic as very effective in generating high quality solutions, along with the matheuristic approach successfully improving several of those results. Moreover, the computational results show that the multi-start metaheuristic outperforms a state-of-the-art hybrid evolutionary metaheuristic for a subset of the large instances which were previously considered in the literature. An additional contribution of this work is the proposal of a benchmark instance set, which consists of newly generated instances as well as others available in the literature for classical graph problems, with the aim of standardizing computational comparisons of approaches for the $b$-coloring problem in future works.


title: Trace inequalities of the Sobolev type and nonlinear Dirichlet problems

abstract: We discuss the solvability of Dirichlet problems of the type $- \Delta_{p, w} u = \sigma$ in $\Omega$; $u = 0$ on $\partial \Omega$, where $\Omega$ is a bounded domain in $\mathbb{R}^{n}$, $\Delta_{p, w}$ is a weighted $(p, w)$-Laplacian and $\sigma$ is a nonnegative locally finite Radon measure on $\Omega$. We do not assume the finiteness of $\sigma(\Omega)$. We revisit this problem from a potential theoretic perspective and provide criteria for the existence of solutions by $L^{p}(w)$-$L^{q}(\sigma)$ trace inequalities or capacitary conditions. Additionally, we apply the method to the singular elliptic problem $- \Delta_{p, w} u = \sigma u^{- \gamma}$ in $\Omega$; $u = 0$ on $\partial \Omega$ and derive connection with the trace inequalities.


title: Robotic fabrication of high-quality lamellae for aberration-corrected transmission electron microscopy

abstract: Aberration-corrected scanning transmission electron microscopy (STEM) is widely used for atomic-level imaging of materials. To accelerate the discovery of new materials based on atomic-level investigations, the throughput of aberration-corrected STEM experiments becomes more and more important. However, the throughput of the full workflow of aberration-corrected STEM is still quite low. A fundamental problem is that the preparation of high-quality thin STEM samples (lamellae) depends on manual operation. Here, inspired by the recent successes of "robot scientists", we demonstrate robotic fabrication of high-quality lamellae by focused-ion-beam (FIB) with full automation software. First, we show that robotic FIB can prepare lamellae with a high success rate, where the robotic FIB controls rough-milling, lift-out, and final-thinning processes. Then, we optimize the FIB parameters of the final-thinning process for single crystal Si. Aberration-corrected STEM imaging of these Si lamellae shows atomic-level images with 55 pm resolution. We also demonstrate robotic fabrication of high-quality lamellae of SrTiO3 and sapphire. The robotic FIB system will resolve the current bottleneck of the full workflow of aberration-corrected STEM analysis and accelerate materials discovery based on atomic-level imaging.


title: The princess and the pea: on the outsized role of inter-layer ligands in copper-pyrazine antiferromagnets

abstract: We investigate the cause of exchange anisotropy in a family of copper-based, quasi-two-dimensional materials with very similar geometries. This family differs mainly in the inter-layer separation, but have very different magnetic interactions even within the basal plane. We use density functional theory and Wannier functions to parameterize two complimentary tight-binding models and show that the superexchange between the Cu(II) ions is dominated by a through-space interaction between hybrid Cu-pyrazine orbitals centered on the copper atoms. We find no correlations between the strength of this exchange interaction with homologous geometric features across the compounds, such as Cu and pyrazine bond lengths and orientations of nearby counter-ions. We find that the pyrazine tilt angles do not affect the Cu-pyrazine-Cu exchange because the lowest unoccupied molecular orbital on the pyrazine is at a very high energy (relative to the frontier orbitals, which are Cu-based). We conclude that the anisotropy of magnetic interactions within this family of materials is largely unpredictable before the crystal structure is firmly established -- it is due to non-homologous geometric features such as the inter-layer organic ligands previously thought to be benign.


title: AI-SARAH: Adaptive and Implicit Stochastic Recursive Gradient Methods

abstract: We present AI-SARAH, a practical variant of SARAH. As a variant of SARAH, this algorithm employs the stochastic recursive gradient yet adjusts step-size based on local geometry. AI-SARAH implicitly computes step-size and efficiently estimates local Lipschitz smoothness of stochastic functions. It is fully adaptive, tune-free, straightforward to implement, and computationally efficient. We provide technical insight and intuitive illustrations on its design and convergence. We conduct extensive empirical analysis and demonstrate its strong performance compared with its classical counterparts and other state-of-the-art first-order methods in solving convex machine learning problems.


title: Center Smoothing: Certified Robustness for Networks with Structured Outputs

abstract: The study of provable adversarial robustness has mostly been limited to classification tasks and models with one-dimensional real-valued outputs. We extend the scope of certifiable robustness to problems with more general and structured outputs like sets, images, language, etc. We model the output space as a metric space under a distance/similarity function, such as intersection-over-union, perceptual similarity, total variation distance, etc. Such models are used in many machine learning problems like image segmentation, object detection, generative models, image/audio-to-text systems, etc. Based on a robustness technique called randomized smoothing, our $\textit{center smoothing}$ procedure can produce models with the guarantee that the change in the output, as measured by the distance metric, remains small for any norm-bounded adversarial perturbation of the input. We apply our method to create certifiably robust models with disparate output spaces - from sets to images - and show that it yields meaningful certificates without significantly degrading the performance of the base model. Code for our experiments is available at: https://github.com/aounon/center-smoothing.


title: Multiplicity and asymptotics of standing waves for the energy critical half-wave

abstract: In this paper, we consider the multiplicity and asymptotics of standing waves with prescribed mass $\int_{{\mathbb{R}^N}} {{u}^2}=a^2$ to the energy critical half-wave \begin{equation}\label{eqA0.1} \sqrt{-\Delta}u=\lambda u+\mu|u|^{q-2} u+|u|^{2^*-2}u,\ \ u\in H^{1/2}(\R^N), \end{equation} where $N\!\geq\! 2$, $a\!>\!0$, $q \!\in\!\big(2,2+\frac{2}{N}\big)$, $2^*\!=\!\frac{2N}{N-1}$ and $\lambda\!\in\!\R$ appears as a Lagrange multiplier. We show that \eqref{eqA0.1} admits a ground state $u_a$ and an excited state $v_a$, which are characterised by a local minimizer and a mountain-pass critical point of the corresponding energy functional. Several asymptotic properties of $\{u_a\}$, $\{v_a\}$ are obtained and it is worth pointing out that we get a precise description of $\{u_a\}$ as $a\!\to\! 0^+$ without needing any uniqueness condition on the related limit problem. The main contribution of this paper is to extend the main results in J. Bellazzini et al. [Math. Ann. 371 (2018), 707-740] from energy subcritical to energy critical case. Furthermore, these results can be extended to the general fractional nonlinear Schr\"{o}dinger equation with Sobolev critical exponent, which generalize the work of H. J. Luo-Z. T. Zhang [Calc. Var. Partial Differ. Equ. 59 (2020)] from energy subcritical to energy critical case.


title: Near-Optimal Randomized Exploration for Tabular Markov Decision Processes

abstract: We study algorithms using randomized value functions for exploration in reinforcement learning. This type of algorithms enjoys appealing empirical performance. We show that when we use 1) a single random seed in each episode, and 2) a Bernstein-type magnitude of noise, we obtain a worst-case $\widetilde{O}\left(H\sqrt{SAT}\right)$ regret bound for episodic time-inhomogeneous Markov Decision Process where $S$ is the size of state space, $A$ is the size of action space, $H$ is the planning horizon and $T$ is the number of interactions. This bound polynomially improves all existing bounds for algorithms based on randomized value functions, and for the first time, matches the $\Omega\left(H\sqrt{SAT}\right)$ lower bound up to logarithmic factors. Our result highlights that randomized exploration can be near-optimal, which was previously achieved only by optimistic algorithms. To achieve the desired result, we develop 1) a new clipping operation to ensure both the probability of being optimistic and the probability of being pessimistic are lower bounded by a constant, and 2) a new recursive formula for the absolute value of estimation errors to analyze the regret.


title: Fair Sparse Regression with Clustering: An Invex Relaxation for a Combinatorial Problem

abstract: In this paper, we study the problem of fair sparse regression on a biased dataset where bias depends upon a hidden binary attribute. The presence of a hidden attribute adds an extra layer of complexity to the problem by combining sparse regression and clustering with unknown binary labels. The corresponding optimization problem is combinatorial, but we propose a novel relaxation of it as an \emph{invex} optimization problem. To the best of our knowledge, this is the first invex relaxation for a combinatorial problem. We show that the inclusion of the debiasing/fairness constraint in our model has no adverse effect on the performance. Rather, it enables the recovery of the hidden attribute. The support of our recovered regression parameter vector matches exactly with the true parameter vector. Moreover, we simultaneously solve the clustering problem by recovering the exact value of the hidden attribute for each sample. Our method uses carefully constructed primal dual witnesses to provide theoretical guarantees for the combinatorial problem. To that end, we show that the sample complexity of our method is logarithmic in terms of the dimension of the regression parameter vector.