title: Radiative transitions and magnetic moments of the charmed and bottom vector mesons in chiral perturbation theory

abstract: In this work, we systematically study the radiative decays and magnetic moments of the charmed and bottom vector mesons with chiral perturbation theory up to one-loop level. We present the results in SU(2) and SU(3) cases with the mass splitting in loop diagrams kept and unkept, respectively. The obtained decay rates for $D^\ast$ and $B^\ast$ mesons in SU(3) case with the mass splitting kept are: $\Gamma_{\bar{D}^{\ast 0}\to \bar{D}^0\gamma}=16.2^{+6.5}_{-6.0}$ keV, $\Gamma_{D^{\ast-}\to D^-\gamma}=0.73^{+0.7}_{-0.3}$ keV, $\Gamma_{D_s^{\ast-}\to D_s^-\gamma}= 0.32^{+0.3}_{-0.3}$ keV, and $\Gamma_{B^{\ast+}\to B^+\gamma}=0.58^{+0.2}_{-0.2}$ keV, $\Gamma_{B^{\ast0}\to B^0\gamma}=0.23^{+0.06}_{-0.06}$ keV, $\Gamma_{B_s^{\ast0}\to B_s^0\gamma}=0.04^{+0.03}_{-0.03}$ keV. The decay width for $D^{\ast-}\to D^-\gamma$ is consistent with the experimental measurement. As a byproduct, the full widths of $\bar{D}^{\ast0}$ and $D_s^{\ast-}$ are $\Gamma_{\mathrm{tot}}(\bar{D}^{\ast0})\simeq77.7^{+26.7}_{-20.5}~\mathrm{keV}$ and $ \Gamma_{\mathrm{tot}}(D_s^{\ast-})\simeq0.62^{+0.45}_{-0.50}~\mathrm{keV}$, respectively. We also calculate the magnetic moments of the heavy vector mesons. The analytical chiral expressions derived in our work shall be helpful for the extrapolations of lattice QCD simulations in the coming future.


title: Two-dimensional Fano lineshapes: Excited-state absorption contributions

abstract: Fano interferences in nanostructures are influenced by dissipation effects as well as many-body interactions. Two dimensional coherent spectroscopies have just begun to be applied to these systems where the spectroscopic signatures of a discrete-continuum structure are not known. In this article we calculate the excited-state absorption contribution for different models of higher-lying excited states. We find that the characteristic asymmetry of one-dimensional spectroscopies is recovered from the many-body contributions, and that the higher-lying excited manifolds have distorted lineshapes that are not anticipated from discrete-level Hamiltonians. We show that the SE cannot have contributions from a flat continuum of states. This work completes the Ground-State Bleach and Stimulated Emission signals that were calculated previously (Phys. Rev. B. 2016, 94, 205137). The model reproduces the observations reported for molecules on surfaces probed by 2DIR.


title: Persistent spin helix in Rashba-Dresselhaus ferroelectric CsBiNb2O7

abstract: Ferroelectric Rashba semiconductors (FERSC) are a novel class of multifunctional materials showing a giant Rashba spin splitting which can be reversed by switching the electric polarization. Although they are excellent candidates as channels in spin field effect transistors, the experimental research has been limited so far to semiconducting GeTe, in which ferroelectric switching is often prevented by heavy doping and/or large leakage currents. Here, we report that CsBiNb2O7, a layered perovskite of Dion-Jacobson type, is a robust ferroelectric with sufficiently strong spin-orbit coupling and spin texture reversible by electric field. Moreover, we reveal that its topmost valence band's spin texture is quasi-independent from the momentum, as a result of the low symmetry of its ferroelectric phase. The peculiar spin polarization pattern in the momentum space may yield the so-called "persistent spin helix", a specific spin-wave mode which protects the spin from decoherence in diffusive transport regime, potentially ensuring a very long spin lifetime in this material.


title: Reference approach in theory of pseudospin systems

abstract: For theoretical description of pseudospin systems with essential short-range and long-range interactions we use the method based on calculations of the free energy functional with taking into account the short-range interactions within the reference approach in cluster approximation. We propose a consistent formulation of the cluster expansion method for quantum pseudospin systems. We develop a method allowing one to obtain within the cluster approximation an Ornstein-Zernike type equation for reference cumulant Green function of an arbitrary order. In the two-particle cluster approximation we derived an explicit expression for pair temperature cumulant Green function of the reference system. In the cluster random phase approximation we calculated and studied thermodynamic characteristics, elementary excitation spectrum, and integral intensities of the Ising model in transverse field.


title: Real intersection homology II: A local duality obstruction

abstract: We show that the intersection pairing on our real intersection homology groups is not a dual pairing in general.


title: Thermodynamics and weak cosmic censorship conjecture in the charged RN-AdS black hole surrounded by quintessence under the scalar field

abstract: In this paper, we study the thermodynamics and the weak cosmic censorship conjecture of the RN-AdS black hole surrounded by the quintessence under the scattering of a charged complex scalar field. With scalar field scattering, the variation of the black hole is calculated in the extended and normal phase spaces. In the extended phase space, the cosmological constant and the normalization parameter are considered as thermodynamic variables, and the first law of thermodynamics is valid, but the second law of thermodynamics is not valid. In the normal phase space, the cosmological constant and the normalization parameter are fixed, and the first and second laws of thermodynamics can also be satisfied. Furthermore, the weak cosmic censorship conjecture is both valid in the extended and normal phase spaces.


title: Multi-charged black lens

abstract: We construct an asymptotically flat, stationary and biaxisymmetric supersymmetric black lens solution in five-dimensional U(1)^3 supergravity. It is shown that the spatial cross section of the horizon is topologically the lens space of L(n,1), and the spacetime is regular on/outside the event horizon. The black lens carries (3n+2) physical quantities, three electric charges, two angular momenta and 3(n-1) magnetic fluxes.


title: Optimal Pricing for Job Offloading in the MEC System with Two Priority Classes

abstract: Multi-Access edge computing (MEC) is an emerging paradigm where users offload computationally intensive jobs to the Access Point (AP). Given that the AP's resources are shared by selfish users, pricing is a useful tool for incentivising users to internalize the negative externality of delay they cause to other users. Nevertheless, different users have different negative valuations towards delay as some are more delay sensitive. To serve heterogeneous users, we propose a priority pricing scheme where users can get served first for a higher price. Our goal is to find the prices such that in decision making, users will choose the class and the offloading frequency that jointly maximize social welfare. With the assumption that the AP knows users' profit functions, we derive in semi-closed form the optimal prices. However in practice, the reporting of users's profit information incurs a large signalling overhead. Besides, in reality users might falsely report their private profit information. To overcome this, we further propose a learning-based pricing mechanism where no knowledge of individual user profit functions is required. At equilibrium, the optimal prices and average edge delays are learnt, and users have chosen the correct priority class and offload at the socially optimal frequency.


title: Weak cosmic censorship conjecture with pressure and volume in the Gauss-Bonnet AdS black hole

abstract: With the Hamilton-Jacobi equation, we obtain the energy-momentum relation of a charged particle as it is absorbed by the Gauss-Bonnet AdS black hole. On the basis of the energy-momentum relation at the event horizon, we investigate the first law, second law, and weak cosmic censorship conjecture in both the normal phase space and extended phase space. Our results show that the first law, second law as well as the weak cosmic censorship conjecture are valid in the normal phase space for all the initial states are black holes. However, in the extended phase space, the second law is violated for the extremal and near-extremal black holes, and the weak cosmic censorship conjecture is violable for the near-extremal black hole, though the first law is still valid. In addition, in both the the normal and extended phase spaces, we find the absorbed particle changes the configuration of the near-extremal black hole, while don't change that of the extremal black hole.


title: Models for damped water waves

abstract: In this paper we derive some new weakly nonlinear asymptotic models describing viscous waves in deep water with or without surface tension effects. These asymptotic models take into account several different dissipative effects and are obtained from the free boundary problems formulated in the works of Dias, Dyachenko and Zakharov (Physics Letters A, 2008), Jiang, Ting, Perlin and Schultz (Journal of Fluid Mechanics,1996) and Wu, Liu and Yue (Journal of Fluid Mechanics, 2006).


title: Fano manifolds containing a negative divisor isomorphic to a rational homogeneous space of Picard number one

abstract: Let $X$ be an $n$-dimensional complex Fano manifolds $(n\geq 3)$. Assume that $X$ contains a divisor $A$, which is isomorphic to a rational homogeneous space with Picard number one, such that the conormal bundle $\mathscr{N}^*_{A/X}$ is ample over $A$. Building on the works of Tsukioka, Watanabe and Casagrande-Druel, we give a complete classification of such pairs $(X,A)$.


title: Filtrations on homotopy invariant sheaves with transfers

abstract: We construct filtrations on homotopy invariant sheaves with transfers and show that under Ayoub's conjectures on $n$-motives, our filtration agrees with the one conjectured by Ayoub and Barbieri-Viale if the latter exists. Our construction is directly motivated by the work of Pelaez.


title: Multimodal 3D Object Detection from Simulated Pretraining

abstract: The need for simulated data in autonomous driving applications has become increasingly important, both for validation of pretrained models and for training new models. In order for these models to generalize to real-world applications, it is critical that the underlying dataset contains a variety of driving scenarios and that simulated sensor readings closely mimics real-world sensors. We present the Carla Automated Dataset Extraction Tool (CADET), a novel tool for generating training data from the CARLA simulator to be used in autonomous driving research. The tool is able to export high-quality, synchronized LIDAR and camera data with object annotations, and offers configuration to accurately reflect a real-life sensor array. Furthermore, we use this tool to generate a dataset consisting of 10 000 samples and use this dataset in order to train the 3D object detection network AVOD-FPN, with finetuning on the KITTI dataset in order to evaluate the potential for effective pretraining. We also present two novel LIDAR feature map configurations in Bird's Eye View for use with AVOD-FPN that can be easily modified. These configurations are tested on the KITTI and CADET datasets in order to evaluate their performance as well as the usability of the simulated dataset for pretraining. Although insufficient to fully replace the use of real world data, and generally not able to exceed the performance of systems fully trained on real data, our results indicate that simulated data can considerably reduce the amount of training on real data required to achieve satisfactory levels of accuracy.


title: Online reactions to the 2017 'Unite the Right' rally in Charlottesville: Measuring polarization in Twitter networks using media followership

abstract: We study the Twitter conversation following the August 2017 `Unite the Right' rally in Charlottesville, Virginia, using tools from network analysis and data science. We use media followership on Twitter and principal component analysis (PCA) to compute a `Left'/`Right' media score on a one-dimensional axis to characterize nodes. We then use these scores, in concert with retweet relationships, to examine the structure of a retweet network of approximately 300,000 accounts that communicated with the #Charlottesville hashtag. The retweet network is sharply polarized, with an assortativity coefficient of 0.8 with respect to the sign of the media PCA score. Community detection using two approaches, a Louvain method and InfoMap, yields largely homogeneous communities in terms of Left/Right node composition. When comparing tweet content, we find that tweets about `Trump' were widespread in both the Left and Right, though the accompanying language was unsurprisingly different. Nodes with large degrees in communities on the Left include accounts that are associated with disparate areas, including activism, business, arts and entertainment, media, and politics. Support of Donald Trump was a common thread among the Right communities, connecting communities with accounts that reference white-supremacist hate symbols, communities with influential personalities in the alt-right, and the largest Right community (which includes the Twitter account FoxNews).


title: The classification of complex algebraic surfaces

abstract: This text grew up from the notes of a graduate course I gave at the University of Roma ``Tor Vergata'' in the academic year 2018--19. The subject is the classification of complex algebraic surfaces following Mori's theory. It includes the $P_{12}$--Theorem, Sarkisov's programme in the surface case and Noether--Castelnuovo's Theorem in its classical version.


title: van der Waals density functional with corrected $C_6$ coefficients

abstract: The non-local van der Waals density functional (vdW-DF) has had tremendous success since its inception in 2004 due to its constraint-based formalism that is rigorously derived from a many-body starting point. However, while vdW-DF can describe binding energies and structures for van der Waals complexes and mixed systems with good accuracy, one long-standing criticism---also since its inception---has been that the $C_6$ coefficients that derive from the vdW-DF framework are largely inaccurate and can be wrong by more than a factor of two. It has long been thought that this failure to describe the $C_6$ coefficients is a conceptual flaw of the underlying plasmon framework used to derive vdW-DF. We prove here that this is not the case and that accurate $C_6$ coefficient can be obtained without sacrificing the accuracy at binding separations from a modified framework that is fully consistent with the constraints and design philosophy of the original vdW-DF formulation. Our design exploits a degree of freedom in the plasmon-dispersion model $\omega_{\mathbf{q}}$, modifying the strength of the long-range van der Waals interaction and the cross-over from long to short separations, with additional parameters tuned_ to reference systems. Testing the new formulation for a range of different systems, we not only confirm the greatly improved description of $C_6$ coefficients, but we also find excellent performance for molecular dimers and other systems. The importance of this development is not necessarily that particular aspects such as $C_6$ coefficients or binding energies are improved, but rather that our finding opens the door for further conceptual developments of an entirely unexplored direction within the exact same constrained-based non-local framework that made vdW-DF so successful in the first place.


title: Formation of Singularities and Existence of Global Continuous Solutions for the Compressible Euler Equations

abstract: We are concerned with the formation of singularities and the existence of global continuous solutions of the Cauchy problem for the one-dimensional non-isentropic Euler equations for compressible fluids. For the isentropic Euler equations, we pinpoint a necessary and sufficient condition for the formation of singularities of solutions with large initial data that allow a far-field vacuum -- there exists a compression in the initial data. For the non-isentropic Euler equations, we identify a sufficient condition for the formation of singularities of solutions with large initial data that allow a far-field vacuum -- there exists a strong compression in the initial data. Furthermore, we identify two new phenomena -- decompression and de-rarefaction -- for the non-isentropic Euler flows, different from the isentropic flows, via constructing two respective solutions. For the decompression phenomenon, we construct a first global continuous non-isentropic solution, even though initial data contain a weak compression, by solving an inverse Goursat problem, so that the solution is smooth, except on several characteristic curves across which the solution has a weak discontinuity (i.e., only Lipschitz continuity). For the de-rarefaction phenomenon, we construct a continuous non-isentropic solution whose initial data contain isentropic rarefactions (i.e., without compression) and a locally stationary varying entropy profile, for which the solution still forms a shock wave in a finite time.

categories: math.AP math-ph math.MP nlin.PS physics.flu-dyn


title: On an effect of inhomogeneous constraints for a maximizing problem of the Sobolev embedding associated with the space of bounded variation

abstract: In this paper, we consider a maximizing problem associated with the Sobolev type embedding on the space of bounded variation. We show that, although the maximizing problem suffers from both of the non-compactness of vanishing and concentrating phenomena, there exists a maximizer for some range of the exponents. Furthermore, we show that any maximizer must be given by a characteristic function on a ball.


title: Eigenstate entanglement: Crossover from the ground state to volume laws

abstract: For the typical quantum many-body systems that obey the eigenstate thermalization hypothesis (ETH), we argue that the entanglement entropy of (almost) all energy eigenstates is described by a single crossover function. The ETH implies that the crossover functions can be deduced from subsystem entropies of thermal ensembles and have universal properties. These functions capture the full crossover from the groundstate entanglement regime at low energies and small subsystem size (area or log-area law) to the extensive volume-law regime at high energies or large subsystem size. For critical one-dimensional systems, a universal scaling function follows from conformal field theory (CFT) and can be adapted for nonlinear dispersions. We use it to also deduce the crossover scaling function for Fermi liquids in $d>1$ dimensions. The analytical results are complemented by numerics for large non-interacting systems of fermions in $d=1$, $2$, and $3$ dimensions and have also been confirmed for bosonic systems and non-integrable spin chains. Furthermore, one can deduce the distribution function for eigenstate entanglement.


title: Quantum ergodicity for pseudo-Laplacians

abstract: We prove quantum ergodicity for the eigenfunctions of the pseudo-Laplacian on Riemannian surfaces with finitely many hyperbolic cusps and ergodic geodesic flow.


title: Role of conserved quantities in Fourier's law for diffusive mechanical systems

abstract: Energy transport can be influenced by the presence of other conserved quantities. We consider here diffusive systems where energy and the other conserved quantities evolve macroscopically on the same diffusive space-time scale. In these situations the Fourier law depends also from the gradient of the other conserved quantities. The rotor chain is a classical example of such systems, where energy and angular momentum are conserved. We review here some recent mathematical results about diffusive transport of energy and other conserved quantities, in particular for systems where the bulk Hamiltonian dynamics is perturbed by conservative stochastic terms. The presence of the stochastic dynamics allows to define the transport coefficients (thermal conductivity) and in some cases to prove the local equilibrium and the linear response argument necessary to obtain the diffusive equations governing the macroscopic evolution of the conserved quantities. Temperature profiles and other conserved quantities profiles in the non-equilibrium stationary states can be then understood from the non-stationary diffusive behaviour. We also review some results and open problems on the two step approach (by weak coupling or kinetic limits) to the heat equation, starting from mechanical models with only energy conserved.


title: Quantum Limits for Harmonic Oscillator

abstract: In this note we consider high energy eigenfunctions of the harmonic oscillator in $\mathbb{R}^d$ and prove that any invariant measure on the energy surface can be written as a weak limit of eigenfunctions.


title: Study designs for extending causal inferences from a randomized trial to a target population

abstract: We examine study designs for extending (generalizing or transporting) causal inferences from a randomized trial to a target population. Specifically, we consider nested trial designs, where randomized individuals are nested within a sample from the target population, and non-nested trial designs, including composite dataset designs, where a randomized trial is combined with a separately obtained sample of non-randomized individuals from the target population. We show that the causal quantities that can be identified in each study design depend on what is known about the probability of sampling non-randomized individuals. For each study design, we examine identification of potential outcome means via the g-formula and inverse probability weighting. Last, we explore the implications of the sampling properties underlying the designs for the identification and estimation of the probability of trial participation.


title: Second Order Expansions for Sample Median with Random Sample Size

abstract: In practice, we often encounter situations where a sample size is not defined in advance and can be a random value. The randomness of the sample size crucially changes the asymptotic properties of the underlying statistic. In the present paper second order Chebyshev--Edgeworth and Cornish--Fisher expansions based of Student's $t$- and Laplace distributions and their quantiles are derived for sample median with random sample size of a special kind.


title: Toward Scalable Fully Homomorphic Encryption Through Light Trusted Computing Assistance

abstract: It has been a long standing problem to securely outsource computation tasks to an untrusted party with integrity and confidentiality guarantees. While fully homomorphic encryption (FHE) is a promising technique that allows computations performed on the encrypted data, it suffers from a significant slow down to the computation. In this paper we propose a hybrid solution that uses the latest hardware Trusted Execution Environments (TEEs) to assist FHE by moving the bootstrapping step, which is one of the major obstacles in designing practical FHE schemes, to a secured SGX enclave. TEEFHE, the hybrid system we designed, makes it possible for homomorphic computations to be performed on smaller ciphertext and secret key, providing better performance and lower memory consumption. We make an effort to mitigate side channel leakages within SGX by making the memory access patterns totally independent from the secret information. The evaluation shows that TEEFHE effectively improves the software only FHE schemes in terms of both time and space.


title: Phish-IRIS: A New Approach for Vision Based Brand Prediction of Phishing Web Pages via Compact Visual Descriptors

abstract: Phishing, a continuously growing cyber threat, aims to obtain innocent users' credentials by deceiving them via presenting fake web pages which mimic their legitimate targets. To date, various attempts have been carried out in order to detect phishing pages. In this study, we treat the problem of phishing web page identification as an image classification task and propose a machine learning augmented pure vision based approach which extracts and classifies compact visual features from web page screenshots. For this purpose, we employed several MPEG7 and MPEG7-like compact visual descriptors (SCD, CLD, CEDD, FCTH and JCD) to reveal color and edge based discriminative visual cues. Throughout the feature extraction process we have followed two different schemes working on either whole screenshots in a "holistic" manner or equal sized "patches" constructing a coarse-to-fine "pyramidal" representation. Moreover, for the task of image classification, we have built SVM and Random Forest based machine learning models. In order to assess the performance and generalization capability of the proposed approach, we have collected a mid-sized corpus covering 14 distinct brands and involving 2852 samples. According to the conducted experiments, our approach reaches up to 90.5% F1 score via SCD. As a result, compared to other studies, the suggested approach presents a lightweight schema serving competitive accuracy and superior feature extraction and inferring speed that enables it to be used as a browser plugin.


title: Drift-diffusion processes from elimination of fast variables under inhomogeneous conditions

abstract: The problem of eliminating fast-relaxing variables to obtain an effective drift-diffusion process in position is solved in a uniform and straightforward way for models with velocity a function jointly of position and fast variables. A more unified view is thereby obtained of the effect of environmental inhomgeneity on the motion of a diffusing particle, in particular, whether a drift is induced, covering both passive and active particles. Infinitesimal generators (equivalently, drift-diffusion fields) for the contracted processes are worked out in detail for several models.


title: Mean-Field Langevin Dynamics and Energy Landscape of Neural Networks

abstract: Our work is motivated by a desire to study the theoretical underpinning for the convergence of stochastic gradient type algorithms widely used for non-convex learning tasks such as training of neural networks. The key insight, already observed in the works of Mei, Montanari and Nguyen (2018), Chizat and Bach (2018) as well as Rotskoff and Vanden-Eijnden (2018), is that a certain class of the finite-dimensional non-convex problems becomes convex when lifted to infinite-dimensional space of measures. We leverage this observation and show that the corresponding energy functional defined on the space of probability measures has a unique minimiser which can be characterised by a first-order condition using the notion of linear functional derivative. Next, we study the corresponding gradient flow structure in 2-Wasserstein metric, which we call Mean-Field Langevin Dynamics (MFLD), and show that the flow of marginal laws induced by the gradient flow converges to a stationary distribution, which is exactly the minimiser of the energy functional. We observe that this convergence is exponential under conditions that are satisfied for highly regularised learning tasks. Our proof of convergence to stationary probability measure is novel and it relies on a generalisation of LaSalle's invariance principle combined with HWI inequality. Importantly, we assume neither that interaction potential of MFLD is of convolution type nor that it has any particular symmetric structure. Furthermore, we allow for the general convex objective function, unlike, most papers in the literature that focus on quadratic loss. Finally, we show that the error between finite-dimensional optimisation problem and its infinite-dimensional limit is of order one over the number of parameters.


title: Searches for lepton number violating $K^+$ decays

abstract: The NA62 experiment at CERN reports a search for the lepton number violating decays $K^+\to\pi^-e^+e^+$ and $K^+\to\pi^-\mu^+\mu^+$ using a data sample collected in 2017. No signals are observed, and upper limits on the branching fractions of these decays of $2.2\times 10^{-10}$ and $4.2\times 10^{-11}$ are obtained, respectively, at 90% confidence level. These upper limits improve on previously reported measurements by factors of 3 and 2, respectively.


title: Estimating variances in time series linear regression models using empirical BLUPs and convex optimization

abstract: We propose a two-stage estimation method of variance components in time series models known as FDSLRMs, whose observations can be described by a linear mixed model (LMM). We based estimating variances, fundamental quantities in a time series forecasting approach called kriging, on the empirical (plug-in) best linear unbiased predictions of unobservable random components in FDSLRM. The method, providing invariant non-negative quadratic estimators, can be used for any absolutely continuous probability distribution of time series data. As a result of applying the convex optimization and the LMM methodology, we resolved two problems $-$ theoretical existence and equivalence between least squares estimators, non-negative (M)DOOLSE, and maximum likelihood estimators, (RE)MLE, as possible starting points of our method and a practical lack of computational implementation for FDSLRM. As for computing (RE)MLE in the case of $ n $ observed time series values, we also discovered a new algorithm of order $\mathcal{O}(n)$, which at the default precision is $10^7$ times more accurate and $n^2$ times faster than the best current Python(or R)-based computational packages, namely CVXPY, CVXR, nlme, sommer and mixed. We illustrate our results on three real data sets $-$ electricity consumption, tourism and cyber security $-$ which are easily available, reproducible, sharable and modifiable in the form of interactive Jupyter notebooks.


title: Time-Delayed Electrons from Higgs Decays to Right-Handed Neutrinos

abstract: We consider the physics reach at the high luminosity LHC (HL-LHC) using the timing capability of a minimum ionizing particle (MIP) timing layer and the electromagnetic calorimeter in the CMS experiment for a simplified right-handed neutrino effective theory. In the simplified model, the lightest right-handed neutrinos are produced through higgs decay with mean decay lengths of order $\mathcal{O}(0.1~{\rm m}-100~{\rm m}$) and then subsequently decay into final states that include electrons. We consider the effect of several different kinematic cuts for a timing based analysis of this model. We demonstrate that if timing information can be successfully incorporated into the event trigger, it is possible to probe the higgs branching ratio to two right-handed neutrinos to the order $\mathcal{O}(10^{-5}) $ for a range of different right-handed neutrino lifetimes.


title: Online Convex Optimization in Adversarial Markov Decision Processes

abstract: We consider online learning in episodic loop-free Markov decision processes (MDPs), where the loss function can change arbitrarily between episodes, and the transition function is not known to the learner. We show $\tilde{O}(L|X|\sqrt{|A|T})$ regret bound, where $T$ is the number of episodes, $X$ is the state space, $A$ is the action space, and $L$ is the length of each episode. Our online algorithm is implemented using entropic regularization methodology, which allows to extend the original adversarial MDP model to handle convex performance criteria (different ways to aggregate the losses of a single episode) , as well as improve previous regret bounds.


title: Bacteria push the limits of chemotactic precision to navigate dynamic chemical gradients

abstract: Ephemeral aggregations of bacteria are ubiquitous in the environment, where they serve as hotbeds of metabolic activity, nutrient cycling, and horizontal gene transfer. In many cases, these regions of high bacterial concentration are thought to form when motile cells use chemotaxis to navigate to chemical hotspots. However, what governs the dynamics of bacterial aggregations is unclear. Here, we use a novel experimental platform to create realistic sub-millimeter scale nutrient pulses with controlled nutrient concentrations. By combining experiments, mathematical theory and agent-based simulations, we show that individual \textit{Vibrio ordalii} bacteria begin chemotaxis toward hotspots of dissolved organic matter (DOM) when the magnitude of the chemical gradient rises sufficiently far above the sensory noise that is generated by stochastic encounters with chemoattractant molecules. Each DOM hotspot is surrounded by a dynamic ring of chemotaxing cells, which congregate in regions of high DOM concentration before dispersing as DOM diffuses and gradients become too noisy for cells to respond to. We demonstrate that \textit{V. ordalii} operates close to the theoretical limits on chemotactic precision. Numerical simulations of chemotactic bacteria, in which molecule counting noise is explicitly taken into account, point at a tradeoff between nutrient acquisition and the cost of chemotactic precision. More generally, our results illustrate how limits on sensory precision can be used to understand the location, spatial extent, and lifespan of bacterial behavioral responses in ecologically relevant environments.


title: Low-Dimensional Self-Bound Quantum Rabi-Coupled Bosonic Droplets

abstract: We analytically calculate the leading quantum corrections of the ground-state energy of two- and one-dimensional weakly interacting Rabi-coupled Bose-Bose mixtures in the frame of the Bogoliubov approximation. We show that to repulsive intraspecies and attractive interspecies interactions, the effect of quantum fluctuations favors the formation of self-bound droplets. These liquidlike states are crucially affected by the Rabi coupling, leading thus to the appearance of a quantum instability. We derive meaningful formulas to describe the droplet phase in the one-dimensional case.


title: On Changes of Global Wet-bulb Temperature and Snowfall Regimes

abstract: To properly interpret the observed shrinkage of the Earth's cryosphere it is important to understand global changes of snowfall dominant regimes. To document these changes, three different reanalysis products of wet-bulb temperature together with observationally-based data sets are processed from 1979 to 2017. It is found that over the Northern Hemisphere (NH), the annual mean wet-bulb temperature has increased at a rate of 0.34$^\circ$C per decade (pd) over land and 0.35$^\circ$C pd over ocean, resulting in a reduction of the annual mean potential areas of snowfall dominant regimes by 0.52/0.34 million km$^2$pd over land/ocean. However, the changes in the Southern Hemisphere (SH) are less conclusive and more uncertain. Among the K$\"o$ppen-Geiger climate classes, the highest warming trend is observed over the NH polar climate regimes. Over studied mountain regions, the Alps are warming at a faster rate compared to the Rockies, Andes and High Mountain Asia (HMA). Due to such warming, potential snowfall areas over the Alps is reducing at 3.64% pd followed by Rockies at 2.81 and HMA at 1.85% pd. On average, these mountain ranges have lost 0.02 million km$^2$pd of potential snowfall areas. The NH potential snowfall areas is retracting towards the North pole over the Central Asia and Europe at a rate of 0.45 and 0.7 degree pd. Furthermore, terrestrial regions over the NH including the Great Plains in the United States, Canadian provinces around the Hudson Bay, Central Siberian and Tibetan Plateaus, are losing as much as 4% of the solid proportion of the annual precipitation amount pd.


title: A type of generalization error induced by initialization in deep neural networks

abstract: How initialization and loss function affect the learning of a deep neural network (DNN), specifically its generalization error, is an important problem in practice. In this work, by exploiting the linearity of DNN training dynamics in the NTK regime \citep{jacot2018neural,lee2019wide}, we provide an explicit and quantitative answer to this problem. Focusing on regression problem, we prove that, in the NTK regime, for any loss in a general class of functions, the DNN finds the same \emph{global} minima---the one that is nearest to the initial value in the parameter space, or equivalently, the one that is closest to the initial DNN output in the corresponding reproducing kernel Hilbert space. Using these optimization problems, we quantify the impact of initial output and prove that a random non-zero one increases the generalization error. We further propose an antisymmetrical initialization (ASI) trick that eliminates this type of error and accelerates the training. To understand whether the above results hold in general, we also perform experiments for DNNs in the non-NTK regime, which demonstrate the effectiveness of our theoretical results and the ASI trick in a qualitative sense. Overall, our work serves as a baseline for the further investigation of the impact of initialization and loss function on the generalization of DNNs, which can potentially guide and improve the training of DNNs in practice.


title: Lectures on curvature flow of networks

abstract: We present a collection of results on the evolution by curvature of networks of planar curves. We discuss in particular the existence of a solution and the analysis of singularities.


title: Linear scaling conventional Fock matrix calculation with stored non-zero two-electron integrals

abstract: It was shown that the conventional Fock matrix calculation, which using stored non-zero two-electron integrals, density prescreening, and data compression methods possesses the linear scaling property with respect to the problem size. This result follows from the proven theorem, which reads that the total number of non-zero two-electron integrals scales asymptotically linearly with respect to the number of basis functions for large molecular systems. An analysis of the Fock matrix calculation with density and density difference prescreening shows that its linear scaling property arises due to the asymptotically linear scaling properties of the number of non-zero two-electron integrals and the linear scaling property of the number of leading matrix elements of the density matrix. The use of the density and the density difference prescreening in the Fock matrix calculation consequently improves this property. The conventional Fock matrix calculation with the stored non-zero two-electron integrals has been reformulated to the Fock matrix calculation with density or density difference prescreening by using the data compression technique to store the non-zero two-electron integrals and their indices. The numerical calculations with this method show that its linear scaling property begins from 2500 to 4000 basis functions in dependence on the basis function type in molecular calculations.


title: Broadcast Congested Clique: Planted Cliques and Pseudorandom Generators

abstract: We develop techniques to prove lower bounds for the BCAST(log n) Broadcast Congested Clique model (a distributed message passing model where in each round, each processor can broadcast an O(log n)-sized message to all other processors). Our techniques are built to prove bounds for natural input distributions. So far, all lower bounds for problems in the model relied on constructing specifically tailored graph families for the specific problem at hand, resulting in lower bounds for artificially constructed inputs, instead of natural input distributions. One of our results is a lower bound for the directed planted clique problem. In this problem, an input graph is either a random directed graph (each directed edge is included with probability 1/2), or a random graph with a planted clique of size k. That is, k randomly chosen vertices have all of the edges between them included, and all other edges in the graph appear with probability 1/2. The goal is to determine whether a clique exists. We show that when k = n^(1/4 - eps), this problem requires a number of rounds polynomial in n. Additionally, we construct a pseudo-random generator which fools the Broadcast Congested Clique. This allows us to show that every k round randomized algorithm in which each processor uses up to n random bits can be efficiently transformed into an O(k)-round randomized algorithm in which each processor uses only up to O(k log n) random bits, while maintaining a high success probability. The pseudo-random generator is simple to describe, computationally very cheap, and its seed size is optimal up to constant factors. However, the analysis is quite involved, and is based on the new technique for proving lower bounds in the model. The technique also allows us to prove the first average case lower bound for the Broadcast Congested Clique, as well as an average-case time hierarchy.


title: Variability in the Atmosphere of the Hot Jupiter Kepler-76b

abstract: Phase curves and secondary eclipses of gaseous exoplanets are diagnostic of atmospheric composition and meteorology, and the long observational baseline and high photometric precision from the Kepler Mission make its dataset well-suited for exploring phase curve variability, which provides additional insights into atmospheric dynamics. Observations of the hot Jupiter Kepler-76b span more than 1,000 days, providing an ideal dataset to search for atmospheric variability. In this study, we find that Kepler-76b's secondary eclipse, with a depth of $87 \pm 6$ parts-per-million (ppm), corresponds to an effective temperature of 2,830$^{+50}_{-30}$ K. Our results also show clear indications of variability in Kepler-76b's atmospheric emission and reflectivity, with the phase curve amplitude typically $50.5 \pm 1.3$ ppm but varying between 35 and 70 ppm over tens of days. As is common for hot Jupiters, Kepler-76b's phase curve shows a discernible offset of $\left( 9 \pm 1.3 \right)^\circ$ eastward of the sub-stellar point and varying in concert with the amplitude. These variations may arise from the advance and retreat of thermal structures and cloud formations in Kepler-76b's atmosphere; the resulting thermal perturbations may couple with the super-rotation expected to transport aerosols, giving rise to a feedback loop. Looking forward, the TESS Mission can provide new insight into planetary atmospheres, with good prospects to observe both secondary eclipses and phase curves among targets from the mission. TESS's increased sensitivity in red wavelengths as compared to Kepler means that it will probably probe different aspects of planetary atmospheres.


title: Finite time blow up for wave equations with strong damping in an exterior domain

abstract: We consider the initial boundary value problem in exterior domain for strongly damped wave equations with power type nonlinearity |u|^p. We will establish blow-up results under some conditions on the initial data and the exponent p.


title: Homotopy Theory in Digital Topology

abstract: Digital topology is part of the ongoing endeavour to understand and analyze digitized images. With a view to supporting this endeavour, many notions from algebraic topology have been introduced into the setting of digital topology. But some of the most basic notions from homotopy theory remain largely absent from the digital topology literature. We embark on a development of homotopy theory in digital topology, and define such fundamental notions as function spaces, path spaces, and cofibrations in this setting. We establish digital analogues of basic homotopy-theoretic properties such as the homotopy extension property for cofibrations, and the homotopy lifting property for certain evaluation maps that correspond to path fibrations in the topological setting. We indicate that some depth may be achieved by using these homotopy-theoretic notions to give a preliminary treatment of Lusternik-Schnirelmann category in the digital topology setting. This topic provides a connection between digital topology and critical points of functions on manifolds, as well as other topics from topological dynamics.


title: Words of Engel type are concise in residually finite groups. Part II

abstract: Given a group-word w and a group G, the verbal subgroup w(G) is the one generated by all w-values in G. The word w is called concise if w(G) is finite whenever the set of w-values in G is finite. It is an open question whether every word is concise in residually finite groups. Let w=w(x_1,..,x_k) be a multilinear commutator word, n a positive integer and q a prime power. In the present article we show that the word [w^q,_n y] is concise in residually finite groups while the word [w,_n y] is boundedly concise in residually finite groups.


title: Sparse Transfer Learning via Winning Lottery Tickets

abstract: The recently proposed Lottery Ticket Hypothesis of Frankle and Carbin (2019) suggests that the performance of over-parameterized deep networks is due to the random initialization seeding the network with a small fraction of favorable weights. These weights retain their dominant status throughout training -- in a very real sense, this sub-network "won the lottery" during initialization. The authors find sub-networks via unstructured magnitude pruning with 85-95% of parameters removed that train to the same accuracy as the original network at a similar speed, which they call winning tickets. In this paper, we extend the Lottery Ticket Hypothesis to a variety of transfer learning tasks. We show that sparse sub-networks with approximately 90-95% of weights removed achieve (and often exceed) the accuracy of the original dense network in several realistic settings. We experimentally validate this by transferring the sparse representation found via pruning on CIFAR-10 to SmallNORB and FashionMNIST for object recognition tasks.


title: Superconductivity, Broken Gauge Symmetry, and the Higgs Mechanism

abstract: The association of broken symmetries with phase transitions is ubiquitous in condensed matter physics: crystals break translational symmetry, magnets break rotational symmetry, and superconductors break gauge symmetry. However, despite the frequency with which it is made, this last statement is a paradox. A gauge symmetry, in this case the U(1) gauge symmetry of electromagnetism, is a redundancy in our description of nature, so the notion of breaking such a "symmetry" is unphysical. Here, we will discuss how gauge symmetry breaks, and doesn't, inside a superconductor, and explore the fundamental relationship between gauge invariance and the striking phenomena observed in superconductors. The majority of this article is intended to be accessible to readers with only a basic knowledge of quantum mechanics.


title: The Cauchy problem for heat equation with fractional Laplacian and exponential nonlinearity

abstract: We consider the Cauchy problem for heat equation with fractional Laplacian and exponential nonlinearity. We establish local well-posedness result in Orlicz spaces. We derive the existence of global solutions for small initial data. We obtain decay estimates for large time in Lebesgue spaces.


title: Uniqueness of stationary states for singular Keller-Segel type models

abstract: We consider a generalised Keller-Segel model with non-linear porous medium type diffusion and non-local attractive power law interaction, focusing on potentials that are more singular than Newtonian interaction. We show uniqueness of stationary states (if they exist) in any dimension both in the diffusion-dominated regime and in the fair-competition regime when attraction and repulsion are in balance. As stationary states are radially symmetric decreasing, the question of uniqueness reduces to the radial setting. Our key result is a sharp generalised Hardy-Littlewood-Sobolev type functional inequality in the radial setting.


title: Discrete Formulation for the dynamics of rods deforming in space

abstract: We describe the main ingredients needed to create, from the smooth lagrangian density, a variational principle for discrete motions of a discrete rod, with corresponding conserved Noether currents. We describe all geometrical objects in terms of elements on the linear Atiyah bundle, using a reduced forward difference operator. We show how this introduces a discrete lagrangian density that models the discrete dynamics of a discrete rod. The presented tools are general enough to represent a discretization of any variational theory in principal bundles, and its simplicity allows to perform an iterative integration algorithm to compute the discrete rod evolution in time, starting from any predefined configurations of all discrete rod elements at initial times.


title: Correlation Coefficients and Semantic Textual Similarity

abstract: A large body of research into semantic textual similarity has focused on constructing state-of-the-art embeddings using sophisticated modelling, careful choice of learning signals and many clever tricks. By contrast, little attention has been devoted to similarity measures between these embeddings, with cosine similarity being used unquestionably in the majority of cases. In this work, we illustrate that for all common word vectors, cosine similarity is essentially equivalent to the Pearson correlation coefficient, which provides some justification for its use. We thoroughly characterise cases where Pearson correlation (and thus cosine similarity) is unfit as similarity measure. Importantly, we show that Pearson correlation is appropriate for some word vectors but not others. When it is not appropriate, we illustrate how common non-parametric rank correlation coefficients can be used instead to significantly improve performance. We support our analysis with a series of evaluations on word-level and sentence-level semantic textual similarity benchmarks. On the latter, we show that even the simplest averaged word vectors compared by rank correlation easily rival the strongest deep representations compared by cosine similarity.


title: Predicting Annotation Difficulty to Improve Task Routing and Model Performance for Biomedical Information Extraction

abstract: Modern NLP systems require high-quality annotated data. In specialized domains, expert annotations may be prohibitively expensive. An alternative is to rely on crowdsourcing to reduce costs at the risk of introducing noise. In this paper we demonstrate that directly modeling instance difficulty can be used to improve model performance, and to route instances to appropriate annotators. Our difficulty prediction model combines two learned representations: a `universal' encoder trained on out-of-domain data, and a task-specific encoder. Experiments on a complex biomedical information extraction task using expert and lay annotators show that: (i) simply excluding from the training data instances predicted to be difficult yields a small boost in performance; (ii) using difficulty scores to weight instances during training provides further, consistent gains; (iii) assigning instances predicted to be difficult to domain experts is an effective strategy for task routing. Our experiments confirm the expectation that for specialized tasks expert annotations are higher quality than crowd labels, and hence preferable to obtain if practical. Moreover, augmenting small amounts of expert data with a larger set of lay annotations leads to further improvements in model performance.


title: Timing and Frequency Synchronization for 1-bit Massive MU-MIMO-OFDM Downlink

abstract: We consider timing and frequency synchronization for the massive multiuser (MU) multiple-input multiple-output (MIMO) downlink where 1-bit digital-to-analog converters (DACs) are used at the base station (BS). We focus on the practically relevant scenario in which orthogonal-frequency division multiplexing (OFDM) is used to communicate over frequency-selective channels. Our contributions are twofold. First, we use Bussgang's theorem to analyze the impact on performance caused by timing and frequency offsets in the presence of 1-bit DACs at the BS. Second, we demonstrate the efficacy of the widely used Schmidl-Cox synchronization algorithm. Our results demonstrate that the 1-bit massive MU-MIMO-OFDM downlink is resilient against timing and frequency offsets.


title: On the Hodge structures of compact hyperk\"ahler manifolds

abstract: The purpose of this note is to give an account of a well-known folklore result: the Hodge structure on the second cohomology of a compact hyperk\"ahler manifold uniquely determines Hodge structures on all higher cohomology groups. We discuss the precise statement and its proof, which are somewhat difficult to locate in the literature.


title: Explicit Third-Order Model Reduction Formulas for General Nonlinear Mechanical Systems

abstract: For general nonlinear mechanical systems, we derive closed-form, reduced-order models up to cubic order based on rigorous invariant manifold results. For conservative systems, the reduction is based on Lyapunov Subcenter Manifold (LSM) theory, whereas for damped-forced systems, we use Spectral Submanifold (SSM) theory. To evaluate our explicit formulas for the reduced model, no coordinate changes are required beyond an initial linear one. The reduced-order models we derive are simple and depend only on physical and modal parameters, allowing us to extract fundamental characteristics, such as backbone curves and forced-response curves, of multi-degree-of-freedom mechanical systems. To numerically verify the accuracy of the reduced models, we test the reduction formulas on several mechanical systems, including a higher-dimensional nonlinear Timoshenko beam.


title: Curvature induced magnonic crystal in nanowires

abstract: A new type of magnonic crystals, curvature induced ones, is realized in ferromagnetic nanowires with periodically deformed shape. A magnon band structure of such crystal is fully determined by its curvature: the developed theory is well confirmed by simulations. An application to nanoscale spintronic devises with the geometrically tunable parameters is proposed, namely, to filter elements.


title: State conversions around exceptional points

abstract: We study state conversion in parity-time (PT) symmetry broken non-Hermitian two level system. We construct a theory and explain underlying mechanism for state conversion and define adiabatic evolutions in non-Hermitian systems. The adiabatic theorem can be used if initial state is an instantaneous eigenstate in Hermitian systems. We show that the system can adiabatically follow the modulationally stable instantaneous eigenstate sooner or later, regardless of initial state if the system parameters are varied slowly in non-Hermitian systems. We discuss the topological feature of dynamical circling in the parameter space.


title: Low-latency Visual SLAM with Appearance-Enhanced Local Map Building

abstract: A local map module is often implemented in modern VO/VSLAM systems to improve data association and pose estimation. Conventionally, the local map contents are determined by co-visibility. While co-visibility is cheap to establish, it utilizes the relatively-weak temporal prior (i.e. seen before, likely to be seen now), therefore admitting more features into the local map than necessary. This paper describes an enhancement to co-visibility local map building by incorporating a strong appearance prior, which leads to a more compact local map and latency reduction in downstream data association. The appearance prior collected from the current image influences the local map contents: only the map features visually similar to the current measurements are potentially useful for data association. To that end, mapped features are indexed and queried with Multi-index Hashing (MIH). An online hash table selection algorithm is developed to further reduce the query overhead of MIH and the local map size. The proposed appearance-based local map building method is integrated into a state-of-the-art VO/VSLAM system. When evaluated on two public benchmarks, the size of the local map, as well as the latency of real-time pose tracking in VO/VSLAM are significantly reduced. Meanwhile, the VO/VSLAM mean performance is preserved or improves.


title: Construction of irreducible polynomials through rational transformations

abstract: Let $\mathbb F_q$ be the finite field with $q$ elements, where $q$ is a power of a prime. We discuss recursive methods for constructing irreducible polynomials over $\mathbb F_q$ of high degree using rational transformations. In particular, given a divisor $D>2$ of $q+1$ and an irreducible polynomial $f\in \mathbb F_{q}[x]$ of degree $n$ such that $n$ is even or $D\not \equiv 2\pmod 4$, we show how to obtain from $f$ a sequence $\{f_i\}_{i\ge 0}$ of irreducible polynomials over $\mathbb F_q$ with $\mathrm{deg}(f_i)=n\cdot D^{i}$.


title: Adaptive Attention Span in Transformers

abstract: We propose a novel self-attention mechanism that can learn its optimal attention span. This allows us to extend significantly the maximum context size used in Transformer, while maintaining control over their memory footprint and computational time. We show the effectiveness of our approach on the task of character level language modeling, where we achieve state-of-the-art performances on text8 and enwiki8 by using a maximum context of 8k characters.


title: Plasma injection into a solar coronal loop

abstract: Context. The details of the spectral profiles of extreme UV emission lines from solar active regions contain key information to investigate the structure, dynamics, and energetics of the solar upper atmosphere. Aims. We characterize the line profiles not only through the Doppler shift and intensity of the bulk part of the profile. More importantly, we investigate the excess emission and asymmetries in the line wings to study twisting motions and helicity. Methods. WeusearasterscanoftheInterfaceRegionImagingSpectrograph(IRIS)inanactive region. We concentrate on the Si iv line at 1394 {\AA} that forms just below 0.1 MK and follow the plasma in a cool loop moving from one footpoint to the other. We apply single-Gaussian fits to the line core, determine the excess emission in the red and blue wings, and derive the red-blue line asymmetry. Results. The blue wing excess at one footpoint shows injection of plasma into the loop that is then flowing to the other side. At the same footpoint, redshifts of the line core indicate that energy is deposited at around 0.1 MK. The enhanced pressure would then push down the cool plasma and inject some plasma into the loop. In the middle part of the loop, the spectral tilts of the line profiles indicate the presence of a helical structure of the magnetic field, and the line wings are symmetrically enhanced. This is an indication that the loop is driven through the injection of helicity at the loop feet. Conclusions. Iftheloopisdriventobehelical,thenonecanexpectthatthemagneticfieldwill be in a turbulent state, as it has been shown by existing MHD models. The turbulent motions could provide an explanation of the (symmetric) line wing enhancements which have been seen also in loops at coronal temperatures, but have not been understood so far.


title: Formation of interstellar propanal and 1-propanol ice: a pathway involving solid-state CO hydrogenation

abstract: 1-propanol (CH3CH2CH2OH) is a three carbon-bearing representative of primary linear alcohols that may have its origin in the cold dark cores in interstellar space. To test this, we investigated in the laboratory whether 1-propanol ice can be formed along pathways possibly relevant to the prestellar core phase. We aim to show in a two-step approach that 1-propanol can be formed through reaction steps that are expected to take place during the heavy CO freeze-out stage by adding C2H2 into the CO + H hydrogenation network via the formation of propanal (CH3CH2CHO) as an intermediate and its subsequent hydrogenation. Temperature programmed desorption-quadrupole mass spectrometry (TPD-QMS) is used to identify the newly formed propanal and 1-propanol. Reflection absorption infrared spectroscopy (RAIRS) is used as a complementary diagnostic tool. The mechanisms that can contribute to the formation of solid-state propanal and 1-propanol, as well as other organic compounds, during the heavy CO freeze-out stage are constrained by both laboratory experiments and theoretical calculations. Here it is shown that recombination of HCO radicals, formed upon CO hydrogenation, with radicals formed upon C2H2 processing - H2CCH and H3CCH2 - offers possible reaction pathways to solid-state propanal and 1-propanol formation. This extends the already important role of the CO hydrogenation chain in the formation of larger COMs (complex organic molecules). The results are used to compare with ALMA observations. The resulting 1-propanol:propanal ratio concludes an upper limit of < 0:35-0:55, which is complemented by computationally-derived activation barriers in addition to the experimental results.


title: Path-integral Monte Carlo study of electronic states in quantum dots in an external magnetic field

abstract: We explore correlated electron states in harmonically confined few-electron quantum dots in an external magnetic field by the path-integral Monte Carlo method for a wide range of the field and the Coulomb interaction strength. Using the phase structure of a preceding unrestricted Hartree-Fock calculation for phase fixing, we find a rich variety of correlated states, often completely different from the prediction of mean-field theory. These are finite temperature results, but sometimes the correlations saturate with decreasing temperature, providing insight into the ground-state properties.


title: The matter fluctuation amplitude inferred from the weak lensing power spectrum and correlation function in CFHTLenS data

abstract: Based on the cosmic shear data from the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS), Kilbinger et al. (2013) obtained a constraint on the amplitude of matter fluctuations of $\sigma_8({\Omega_\mathrm{m}}/0.27)^{0.6}=0.79\pm0.03$ from the two-point correlation function (2PCF). This is $\approx3\sigma$ lower than the value $0.89\pm0.01$ derived from Planck data on cosmic microwave background (CMB) anisotropies. On the other hand, based on the same CFHTLenS data, but using the power spectrum, and performing a different analysis, Liu et al. (2015) obtained the higher value of $\sigma_8({\Omega_\mathrm{m}}/0.27)^{0.64}=0.87^{+0.05}_{-0.06}$. We here investigate the origin of this difference, by performing a fair side-by-side comparison of the 2PCF and power spectrum analyses on CFHTLenS data. We find that these two statistics indeed deliver different results, even when applied to the same data in an otherwise identical procedure. We identify excess power in the data on small scales ($\ell>5,000$) driving the larger values inferred from the power spectrum. We speculate on the possible origin of this excess small-scale power. More generally, our results highlight the utility of analysing the 2PCF and the power spectrum in tandem, to discover (and to help control) systematic errors.


title: $L_2$-small ball asymptotics for a family of finite-dimensional perturbations of Gaussian functions

abstract: In this article we study the small ball probabilities in $L_2$-norm for a family of finite-dimensional perturbations of Gaussian functions. We define three types of perturbations: non-critical, partially critical and critical; and derive small ball asymptotics for the perturbated process in terms of the small ball asymptotics for the original process. The natural examples of such perturbations appear in statistics in the study of empirical processes with estimated parameters (the so-called Durbin's processes). We show that the Durbin's processes are critical perturbations of the Brownian bridge. Under some additional assumptions, general results can be simplified. As an example we find the exact $L_2$-small ball asymptotics for critical perturbations of the Green processes (the processes which covariance function is the Green function of the ordinary differential operator).


title: Verification of Threshold-Based Distributed Algorithms by Decomposition to Decidable Logics

abstract: Verification of fault-tolerant distributed protocols is an immensely difficult task. Often, in these protocols, thresholds on set cardinalities are used both in the process code and in its correctness proof, e.g., a process can perform an action only if it has received an acknowledgment from at least half of its peers. Verification of threshold-based protocols is extremely challenging as it involves two kinds of reasoning: first-order reasoning about the unbounded state of the protocol, together with reasoning about sets and cardinalities. In this work, we develop a new methodology for decomposing the verification task of such protocols into two decidable logics: EPR and BAPA. Our key insight is that such protocols use thresholds in a restricted way as a means to obtain certain properties of "intersection" between sets. We define a language for expressing such properties, and present two translations: to EPR and BAPA. The EPR translation allows verifying the protocol while assuming these properties, and the BAPA translation allows verifying the correctness of the properties. We further develop an algorithm for automatically generating the properties needed for verifying a given protocol, facilitating fully automated deductive verification. Using this technique we have verified several challenging protocols, including Byzantine one-step consensus, hybrid reliable broadcast and fast Byzantine Paxos.


title: All-Sky-ASTROGAM: The MeV Gamma-Ray Companion to Multimessenger Astronomy

abstract: All-Sky-ASTROGAM is a gamma-ray observatory operating in a broad energy range, 100 keV to a few hundred MeV, recently proposed as the "Fast" (F) mission of the European Space Agency for a launch in 2028 to an L2 orbit. The scientific payload is composed of a unique gamma-ray imaging monitor for astrophysical transients, with very large field of view (almost 4$\pi$ sr) and optimal sensitivity to detect bright and intermediate flux sources (gamma-ray bursts, active galactic nuclei, X-ray binaries, supernovae and novae) at different timescales ranging from seconds to months. The mission will operate in a maturing gravitational wave and multi-messenger epoch, opening up new and exciting synergies.


title: Good Feature Selection for Least Squares Pose Optimization in VO/VSLAM

abstract: This paper aims to select features that contribute most to the pose estimation in VO/VSLAM. Unlike existing feature selection works that are focused on efficiency only, our method significantly improves the accuracy of pose tracking, while introducing little overhead. By studying the impact of feature selection towards least squares pose optimization, we demonstrate the applicability of improving accuracy via good feature selection. To that end, we introduce the Max-logDet metric to guide the feature selection, which is connected to the conditioning of least squares pose optimization problem. We then describe an efficient algorithm for approximately solving the NP-hard Max-logDet problem. Integrating Max-logDet feature selection into a state-of-the-art visual SLAM system leads to accuracy improvements with low overhead, as demonstrated via evaluation on a public benchmark.


title: Characterizing SLAM Benchmarks and Methods for the Robust Perception Age

abstract: The diversity of SLAM benchmarks affords extensive testing of SLAM algorithms to understand their performance, individually or in relative terms. The ad-hoc creation of these benchmarks does not necessarily illuminate the particular weak points of a SLAM algorithm when performance is evaluated. In this paper, we propose to use a decision tree to identify challenging benchmark properties for state-of-the-art SLAM algorithms and important components within the SLAM pipeline regarding their ability to handle these challenges. Establishing what factors of a particular sequence lead to track failure or degradation relative to these characteristics is important if we are to arrive at a strong understanding for the core computational needs of a robust SLAM algorithm. Likewise, we argue that it is important to profile the computational performance of the individual SLAM components for use when benchmarking. In particular, we advocate the use of time-dilation during ROS bag playback, or what we refer to as slo-mo playback. Using slo-mo to benchmark SLAM instantiations can provide clues to how SLAM implementations should be improved at the computational component level. Three prevalent VO/SLAM algorithms and two low-latency algorithms of our own are tested on selected typical sequences, which are generated from benchmark characterization, to further demonstrate the benefits achieved from computationally efficient components.


title: On $C^0$-continuity of the spectral norm for symplectically non-aspherical manifolds

abstract: The purpose of this paper is to study the relation between the $C^0$-topology and the topology induced by the spectral norm on the group of Hamiltonian diffeomorphisms of a closed symplectic manifold. Following the approach of Buhovsky-Humili\`ere-Seyfaddini, we prove the $C^0$-continuity of the spectral norm for complex projective spaces and negative monotone symplectic manifolds. The case of complex projective spaces provides an alternative approach to the $C^0$-continuity of the spectral norm proven by Shelukhin. We also prove a partial $C^0$-continuity of the spectral norm for rational symplectic manifolds. Some applications such as the Arnold conjecture in the context of $C^0$-symplectic topology are also discussed.


title: Unraveling the Effect of Electron-Electron Interaction on Electronic Transport in High-Mobility Stannate Films

abstract: Contrary to the common belief that electron-electron interaction (EEI) should be negligible in s-orbital-based conductors, we demonstrated that the EEI effect could play a significant role on electronic transport leading to the misinterpretation of the Hall data. We show that the EEI effect is primarily responsible for an increase in the Hall coefficient in the La-doped SrSnO3 films below 50 K accompanied by an increase in the sheet resistance. The quantitative analysis of the magnetoresistance (MR) data yielded a large phase coherence length of electrons exceeding 450 nm at 1.8 K and revealed the electron-electron interaction being accountable for breaking of electron phase coherency in La-doped SrSnO3 films. These results while providing critical insights into the fundamental transport behavior in doped stannates also indicate the potential applications of stannates in quantum coherent electronic devices owing to their large phase coherence length.


title: Transcendental Julia Sets with Fractional Packing Dimension

abstract: We construct a family of transcendental entire functions whose Julia sets have packing dimension in $(1,2)$. These are the first examples where the computed packing dimension is not $1$ or $2$. Our construction will allow us further show that the set of packing dimensions attained is dense in the interval $(1,2)$, and that the Hausdorff dimension of the Julia sets can be made arbitrarily close to the corresponding packing dimension.


title: Iterative Estimation of Nonparametric Regressions with Continuous Endogenous Variables and Discrete Instruments

abstract: We consider a nonparametric regression model with continuous endogenous independent variables when only discrete instruments are available that are independent of the error term. While this framework is very relevant for applied research, its implementation is cumbersome, as the regression function becomes the solution to a nonlinear integral equation. We propose a simple iterative procedure to estimate such models and showcase some of its asymptotic properties. In a simulation experiment, we discuss the details of its implementation in the case when the instrumental variable is binary. We conclude with an empirical application in which we examine the effect of pollution on house prices in a short panel of U.S. counties.


title: Decoupling of brain function from structure reveals regional behavioral specialization in humans

abstract: The brain is an assembly of neuronal populations interconnected by structural pathways. Brain activity is expressed on and constrained by this substrate. Therefore, statistical dependencies between functional signals in directly connected areas can be expected higher. However, the degree to which brain function is bound by the underlying wiring diagram remains a complex question that has been only partially answered. Here, we introduce the structural-decoupling index to quantify the coupling strength between structure and function, and we reveal a macroscale gradient from brain regions more strongly coupled, to regions more strongly decoupled, than expected by realistic surrogate data. This gradient spans behavioral domains from lower-level sensory function to high-level cognitive ones and shows for the first time that the strength of structure-function coupling is spatially varying in line with evidence derived from other modalities, such as functional connectivity, gene expression, microstructural properties and temporal hierarchy.


title: RE3/1 and RE4/1 RPC chambers integration in the inner region of the forward muon spectrometer in the CMS experiment

abstract: The high pseudorapidity ($\eta$) region of the Compact Muon Solenoid (CMS) muon system is covered by Cathode Strip Chambers only and lacks redundant coverage despite the fact that it is a challenging region for muons in terms of backgrounds and momentum resolution. During the annual Year-End Technical Stops 2022 & 2023, two new layers of improved Resistive Plate Chambers (iRPC) will be added, RE3/1 & RE4/1, which will completely cover the region of $1.8 < |\eta| < 2.4$ in the endcap. Thus, the additional new chambers will lead to increase efficiency for both trigger and offline reconstruction in the difficult region where the background is the highest and the magnetic field is the lowest within the muon system. The extended RPC system will improve the performance and the robustness of the muon trigger. The final design of iRPC chambers and the concept to integrate and install them in the CMS muon system have been finalized. In this report, the main results demonstrating the implementation and installation of the new iRPC detectors in the CMS muon system at high $|\eta|$ region will be presented.


title: Associated top-pair production with a heavy boson production through NLO+NNLL accuracy at the LHC

abstract: In this talk we present results of our recent calculations of cross sections and distributions for the associate production of top-antitop quark pairs with a heavy boson (Higgs, W, Z) at the LHC, obtained using threshold resummation in direct QCD, i.e. in the Mellin-space approach.


title: Development of an Advanced Force Field for Water using Variational Energy Decomposition Analysis

abstract: Given the piecewise approach to modeling intermolecular interactions for force fields, they can be difficult to parameterize since they are fit to data like total energies that only indirectly connect to their separable functional forms. Furthermore, by neglecting certain types of molecular interactions such as charge penetration and charge transfer, most classical force fields must rely on, but do not always demonstrate, how cancellation of errors occurs among the remaining molecular interactions accounted for such as exchange repulsion, electrostatics, and polarization. In this work we present the first generation of the (many-body) MB-UCB force field that explicitly accounts for the decomposed molecular interactions commensurate with a variational energy decomposition analysis, including charge transfer, with force field design choices that reduce the computational expense of the MB-UCB potential while remaining accurate. We optimize parameters using only single water molecule and water cluster data up through pentamers, with no fitting to condensed phase data, and we demonstrate that high accuracy is maintained when the force field is subsequently validated against conformational energies of larger water cluster data sets, radial distribution functions of the liquid phase, and the temperature dependence of thermodynamic and transport water properties. We conclude that MB-UCB is comparable in performance to MB-Pol, but is less expensive and more transferable by eliminating the need to represent short-ranged interactions through large parameter fits to high order polynomials.


title: Spatio-Temporal Adversarial Learning for Detecting Unseen Falls

abstract: Fall detection is an important problem from both the health and machine learning perspective. A fall can lead to severe injuries, long term impairments or even death in some cases. In terms of machine learning, it presents a severely class imbalance problem with very few or no training data for falls owing to the fact that falls occur rarely. In this paper, we take an alternate philosophy to detect falls in the absence of their training data, by training the classifier on only the normal activities (that are available in abundance) and identifying a fall as an anomaly. To realize such a classifier, we use an adversarial learning framework, which comprises of a spatio-temporal autoencoder for reconstructing input video frames and a spatio-temporal convolution network to discriminate them against original video frames. 3D convolutions are used to learn spatial and temporal features from the input video frames. The adversarial learning of the spatio-temporal autoencoder will enable reconstructing the normal activities of daily living efficiently; thus, rendering detecting unseen falls plausible within this framework. We tested the performance of the proposed framework on camera sensing modalities that may preserve an individual's privacy (fully or partially), such as thermal and depth camera. Our results on three publicly available datasets show that the proposed spatio-temporal adversarial framework performed better than other baseline frame based (or spatial) adversarial learning methods.


title: Magnetic resonance imaging of mean cell size in human breast tumors

abstract: Purpose: Cell size is a fundamental characteristic of all tissues, and changes in cell size in cancer reflect tumor status and response to treatments, such as apoptosis and cell cycle arrest. Unfortunately, cell size can only be obtained by pathologic evaluation of the tumor in the current standard of care. Previous imaging approaches can be implemented on only animal MRI scanners or require relatively long acquisition times that are undesirable for clinical imaging. There is a need to develop cell size imaging for clinics. Experimental Design: We propose a new method, IMPULSED (Imaging Microstructural Parameters Using Limited Spectrally Edited Diffusion) that can characterize mean cell sizes in solid tumors. We report the use of combined sequences with different gradient waveforms on human MRI and analytical equations that link DWI signals of real gradient waveforms and specific microstructural parameters such as cell size. We also describe comprehensive validations using computer simulations, cell experiments in vitro, and animal experiments in vivo and finally demonstrate applications in pre-operative breast cancer patients. Results: With fast acquisitions (~ 7 mins), IMPULSED can provide high-resolution (1.3 mm in-plane) mapping of mean cell size of human tumors in vivo on currently-available 3T MRI scanners. All validations suggest IMPULSED provide accurate and reliable measurements of mean cell size. Conclusion: The proposed IMPULSED method can assess cell size variations in the tumor of breast cancer patients, which may have the potential to assess early response to neoadjuvant therapy.


title: Not all groups are LEF groups, or can you know if a group is infinite?

abstract: This is an introduction to the class of groups that are locally embeddable into finite groups.


title: Generalized model of interacting integrable tops

abstract: We introduce a family of classical integrable systems describing dynamics of $M$ interacting ${\rm gl}_N$ integrable tops. It extends the previously known model of interacting elliptic tops. Our construction is based on the ${\rm GL}_N$ $R$-matrix satisfying the associative Yang-Baxter equation. The obtained systems can be considered as extensions of the spin type Calogero-Moser models with (the classical analogues of) anisotropic spin exchange operators given in terms of the $R$-matrix data. In $N=1$ case the spin Calogero-Moser model is reproduced. Explicit expressions for ${\rm gl}_{NM}$-valued Lax pair with spectral parameter and its classical dynamical $r$-matrix are obtained. Possible applications are briefly discussed.


title: The NP-hard problem of computing the maximal sample variance over interval data is solvable in almost linear time with high probability

abstract: We consider the algorithm by Ferson et al. (Reliable computing 11(3), p. 207-233, 2005) designed for solving the NP-hard problem of computing the maximal sample variance over interval data, motivated by robust statistics (in fact, the formulation can be written as a nonconvex quadratic program with a specific structure). First, we propose a new version of the algorithm improving its original time bound $O(n^2 2^\omega)$ to $O(n \log n+n\cdot 2^\omega)$, where $n$ is number of input data and $\omega$ is the clique number in a certain intersection graph. Then we treat input data as random variables as it is usual in statistics) and introduce a natural probabilistic data generating model. We get $2^\omega = O(n^{1/\log\log n})$ and $\omega = O(\log n / \log\log n)$ on average. This results in average computing time $O(n^{1+\epsilon})$ for $\epsilon > 0$ arbitrarily small, which may be considered as "surprisingly good" average time complexity for solving an NP-hard problem. Moreover, we prove the following tail bound on the distribution of computation time: hard instances, forcing the algorithm to compute in time $2^{\Omega(n)}$, occur rarely, with probability tending to zero at the rate $e^{-n\log\log n}$.


title: Minimal Achievable Sufficient Statistic Learning

abstract: We introduce Minimal Achievable Sufficient Statistic (MASS) Learning, a training method for machine learning models that attempts to produce minimal sufficient statistics with respect to a class of functions (e.g. deep networks) being optimized over. In deriving MASS Learning, we also introduce Conserved Differential Information (CDI), an information-theoretic quantity that - unlike standard mutual information - can be usefully applied to deterministically-dependent continuous random variables like the input and output of a deep network. In a series of experiments, we show that deep networks trained with MASS Learning achieve competitive performance on supervised learning and uncertainty quantification benchmarks.


title: Global distribution of far-ultraviolet emissions from highly ionized gas in the Milky Way

abstract: We present all-sky maps of two major FUV cooling lines, C IV and O VI, of highly ionized gas to investigate the nature of the transition-temperature gas. From the extinction-corrected line intensities of C IV and O VI, we calculated the gas temperature and the emission measure of the transition-temperature gas assuming isothermal plasma in the collisional ionization equilibrium. The gas temperature was found to be more or less uniform throughout the Galaxy with a value of (1.89 $\pm$ 0.06) $\times$ $10^5$ K. The emission measure of the transition-temperature gas is described well by a disk-like model in which the scale height of the electron density is $z_0=6_{-2}^{+3}$ kpc. The total mass of the transition-temperature gas is estimated to be approximately $6.4_{-2.8}^{+5.2}\times10^9 M_{\bigodot}$. We also calculated the volume-filling fraction of the transition-temperature gas, which was estimated to be $f=0.26\pm0.09$, and varies from $f\sim0.37$ in the inner Galaxy to $f\sim0.18$ in the outer Galaxy. The spatial distribution of C IV and O VI cannot be explained by a simple supernova remnant model or a three-phase model. The combined effects of supernova remnants and turbulent mixing layers can explain the intensity ratio of C IV and O VI. Thermal conduction front models and high-velocity cloud models are also consistent with our observation.


title: Detection of the Quantum Illumination Measurement

abstract: In this report, we discuss possibilities to detect a signal at the target from the quantum illumination protocol, that could serve as a quantum radar. We assume a simple universal detecting schema on the target and study if it is possible to discover the quantum illumination measurement and in what conditions considering the microwave regime. Assuming many simplifications, we found that the possibility or the advantage of the detection of the quantum illumination measurement strongly depends on the realization of the quantum illumination protocol.


title: Radiative transfer in half spaces of arbitrary dimension

abstract: We solve the classic albedo and Milne problems of plane-parallel illumination of an isotropically-scattering half-space when generalized to a Euclidean domain $\mathbb{R}^d$ for arbitrary $d \ge 1$. A continuous family of pseudo-problems and related $H$ functions arises and includes the classical 3D solutions, as well as 2D "Flatland" and rod-model solutions, as special cases. The Case-style eigenmode method is applied to the general problem and the internal scalar densities, emerging distributions, and their respective moments are expressed in closed-form. Universal properties invariant to dimension $d$ are highlighted and we find that a discrete diffusion mode is not universal for $d > 3$ in absorbing media. We also find unexpected correspondences between differing dimensions and between anisotropic 3D scattering and isotropic scattering in high dimension.


title: U-Net Based Multi-instance Video Object Segmentation

abstract: Multi-instance video object segmentation is to segment specific instances throughout a video sequence in pixel level, given only an annotated first frame. In this paper, we implement an effective fully convolutional networks with U-Net similar structure built on top of OSVOS fine-tuned layer. We use instance isolation to transform this multi-instance segmentation problem into binary labeling problem, and use weighted cross entropy loss and dice coefficient loss as our loss function. Our best model achieves F mean of 0.467 and J mean of 0.424 on DAVIS dataset, which is a comparable performance with the State-of-the-Art approach. But case analysis shows this model can achieve a smoother contour and better instance coverage, meaning it better for recall focused segmentation scenario. We also did experiments on other convolutional neural networks, including Seg-Net, Mask R-CNN, and provide insightful comparison and discussion.


title: On the Average Maximal Number of Balls in a Bin Resulting from Throwing r Balls into n Bins T times

abstract: We use the holonomic ansatz to estimate the asymptotic behavior, in $T$, of the average maximal number of balls in a bin that is obtained when one throws uniformly at random (without replacement) $r$ balls into $n$ bins, $T$ times. Our approach works, in principle, for any fixed $n$ and $r$. We were able to do the cases $(n,r)$ = $(2,1),(3,1),(4,1), (4,2)$, but things get too complicated for larger values of $n$ and $r$. We are pledging a \$150 donation to the OEIS for an explicit expression, (in terms of $n$, $r$, and $\pi$) for the constant $C_{n,r}$ such that that average equals $\frac{n}{r}\,T+C_{n,r} \sqrt{T}+O(1/\sqrt{T})$. In this version we announce that the problem has been solved (to the extent possible) by Marcus Michelen.


title: Galactic Chemical Evolution of Radioactive Isotopes

abstract: The presence of short-lived ($\sim$\,Myr) radioactive isotopes in meteoritic inclusions at the time of their formation represents a unique opportunity to study the circumstances that led to the formation of the Solar System. To interpret these observations we need to calculate the evolution of radioactive-to-stable isotopic ratios in the Galaxy. We present an extension of the open-source galactic chemical evolution codes NuPyCEE and JINAPyCEE that enables to track the decay of radioactive isotopes in the interstellar medium. We show how the evolution of isotopic ratio depends on the star formation history and efficiency, star-to-gas mass ratio, and galactic outflows. Given the uncertainties in the observations used to calibrate our model, our predictions for isotopic ratios at the time of formation of the Sun are uncertain by a factor of 3.6. At that time, to recover the actual radioactive-to-stable isotopic ratios predicted by our model, one can multiply the steady-state solution (see Equation~1) by $2.3^{+3.4}_{-0.7}$. However, in the cases where the radioactive isotope has a half-life longer than $\sim$\,200\,Myr, or the target radioactive or stable isotopes have mass- and/or metallicity-depended production rates, or they originate from different sources with different delay-time distributions, or the reference isotope is radioactive, our codes should be used for more accurate solutions. Our preliminary calculations confirm the dichotomy between radioactive nuclei in the early Solar System with $r$- and $s$-process origin, and that $^{55}$Mn and $^{60}$Fe can be explained by galactic chemical evolution, while $^{26}$Al cannot.


title: Small unit-distance graphs in the plane

abstract: We prove that a graph on up to 9 vertices is a unit-distance graph if and only if it does not contain one of 74 so-called minimal forbidden graphs. This extends the work of Chilakamarri and Mahoney (1995), who provide a similar classification for unit-distance graphs on up to 7 vertices.


title: HellaSwag: Can a Machine Really Finish Your Sentence?

abstract: Recent work by Zellers et al. (2018) introduced a new task of commonsense natural language inference: given an event description such as "A woman sits at a piano," a machine must select the most likely followup: "She sets her fingers on the keys." With the introduction of BERT, near human-level performance was reached. Does this mean that machines can perform human level commonsense inference? In this paper, we show that commonsense inference still proves difficult for even state-of-the-art models, by presenting HellaSwag, a new challenge dataset. Though its questions are trivial for humans (>95% accuracy), state-of-the-art models struggle (<48%). We achieve this via Adversarial Filtering (AF), a data collection paradigm wherein a series of discriminators iteratively select an adversarial set of machine-generated wrong answers. AF proves to be surprisingly robust. The key insight is to scale up the length and complexity of the dataset examples towards a critical 'Goldilocks' zone wherein generated text is ridiculous to humans, yet often misclassified by state-of-the-art models. Our construction of HellaSwag, and its resulting difficulty, sheds light on the inner workings of deep pretrained models. More broadly, it suggests a new path forward for NLP research, in which benchmarks co-evolve with the evolving state-of-the-art in an adversarial way, so as to present ever-harder challenges.


title: Testing DNN Image Classifiers for Confusion & Bias Errors

abstract: Image classifiers are an important component of today's software, from consumer and business applications to safety-critical domains. The advent of Deep Neural Networks (DNNs) is the key catalyst behind such wide-spread success. However, wide adoption comes with serious concerns about the robustness of software systems dependent on DNNs for image classification, as several severe erroneous behaviors have been reported under sensitive and critical circumstances. We argue that developers need to rigorously test their software's image classifiers and delay deployment until acceptable. We present an approach to testing image classifier robustness based on class property violations. We found that many of the reported erroneous cases in popular DNN image classifiers occur because the trained models confuse one class with another or show biases towards some classes over others. These bugs usually violate some class properties of one or more of those classes. Most DNN testing techniques focus on per-image violations, so fail to detect class-level confusions or biases. We developed a testing technique to automatically detect class-based confusion and bias errors in DNN-driven image classification software. We evaluated our implementation, DeepInspect, on several popular image classifiers with precision up to 100% (avg.~72.6%) for confusion errors, and up to 84.3% (avg.~66.8%) for bias errors. DeepInspect found hundreds of classification mistakes in widely-used models, many exposing errors indicating confusion or bias.


title: On non-local ergodic Jacobi semigroups: spectral theory, convergence-to-equilibrium and contractivity

abstract: In this paper, we introduce and study non-local Jacobi operators, which generalize the classical (local) Jacobi operators. We show that these operators extend to generators of ergodic Markov semigroups with unique invariant probability measures and study their spectral and convergence properties. In particular, we derive a series expansion of the semigroup in terms of explicitly defined polynomials, which generalize the classical Jacobi orthogonal polynomials. In addition, we give a complete characterization of the spectrum of the non-self-adjoint generator and semigroup. We show that the variance decay of the semigroup is hypocoercive with explicit constants, which provides a natural generalization of the spectral gap estimate. After a random warm-up time, the semigroup also decays exponentially in entropy and is both hypercontractive and ultracontractive. Our proofs hinge on the development of commutation identities, known as intertwining relations, between local and non-local Jacobi operators and semigroups, with the local objects serving as reference points for transferring properties from the local to the non-local case.


title: Shaping the learning landscape in neural networks around wide flat minima

abstract: Learning in Deep Neural Networks (DNN) takes place by minimizing a non-convex high-dimensional loss function, typically by a stochastic gradient descent (SGD) strategy. The learning process is observed to be able to find good minimizers without getting stuck in local critical points, and that such minimizers are often satisfactory at avoiding overfitting. How these two features can be kept under control in nonlinear devices composed of millions of tunable connections is a profound and far reaching open question. In this paper we study basic non-convex one- and two-layer neural network models which learn random patterns, and derive a number of basic geometrical and algorithmic features which suggest some answers. We first show that the error loss function presents few extremely wide flat minima (WFM) which coexist with narrower minima and critical points. We then show that the minimizers of the cross-entropy loss function overlap with the WFM of the error loss. We also show examples of learning devices for which WFM do not exist. From the algorithmic perspective we derive entropy driven greedy and message passing algorithms which focus their search on wide flat regions of minimizers. In the case of SGD and cross-entropy loss, we show that a slow reduction of the norm of the weights along the learning process also leads to WFM. We corroborate the results by a numerical study of the correlations between the volumes of the minimizers, their Hessian and their generalization performance on real data.


title: A Generalization of the Gram determinant of type A

abstract: The Gram determinant of type $A$ was introduced by Lickorish in his work on invariants of 3 - manifolds. We generalize the theory of the Gram determinant of type $A$ by evaluating, in the annulus, a bilinear form of non-intersecting connections in the disc. The main result provides a closed formula for this Gram determinant. We conclude the paper by discussing Chen's conjecture about the Gram determinant of type $Mb$ evaluated in the Klein bottle.


title: Label Mapping Neural Networks with Response Consolidation for Class Incremental Learning

abstract: Class incremental learning refers to a special multi-class classification task, in which the number of classes is not fixed but is increasing with the continual arrival of new data. Existing researches mainly focused on solving catastrophic forgetting problem in class incremental learning. To this end, however, these models still require the old classes cached in the auxiliary data structure or models, which is inefficient in space or time. In this paper, it is the first time to discuss the difficulty without support of old classes in class incremental learning, which is called as softmax suppression problem. To address these challenges, we develop a new model named Label Mapping with Response Consolidation (LMRC), which need not access the old classes anymore. We propose the Label Mapping algorithm combined with the multi-head neural network for mitigating the softmax suppression problem, and propose the Response Consolidation method to overcome the catastrophic forgetting problem. Experimental results on the benchmark datasets show that our proposed method achieves much better performance compared to the related methods in different scenarios.