title: Structure Learning for Cyclic Linear Causal Models

abstract: We consider the problem of structure learning for linear causal models based on observational data. We treat models given by possibly cyclic mixed graphs, which allow for feedback loops and effects of latent confounders. Generalizing related work on bow-free acyclic graphs, we assume that the underlying graph is simple. This entails that any two observed variables can be related through at most one direct causal effect and that (confounding-induced) correlation between error terms in structural equations occurs only in absence of direct causal effects. We show that, despite new subtleties in the cyclic case, the considered simple cyclic models are of expected dimension and that a previously considered criterion for distributional equivalence of bow-free acyclic graphs has an analogue in the cyclic case. Our result on model dimension justifies in particular score-based methods for structure learning of linear Gaussian mixed graph models, which we implement via greedy search.


title: Product Forms for FCFS Queueing Models with Arbitrary Server-Job Compatibilities: An Overview

abstract: In recent years a number of models involving different compatibilities between jobs and servers in queueing systems, or between agents and resources in matching systems, have been studied, and, under Markov assumptions and appropriate stability conditions, the stationary distributions have been shown to have product forms. We survey these results and show how, under an appropriate detailed description of the state, many are corollaries of similar results for the Order Independent Queue. We also discuss how to use the product form results to determine distributions for steady-state response times.


title: Hard core run and tumble particles on a one dimensional lattice

abstract: We study the large scale behavior of a collection of hard core run and tumble particles on a one dimensional lattice with periodic boundary conditions. Each particle has persistent motion in one direction decided by an associated spin variable until the direction of spin is reversed. We map the run and tumble model to a mass transfer model with fluctuating directed bonds. We calculate the steady state single site mass distribution in the mass model within a mean field approximation for larger spin-flip rates and by analyzing an appropriate coalescence fragmentation model for small spin-flip rates. We also calculate the hydrodynamic coefficients of diffusivity and conductivity for both large and small spin-flip rates and show that the Einstein relation is violated in both regimes. We also show how the non-gradient nature of the process can be taken into account in a systematic manner to calculate the hydrodynamic coefficients.


title: Neutrino Floor in Leptophilic $U(1)$ Models: Modification in $U(1)_{L_{\mu}-L_{\tau}}$

abstract: In this work, we investigate the beyond standard model (BSM) impact of leptophilic U(1) models, namely $ U(1)_{L_\mu-L_e}$, $U(1)_{L_e-L_\tau}$ and $U(1)_{L_\mu-L_\tau}$ on coherent elastic neutrino-nucleus scattering (CE$\nu$NS) and hence its effect on dark matter (DM) direct detection experiments. Imposing the latest relevant experimental constraints on these models, we obtain $\mathcal{O}(50\%)$ enhancement for case of $U(1)_{L_\mu-L_\tau}$ in a region $m_Z' \approx 20~$MeV. Subsequently, we observe that the enhancement seen in CE$\nu$NS is roughly getting translated to enhancement by a factor of 2.7 (for Germanium based detectors) and 1.8 (for Xenon based detectors) in the neutrino scattering event rate which eventually enhances the neutrino floor by same amount. This enhancement is more prominent in the region with DM masses less than 10 GeV. The model parameter space that leads to this enhancement, can simultaneously explain both anomalous magnetic moment of muon ($(g-2)_{\mu}$) and observed DM relic density, in a modified scenario. Enhancement of neutrino floor requires increased number of DM-nucleon scattering events in the future DM direct detection experiments, to establish themselves to be DM signal events. In absence of any DM signal, those experiments can directly be used to measure the neutrino rate, quantifying the BSM effects.


title: Representation formulas and pointwise properties for Barron functions

abstract: We study the natural function space for infinitely wide two-layer neural networks with ReLU activation (Barron space) and establish different representation formulae. In two cases, we describe the space explicitly up to isomorphism. Using a convenient representation, we study the pointwise properties of two-layer networks and show that functions whose singular set is fractal or curved (for example distance functions from smooth submanifolds) cannot be represented by infinitely wide two-layer networks with finite path-norm. We use this structure theorem to show that the only $C^1$-diffeomorphisms which Barron space are affine. Furthermore, we show that every Barron function can be decomposed as the sum of a bounded and a positively one-homogeneous function and that there exist Barron functions which decay rapidly at infinity and are globally Lebesgue-integrable. This result suggests that two-layer neural networks may be able to approximate a greater variety of functions than commonly believed.


title: Pandemic Pulse: Unraveling and Modeling Social Signals during the COVID-19 Pandemic

abstract: We present and begin to explore a collection of social data that represents part of the COVID-19 pandemic's effects on the United States. This data is collected from a range of sources and includes longitudinal trends of news topics, social distancing behaviors, community mobility changes, web searches, and more. This multimodal effort enables new opportunities for analyzing the impacts such a pandemic has on the pulse of society. Our preliminary results show that the number of COVID-19-related news articles published immediately after the World Health Organization declared the pandemic on March 11, and that since that time have steadily decreased---regardless of changes in the number of cases or public policies. Additionally, we found that politically moderate and scientifically-grounded sources have, relative to baselines measured before the beginning of the pandemic, published a lower proportion of COVID-19 news than more politically extreme sources. We suggest that further analysis of these multimodal signals could produce meaningful social insights and present an interactive dashboard to aid further exploration.


title: On subconvexity bounds for twisted L-functions

abstract: We prove hybrid subconvexity bounds for a wide class of twisted L-functions $L(s,f\times \chi)$ at the central point, including a new instance of the Weyl subconvexity bound.


title: Kaon decays shedding light on massless dark photons

abstract: We explore kaon decays with missing energy carried away by a massless dark photon, $\bar\gamma$, assumed to have flavor-changing dipole-type couplings to the $d$ and $s$ quarks. We consider in particular the neutral-kaon modes $K_L\to\gamma\bar\gamma$ and $K_L\to\pi^0\gamma\bar\gamma$ and their $K_S$ counterparts, as well as the charged-kaon channel $K^+\to\pi^+\gamma\bar\gamma$, each of which also has an ordinary photon, $\gamma$, in the final state. In addition, we look at $K_{L,S}\to\pi^+\pi^-\bar\gamma$ and $K^+\to\pi^+\pi^0\bar\gamma$. Interestingly, the same $ds\bar\gamma$ interactions give rise to the flavor-changing two-body decays of hyperons with missing energy and are subject to model-independent constraints that can be inferred from the existing hyperon data. Taking this into account, we obtain branching fractions ${\cal B}(K_L\to\gamma\bar\gamma)$ and ${\cal B}(K_L\to\pi^0\gamma\bar\gamma)$ which can be as high as $10^{-3}$ and $10^{-6}$, respectively, one or both of which may be within the sensitivity reach of the KOTO experiment. Furthermore, we find that ${\cal B}(K^+\to\pi^+\gamma\bar\gamma)$ and ${\cal B}(K^+\to\pi^+\pi^0\bar\gamma)$ are allowed to be maximally of order $10^{-6}$ as well, which may be probed by NA62. Complementarily, the hyperon modes can have rates which are potentially accessible by BESIII. Thus, these ongoing experiments could soon be able to offer significant tests on the existence of the massless dark photon.


title: ClarQ: A large-scale and diverse dataset for Clarification Question Generation

abstract: Question answering and conversational systems are often baffled and need help clarifying certain ambiguities. However, limitations of existing datasets hinder the development of large-scale models capable of generating and utilising clarification questions. In order to overcome these limitations, we devise a novel bootstrapping framework (based on self-supervision) that assists in the creation of a diverse, large-scale dataset of clarification questions based on post-comment tuples extracted from stackexchange. The framework utilises a neural network based architecture for classifying clarification questions. It is a two-step method where the first aims to increase the precision of the classifier and second aims to increase its recall. We quantitatively demonstrate the utility of the newly created dataset by applying it to the downstream task of question-answering. The final dataset, ClarQ, consists of ~2M examples distributed across 173 domains of stackexchange. We release this dataset in order to foster research into the field of clarification question generation with the larger goal of enhancing dialog and question answering systems.


title: Revisiting Few-sample BERT Fine-tuning

abstract: This paper is a study of fine-tuning of BERT contextual representations, with focus on commonly observed instabilities in few-sample scenarios. We identify several factors that cause this instability: the common use of a non-standard optimization method with biased gradient estimation; the limited applicability of significant parts of the BERT network for down-stream tasks; and the prevalent practice of using a pre-determined, and small number of training iterations. We empirically test the impact of these factors, and identify alternative practices that resolve the commonly observed instability of the process. In light of these observations, we re-visit recently proposed methods to improve few-sample fine-tuning with BERT and re-evaluate their effectiveness. Generally, we observe the impact of these methods diminishes significantly with our modified process.


title: Random Reshuffling: Simple Analysis with Vast Improvements

abstract: Random Reshuffling (RR) is an algorithm for minimizing finite-sum functions that utilizes iterative gradient descent steps in conjunction with data reshuffling. Often contrasted with its sibling Stochastic Gradient Descent (SGD), RR is usually faster in practice and enjoys significant popularity in convex and non-convex optimization. The convergence rate of RR has attracted substantial attention recently and, for strongly convex and smooth functions, it was shown to converge faster than SGD if 1) the stepsize is small, 2) the gradients are bounded, and 3) the number of epochs is large. We remove these 3 assumptions, improve the dependence on the condition number from $\kappa^2$ to $\kappa$ (resp. from $\kappa$ to $\sqrt{\kappa}$) and, in addition, show that RR has a different type of variance. We argue through theory and experiments that the new variance type gives an additional justification of the superior performance of RR. To go beyond strong convexity, we present several results for non-strongly convex and non-convex objectives. We show that in all cases, our theory improves upon existing literature. Finally, we prove fast convergence of the Shuffle-Once (SO) algorithm, which shuffles the data only once, at the beginning of the optimization process. Our theory for strongly-convex objectives tightly matches the known lower bounds for both RR and SO and substantiates the common practical heuristic of shuffling once or only a few times. As a byproduct of our analysis, we also get new results for the Incremental Gradient algorithm (IG), which does not shuffle the data at all.


title: Anticanonically balanced metrics on Fano manifolds

abstract: We show that if a Fano manifold has discrete automorphism group and admits a polarized K\"ahler-Einstein metric, then there exists a sequence of anticanonically balanced metrics converging smoothly to the K\"ahler-Einstein metric. Our proof is based on a simplification of Donaldson's proof of the analogous result for balanced metrics, replacing a delicate geometric argument by the use of Berezin-Toeplitz quantization. We then apply this result to compute the asymptotics of the optimal rate of convergence to the fixed point of Donaldson's iterations in the anticanonical setting.


title: What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

abstract: In recent years, on-policy reinforcement learning (RL) has been successfully applied to many different continuous control tasks. While RL algorithms are often conceptually simple, their state-of-the-art implementations take numerous low- and high-level design decisions that strongly affect the performance of the resulting agents. Those choices are usually not extensively discussed in the literature, leading to discrepancy between published descriptions of algorithms and their implementations. This makes it hard to attribute progress in RL and slows down overall progress [Engstrom'20]. As a step towards filling that gap, we implement >50 such ``choices'' in a unified on-policy RL framework, allowing us to investigate their impact in a large-scale empirical study. We train over 250'000 agents in five continuous control environments of different complexity and provide insights and practical recommendations for on-policy training of RL agents.


title: Unambiguous evidence of three coexisting ferroelectric phases in a lead-free Li$_{x}$Na$_{1-x}$NbO$_{3}$ system

abstract: We report here the presence of three coexisting ferroelectric phases in a lead-free lithium sodium niobate (Li$_{x}$Na$_{1-x}$NbO$_{3}$; LNNx) system stable for $0.15 \leq x \leq 0.80$, which contrasts the review report of Dixon and Lightfoot [Phys. Rev. B $\textbf{97}$, 224105 (2018)]. More importantly, we have identified LNN20 as an important composition for technological applications due to its high dielectric permittivity, low loss, and high ferroelectric response. The anomalous dielectric and ferroelectric responses in LNN20 have been attributed to the morphotropic phase boundary like nature around this composition.


title: IRAM 30m-EMIR Redshift Search of z = 3-4 Lensed Dusty Starbursts selected from the HerBS sample

abstract: Using the EMIR instrument on the IRAM 30m telescope, we conducted a spectroscopic redshift search of seven z$_{\rm phot}$ $\sim$ 4 sub-millimetre bright galaxies selected from the Herschel Bright Sources (HerBS) sample with fluxes at 500 $\mu$m greater than 80 mJy. For four sources, we obtained spectroscopic redshifts between 3.4 < z < 4.1 through the detection of multiple CO-spectral lines with J $\leq$ 3. Later, we detected low-J transitions for two of these sources with the GBT including the CO(1-0) transition. For the remaining three sources, more data are needed to determine the spectroscopic redshift unambiguously. The measured CO luminosities and line widths suggest that all these sources are gravitationally lensed. These observations demonstrate that the 2 mm window is indispensable to confirm robust spectroscopic redshifts for z < 4 sources. Finally, we present an efficient graphical method to correctly identify spectroscopic redshifts.


title: CAN-D: A Modular Four-Step Pipeline for Comprehensively Decoding Controller Area Network Data

abstract: CANs are a broadcast protocol for real-time communication of critical vehicle subsystems. Original equipment manufacturers of passenger vehicles hold secret their mappings of CAN data to vehicle signals, and these definitions vary according to make, model, and year. Without these mappings, the wealth of real-time vehicle information hidden in the CAN packets is uninterpretable, impeding vehicle-related research. Guided by the 4-part CAN signal definition, we present CAN-D (CAN-Decoder), a modular, 4-step pipeline for identifying each signal's boundaries (start bit, length), endianness (byte order), signedness (bit-to-integer encoding), and by leveraging diagnostic standards, augmenting a subset of the extracted signals with physical interpretation. We provide a comprehensive review of the CAN signal reverse engineering research. Previous methods ignore endianness and signedness, rendering them incapable of decoding many standard CAN signal definitions. Incorporating endianness grows the search space from 128 to 4.72E21 signal tokenizations and introduces a web of changing dependencies. We formulate, formally analyze, and provide an efficient solution to an optimization problem, allowing identification of the optimal set of signal boundaries and byte orderings. We provide two novel, state-of-the-art signal boundary classifiers-both superior to previous approaches in precision and recall in three different test scenarios-and the first signedness classification algorithm which exhibits a $>$97\% F-score. CAN-D is the only solution with the potential to extract any CAN signal. In evaluation on 10 vehicles, CAN-D's average $\ell^1$ error is 5x better than all previous methods and exhibits lower ave. error, even when considering only signals that meet prior methods' assumptions. CAN-D is implemented in lightweight hardware, allowing for an OBD-II plugin for real-time in-vehicle CAN decoding.


title: When Science is a Game

abstract: What happens when scientists are, at certain points in a field's development, playing a game? I present a framework for such an analysis that draws on the theory of games provided by the historian Johan Huizinga. Huizinga gives five conditions for a social practice to become a game: free engagement, disconnection, boundedness in time and arena, the order-creation of rules, and the presence of tension. Application of this theory to scientific practice predicts patterns of behavior that can be tested by quantitative analysis: the emergence of hard boundaries between disciplines, the closure of loopholes in theory creation, resistance to certain innovations in journal publication, and the ways in which scientists fail to prosecute colleagues who engage in questionable research practices.


title: Neutral Cr and V in the atmosphere of ultra hot jupiter WASP-121 b

abstract: Ultra hot jupiters (UHJs), giant exoplanets with equilibrium temperatures above 2000 K, are ideal laboratories for studying metal compositions of planetary atmospheres. At these temperatures the thermal dissociation of metal-rich molecules into their constituent elements makes these atmospheres conducive for elemental characterisation. Several elements, mostly ionized metals, have been detected in UHJs recently using high resolution transit spectroscopy. Even though a number of neutral transition metals (e.g., Fe, Ti, V, Cr) are expected to be strong sources of optical/NUV opacity and, hence, influence radiative processes in the lower atmospheres of UHJs, only Fe I has been detected to date. We conduct a systematic search for atomic species in the UHJ WASP-121 b. Using theoretical models we present a metric to predict the atomic species likely to be detectable in such planets with high resolution transmission spectroscopy. We search for the predicted species in observations of WASP-121 b and report the first detections of neutral transition metals Cr I and V I in an exoplanet at 3.6 $\sigma$ and 4.5 $\sigma$, respectively. We confirm previous detections of Fe I and Fe II. Whereas Fe II was detected previously in the NUV, we detect it in the optical. We infer that the neutral elements Fe I, V I, and Cr I are present in the lower atmosphere, as predicted by thermochemical equilibrium, while Fe II is a result of photoionisation in the upper atmosphere. Our study highlights the rich chemical diversity of UHJs.


title: Recovery of 21 cm intensity maps with sparse component separation

abstract: 21 cm intensity mapping has emerged as a promising technique to map the large-scale structure of the Universe. However, the presence of foregrounds with amplitudes orders of magnitude larger than the cosmological signal constitutes a critical challenge. Here, we test the sparsity-based algorithm Generalised Morphological Component Analysis (GMCA) as a blind component separation technique for this class of experiments. We test the GMCA performance against realistic full-sky mock temperature maps that include, besides astrophysical foregrounds, also a fraction of the polarized part of the signal leaked into the unpolarized one, a very troublesome foreground to subtract, usually referred to as polarization leakage. To our knowledge, this is the first time the removal of such component is performed with no prior assumption. We assess the success of the cleaning by comparing the true and recovered power spectra, in the angular and radial directions. In the best scenario looked at, GMCA is able to recover the input angular (radial) power spectrum with an average bias of $\sim 5\%$ for $\ell>25$ ($20 - 30 \%$ for $k_{\parallel} \gtrsim 0.02 \,h^{-1}$Mpc), in the presence of polarization leakage. Our results are robust also when up to $40\%$ of channels are missing, mimicking a Radio Frequency Interference (RFI) flagging of the data. Having quantified the notable effect of polarisation leakage on our results, in perspective we advocate the use of more realistic simulations when testing 21 cm intensity mapping capabilities.


title: Powering galactic super-winds with small-scale AGN winds

abstract: We present a new implementation for active galactic nucleus (AGN) feedback through small-scale, ultra-fast winds in the moving-mesh hydrodynamic code AREPO. The wind is injected by prescribing mass, momentum and energy fluxes across a spherical boundary centred on a supermassive black hole according to available constraints for accretion disc winds. After sweeping-up a mass equal to their own, small-scale winds thermalise, powering energy-driven outflows with dynamics, structure and cooling properties in excellent agreement with those of analytic wind solutions. Momentum-driven solutions do not easily occur, because the Compton cooling radius is usually much smaller than the free-expansion radius of the small-scale winds. Through various convergence tests, we demonstrate that our implementation yields wind solutions which are well converged down to the typical resolution achieved in cosmological simulations. We test our model in hydrodynamic simulations of isolated Milky Way - mass galaxies. Above a critical AGN luminosity, initially spherical, small-scale winds power bipolar, energy-driven super-winds that break out of the galactic nucleus, flowing at speeds $> 1000 \rm \, km \, s^{-1}$ out to $\sim 10 \, \rm kpc$. These energy-driven outflows result in moderate, but long-term, reduction in star formation, which becomes more pronounced for higher AGN luminosities and faster small-scale winds. Suppression of star formation proceeds through a rapid mode that involves the removal of the highest-density, nuclear gas and through a slower mode that effectively halts halo gas accretion. Our new implementation makes it possible to model AGN-driven winds in a physically meaningful and validated way in simulations of galaxy evolution, the interstellar medium and black hole accretion flows.


title: Multiwavelength classification of X-ray selected galaxy cluster candidates using convolutional neural networks

abstract: Galaxy clusters appear as extended sources in XMM-Newton images, but not all extended sources are clusters. So, their proper classification requires visual inspection with optical images, which is a slow process with biases that are almost impossible to model. We tackle this problem with a novel approach, using convolutional neural networks (CNNs), a state-of-the-art image classification tool, for automatic classification of galaxy cluster candidates. We train the networks on combined XMM-Newton X-ray observations with their optical counterparts from the all-sky Digitized Sky Survey. Our data set originates from the X-CLASS survey sample of galaxy cluster candidates, selected by a specially developed pipeline, the XAmin, tailored for extended source detection and characterisation. Our data set contains 1 707 galaxy cluster candidates classified by experts. Additionally, we create an official Zooniverse citizen science project, The Hunt for Galaxy Clusters, to probe whether citizen volunteers could help in a challenging task of galaxy cluster visual confirmation. The project contained 1 600 galaxy cluster candidates in total of which 404 overlap with the expert's sample. The networks were trained on expert and Zooniverse data separately. The CNN test sample contains 85 spectroscopically confirmed clusters and 85 non-clusters that appear in both data sets. Our custom network achieved the best performance in the binary classification of clusters and non-clusters, acquiring accuracy of 90 %, averaged after 10 runs. The results of using CNNs on combined X-ray and optical data for galaxy cluster candidate classification are encouraging and there is a lot of potential for future usage and improvements.


title: The dust never settles: collisional production of gas and dust in evolved planetary systems

abstract: Multi-epoch infrared photometry from Spitzer is used to monitor circumstellar discs at white dwarfs, which are consistent with disrupted minor planets whose debris is accreted and chemically reflected by their host stars. Widespread infrared variability is found across the population of 37 stars with two or more epochs. Larger flux changes occur on longer time-scales, reaching several tens of per cent over baselines of a few years. The canonical model of a geometrically thin, optically thick disc is thus insufficient, as it cannot give rise to the observed behaviour. Optically thin dust best accounts for the variability, where collisions drive dust production and destruction. Notably, the highest infrared variations are seen in systems that show Ca II emission, supporting planetesimal collisions for all known debris discs, with the most energetic occurring in those with detected gaseous debris. The sample includes the only polluted white dwarf with a circumbinary disc, where the signal of the day-night cycle of its irradiated substellar companion appears diluted by dust emission.


title: Solar System limits on gravitational dipoles

abstract: The gravitational dipole theory of Hadjukovic (2010) is based on the hypothesis that antimatter has a negative gravitational mass and thus falls upwards on Earth. Astrophysically, the model is similar to but more fundamental than Modified Newtonian Dynamics (MOND), with the Newtonian gravity $g_{_N}$ towards an isolated point mass boosted by the factor $\nu = 1 + \left( \alpha/x \right) \tanh \left( \sqrt{x}/\alpha \right)$, where $x \equiv g_{_N}/a_{_0}$ and $a_{_0} = 1.2 \times 10^{-10}$ m/s$^2$ is the MOND acceleration constant. We show that $\alpha$ must lie in the range ${0.4-1}$ to acceptably fit galaxy rotation curves. In the Solar System, this interpolating function implies an extra Sunwards acceleration of ${\alpha a_{_0}}$. This would cause Saturn to deviate from Newtonian expectations by ${7000 \left( \alpha/0.4 \right)}$ km over 15 years, starting from known initial position and velocity on a near-circular orbit. We demonstrate that this prediction should not be significantly altered by the postulated dipole haloes of other planets due to the rather small region in which each planet's gravity dominates over that of the Sun. The orbit of Saturn should similarly be little affected by a possible ninth planet in the outer Solar System and by the Galactic gravity causing a non-spherical distribution of gravitational dipoles several kAU from the Sun. Radio tracking of the Cassini spacecraft orbiting Saturn yields a ${5\sigma}$ upper limit of 160 metres on deviations from its conventionally calculated trajectory. These measurements imply a much more stringent upper limit on $\alpha$ than the minimum required for consistency with rotation curve data. Therefore, no value of $\alpha$ can simultaneously match all available constraints, falsifying the gravitational dipole theory in its current form at extremely high significance.


title: Quasilocal conservation laws in cosmology: a first look

abstract: Quasilocal definitions of stress-energy-momentum---that is, in the form of boundary densities (in lieu of local volume densities)---have proven generally very useful in formulating and applying conservation laws in general relativity. In this essay, we take a first basic look into applying these to cosmology, specifically using the Brown-York quasilocal stress-energy-momentum tensor for matter and gravity combined. We compute this tensor and present some simple results for a flat FLRW spacetime with a perfect fluid matter source.


title: Quantum Many-body Bootstrap

abstract: A numerical bootstrap method is proposed to provide rigorous and nontrivial bounds in general quantum many-body systems with locality. In particular, lower bounds on ground state energies of local lattice systems are obtained by imposing positivity constraints on certain operator expectation values. Complemented with variational upper bounds, ground state observables are constrained to be within a narrow range. The method is demonstrated with the Hubbard model in one and two dimensions, and bounds on ground state double occupancy and magnetization are discussed.


title: Observing the fate of the false vacuum with a quantum laboratory

abstract: We design and implement a quantum laboratory to experimentally observe and study dynamical processes of quantum field theories. Our approach encodes the field theory as an Ising model, which is then solved by a quantum annealer. As a proof-of-concept, we encode a scalar field theory and measure the probability for it to tunnel from the false to the true vacuum for various tunnelling times, vacuum displacements and potential profiles. The results are in accord with those predicted theoretically, showing that a quantum annealer is a genuine quantum system that can be used as a quantum laboratory. This is the first time it has been possible to experimentally measure instanton processes in a freely chosen quantum field theory. This novel and flexible method to study the dynamics of quantum systems can be applied to any field theory of interest. Experimental measurements of the dynamical behaviour of field theories are independent of theoretical calculations and can be used to infer their properties without being limited by the availability of suitable perturbative or nonperturbative computational methods. In the near future, measurements in such a quantum laboratory could therefore be used to improve theoretical and computational methods conceptually and may enable the measurement and detailed study of previously unobserved quantum phenomena.


title: Variational Quantum Boltzmann Machines

abstract: This work presents a novel realization approach to Quantum Boltzmann Machines (QBMs). The preparation of the required Gibbs states, as well as the evaluation of the loss function's analytic gradient is based on Variational Quantum Imaginary Time Evolution, a technique that is typically used for ground state computation. In contrast to existing methods, this implementation facilitates near-term compatible QBM training with gradients of the actual loss function for arbitrary parameterized Hamiltonians which do not necessarily have to be fully-visible but may also include hidden units. The variational Gibbs state approximation is demonstrated with numerical simulations and experiments run on real quantum hardware provided by IBM Quantum. Furthermore, we illustrate the application of this variational QBM approach to generative and discriminative learning tasks using numerical simulation.


title: Binary Classification with Classical Instances and Quantum Labels

abstract: In classical statistical learning theory, one of the most well studied problems is that of binary classification. The information-theoretic sample complexity of this task is tightly characterized by the Vapnik-Chervonenkis (VC) dimension. A quantum analog of this task, with training data given as a quantum state has also been intensely studied and is now known to have the same sample complexity as its classical counterpart. We propose a novel quantum version of the classical binary classification task by considering maps with classical input and quantum output and corresponding classical-quantum training data. We discuss learning strategies for the agnostic and for the realizable case and study their performance to obtain sample complexity upper bounds. Moreover, we provide sample complexity lower bounds which show that our upper bounds are essentially tight for pure output states. In particular, we see that the sample complexity is the same as in the classical binary classification task w.r.t. its dependence on accuracy, confidence and the VC-dimension.


title: Polar quasinormal modes of the scalarized Einstein-Gauss-Bonnet black holes

abstract: We study the polar quasinormal modes of spontaneously scalarized black holes in Einstein-Gauss-Bonnet theory. In previous works we showed that a set of nodeless solutions of the fundamental branch of the model studied in [1] are stable under both radial [2] and axial perturbations [3]. Here we calculate the polar quasinormal modes and show that this set of solutions is stable against the polar perturbations as well. Thus for a certain region of the parameter space the scalarized black holes are potentially stable physically interesting objects. The spectrum of the polar quasinormal modes differs both quantitatively and qualitatively from the Schwarzschild one which offers the possibility to test the Gauss-Bonnet theory via the future gravitational wave observations.


title: HiggsBounds-5: Testing Higgs Sectors in the LHC 13 TeV Era

abstract: We describe recent developments of the public computer code HiggsBounds. In particular, these include the incorporation of LHC Higgs search results from Run 2 at a center-of-mass energy of 13 TeV, and an updated and extended framework for the theoretical input that accounts for improved Higgs cross section and branching ratio predictions and new search channels. We furthermore discuss an improved method used in HiggsBounds to approximately reconstruct the exclusion likelihood for LHC searches for non-standard Higgs bosons decaying to $\tau\tau$ final states. We describe in detail the new and updated functionalities of the new version HiggsBounds-5.


title: VINTERGATAN I: The origins of chemically, kinematically and structurally distinct discs in a simulated Milky Way-mass galaxy

abstract: Spectroscopic surveys of the Milky Way's stars have revealed spatial, chemical and kinematical structures that encode its history. In this work, we study their origins using a cosmological zoom simulation, VINTERGATAN, of a Milky Way-mass disc galaxy. We find that in connection to the last major merger at $z\sim 1.5$, cosmological accretion leads to the rapid formation of an outer, metal-poor, low-[$\alpha$/Fe] gas disc around the inner, metal-rich galaxy containing the old high-[$\alpha$/Fe] stars. This event leads to a bimodality in [$\alpha$/Fe] over a range of [Fe/H]. A detailed analysis of how the galaxy evolves since $z\sim 1$ is presented. We demonstrate the way in which inside-out growth shapes the radial surface density and metallicity profile and how radial migration preferentially relocates stars from the inner to the outer disc. Secular disc heating is found to give rise to increasing velocity dispersions and scaleheights with stellar age, which together with disc flaring explains several trends observed in the Milky Way, including shallower radial [Fe/H]-profiles above the midplane. We show how the galaxy formation scenario imprints non-trivial mappings between structural associations (i.e. thick and thin discs), velocity dispersions, $\alpha$-enhancements, and ages of stars, e.g. the most metal-poor stars in the low-[$\alpha$/Fe] sequence are found to have a scaleheight comparable to old high-[$\alpha$/Fe] stars. Finally, we illustrate how at low spatial resolution, comparable to the thickness of the galaxy, the proposed pathway to distinct sequences in [$\alpha$/Fe]-[Fe/H] cannot be captured.


title: Simple theory for scotogenic dark matter with residual matter-parity

abstract: Dark matter stability can result from a residual matter-parity symmetry surviving spontaneous breaking of an extended gauge symmetry. We propose the simplest scotogenic dark matter completion of the original SVS theory (Phys.Rev. D22 (1980) 738), in which the "dark sector" particles as well as matter-parity find a natural theoretical origin in the model. We briefly comment on its main features.


title: Higher-order interactions in statistical physics and machine learning: A model-independent solution to the inverse problem at equilibrium

abstract: The problem of inferring pair-wise and higher-order interactions in complex systems involving large numbers of interacting variables, from observational data, is fundamental to many fields. Known to the statistical physics community as the inverse problem, it has become accessible in recent years due to real and simulated 'big' data being generated. Current approaches to the inverse problem rely on parametric assumptions, physical approximations, e.g. mean-field theory, and ignoring higher-order interactions which may lead to biased or incorrect estimates. We bypass these shortcomings using a cross-disciplinary approach and demonstrate that none of these assumptions and approximations are necessary: We introduce a universal, model-independent, and fundamentally unbiased estimator of all-order symmetric interactions, via the non-parametric framework of Targeted Learning, a subfield of mathematical statistics. Due to its universality, our definition is readily applicable to any system at equilibrium with binary and categorical variables, be it magnetic spins, nodes in a neural network, or protein networks in biology. Our approach is targeted, not requiring fitting unnecessary parameters. Instead, it expends all data on estimating interactions, hence substantially increasing accuracy. We demonstrate the generality of our technique both analytically and numerically on (i) the 2-dimensional Ising model, (ii) an Ising-like model with 4-point interactions, (iii) the Restricted Boltzmann Machine, and (iv) simulated individual-level human DNA variants and representative traits. The latter demonstrates the applicability of this approach to discover epistatic interactions causal of disease in population biomedicine.

categories: stat.ME cond-mat.stat-mech hep-lat physics.comp-ph stat.ML


title: VINTERGATAN II: the history of the Milky Way told by its mergers

abstract: Using the VINTERGATAN cosmological zoom simulation, we explore the contributions of the in situ and accreted material, and the effect of galaxy interactions and mergers in the assembly of a Milky Way-like galaxy. We find that the initial growth phase of galaxy evolution, dominated by repeated major mergers, provides the necessary physical conditions for the assembly of a thick, kinematically hot disk populated by high-[$\alpha$/Fe] stars, formed both in situ and in accreted satellite galaxies. We find that the diversity of evolutionary tracks followed by the simulated galaxy and its progenitors leads to very little overlap of the in situ and accreted populations for any given chemical composition. At a given age, the spread in [$\alpha$/Fe] abundance ratio results from the diversity of physical conditions in VINTERGATAN and its satellites, with an enhancement in [$\alpha$/Fe] found in stars formed during starburst episodes. Later, the cessation of the merger activity promotes the in situ formation of stars in the low-[$\alpha$/Fe] regime, in a radially extended, thin and overall kinematically colder disk, thus establishing chemically bimodal thin and thick disks, in line with observations. We draw links between notable features in the [Fe/H] - [$\alpha$/Fe] plane with their physical causes, and propose a comprehensive formation scenario explaining self-consistently, in the cosmological context, the main observed properties of the Milky Way.


title: VINTERGATAN III: how to reset the metallicity of the Milky Way

abstract: Using the cosmological zoom simulation VINTERGATAN, we present a new scenario for the onset of star formation at the metal-poor end of the low-[$\alpha$/Fe] sequence in a Milky Way-like galaxy. In this scenario, the galaxy is fueled by two distinct gas flows. One is enriched by outflows from massive galaxies, but not the other. While the former feeds the inner galactic region, the latter fuels an outer gas disk, inclined with respect to the main galactic plane, and with a significantly poorer chemical content. The first passage of the last major merger galaxy triggers tidal compression in the outer disk, which increases the gas density and eventually leads to star formation, at a metallicity 0.75 dex lower than the inner galaxy. This forms the first stars of the low-[$\alpha$/Fe] sequence. These in situ stars have halo-like kinematics, similarly to what is observed in the Milky Way, due to the inclination of the outer disk which eventually aligns with the inner one via gravitational torques. We show that this tilting disk scenario is likely to be common in Milky-Way like galaxies. This process implies that the low-[$\alpha$/Fe] sequence is populated in situ, simultaneously from two formation channels, in the inner and the outer galaxy, with distinct metallicities. This contrasts with purely sequential scenarios for the assembly of the Milky Way disk and could be tested observationally.


title: High-precision abundances of elements in solar-type stars. Evidence of two distinct sequences in abundance-age relations

abstract: HARPS spectra with signal-to-noise ratios S/N > 600 at 6000 A were analysed with MARCS model atmospheres to obtain 1D LTE abundances of C, O, Na, Mg, Al, Si, Ca, Ti, Cr, Fe, Ni, Sr, and Y for 72 nearby solar-type stars with metallicities in the range -0.3 < [Fe/H] < +0.3 and ASTEC stellar models were used to determine stellar ages from effective temperatures, luminosities obtained via Gaia DR2 parallaxes, and heavy element abundances. The resulting age-metallicity distribution appears to consist of two distinct populations: a sequence of old stars with a steep rise of [Fe/H] to about +0.3 dex at an age of ~7 Gyr and a younger sequence with [Fe/H] increasing from -0.3 dex to about +0.2 dex over the last six Gyr. Furthermore, the trends of several abundance ratios, [O/Fe], [Na/Fe], [Ca/Fe], and [Ni/Fe], as a function of stellar age split into two corresponding sequences. The [Y/Mg]-age relation, on the other hand, shows no offset between the two age sequences and has no significant dependence on [Fe/H], but the components of a visual binary star, zeta Reticuli, have a large and puzzling deviation. The split of the age-metallicity distribution into two sequences may be interpreted as evidence of two episodes of accretion of gas onto the Galactic disk with a quenching of star formation in between. Some of the [X/Fe]-age relations support this scenario but other relations are not so easy to explain, which calls for a deeper study of systematic errors in the derived abundances as a function of [Fe/H], in particular 3D non-LTE effects.


title: Pure spinors and $D=11$ supergravity

abstract: In this Thesis we study first- and second-quantized approaches describing $D=11$ supergravity using pure spinor variables. We introduce the so-called $D=11$ pure spinor superparticle through BRST cohomology arguments starting from the semi-light-cone gauge $D=11$ Brink-Schwarz-like superparticle. After performing a light-cone gauge analysis of the pure spinor BRST cohomology at ghost number three, we find the linearized equations of motion of $D=11$ supergravity in $D=9$ superspace. In addition, we construct a BRST-closed, ghost number one vertex operator made out of worldline fields and $D=11$ supergravity superfields, and we run into an inconsistency when constructing a ghost number zero vertex operator satisfying a standard descent equation. We then introduce the non-minimal version of the $D=11$ pure spinor superparticle, in which a composite $b$-ghost can be constructed satisfying $\{Q,b\} = P^{2}$. However, its complicated expression makes it difficult to check its nilpotency. We show that introducing an $SO(1,10)$ fermionic vector $\bar{\Sigma}^{a}$ simplifies the form of the $b$-ghost considerably, which allows us to verify that $\{Q,b\} = P^{2}$ and $\{b,b\}=$ BRST-exact. Using this $b$-ghost we propose an alternative ghost number zero vertex operator satisfying a standard descent equation. However, its expression will depend on non-minimal pure spinor variables in a very complicated fashion. After discussing this first-quantized approach for $D=11$ supergravity, we move on to discussing the pure spinor master actions introduced by Cederwall for studying maximally supersymmetric gauge theories. We show that these actions indeed describe $D=10$ super-Yang-Mills, $D=10$ super-Born-Infeld and $D=11$ supergravity by extracting the equations of motion in ordinary superspace for each one of these theories.


title: Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertainty

abstract: In image segmentation, there is often more than one plausible solution for a given input. In medical imaging, for example, experts will often disagree about the exact location of object boundaries. Estimating this inherent uncertainty and predicting multiple plausible hypotheses is of great interest in many applications, yet this ability is lacking in most current deep learning methods. In this paper, we introduce stochastic segmentation networks (SSNs), an efficient probabilistic method for modelling aleatoric uncertainty with any image segmentation network architecture. In contrast to approaches that produce pixel-wise estimates, SSNs model joint distributions over entire label maps and thus can generate multiple spatially coherent hypotheses for a single image. By using a low-rank multivariate normal distribution over the logit space to model the probability of the label map given the image, we obtain a spatially consistent probability distribution that can be efficiently computed by a neural network without any changes to the underlying architecture. We tested our method on the segmentation of real-world medical data, including lung nodules in 2D CT and brain tumours in 3D multimodal MRI scans. SSNs outperform state-of-the-art for modelling correlated uncertainty in ambiguous images while being much simpler, more flexible, and more efficient.


title: On the composition of two spherical twists

abstract: E. Segal proved that any autoequivalence of an enhanced triangulated category can be realised as a spherical twist. However, when exhibiting an autoequivalence as a spherical twist one has various choices for the source category of the spherical functor. We describe a construction that realises the composition of two spherical twists as the twist around a single spherical functor whose source category semiorthogonally decomposes into the source categories for the spherical functors we started with. We give a description of the cotwist for this spherical functor and prove, in the special case when our starting twists are around spherical objects, that the cotwist is the Serre functor (up to a shift). We finish with an explicit treatment for the case of P-objects.


title: Revisiting visual-inertial structure from motion for odometry and SLAM initialization

abstract: In this paper, an efficient closed-form solution for the state initialization in visual-inertial odometry (VIO) and simultaneous localization and mapping (SLAM) is presented. Unlike the state-of-the-art, we do not derive linear equations from triangulating pairs of point observations. Instead, we build on a direct triangulation of the unknown $3D$ point paired with each of its observations. We show and validate the high impact of such a simple difference. The resulting linear system has a simpler structure and the solution through analytic elimination only requires solving a $6\times 6$ linear system (or $9 \times 9$ when accelerometer bias is included). In addition, all the observations of every scene point are jointly related, thereby leading to a less biased and more robust solution. The proposed formulation attains up to $50$ percent decreased velocity and point reconstruction error compared to the standard closed-form solver, while it is $4\times$ faster for a $7$-frame set. Apart from the inherent efficiency, fewer iterations are needed by any further non-linear refinement thanks to better parameter initialization. In this context, we provide the analytic Jacobians for a non-linear optimizer that optionally refines the initial parameters. The superior performance of the proposed solver is established by quantitative comparisons with the state-of-the-art solver.


title: Noise on the Non-Abelian $\nu=5/2$ Fractional Quantum Hall Edge

abstract: The recent measurement of a half-integer thermal conductance for the $\nu=5/2$ fractional quantum Hall state has confirmed its non-Abelian nature, making the question of the underlying topological order highly intriguing. We analyze the shot noise at the edge of the three most prominent non-Abelian candidate states. We show that the noise scaling with respect to the edge length can, in combination with the thermal conductance, be used to experimentally distinguish between the Pfaffian, anti-Pfaffian, and particle-hole-Pfaffian edge structures.


title: Traversable wormhole and Hawking-Page transition in coupled complex SYK models

abstract: Recent work has shown that coupling two identical Sachdev-Ye-Kitaev (SYK) models can realize a phase of matter that is holographically dual to an eternal traversable wormhole. This phase supports revival oscillations between two quantum chaotic systems that can be interpreted as information traversing the wormhole. Here we generalize these ideas to a pair of coupled SYK models with complex fermions that respect a global U(1) charge symmetry. Such models show richer behavior than conventional SYK models with Majorana fermions and may be easier to realize experimentally. We consider two different couplings, namely tunneling and charge-conserving two-body interactions, and obtain the corresponding phase diagram using a combination of numerical and analytical techniques. At low temperature we find a charge-neutral gapped phase that supports revival oscillations, with a ground state close to the thermofield double, which we argue is dual to a traversable wormhole. We also find two different gapless non-Fermi liquid phases with tunable charge density which we interpret as dual to a `large' and `small' charged black hole. The gapped and gapless phases are separated by a first-order phase transition of the Hawking-Page type. Finally, we discuss an SU(2)-symmetric limit of our model that is closely related to proposed realizations of SYK physics with spinful fermions in graphene, and explain its relevance for future experiments on this system.


title: Convergence of Pseudo-Bayes Factors in Forward and Inverse Regression Problems

abstract: In the Bayesian literature on model comparison, Bayes factors play the leading role. In the classical statistical literature, model selection criteria are often devised used cross-validation ideas. Amalgamating the ideas of Bayes factor and cross-validation Geisser and Eddy (1979) created the pseudo-Bayes factor. The usage of cross-validation inculcates several theoretical advantages, computational simplicity and numerical stability in Bayes factors as the marginal density of the entire dataset is replaced with products of cross-validation densities of individual data points. However, the popularity of pseudo-Bayes factors is still negligible in comparison with Bayes factors, with respect to both theoretical investigations and practical applications. In this article, we establish almost sure exponential convergence of pseudo-Bayes factors for large samples under a general setup consisting of dependent data and model misspecifications. We particularly focus on general parametric and nonparametric regression setups in both forward and inverse contexts. We illustrate our theoretical results with various examples, providing explicit calculations. We also supplement our asymptotic theory with simulation experiments in small sample situations of Poisson log regression and geometric logit and probit regression, additionally addressing the variable selection problem. We consider both linear and nonparametric regression modeled by Gaussian processes for our purposes. Our simulation results provide quite interesting insights into the usage of pseudo-Bayes factors in forward and inverse setups.


title: Modeling and Simulation of COVID-19 Pandemic for Cincinnati Tri-State Area

abstract: In this paper, we use SIR model to simulate the COVID-19 pandemic for Cincinnati Tri-State Area. We have built a representative population of Cincinnati that includes movements for traveling to stores, schools, workplaces, and traveling to friends houses. Using this model, we simulate the effect of quarantine, return to work, and panic buying. We show that that there will be a second wave of infections when people return to work and significant increase in number of infections when there is panic buying at stores with the announcement of the quarantine measures.


title: Notes on the 11D pure spinor wordline vertex operators

abstract: The construction of the ghost number zero and one vertex operators for the 11D pure spinor superparticle will be revisited. In this sense, an alternative way of defining the ghost number one vertex operator will be given after introducing a ghost number -2 operator made out of physical operators defined on the 11D non-minimal pure spinor superspace. This procedure will make explicit and transparent the relation between the ghost number three and one vertex operators. In addition, using a non-Lorentz covariant b-ghost, ghost number zero and two vertex operators satisfying standard descent equations will be presented in full form.


title: A Pure Spinor Twistor Description of the $D=10$ Superparticle

abstract: We present a novel twistor formulation of the ten-dimensional massless superparticle. This formulation is based on the introduction of pure spinor variables through a field redefinition of another model for the superparticle, and in the new description we find that the super-Pauli-Lubanski three-form naturally arises as a constraint. Quantization is studied in detail for both models and they are shown to correctly describe the $D = 10$ super-Yang-Mills states.


title: The Numerical Unified Transform Method for Initial-boundary Value Problems on the Half-line

abstract: We implement the Unified Transform Method of Fokas as a numerical method to solve linear partial differential equations on the half-line. The method computes the solution at any x and t without spatial discretization or time stepping. With the help of contour deformations and oscillatory integration techniques, the method's complexity does not increase for large x,t and the method is more accurate as x,t increase. Our goal is to make no assumptions on the functional form of the initial or boundary functions while maintaining high accuracy in a large region of the (x,t) plane.


title: A Pure Spinor Twistor Description of Ambitwistor Strings

abstract: We present a novel ten-dimensional description of ambitwistor strings. This formulation is based on a set of supertwistor variables involving pure spinors and a set of constraints previously introduced in the context of the $D=10$ superparticle following a ten-dimensional twistor-like construction introduced by Berkovits. We perform a detailed quantum-mechanical analysis of the constraint algebra, we show that the corresponding central charges vanish, and after considering a convenient gauge fixing procedure, physical states are found. Vertex operators are explicitly constructed and, by noticing a relation with the standard pure spinor formalism, scattering amplitudes are shown to correctly describe $D=10$ super-Yang-Mills interactions. As in other ambitwistor string models, amplitudes are found to be localized on the support of the scattering equations, and thus this work provides a bridge between Berkovits' construction and the Cachazo-He-Yuan formulae. After extending the pure spinor twistor transform to include an additional supersymmetry, our results are immediately generalized to Type IIB supergravity.


title: Report from the NSF Future Directions Workshop, Toward User-Oriented Agents: Research Directions and Challenges

abstract: This USER Workshop was convened with the goal of defining future research directions for the burgeoning intelligent agent research community and to communicate them to the National Science Foundation. It took place in Pittsburgh Pennsylvania on October 24 and 25, 2019 and was sponsored by National Science Foundation Grant Number IIS-1934222. Any opinions, findings and conclusions or future directions expressed in this document are those of the authors and do not necessarily reflect the views of the National Science Foundation. The 27 participants presented their individual research interests and their personal research goals. In the breakout sessions that followed, the participants defined the main research areas within the domain of intelligent agents and they discussed the major future directions that the research in each area of this domain should take


title: On the ring nebulae around runaway Wolf-Rayet stars

abstract: Wolf-Rayet stars are advanced evolutionary stages of massive stars. Despite their large mass-loss rates and high wind velocities, none of them display a bow shock, although a fraction of them are classified as runaway. Our 2.5-D numerical simulations of circumstellar matter around a 60Mo runaway star show that the fast Wolf-Rayet stellar wind is released into a wind-blown cavity filled with various shocks and discontinuities generated throughout the precedent evolutionary phases. The resulting fast-wind slow-wind interaction leads to the formation of spherical shells of swept-up dusty material similar to those observed in near infrared 24 micron with Spitzer, and which appear to be co-moving with the runaway massive stars, regardless of their proper motion and/or the properties of the local ambient medium. We interpret bright infrared rings around runaway Wolf-Rayet stars in the Galactic plane, like WR138a, as indication of their very high initial masses and a complex evolutionary history. Stellar-wind bow shocks become faint as stars run in diluted media, therefore, our results explain the absence of detected bow shocks around Galactic Wolf-Rayet stars such as the high-latitude, very fast-moving objects WR71, WR124 and WR148. Our results show that the absence of a bow shock is consistent with a runaway nature of some Wolf-Rayet stars. This questions the in-situ star formation scenario of high-latitude Wolf-Rayet stars in favor of dynamical ejection from birth sites in the Galactic plane.


title: Towards Robust Fine-grained Recognition by Maximal Separation of Discriminative Features

abstract: Adversarial attacks have been widely studied for general classification tasks, but remain unexplored in the context of fine-grained recognition, where the inter-class similarities facilitate the attacker's task. In this paper, we identify the proximity of the latent representations of different classes in fine-grained recognition networks as a key factor to the success of adversarial attacks. We therefore introduce an attention-based regularization mechanism that maximally separates the discriminative latent features of different classes while minimizing the contribution of the non-discriminative regions to the final class prediction. As evidenced by our experiments, this allows us to significantly improve robustness to adversarial attacks, to the point of matching or even surpassing that of adversarial training, but without requiring access to adversarial samples.


title: An analytic treatment of Quartic Hilltop Inflation

abstract: Quartic hilltop inflation remains one of the most successful inflationary models. Yet, the expectations of early treatments of hilltop inflation would contradict the observations and render the model excluded. However, recent numerical treatment has demonstrated that quartic hilltop inflation actually fares well with observations. In this work, a fully analytic treatment of the model aims to dispel the mystery surrounding the behaviour of quartic hilltop inflation. The results obtained are in excellent agreement with numerical works on the subject, yet offer simple analytic formulas to calculate observables and easily test thereby quartic hilltop inflation, hopefully revealing information on the theoretical background.


title: Persistence-Speed Coupling Enhances the Search Efficiency of Migrating Immune Cells

abstract: Migration of immune cells within the human body allows them to fulfill their main function of detecting pathogens. Adopting an optimal navigation and search strategy by these cells is of crucial importance to achieve an efficient immune response. Analyzing the dynamics of dendritic cells in our in vitro experiments reveals that the directional persistence of these cells is highly correlated with their migration speed, and that the persistence-speed coupling enables the migrating cells to reduce their search time. We introduce theoretically a new class of random search optimization problems by minimizing the mean first-passage time (MFPT) with respect to the strength of the coupling between influential parameters such as speed and persistence length. We derive an analytical expression for the MFPT in a confined geometry and verify that the correlated motion improves the search efficiency if the mean persistence length is sufficiently shorter than the confinement size. In contrast, a positive persistence-speed correlation even increases the MFPT at long persistence length regime, thus, such a strategy is disadvantageous for highly persistent active agents.


title: On the Theory and Practice of Thin Walled Structures

abstract: We consider the problem of satisfaction of boundary conditions when the generalized stress vector is given on the surfaces for elastic plates and shells. This problem was open also both for refined theories in the wide sense and hierarchical type models. This one for hierarchical models was formulated by Vekua. In nonlinear cases the bending and compression-extension processes did not split and for this aim we cited von Karman type system without variety of ad hoc assumptions since, in the classical form of this system of DEs one of them represents the condition of compatibility but it is not an equilibrium equation. Thus, we created the mathematical theory of refined theories both in linear and nonlinear cases for anisotropic nonhomogeneous elastic plates and shells, approximately satisfying the corresponding system of partial differential equations and boundary conditions on the surfaces. The optimal and convenient refined theory might be chosen easily by selection of arbitrary parameters; preliminarily a few necessary experimental measurements have been made without using any simplifying hypotheses. The same problem is solved for hierarchical models too.


title: Testing MOdified Gravity (MOG) theory and dark matter model in Milky Way using the local observables

abstract: In this paper, we have investigated one of the alternative theories to dark matter named MOdified Gravity (MOG) by testing its ability to describe the local dynamics of the Milky Way in vertical and transverse directions with the baryonic matter. MOG is designed to interpret the dynamics of galaxies and cluster of galaxies without the need for dark matter. We use local observational data such as the vertical dispersion, rotation curve, surface density and number density of stars in the Milky Way to obtained the parameters of MOG and the baryonic component of MW by implementing a Bayesian approach to the parameter estimation based on a Markov Chain Monte Carlo method. We compare our results with the dark matter model of MW. The two models of MOG and CDM are able to describe equally well the rotation curve and the vertical dynamics of stars in the local MW. The best values for the free parameters of MOG in this analysis is obtained as $\alpha = 8.99 \pm 0.02 $ and $\mu =0.054\pm 0.005$ kpc$^{-1}$. Also, we obtain the parameters of the generalized gNFW model in the dark matter model. Our best value of bulge mass from MOG is $(1.06 \pm 0.26)\times10^{10}\rm M_{\odot}$ which is consistent with the estimations form the microlensing observations.


title: Learning normalizing flows from Entropy-Kantorovich potentials

abstract: We approach the problem of learning continuous normalizing flows from a dual perspective motivated by entropy-regularized optimal transport, in which continuous normalizing flows are cast as gradients of scalar potential functions. This formulation allows us to train a dual objective comprised only of the scalar potential functions, and removes the burden of explicitly computing normalizing flows during training. After training, the normalizing flow is easily recovered from the potential functions.


title: VLSI Implementation of TDC Architectures Used in PET Imaging Systems

abstract: Positron emission tomography (PET) is a medical imaging method based on the measurement of concentrations of positron-emitting radionuclides in a living body. In the PET imaging system, glucose is labeled with a positron-emitting radionuclide and injected intravenously. Then, the positrons move through the tissue and collide with the electrons of the cells in which they interact. As a result of this interaction, two gamma rays are emitted in the opposite direction. Gama rays emitted from cancerous tissue that has retained radioactive glucose are detected through ring-shaped detectors. And the detected signals are converted into an electrical response. Subsequently, these responses are sampled with electronic circuits and recorded as histogram matrix to generate the image set. The gamma rays may not reach the detectors located in the opposite position in equal time. In PETs having TOF characteristics, it is aimed to obtain better positioning information by a method based on the principle of measuring the difference between the reach time of the two photons to detectors. The measurement of the flight time is carried out with TDC structures. The measurement of this time difference at the ps level is directly related to the spatial resolution of the PET system. In this study, 45 nm CMOS VLSI simulations of TDC structures that have various architectural approaches were performed for use in PET systems. With the designed TDC architectures, two gamma photons time reach to detectors have been simulated and the time difference has been successfully digitized. In addition, various performance metrics such as input and output voltages, time resolutions, measurement ranges, and power analysis of TDC architectures have been determined. Proposed Vernier oscillator-based TDC architecture has been reached 25 ps time resolution with a low power consumption of 1.62681 mW at 1V supply voltage.


title: Optimal Group Size in Microlending

abstract: Microlending, where a bank lends to a small group of people without credit histories, began with the Grameen Bank in Bangladesh, and is widely seen as the creation of Muhammad Yunus, who received the Nobel Peace Prize in recognition of his largely successful efforts. Since that time the modeling of microlending has received a fair amount of academic attention. One of the issues not yet addressed in full detail, however, is the issue of the size of the group. Some attention has nevertheless been paid using an experimental and game theory approach. We, instead, take a mathematical approach to the issue of an optimal group size, where the goal is to minimize the probability of default of the group. To do this, one has to create a model with interacting forces, and to make precise the hypotheses of the model. We show that the original choice of Muhammad Yunus, of a group size of five people, is, under the right, and, we believe, reasonable hypotheses, either close to optimal, or even at times exactly optimal, i.e., the optimal group size is indeed five people.


title: Leveraging Bitcoin Testnet for Bidirectional Botnet Command and Control Systems

abstract: Over the past twenty years, the number of devices connected to the Internet grew exponentially. Botnets benefited from this rise to increase their size and the magnitude of their attacks. However, they still have a weak point in their Command & Control (C&C) system, which is often based on centralized services or require a complex infrastructure to keep operating without being taken down by authorities. The recent spread of blockchain technologies may give botnets a powerful tool to make them very hard to disrupt. Recent research showed how it is possible to embed C&C messages in Bitcoin transactions, making them nearly impossible to block. Nevertheless, transactions have a cost and allow very limited amounts of data to be transmitted. Because of that, only messages from the botmaster to the bots are sent via Bitcoin, while bots are assumed to communicate through external channels. Furthermore, for the same reason, Bitcoin-based messages are sent in clear. In this paper we show how, using Bitcoin Testnet, it is possible to overcome these limitations and implement a cost-free, bidirectional, and encrypted C&C channel between the botmaster and the bots. We propose a communication protocol and analyze its viability in real life. Our results show that this approach would enable a botmaster to build a robust and hard-to-disrupt C&C system at virtually no cost, thus representing a realistic threat for which countermeasures should be devised.


title: On the Maximum Mutual Information Capacity of Neural Architectures

abstract: We derive the closed-form expression of the maximum mutual information - the maximum value of $I(X;Z)$ obtainable via training - for a broad family of neural network architectures. The quantity is essential to several branches of machine learning theory and practice. Quantitatively, we show that the maximum mutual information for these families all stem from generalizations of a single catch-all formula. Qualitatively, we show that the maximum mutual information of an architecture is most strongly influenced by the width of the smallest layer of the network - the "information bottleneck" in a different sense of the phrase, and by any statistical invariances captured by the architecture.


title: Map3D: Registration Based Multi-Object Tracking on 3D Serial Whole Slide Images

abstract: There has been a long pursuit for precise and reproducible glomerular quantification on renal pathology to leverage both research and practice. When digitizing the biopsy tissue samples using whole slide imaging (WSI), a set of serial sections from the same tissue can be acquired as a stack of images, similar to frames in a video. In radiology, the stack of images (e.g., computed tomography) are naturally used to provide 3D context for organs, tissues, and tumors. In pathology, it is appealing to do a similar 3D assessment. However, the 3D identification and association of large-scale glomeruli on renal pathology is challenging due to large tissue deformation, missing tissues, and artifacts from WSI. In this paper, we propose a novel Multi-object Association for Pathology in 3D (Map3D) method for automatically identifying and associating large-scale cross-sections of 3D objects from routine serial sectioning and WSI. The innovations of the Map3D method are three-fold: (1) the large-scale glomerular association is formed as a new multi-object tracking (MOT) perspective; (2) the quality-aware whole series registration is proposed to not only provide affinity estimation but also offer automatic kidney-wise quality assurance (QA) for registration; (3) a dual-path association method is proposed to tackle the large deformation, missing tissues, and artifacts during tracking. To the best of our knowledge, the Map3D method is the first approach that enables automatic and large-scale glomerular association across 3D serial sectioning using WSI. Our proposed method Map3D achieved MOTA= 44.6, which is 12.1% higher than the non deep learning benchmarks.


title: Activity-based contact network scaling and epidemic propagation in metropolitan areas

abstract: Given the growth of urbanization and emerging pandemic threats, more sophisticated models are required to understand disease propagation and investigate the impacts of intervention strategies across various city types. We introduce a fully mechanistic, activity-based and highly spatio-temporally resolved epidemiological model which leverages on person-trajectories obtained from integrated mobility demand and supply models in full-scale cities. Simulating COVID-19 evolution in two full-scale cities with representative synthetic populations and mobility patterns, we analyze activity-based contact networks. We observe that transit contacts are scale-free in both cities, work contacts are Weibull distributed, and shopping or leisure contacts are exponentially distributed. We also investigate the impact of the transit network, finding that its removal dampens disease propagation, while work is also critical to post-peak disease spreading. Our framework, validated against existing case and mortality data, demonstrates the potential for tracking and tracing, along with detailed socio-demographic and mobility analyses of epidemic control strategies.


title: Efficient Contextual Bandits with Continuous Actions

abstract: We create a computationally tractable algorithm for contextual bandits with continuous actions having unknown structure. Our reduction-style algorithm composes with most supervised learning representations. We prove that it works in a general sense and verify the new functionality with large-scale experiments.


title: Principled Analyses and Design of First-Order Methods with Inexact Proximal Operators

abstract: Proximal operations are among the most common primitives appearing in both practical and theoretical (or high-level) optimization methods. This basic operation typically consists in solving an intermediary (hopefully simpler) optimization problem. In this work, we survey notions of inaccuracies that can be used when solving those intermediary optimization problems. Then, we show that worst-case guarantees for algorithms relying on such inexact proximal operations can be systematically obtained through a generic procedure based on semidefinite programming. This methodology is primarily based on the approach introduced by Drori and Teboulle (2014) and on convex interpolation results, and allows producing non-improvable worst-case analyzes. In other words, for a given algorithm, the methodology generates both worst-case certificates (i.e., proofs) and problem instances on which those bounds are achieved. Relying on this methodology, we study numerical worst-case performances of a few basic methods relying on inexact proximal operations including accelerated variants, and design a variant with optimized worst-case behaviour. We further illustrate how to extend the approach to support strongly convex objectives by studying a simple relatively inexact proximal minimization method.


title: Numerical evidence of Dynamical spectral rigidity of ellipses among smooth $\mathbb{Z}_2$-symmetric domains

abstract: We present numerical evidence for spectral rigidity among $\mathbb{Z}_{2}$-symmetric domains of ellipses of eccentricity smaller than $0.30$.


title: A locally F-finite Noetherian domain that is not F-finite

abstract: Using an old example of Nagata, we construct a Noetherian ring of prime characteristic p, whose Frobenius morphism is locally finite, but not finite.


title: ALMA full polarization observations of PKS1830-211 during its record-breaking flare of 2019

abstract: We report Atacama-Large-millimeter-Array (ALMA) Band 6 full-polarization observations of the lensed blazar PKS1830-211 during its record-breaking radio and gamma-ray flare in the spring of 2019. The observations were taken close to the peak of the gamma activity and show a clear difference in polarization state between the two time-delayed images. The leading image has a fractional polarization about three times lower than the trailing image, implying that significant depolarization occurred during the flare. In addition, we observe clear intra-hour variability of the polarization properties between the two lensed images, with a quasi-linear increase of the differential electric-vector position angle at a rate of about two degrees per hour, associated with changes of the relative fractional polarization of ~10%. This variability, combined with the lower polarization close to the peak of gamma activity, is in agreement with models of magnetic turbulence to explain polarization variability in blazar jets. Finally, the comparison of results from the full and differential polarization analysis confirms that the differential polarization technique (Marti-Vidal et al. 2016) can provide useful information on the polarization state of sources like gravitationally lensed radio-loud quasars.


title: Evaluating the Exploitability of Implicit Interactions in Distributed Systems

abstract: Implicit interactions refer to those interactions among the components of a system that may be unintended and/or unforeseen by the system designers. As such, they represent cybersecurity vulnerabilities that can be exploited to mount cyber-attacks causing serious and destabilizing system effects. In this paper, we study implicit interactions in distributed systems specified using the algebraic modeling framework known as Communicating Concurrent Kleene Algebra (C$^2$KA). To identify and defend against a range of possible attack scenarios, we develop a new measure of exploitability for implicit interactions to aid in evaluating the threat posed by the existence of such vulnerabilities in system designs for launching cyber-attacks. The presented approach is based on the modeling and analysis of the influence and response of the system agents and their C$^2$KA specifications. We also demonstrate the applicability of the proposed approach using a prototype tool that supports the automated analysis. The rigorous, practical techniques presented here enable cybersecurity vulnerabilities in the designs of distributed systems to be more easily identified, assessed, and then mitigated, offering significant improvements to overall system resilience, dependability, and security.


title: Controlling spin without magnetic fields -- the Bloch-Rashba rotator

abstract: We consider the dynamics of a quantum particle held in a lattice potential, and subjected to a time-dependent spin-orbit coupling. Tilting the lattice causes the particle to perform Bloch oscillations, and by suitably changing the Rashba interaction during its motion, the spin of the particle can be gradually rotated. Even if the Rashba coupling can only be altered by a small amount, large spin-rotations can be obtained by accumulating the rotation from successive oscillations. We show how the time-dependence of the spin-orbit coupling can be chosen to maximize the rotation per cycle, and thus how this method can be used to produce a precise and controllable spin-rotator, the Bloch-Rashba rotator, without requiring an applied magnetic field.


title: Collective Effects and Pattern Formation for Directional Locking of Disks Moving Through Obstacle Arrays

abstract: We examine directional locking effects in an assembly of disks driven through a square array of obstacles as the angle of drive rotates from zero to ninety degrees. For increasing disk densities, the system exhibits a series of different dynamic patterns along certain locking directions, including one-dimensional or multiple row chain phases and density modulated phases. For non-locking driving directions, the disks form disordered patterns or clusters. When the obstacles are small or far apart, a large number of locking phases appear; however, as the number of disks increases, the number of possible locking phases drops due to the increasing frequency of collisions between the disks and obstacles. For dense arrays or large obstacles, we find an increased clogging effect in which immobile and moving disks coexist.


title: Efficient Partial Snapshot Implementations

abstract: In this work, we propose the $\lambda$-scanner snapshot, a variation of the snapshot object, which supports any fixed amount of $0 < \lambda \leq n$ different $SCAN$ operations being active at any given time. Whenever $\lambda$ is equal to the number of processes $n$ in the system, the $\lambda$-scanner object implements a multi-scanner object, while in case that $\lambda$ is equal to $1$, the $\lambda$-scanner object implements a single-scanner object. We present the $\lambda-Snap$ snapshot object, a wait-free $\lambda$-scanner snapshot implementation that has a step complexity of $O(\lambda)$ for $UPDATE$ operations and $O(\lambda m)$ for $SCAN$ operations. The space complexity of $\lambda-Snap$ is $O(\lambda m)$. $\lambda-Snap$ provides a trade-off between the step/space complexity and the maximum number of $SCAN$ operations that the system can afford to be active on any given point in time. The low space complexity that our implementations provide makes them more appealing in real system applications. Moreover, we provide a slightly modified version of the $\lambda-Snap$ implementation, which is called partial $\lambda-Snap$, that is able to support dynamic partial scan operations. In such an object, processes can execute modified $SCAN$ operations called $PARTIAL\_SCAN$ that could obtain a part of the snapshot object avoiding to read the whole set of components. In this work, we first provide a simple single-scanner version of $\lambda-Snap$, which is called $1-Snap$. We provide $1-Snap$ just for presentation purposes, since it is simpler than $\lambda-Snap$. The $UPDATE$ in $1-Snap$ has a step complexity of $O(1)$, while the $SCAN$ has a step complexity of $O(m)$. This implementation uses $O(m)$ $CAS$ registers.


title: On Mixup Regularization

abstract: Mixup is a data augmentation technique that creates new examples as convex combinations of training points and labels. This simple technique has empirically shown to improve the accuracy of many state-of-the-art models in different settings and applications, but the reasons behind this empirical success remain poorly understood. In this paper we take a substantial step in explaining the theoretical foundations of Mixup, by clarifying its regularization effects. We show that Mixup can be interpreted as standard empirical risk minimization estimator subject to a combination of data transformation and random perturbation of the transformed data. We gain two core insights from this new interpretation. First, the data transformation suggests that, at test time, a model trained with Mixup should also be applied to transformed data, a one-line change in code that we show empirically to improve both accuracy and calibration of the prediction. Second, we show how the random perturbation of the new interpretation of Mixup induces multiple known regularization schemes, including label smoothing and reduction of the Lipschitz constant of the estimator. These schemes interact synergistically with each other, resulting in a self calibrated and effective regularization effect that prevents overfitting and overconfident predictions. We corroborate our theoretical analysis with experiments that support our conclusions.


title: Universal Power Law Scaling Near the Turning Points

abstract: We show analytically and numerically that, the velocity $v_\pm$ of a particle near the turning points $x_0$ vanishes, i. e. $v_\pm\rightarrow 0$ as $x\rightarrow x_0$, according to the power law scaling $\left|v_\pm\right| \propto \left|x_0-x\right|^{\beta}$, where the exponent $\beta=1/2$ is independent of the particle mass and the force acting on it. We also show that, the time spends it any particle at each small interval $dx$ near the turning points diverges as $\tau\propto \left|x_0-x\right|^{\nu}$, with the exponent $\nu=-1/2$. Behavior we find here is very similar to power law scaling that had been found near the critical points for systems which undergo a phase transition.


title: Learning to Incentivize Other Learning Agents

abstract: The challenge of developing powerful and general Reinforcement Learning (RL) agents has received increasing attention in recent years. Much of this effort has focused on the single-agent setting, in which an agent maximizes a predefined extrinsic reward function. However, a long-term question inevitably arises: how will such independent agents cooperate when they are continually learning and acting in a shared multi-agent environment? Observing that humans often provide incentives to influence others' behavior, we propose to equip each RL agent in a multi-agent environment with the ability to give rewards directly to other agents, using a learned incentive function. Each agent learns its own incentive function by explicitly accounting for its impact on the learning of recipients and, through them, the impact on its own extrinsic objective. We demonstrate in experiments that such agents significantly outperform standard RL and opponent-shaping agents in challenging general-sum Markov games, often by finding a near-optimal division of labor. Our work points toward more opportunities and challenges along the path to ensure the common good in a multi-agent future.


title: Accelerating linear solvers for Stokes problems with C++ metaprogramming

abstract: The efficient solution of large sparse saddle point systems is very important in computational fluid mechanics. The discontinuous Galerkin finite element methods have become increasingly popular for incompressible flow problems but their application is limited due to high computational cost. We describe the C++ programming techniques that may help to accelerate linear solvers for such problems. The approach is based on the policy-based design pattern and partial template specialization, and is implemented in the open source AMGCL library. The efficiency is demonstrated with the example of accelerating an iterative solver of a discontinuous Galerkin finite element method for the Stokes problem. The implementation allows selecting algorithmic components of the solver by adjusting template parameters without any changes to the codebase. It is possible to switch the system matrix to use small statically sized blocks to store the nonzero values, or use a mixed precision solution, which results in up to 4 times speedup, and reduces the memory footprint of the algorithm by about 40\%. We evaluate both monolithic and composite preconditioning strategies for the 3 benchmark problems. The performance of the proposed solution is compared with a multithreaded direct Pardiso solver and a parallel iterative PETSc solver.


title: Causal Feature Selection for Algorithmic Fairness

abstract: The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality training data, most of the fairness literature ignores this stage. In this work, we consider fairness in the integration component of data management, aiming to identify features that improve prediction without adding any bias to the dataset. We work under the causal interventional fairness paradigm. Without requiring the underlying structural causal model a priori, we propose an approach to identify a sub-collection of features that ensure the fairness of the dataset by performing conditional independence tests between different subsets of features. We use group testing to improve the complexity of the approach. We theoretically prove the correctness of the proposed algorithm to identify features that ensure interventional fairness and show that sub-linear conditional independence tests are sufficient to identify these variables. A detailed empirical evaluation is performed on real-world datasets to demonstrate the efficacy and efficiency of our technique.


title: Marginal Utility for Planning in Continuous or Large Discrete Action Spaces

abstract: Sample-based planning is a powerful family of algorithms for generating intelligent behavior from a model of the environment. Generating good candidate actions is critical to the success of sample-based planners, particularly in continuous or large action spaces. Typically, candidate action generation exhausts the action space, uses domain knowledge, or more recently, involves learning a stochastic policy to provide such search guidance. In this paper we explore explicitly learning a candidate action generator by optimizing a novel objective, marginal utility. The marginal utility of an action generator measures the increase in value of an action over previously generated actions. We validate our approach in both curling, a challenging stochastic domain with continuous state and action spaces, and a location game with a discrete but large action space. We show that a generator trained with the marginal utility objective outperforms hand-coded schemes built on substantial domain knowledge, trained stochastic policies, and other natural objectives for generating actions for sampled-based planners.


title: $^1$H-NMR Dipole-Dipole Relaxation in Fluids: Relaxation of Individual $^1$H-$^1$H Pairs versus Relaxation of Molecular Modes

abstract: The intra-molecular $^1$H-NMR dipole-dipole relaxation of molecular fluids has traditionally been interpreted within the Bloembergen-Purcell-Pound (BPP) theory of NMR intra-molecular relaxation. The BPP theory draws upon Debye's theory for describing the rotational diffusion of the $^1$H-$^1$H pair and predicts a mono-exponential decay of the $^1$H-$^1$H dipole-dipole autocorrelation function between distinct spin pairs. Using molecular dynamics (MD) simulations, we show that for both $n$-heptane and water this is not the case. In particular, the autocorrelation function of individual $^1$H-$^1$H intra-molecular pairs itself evinces a rich stretched-exponential behavior, implying a distribution in rotational correlation times. However for the high-symmetry molecule neopentane, the individual $^1$H-$^1$H intra-molecular pairs do conform to the BPP description, suggesting an important role of molecular symmetry in aiding agreement with the BPP model. The inter-molecular autocorrelation functions for $n$-heptane, water, and neopentane also do not admit a mono-exponential behavior of individual $^1$H-$^1$H inter-molecular pairs at distinct initial separations. We suggest expanding the auto-correlation function in terms of molecular modes, where the molecular modes do have an exponential relaxation behavior. With care, the resulting Fredholm integral equation of the first kind can be inverted to recover the probability distribution of the molecular modes. The advantages and limitations of this approach are noted.


title: The Effect of Singularization on the Euler Characteristic

abstract: In this work, singular surfaces are obtained from smooth orientable closed surfaces by applying three basic simple loop operations, collapsing operation, zipping operation and double loop identification, each of which produces different singular surfaces. A formula that provides the Euler characteristic of the singularized surface is proved. Also, we introduce a new definition of genus for singularized surfaces which generalizes the classical definition of genus in the smooth case. A theorem relating the Euler characteristic to the genus of the singularized surface is proved.


title: Scalable Partial Explainability in Neural Networks via Flexible Activation Functions

abstract: Achieving transparency in black-box deep learning algorithms is still an open challenge. High dimensional features and decisions given by deep neural networks (NN) require new algorithms and methods to expose its mechanisms. Current state-of-the-art NN interpretation methods (e.g. Saliency maps, DeepLIFT, LIME, etc.) focus more on the direct relationship between NN outputs and inputs rather than the NN structure and operations itself. In current deep NN operations, there is uncertainty over the exact role played by neurons with fixed activation functions. In this paper, we achieve partially explainable learning model by symbolically explaining the role of activation functions (AF) under a scalable topology. This is carried out by modeling the AFs as adaptive Gaussian Processes (GP), which sit within a novel scalable NN topology, based on the Kolmogorov-Arnold Superposition Theorem (KST). In this scalable NN architecture, the AFs are generated by GP interpolation between control points and can thus be tuned during the back-propagation procedure via gradient descent. The control points act as the core enabler to both local and global adjustability of AF, where the GP interpolation constrains the intrinsic autocorrelation to avoid over-fitting. We show that there exists a trade-off between the NN's expressive power and interpretation complexity, under linear KST topology scaling. To demonstrate this, we perform a case study on a binary classification dataset of banknote authentication. By quantitatively and qualitatively investigating the mapping relationship between inputs and output, our explainable model can provide interpretation over each of the one-dimensional attributes. These early results suggest that our model has the potential to act as the final interpretation layer for deep neural networks.


title: Geodesics of positive Lagrangians from special Lagrangians with boundary

abstract: Geodesics in the space of positive Lagrangian submanifolds are solutions of a fully non-linear degenerate elliptic PDE. We show that a geodesic segment in the space of positive Lagrangians corresponds to a one parameter family of special Lagrangian cylinders, called the cylindrical transform. The boundaries of the cylinders are contained in the positive Lagrangians at the ends of the geodesic. The special Lagrangian equation with positive Lagrangian boundary conditions is elliptic and the solution space is a smooth manifold, which is one dimensional in the case of cylinders. A geodesic can be recovered from its cylindrical transform by solving the Dirichlet problem for the Laplace operator on each cylinder. Using the cylindrical transform, we show the space of pairs of positive Lagrangian spheres connected by a geodesic is open. Thus, we obtain the first examples of strong solutions to the geodesic equation in arbitrary dimension not invariant under isometries. In fact, the solutions we obtain are smooth away from a finite set of points.


title: Joint Training of Variational Auto-Encoder and Latent Energy-Based Model

abstract: This paper proposes a joint training method to learn both the variational auto-encoder (VAE) and the latent energy-based model (EBM). The joint training of VAE and latent EBM are based on an objective function that consists of three Kullback-Leibler divergences between three joint distributions on the latent vector and the image, and the objective function is of an elegant symmetric and anti-symmetric form of divergence triangle that seamlessly integrates variational and adversarial learning. In this joint training scheme, the latent EBM serves as a critic of the generator model, while the generator model and the inference model in VAE serve as the approximate synthesis sampler and inference sampler of the latent EBM. Our experiments show that the joint training greatly improves the synthesis quality of the VAE. It also enables learning of an energy function that is capable of detecting out of sample examples for anomaly detection.


title: H\"older regularity of a Wiener integral in abstract space

abstract: In this article, we propose a way to consider processes indexed by a collection $\mathcal{A}$ of subsets of a general set $\mathcal{T}$. A large class of vector spaces, manifolds and continuous $\mathbb{R}$-trees are particular cases. Lattice-theoretic and topological assumptions are considered separately with a view to clarifying the exposition. We then define a Wiener-type integral $Y_A = \int_A f\,\text dX$ for all $A\in\mathcal{A}$ for a deterministic function $f:\mathcal{T} \rightarrow \mathbb{R}$ and a set-indexed L\'evy process $X$. It is a particular case of Raput and Rosinski [40], but our setting enables a quicker construction and yields more properties about the sample paths of $Y.$ Finally, bounds for the H\"older regularity of $Y$ are given which indicate how the regularities of $f$ and $X$ contributes to that of $Y$. This follows the works of Jaffard [24] and Balan\c{c}a and Herbin [6].


title: Deterministic Gaussian Averaged Neural Networks

abstract: We present a deterministic method to compute the Gaussian average of neural networks used in regression and classification. Our method is based on an equivalence between training with a particular regularized loss, and the expected values of Gaussian averages. We use this equivalence to certify models which perform well on clean data but are not robust to adversarial perturbations. In terms of certified accuracy and adversarial robustness, our method is comparable to known stochastic methods such as randomized smoothing, but requires only a single model evaluation during inference.