title: Comparison of Citations Trends between the COVID-19 Pandemic and SARS-CoV, MERS-CoV, Ebola, Zika, Avian and Swine Influenza Epidemics

abstract: Objective: The novel coronavirus COVID-19 outbreak rapidly evolved into pandemic. Global research efforts focus on this topic and with the collaboration of the scientific journals publication industry produced more than 16,000 related published articles in PubMed within five months from the onset of the outbreak. Herein, a comparison of the COVID-19 citations in PubMed and Web of Science was performed with SARS-CoV, MERS-CoV, Ebola, Zika, avian and swine influenza epidemics. Methods: The citations were searched and collected using the disease terms and the date of publication restriction. The total number of PubMed citations and the HIV associated papers during the same chronological periods were examined in parallel. The journal category and country information of the publications were gathered from Web of Science. The collected data were statistically analyzed and compared. Results: Significant correlations were found between COVID-19 and MERS (CC=0.988; p=0.003; q=0.006), Ebola (CC=0.987; p=0.003; q=0.011), and SARS (CC=0.964; p=0.015; q=0.028) epidemics five-month pick of novel citations in PubMed. However, COVID-19 publications were accumulated earlier and in larger numbers than any other 21st century major communicable disease outbreak. Conclusion: The acceleration and the total number of COVID-19 publications represent an unprecedented landmark event in the medical library history. The immediate adoption of the fast-track peer-reviewing and publishing as well as the open access publication policies by the journal publishers are significant contributors to this bibliographic phenomenon.


title: Open-Narrow-Synechiae Anterior Chamber Angle Classification in AS-OCT Sequences

abstract: Anterior chamber angle (ACA) classification is a key step in the diagnosis of angle-closure glaucoma in Anterior Segment Optical Coherence Tomography (AS-OCT). Existing automated analysis methods focus on a binary classification system (i.e., open angle or angle-closure) in a 2D AS-OCT slice. However, clinical diagnosis requires a more discriminating ACA three-class system (i.e., open, narrow, or synechiae angles) for the benefit of clinicians who seek better to understand the progression of the spectrum of angle-closure glaucoma types. To address this, we propose a novel sequence multi-scale aggregation deep network (SMA-Net) for open-narrow-synechiae ACA classification based on an AS-OCT sequence. In our method, a Multi-Scale Discriminative Aggregation (MSDA) block is utilized to learn the multi-scale representations at slice level, while a ConvLSTM is introduced to study the temporal dynamics of these representations at sequence level. Finally, a multi-level loss function is used to combine the slice-based and sequence-based losses. The proposed method is evaluated across two AS-OCT datasets. The experimental results show that the proposed method outperforms existing state-of-the-art methods in applicability, effectiveness, and accuracy. We believe this work to be the first attempt to classify ACAs into open, narrow, or synechia types grading using AS-OCT sequences.


title: Accurate photon echo timing by optical freezing of exciton dephasing and rephasing in quantum dots

abstract: Semiconductor quantum dots are excellent candidates for ultrafast coherent manipulation of qubits by laser pulses on picosecond timescales or even faster. In inhomogeneous ensembles a macroscopic optical polarization decays rapidly due to dephasing, which, however, is reversible in photon echoes carrying complete information about the coherent ensemble dynamics. Control of the echo emission time is mandatory for applications. Here, we propose a novel concept to reach this goal. In a two-pulse photon echo sequence, we apply an additional resonant control pulse with multiple of 2pi area. Depending on its arrival time, the control slows down dephasing or rephasing of the exciton ensemble during its action. We demonstrate for self-assembled (In,Ga)As quantum dots that the photon echo emission time can be retarded or advanced by 5 ps relative to its nominal appearance time without control. This versatile protocol may be used to obtain significantly longer temporal shifts for suitably tailored control pulses.


title: Confinement of an alkaline-earth element in a grating magneto-optical trap

abstract: We demonstrate a compact magneto-optical trap (MOT) of alkaline-earth atoms using a nanofabricated diffraction grating chip. A single input laser beam, resonant with the broad $^1$S$_0\,\rightarrow \,^1$P$_1$ transition of strontium, forms the MOT in combination with three diffracted beams from the grating chip and a magnetic field produced by permanent magnets. A differential pumping tube limits the effect of the heated, effusive source on the background pressure in the trapping region. The system has a total volume of around 2.4 L. With our setup, we have trapped up to $5 \times 10^6$ $^{88}$Sr atoms, at a temperature of approximately $6$ mK, and with a trap lifetime of approximately 1 s. Our results will aid the effort to miniaturize optical atomic clocks and other quantum technologies based on alkaline-earth atoms.


title: A linear implicit Euler method for the finite element discretization of a controlled stochastic heat equation

abstract: We consider a numerical approximation of a linear quadratic control problem constrained by the stochastic heat equation with non-homogeneous Neumann boundary conditions. This involves a combination of distributed and boundary control, as well as both distributed and boundary noise. We apply the finite element method for the spatial discretization and the linear implicit Euler method for the temporal discretization. Due to the low regularity induced by the boundary noise, convergence orders above 1/2 in space and 1/4 in time cannot be expected. We prove such optimal convergence orders for our full discretization when the distributed noise and the initial condition are sufficiently smooth. Under less smooth conditions, the convergence order is further decreased. Our results only assume that the related (deterministic) differential Riccati equation can be approximated with a certain convergence order, which is easy to achieve in practice. We confirm these theoretical results through a numerical experiment in a two dimensional domain.


title: Bayesian Probabilistic Numerical Integration with Tree-Based Models

abstract: Bayesian quadrature (BQ) is a method for solving numerical integration problems in a Bayesian manner, which allows users to quantify their uncertainty about the solution. The standard approach to BQ is based on a Gaussian process (GP) approximation of the integrand. As a result, BQ is inherently limited to cases where GP approximations can be done in an efficient manner, thus often prohibiting very high-dimensional or non-smooth target functions. This paper proposes to tackle this issue with a new Bayesian numerical integration algorithm based on Bayesian Additive Regression Trees (BART) priors, which we call BART-Int. BART priors are easy to tune and well-suited for discontinuous functions. We demonstrate that they also lend themselves naturally to a sequential design setting and that explicit convergence rates can be obtained in a variety of settings. The advantages and disadvantages of this new methodology are highlighted on a set of benchmark tests including the Genz functions, and on a Bayesian survey design problem.


title: Sustainability of ICT hardware procurement in Switzerland -- A status-quo analysis of the public procurement sector

abstract: Sustainable procurement requires organizations to align their purchasing behavior with regard to broader goals linked to resource efficiency, climate change, social responsibility and other sustainability criteria. The level of sustainability in Information and Communication Technology (ICT) hardware procurement is analyzed for two reasons: First, ICT hardware belongs to the six key product groups in sustainable procurement. Second, ICT in general is expected to be an important enabler for low-carbon economies, providing solutions to reduce Green-House Gas (GHG) emissions. While the advantages of sustainable procurement are obvious, certain barriers hinder the adoption in day-to-day procurement. This case study on ICT hardware discusses the three important barriers "lack of clear definitions per product group", "missing market intelligence about sustainable products" and "inflexible procedures and attitudes as barriers for innovative approaches" based on an in-depth analysis of sustainable procurement of ICT hardware by the public sector in Switzerland. To this end, tender data published on the national procurement platform simap.ch is screened for sustainability criteria using the Common Procurement Vocabulary (CPV) nomenclature to identify relevant ICT projects. The results reveal to which extent such criteria as well as their determinants are currently included in public tenders. Using two different approaches, only a small number of tenders were found containing sustainability criteria of a wide range from basic to comprehensive. The overall performance of Swiss public procurement is benchmarked by comparing the identified sustainability criteria with available criteria from international key actors in sustainable procurement. Thus, this analysis provides novel insights on how public agencies today take sustainability into account when procuring ICT hardware.


title: The aggregated unfitted finite element method on parallel tree-based adaptive meshes

abstract: In this work, we present an adaptive unfitted finite element scheme that combines the aggregated finite element method with parallel adaptive mesh refinement. We introduce a novel scalable distributed-memory implementation of the resulting scheme on locally-adapted Cartesian forest-of-trees meshes. We propose a two-step algorithm to construct the finite element space at hand by means of a discrete extension operator that carefully mixes aggregation constraints of problematic degrees of freedom, which get rid of the small cut cell problem, and standard hanging degree of freedom constraints, which ensure trace continuity on non-conforming meshes. Following this approach, we derive a finite element space that can be expressed as the original one plus well-defined linear constraints. Moreover, it requires minimum parallelization effort, using standard functionality available in existing large-scale finite element codes. Numerical experiments demonstrate its optimal mesh adaptation capability, robustness to cut location and parallel efficiency, on classical Poisson $hp$-adaptivity benchmarks. Our work opens the path to functional and geometrical error-driven dynamic mesh adaptation with the aggregated finite element method in large-scale realistic scenarios. Likewise, it can offer guidance for bridging other scalable unfitted methods and parallel adaptive mesh refinement.


title: Mechanisms for collective inversion-symmetry breaking in dabconium perovskite ferroelectrics

abstract: Dabconium hybrid perovskites include a number of recently-discovered ferroelectric phases with large spontaneous polarisations. The origin of ferroelectric response has been rationalised in general terms in the context of hydrogen bonding, covalency, and strain coupling. Here we use a combination of simple theory, Monte Carlo simulations, and density functional theory calculations to assess the ability of these microscopic ingredients---together with the always-present through-space dipolar coupling---to account for the emergence of polarisation in these particular systems whilst not in other hybrid perovskites. Our key result is that the combination of A-site polarity, preferred orientation along $\langle111\rangle$ directions, and ferroelastic strain coupling drives precisely the ferroelectric transition observed experimentally. We rationalise the absence of polarisation in many hybrid perovskites, and arrive at a set of design rules for generating FE examples beyond the dabconium family alone.


title: On Schwartz equivalence of quasidiscs and other planar domains

abstract: Two open subsets of $\mathbb{R}^n$ are called Schwartz equivalent if there exists a diffeomorphism between them that induces an isomorphism of Fr\'echet spaces between their spaces of Schwartz functions. In this paper we use tools from quasiconformal geometry in order to prove the Schwartz equivalence of a few families of planar domains. We prove that all quasidiscs are Schwartz equivalent and that any two non-simply-connected planar domains whose boundaries are quasicircles are Schwartz equivalent. We classify the two Schwartz equivalence classes of domains that consist of the entire plane minus a quasiarc and prove a Koebe type theorem, stating that any planar domain whose connected components of its boundary are finitely many quasicircles is Schwartz equivalent to a circle domain. We also prove that the notion of Schwartz equivalence is strictly finer than the notion of $C^\infty$-diffeomorphism by constructing examples of open subsets of $\mathbb{R}^n$ that are $C^\infty$-diffeomorphic and are not Schwartz equivalent.


title: Pacotte tree networks, graph theory and projective geometry

abstract: The notion of tree network has sparked renewed interest in recent years, particularly in computer science and biology (neural network). However, this notion is usually interpreted in an extremely restrictive way: essentially linked to data processing, today tree networks are hybrid network topologies in which star networks are generally interconnected via bus networks. These networks are, most often, hierarchical and regular, and each of their nodes can have an arbitrary number of child nodes. At the outset, however, the notion of tree network, introduced in 1936 by Belgian physicist Julien Pacotte, was quite different: more general and, at the same time, more constrained, it should also serve an ambitious objective: the reconstruction of mathematics from concrete empirical structures. Usually poorly commented on and poorly understood (especially by philosophers), it had no real posterity. In this article, we first try to clarify this notion of "tree network" in the sense of Julien Pacotte, which makes it possible to eliminate the bad interpretations to which this notion has given rise. To this end, we use the language and concepts of graph theory and formalize the main properties of these networks which, contrary to popular belief, are not, in general, trees. In a second part, we then try to follow and explain, step by step, how Pacotte intended, using concepts borrowed from projective geometry, to reconstruct all of mathematics from such a network.


title: (Four) Dual Plaquette 3D Ising Models

abstract: A characteristic feature of the 3d plaquette Ising model is its planar subsystem symmetry. The quantum version of this model has been shown to be related via a duality to the X-Cube model, which has been paradigmatic in the new and rapidly developing field of fractons. The relation between the 3d plaquette Ising and the X-Cube model is similar to that between the 2d quantum transverse spin Ising model and the Toric Code. Gauging the global symmetry in the case of the 2d Ising model and considering the gauge invariant sector of the high temperature phase leads to the Toric Code, whereas gauging the subsystem symmetry of the 3d quantum transverse spin plaquette Ising model leads to the X-Cube model. A non-standard dual formulation of the 3d plaquette Ising model which utilises three flavours of spins has recently been discussed in the context of dualising the fracton-free sector of the X-Cube model. In this paper we investigate the classical spin version of this non-standard dual Hamiltonian and discuss its properties in relation to the more familiar Ashkin-Teller-like dual and further related dual formulations involving both link and vertex spins and non-Ising spins.


title: A Graph-Based Modeling Abstraction for Optimization: Concepts and Implementation in Plasmo.jl

abstract: We present a general graph-based modeling abstraction for optimization that we call an OptiGraph. Under this abstraction, any optimization problem is treated as a hierarchical hypergraph in which nodes represent optimization subproblems and edges represent connectivity between such subproblems. The abstraction enables the modular construction of highly complex models in an intuitive manner, facilitates the use of graph analysis tools (to perform partitioning, aggregation, and visualization tasks), and facilitates communication of structures to decomposition algorithms. We provide an open-source implementation of the abstraction in the Julia-based package Plasmo.jl. We provide tutorial examples and large application case studies to illustrate the capabilities.


title: Adversarial Infidelity Learning for Model Interpretation

abstract: Model interpretation is essential in data mining and knowledge discovery. It can help understand the intrinsic model working mechanism and check if the model has undesired characteristics. A popular way of performing model interpretation is Instance-wise Feature Selection (IFS), which provides an importance score of each feature representing the data samples to explain how the model generates the specific output. In this paper, we propose a Model-agnostic Effective Efficient Direct (MEED) IFS framework for model interpretation, mitigating concerns about sanity, combinatorial shortcuts, model identifiability, and information transmission. Also, we focus on the following setting: using selected features to directly predict the output of the given model, which serves as a primary evaluation metric for model-interpretation methods. Apart from the features, we involve the output of the given model as an additional input to learn an explainer based on more accurate information. To learn the explainer, besides fidelity, we propose an Adversarial Infidelity Learning (AIL) mechanism to boost the explanation learning by screening relatively unimportant features. Through theoretical and experimental analysis, we show that our AIL mechanism can help learn the desired conditional distribution between selected features and targets. Moreover, we extend our framework by integrating efficient interpretation methods as proper priors to provide a warm start. Comprehensive empirical evaluation results are provided by quantitative metrics and human evaluation to demonstrate the effectiveness and superiority of our proposed method. Our code is publicly available online at https://github.com/langlrsw/MEED.


title: Tropes in films: an initial analysis

abstract: TVTropes is a wiki that describes tropes and which ones are used in which artistic work. We are mostly interested in films, so after releasing the TropeScraper Python module that extracts data from this site, in this report we use scraped information to describe statistically how tropes and films are related to each other and how these relations evolve in time. In order to do so, we generated a dataset through the tool TropeScraper in April 2020. We have compared it to the latest snapshot of DB Tropes, a dataset covering the same site and published in July 2016, providing descriptive analysis, studying the fundamental differences and addressing the evolution of the wiki in terms of the number of tropes, the number of films and connections. The results show that the number of tropes and films doubled their value and quadrupled their relations, and films are, at large, better described in terms of tropes. However, while the types of films with the most tropes has not changed significantly in years, the list of most popular tropes has. This outcome can help on shedding some light on how popular tropes evolve, which ones become more popular or fade away, and in general how a set of tropes represents a film and might be a key to its success. The dataset generated, the information extracted, and the summaries provided are useful resources for any research involving films and tropes. They can provide proper context and explanations about the behaviour of models built on top of the dataset, including the generation of new content or its use in machine learning.


title: A fiducial approach to nonparametric deconvolution problem: discrete case

abstract: Fiducial inference, as generalized by Hannig et al. (2016), is applied to nonparametric g-modeling (Efron, 2016) in the discrete case. We propose a computationally efficient algorithm to sample from the fiducial distribution, and use the generated samples to construct point estimates and confidence intervals. We study the theoretical properties of the fiducial distribution and perform extensive simulations in various scenarios. The proposed approach yields good statistical performance in terms of the mean squared error of point estimators and the coverage of confidence intervals. Furthermore, we apply the proposed fiducial method to estimate the probability of each satellite site being malignant using gastric adenocarcinoma data with 844 patients (Efron, 2016).


title: Indications for very high metallicity and absence of methane for the eccentric exo-Saturn WASP-117b

abstract: We investigate the atmospheric composition of the long period ($P_{\rm orb}=$ 10 days), eccentric exo-Saturn WASP-117b. WASP-117b could be in atmospheric temperature and chemistry similar to WASP-107b. In mass and radius WASP-117b is similar to WASP-39b, which allows a comparative study of these planets. We analyze a near-infrared transmission spectrum of WASP-117b taken with Hubble Space Telescope/WFC3 G141, which was reduced with two independent pipelines. High resolution measurements were taken with VLT/ESPRESSO in the optical. We report the robust ($3\sigma$) detection of a water spectral feature. Using a 1D atmosphere model with isothermal temperature, uniform cloud deck and equilibrium chemistry, the Bayesian evidence of a retrieval analysis of the transmission spectrum indicates a preference for a high atmospheric metallicity ${\rm [Fe/H]}=2.58^{+0.26}_{-0.37}$ and clear skies. The data are also consistent with a lower-metallicity composition ${\rm [Fe/H]}<1.75$ and a cloud deck between $10^{-2.2} - 10^{-5.1}$ bar, but with weaker Bayesian preference. We retrieve a low CH$_4$ abundance of $<10^{-4}$ volume fraction within $1 \sigma$ and $<2\cdot 10^{-1}$ volume fraction within $3 \sigma$. We cannot constrain the equilibrium temperature between theoretically imposed limits of 700 and 1000~K. Further observations are needed to confirm quenching of CH$_4$ with $K_{zz}\geq 10^8$~cm$^2$/s. We report indications of Na and K in the VLT/ESPRESSO high resolution spectrum with substantial Bayesian evidence in combination with HST data.


title: Using GAMA to probe the impact of small-scale galaxy physics on nonlinear redshift-space distortions

abstract: We present improved modelling of the redshift-space distortions of galaxy clustering that arise from peculiar velocities. We create mock galaxy catalogues in the framework of the halo model, using data from the Bolshoi project. These mock galaxy populations are inserted into the haloes with additional degrees of freedom that govern spatial and kinematical biases of the galaxy populations relative to the dark matter. We explore this generalised halo model with an MCMC algorithm, comparing the predictions to data from the Galaxy And Mass Assembly (GAMA) survey, and thus derive one of the first constraints on the detailed kinematic degrees of freedom for satellite galaxies within haloes. With this approach, the distortions of the redshift-space galaxy autocorrelations can be accounted for down to spatial separations close to 10 kpc, opening the prospect of improved RSD measurements of the perturbation growth rate by the inclusion of data from nonlinear scales.


title: The slow heartbeats of an ultra-luminous X-ray source in NGC 3621

abstract: We report on the results of X-ray observations of 4XMM J111816.0-324910, a transient ultra-luminous X-ray source located in the galaxy NGC 3621. This system is characterised by a transient nature and marked variability with characteristic time-scale of ~3500 s, differently from other ULXs, which in the vast majority show limited intra-observation variability. Such a behaviour is very reminiscent of the so-called heartbeats sometimes observed in the Galactic black hole binary GRS 1915+105, where the variability time-scale is ~10-1000 s. We study the spectral and timing properties of this object and find that overall, once the differences in the variability time-scales are taken into account, they match quite closely those of both GRS 1915+105, and of a number of objects showing heartbeats in their light-curves, including a confirmed neutron star and a super-massive black hole powering an active galactic nucleus. We investigate the nature of the compact object in 4XMM J111816.0-324910 by searching for typical neutron star signatures and by attempting a mass estimate based on different methods and assumptions. Based on the current available data, we are not able to unambiguously determine the nature of the accreting compact object responsible for the observed phenomenology.


title: Interpretable Deep Graph Generation with Node-Edge Co-Disentanglement

abstract: Disentangled representation learning has recently attracted a significant amount of attention, particularly in the field of image representation learning. However, learning the disentangled representations behind a graph remains largely unexplored, especially for the attributed graph with both node and edge features. Disentanglement learning for graph generation has substantial new challenges including 1) the lack of graph deconvolution operations to jointly decode node and edge attributes; and 2) the difficulty in enforcing the disentanglement among latent factors that respectively influence: i) only nodes, ii) only edges, and iii) joint patterns between them. To address these challenges, we propose a new disentanglement enhancement framework for deep generative models for attributed graphs. In particular, a novel variational objective is proposed to disentangle the above three types of latent factors, with novel architecture for node and edge deconvolutions. Moreover, within each type, individual-factor-wise disentanglement is further enhanced, which is shown to be a generalization of the existing framework for images. Qualitative and quantitative experiments on both synthetic and real-world datasets demonstrate the effectiveness of the proposed model and its extensions.


title: Operational-Based Annual Energy Production Uncertainty: Are its Components Actually Uncorrelated?

abstract: Calculations of annual energy production (AEP) from a wind power plant-whether based on preconstruction or operational data-are critical for wind plant financial transactions. A popular industry practice is to assume that different uncertainty components within an AEP calculation are uncorrelated and can therefore be combined as the sum of their squares. We assess the practical validity of this assumption for operational-based uncertainty, by performing operational AEP estimates for more than 470 wind plants in the United States, mostly in simple terrain. We apply a Monte Carlo approach to quantify uncertainty in five categories: revenue meter data, wind speed data, regression relationship, long-term correction, and future interannual variability. We identify correlations between categories by comparing the results across all 470 wind plants. We observe a positive correlation between interannual variability and the linearized long-term correction; a negative correlation between wind resource interannual variability and linear regression; and a positive correlation between reference wind speed uncertainty and linear regression. Then, we contrast total operational AEP uncertainty values calculated by omitting and considering the correlations between the uncertainty components. We quantify that ignoring these correlations leads to an underestimation of total AEP uncertainty of, on average, 0.1%, and as large as 0.5% for specific sites. Although these are not large increases, these would still impact wind plant financing rates; further, we expect these values to increase for wind plants in complex terrain. Based on these results, we conclude that correlations between the identified uncertainty components should be considered when computing the total AEP uncertainty.


title: A Refined Model for Epitaxial Tilt of Epilayers Grown on Miscut Substrates

abstract: A refined model of the origin of epitaxial tilt on miscut (or vicinal) substrates is explained by employing crystal modeling and reciprocal space analysis. The Nagai tilt model (H. Nagai, J. Appl. Phys., 45, 3789 (1974)) is often cited to explain the tilt of lattice planes in a pseudomorphic layer deposited on a miscut substrate that is observed in high resolution x-ray diffraction measurements. Here, however, we demonstrate how that model incorrectly describes how the substrate applies biaxial stress onto the epitaxial layer. Most importantly, the stress applied to an epitaxial layer on a miscut substrate is not along a low index plane. For example, the surface plane of a nominally (001) cubic substrate with a miscut of 10{\deg} towards the [110] is the (118) plane and the stress applied is parallel along the (118) plane and not (001). Furthermore, under the framework of reciprocal space, the {00l} reflections would be symmetric reflections for on-axis substrates but asymmetric reflections for miscut substrates. The tilt that is experimentally observed between the low index substrate planes and the epitaxial layer planes ((001) for example with a miscut substrate) matches that which is predicted by treating the low index reflections as asymmetric reflections. An epitaxial tilt equation is provided which describes the tilt between epitaxial and substrate layers based on the lattice parameter mismatch as well as the Poisson ratio of the layer that is applicable to any crystal system.


title: End-to-end User Recognition using Touchscreen Biometrics

abstract: We study the touchscreen data as behavioural biometrics. The goal was to create an end-to-end system that can transparently identify users using raw data from mobile devices. The touchscreen biometrics was researched only few times in series of works with disparity in used methodology and databases. In the proposed system data from the touchscreen goes directly, without any processing, to the input of a deep neural network, which is able to decide on the identity of the user. No hand-crafted features are used. The implemented classification algorithm tries to find patterns by its own from raw data. The achieved results show that the proposed deep model is sufficient enough for the given identification task. The performed tests indicate high accuracy of user identification and better EER results compared to state of the art systems. The best result achieved by our system is 0.65% EER.


title: A t-distribution based operator for enhancing out of distribution robustness of neural network classifiers

abstract: Neural Network (NN) classifiers can assign extreme probabilities to samples that have not appeared during training (out-of-distribution samples) resulting in erroneous and unreliable predictions. One of the causes for this unwanted behaviour lies in the use of the standard softmax operator which pushes the posterior probabilities to be either zero or unity hence failing to model uncertainty. The statistical derivation of the softmax operator relies on the assumption that the distributions of the latent variables for a given class are Gaussian with known variance. However, it is possible to use different assumptions in the same derivation and attain from other families of distributions as well. This allows derivation of novel operators with more favourable properties. Here, a novel operator is proposed that is derived using $t$-distributions which are capable of providing a better description of uncertainty. It is shown that classifiers that adopt this novel operator can be more robust to out of distribution samples, often outperforming NNs that use the standard softmax operator. These enhancements can be reached with minimal changes to the NN architecture.


title: Democratising blockchain: A minimal agency consensus model

abstract: We propose a novel consensus protocol based on a hybrid approach, that combines a directed acyclic graph (DAG) and a classical chain of blocks. This architecture allows us to enforce collective block construction, minimising the monopolistic power of the round-leader. In this way, we decrease the possibility for collusion among senders and miners, as well as miners themselves, allowing the use of more incentive compatible and fair pricing strategies. We investigate these possibilities alongside the ability to use the DAG structure to minimise the risk of transaction censoring. We conclude by providing preliminary benchmarks of our protocol and by exploring further research directions.


title: Numerical Approximations and Error Analysis of the Cahn-Hilliard Equation with Dynamic Boundary Conditions

abstract: We consider the numerical approximations of the Cahn-Hilliard equation with dynamic boundary conditions (C. Liu et. al., Arch. Rational Mech. Anal., 2019). We propose a first-order in time, linear and energy stable numerical scheme, which is based on the stabilized linearly implicit approach. The energy stability of the scheme is proved and the semi-discrete-in-time error estimates are carried out. Numerical experiments, including the comparison with the former work, the accuracy tests with respect to the time step size and the shape deformation of a droplet, are performed to validate the accuracy and the stability of the proposed scheme.


title: Why does the Kerr-Newman black hole have the same gyromagnetic ratio as the electron?

abstract: We have recently proposed a deterministic matrix dynamics at the Planck scale, for gravity coupled to Dirac fermions, evolving in the so-called Connes time. By coarse-graining this dynamics over time intervals much larger than Planck time, we derived the space-time manifold, quantum theory, and classical general relativity, as low energy emergent approximations to the underlying matrix dynamics. In the present article, we show how to include Yang-Mills gauge fields in this Planck scale matrix dynamics. We do this by appropriately modifying the fundamental action for the previously introduced `atom' of space-time-matter [which we now call an `aikyon']. This is achieved by modifying the Dirac operator to include a `potential' for the Yang-Mills aspect, and a `current' for the Yang-Mills charge. Our work opens up an avenue for unification of gravity with gauge-fields and Dirac fermions. We show how spontaneous localisation in the matrix dynamics gives rise to general relativity coupled to gauge-fields and relativistic point particles, in the classical limit. We use this formalism to explain the remarkable fact that the Kerr-Newman black hole has the same value for the gyromagnetic ratio as that for a Dirac fermion, both being twice the classical value.


title: Concentration inequalities for log-concave distributions with applications to random surface fluctuations

abstract: We derive two concentration inequalities for linear functions of log-concave distributions: an enhanced version of the classical Brascamp--Lieb concentration inequality, and an inequality quantifying log-concavity of marginals in a manner suitable for obtaining variance and tail probability bounds. These inequalities are applied to the statistical mechanics problem of estimating the fluctuations of random surfaces of the $\nabla\varphi$ type. The classical Brascamp--Lieb inequality bounds the fluctuations whenever the interaction potential is uniformly convex. We extend these bounds to the case of convex potentials whose second derivative vanishes only on a zero measure set, when the underlying graph is a $d$-dimensional discrete torus. The result applies, in particular, to potentials of the form $U(x)=|x|^p$ with $p>1$ and answers a question discussed by Brascamp--Lieb--Lebowitz (1975). Additionally, new tail probability bounds are obtained for the family of potentials $U(x) = |x|^p+x^2$, $p>2$. This result answers a question mentioned by Deuschel and Giacomin (2000).


title: Low Distortion Block-Resampling with Spatially Stochastic Networks

abstract: We formalize and attack the problem of generating new images from old ones that are as diverse as possible, only allowing them to change without restrictions in certain parts of the image while remaining globally consistent. This encompasses the typical situation found in generative modelling, where we are happy with parts of the generated data, but would like to resample others ("I like this generated castle overall, but this tower looks unrealistic, I would like a new one"). In order to attack this problem we build from the best conditional and unconditional generative models to introduce a new network architecture, training procedure, and algorithm for resampling parts of the image as desired.


title: On the phase transition in the sublattice TASEP with stochastic blockage

abstract: We revisit the defect-induced nonequilibrium phase transition from a largely homogeneous free-flow phase to a phase-separated congested phase in the sublattice totally asymmetric simple exclusion process (TASEP) with local deterministic bulk dynamics and a stochastic defect that mimicks a random blockage. Exact results are obtained for the compressibility and density correlations for a stationary grandcanonical ensemble given by the matrix product ansatz. At the critical density the static compressibility diverges while in the phase separated state above the critical point the compressibility vanishes due to strong non-local correlations. These correlations arise from a long range effective interaction between particles that appears in the stationary state despite the locality of the microscopic dynamics.


title: Non-iterative Modal Logics are Coalgebraic

abstract: A modal logic is \emph{non-iterative} if it can be defined by axioms that do not nest modal operators, and \emph{rank-1} if additionally all propositional variables in axioms are in scope of a modal operator. It is known that every syntactically defined rank-1 modal logic can be equipped with a canonical coalgebraic semantics, ensuring soundness and strong completeness. In the present work, we extend this result to non-iterative modal logics, showing that every non-iterative modal logic can be equipped with a canonical coalgebraic semantics defined in terms of a copointed functor, again ensuring soundness and strong completeness via a canonical model construction. Like in the rank-1 case, the canonical coalgebraic semantics is equivalent to a neighbourhood semantics with suitable frame conditions, so the known strong completeness of non-iterative modal logics over neighbourhood semantics is implied. As an illustration of these results, we discuss deontic logics with factual detachment, which is captured by axioms that are non-iterative but not rank~1.


title: Real-time Localization Using Radio Maps

abstract: This paper deals with the problem of localization in a cellular network in a dense urban scenario. Global Navigation Satellite System typically performs poorly in urban environments when there is no line-of-sight between the devices and the satellites, and thus alternative localization methods are often required. We present a simple yet effective method for localization based on pathloss. In our approach, the user to be localized reports the received signal strength from a set of base stations with known locations. For each base station we have a good approximation of the pathloss at each location in the map, provided by RadioUNet, an efficient deep learning-based simulator of pathloss functions in urban environment, akin to ray-tracing. Using the approximations of the pathloss functions of all base stations and the reported signal strengths, we are able to extract a very accurate approximation of the location of the user.


title: Deep Visual Reasoning: Learning to Predict Action Sequences for Task and Motion Planning from an Initial Scene Image

abstract: In this paper, we propose a deep convolutional recurrent neural network that predicts action sequences for task and motion planning (TAMP) from an initial scene image. Typical TAMP problems are formalized by combining reasoning on a symbolic, discrete level (e.g. first-order logic) with continuous motion planning such as nonlinear trajectory optimization. Due to the great combinatorial complexity of possible discrete action sequences, a large number of optimization/motion planning problems have to be solved to find a solution, which limits the scalability of these approaches. To circumvent this combinatorial complexity, we develop a neural network which, based on an initial image of the scene, directly predicts promising discrete action sequences such that ideally only one motion planning problem has to be solved to find a solution to the overall TAMP problem. A key aspect is that our method generalizes to scenes with many and varying number of objects, although being trained on only two objects at a time. This is possible by encoding the objects of the scene in images as input to the neural network, instead of a fixed feature vector. Results show runtime improvements of several magnitudes. Video: https://youtu.be/i8yyEbbvoEk


title: The concept of velocity in the history of Brownian motion -- From physics to mathematics and back

abstract: Interest in Brownian motion was shared by different communities: this phenomenon was first observed by the botanist Robert Brown in 1827, then theorised by physicists in the 1900s, and eventually modelled by mathematicians from the 1920s, while still evolving as a physical theory. Consequently, Brownian motion now refers to the natural phenomenon but also to the theories accounting for it. There is no published work telling its entire history from its discovery until today, but rather partial histories either from 1827 to Perrin's experiments in the late 1900s, from a physicist's point of view; or from the 1920s from a mathematician's point of view. In this article, we tackle the period straddling the two `half-histories' just mentioned, in order to highlight continuity, to investigate the domain-shift from physics to mathematics, and to survey the enhancements of later physical theories. We study the works of Einstein, Smoluchowski, Langevin, Wiener, Ornstein and Uhlenbeck from 1905 to 1934 as well as experimental results, using the concept of Brownian velocity as a leading thread. We show how Brownian motion became a research topic for the mathematician Wiener in the 1920s, why his model was an idealization of physical experiments, what Ornstein and Uhlenbeck added to Einstein's results, and how Wiener, Ornstein and Uhlenbeck developed in parallel contradictory theories concerning Brownian velocity.


title: SALD: Sign Agnostic Learning with Derivatives

abstract: Learning 3D geometry directly from raw data, such as point clouds, triangle soups, or unoriented meshes is still a challenging task that feeds many downstream computer vision and graphics applications. In this paper, we introduce SALD: a method for learning implicit neural representations of shapes directly from raw data. We generalize sign agnostic learning (SAL) to include derivatives: given an unsigned distance function to the input raw data, we advocate a novel sign agnostic regression loss, incorporating both pointwise values and gradients of the unsigned distance function. Optimizing this loss leads to a signed implicit function solution, the zero level set of which is a high quality and valid manifold approximation to the input 3D data. The motivation behind SALD is that incorporating derivatives in a regression loss leads to a lower sample complexity, and consequently better fitting. In addition, we prove that SAL enjoys a minimal length property in 2D, favoring minimal length solutions. More importantly, we are able to show that this property still holds for SALD, i.e., with derivatives included. We demonstrate the efficacy of SALD for shape space learning on two challenging datasets: ShapeNet that contains inconsistent orientation and non-manifold meshes, and D-Faust that contains raw 3D scans (triangle soups). On both these datasets, we present state-of-the-art results.


title: Scalable Optimal Deployment in the Cloud of Component-based Applications using Optimization Modulo Theory, Mathematical Programming and Symmetry Breaking

abstract: The problem of Cloud resource provisioning for component-based applications consists in the allocation of virtual machines (VMs) offers from various Cloud Providers to a set of applications such that the constraints induced by the interactions between components and by the components hardware/software requirements are satisfied and the performance objectives are optimized (e.g. costs are minimized). It can be formulated as a constraint optimization problem, hence, in principle the optimization can be carried out automatically. In the case the set of VM offers is large (several hundreds), the computational requirement is huge, making the automatic optimization practically impossible with the current general optimization modulo theory (OMT) and mathematical programming (MP) tools. We overcame the difficulty by methodologically analyzing the particularities of the problem with the aim of identifying search space reduction methods. These are methods exploiting:(1) the symmetries of the general Cloud deployment problem, (2) the graph representation associated to the structural constraints specific to each particular application, and (3) their combination. An extensive experimental analysis has been conducted on four classes of real-world problems, using six symmetry breaking strategies and two types of optimization solvers. As a result, the combination of a variable reduction strategy with a column-wise symmetry breaker leads to a scalable deployment solution, when OMT is used to solve the resulting optimization problem.


title: Initial-boundary value problem for 2D magneto-micropolar equations with zero angular viscosity

abstract: In this paper, we are concerned with the initial-boundary value problem to the 2D magneto-micropolar system with zero angular viscosity in a smooth bounded domain. We prove that there exists a unique global strong solution of such a system by imposing natural boundary conditions and regularity assumptions on the initial data, without any compatibility condition.


title: Distributed Learning on Heterogeneous Resource-Constrained Devices

abstract: We consider a distributed system, consisting of a heterogeneous set of devices, ranging from low-end to high-end. These devices have different profiles, e.g., different energy budgets, or different hardware specifications, determining their capabilities on performing certain learning tasks. We propose the first approach that enables distributed learning in such a heterogeneous system. Applying our approach, each device employs a neural network (NN) with a topology that fits its capabilities; however, part of these NNs share the same topology, so that their parameters can be jointly learned. This differs from current approaches, such as federated learning, which require all devices to employ the same NN, enforcing a trade-off between achievable accuracy and computational overhead of training. We evaluate heterogeneous distributed learning for reinforcement learning (RL) and observe that it greatly improves the achievable reward on more powerful devices, compared to current approaches, while still maintaining a high reward on the weaker devices. We also explore supervised learning, observing similar gains.


title: Is there still something left that Gravity Probe B can measure?

abstract: We perform a full analytical and numerical treatment, to the first post-Newtonian (1pN) order, of the general relativistic long-term spin precession of an orbiting gyroscope due to the mass quadrupole moment $J_2$ of its primary without any restriction on either the gyro's orbital configuration and the orientation in space of the symmetry axis $\boldsymbol{\hat{k}}$ of the central body. We apply our results to the past spaceborne Gravity Probe B (GP-B) mission by finding a secular rate of its spin's declination $\delta$ which may be as large as $\lesssim 30-40\,\mathrm{milliarcseconds\,per\,year\,(\mathrm{mas\,yr}^{-1}})$, depending on the initial orbital phase $f_0$. Both our analytical calculation and our simultaneous integration of the equations for the parallel transport of the spin 4-vector and of the geodesic equations of motion of the gyroscope confirm such a finding. For GP-B, the reported mean error in measuring the spin's declination rate amounts to $\sigma^\mathrm{GP-B}_{\dot\delta}=18.3\,\mathrm{mas\,yr}^{-1}$. We also calculate the general analytical expressions of the gravitomagnetic spin precession induced by the primary's angular momentum $\boldsymbol J$. In view of their generality, our results can be extended also to other astronomical and astrophysical scenarios of interest like, e.g., stars orbiting galactic supermassive black holes, exoplanets close to their parent stars, tight binaries hosting compact stellar corpses.


title: Retrieval-Augmented Generation for Code Summarization via Hybrid GNN

abstract: Source code summarization aims to generate natural language summaries from structured code snippets for better understanding code functionalities. However, automatic code summarization is challenging due to the complexity of the source code and the language gap between the source code and natural language summaries. Most previous approaches either rely on retrieval-based (which can take advantage of similar examples seen from the retrieval database, but have low generalization performance) or generation-based methods (which have better generalization performance, but cannot take advantage of similar examples). This paper proposes a novel retrieval-augmented mechanism to combine the benefits of both worlds. Furthermore, to mitigate the limitation of Graph Neural Networks (GNNs) on capturing global graph structure information of source code, we propose a novel attention-based dynamic graph to complement the static graph representation of the source code, and design a hybrid message passing GNN for capturing both the local and global structural information. To evaluate the proposed approach, we release a new challenging benchmark, crawled from diversified large-scale open-source C projects (total 95k+ unique functions in the dataset). Our method achieves the state-of-the-art performance, improving existing methods by 1.42, 2.44 and 1.29 in terms of BLEU-4, ROUGE-L and METEOR.


title: Common Cell type Nomenclature for the mammalian brain: A systematic, extensible convention

abstract: The advancement of single cell RNA-sequencing technologies has led to an explosion of cell type definitions across multiple organs and organisms. While standards for data and metadata intake are arising, organization of cell types has largely been left to individual investigators, resulting in widely varying nomenclature and limited alignment between taxonomies. To facilitate cross-dataset comparison, the Allen Institute created the Common Cell type Nomenclature (CCN) for matching and tracking cell types across studies that is qualitatively similar to gene transcript management across different genome builds. The CCN can be readily applied to new or established taxonomies and was applied herein to diverse cell type datasets derived from multiple quantifiable modalities. The CCN facilitates assigning accurate yet flexible cell type names in the mammalian cortex as a step towards community-wide efforts to organize multi-source, data-driven information related to cell type taxonomies from any organism.


title: D-VPnet: A Network for Real-time Dominant Vanishing Point Detection in Natural Scenes

abstract: As an important part of linear perspective, vanishing points (VPs) provide useful clues for mapping objects from 2D photos to 3D space. Existing methods are mainly focused on extracting structural features such as lines or contours and then clustering these features to detect VPs. However, these techniques suffer from ambiguous information due to the large number of line segments and contours detected in outdoor environments. In this paper, we present a new convolutional neural network (CNN) to detect dominant VPs in natural scenes, i.e., the Dominant Vanishing Point detection Network (D-VPnet). The key component of our method is the feature line-segment proposal unit (FLPU), which can be directly utilized to predict the location of the dominant VP. Moreover, the model also uses the two main parallel lines as an assistant to determine the position of the dominant VP. The proposed method was tested using a public dataset and a Parallel Line based Vanishing Point (PLVP) dataset. The experimental results suggest that the detection accuracy of our approach outperforms those of state-of-the-art methods under various conditions in real-time, achieving rates of 115fps.


title: Asymptotic $\ast$--distribution of permuted Haar unitary matrices

abstract: We study Haar unitary random matrices with permuted entries. For a sequence of permutations $\left(\sigma_N\right)_N$, where $\sigma_N$ acts on $N\times N$ matrices we identify conditions under which the $\ast$--distribution of permuted Haar unitary matrices $U_N^{\sigma_N}$ is asymptotically circular and free from the unpermuted sequence $U_N$. We show that this convergence takes place in the almost sure sense. Moreover we show that our conditions on the sequence of permutations are generic in the sense that are almost surely satisfied by a sequence of random permutations.


title: Fast Modeling and Understanding Fluid Dynamics Systems with Encoder-Decoder Networks

abstract: Is a deep learning model capable of understanding systems governed by certain first principle laws by only observing the system's output? Can deep learning learn the underlying physics and honor the physics when making predictions? The answers are both positive. In an effort to simulate two-dimensional subsurface fluid dynamics in porous media, we found that an accurate deep-learning-based proxy model can be taught efficiently by a computationally expensive finite-volume-based simulator. We pose the problem as an image-to-image regression, running the simulator with different input parameters to furnish a synthetic training dataset upon which we fit the deep learning models. Since the data is spatiotemporal, we compare the performance of two alternative treatments of time; a convolutional LSTM versus an autoencoder network that treats time as a direct input. Adversarial methods are adopted to address the sharp spatial gradient in the fluid dynamic problems. Compared to traditional simulation, the proposed deep learning approach enables much faster forward computation, which allows us to explore more scenarios with a much larger parameter space given the same time. It is shown that the improved forward computation efficiency is particularly valuable in solving inversion problems, where the physics model has unknown parameters to be determined by history matching. By computing the pixel-level attention of the trained model, we quantify the sensitivity of the deep learning model to key physical parameters and hence demonstrate that the inversion problems can be solved with great acceleration. We assess the efficacy of the machine learning surrogate in terms of its training speed and accuracy. The network can be trained within minutes using limited training data and achieve accuracy that scales desirably with the amount of training data supplied.


title: Deep learning of contagion dynamics on complex networks

abstract: Forecasting the evolution of contagion dynamics is still an open problem to which mechanistic models only offer a partial answer. To remain mathematically or computationally tractable, these models must rely on simplifying assumptions, thereby limiting the quantitative accuracy of their predictions and the complexity of the dynamics they can model. Here, we propose a complementary approach based on deep learning where the effective local mechanisms governing a dynamic on a network are learned from time series data. Our graph neural network architecture makes very few assumptions about the dynamics, and we demonstrate its accuracy using different contagion dynamics of increasing complexity. By allowing simulations on arbitrary network structures, our approach makes it possible to explore the properties of the learned dynamics beyond the training data. Finally, we illustrate the applicability of our approach using real data of the COVID-19 outbreak in Spain. Our results demonstrate how deep learning offers a new and complementary perspective to build effective models of contagion dynamics on networks.


title: Fundamental stellar parameters of benchmark stars from CHARA interferometry. I. Metal-poor stars

abstract: Benchmark stars are crucial as validating standards for current as well as future large stellar surveys of the Milky Way. However, the number of suitable metal-poor benchmarks is currently limited. We aim to construct a new set of metal-poor benchmarks, based on reliable interferometric effective temperature ($T_\text{eff}$) determinations and a homogeneous analysis with a desired precision of $1\%$ in $T_\text{eff}$. We observed ten late-type metal-poor dwarf and giants: HD2665, HD6755, HD6833, HD103095, HD122563, HD127243, HD140283, HD175305, HD221170, and HD224930. Only three of the ten stars (HD103095, HD122563, and HD140283) have previously been used as benchmarks. For the observations, we used the high angular resolution optical interferometric instrument PAVO at the CHARA array. We modelled angular diameters using 3D limb darkening models and determined $T_\text{eff}$ directly from the Stefan-Boltzmann relation, with an iterative procedure to interpolate over tables of bolometric corrections. Surface gravities ($\log(g)$) were estimated from comparisons to Dartmouth stellar evolution model tracks. We collected spectroscopic observations from the ELODIE and FIES spectrographs and estimated metallicities ($\mathrm{[Fe/H]}$) from a 1D non-LTE abundance analysis of unblended lines of neutral and singly ionized iron. We inferred $T_\text{eff}$ to better than $1\%$ for five of the stars (HD103095, HD122563, HD127243, HD140283, and HD224930). The $T_\text{eff}$ of the other five stars are reliable to between $2-3\%$; the higher uncertainty on the $T_\text{eff}$ for those stars is mainly due to their having a larger uncertainty in the bolometric fluxes. We also determined $\log(g)$ and $\mathrm{[Fe/H]}$ with median uncertainties of $0.03\,\mathrm{dex}$ and $0.09\,\mathrm{dex}$, respectively. These ten stars can, therefore, be adopted as a new, reliable set of metal-poor benchmarks.


title: Random Van der Waerden Theorem

abstract: In this paper we prove the Random Van der Waerden Theorem: For $q_1 \geq q_2 \geq \dotsb \geq q_r \geq 3 \in \mathbb{N}$ there exist $c,C >0$ such that \[ \lim_{n \to \infty} \mathbb{P}([n]_p \rightarrow (q_1,\dotsc, q_r)) = \begin{cases} 1 & \text{if } p \geq C \cdot n^{-\frac{q_2}{q_1(q_2-1)}}, 0 & \text{if } p \leq c \cdot n^{-\frac{q_2}{q_1(q_2-1)}}, \end{cases}\] extending the results of R\"odl and Ruci\'nski for the symmetric case $q_i = q$. The proof for the 1-statement is based on the Hypergraph Container Method by Balogh, Morris and Samotij and Saxton and Thomason. The proof for the 0-statement is an extension of R\"odl and Ruci\'nski's argument for the symmetric case.


title: Secondary Electron Emission by Plasmon Induced Symmetry Breaking in Highly Oriented Pyrolitic Graphite (HOPG)

abstract: Two-particle spectroscopy with correlated electron pairs is used to establish the causal link between the secondary electron spectrum, the $(\pi+\sigma)-$plasmon peak and the unoccupied band structure of highly oriented pyrolitic graphite. The plasmon spectrum is resolved with respect to the involved interband transitions and clearly exhibits final state effects, in particular due to the energy gap between the interlayer resonances along the $\Gamma$A-direction. The corresponding final state effects can also be identified in the secondary electron spectrum. Interpretation of the results is performed on the basis of density functional theory and tight binding calculations. Excitation of the plasmon perturbs the symmetry of the system and leads to hybridisation of the interlayer resonances with atom-like $\sigma^*$ bands along the $\Gamma A$-direction. These hybrid states have a high density of states as well as sufficient mobility along the graphite $c$-axis leading to the sharp $\sim$3\ eV resonance in the spectrum of emitted secondary electrons reported throughout the literature.


title: Near-field infrared nano-spectroscopy of surface phonon-polariton resonances

abstract: We present combined experimental and numerical work on light-matter interactions at nanometer length scales. We report novel numerical simulations of near-field infrared nanospectroscopy that consider, for the first time, detailed tip geometry and have no free parameters. Our results match published spectral shapes of amplitude and phase measurements even for strongly resonant surface phonon-polariton (SPhP) modes. They also verify published absolute scattering amplitudes for the first time. A novel, ultrabroadband light source enables near-field amplitude and phase acquisition into the far-infrared spectral range. This allowed us to discover a strong SPhP resonance in the polar dielectric SrTiO3 (STO) at approximately 24 micrometer wavelength of incident light.


title: Neuroevolution in Deep Neural Networks: Current Trends and Future Challenges

abstract: A variety of methods have been applied to the architectural configuration and learning or training of artificial deep neural networks (DNN). These methods play a crucial role in the success or failure of the DNN for most problems and applications. Evolutionary Algorithms (EAs) are gaining momentum as a computationally feasible method for the automated optimisation and training of DNNs. Neuroevolution is a term which describes these processes of automated configuration and training of DNNs using EAs. While many works exist in the literature, no comprehensive surveys currently exist focusing exclusively on the strengths and limitations of using neuroevolution approaches in DNNs. Prolonged absence of such surveys can lead to a disjointed and fragmented field preventing DNNs researchers potentially adopting neuroevolutionary methods in their own research, resulting in lost opportunities for improving performance and wider application within real-world deep learning problems. This paper presents a comprehensive survey, discussion and evaluation of the state-of-the-art works on using EAs for architectural configuration and training of DNNs. Based on this survey, the paper highlights the most pertinent current issues and challenges in neuroevolution and identifies multiple promising future research directions.


title: Polylog-overhead highly fault-tolerant measurement-based quantum computation: all-Gaussian implementation with Gottesman-Kitaev-Preskill code

abstract: Scalability of flying photonic quantum systems in generating quantum entanglement offers a potential for implementing large-scale fault-tolerant quantum computation, especially by means of measurement-based quantum computation (MBQC). However, existing protocols for MBQC inevitably impose a polynomial overhead cost in implementing quantum computation due to geometrical constraints of entanglement structures used in the protocols, and the polynomial overhead potentially cancels out useful polynomial speedups in quantum computation. To implement quantum computation without this cancellation, we construct a protocol for photonic MBQC that achieves as low as poly-logarithmic overhead, by introducing an entanglement structure for low-overhead qubit permutation. Based on this protocol, we design a fault-tolerant photonic MBQC protocol that can be performed by experimentally tractable homodyne detection and Gaussian entangling operations combined with the Gottesman-Kitaev-Preskill (GKP) quantum error-correcting code, which we concatenate with the $7$-qubit code. Our fault-tolerant protocol achieves the threshold $7.8$ dB in terms of the squeezing level of the GKP code, outperforming $8.3$ dB of the best existing protocol for fault-tolerant quantum computation with the GKP surface code. Thus, bridging a gap between theoretical progress on MBQC and photonic experiments towards implementing MBQC, our results open a new way towards realization of a large class of quantum speedups including those polynomial.


title: On the distribution of the order and index for the reductions of algebraic numbers

abstract: Let $\alpha_1,\ldots,\alpha_r$ be algebraic numbers in a number field $K$ generating a subgroup of rank $r$ in $K^\times$. We investigate under GRH the number of primes $\mathfrak p$ of $K$ such that each of the orders of $(\alpha_i\bmod\mathfrak p)$ lies in a given arithmetic progression associated to $\alpha_i$. We also study the primes $\mathfrak p$ for which the index of $(\alpha_i\bmod\mathfrak p)$ is a fixed integer or lies in a given set of integers for each $i$. An additional condition on the Frobenius conjugacy class of $\mathfrak p$ may be considered. Such results are generalizations of a theorem of Ziegler from 2006, which concerns the case $r=1$ of this problem.


title: A note on the universality of ESDs of inhomogeneous random matrices

abstract: In this short note, we extend the celebrated results of Tao and Vu, and Krishnapur on the universality of empirical spectral distributions to a wide class of inhomogeneous complex random matrices, by showing that a technical and hard-to-verify Fourier domination assumption may be replaced simply by a natural uniform anti-concentration assumption. Along the way, we show that inhomogeneous complex random matrices, whose expected squared Hilbert-Schmidt norm is quadratic in the dimension, and whose entries (after symmetrization) are uniformly anti-concentrated at $0$ and infinity, typically have smallest singular value $\Omega(n^{-1/2})$. The rate $n^{-1/2}$ is sharp, and closes a gap in the literature. Our proofs closely follow recent works of Livshyts, and Livshyts, Tikhomirov, and Vershynin on inhomogeneous real random matrices. The new ingredient is a couple of anti-concentration inequalities for sums of independent, but not necessarily identically distributed, complex random variables, which may also be useful in other contexts.


title: Cost-effective Interactive Attention Learning with Neural Attention Processes

abstract: We propose a novel interactive learning framework which we refer to as Interactive Attention Learning (IAL), in which the human supervisors interactively manipulate the allocated attentions, to correct the model's behavior by updating the attention-generating network. However, such a model is prone to overfitting due to scarcity of human annotations, and requires costly retraining. Moreover, it is almost infeasible for the human annotators to examine attentions on tons of instances and features. We tackle these challenges by proposing a sample-efficient attention mechanism and a cost-effective reranking algorithm for instances and features. First, we propose Neural Attention Process (NAP), which is an attention generator that can update its behavior by incorporating new attention-level supervisions without any retraining. Secondly, we propose an algorithm which prioritizes the instances and the features by their negative impacts, such that the model can yield large improvements with minimal human feedback. We validate IAL on various time-series datasets from multiple domains (healthcare, real-estate, and computer vision) on which it significantly outperforms baselines with conventional attention mechanisms, or without cost-effective reranking, with substantially less retraining and human-model interaction cost.


title: Error estimation and adaptivity for differential equations with multiple scales in time

abstract: We consider systems of ordinary differential equations with multiple scales in time. In general, we are interested in the long time horizon of a slow variable that is coupled to solution components that act on a fast scale. Although the fast scale variables are essential for the dynamics of the coupled problem, they are often of no interest in themselves. Recently we have proposed a temporal multiscale approach that fits into the framework of the heterogeneous multiscale method and that allows for efficient simulations with significant speedups. Fast and slow scales are decoupled by introducing local averages and by replacing fast scale contributions by localized periodic-in-time problems. Here, we generalize this multiscale approach to a larger class of problems but in particular, we derive an a posteriori error estimator based on the dual weighted residual method that allows for a splitting of the error into averaging error, error on the slow scale and error on the fast scale. We demonstrate the accuracy of the error estimator and also its use for adaptive control of a numerical multiscale scheme.


title: Conditional Sig-Wasserstein GANs for Time Series Generation

abstract: Generative adversarial networks (GANs) have been extremely successful in generating samples, from seemingly high dimensional probability measures. However, these methods struggle to capture the temporal dependence of joint probability distributions induced by time-series data. Furthermore, long time-series data streams hugely increase the dimension of the target space, which may render generative modelling infeasible. To overcome these challenges, motivated by the autoregressive models in econometric, we are interested in the conditional distribution of future time series given the past information. We propose the generic conditional Sig-WGAN framework by integrating Wasserstein-GANs (WGANs) with mathematically principled and efficient path feature extraction called the signature of a path. The signature of a path is a graded sequence of statistics that provides a universal description for a stream of data, and its expected value characterises the law of the time-series model. In particular, we develop the conditional Sig-$W_1$ metric, that captures the conditional joint law of time series models, and use it as a discriminator. The signature feature space enables the explicit representation of the proposed discriminators which alleviates the need for expensive training. We validate our method on both synthetic and empirical dataset and observe that our method consistently and significantly outperforms state-of-the-art benchmarks with respect to measures of similarity and predictive ability.


title: Report from the A.I. For Nuclear Physics Workshop

abstract: This report is an outcome of the workshop "AI for Nuclear Physics" held at Thomas Jefferson National Accelerator Facility on March 4-6, 2020. The workshop brought together 184 scientists to explore opportunities for Nuclear Physics in the area of Artificial Intelligence. The workshop consisted of plenary talks, as well as six working groups. The report includes the workshop deliberations and additional contributions to describe prospects for using AI across Nuclear Physics research.


title: High-$z$ Universe probed via Lensing by QSOs (HULQ) I. Number Estimates of QSO-QSO and QSO-Galaxy Lenses

abstract: It is unclear how galaxies and their central supermassive black holes (SMBHs) co-evolve across cosmic time, especially for the non-local universe ($z \gtrsim 0.5$). The High-$z$ Universe probed via Lensing by QSOs (HULQ) project proposes to utilize quasi-stellar object (QSO) host galaxies acting as gravitational lenses (QSO lenses) to investigate this topic. This paper focuses on the feasibility of this project, i.e., whether sufficiently large numbers of QSO lenses are expected to be found in various concurrent and future imaging surveys. We find that $\sim 440$ QSO lenses will reside in the Hyper Suprime-Cam Wide survey (HSC/Wide), which is expected to be the most prolific concurrent survey, with this number being boosted by one to two orders of magnitude (to $\sim 10000$) with upcoming surveys such as that conducted with the Large Synoptic Survey Telescope (LSST). We discuss several methods of how to study the redshift evolution of the $M_{\rm BH} - \sigma_*$ relation, which is a stand-out illustration of the co-evolution. In addition, we demonstrate how the intimacy of lensed images to the bright deflector QSO for most systems will affect the \textit{detectability} of QSO lenses. We estimate that only $\sim 82$ and $900$ will be detectable for HSC/Wide and LSST, respectively; the decrease is significant yet still yields an acceptable sample for the main objective. This decrease will be less of a problem for space-based imaging surveys, for their small point spread function FWHMs will allow detections of lensed images lying relatively close to the deflector QSO, and thus unveil the less massive yet more numerous QSO hosts.


title: Quantum Coherence and Ergotropy

abstract: Constraints on work extraction are fundamental to our operational understanding of the thermodynamics of both classical and quantum systems. In the quantum setting, finite-time control operations typically generate coherence in the instantaneous energy eigenbasis of the dynamical system. Thermodynamic cycles can, in principle, be designed to extract work from this non-equilibrium resource. Here, we isolate and study the quantum coherent component to the work yield in such protocols. Specifically, we identify a coherent contribution to the ergotropy (the maximum amount of unitarily extractable work via cyclical variation of Hamiltonian parameters). We show this by dividing the optimal transformation into an incoherent operation and a coherence extraction cycle. We obtain bounds for both the coherent and incoherent parts of the extractable work and discuss their saturation in specific settings. Our results are illustrated with several examples, including finite-dimensional systems and bosonic Gaussian states that describe recent experiments on quantum heat engines with a quantized load.


title: Standing MHD Waves in a Magnetic Slab Embedded in an Asymmetric Magnetic Plasma Environment: Surface Waves

abstract: Building on a previous study that analyses surface waves in magnetic slabs embedded in a non-magnetic external environment, in this study the model is generalised and external magnetic fields are added. The slab is assumed to be thin, with weak magnetic asymmetry. The frequencies of the standing harmonic modes are derived to leading-order in the small quantities representing the thin slab width and the weak asymmetry. It is found that the frequencies are more prone to changes to the width of the slab than changes in the magnetic asymmetry. The frequency ratio of the first harmonic to the fundamental mode is derived, along with the amplitude difference between the two sides of the slab, as these may be observable quantities that can be compared with observational results and applied to carry out solar magneto-seismology.


title: Identifying galaxy groups at high redshift from incomplete spectroscopic data: I. The group finder and application to zCOSMOS

abstract: Identifying galaxy groups from redshift surveys of galaxies plays an important role in connecting galaxies with the underlying dark matter distribution. Current and future high-$z$ spectroscopic surveys, usually incomplete in redshift sampling, present both opportunities and challenges to identifying groups in the high-$z$ Universe. We develop a group finder that is based on incomplete redshift samples combined with photometric data, using a machine learning method to assign halo masses to identified groups. Test using realistic mock catalogs shows that $\gtrsim 90\%$ of true groups with halo masses $\rm M_h \gtrsim 10^{12} M_{\odot}/h$ are successfully identified, and that the fraction of contaminants is smaller than $10\%$. The standard deviation in the halo mass estimation is smaller than 0.25 dex at all masses. We apply our group finder to zCOSMOS-bright and describe basic properties of the group catalog obtained.


title: The merger-driven evolution of massive early-type galaxies

abstract: The evolution of the structural and kinematic properties of early-type galaxies (ETGs), their scaling relations, as well as their stellar metallicity and age contain precious information on the assembly history of these systems. We present results on the evolution of the stellar mass-velocity dispersion relation of ETGs, focusing in particular on the effects of some selection criteria used to define ETGs. We also try to shed light on the role that in-situ and ex-situ stellar populations have in massive ETGs, providing a possible explanation of the observed metallicity distributions.


title: Evolution of the $B$-Meson Light-Cone Distribution Amplitude in Laplace Space

abstract: The $B$-meson light-cone distribution amplitude is a central quantity governing non-perturbative hadronic dynamics in exclusive $B$ decays. We show that the information needed to describe such processes at leading power in $\Lambda_{\rm QCD}/m_b$ is most directly contained in its Laplace transform $\tilde\phi_+(\eta)$. We derive the renormalization-group (RG) equation satisfied by this function and present its exact solution. We express the RG-improved QCD factorization theorem for the decay $B^-\to\gamma\ell^-\bar\nu$ in terms of $\tilde\phi_+(\eta)$ and show that it is explicitly independent of the factorization scale. We propose an unbiased parameterization of $\tilde\phi_+(\eta)$ in terms of a small set of uncorrelated hadronic parameters.


title: Effective Field Theory for Acoustic and Pseudo-Acoustic Phonons in Solids

abstract: We present a relativistic effective field theory for the interaction between acoustic and gapped phonons in the limit of a small gap. We show that, while the former are the Goldstone modes associated with the spontaneous breaking of spacetime symmetries, the latter are pseudo-Goldstones associated with some (small) explicit breaking. We hence dub them "pseudo-acoustic" phonons. In this first investigation, we build our effective theory for the cases of one and two spatial dimensions, two atomic species, and assuming large distance isotropy. As an illustrative example, we show how the theory can be applied to compute the total lifetime of both acoustic and pseudo-acoustic phonons. This construction can find applications that range from the physics of bilayer graphene to sub-GeV dark matter detectors.


title: Elemental Abundances in M31: Iron and Alpha Element Abundances in M31's Outer Halo

abstract: We present [Fe/H] and [$\alpha$/Fe] abundances, derived using spectral synthesis techniques, for stars in M31's outer stellar halo. The 21 [Fe/H] measurements and 7 [$\alpha$/Fe] measurements are drawn from fields ranging from 43 to 165 kpc in projected distance from M31. We combine our measurements with existing literature measurements, and compare the resulting sample of 23 stars with [Fe/H] and 9 stars with [$\alpha$/Fe] measurements in M31's outer halo with [$\alpha$/Fe] and [Fe/H] measurements, also derived from spectral synthesis, in M31's inner stellar halo ($r < $26 kpc) and dSph galaxies. The stars in M31's outer halo have [$\alpha$/Fe] patterns that are consistent with the largest of M31's dSph satellites (And I and And VII). These abundances provide tentative evidence that the [$\alpha$/Fe] abundances of stars in M31's outer halo are more similar to the abundances of Milky Way halo stars than to the abundances of stars in M31's inner halo. We also compare the spectral synthesis-based [Fe/H] measurements of stars in M31's halo with previous photometric [Fe/H] estimates, as a function of projected distance from M31. The spectral synthesis-based [Fe/H] measurements are consistent with a large-scale metallicity gradient previously observed in M31's stellar halo to projected distances as large as 100 kpc.


title: Lattice Calculation of Pion Form Factor with Overlap Fermions

abstract: We present a precise calculation of the pion form factor using overlap fermions on seven ensembles of 2+1-flavor domain-wall configurations with pion masses varying from 139 to 340 MeV. Taking advantage of the fast Fourier transform and other techniques to access many combinations of source and sink momenta, we find the pion mean square charge radius to be $\langle {r_\pi^2} \rangle= 0.430(5)(13)\ {\rm{fm^2}}$, which agrees well with the experimental result, and includes the systematic uncertainties from chiral extrapolation, lattice spacing and finite-volume dependence. We also find that $\langle {r_\pi^2} \rangle$ depends on both the valence and sea quark masses strongly and predict the pion form factor up to $Q^2 = 1.0 \ {\rm{GeV^2}}$ which agrees with experiments very well.


title: Finding New Physics without learning about it: Anomaly Detection as a tool for Searches at Colliders

abstract: In this paper we propose a new strategy, based on anomaly detection methods, to search for new physics phenomena at colliders independently of the details of such new events. For this purpose, machine learning techniques are trained using Standard Model events, with the corresponding outputs being sensitive to physics beyond it. We explore three novel AD methods in HEP: Isolation Forest, Histogram Based Outlier Detection, and Deep Support Vector Data Description; alongside the most customary Autoencoder. In order to evaluate the sensitivity of the proposed approach, predictions from specific new physics models are considered and compared to those achieved when using fully supervised deep neural networks. A comparison between shallow and deep anomaly detection techniques is also presented. Our results demonstrate the potential of semi-supervised anomaly detection techniques to extensively explore the present and future hadron colliders' data.


title: A program for the full axiom of choice

abstract: The theory of classical realizability is a framework for the Curry-Howard correspondence which enables to associate a program with each proof in Zermelo-Fraenkel set theory. But, almost all the applications of mathematics in physics, probability, statistics, etc. use Analysis i.e. the axiom of dependent choice (DC) or even the (full) axiom of choice (AC). It is therefore important to find explicit programs for these axioms. Various solutions have been found for DC, for instance the lambda-term called "bar recursion" or the instruction "quote" of LISP. We present here the first program for AC.


title: On the Fast Random Sampling and Other Properties of the Three Point Correlation Function in Galaxy Surveys

abstract: In the forthcoming large volume galaxy surveys higher order statistics will provide complementary information to the usual two point statistics. Low variance estimators of the Three Point Correlation Function (3CPF) of discrete data count triangle configurations with vertices mixing data and random catalogues. Large density random catalogues are used to reduce the shot noise, which leads to a computational cost of one or two orders of magnitude more than the pure data histogram. In this paper, we explore time reductions of the isotropic 3PCF random sampling terms in periodic boxes without using random catalogues. In the first approach, based on Hamilton's construction of his famous two point estimator, we use an ad-hoc two point correlation term, while for the second procedure we construct the operators from a geometrical viewpoint, using two sides and their opening angle to describe the 3PCF triangle configurations. We map the last result to the three triangle side basis either numerically or analytically, and show that the latter approach performs best when applied to synthetic data. Moreover, we elaborate on going beyond periodic boxes, discuss other low variance n-point estimators and present useful 3PCF visualization schemes.


title: Characterizing IoT Networks with Asynchronous Time-Sensitive Periodic Traffic

abstract: This paper develops a novel spatiotemporal model for large-scale IoT networks with asynchronous periodic traffic and hard-packet deadlines. A static marked Poisson bipolar point process is utilized to model the spatial locations of the IoT devices, where the marks mimic the relative time-offsets of traffic duty cycles at different devices. At each device, an absorbing Markov chain is utilized to capture the temporal evolution of packets from generation until either successful delivery or deadline expiry. The temporal evolution of packets is defined in terms of the Aloha transmission/backoff states. From the network perspective, the meta distribution of the transmission success probability is used to characterize the mutual interference among of the coexisting devices. To this end, the network performance is characterized in terms of the probabilities of meeting/missing the delivery deadlines and transmission latency. The results unveil counter-intuitive superior performance of strict packet deadlines in terms of transmission success and latency.


title: Hypersequent calculi for non-normal modal and deontic logics: Countermodels and optimal complexity

abstract: We present some hypersequent calculi for all systems of the classical cube and their extensions with axioms $T$, $P$, $D$, and, for every $n\geq 1$, rule $RD^+_n$. The calculi are internal as they only employ the language of the logic, plus additional structural connectives. We show that the calculi are complete with respect to the corresponding axiomatisation by a syntactic proof of cut elimination. Then we define a terminating root-first proof search strategy based on the hypersequent calculi and show that it is optimal for coNP-complete logics. Moreover, we obtain that from every saturated leaf of a failed proof it is possible to define a countermodel of the root hypersequent in the bi-neighbourhood semantics, and for regular logics also in the relational semantics. We finish the paper by giving a translation between hypersequent rule applications and derivations in a labelled system for the classical cube.


title: Unravelling the richness of dark sector by FASER$\nu$

abstract: FASER$\nu$ is a newly proposed experiment which will take data in run III of the LHC during 2021-2023. It will be located in front of the FASER detector, 480~m away from the ATLAS interaction point in the forward direction. Its main goal is to detect neutrinos of all flavors produced at the interaction point with superb precision in reconstructing charged tracks. This capability makes FASER$\nu$ an ideal setup for uncovering the pattern and properties of a light dark sector. We demonstrate this capability for a well-motivated class of models with a dark matter candidate of mass around a few GeV. Dark matter annihilates to a pair of intermediate neutral particles that subsequently decay into the standard model charged fermions. We show how FASER$\nu$ can shed light on the structure of the dark sector by unravelling the decay chain within such models.


title: Lyubeznik numbers, $F$-modules and modules of generalized fractions

abstract: This paper presents an algorithm for calculation of the Lyubeznik numbers of a local ring which is a homomorphic image of a regular local ring $R$ of prime characteristic. The methods used employ Lyubeznik's $F$-modules over $R$, particularly his $F$-finite $F$-modules, and also the modules of generalized fractions of Sharp and Zakeri. It is shown that many modules of generalized fractions over $R$ have natural structures as $F$-modules; these lead to $F$-module structures on certain local cohomology modules over $R$, which are exploited, in conjunction with $F$-module structures on injective $R$-modules that result from work of Huneke and Sharp, to compute Lyubeznik numbers. The resulting algorithm has been implemented in Macaulay2.


title: Gravitational Microlensing Event Statistics for the Zwicky Transient Facility

abstract: Microlensing surveys have discovered thousands of events with almost all events discovered within the Galactic bulge or toward the Magellanic clouds. The Zwicky Transient Facility (ZTF), while not designed to be a microlensing campaign, is an optical time-domain survey that observes the entire northern sky every few nights including the Galactic plane. ZTF observes $\sim10^9$ stars in g-band and r-band and can significantly contribute to the observed microlensing population. We predict that ZTF will observe $\sim$1100 microlensing events in three years of observing within $10^\circ$ degrees latitude of the Galactic plane, with $\sim$500 events in the outer Galaxy ($\ell \geq 10^\circ$). This yield increases to $\sim$1400 ($\sim$800) events by combining every three ZTF exposures, $\sim$1800 ($\sim$900) events if ZTF observes for a total of five years, and $\sim$2400 ($\sim$1300) events for a five year survey with post-processing image stacking. Using the microlensing modeling software PopSyCLE, we compare the microlensing populations in the Galactic bulge and the outer Galaxy. We also present an analysis of the microlensing event ZTF18abhxjmj to demonstrate how to leverage these population statistics in event modeling. ZTF will constrain Galactic structure, stellar populations, and primordial black holes through photometric microlensing.


title: On Coresets For Regularized Regression

abstract: We study the effect of norm based regularization on the size of coresets for regression problems. Specifically, given a matrix $ \mathbf{A} \in {\mathbb{R}}^{n \times d}$ with $n\gg d$ and a vector $\mathbf{b} \in \mathbb{R} ^ n $ and $\lambda > 0$, we analyze the size of coresets for regularized versions of regression of the form $\|\mathbf{Ax}-\mathbf{b}\|_p^r + \lambda\|{\mathbf{x}}\|_q^s$ . Prior work has shown that for ridge regression (where $p,q,r,s=2$) we can obtain a coreset that is smaller than the coreset for the unregularized counterpart i.e. least squares regression (Avron et al). We show that when $r \neq s$, no coreset for regularized regression can have size smaller than the optimal coreset of the unregularized version. The well known lasso problem falls under this category and hence does not allow a coreset smaller than the one for least squares regression. We propose a modified version of the lasso problem and obtain for it a coreset of size smaller than the least square regression. We empirically show that the modified version of lasso also induces sparsity in solution, similar to the original lasso. We also obtain smaller coresets for $\ell_p$ regression with $\ell_p$ regularization. We extend our methods to multi response regularized regression. Finally, we empirically demonstrate the coreset performance for the modified lasso and the $\ell_1$ regression with $\ell_1$ regularization.


title: Faster PAC Learning and Smaller Coresets via Smoothed Analysis

abstract: PAC-learning usually aims to compute a small subset ($\varepsilon$-sample/net) from $n$ items, that provably approximates a given loss function for every query (model, classifier, hypothesis) from a given set of queries, up to an additive error $\varepsilon\in(0,1)$. Coresets generalize this idea to support multiplicative error $1\pm\varepsilon$. Inspired by smoothed analysis, we suggest a natural generalization: approximate the \emph{average} (instead of the worst-case) error over the queries, in the hope of getting smaller subsets. The dependency between errors of different queries implies that we may no longer apply the Chernoff-Hoeffding inequality for a fixed query, and then use the VC-dimension or union bound. This paper provides deterministic and randomized algorithms for computing such coresets and $\varepsilon$-samples of size independent of $n$, for any finite set of queries and loss function. Example applications include new and improved coreset constructions for e.g. streaming vector summarization [ICML'17] and $k$-PCA [NIPS'16]. Experimental results with open source code are provided.


title: Tensor train decompositions on recurrent networks

abstract: Recurrent neural networks (RNN) such as long-short-term memory (LSTM) networks are essential in a multitude of daily live tasks such as speech, language, video, and multimodal learning. The shift from cloud to edge computation intensifies the need to contain the growth of RNN parameters. Current research on RNN shows that despite the performance obtained on convolutional neural networks (CNN), keeping a good performance in compressed RNNs is still a challenge. Most of the literature on compression focuses on CNNs using matrix product (MPO) operator tensor trains. However, matrix product state (MPS) tensor trains have more attractive features than MPOs, in terms of storage reduction and computing time at inference. We show that MPS tensor trains should be at the forefront of LSTM network compression through a theoretical analysis and practical experiments on NLP task.


title: Variational Model-based Policy Optimization

abstract: Model-based reinforcement learning (RL) algorithms allow us to combine model-generated data with those collected from interaction with the real system in order to alleviate the data efficiency problem in RL. However, designing such algorithms is often challenging because the bias in simulated data may overshadow the ease of data generation. A potential solution to this challenge is to jointly learn and improve model and policy using a universal objective function. In this paper, we leverage the connection between RL and probabilistic inference, and formulate such an objective function as a variational lower-bound of a log-likelihood. This allows us to use expectation maximization (EM) and iteratively fix a baseline policy and learn a variational distribution, consisting of a model and a policy (E-step), followed by improving the baseline policy given the learned variational distribution (M-step). We propose model-based and model-free policy iteration (actor-critic) style algorithms for the E-step and show how the variational distribution learned by them can be used to optimize the M-step in a fully model-based fashion. Our experiments on a number of continuous control tasks show that despite being more complex, our model-based (E-step) algorithm, called {\em variational model-based policy optimization} (VMBPO), is more sample-efficient and robust to hyper-parameter tuning than its model-free (E-step) counterpart. Using the same control tasks, we also compare VMBPO with several state-of-the-art model-based and model-free RL algorithms and show its sample efficiency and performance.


title: Hierarchical regularization networks for sparsification based learning on noisy datasets

abstract: We propose a hierarchical learning strategy aimed at generating sparse representations and associated models for large noisy datasets. The hierarchy follows from approximation spaces identified at successively finer scales. For promoting model generalization at each scale, we also introduce a novel, projection based penalty operator across multiple dimension, using permutation operators for incorporating proximity and ordering information. The paper presents a detailed analysis of approximation properties in the reconstruction Reproducing Kernel Hilbert Spaces (RKHS) with emphasis on optimality and consistency of predictions and behavior of error functionals associated with the produced sparse representations. Results show the performance of the approach as a data reduction and modeling strategy on both synthetic (univariate and multivariate) and real datasets (time series). The sparse model for the test datasets, generated by the presented approach, is also shown to efficiently reconstruct the underlying process and preserve generalizability.


title: Fast Optimization with Zeroth-Order Feedback in Distributed, Multi-User MIMO Systems

abstract: In this paper, we develop a gradient-free optimization methodology for efficient resource allocation in Gaussian MIMO multiple access channels. Our approach combines two main ingredients: (i) an entropic semidefinite optimization based on matrix exponential learning (MXL); and (ii) a one-shot gradient estimator which achieves low variance through the reuse of past information. This novel algorithm, which we call gradient-free MXL algorithm with callbacks (MXL0$^{+}$), retains the convergence speed of gradient-based methods while requiring minimal feedback per iteration$-$a single scalar. In more detail, in a MIMO multiple access channel with $K$ users and $M$ transmit antennas per user, the MXL0$^{+}$ algorithm achieves $\epsilon$-optimality within $\text{poly}(K,M)/\epsilon^2$ iterations (on average and with high probability), even when implemented in a fully distributed, asynchronous manner. For cross-validation, we also perform a series of numerical experiments in medium- to large-scale MIMO networks under realistic channel conditions. Throughout our experiments, the performance of MXL0$^{+}$ matches$-$and sometimes exceeds$-$that of gradient-based MXL methods, all the while operating with a vastly reduced communication overhead. In view of these findings, the MXL0$^{+}$ algorithm appears to be uniquely suited for distributed massive MIMO systems where gradient calculations can become prohibitively expensive.


title: Sideband control of a multimode quantum bulk acoustic system

abstract: Multimode bulk acoustic systems show promise for use in superconducting quantum computation. They can serve as a medium term memory storage, with exceptional coherence times demonstrated, and they exhibit a mode density that is physically highly compact. Here we experimentally demonstrate accessing individual acoustic modes without being hindered by the uniform frequency spacing of the modes. We use sideband control where a low-frequency modulation is applied to the transmon qubit energy. The amplitude of the modulation defines the qubit-acoustic mode coupling, and its frequency detunes the acoustic sidebands, therefore enabling selectively switching on or off the interaction, and allows for a full control on the individual modes.