title: DeepGG: a Deep Graph Generator

abstract: Learning distributions of graphs can be used for automatic drug discovery, molecular design, complex network analysis, and much more. We present an improved framework for learning generative models of graphs based on the idea of deep state machines. To learn state transition decisions we use a set of graph and node embedding techniques as memory of the state machine. Our analysis is based on learning the distribution of random graph generators for which we provide statistical tests to determine which properties can be learned and how well the original distribution of graphs is represented. We show that the design of the state machine favors specific distributions. Models of graphs of size up to 150 vertices are learned. Code and parameters are publicly available to reproduce our results.


title: Sink-rise dynamics of horizontally oscillating active matter in granular media: Theory

abstract: An intermediate step to modelling behaviour of active matter is understanding interactions of active objects (AOs) with inanimate matter, which often lead to a range of rich behaviour. We present a range of simulations of the interaction of a self-energised AO with three-dimensional granular matter and develop a first-principles theoretical model to describe the observed phenomena. The AO oscillates horizontally, which causes it to either rise against gravity or sink, depending on the oscillation amplitude and frequency. We identify two competing mechanisms that drive the vertical motion. When the AO moves below a critical speed, $v_c$, it generates a jammed stagnant zone ahead of it, which effects an upward force and leads to the rise. Above $v_c$ and certain kinetic energy, the medium around the AO fluidises and the AO sinks into the layer supporting it. The duration of the rising and sinking phases depend non-trivially on the AO's amplitude and frequency leading to an intricate nonlinear dynamics. We derive the equation of motion for the time-dependent depth from first-principles and show that its solutions agree well with a wide range of computer simulations, which we perform within the range of parameters allowed by the finiteness of the simulated system.


title: An Empirical Meta-analysis of the Life Sciences (Linked?) Open Data on the Web

abstract: While the biomedical community has published several "open data" sources in the last decade, most researchers still endure severe logistical and technical challenges to discover, query, and integrate heterogeneous data and knowledge from multiple sources. To tackle these challenges, the community has experimented with Semantic Web and linked data technologies to create the Life Sciences Linked Open Data (LSLOD) cloud. In this paper, we extract schemas from more than 80 publicly available biomedical linked data graphs into an LSLOD schema graph and conduct an empirical meta-analysis to evaluate the extent of semantic heterogeneity across the LSLOD cloud. We observe that several LSLOD sources exist as stand-alone data sources that are not inter-linked with other sources, use unpublished schemas with minimal reuse or mappings, and have elements that are not useful for data integration from a biomedical perspective. We envision that the LSLOD schema graph and the findings from this research will aid researchers who wish to query and integrate data and knowledge from multiple biomedical sources simultaneously on the Web.


title: The q-voter model on the torus

abstract: In the $q$-voter model, the voter at $x$ changes its opinion at rate $f_x^q$, where $f_x$ is the fraction of neighbors with the opposite opinion. Mean-field calculations suggest that there should be coexistence between opinions if $q<1$ and clustering if $q>1$. This model has been extensively studied by physicists, but we do not know of any rigorous results. In this paper, we use the machinery of voter model perturbations to show that the conjectured behavior holds for $q$ close to 1. More precisely, we show that if $q<1$, then for any $m<\infty$ the process on the three-dimensional torus with $n$ points survives for time $n^m$, and after an initial transient phase has a density that it is always close to 1/2. If $q>1$, then the process rapidly reaches fixation on one opinion. It is interesting to note that in the second case the limiting ODE (on its sped up time scale) reaches 0 at time $\log n$ but the stochastic process on the same time scale dies out at time $(1/3)\log n$.


title: Generalized Spectral Clustering via Gromov-Wasserstein Learning

abstract: We establish a bridge between spectral clustering and Gromov-Wasserstein Learning (GWL), a recent optimal transport-based approach to graph partitioning. This connection both explains and improves upon the state-of-the-art performance of GWL. The Gromov-Wasserstein framework provides probabilistic correspondences between nodes of source and target graphs via a quadratic programming relaxation of the node matching problem. Our results utilize and connect the observations that the GW geometric structure remains valid for any rank-2 tensor, in particular the adjacency, distance, and various kernel matrices on graphs, and that the heat kernel outperforms the adjacency matrix in producing stable and informative node correspondences. Using the heat kernel in the GWL framework provides new multiscale graph comparisons without compromising theoretical guarantees, while immediately yielding improved empirical results. A key insight of the GWL framework toward graph partitioning was to compute GW correspondences from a source graph to a template graph with isolated, self-connected nodes. We show that when comparing against a two-node template graph using the heat kernel at the infinite time limit, the resulting partition agrees with the partition produced by the Fiedler vector. This in turn yields a new insight into the k-cut graph partitioning problem through the lens of optimal transport. Our experiments on a range of real-world networks achieve comparable results to, and in many cases outperform, the state-of-the-art achieved by GWL.


title: Single-Layer Graph Convolutional Networks For Recommendation

abstract: Graph Convolutional Networks (GCNs) and their variants have received significant attention and achieved start-of-the-art performances on various recommendation tasks. However, many existing GCN models tend to perform recursive aggregations among all related nodes, which arises severe computational burden. Moreover, they favor multi-layer architectures in conjunction with complicated modeling techniques. Though effective, the excessive amount of model parameters largely hinder their applications in real-world recommender systems. To this end, in this paper, we propose the single-layer GCN model which is able to achieve superior performance along with remarkably less complexity compared with existing models. Our main contribution is three-fold. First, we propose a principled similarity metric named distribution-aware similarity (DA similarity), which can guide the neighbor sampling process and evaluate the quality of the input graph explicitly. We also prove that DA similarity has a positive correlation with the final performance, through both theoretical analysis and empirical simulations. Second, we propose a simplified GCN architecture which employs a single GCN layer to aggregate information from the neighbors filtered by DA similarity and then generates the node representations. Moreover, the aggregation step is a parameter-free operation, such that it can be done in a pre-processing manner to further reduce red the training and inference costs. Third, we conduct extensive experiments on four datasets. The results verify that the proposed model outperforms existing GCN models considerably and yields up to a few orders of magnitude speedup in training, in terms of the recommendation performance.


title: Spectroscopic thickness and quality metrics for PtSe$_2$ layers produced by top-down and bottom-up techniques

abstract: Thin films of noble-metal-based transition metal dichalcogenides, such as PtSe$_2$, have attracted increasing attention due to their interesting layer-number dependent properties and application potential. While it is difficult to cleave bulk crystals down to mono- and few-layers, a range of growth techniques have been established producing material of varying quality and layer number. However, to date, no reliable high-throughput characterization to assess layer number exists. Here, we use top-down liquid phase exfoliation (LPE) coupled with centrifugation to produce widely basal plane defect-free PtSe$_2$ nanosheets of varying sizes and thicknesses. Quantification of the lateral dimensions by statistical atomic force microscopy allows us to quantitatively link information contained in optical spectra to the dimensions. For LPE nanosheets we establish metrics for lateral size and layer number based on extinction spectroscopy. Further, we compare the Raman spectroscopic response of LPE nanosheets with micromechanically exfoliated PtSe$_2$, as well as thin films produced by a range of bottom up techniques. We demonstrate that the Eg1 peak position and the intensity ratio of the Eg1/ A1g1 peaks can serve as robust metric for layer number across all sample types and will be of importance in future benchmarking of PtSe$_2$ films.


title: Learning Restricted Boltzmann Machines with Sparse Latent Variables

abstract: Restricted Boltzmann Machines (RBMs) are a common family of undirected graphical models with latent variables. An RBM is described by a bipartite graph, with all observed variables in one layer and all latent variables in the other. We consider the task of learning an RBM given samples generated according to it. The best algorithms for this task currently have time complexity $\tilde{O}(n^2)$ for ferromagnetic RBMs (i.e., with attractive potentials) but $\tilde{O}(n^d)$ for general RBMs, where $n$ is the number of observed variables and $d$ is the maximum degree of a latent variable. Let the MRF neighborhood of an observed variable be its neighborhood in the Markov Random Field of the marginal distribution of the observed variables. In this paper, we give an algorithm for learning general RBMs with time complexity $\tilde{O}(n^{2^s+1})$, where $s$ is the maximum number of latent variables connected to the MRF neighborhood of an observed variable. This is an improvement when $s < \log_2 (d-1)$, which corresponds to RBMs with sparse latent variables. Furthermore, we give a version of this learning algorithm that recovers a model with small prediction error and whose sample complexity is independent of the minimum potential in the Markov Random Field of the observed variables. This is of interest because the sample complexity of current algorithms scales with the inverse of the minimum potential, which cannot be controlled in terms of natural properties of the RBM.


title: A tetrachotomy of ontology-mediated queries with a covering axiom

abstract: Our concern is the problem of efficiently determining the data complexity of answering queries mediated by description logic ontologies and constructing their optimal rewritings to standard database queries. Originated in ontology-based data access and datalog optimisation, this problem is known to be computationally very complex in general, with no explicit syntactic characterisations available. In this article, aiming to understand the fundamental roots of this difficulty, we strip the problem to the bare bones and focus on Boolean conjunctive queries mediated by a simple covering axiom stating that one class is covered by the union of two other classes. We show that, on the one hand, these rudimentary ontology-mediated queries, called disjunctive sirups (or d-sirups), capture many features and difficulties of the general case. For example, answering d-sirups is Pi^p_2-complete for combined complexity and can be in AC0 or LogSpace-, NL-, P-, or coNP-complete for data complexity (with the problem of recognising FO-rewritability of d-sirups being 2ExpTime-hard); some d-sirups only have exponential-size resolution proofs, some only double-exponential-size positive existential FO-rewritings and single-exponential-size nonrecursive datalog rewritings. On the other hand, we prove a few partial sufficient and necessary conditions of FO- and (symmetric/linear-) datalog rewritability of d-sirups. Our main technical result is a complete and transparent syntactic AC0/NL/P/coNP tetrachotomy of d-sirups with disjoint covering classes and a path-shaped Boolean conjunctive query. To obtain this tetrachotomy, we develop new techniques for establishing P- and coNP-hardness of answering non-Horn ontology-mediated queries as well as showing that they can be answered in NL.


title: Resolution-dependent Subsonic Non-thermal Line Dispersion Revealed by ALMA

abstract: We report here Atacama Large Millimeter/submillimeter Array (ALMA) N$_2$H$^+$ (1-0) images of the Orion Molecular Cloud 2 and 3 (OMC-2/3) with high angular resolution (3'' or 1200 au) and high spatial dynamic range. Combining dataset from the ALMA main array, ALMA Compact Array (ACA), the Nobeyama 45m Telescope, and the JVLA (providing temperature measurement on matching scales), we find that most of the dense gas in OMC-2/3 is subsonic ($\rm \sigma_{NT}/c_{s}$ = 0.62) with a mean line width ($\Delta\upsilon$) of 0.39 km s$^{-1}$ FWHM. This is markedly different from the majority of previous observations of massive star-forming regions. In contrast, line widths from the Nobeyama Telescope are transonic at 0.69 km s$^{-1}$ ($\rm \sigma_{NT}/c_{s}$ = 1.08). We demonstrated that the larger line widths obtained by the single-dish telescope arose from unresolved sub-structures within their respective beams. The dispersions from larger scales $\sigma_{ls}$ (as traced by the Nobeyama Telescope) can be decomposed into three components $\rm \sigma_{ls}^2 = \sigma_{ss}^2+ \sigma_{bm}^2+ \sigma_{rd}^2$, where small-scale $\sigma_{ss}$ is the line dispersion of each ALMA beam, bulk motion $\sigma_{bm}$ is dispersion between peak velocity of each ALMA beam, and $\sigma_{rd}$ is the residual dispersion. Such decomposition, though purely empirical, appears to be robust throughout our data cubes. Apparent supersonic line widths, commonly found in massive molecular clouds, are thus likely due to the effect of poor spatial resolution. The observed non-thermal line dispersion (sometimes referred to as 'turbulence') transits from supersonic to subsonic at $\sim 0.05$ pc scales in OMC-2/3 region. Such transition could be commonly found with sufficient spatial (not just angular) resolution, even in regions with massive young clusters, such as Orion molecular clouds studied here.


title: A sharp Clifford-wavelet Heisenberg-type uncertainty principle

abstract: In the present work we are concerned with the development of a new uncertainty principle based on wavelet transform in the Clifford analysis/algebras framework. We precisely derive a sharp Heisenberg-type uncertainty principle for the continuous Clifford wavelet transform.


title: Realistic text replacement with non-uniform style conditioning

abstract: In this work, we study the possibility of realistic text replacement, the goal of which is to replace text present in the image with user-supplied text. The replacement should be performed in a way that will not allow distinguishing the resulting image from the original one. We achieve this goal by developing a novel non-uniform style conditioning layer and apply it to an encoder-decoder ResNet based architecture. The resulting model is a single-stage model, with no post-processing. The proposed model achieves realistic text replacement and outperforms existing approaches on ICDAR MLT.


title: Learning pose variations within shape population by constrained mixtures of factor analyzers

abstract: Mining and learning the shape variability of underlying population has benefited the applications including parametric shape modeling, 3D animation, and image segmentation. The current statistical shape modeling method works well on learning unstructured shape variations without obvious pose changes (relative rotations of the body parts). Studying the pose variations within a shape population involves segmenting the shapes into different articulated parts and learning the transformations of the segmented parts. This paper formulates the pose learning problem as mixtures of factor analyzers. The segmentation is obtained by components posterior probabilities and the rotations in pose variations are learned by the factor loading matrices. To guarantee that the factor loading matrices are composed by rotation matrices, constraints are imposed and the corresponding closed form optimal solution is derived. Based on the proposed method, the pose variations are automatically learned from the given shape populations. The method is applied in motion animation where new poses are generated by interpolating the existing poses in the training set. The obtained results are smooth and realistic.


title: Semi-infinite Pl\"ucker relations and arcs over toric degeneration

abstract: We study the algebra of Weyl modules in types $A$ and $C$ using the methods of arcs over toric degenerations and functional realization of dual space. We compute the generators and relations of this algebra and construct its basis.


title: An Automated Generation of Bootstrap Equations for Numerical Study of Critical Phenomena

abstract: In this thesis, we introduce new tools for the conformal bootstrap, autoboot and qboot. Each tool solves a different step in the whole computational stack, and combined with an existing efficient tool SDPB which solves semidefinite programming (SDP), our tools make it easier to study conformal field theories with more complicated global symmetries and with more general spectra. In the introduction, we review how the conformal bootstrap method gives rich information about the theory at the fixed point of renormalization group, or in other words, the critical phenomena such as the Ising model at criticality. The following three sections focus on the theories behind the implementation of autoboot and qboot, and the explicit implementation, freely available at https://github.com/selpoG/autoboot/ and https://github.com/selpoG/qboot/, is discussed in section 5. We also have two applications in the last section, the Ising model and the O(2) vector model in three dimensions, each of them has close relationship with a physical system in the real world.


title: Reconstructing Haemodynamics Quantities of Interest from Doppler Ultrasound Imaging

abstract: The present contribution deals with the estimation of haemodynamics Quantities of Interest by exploiting Ultrasound Doppler measurements. A fast method is proposed, based on the PBDW method. Several methodological contributions are described: a sub-manifold partitioning is introduced to improve the reduced-order approximation, two different ways to estimate the pressure drop are compared, and an error estimation is derived. A test-case on a realistic common carotid geometry is presented, showing that the proposed approach is promising in view of realistic applications.


title: Effects of Thermal Emission on the Transmission Spectra of Hot Jupiters

abstract: The atmosphere on the dayside of a highly irradiated close-in gas giant (also known as a hot Jupiter) absorbs a significant part of the incident stellar radiation which again gets re-emitted in the infrared wavelengths both from the day and the night sides of the planet. The re-emitted thermal radiation from the night side facing the observers during the transit event of such a planet contributes to the transmitted stellar radiation. We demonstrate that the transit spectra at the infrared region get altered significantly when such re-emitted thermal radiation of the planet is included. We assess the effects of the thermal emission of the hot Jupiters on the transit spectra by simulating observational spectroscopic data with corresponding errors from the different channels of the upcoming James Webb Space Telescope. We find that the effect is statistically significant with respect to the noise levels of those simulated data. Hence, we convey the important message that the planetary thermal re-emission must be taken into consideration in the retrieval models of transit spectra for hot Jupiters for a more accurate interpretation of the observed transit spectra.


title: Deep active inference agents using Monte-Carlo methods

abstract: Active inference is a Bayesian framework for understanding biological intelligence. The underlying theory brings together perception and action under one single imperative: minimizing free energy. However, despite its theoretical utility in explaining intelligence, computational implementations have been restricted to low-dimensional and idealized situations. In this paper, we present a neural architecture for building deep active inference agents operating in complex, continuous state-spaces using multiple forms of Monte-Carlo (MC) sampling. For this, we introduce a number of techniques, novel to active inference. These include: i) selecting free-energy-optimal policies via MC tree search, ii) approximating this optimal policy distribution via a feed-forward `habitual' network, iii) predicting future parameter belief updates using MC dropouts and, finally, iv) optimizing state transition precision (a high-end form of attention). Our approach enables agents to learn environmental dynamics efficiently, while maintaining task performance, in relation to reward-based counterparts. We illustrate this in a new toy environment, based on the dSprites data-set, and demonstrate that active inference agents automatically create disentangled representations that are apt for modeling state transitions. In a more complex Animal-AI environment, our agents (using the same neural architecture) are able to simulate future state transitions and actions (i.e., plan), to evince reward-directed navigation - despite temporary suspension of visual input. These results show that deep active inference - equipped with MC methods - provides a flexible framework to develop biologically-inspired intelligent agents, with applications in both machine learning and cognitive science.


title: Sumsets of Wythoff Sequences, Fibonacci Representation, and Beyond

abstract: Let $\alpha = (1+\sqrt{5})/2$ and define the lower and upper Wythoff sequences by $a_i = \lfloor i \alpha \rfloor$, $b_i = \lfloor i \alpha^2 \rfloor$ for $i \geq 1$. In a recent interesting paper, Kawsumarng et al. proved a number of results about numbers representable as sums of the form $a_i + a_j$, $b_i + b_j$, $a_i + b_j$, and so forth. In this paper I show how to derive all of their results, using one simple idea and existing free software called Walnut. The key idea is that for each of their sumsets, there is a relatively small automaton accepting the Fibonacci representation of the numbers represented. I also show how the automaton approach can easily prove other results.


title: Neural Vortex Method: from Finite Lagrangian Particles to Infinite Dimensional Eulerian Dynamics

abstract: In the field of fluid numerical analysis, there has been a long-standing problem: lacking of a rigorous mathematical tool to map from a continuous flow field to discrete vortex particles, hurdling the Lagrangian particles from inheriting the high resolution of a large-scale Eulerian solver. To tackle this challenge, we propose a novel learning-based framework, the Neural Vortex Method (NVM), which builds a neural-network description of the Lagrangian vortex structures and their interaction dynamics to reconstruct the high-resolution Eulerian flow field in a physically-precise manner. The key components of our infrastructure consist of two networks: a vortex representation network to identify the Lagrangian vortices from a grid-based velocity field and a vortex interaction network to learn the underlying governing dynamics of these finite structures. By embedding these two networks with a vorticity-to-velocity Poisson solver and training its parameters using the high-fidelity data obtained from high-resolution direct numerical simulation, we can predict the accurate fluid dynamics on a precision level that was infeasible for all the previous conventional vortex methods (CVMs). To the best of our knowledge, our method is the first approach that can utilize motions of finite particles to learn infinite dimensional dynamic systems. We demonstrate the efficacy of our method in generating highly accurate prediction results, with low computational cost, of the leapfrogging vortex rings system, the turbulence system, and the systems governed by Euler equations with different external forces.


title: Dense Stable Rank and Runge Type Approximation Theorems for $\mathbf{H^\infty}$ Maps

abstract: Let $H^\infty(\mathbb D\times\N)$ be the Banach algebra of bounded holomorphic functions defined on the disjoint union of countably many copies of the open unit disk $\mathbb D\subset\mathbb C$. We show that the dense stable rank of $H^\infty(\mathbb D\times\N)$ is one and using this fact prove some nonlinear Runge-type approximation theorems for $H^\infty(\mathbb D\times\N)$ maps. Then we apply these results to obtain a priori uniform estimates of norms of approximating maps in similar approximation problems for algebra $H^\infty(\mathbb D)$.


title: RoeNets: Predicting Discontinuity of Hyperbolic Systems from Continuous Data

abstract: We introduce Roe Neural Networks (RoeNets) that can predict the discontinuity of the hyperbolic conservation laws (HCLs) based on short-term discontinuous and even continuous training data. Our methodology is inspired by Roe approximate Riemann solver (P. L. Roe, J. Comput. Phys., vol. 43, 1981, pp. 357--372), which is one of the most fundamental HCLs numerical solvers. In order to accurately solve the HCLs, Roe argues the need to construct a Roe matrix that fulfills "Property U", including diagonalizable with real eigenvalues, consistent with the exact Jacobian, and preserving conserved quantities. However, the construction of such matrix cannot be achieved by any general numerical method. Our model made a breakthrough improvement in solving the HCLs by applying Roe solver under a neural network perspective. To enhance the expressiveness of our model, we incorporate pseudoinverses into a novel context to enable a hidden dimension so that we are flexible with the number of parameters. The ability of our model to predict long-term discontinuity from a short window of continuous training data is in general considered impossible using traditional machine learning approaches. We demonstrate that our model can generate highly accurate predictions of evolution of convection without dissipation and the discontinuity of hyperbolic systems from smooth training data.


title: In Search of Newer Targets for IBD: A Systems and a Network Medicine Approach

abstract: Introduction: Crohn's disease and ulcerative colitis, both under the umbrella of inflammatory bowel diseases (IBD), involve many distinct molecular processes. The difference in their molecular processes is studied by using the different genes involved in each disease, and it is explored further for drug targeting and drug repurposing. Methods: The initial set of genes was obtained by mining published literature and several curated databases. The identified genes were then subject to Systems and Network analysis to reveal their molecular processes and shed some light on their pathogenesis. Such methodologies have identified newer targets and drugs that can be repurposed. Results: We use a Systems and Network Medicine approach to understand the mechanism of actions of genes involved in IBD. From an initial set of genes mined from literature and curated databases, we used the Multi-Steiner Tree algorithm implemented within the CoVex systems medicine platform to expand each disease module by incorporating candidate genes with significant connections to the disease-related seed genes. Such expanded disease modules will identify a larger set of potential targets and drugs. We used the Closeness Centrality algorithm implemented within CoVex to search for newer targets and repurposable drugs. Through a network medicine approach, we provide a mechanistic view of the diseases and point to newer drugs and targets. Conclusion: We demonstrate that the Systems and Network Medicine approach is a powerful way to understand diseases and understand their mechanisms of action.


title: Predictive Coding Approximates Backprop along Arbitrary Computation Graphs

abstract: Backpropagation of error (backprop) is a powerful algorithm for training machine learning architectures through end-to-end differentiation. However, backprop is often criticised for lacking biological plausibility. Recently, it has been shown that backprop in multilayer-perceptrons (MLPs) can be approximated using predictive coding, a biologically-plausible process theory of cortical computation which relies only on local and Hebbian updates. The power of backprop, however, lies not in its instantiation in MLPs, but rather in the concept of automatic differentiation which allows for the optimisation of any differentiable program expressed as a computation graph. Here, we demonstrate that predictive coding converges asymptotically (and in practice rapidly) to exact backprop gradients on arbitrary computation graphs using only local learning rules. We apply this result to develop a straightforward strategy to translate core machine learning architectures into their predictive coding equivalents. We construct predictive coding CNNs, RNNs, and the more complex LSTMs, which include a non-layer-like branching internal graph structure and multiplicative interactions. Our models perform equivalently to backprop on challenging machine learning benchmarks, while utilising only local and (mostly) Hebbian plasticity. Our method raises the potential that standard machine learning algorithms could in principle be directly implemented in neural circuitry, and may also contribute to the development of completely distributed neuromorphic architectures.


title: Uncertainty-Aware Deep Classifiers using Generative Models

abstract: Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high uncertainty for the data samples close to class boundaries or from the outside of the training distribution. These approaches use an auxiliary data set during training to represent out-of-distribution samples. However, selection or creation of such an auxiliary data set is non-trivial, especially for high dimensional data such as images. In this work we develop a novel neural network model that is able to express both aleatoric and epistemic uncertainty to distinguish decision boundary and out-of-distribution regions of the feature space. To this end, variational autoencoders and generative adversarial networks are incorporated to automatically generate out-of-distribution exemplars for training. Through extensive analysis, we demonstrate that the proposed approach provides better estimates of uncertainty for in- and out-of-distribution samples, and adversarial examples on well-known data sets against state-of-the-art approaches including recent Bayesian approaches for neural networks and anomaly detection methods.


title: Quiet Sun electron densities and their uncertainties derived from spectral emission line intensities

abstract: The goal of this paper is to apply statistical methods to determine electrons densities and their errors from measurements of density-sensitive line intensities in the quiet Sun. Three methods are employed. The first is the use of L-function plots to provide a quick visual assessment of the likelihood that a set of line intensities can provide a robust estimate of these quantities. A second methods involves a chi-squared minimization together with a prescription for determining the regions of statistical confidence in addition to the best-fitting value. A third method uses a Bayesian inference technique that employs a Monte-Carlo Markov-chain (MCMC) calculation from which an analysis of the posterior distributions provide estimates of the mean and regions of high probability density. Using these three methods, observations of extreme-ultraviolet spectral lines originating from regions of the quiet Sun have been analyzed. The quantitative chi-squared minimization and MCMC sampling provide results that are generally in good agreement, especially for sets of lines of ions that have L-function plots that suggest that a robust analysis might be possible.


title: Thermodynamic and Transport Properties of Matter Formed in $pp$, $p$-Pb, Xe-Xe and Pb-Pb Collisions at the Large Hadron Collider using Color String Percolation Model

abstract: To have a better understanding of the matter formed in ultra-relativistic collisions, using the Color String Percolation Model (CSPM), we have estimated initial energy density, mean free path, squared speed of sound, shear viscosity to entropy density ratio ($\eta/s$), bulk viscosity to entropy density ratio and bulk modulus for $pp$, $p$-Pb, Xe-Xe and Pb-Pb collisions at the Large Hadron Collider (LHC). These observables are studied as a function of final state charged particle multiplicity density and initial state percolation temperature. The results from this work are compared with the results from well known QCD models and with the transport properties of matter found in day-to-day life. These observables allow us to conclude an array of important findings about the matter formed in high energy collisions at the LHC. This work gives a threshold of charged particle multiplicity $\langle dN_{ch}/d\eta \rangle \simeq$ 20, after which there are indications of change in the dynamics of the systems. The critical initial energy density and temperature as estimated by lattice QCD, are observed to be achieved for events with final state multiplicity $\langle dN_{ch}/d\eta \rangle \geq$ 20. In addition, for these high-multiplicity events, the estimated $\eta/s$ are comparable with that is observed for heavy-ion collisions, which is an indication of a strongly coupled Quark Gluon Plasma. This makes LHC high-multiplicity $pp$ collision events as probable candidates for the search of QGP droplets.


title: The Farey map exploited in wavelet analysis -- Construction of an associated Farey mother wavelet

abstract: In the present work the well known Farey map is exploited to consruct a new mother wavelet. Properties such as admissibility, moments, 2-scale relation and reconstruction rule have been established. The constructed mother may be a good candidate to analyze hyperbolic problems such as hyperbolic PDEs.


title: Infinite products related to generalized Thue-Morse sequences

abstract: Given an integer $q\ge2$ and $\theta_1,\cdots,\theta_{q-1}\in\{0,1\}$, let $(\theta_n)_{n\ge0}$ be the generalized Thue-Morse sequence, defined to be the unique fixed point of the morphism $$0\mapsto0\theta_1\cdots\theta_{q-1}$$ $$1\mapsto1\overline{\theta}_1\cdots\overline{\theta}_{q-1}$$ beginning with $\theta_0:=0$, where $\overline{0}:=1$ and $\overline{1}:=0$. For rational functions $R$, we study infinite products of the forms $$\prod_{n=1}^\infty\Big(R(n)\Big)^{(-1)^{\theta_n}}\quad\text{and}\quad\prod_{n=1}^\infty\Big(R(n)\Big)^{\theta_n}.$$ This generalizes relevant results given by Allouche, Riasat and Shallit in 2019 on infinite products related to the famous Thue-Morse sequence $(t_n)_{n\ge0}$ of the forms $$\prod_{n=1}^\infty\Big(R(n)\Big)^{(-1)^{t_n}}\quad\text{and}\quad\prod_{n=1}^\infty\Big(R(n)\Big)^{t_n}.$$


title: Principal points and elliptical distributions from the multivariate setting to the functional case

abstract: The $k$ principal points of a random vector $\mathbf{X}$ are defined as a set of points which minimize the expected squared distance between $\mathbf{X}$ and the nearest point in the set. They are thoroughly studied in Flury (1990, 1993), Tarpey (1995) and Tarpey, Li and Flury (1995). For their treatment, the examination is usually restricted to the family of elliptical distributions. In this paper, we present an extension of the previous results to the functional elliptical distribution case, i.e., when dealing with random elements over a separable Hilbert space ${\cal H}$. Principal points for gaussian processes were defined in Tarpey and Kinateder (2003). In this paper, we generalize the concepts of principal points, self-consistent points and elliptical distributions so as to fit them in this functional framework. Results linking self-consistency and the eigenvectors of the covariance operator are re-obtained in this new setting as well as an explicit formula for the $k=2$ case so as to include elliptically distributed random elements in ${\cal H}$.


title: A local compactification of the Bridgeland stability manifold

abstract: Bridgeland stability manifolds of Calabi-Yau categories are of noticeable interest both in mathematics and in physics. By looking at some of the known example, a pattern clearly emerges and gives a fairly precise description of how they look like. In particular, they all seem to have missing loci, which tend to correspond to degenerate stability conditions vanishing on spherical objects. Describing such missing strata is also interesting from a mirror-symmetric perspective, as they conjecturally parametrize interesting types of degenerations of complex structures. All the naive attempts at constructing modular partial compactifications show how elusive and subtle the problem in fact is: ideally, the missing strata would correspond to stability manifolds of quotient triangulated categories, but establishing such correspondence on geometric level and viewing stability conditions on quotients of the original triangulated category as suitable degenerations of stability conditions is not straightforward. In this paper, we will present a method to construct such partial compactifications if some additional hypoteses are satisfied, by realizing our space of interest as a suitable metric completion of the stability manifold.


title: Sublattice symmetry breaking and ultra low energy excitations in Graphene-on-hBN Heterostructures

abstract: The low-lying states of graphene contain exciting topological properties that depend on the interplay of different symmetry breaking terms. The corresponding energy gaps remained unexplored until recently, owing to the low energy scale of the terms involved (few tens of ueV). These low energy terms include sublattice splitting, the Rashba and the intrinsic spin-orbit coupling, whose balance determines the topological properties. In this work, we unravel the contributions arising from the sublattice and the intrinsic spin orbit splitting in graphene on hexagonal boron-nitride. Employing resistively-detected electron spin resonance, we measure a sublattice splitting of the order of 20E-6 eV, and confirm an intrinsic spin orbit coupling of approximately 45E-6 eV. The dominance of the latter suggests a topologically non-trivial state, involving fascinating properties. Electron spin resonance is a promising route towards unveiling the intriguing band structure at low energy scales.


title: Toric double determinantal varieties

abstract: We examine Li's double determinantal varieties in the special case that they are toric. We recover from the general double determinantal varieties case, via a more elementary argument, that they are irreducible and show that toric double determinantal varieties are smooth. We use this framework to give a straighforward formula for their dimension. Finally, we use the smallest nontrivial toric double determinantal variety to provide some empirical evidence concerning an open problem in local algebra.


title: Magnetocrystalline anisotropy of the easy-plane metallic antiferromagnet Fe$_2$As

abstract: Magnetocrystalline anisotropy is a fundamental property of magnetic materials that determines the dynamics of magnetic precession, the frequency of spin waves, the thermal stability of magnetic domains, and the efficiency of spintronic devices. We combine torque magnetometry and density functional theory calculations to determine the magnetocrystalline anisotropy of the metallic antiferromagnet Fe$_2$As. Fe$_2$As has a tetragonal crystal structure with the N\'eel vector lying in the (001) plane. We report that the four-fold magnetocrystalline anisotropy in the (001)-plane of Fe$_2$As is extremely small, ${K_{22}} = - 150~{\rm{ J/}}{{\rm{m}}^{\rm{3}}}$ at T = 4 K, much smaller than perpendicular magnetic anisotropy of ferromagnetic structure widely used in spintronics device. ${K_{22}}$ is strongly temperature dependent and close to zero at T > 150 K. The anisotropy ${K_1}$ in the (010) plane is too large to be measured by torque magnetometry and we determine ${K_1} = -830~{\rm{ kJ/}}{{\rm{m}}^{\rm{3}}}$ using first-principles density functional theory. Our simulations show that the contribution to the anisotropy from classical magnetic dipole-dipole interactions is comparable to the contribution from spin-orbit coupling. The calculated four-fold anisotropy in the (001) plane ${K_{22}}$ ranges from $- 292~{\rm{ J/}}{{\rm{m}}^{\rm{3}}}$ to $280~{\rm{ J/}}{{\rm{m}}^{\rm{3}}}$, the same order of magnitude as the measured value. We use ${K_1}$ from theory to predict the frequency and polarization of the lowest frequency antiferromagnetic resonance mode and find that the mode is linearly polarized in the (001)-plane with $f = $ 670 GHz.


title: Finger Texture Biometric Characteristic: a Survey

abstract: \begin{abstract} In recent years, the Finger Texture (FT) has attracted considerable attention as a biometric characteristic. It can provide efficient human recognition performance, because it has different human-specific features of apparent lines, wrinkles and ridges distributed along the inner surface of all fingers. Also, such pattern structures are reliable, unique and remain stable throughout a human's life. Efficient biometric systems can be established based only on FTs. In this paper, a comprehensive survey of the relevant FT studies is presented. We also summarise the main drawbacks and obstacles of employing the FT as a biometric characteristic, and provide useful suggestions to further improve the work on FT. \end{abstract}


title: Robotic Motion Planning using Learned Critical Sources and Local Sampling

abstract: Sampling based methods are widely used for robotic motion planning. Traditionally, these samples are drawn from probabilistic ( or deterministic ) distributions to cover the state space uniformly. Despite being probabilistically complete, they fail to find a feasible path in a reasonable amount of time in constrained environments where it is essential to go through narrow passages (bottleneck regions). Current state of the art techniques train a learning model (learner) to predict samples selectively on these bottleneck regions. However, these algorithms depend completely on samples generated by this learner to navigate through the bottleneck regions. As the complexity of the planning problem increases, the amount of data and time required to make this learner robust to fine variations in the structure of the workspace becomes computationally intractable. In this work, we present (1) an efficient and robust method to use a learner to locate the bottleneck regions and (2) two algorithms that use local sampling methods to leverage the location of these bottleneck regions for efficient motion planning while maintaining probabilistic completeness. We test our algorithms on 2 dimensional planning problems and 7 dimensional robotic arm planning, and report significant gains over heuristics as well as learned baselines.


title: On locally homogeneous pseudo-Riemannian compact einstein manifolds

abstract: We ask a general question: what are locally homogeneous compact pseudo-Riemannian Einstein manifolds? We show that any standard compact Clifford-Klein form of a simple non-compact Lie group admits at least one Einstein metric. We conjecture that these are basically the only possible locally homogeneous Einstein pseudo-Riemannian compact manifolds using T. Kobayashi's conjecture as a guiding principle.


title: On the self-replicating properties of Riemann zeta zeros: A statistical study

abstract: We study distributions of differences of unscaled Riemann zeta zeros, $\gamma-\gamma^{'}$, at large distances. We show, that independently of the height, a subset of finite number of successive zeros knows the locations of lower level zeros. The information contained in the subset of zeros is inversely proportional to $ln(\gamma/(2\pi))$, where $\gamma$ is the average zeta of the subset. Because the mean difference of the zeros also decreases as inversely proportional to $ln(\gamma/(2\pi))$, each equally long segment of the line $\Re(z)=1/2$ contains equal amount of information. The distributions of differences are skewed towards the nearest zeta zero, or at least, in the case of very nearby zeros, the skewness always decreases when zeta zero is crossed in increasing direction. We also show that the variance of distributions has local maximum or, at least, a turning point at every zeta zero, i.e., local minimum of the second derivative of the variance. In addition, it seems that the higher the zeros the more compactly the distributions of the differences are located in the skewness-kurtosis -plane. The flexibility of the Johnson distribution allows us to fit the distributions nicely, despite of the values of skewness and kurtosis of the distributions.


title: Surgery and Excision for Furuta-Ohta invariants on Homology $S^1 \times S^3$

abstract: We prove a surgery formula and an excision formula for the Furuta-Ohta invariant $\lambda_{FO}$ defined on homology $S^1 \times S^3$, which provides more evidence on its equivalence with the Casson-Seiberg-Witten invariant $\lambda_{SW}$. These formulae are applied to compute $\lambda_{FO}$ of certain families of manifolds obtained as mapping tori under diffeomorphisms of $3$-manifolds. In the course of the proof, we give a complete description of the degree-zero moduli space of ASD instantons on $4$-manifolds of homology $H_*(D^2 \times T^2; \mathbb{Z})$ with a cylindrical end modeled on $[0, \infty) \times T^3$.


title: EnK: Encoding time-information in convolution

abstract: Recent development in deep learning techniques has attracted attention in decoding and classification in EEG signals. Despite several efforts utilizing different features of EEG signals, a significant research challenge is to use time-dependent features in combination with local and global features. There have been several efforts to remodel the deep learning convolution neural networks (CNNs) to capture time-dependency information by incorporating hand-crafted features, slicing the input data in a smaller time-windows, and recurrent convolution. However, these approaches partially solve the problem, but simultaneously hinder the CNN's capability to learn from unknown information that might be present in the data. To solve this, we have proposed a novel time encoding kernel (EnK) approach, which introduces the increasing time information during convolution operation in CNN. The encoded information by EnK lets CNN learn time-dependent features in-addition to local and global features. We performed extensive experiments on several EEG datasets: cognitive conflict (CC), physical-human robot collaboration (pHRC), P300 visual-evoked potentials, movement-related cortical potentials (MRCP). EnK outperforms the state-of-art by 12\% (F1 score). Moreover, the EnK approach required only one additional parameter to learn and can be applied to a virtually any CNN architectures with minimal efforts. These results support our methodology and show high potential to improve CNN performance in the context of time-series data in general.


title: Learning Illumination Patterns for Coded Diffraction Phase Retrieval

abstract: Signal recovery from nonlinear measurements involves solving an iterative optimization problem. In this paper, we present a framework to optimize the sensing parameters to improve the quality of the signal recovered by the given iterative method. In particular, we learn illumination patterns to recover signals from coded diffraction patterns using a fixed-cost alternating minimization-based phase retrieval method. Coded diffraction phase retrieval is a physically realistic system in which the signal is first modulated by a sequence of codes before the sensor records its Fourier amplitude. We represent the phase retrieval method as an unrolled network with a fixed number of layers and minimize the recovery error by optimizing over the measurement parameters. Since the number of iterations/layers are fixed, the recovery incurs a fixed cost. We present extensive simulation results on a variety of datasets under different conditions and a comparison with existing methods. Our results demonstrate that the proposed method provides near-perfect reconstruction using patterns learned with a small number of training images. Our proposed method provides significant improvements over existing methods both in terms of accuracy and speed.


title: A Review of Incident Prediction, Resource Allocation, and Dispatch Models for Emergency Management

abstract: In the last fifty years, researchers have developed statistical, data-driven, analytical, and algorithmic approaches for designing and improving emergency response management (ERM) systems. The problem has been noted as inherently difficult and constitutes spatio-temporal decision making under uncertainty, which has been addressed in the literature with varying assumptions and approaches. This survey provides a detailed review of these approaches, focusing on the key challenges and issues regarding four sub-processes: (a) incident prediction, (b) incident detection, (c) resource allocation, and (c) computer-aided dispatch for emergency response. We highlight the strengths and weaknesses of prior work in this domain and explore the similarities and differences between different modeling paradigms. We conclude by illustrating open challenges and opportunities for future research in this complex domain.


title: Learning Behaviors with Uncertain Human Feedback

abstract: Human feedback is widely used to train agents in many domains. However, previous works rarely consider the uncertainty when humans provide feedback, especially in cases that the optimal actions are not obvious to the trainers. For example, the reward of a sub-optimal action can be stochastic and sometimes exceeds that of the optimal action, which is common in games or real-world. Trainers are likely to provide positive feedback to sub-optimal actions, negative feedback to the optimal actions and even do not provide feedback in some confusing situations. Existing works, which utilize the Expectation Maximization (EM) algorithm and treat the feedback model as hidden parameters, do not consider uncertainties in the learning environment and human feedback. To address this challenge, we introduce a novel feedback model that considers the uncertainty of human feedback. However, this incurs intractable calculus in the EM algorithm. To this end, we propose a novel approximate EM algorithm, in which we approximate the expectation step with the Gradient Descent method. Experimental results in both synthetic scenarios and two real-world scenarios with human participants demonstrate the superior performance of our proposed approach.


title: Probabilistic Timed Automata with One Clock and Initialised Clock-Dependent Probabilities

abstract: Clock-dependent probabilistic timed automata extend classical timed automata with discrete probabilistic choice, where the probabilities are allowed to depend on the exact values of the clocks. Previous work has shown that the quantitative reachability problem for clock-dependent probabilistic timed automata with at least three clocks is undecidable. In this paper, we consider the subclass of clock-dependent probabilistic timed automata that have one clock, that have clock dependencies described by affine functions, and that satisfy an initialisation condition requiring that, at some point between taking edges with non-trivial clock dependencies, the clock must have an integer value. We present an approach for solving in polynomial time quantitative and qualitative reachability problems of such one-clock initialised clock-dependent probabilistic timed automata. Our results are obtained by a transformation to interval Markov decision processes.


title: Thoracic Disease Identification and Localization using Distance Learning and Region Verification

abstract: The identification and localization of diseases in medical images using deep learning models have recently attracted significant interest. Existing methods only consider training the networks with each image independently and most leverage an activation map for disease localization. In this paper, we propose an alternative approach that learns discriminative features among triplets of images and cyclically trains on region features to verify whether attentive regions contain information indicative of a disease. Concretely, we adapt a distance learning framework for multi-label disease classification to differentiate subtle disease features. Additionally, we feed back the features of the predicted class-specific regions to a separate classifier during training to better verify the localized diseases. Our model can achieve state-of-the-art classification performance on the challenging ChestX-ray14 dataset, and our ablation studies indicate that both distance learning and region verification contribute to overall classification performance. Moreover, the distance learning and region verification modules can capture essential information for better localization than baseline models without these modules.


title: Nielsen-Ninomiya Theorem with Bulk Topology: Duality in Floquet and Non-Hermitian Systems

abstract: The Nielsen-Ninomiya theorem is a fundamental theorem on the realization of chiral fermions in static lattice systems in high-energy and condensed matter physics. Here we extend the theorem in dynamical systems, which include the original Nielsen-Ninomiya theorem in the static limit. In contrast to the original theorem, which is a no-go theorem for bulk chiral fermions, the new theorem permits them due to bulk topology intrinsic to dynamical systems. The theorem is based on duality enabling a unified treatment of periodically driven systems and non-Hermitian ones. We also present the extended theorem for non-chiral gapless fermions protected by symmetry. Finally, as an application of our theorem and duality, we predict a new type of chiral magnetic effect -- the non-Hermitian chiral magnetic skin effect.

categories: cond-mat.mes-hall hep-lat math-ph math.MP physics.optics quant-ph


title: Machine learning dynamics of phase separation in correlated electron magnets

abstract: We demonstrate machine-learning enabled large-scale dynamical simulations of electronic phase separation in double-exchange system. This model, also known as the ferromagnetic Kondo lattice model, is believed to be relevant for the colossal magnetoresistance phenomenon. Real-space simulations of such inhomogeneous states with exchange forces computed from the electron Hamiltonian can be prohibitively expensive for large systems. Here we show that linear-scaling exchange field computation can be achieved using neural networks trained by datasets from exact calculation on small lattices. Our Landau-Lifshitz dynamics simulations based on machine-learning potentials nicely reproduce not only the nonequilibrium relaxation process, but also correlation functions that agree quantitatively with exact simulations. Our work paves the way for large-scale dynamical simulations of correlated electron systems using machine-learning models.

categories: cond-mat.str-el cond-mat.dis-nn cond-mat.mes-hall cs.LG


title: Far From Equilibrium Hydrodynamics and the Beam Energy Scan

abstract: The existence of hydrodynamic attractors in rapidly expanding relativistic systems has shed light on the success of relativistic hydrodynamics in describing heavy-ion collisions at zero chemical potential. As the search for the QCD critical point continues, it is important to investigate how out of equilibrium effects influence the trajectories on the QCD phase diagram. In this proceedings, we study a Bjorken expanding hydrodynamic system based on DMNR equations of motion with initial out of equilibrium effects and finite chemical potential in a system with a critical point. We find that the initial conditions are not unique for a specific freeze-out point, but rather the system can evolve to the same final state freeze-out point with a wide range of initial baryon chemical potential, $\mu_B$. For the same initial energy density and baryon density, depending on how far out of equilibrium the system begins, the initial $\mu_B$ can vary by $\Delta \mu_B\sim 350$ MeV. Our results indicate that knowledge of the out-of-equilibrium effects in the initial state provide vital information that influences the search for the QCD critical point.


title: On static and hydrodynamic biaxial nematic liquid crystals

abstract: In the first part of this paper, we will consider minimizing configurations of the Oseen-Frank energy functional $E(n, m)$ for a biaxial nematics $(n, m):\Omega\to \mathbb S^2\times \mathbb S^2$ with $n\cdot m=0$ in dimension three, and establish that it is smooth off a closed set of $1$-dimension Hausdorff measure zero. In the second part, we will consider a simplified Ericksen-Leslie system for biaxial nematics $(n, m)$ in a two dimensional domain and establish the existence of a unique global weak solution $(u, n, m)$ that is smooth off at most finitely many singular times for any initial and boundary data of finite energy. They extend to biaxial nematics of earlier results corresponding to minimizing uniaxial nematics by Hardt-Kindelerherer-Lin \cite{HKL} and a simplified hydrodynamics of uniaxial liquid crystal by Lin-Lin-Wang \cite{LLW10} respectively.


title: Extensions and limitations of randomized smoothing for robustness guarantees

abstract: Randomized smoothing, a method to certify a classifier's decision on an input is invariant under adversarial noise, offers attractive advantages over other certification methods. It operates in a black-box and so certification is not constrained by the size of the classifier's architecture. Here, we extend the work of Li et al. \cite{li2018second}, studying how the choice of divergence between smoothing measures affects the final robustness guarantee, and how the choice of smoothing measure itself can lead to guarantees in differing threat models. To this end, we develop a method to certify robustness against any $\ell_p$ ($p\in\mathbb{N}_{>0}$) minimized adversarial perturbation. We then demonstrate a negative result, that randomized smoothing suffers from the curse of dimensionality; as $p$ increases, the effective radius around an input one can certify vanishes.


title: Ricci-inverse gravity: a novel alternative gravity, its flaws, and how to cure them

abstract: We introduce a novel theory of gravity based on the inverse of the Ricci tensor, that we call the anticurvature tensor. We derive the general equations of motion for any Lagrangian function of the curvature and anticurvature scalars. We then demonstrate a no-go theorem: no Lagrangian that contains terms linear in any positive or negative power of the anticurvature scalar can drive an evolution from deceleration to acceleration, as required by observations. This effectively rules out many realizations of this theory, as we illustrate in detail in a particular case. Finally, we speculate on how to circumvent the no-go theorem.


title: Weak compactness of simplified nematic liquid flows in 2D

abstract: For any bounded, smooth domain $\Omega\subset \R^2$, %(or $\Omega=\R^2$), we will establish the weak compactness property of solutions to the simplified Ericksen-Leslie system for both uniaxial and biaxial nematics, and the convergence of weak solutions of the Ginzburg-Landau type nematic liquid crystal flow to a weak solution of the simplified Ericksen-Leslie system as the parameter tends to zero. This is based on the compensated compactness property of the Ericksen stress tensors, which is obtained by the $L^p$-estimate of the Hopf differential for the Ericksen-Leslie system and the Pohozaev type argument for the Ginzburg-Landau type nematic liquid crystal flow.


title: Nonreciprocal-Beam Phased-Array Antennas

abstract: This study presents a nonreciprocal-beam phased-array antenna constituted of phase-gradient patch radiators integrated with transistor-based nonreciprocal phase shifters. Such an antenna exhibits different beams for transmission and reception states. The proposed phased-array antenna provides power amplification for both transmission and reception states, which is of paramount importance in most practical applications. In addition, in contrast to the recently proposed time-modulated antennas, the proposed nonreciprocal-beam phased-array antenna introduces no undesired time harmonics and unwanted frequency conversion, requires no radio frequency bias signal. Furthermore, the nonreciprocal phased-array antenna is lightweight and is amenable to integrated circuit fabrication. The transmission and reception beam angles, the beam shapes, and the power amplification level may be easily tuned by changing the direct current (dc) bias of the transistors and phase of the passive phase shifters. Such a nonreciprocal-beam phased-array antenna is expected to find military and commercial applications.


title: Generating Realistic Stock Market Order Streams

abstract: We propose an approach to generate realistic and high-fidelity stock market data based on generative adversarial networks (GANs). Our Stock-GAN model employs a conditional Wasserstein GAN to capture history dependence of orders. The generator design includes specially crafted aspects including components that approximate the market's auction mechanism, augmenting the order history with order-book constructions to improve the generation task. We perform an ablation study to verify the usefulness of aspects of our network structure. We provide a mathematical characterization of distribution learned by the generator. We also propose statistics to measure the quality of generated orders. We test our approach with synthetic and actual market data, compare to many baseline generative models, and find the generated data to be close to real data.


title: On the new LHCb angular analysis of $B \to K^* \mu^+ \mu^-$: Hadronic effects or New Physics?

abstract: The new angular analysis of the decay $B \to K^* \ell^+ \ell^-$ recently presented by the LHCb Collaboration still indicates some tensions with the Standard Model predictions. There are several ongoing analyses to solve the problem of separating hadronic and New Physics effects in this decay, but the significance of the observed tensions in the angular observables in $B \to K^* \mu^+\mu^-$ is still dependent on a theory guesstimate of the hadronic contributions to these decays. Using the new data from LHCb we offer two tests which make a statistical comparison to determine whether the most favoured explanation of the anomalies is New Physics or underestimated hadronic effects. We then analyse the usefulness of these tests in two future scenarios. Finally, we update our global fits to all available $b \to s $ data and discuss the impact of the new LHCb measurements.


title: Metastable behavior of weakly mixing Markov chains: the case of reversible, critical zero-range processes

abstract: We present a general method to derive the metastable behavior of weakly mixing Markov chains. This approach is based on properties of the resolvent equations and can be applied to metastable dynamics which do not satisfy the mixing conditions required in Beltr\'an and Landim (2010,2012) or in Landim et. al. (2020). As an application, we study the metastable behavior of critical zero-range processes. Let $r: S\times S\to \bb R_+$ be the jump rates of an irreducible random walk on a finite set $S$, reversible with respect to the uniform measure. For $\alpha >0$, let $g: \bb N\to \bb R_+$ be given by $g(0)=0$, $g(1)=1$, $g(k) = [k/(k-1)]^\alpha$, $k\ge 2$. Consider a zero-range process on $S$ in which a particle jumps from a site $x$, occupied by $k$ particles, to a site $y$ at rate $g(k) r(x,y)$. For $\alpha \ge 1$, in the stationary state, as the total number of particles, represented by $N$, tends to infinity, all particles but a negligible number accumulate at one single site. This phenomenon is called condensation. Since condensation occurs if and only if $\alpha\ge 1$, we call the case $\alpha =1$ critical. By applying the general method established in the first part of the article to the critical case, we show that the site which concentrates almost all particles evolves in the time-scale $N^2 \log N$ as a random walk on $S$ whose transition rates are proportional to the capacities of the underlying random walk.


title: A Generalization of the Pearson Correlation to Riemannian Manifolds

abstract: The increasing application of deep-learning is accompanied by a shift towards highly non-linear statistical models. In terms of their geometry it is natural to identify these models with Riemannian manifolds. The further analysis of the statistical models therefore raises the issue of a correlation measure, that in the cutting planes of the tangent spaces equals the respective Pearson correlation and extends to a correlation measure that is normalized with respect to the underlying manifold. In this purpose the article reconstitutes elementary properties of the Pearson correlation to successively derive a linear generalization to multiple dimensions and thereupon a nonlinear generalization to principal manifolds, given by the Riemann-Pearson Correlation.


title: Efficient AutoML Pipeline Search with Matrix and Tensor Factorization

abstract: Data scientists seeking a good supervised learning model on a new dataset have many choices to make: they must preprocess the data, select features, possibly reduce the dimension, select an estimation algorithm, and choose hyperparameters for each of these pipeline components. With new pipeline components comes a combinatorial explosion in the number of choices! In this work, we design a new AutoML system to address this challenge: an automated system to design a supervised learning pipeline. Our system uses matrix and tensor factorization as surrogate models to model the combinatorial pipeline search space. Under these models, we develop greedy experiment design protocols to efficiently gather information about a new dataset. Experiments on large corpora of real-world classification problems demonstrate the effectiveness of our approach.


title: Vilkovisky unique effective action in quantum gravity

abstract: The divergent part of the one-loop Vilkovisky unique effective action for quantum Einstein gravity is evaluated in the general parametrization of the quantum field, including the separated conformal factor. The output of this calculation explicitly demonstrates the parametrization and conformal gauge independence of the unique effective action with the configuration space metric chosen following Vilkovisky's prescription.


title: Deep Reinforcement Learning for Human-Like Driving Policies in Collision Avoidance Tasks of Self-Driving Cars

abstract: The technological and scientific challenges involved in the development of autonomous vehicles (AVs) are currently of primary interest for many automobile companies and research labs. However, human-controlled vehicles are likely to remain on the roads for several decades to come and may share with AVs the traffic environments of the future. In such mixed environments, AVs should deploy human-like driving policies and negotiation skills to enable smooth traffic flow. To generate automated human-like driving policies, we introduce a model-free, deep reinforcement learning approach to imitate an experienced human driver's behavior. We study a static obstacle avoidance task on a two-lane highway road in simulation (Unity). Our control algorithm receives a stochastic feedback signal from two sources: a model-driven part, encoding simple driving rules, such as lane-keeping and speed control, and a stochastic, data-driven part, incorporating human expert knowledge from driving data. To assess the similarity between machine and human driving, we model distributions of track position and speed as Gaussian processes. We demonstrate that our approach leads to human-like driving policies.


title: AutoPrivacy: Automated Layer-wise Parameter Selection for Secure Neural Network Inference

abstract: Hybrid Privacy-Preserving Neural Network (HPPNN) implementing linear layers by Homomorphic Encryption (HE) and nonlinear layers by Garbled Circuit (GC) is one of the most promising secure solutions to emerging Machine Learning as a Service (MLaaS). Unfortunately, a HPPNN suffers from long inference latency, e.g., $\sim100$ seconds per image, which makes MLaaS unsatisfactory. Because HE-based linear layers of a HPPNN cost $93\%$ inference latency, it is critical to select a set of HE parameters to minimize computational overhead of linear layers. Prior HPPNNs over-pessimistically select huge HE parameters to maintain large noise budgets, since they use the same set of HE parameters for an entire network and ignore the error tolerance capability of a network. In this paper, for fast and accurate secure neural network inference, we propose an automated layer-wise parameter selector, AutoPrivacy, that leverages deep reinforcement learning to automatically determine a set of HE parameters for each linear layer in a HPPNN. The learning-based HE parameter selection policy outperforms conventional rule-based HE parameter selection policy. Compared to prior HPPNNs, AutoPrivacy-optimized HPPNNs reduce inference latency by $53\%\sim70\%$ with negligible loss of accuracy.


title: Overall Agreement for Multiple Raters with Replicated Measurements

abstract: Multiple raters are often needed to be used interchangeably in practice for measurement or evaluation. Assessing agreement among these multiple raters via agreement indices are necessary before their participation. While the intuitively appealing agreement indices such as coverage probability and total deviation index, and relative area under coverage probability curve, have been extended for assessing overall agreement among multiple raters, these extensions have limitations. The existing overall agreement indices either require normality and homogeneity assumptions or did not preserve the intuitive interpretation of the indices originally defined for two raters. In this paper, we propose a new set of overall agreement indices based on maximum pairwise differences among all raters. The proposed new overall coverage probability, overall total deviation index and relative area under overall coverage probability curve retain the original intuitive interpretation from the pairwise version. Without making any distributional assumption, we also propose a new unified nonparametric estimation and inference approach for the overall indices based on generalized estimating equations that can accommodate replications made by the same rater. Under mild assumptions, the proposed variance estimator is shown to achieve efficiency bound under independent working correlation matrix. Simulation studies under different scenarios are conducted to assess the performance of the proposed estimation and inference approach with and without replications. We illustrate the methodology by using a blood pressure data with three raters who made three replications on each subjects.


title: Relativistic frame-dragging and the Hong-Ou-Mandel dip $-$ a primitive to gravitational effects in multi-photon quantum-interference

abstract: We investigate the Hong-Ou-Mandel (HOM) effect $-$ a two-photon quantum-interference effect $-$ in the space-time of a rotating spherical mass. In particular, we analyze a common-path HOM setup restricted to the surface of the earth and show that, in principle, general-relativistic frame-dragging induces observable shifts in the HOM dip. For completeness and correspondence with current literature, we also analyze the emergence of gravitational time-dilation effects in HOM interference, for a dual-arm configuration. The formalism thus presented establishes a basis for encoding general-relativistic effects into local, multi-photon, quantum-interference experiments. Demonstration of these instances would signify genuine observations of quantum and general relativistic effects, in tandem, and would also extend the domain of validity of general relativity, to the arena of quantized electromagnetic fields.


title: Randomized Entity-wise Factorization for Multi-Agent Reinforcement Learning

abstract: Multi-agent settings in the real world often involve tasks with varying types and quantities of agents and non-agent entities; however, common patterns of behavior often emerge among these agents/entities. Our method aims to leverage these commonalities by asking the question: ``What is the expected utility of each agent when only considering a randomly selected sub-group of its observed entities?'' By posing this counterfactual question, we can recognize state-action trajectories within sub-groups of entities that we may have encountered in another task and use what we learned in that task to inform our prediction in the current one. We then reconstruct a prediction of the full returns as a combination of factors considering these disjoint groups of entities and train this ``randomly factorized" value function as an auxiliary objective for value-based multi-agent reinforcement learning. By doing so, our model can recognize and leverage similarities across tasks to improve learning efficiency in a multi-task setting. Our approach, Randomized Entity-wise Factorization for Imagined Learning (REFIL), outperforms all strong baselines by a significant margin in challenging multi-task StarCraft micromanagement settings.


title: MAV Navigation in Unknown Dark Underground Mines Using Deep Learning

abstract: This article proposes a Deep Learning (DL) method to enable fully autonomous flights for low-cost Micro Aerial Vehicles (MAVs) in unknown dark underground mine tunnels. This kind of environments pose multiple challenges including lack of illumination, narrow passages, wind gusts and dust. The proposed method does not require accurate pose estimation and considers the flying platform as a floating object. The Convolutional Neural Network (CNN) supervised image classifier method corrects the heading of the MAV towards the center of the mine tunnel by processing the image frames from a single on-board camera, while the platform navigates at constant altitude and desired velocity references. Moreover, the output of the CNN module can be used from the operator as means of collision prediction information. The efficiency of the proposed method has been successfully experimentally evaluated in multiple field trials in an underground mine in Sweden, demonstrating the capability of the proposed method in different areas and illumination levels.


title: Efficient Poverty Mapping using Deep Reinforcement Learning

abstract: The combination of high-resolution satellite imagery and machine learning have proven useful in many sustainability-related tasks, including poverty prediction, infrastructure measurement, and forest monitoring. However, the accuracy afforded by high-resolution imagery comes at a cost, as such imagery is extremely expensive to purchase at scale. This creates a substantial hurdle to the efficient scaling and widespread adoption of high-resolution-based approaches. To reduce acquisition costs while maintaining accuracy, we propose a reinforcement learning approach in which free low-resolution imagery is used to dynamically identify where to acquire costly high-resolution images, prior to performing a deep learning task on the high-resolution images. We apply this approach to the task of poverty prediction in Uganda, building on an earlier approach that used object detection to count objects and use these counts to predict poverty. Our approach exceeds previous performance benchmarks on this task while using 80% fewer high-resolution images. Our approach could have application in many sustainability domains that require high-resolution imagery.


title: Unsupervised Learning for Subterranean Junction Recognition Based on 2D Point Cloud

abstract: This article proposes a novel unsupervised learning framework for detecting the number of tunnel junctions in subterranean environments based on acquired 2D point clouds. The implementation of the framework provides valuable information for high level mission planners to navigate an aerial platform in unknown areas or robot homing missions. The framework utilizes spectral clustering, which is capable of uncovering hidden structures from connected data points lying on non-linear manifolds. The spectral clustering algorithm computes a spectral embedding of the original 2D point cloud by utilizing the eigen decomposition of a matrix that is derived from the pairwise similarities of these points. We validate the developed framework using multiple data-sets, collected from multiple realistic simulations, as well as from real flights in underground environments, demonstrating the performance and merits of the proposed methodology.


title: Learn-Apply-Reinforce/Share Learning: Hackathons and CTFs as General Pedagogic Tools in Higher Education, and Their Applicability to Distance Learning

abstract: This paper lays out two teaching/learning methods that are becoming increasingly prevalent in computer science - hackathons, and Capture the Flag (CTF) competitions - and the pedagogic theory that underpins them. A case study of each is analysed, and the underpinning similarities extracted. The frameworks are then generalised to Learn-Apply-Reinforce/Share Learning - a social constructivistic method that can be used subject-independently. The applicability of this new method to distance learning is then investigated - with a mind to potential necessity to work from home - both due to increasing demand in the Higher Education sector, but also the devastating impact of crises such as the ongoing COVID-19 pandemic. Finally, a few potential extensions and future applications are discussed - including the possibilities of pivoting the method to be more research-driven, or indeed, to drive research.


title: Subterranean MAV Navigation based on Nonlinear MPC with Collision Avoidance Constraints

abstract: Micro Aerial Vehicles (MAVs) navigation in subterranean environments is gaining attention in the field of aerial robotics, however there are still multiple challenges for collision free navigation in such harsh environments. This article proposes a novel baseline solution for collision free navigation with Nonlinear Model Predictive Control (NMPC). In the proposed method, the MAV is considered as a floating object, where the velocities on the $x$, $y$ axes and the position on altitude are the references for the NMPC to navigate along the tunnel, while the NMPC avoids the collision by considering kinematics of the obstacles based on measurements from a 2D lidar. Moreover, a novel approach for correcting the heading of the MAV towards the center of the mine tunnel is proposed, while the efficacy of the suggested framework has been evaluated in multiple field trials in an underground mine in Sweden.


title: Bayesian Hidden Physics Models: Uncertainty Quantification for Discovery of Nonlinear Partial Differential Operators from Data

abstract: What do data tell us about physics-and what don't they tell us? There has been a surge of interest in using machine learning models to discover governing physical laws such as differential equations from data, but current methods lack uncertainty quantification to communicate their credibility. This work addresses this shortcoming from a Bayesian perspective. We introduce a novel model comprising "leaf" modules that learn to represent distinct experiments' spatiotemporal functional data as neural networks and a single "root" module that expresses a nonparametric distribution over their governing nonlinear differential operator as a Gaussian process. Automatic differentiation is used to compute the required partial derivatives from the leaf functions as inputs to the root. Our approach quantifies the reliability of the learned physics in terms of a posterior distribution over operators and propagates this uncertainty to solutions of novel initial-boundary value problem instances. Numerical experiments demonstrate the method on several nonlinear PDEs.


title: Pre-training Polish Transformer-based Language Models at Scale

abstract: Transformer-based language models are now widely used in Natural Language Processing (NLP). This statement is especially true for English language, in which many pre-trained models utilizing transformer-based architecture have been published in recent years. This has driven forward the state of the art for a variety of standard NLP tasks such as classification, regression, and sequence labeling, as well as text-to-text tasks, such as machine translation, question answering, or summarization. The situation have been different for low-resource languages, such as Polish, however. Although some transformer-based language models for Polish are available, none of them have come close to the scale, in terms of corpus size and the number of parameters, of the largest English-language models. In this study, we present two language models for Polish based on the popular BERT architecture. The larger model was trained on a dataset consisting of over 1 billion polish sentences, or 135GB of raw text. We describe our methodology for collecting the data, preparing the corpus, and pre-training the model. We then evaluate our models on thirteen Polish linguistic tasks, and demonstrate improvements over previous approaches in eleven of them.


title: First order thickenings and cotorsors

abstract: Let $X$ be a scheme and let $\mathcal{M}$ be a quasi-coherent sheaf on $X$. Then $\mathcal{M}$ can be viewed as a cogroup object in the category of schemes under $X$. We show that the category of first order thickenings of $X$ by $\mathcal{M}$ is equivalent to the category of $\mathcal{M}$-cotorsors.


title: In-Ear Measurement of Blood Oxygen Saturation: An Ambulatory Tool Needed To Detect The Delayed Life-Threatening Hypoxaemia in COVID-19

abstract: Non-invasive ambulatory estimation of blood oxygen saturation has emerged as an important clinical requirement to detect hypoxemia in the delayed post-infective phase of COVID-19, where dangerous hypoxia may occur in the absence of subjective breathlessness. This immediate clinical driver, combined with the general quest for more personalised health data, means that pulse oximetry measurement of capillary oxygen saturation (SpO2) will likely expand into both the clinical and consumer market of wearable health technology in the near future. In this study, we set out to establish the feasibility of SpO2 measurement from the ear canal as a convenient site for long term monitoring, and perform a comprehensive comparison with the right index finger - the conventional clinical measurement site. During resting SpO2 estimation, we found a root mean square difference of 1.47% between the two measurement sites, with a mean difference of 0.23% higher SpO2 in the right ear canal. Through the simultaneous recording of pulse oximetry from both the right ear canal and index finger during breath holds, we observe a substantial improvement in response time between the ear and finger that has a mean of 12.4 seconds and a range of 4.2 - 24.2 seconds across all subjects. Factors which influence this response time, termed SpO2 delay, such as the sex of a subject are also explored. Furthermore, we examine the potential downsides of ear canal blood oxygen saturation measurement, namely the lower photoplethysmogram amplitude, and suggest ways to mitigate this disadvantage. These results are presented in conjunction with previously discovered benefits such as robustness to temperature, making the case for measurement of SpO2 from the ear canal being both convenient and superior to conventional finger measurement sites for continuous non-intrusive long term monitoring in both clinical and everyday-life settings.


title: Tensors over Semirings for Latent-Variable Weighted Logic Programs

abstract: Semiring parsing is an elegant framework for describing parsers by using semiring weighted logic programs. In this paper we present a generalization of this concept: latent-variable semiring parsing. With our framework, any semiring weighted logic program can be latentified by transforming weights from scalar values of a semiring to rank-n arrays, or tensors, of semiring values, allowing the modelling of latent variables within the semiring parsing framework. Semiring is too strong a notion when dealing with tensors, and we have to resort to a weaker structure: a partial semiring. We prove that this generalization preserves all the desired properties of the original semiring framework while strictly increasing its expressiveness.


title: Probing the sensitivity to leptonic $\delta_{CP}$ in presence of invisible decay of $\nu_3$ using atmospheric neutrinos

abstract: One of the main neutrino oscillation parameters whose value has not been determined very precisely is the leptonic $\delta_{CP}$ phase. Since neutrinos have a tiny but finite mass they can undergo decay both visibly and invisibly. The effect of invisible decay of the third mass eigen state $\nu_3$ on the sensitivity to $\delta_{CP}$ is analysed here using atmospheric neutrino and anti-neutrino events. Effects of detector resolutions and systematic uncertainties are studied to identify the optimum resolutions and efficiencies required by a detector to obtain a significant sensitivity even in presence of decay.


title: Structure retrieval in liquid-phase electron scattering

abstract: Electron scattering on liquid samples has been enabled recently by the development of ultrathin liquid sheet technologies. The data treatment of liquid-phase electron scattering has been mostly reliant on methodologies developed for gas electron diffraction, in which theoretical inputs and empirical fittings are often needed to account for the atomic form factor and remove the inelastic scattering background. The accuracy and impact of these theoretical and empirical inputs has not been benchmarked for liquid-phase electron scattering data. In this work, we present an alternative data treatment method that requires neither theoretical inputs nor empirical fittings. The merits of this new method are illustrated through the retrieval of real-space molecular structure from experimental electron scattering patterns of liquid water, carbon tetrachloride, chloroform, and dichloromethane.


title: On Besov regularity and local time of the stochastic heat equation

abstract: Sharp Besov regularities in time and space variables are investigated for $\left(u(t,x),\; t\in [0,T],\; x\in \mathbb{R}\right)$, the mild solution to the stochastic heat equation driven by space-time white noise. Existence, H\"{o}lder continuity, and Besov regularity of local times are established for $u(t,x)$ viewed either as a process in the space variable or time variable. Hausdorff dimensions of their corresponding level sets are also obtained.


title: Distributed-Memory Vertex-Centric Network Embedding for Large-Scale Graphs

abstract: Network embedding is an important step in many different computations based on graph data. However, existing approaches are limited to small or middle size graphs with fewer than a million edges. In practice, web or social network graphs are orders of magnitude larger, thus making most current methods impractical for very large graphs. To address this problem, we introduce a new distributed-memory parallel network embedding method based on Apache Spark and GraphX. We demonstrate the scalability of our method as well as its ability to generate meaningful embeddings for vertex classification and link prediction on both real-world and synthetic graphs.


title: Constant-Expansion Suffices for Compressed Sensing with Generative Priors

abstract: Generative neural networks have been empirically found very promising in providing effective structural priors for compressed sensing, since they can be trained to span low-dimensional data manifolds in high-dimensional signal spaces. Despite the non-convexity of the resulting optimization problem, it has also been shown theoretically that, for neural networks with random Gaussian weights, a signal in the range of the network can be efficiently, approximately recovered from a few noisy measurements. However, a major bottleneck of these theoretical guarantees is a network expansivity condition: that each layer of the neural network must be larger than the previous by a logarithmic factor. Our main contribution is to break this strong expansivity assumption, showing that constant expansivity suffices to get efficient recovery algorithms, besides it also being information-theoretically necessary. To overcome the theoretical bottleneck in existing approaches we prove a novel uniform concentration theorem for random functions that might not be Lipschitz but satisfy a relaxed notion which we call "pseudo-Lipschitzness." Using this theorem we can show that a matrix concentration inequality known as the Weight Distribution Condition (WDC), which was previously only known to hold for Gaussian matrices with logarithmic aspect ratio, in fact holds for constant aspect ratios too. Since the WDC is a fundamental matrix concentration inequality in the heart of all existing theoretical guarantees on this problem, our tighter bound immediately yields improvements in all known results in the literature on compressed sensing with deep generative priors, including one-bit recovery, phase retrieval, low-rank matrix recovery, and more.


title: Blurring Boundaries: Toward the Collective Empathic Understanding of Product Requirements

abstract: Within the agile paradigm, many software product companies create cross-functional product development teams that own their product or a defined set of product features. In contrast to development teams operating within a heavily-disciplined software development process, these product teams often require a deeper and, importantly, a collective understanding of the product domain to serve as a rich context within which to understand the product requirements. Little is known about the factors that support or impede these teams in collectively achieving this deep understanding of the product domain. Using Constructivist Grounded Theory method, we study individuals and teams across seven software companies that create products for a diverse range of markets. The study found that certain organisational and planning process factors play a significant role in whether product development teams have the potential to collectively develop deep domain understanding. These factors also impact individual and development team dynamics. We identify two essential metaphorical dynamics of broadening the lens and blurring boundaries that cross-functional product teams employ in order to fully embrace product ownership, visioning, and planning towards achieving a deep collective domain understanding, creating a richer context in which to understand product requirements. We also conclude that the highly specialised nature of many organisational models and development processes is contraindicated for cross-functional product development teams in achieving this deep collective understanding and we call for a rethinking of conventional organisational and product planning practices for software product development.


title: Unsupervised Differentiable Multi-aspect Network Embedding

abstract: Network embedding is an influential graph mining technique for representing nodes in a graph as distributed vectors. However, the majority of network embedding methods focus on learning a single vector representation for each node, which has been recently criticized for not being capable of modeling multiple aspects of a node. To capture the multiple aspects of each node, existing studies mainly rely on offline graph clustering performed prior to the actual embedding, which results in the cluster membership of each node (i.e., node aspect distribution) fixed throughout training of the embedding model. We argue that this not only makes each node always have the same aspect distribution regardless of its dynamic context, but also hinders the end-to-end training of the model that eventually leads to the final embedding quality largely dependent on the clustering. In this paper, we propose a novel end-to-end framework for multi-aspect network embedding, called asp2vec, in which the aspects of each node are dynamically assigned based on its local context. More precisely, among multiple aspects, we dynamically assign a single aspect to each node based on its current context, and our aspect selection module is end-to-end differentiable via the Gumbel-Softmax trick. We also introduce the aspect regularization framework to capture the interactions among the multiple aspects in terms of relatedness and diversity. We further demonstrate that our proposed framework can be readily extended to heterogeneous networks. Extensive experiments towards various downstream tasks on various types of homogeneous networks and a heterogeneous network demonstrate the superiority of asp2vec.


title: Improving Inference for Neural Image Compression

abstract: We consider the problem of lossy image compression with deep latent variable models. State-of-the-art methods build on hierarchical variational autoencoders (VAEs) and learn inference networks to predict a compressible latent representation of each data point. Drawing on the variational inference perspective on compression, we identify three approximation gaps which limit performance in the conventional approach: an amortization gap, a discretization gap, and a marginalization gap. We propose remedies for each of these three limitations based on ideas related to iterative inference, stochastic annealing for discrete optimization, and bits-back coding, resulting in the first application of bits-back coding to lossy compression. In our experiments, which include extensive baseline comparisons and ablation studies, we achieve new state-of-the-art performance on lossy image compression using an established VAE architecture, by changing only the inference method.


title: Potential for Improved Time Resolution Using Very Thin Ultra-Fast Silicon Detectors (UFSDs)

abstract: Ultra-Fast Silicon Detectors (UFSDs) are n-in-p silicon detectors that implement moderate gain (typically 5 to 25) using a thin highly doped p++ layer between the high resistivity p-bulk and the junction of the sensor. The presence of gain allows excellent time measurement for impinging minimum ionizing charged particles. An important design consideration is the sensor thickness, which has a strong impact on the achievable time resolution. We present the result of measurements for LGADs of thickness between 20 micro-m and 50 micro-m. The data are fit to a formula that captures the impact of both electronic jitter and Landau fluctuations on the time resolution. The data illustrate the importance of having a saturated electron drift velocity and a large signal-to-noise in order to achieve good time resolution. Sensors of 20 micro-m thickness offer the potential of 10 to 15 ps time resolution per measurement, a significant improvement over the value for the 50 micro-m sensors that have been typically used to date.


title: On certain Semigroups of Transformations that preserve a partition

abstract: Let $X$ be a nonempty set, and let $\mathcal{T}_X$ be the full transformation semigroup on $X$. For a partition $\mathcal{P} = \{X_i \;|\; i\in I\}$ of $X$, we consider the semigroup $T(X, \mathcal{P}) = \{f\in \mathcal{T}_X\;|\; \forall X_i\;\exists X_j,\; X_i f \subseteq X_j\}$, the subsemigroup $\Sigma(X, \mathcal{P}) = \{f\in T(X, \mathcal{P})\;|\; Xf \cap X_i \neq \emptyset\; \forall X_i\}$, and the group of units $S(X, \mathcal{P})$ of $T(X, \mathcal{P})$. In this paper, we first characterize the elements of $\Sigma(X, \mathcal{P})$. For a permutation $f$ of finite $X$, we next observe whether there exists a nontrivial partition $\mathcal{P}$ of $X$ such that $f\in S(X, \mathcal{P})$. We then characterize and enumerate the idempotents in the semigroup $\Sigma(X, \mathcal{P})$ for arbitrary and finite $X$, respectively. We also characterize the elements of $S(X, \mathcal{P})$. For finite $X$, we finally calculate the cardinality of $T(X, \mathcal{P})$, $\Sigma(X, \mathcal{P})$, and $S(X, \mathcal{P})$.


title: Quantum Dynamics of Collective Spin States in a Thermal Gas

abstract: Ensembles of alkali or noble-gas atoms at room temperature and above are widely applied in quantum optics and metrology owing to their long-lived spins. Their collective spin states maintain nonclassical nonlocal correlations, despite the atomic thermal motion in the bulk and at the boundaries. Here we present a stochastic, fully-quantum description of the effect of atomic diffusion in these systems. We employ the Bloch-Heisenberg-Langevin formalism to account for the quantum noise originating from diffusion and from various boundary conditions corresponding to typical wall coatings, thus modeling the dynamics of nonclassical spin states with spatial inter-atomic correlations. As examples, we apply the model to calculate spin noise spectroscopy, temporal relaxation of squeezed spin states, and the coherent coupling between two spin species in a hybrid system.


title: Economic and Business Dimensions Cloud Computing and Electricity: Beyond the Utility Model

abstract: An overly simplistic reliance on the utility model risks blinding us to the real opportunities and challenges of cloud computing.