title: Accurate Retinal Vessel Segmentation via Octave Convolution Neural Network

abstract: Retinal vessel segmentation is a crucial step in diagnosing and screening various diseases, including diabetes, ophthalmologic diseases, and cardiovascular diseases. In this paper, we propose an effective and efficient method for vessel segmentation in color fundus images using encoder-decoder based octave convolution networks. Compared with other convolution networks utilizing standard convolution for feature extraction, the proposed method utilizes octave convolutions and octave transposed convolutions for learning multiple-spatial-frequency features, thus can better capture retinal vasculatures with varying sizes and shapes. To provide the network the capability of learning how to decode multifrequency features, we extend octave convolution and propose a new operation named octave transposed convolution. A novel architecture of convolutional neural network, named as Octave UNet integrating both octave convolutions and octave transposed convolutions is proposed based on the encoder-decoder architecture of UNet, which can generate high resolution vessel segmentation in one single forward feeding without post-processing steps. Comprehensive experimental results demonstrate that the proposed Octave UNet outperforms the baseline UNet achieving better or comparable performance to the state-of-the-art methods with fast processing speed. Specifically, the proposed method achieves 0.9664 / 0.9713 / 0.9759 / 0.9698 accuracy, 0.8374 / 0.8664 / 0.8670 / 0.8076 sensitivity, 0.9790 / 0.9798 / 0.9840 / 0.9831 specificity, 0.8127 / 0.8191 / 0.8313 / 0.7963 F1 score, and 0.9835 / 0.9875 / 0.9905 / 0.9845 Area Under Receiver Operating Characteristic curve, on DRIVE, STARE, CHASE_DB1, and HRF datasets, respectively.


title: Nature of interference between Autler-Townes peaks in multi-level system

abstract: In this work we present a theoretical frame work to identify the role and the nature of interference between Autler-Townes (AT) peaks (or dressed states) in generic multi-level system. The destructive interference between the AT peaks, gives rise to sharp transparency window known as electromagnetically induced transparency (EIT). In the three-level system, the two AT peaks interferes pair-wise with each other, almost similar to the two-slit interference. In the four-level system, the interference between the three AT peaks is also pair-wise analogous to three-slit interference but has a bit more complicated nature of interference. However, in many practical situations in atomic systems only the simple form of interference similar to three-level system dominates. In the three-level system, the nature of interference (i.e. constructive, destructive or zero/no interference) between the two AT peaks is purely determined by the natural decay rate of the states coupled by the control laser. However, in four-level system the nature of interference between the two extreme AT peaks can be tuned from constructive to destructive by tuning the power of the control laser.


title: Adversarial Pixel-Level Generation of Semantic Images

abstract: Generative Adversarial Networks (GANs) have obtained extraordinary success in the generation of realistic images, a domain where a lower pixel-level accuracy is acceptable. We study the problem, not yet tackled in the literature, of generating semantic images starting from a prior distribution. Intuitively this problem can be approached using standard methods and architectures. However, a better-suited approach is needed to avoid generating blurry, hallucinated and thus unusable images since tasks like semantic segmentation require pixel-level exactness. In this work, we present a novel architecture for learning to generate pixel-level accurate semantic images, namely Semantic Generative Adversarial Networks (SemGANs). The experimental evaluation shows that our architecture outperforms standard ones from both a quantitative and a qualitative point of view in many semantic image generation tasks.


title: Spin-polarized electronic surface states of Re(0001): an ab-initio investigation

abstract: We study the electronic structure of the Re(0001) surface by means of ab-initio techniques based on the Fully Relativistic (FR) Density Functional Theory (DFT) and the Projector Augmented-Wave (PAW) method. We identify the main surface states and resonances and study in detail their energy dispersion along the main symmetry lines of the SBZ. Moreover, we discuss the effect of spin-orbit coupling on the energy splittings and the spin-polarization of the main surface states and resonances. Whenever possible, we compare the results with previously studied heavy metals surfaces. We find empty resonances, located below a gap similar to the L-gap of the (111) fcc surfaces, that have a downward dispersion and cross the Fermi level, similarly to the recently studied Os(0001) surface. Their spin polarization at the Fermi level is similar to that predicted by the Rashba model, but the usual level crossing at $\bar{\Gamma}$ is not found with our slab thickness. Moreover, for selected states, we follow the spin polarization along the high symmetry lines, discussing its behavior with respect to ${\bf k}_{\parallel}$, the wave-vector parallel to the surface.


title: On spherical unitary representations of groups of spheromorphisms of Bruhat--Tits trees

abstract: Consider an infinite homogeneous tree $T_n$ of valence $n+1$, its group $Aut(T_n)$ of automorphisms, and the group $Hie(T_n)$ of its spheromorphisms (hierarchomorphisms), i.~e., the group of homeomorphisms of the boundary of $T_n$ that locally coincide with transformations defined by automorphisms. We show that the subgroup $Aut(T_n)$ is spherical in $Hie(T_n)$, i.~e., any irreducible unitary representation of $Hie(T_n)$ contains at most one $Aut(T_n)$-fixed vector. We present a combinatorial description of the space of double cosets of $Hie(T_n)$ with respect to $Aut(T_n)$ and construct a 'new' family of spherical representations of $Hie(T_n)$. We also show that the Thompson group has $PSL(2,\mathbb{Z})$-spherical unitary


title: A New Malware Detection System Using a High Performance-ELM method

abstract: A vital element of a cyberspace infrastructure is cybersecurity. Many protocols proposed for security issues, which leads to anomalies that affect the related infrastructure of cyberspace. Machine learning (ML) methods used to mitigate anomalies behavior in mobile devices. This paper aims to apply a High Performance Extreme Learning Machine (HP-ELM) to detect possible anomalies in two malware datasets. Two widely used datasets (the CTU-13 and Malware) are used to test the effectiveness of HP-ELM. Extensive comparisons are carried out in order to validate the effectiveness of the HP-ELM learning method. The experiment results demonstrate that the HP-ELM was the highest accuracy of performance of 0.9592 for the top 3 features with one activation function.


title: Remark on Algorithm 680: evaluation of the complex error function: Cause and Remedy for the Loss of Accuracy Near the Real Axis

abstract: In this remark we identify the cause of the loss of accuracy in the computation of the Faddeyeva function, w(z), near the real axis when using Algorithm 680. We provide a simple correction to this problem which allows us to restore this code as one of the important reference routines for accuracy comparisons.


title: Obtaining consistent Lorentz gauging for a gravitationally coupled fermion

abstract: For internal gauge forces, the result of locally gauging, i.e., of performing the substitution $\partial \rightarrow D$, is physically the same whether performed on the action or on the corresponding Euler-Lagrange equations of motion. Rather unsettling, though, such commutativity fails for the standard way of coupling a Dirac fermion to the gravitational field in the setting of a local Lorentz gauge theory of general relativity in the vierbein formalism, the equivalence principle thus seemingly being here violated. This paper will present a formalism in which commutativity holds for the gravitational force as well, the action for the gravitational field itself being still the Einstein-Hilbert one. Notably, in this formalism, the spinor field will carry a world/coordinate index, rather than a Lorentz spinor index as it does standardly. More generally, no Lorentz indices will figure, neither vector indices nor spinor indices, which from a parsimonious point of view seems quite satisfactory.


title: missSBM: An R Package for Handling Missing Values in the Stochastic Block Model

abstract: The Stochastic Block Model (SBM) is a popular probabilistic model for random graphs. It is commonly used for clustering network data by aggregating nodes that share similar connectivity patterns into blocks. When fitting an SBM to a network which is partially observed, it is important to take into account the underlying process that generates the missing values, otherwise the inference may be biased. This paper introduces missSBM, an R-package fitting the SBM when the network is partially observed, i.e., the adjacency matrix contains not only 1's or 0's encoding presence or absence of edges but also NA's encoding missing information between pairs of nodes. This package implements a set of algorithms for fitting the binary SBM, possibly in the presence of external covariates, by performing variational inference adapted to several observation processes. Our implementation automatically explores different block numbers to select the most relevant model according to the Integrated Classification Likelihood (ICL) criterion. The ICL criterion can also help determine which observation process better corresponds to a given dataset. Finally, missSBM can be used to perform imputation of missing entries in the adjacency matrix. We illustrate the package on a network data set consisting of interactions between political blogs sampled during the French presidential election in 2007.


title: On extremal results of multiplicative Zagreb indices of trees with given distance $k$-domination number

abstract: The first multiplicative Zagreb index $\Pi_1$ of a graph $G$ is the product of the square of every vertex degree, while the second multiplicative Zagreb index $\Pi_2$ is the product of the products of degrees of pairs of adjacent vertices. In this paper, we give sharp lower bound for $\Pi_1$ and upper bound for $\Pi_2$ of trees with given distance $k$-domination number, and characterize those trees attaining the bounds.


title: Small G\'al sums and applications

abstract: In recent years, maximizing G\'al sums regained interest due to a firm link with large values of $L$-functions. In the present paper, we initiate an investigation of small sums of G\'al type, with respect to the $L^1$-norm. We also consider the intertwined question of minimizing weighted versions of the usual multiplicative energy. We apply our estimates to: (i) a logarithmic refinement of Burgess' bound on character sums, improving previous results of Kerr, Shparlinski and Yau; (ii) an improvement on earlier lower bounds by Louboutin and the second author for the number of non vanishing theta functions associated to Dirichlet characters; and (iii) new lower bounds for low moments of character sums.


title: Modularity in Multilayer Networks using Redundancy-based Resolution and Projection-based Inter-Layer Coupling

abstract: The generalized version of modularity for multilayer networks, a.k.a. multislice modularity, is characterized by two model parameters, namely resolution factor and inter-layer coupling factor. The former corresponds to a notion of layer-specific relevance, whereas the inter-layer coupling factor represents the strength of node connections across the network layers. Despite the potential of this approach, the setting of both parameters can be arbitrarily selected, without considering specific characteristics from the topology of the multilayer network as well as from an available community structure. Also, the multislice modularity is not designed to explicitly model order relations over the layers, which is of prior importance for dynamic networks. This paper aims to overcome the main limitations of the multislice modularity by introducing a new formulation of modularity for multilayer networks. We revise the role and semantics of both the resolution and inter-layer coupling factors based on information available from the within-layer and inter-layer structures of the multilayer communities. Also, our proposed multilayer modularity is general enough to consider orderings of network layers and their constraints on layer coupling. Experiments were carried out on synthetic and real-world multilayer networks using state-of-the-art approaches for multilayer community detection. The obtained results have shown the meaningfulness of the proposed modularity, revealing the effects of different combinations of the resolution and inter-layer coupling functions. This work also represents a starting point for the development of new optimization methods for community detection in multilayer networks.


title: On the dynamics of 3D electrified falling films

abstract: In this article, we consider a non-local variant of the Kuramoto-Sivashinsky equation in three dimensions (2D interface). Besides showing the global wellposedness of this equation we also obtain some qualitative properties of the solutions. In particular, we prove that the solutions become analytic in the spatial variable for positive time, the existence of a compact global attractor and an upper bound on the number of spatial oscillations of the solutions. We observe that such a bound is particularly interesting due to the chaotic behavior of the solutions.


title: On the Hasse invariants of the Tate normal forms $E_5$ and $E_7$

abstract: A formula is proved for the number of linear factors over $\mathbb{F}_l$ of the Hasse invariant of the Tate normal form $E_5(b)$ for a point of order $5$, as a polynomial in the parameter $b$, in terms of the class number of the imaginary quadratic field $K=\mathbb{Q}(\sqrt{-l})$, proving a conjecture of the author from 2005. A similar theorem is proved for quadratic factors with constant term $-1$, and a theorem is stated for the number of quartic factors of a specific form in terms of the class number of $\mathbb{Q}(\sqrt{-5l})$. These results are shown to imply a recent conjecture of Nakaya on the number of linear factors over $\mathbb{F}_l$ of the supersingular polynomial $ss_l^{(5*)}(X)$ corresponding to the Fricke group $\Gamma_0^*(5)$. The degrees and forms of the irreducible factors of the Hasse invariant of the Tate normal form $E_7$ for a point of order $7$ are determined, which is used to show that the polynomial $ss_l^{(N*)}(X)$ for the group $\Gamma_0^*(N)$ has roots in $\mathbb{F}_{l^2}$, for any prime $l \neq N$, when $N \in \{2,3,5,7\}$.


title: Physics of integer spin antiferromagnetic chains : Haldane gaps and edge states

abstract: The antiferromagnetic Heisenberg spin chain with integer spin has short-range magnetic order and an excitation energy gap above the ground state. This so-called Haldane gap is proportional to the exchange coupling $J$ of the Heisenberg chain. We discuss recent results about the spin dependence of the Haldane gap and conjecture an analytical formula valid asymptotically for large spin values. We next study the robustness of the edge states of the spin one chain by studying by the DMRG algorithm a spin one ladder. We show that the peculiar hidden topological order of the spin one chain disappears smoothly by increasing the ladder rung coupling without any intervening phase transition. This is evidence for the fragile character of the topological order of the spin one chain.


title: Robust test for dispersion parameter change in discretely observed diffusion processes

abstract: This paper deals with the problem of testing for dispersion parameter change in discretely observed diffusion processes when the observations are contaminated by outliers. To lessen the impact of outliers, we first calculate residuals using a robust estimate and then propose a trimmed-residual based CUSUM test. The proposed test is shown to converge weakly to a function of the Brownian bridge under the null hypothesis of no parameter change. We conduct simulations to evaluate performances of the proposed test in the presence of outliers. Numerical results confirm that the proposed test posses a strong robust property against outliers. In real data analysis, we fit the Ornstein-Uhlenbeck process to KOSPI200 volatility index data and locate some change points that are not detected by a naive CUSUM test.


title: On the complexity of classifying Lebesgue spaces

abstract: Computability theory is used to evaluate the complexity of classifying various kinds of Lebesgue spaces and associated isometric isomorphism problems.


title: Turbulence Dynamo in Galaxy Clusters

abstract: The existence of microgauss magnetic fields in galaxy clusters have been established through observations of synchrotron radiation and Faraday rotation. They are conjectured to be generated via small-scale dynamo by turbulent flow motions in the intracluster medium (ICM). Some of giant radio relics, on the other hand, show the structures of synchrotron polarization vectors, organized over the scales of $\sim$ Mpc, challenging the turbulence origin of cluster magnetic fields. Unlike turbulence in the interstellar medium, turbulence in the ICM is subsonic. And it is driven sporadically in highly stratified backgrounds, when major mergers occur during the hierarchical formation of clusters. To investigate quantitatively the characteristics of turbulence dynamo in such ICM environment, we performed a set of turbulence simulations using a high-order-accurate, magnetohydrodynamic (MHD) code. We find that turbulence dynamo could generate the cluster magnetic fields up to the observed level from the primordial seed fields of $10^{-15}$ G or so within the age of the universe, if the MHD description of the ICM could be extended down to $\sim$ kpc scales. However, highly organized structures of polarization vectors, such as those observed in the Sausage relic, are difficult to be reproduced by the shock compression of turbulence-generated magnetic fields. This implies that the modeling of giant radio relics may require the pre-existing magnetic fields organized over $\sim$ Mpc scales.


title: PUFFINN: Parameterless and Universally Fast FInding of Nearest Neighbors

abstract: We present PUFFINN, a parameterless LSH-based index for solving the $k$-nearest neighbor problem with probabilistic guarantees. By parameterless we mean that the user is only required to specify the amount of memory the index is supposed to use and the result quality that should be achieved. The index combines several heuristic ideas known in the literature. By small adaptions to the query algorithm, we make heuristics rigorous. We perform experiments on real-world and synthetic inputs to evaluate implementation choices and show that the implementation satisfies the quality guarantees while being competitive with other state-of-the-art approaches to nearest neighbor search. We describe a novel synthetic data set that is difficult to solve for almost all existing nearest neighbor search approaches, and for which PUFFINN significantly outperform previous methods.


title: Engel structures on complex surfaces

abstract: We classify complex surfaces $(M,\,J)$ admitting Engel structures $\mathcal{D}$ which are complex line bundles. Namely we prove that this happens if and only if $(M,\,J)$ has trivial Chern classes. We construct examples of such Engel structures by adapting a construction due to Geiges. We also study associated Engel defining forms and define a unique splitting of $TM$ associated with $\mathcal{D}$ $J$-Engel.


title: On the notion of number in humans and machines

abstract: In this paper, we performed two types of software experiments to study the numerosity classification (subitizing) in humans and machines. Experiments focus on a particular kind of task is referred to as Semantic MNIST or simply SMNIST where the numerosity of objects placed in an image must be determined. The experiments called SMNIST for Humans are intended to measure the capacity of the Object File System in humans. In this type of experiment the measurement result is in well agreement with the value known from the cognitive psychology literature. The experiments called SMNIST for Machines serve similar purposes but they investigate existing, well known (but originally developed for other purpose) and under development deep learning computer programs. These measurement results can be interpreted similar to the results from SMNIST for Humans. The main thesis of this paper can be formulated as follows: in machines the image classification artificial neural networks can learn to distinguish numerosities with better accuracy when these numerosities are smaller than the capacity of OFS in humans. Finally, we outline a conceptual framework to investigate the notion of number in humans and machines.


title: Complex-balanced equilibria of generalized mass-action systems: Necessary conditions for linear stability

abstract: It is well known that, for mass-action systems, complex-balanced equilibria are asymptotically stable. For generalized mass-action systems, even if there exists a unique complex-balanced equilibrium (in every stoichiometric class and for all rate constants), it need not be stable. We first discuss several notions of matrix stability (on a linear subspace) such as D-stability and diagonal stability, and then we apply our abstract results to complex-balanced equilibria of generalized mass-action systems. In particular, we show that linear stability (on the stoichiometric subspace and for all rate constants) implies uniqueness. For cyclic networks, we characterize linear stability (in terms of D-stability of the Jacobian matrix); and for weakly reversible networks, we give necessary conditions for linear stability (in terms of D-semistability of the Jacobian matrices of all cycles in the network). Moreover, we show that, for classical mass-action systems, complex-balanced equilibria are not just asymptotically stable, but even diagonally stable (and hence linearly stable). Finally, we recall and extend characterizations of D-stability and diagonal stability for matrices of dimension up to three, and we illustrate our results by examples of irreversible cycles (of dimension up to three) and of reversible chains and S-systems (of arbitrary dimension).


title: Improving and benchmarking of algorithms for decision making with lower previsions

abstract: Maximality, interval dominance, and E-admissibility are three well-known criteria for decision making under severe uncertainty using lower previsions. We present a new fast algorithm for finding maximal gambles. We compare its performance to existing algorithms, one proposed by Troffaes and Hable (2014), and one by Jansen, Augustin, and Schollmeyer (2017). To do so, we develop a new method for generating random decision problems with pre-specified ratios of maximal and interval dominant gambles. Based on earlier work, we present efficient ways to find common feasible starting points in these algorithms. We then exploit these feasible starting points to develop early stopping criteria for the primal-dual interior point method, further improving efficiency. We find that the primal-dual interior point method works best. We also investigate the use of interval dominance to eliminate non-maximal gambles. This can make the problem smaller, and we observe that this benefits Jansen et al.'s algorithm, but perhaps surprisingly, not the other two algorithms. We find that our algorithm, without using interval dominance, outperforms all other algorithms in all scenarios in our benchmarking.


title: On the robust existence of piecewise quadratic Lyapunov functions for hybrid models of gene regulatory networks

abstract: In this work we addressed the problem of stability analysis for an uncertain piecewise affine model of a genetic regulatory network. In particular we considered polytopic parameter uncertainties on the proteins production rate functions, giving conditions for the existence of a piecewise quadratic Lyapunov function for any possible realization of the system. In the spirit of other works in literature, the resulting conditions will be given on the vertices of the parameter polytope, while still taking into consideration the piecewise nature of the Lyapunov function and the presence, in general, of sliding modes solutions. An example is shown to prove the validity and applicability of the theoretical results.


title: Number conserving particle-hole RPA for superfluid nuclei

abstract: We present a number conserving particle-hole RPA theory for collective excitations in the transition from normal to superfluid nuclei. The method derives from an RPA theory developed long ago in quantum chemistry using antisymmetric geminal powers, or equivalently number projected HFB states, as reference states. We show within a minimal model of pairing plus monopole interactions that the number conserving particle-hole RPA excitations evolve smoothly across the superfluid phase transition close to the exact results, contrary to particle-hole RPA in the normal phase and quasiparticle RPA in the superfluid phase that require a change of basis at the broken symmetry point. The new formalism can be applied in a straightforward manner to study particle-hole excitations on top of a number projected HFB state.


title: Continual Rare-Class Recognition with Emerging Novel Subclasses

abstract: Given a labeled dataset that contains a rare (or minority) class of of-interest instances, as well as a large class of instances that are not of interest, how can we learn to recognize future of-interest instances over a continuous stream? We introduce RaRecognize, which (i) estimates a general decision boundary between the rare and the majority class, (ii) learns to recognize individual rare subclasses that exist within the training data, as well as (iii) flags instances from previously unseen rare subclasses as newly emerging. The learner in (i) is general in the sense that by construction it is dissimilar to the specialized learners in (ii), thus distinguishes minority from the majority without overly tuning to what is seen in the training data. Thanks to this generality, RaRecognize ignores all future instances that it labels as majority and recognizes the recurrent as well as emerging rare subclasses only. This saves effort at test time as well as ensures that the model size grows moderately over time as it only maintains specialized minority learners. Through extensive experiments, we show that RaRecognize outperforms state-of-the art baselines on three real-world datasets that contain corporate-risk and disaster documents as rare classes.


title: On the formal principle for curves on projective surfaces

abstract: We prove that the formal completion of a complex projective surface along a rigid smooth curve with trivial normal bundle determines the birational equivalence class of the surface.


title: Computing Haar Measures

abstract: According to Haar's Theorem, every compact group $G$ admits a unique (regular, right and) left-invariant Borel probability measure $\mu_G$. Let the Haar integral (of $G$) denote the functional $\int_G:\mathcal{C}(G)\ni f\mapsto \int f\,d\mu_G$ integrating any continuous function $f:G\to\mathbb{R}$ with respect to $\mu_G$. This generalizes, and recovers for the additive group $G=[0;1)\mod 1$, the usual Riemann integral: computable (cmp. Weihrauch 2000, Theorem 6.4.1), and of computational cost characterizing complexity class #P$_1$ (cmp. Ko 1991, Theorem 5.32). We establish that in fact every computably compact computable metric group renders the Haar integral computable: once asserting computability using an elegant synthetic argument, exploiting uniqueness in a computably compact space of probability measures; and once presenting and analyzing an explicit, imperative algorithm based on 'maximum packings' with rigorous error bounds and guaranteed convergence. Regarding computational complexity, for the groups $\mathcal{SO}(3)$ and $\mathcal{SU}(2)$ we reduce the Haar integral to and from Euclidean/Riemann integration. In particular both also characterize #P$_1$. Implementation and empirical evaluation using the iRRAM C++ library for exact real computation confirms the (thus necessary) exponential runtime.


title: Safeguarding the Evidential Value of Forensic Cryptocurrency Investigations

abstract: Analyzing cryptocurrency payment flows has become a key forensic method in law enforcement and is nowadays used to investigate a wide spectrum of criminal activities. However, despite its widespread adoption, the evidential value of obtained findings in court is still largely unclear. In this paper, we focus on the key ingredients of modern cryptocurrency analytics techniques, which are clustering heuristics and attribution tags. We identify internationally accepted standards and rules for substantiating suspicions and providing evidence in court and project them onto current cryptocurrency forensics practices. By providing an empirical analysis of CoinJoin transactions, we illustrate possible sources of misinterpretation in algorithmic clustering heuristics. Eventually, we derive a set of legal key requirements and translate them into a technical data sharing framework that fosters compliance with existing legal and technical standards in the realm of cryptocurrency forensics. Integrating the proposed framework in modern cryptocurrency analytics tools could allow more efficient and effective investigations, while safeguarding the evidential value of the analysis and the fundamental rights of affected persons.


title: Symphony of high-dimensional brain

abstract: This paper is the final part of the scientific discussion organised by the Journal "Physics of Life Rviews" about the simplicity revolution in neuroscience and AI. This discussion was initiated by the review paper "The unreasonable effectiveness of small neural ensembles in high-dimensional brain". Phys Life Rev 2019, doi 10.1016/j.plrev.2018.09.005, arXiv:1809.07656. The topics of the discussion varied from the necessity to take into account the difference between the theoretical random distributions and "extremely non-random" real distributions and revise the common machine learning theory, to different forms of the curse of dimensionality and high-dimensional pitfalls in neuroscience. V. K{\r{u}}rkov{\'a}, A. Tozzi and J.F. Peters, R. Quian Quiroga, P. Varona, R. Barrio, G. Kreiman, L. Fortuna, C. van Leeuwen, R. Quian Quiroga, and V. Kreinovich, A.N. Gorban, V.A. Makarov, and I.Y. Tyukin participated in the discussion. In this paper we analyse the symphony of opinions and the possible outcomes of the simplicity revolution for machine learning and neuroscience.


title: Adversarial optimization for joint registration and segmentation in prostate CT radiotherapy

abstract: Joint image registration and segmentation has long been an active area of research in medical imaging. Here, we reformulate this problem in a deep learning setting using adversarial learning. We consider the case in which fixed and moving images as well as their segmentations are available for training, while segmentations are not available during testing; a common scenario in radiotherapy. The proposed framework consists of a 3D end-to-end generator network that estimates the deformation vector field (DVF) between fixed and moving images in an unsupervised fashion and applies this DVF to the moving image and its segmentation. A discriminator network is trained to evaluate how well the moving image and segmentation align with the fixed image and segmentation. The proposed network was trained and evaluated on follow-up prostate CT scans for image-guided radiotherapy, where the planning CT contours are propagated to the daily CT images using the estimated DVF. A quantitative comparison with conventional registration using \texttt{elastix} showed that the proposed method improved performance and substantially reduced computation time, thus enabling real-time contour propagation necessary for online-adaptive radiotherapy.


title: Tetrahedral Geometry from Areas

abstract: We solve a very classical problem motivated by considerations in quantum gravity: providing a description of the geometry of a Euclidean tetrahedron from the initial data of the areas of the faces and the areas of the medial parallelograms of Yetter or equivalently of the pseudofaces of McConnell. In particular, we derive expressions for the dihedral angles, face angles and (an) edge length, the remaining parts being derivable by symmetry or by identities in the classic 1902 compendium of results on tetrahedral geometry of Richardson. We also provide an alternative proof using (bi)vectors of the result of Yetter that four times the sum of the squared areas of the medial parallelograms is equal to the sum of the squared areas of the faces. The updated version corrects several errors and provides better historical context for the result.


title: Modelling Airway Geometry as Stock Market Data using Bayesian Changepoint Detection

abstract: Numerous lung diseases, such as idiopathic pulmonary fibrosis (IPF), exhibit dilation of the airways. Accurate measurement of dilatation enables assessment of the progression of disease. Unfortunately the combination of image noise and airway bifurcations causes high variability in the profiles of cross-sectional areas, rendering the identification of affected regions very difficult. Here we introduce a noise-robust method for automatically detecting the location of progressive airway dilatation given two profiles of the same airway acquired at different time points. We propose a probabilistic model of abrupt relative variations between profiles and perform inference via Reversible Jump Markov Chain Monte Carlo sampling. We demonstrate the efficacy of the proposed method on two datasets; (i) images of healthy airways with simulated dilatation; (ii) pairs of real images of IPF-affected airways acquired at 1 year intervals. Our model is able to detect the starting location of airway dilatation with an accuracy of 2.5mm on simulated data. The experiments on the IPF dataset display reasonable agreement with radiologists. We can compute a relative change in airway volume that may be useful for quantifying IPF disease progression. The code is available at https://github.com/quan14/Modelling_Airway_Geometry_as_Stock_Market_Data


title: Resolution of the ATLAS muon spectrometer monitored drift tubes in LHC Run 2

abstract: The momentum measurement capability of the ATLAS muon spectrometer relies fundamentally on the intrinsic single-hit spatial resolution of the monitored drift tube precision tracking chambers. Optimal resolution is achieved with a dedicated calibration program that addresses the specific operating conditions of the 354000 high-pressure drift tubes in the spectrometer. The calibrations consist of a set of timing offsets and drift time to drift distance transfer relations, and result in chamber resolution functions. This paper describes novel algorithms to obtain precision calibrations from data collected by ATLAS in LHC Run 2 and from a gas monitoring chamber, deployed in a dedicated gas facility. The algorithm output consists of a pair of correction constants per chamber which are applied to baseline calibrations, and determined to be valid for the entire ATLAS Run 2. The final single-hit spatial resolution, averaged over 1172 monitored drift tube chambers, is $81.7 \pm 2.2 \mu$m.


title: An Image Source Method Framework for Arbitrary Reflecting Boundaries

abstract: We propose a theoretical framework for the image source method that generalizes to arbitrary reflecting boundaries, e.g. boundaries that are curved or even with certain openings. Furthermore, it can seamlessly incorporate boundary absorption, source directivity, and nonspecular reflections. This framework is based on the notion of reflection paths that allows the introduction of the concepts of validity and visibility of virtual sources. These definitions facilitate the determination, for a given source and receiver location, of the distribution of virtual sources that explain the boundary effects of a wide range of reflecting surfaces. The structure of the set of virtual sources is then more general than just punctual virtual sources. Due to this more diverse configuration of image sources, we represent the room impulse response as an integral involving the temporal excitation signal against a measure determined by the source and receiver locations, and the original boundary. The latter smoothly enables, in an analytically tractable manner, the incorporation of more general boundary shapes as well as directivity of sources and boundary absorption while, at the same time, maintaining the conceptual benefits of the image source method.


title: Kinetic and internal energy transfer in implicit large eddy simulations of forced compressible turbulence

abstract: We revisit the problem of how energy transfer through the turbulent cascade operates in compressible hydrodynamic turbulence. In general, there is no conservative compressible cascade since the kinetic and internal energy reservoirs can exchange energy through pressure dilatation. Moreover, statistically stationary turbulence at high Mach number can only be maintained in nearly isothermal gas, i.e., if excess heat produced by shock compression and kinetic energy dissipation is continuously removed from the system. We mimic this process by a linear cooling term in numerical simulations of turbulence driven by stochastic forcing. This allows us to investigate turbulence statistics for a broad range of Mach numbers. We compute the rate of change of kinetic and internal energy in wavenumber shells caused by advective, compressive, and pressure dilatation effects and constrain power-law fits to compressible turbulence energy spectra to a range of wavenumbers in which the total energy transfer is close to zero. The resulting scaling exponents are significantly affected by the forcing. Depending on the root mean square Mach number, we find a nearly constant advective component of the cross-scale flux of kinetic energy at intermediate wavenumbers for particular mixtures of solenoidal and compressive modes in the forcing. This suggests the existence of a natural, Mach number dependent mixture of forcing modes. Our findings also support an advection-dominated regime at high Mach numbers with specific scaling exponents (Burgers scaling for the pure velocity fluctuation $u$ and Kolmogorov scaling for the mass-weighted variable $v=\rho^{1/3}u$).


title: A representation of the wave function on the three-dimensional space

abstract: One of the major concerns of Schr\"odinger, Lorentz, Einstein, and many others about the wave function is that it is defined on the $3\mathbf{N}$-dimensional configuration space, rather than on the $3$-dimensional physical space. This gives the impression that quantum mechanics cannot have a three-dimensional space or spacetime ontology, even in the absence of quantum measurements. In particular, this seems to affect interpretations which take the wave function as a physical entity, in particular the many worlds and the spontaneous collapse interpretations, and some versions of the pilot wave theory. Here, a representation of the many-particle states is given, as multi-layered fields defined on the $3$-dimensional physical space. This representation is equivalent to the usual representation on the configuration space, but it makes it explicit that it is possible to interpret the wave functions as defined on the physical space. As long as only unitary evolution is involved, the interactions are local. I intended this representation to capture and formalize the non-explicit and informal intuition of many working quantum physicists, who, by considering the wave function sometimes to be defined on the configuration space, and sometimes on the physical space, may seem to researchers in the foundations of quantum theory as adopting an inconsistent view about its ontology. This representation does not aim to solve the measurement problem, and it allows for Schr\"odinger cats just like the usual one. But it may help various interpretations to solve these problems, through inclusion of the wave function as (part of) their primitive ontology. In an appendix, it is shown how the multi-layered field representation can be extended to quantum field theory.


title: FIESTA: Fast IdEntification of State-of-The-Art models using adaptive bandit algorithms

abstract: We present FIESTA, a model selection approach that significantly reduces the computational resources required to reliably identify state-of-the-art performance from large collections of candidate models. Despite being known to produce unreliable comparisons, it is still common practice to compare model evaluations based on single choices of random seeds. We show that reliable model selection also requires evaluations based on multiple train-test splits (contrary to common practice in many shared tasks). Using bandit theory from the statistics literature, we are able to adaptively determine appropriate numbers of data splits and random seeds used to evaluate each model, focusing computational resources on the evaluation of promising models whilst avoiding wasting evaluations on models with lower performance. Furthermore, our user-friendly Python implementation produces confidence guarantees of correctly selecting the optimal model. We evaluate our algorithms by selecting between 8 target-dependent sentiment analysis methods using dramatically fewer model evaluations than current model selection approaches.


title: Influence of anisotropy, tilt and pairing of Weyl nodes: The Weyl semimetals TaAs, TaP, NbAs and NbP

abstract: By means of $ab \ initio$ band structure methods and model Hamiltonians we investigate the electronic, spin and topological properties of four monopnictides crystallizing in body centered tetragonal structure. We show that the Weyl bands around a Weyl point W1 or W2 possess a strong anisotropy and tilt of the accompanying Dirac cones. These effects are larger for W2 nodes than for W1 ones. The node tilts and positions in energy space significantly influence the density of states of single-particle Weyl excitations. The node anisotropies destroy the conventional picture of (anti)parallel spin and wave vector of a Weyl fermion. This also holds for the Berry curvature around a node, while the monopole charges are independent as integrated quantities. The pairing of the nodes strongly modify the spin texture and the Berry curvature for wave vectors in between the two nodes. Spin components may change their orientation. Integrals over planes perpendicular to the connection line yield finite Zak phases and winding numbers for planes between the two nodes, thereby indicating the topological character.


title: Recent Results on $\tau$ Decays

abstract: We present herein new results from Belle on the $\tau^- \rightarrow \pi^- \nu_{\rm \tau} \ell^+ \ell^- $ branching fraction and from BABAR on the $\tau^- \rightarrow K^- (0,1,2,3) \pi^0 \nu_{\rm \tau}$, $\tau^- \rightarrow \pi^- (3,4) \pi^0 \nu_{\rm \tau}$ and $\tau^- \rightarrow K^- K^0_{\rm S} \nu_{\rm \tau}$ branching fractions. From the $K^- K^0_{\rm S}$ mass spectrum we determine the spectral function. The improved branching fraction measurements of the $\tau^- \rightarrow K^- (0,1,2,3) \pi^0 \nu_{\rm \tau}$ decays are used to determine $|V_{\rm us}|$ from $\tau^- \rightarrow X_{\rm s}^- \nu_{\rm \tau}$ inclusive decays.


title: Well-posedness of strong solutions to the anelastic equations of stratified viscous flows

abstract: We establish the local and global well-posedness of strong solutions to the two- and three-dimensional anelastic equations of stratified viscous flows. In this model, the interaction of the density profile with the velocity field is taken into account, and the density background profile is permitted to have physical vacuum singularity. The existing time of the solutions is infinite in two dimensions, with general initial data, and in three dimensions with small initial data.


title: The $\dot W^{-1,p}$ Neumann problem for higher order elliptic equations

abstract: We solve the Neumann problem in the half space $\mathbb{R}^{n+1}_+$, for higher order elliptic differential equations with variable self-adjoint $t$-independent coefficients, and with boundary data in the negative smoothness space $\dot W^{-1,p}$, where $\max(0,\frac{1}{2}-\frac{1}{n}-\varepsilon) <\frac{1}{p} <\frac{1}{2}$. Our arguments are inspired by an argument of Shen and build on known well posedness results in the case $p=2$. We use the same techniques to establish nontangential and square function estimates on layer potentials with inputs in $L^p$ or $\dot W^{\pm1,p}$ for a similar range of $p$, based on known bounds for $p$ near $2$; in this case we may relax the requirement of self-adjointess.


title: On graphs with equal total domination and Grundy total domination number

abstract: A sequence $(v_1,\ldots ,v_k)$ of vertices in a graph $G$ without isolated vertices is called a total dominating sequence if every vertex $v_i$ in the sequence totally dominates at least one vertex that was not totally dominated by $\{v_1,\ldots , v_{i-1}\}$ and $\{v_1,\ldots ,v_k\}$ is a total dominating set of $G$. The length of a shortest such sequence is the total domination number of G ($\gamma_t(G)$), while the length of a longest such sequence is the Grundy total domination number of $G$ ($\gamma_{gr}^t(G)$). In this paper we study graphs with equal total and Grundy total domination number. We characterize bipartite graphs with both total and Grundy total domination number equal to 4, and show that there is no connected chordal graph $G$ with $\gamma_t(G)=\gamma_{gr}^t(G)=4$. The main result of the paper is a characterization of regular bipartite graphs with $\gamma_t(G)=\gamma_{gr}^t(G)=6$ proved by establishing a surprising correspondence between existence of such graphs and a classical but still open problem of the existence of certain finite projective planes.


title: Implications from Late-Time X-ray Detections of Optically Selected Tidal Disruption Events: State Changes, Unification, and Detection Rates

abstract: We present Chandra X-ray observations of four optically-selected tidal disruption events (TDEs) obtained 4-9 years after discovery. Three sources were detected with luminosities between 9X10^40 and 3X10^42 erg/s. The spectrum of PTF09axc is consistent with a power law of index 2.5+-0.1, whereas the spectrum of PTF09ge is very soft. The power law spectrum of PTF09axc and prior literature findings, provide evidence that TDEs transition from an early-time soft state to a late-time hard state many years after disruption. We propose that the time to peak luminosity for optical and X-ray emission may differ substantially in TDEs, with X-rays being produced or becoming observable later. This delay helps explain the differences in observed properties such as L_opt/L_ X of optically and X-ray selected TDEs. We update TDE rate predictions for the eROSITA instrument: it ranges from 3 per yr to 990 per yr, depending sensitively on the distribution of black hole spins and the time delay between disruption and peak X-ray brightness. We further predict an asymmetry in the number of retrograde and prograde disks in samples of optically and X-ray selected TDEs. The details of the observational biases can contribute to observed differences between optically and X-ray selected TDEs (with optically selected TDEs being fainter in X-rays for retrograde TDE disks).


title: SybilQuorum: Open Distributed Ledgers Through Trust Networks

abstract: The Sybil attack plagues all peer-to-peer systems, and modern open distributed ledgers employ a number of tactics to prevent it from proof of work, or other resources such as space, stake or memory, to traditional admission control in permissioned settings. With SybilQuorum we propose an alternative approach to securing an open distributed ledger against Sybil attacks, and ensuring consensus amongst honest participants, leveraging social network based Sybil defences. We show how nodes expressing their trust relationships through the ledger can bootstrap and operate a value system, and general transaction system, and how Sybil attacks are thwarted. We empirically evaluate our system as a secure Federated Byzantine Agreement System, and extend the theory of those systems to do so.


title: Far-from-equilibrium dynamics of angular momentum in a quantum many-particle system

abstract: We use laser-induced rotation of single molecules embedded in superfluid helium nanodroplets to reveal angular momentum dynamics and transfer in a controlled setting, under far-from-equilibrium conditions. As an unexpected result, we observe pronounced oscillations of time-dependent molecular alignment that have no counterpart in gas-phase molecules. Angulon theory reveals that these oscillations originate from the unique rotational structure of molecules in He droplets and quantum-state-specific transfer of rotational angular momentum to the many-body He environment on picosecond timescales. Our results pave the way to understanding collective effects of macroscopic angular momentum exchange in solid state systems in a bottom-up fashion.

categories: physics.atm-clus cond-mat.mes-hall cond-mat.quant-gas physics.atom-ph physics.chem-ph


title: L*-Based Learning of Markov Decision Processes (Extended Version)

abstract: Automata learning techniques automatically generate system models from test observations. These techniques usually fall into two categories: passive and active. Passive learning uses a predetermined data set, e.g., system logs. In contrast, active learning actively queries the system under learning, which is considered more efficient. An influential active learning technique is Angluin's L* algorithm for regular languages which inspired several generalisations from DFAs to other automata-based modelling formalisms. In this work, we study L*-based learning of deterministic Markov decision processes, first assuming an ideal setting with perfect information. Then, we relax this assumption and present a novel learning algorithm that collects information by sampling system traces via testing. Experiments with the implementation of our sampling-based algorithm suggest that it achieves better accuracy than state-of-the-art passive learning techniques with the same amount of test data. Unlike existing learning algorithms with predefined states, our algorithm learns the complete model structure including the states.


title: Cosmic ray acceleration by shocks: spectral steepening due to turbulent magnetic field amplification

abstract: We show that the energy required to turbulently amplify magnetic field during cosmic ray (CR) acceleration by shocks extracts energy from the CR and steepens the CR energy spectrum.


title: Is the fermionic exchange phase also acquired locally?

abstract: We argue that the fermionic exchange phase could be detected by local means. We propose a simple experiment to test our idea. This leads us to speculate that there might be a deeper mechanism behind the notion of particle statistics in quantum physics that goes beyond the conventional argument based on the spin-statistics connections.


title: Bidirectional Type Class Instances (Extended Version)

abstract: GADTs were introduced in Haskell's eco-system more than a decade ago, but their interaction with several mainstream features such as type classes and functional dependencies has a lot of room for improvement. More specifically, for some GADTs it can be surprisingly difficult to provide an instance for even the simplest of type classes. In this paper we identify the source of this shortcoming and address it by introducing a conservative extension to Haskell's type classes: Bidirectional Type Class Instances. In essence, under our interpretation class instances correspond to logical bi-implications, in contrast to their traditional unidirectional interpretation. We present a fully-fledged design of bidirectional instances, covering the specification of typing and elaboration into System FC, as well as an algorithm for type inference and elaboration. We provide a proof-of-concept implementation of our algorithm, and revisit the meta-theory of type classes in the presence of our extension.


title: A multifactorial evaluation framework for gene regulatory network reconstruction

abstract: In the past years, many computational methods have been developed to infer the structure of gene regulatory networks from time-series data. However, the applicability and accuracy presumptions of such algorithms remain unclear due to experimental heterogeneity. This paper assesses the performance of recent and successful network inference strategies under a novel, multifactorial evaluation framework in order to highlight pragmatic tradeoffs in experimental design. The effects of data quantity and systems perturbations are addressed, thereby formulating guidelines for efficient resource management. Realistic data were generated from six widely used benchmark models of rhythmic and non-rhythmic gene regulatory systems with random perturbations mimicking the effect of gene knock-out or chemical treatments. Then, time-series data of increasing lengths were provided to five state-of-the-art network inference algorithms representing distinctive mathematical paradigms. The performances of such network reconstruction methodologies are uncovered under various experimental conditions. We report that the algorithms do not benefit equally from data increments. Furthermore, for rhythmic systems, it is more profitable for network inference strategies to be run on long time-series rather than short time-series with multiple perturbations. By contrast, for the non-rhythmic systems, increasing the number of perturbation experiments yielded better results than increasing the sampling frequency. We expect that future benchmark and algorithm design would integrate such multifactorial considerations to promote their widespread and conscientious usage.


title: The Hunt for Primordial Interactions in the Large Scale Structures of the Universe

abstract: The understanding of the primordial mechanism that seeded the cosmic structures we observe today in the sky is one of the major goals in cosmology. The leading paradigm for such a mechanism is provided by the inflationary scenario, a period of violent accelerated expansion in the very early stages of evolution of the Universe. While our current knowledge of the physics of inflation is limited to phenomenological models which fit observations, an exquisite understanding of the particle content and interactions taking place during inflation would provide breakthroughs in our understanding of fundamental physics at high energies. In this review, we summarize recent theoretical progress in the modelling of the imprint of primordial interactions in the large scale structures of the Universe. We focus specifically on the effects of such interactions on the statistical distribution of dark matter halos, providing a consistent treatment of the steps required to connect the correlations generated among fields during inflation all the way to the late-time correlations of halos.


title: Variance reduction for effective energies of random lattices in the Thomas-Fermi-von Weizs\"acker model

abstract: In the computation of the material properties of random alloys, the method of "special quasirandom structures" attempts to approximate the properties of the alloy on a finite volume with higher accuracy by replicating certain statistics of the random atomic lattice in the finite volume as accurately as possible. In the present work, we provide a rigorous justification for a variant of this method in the framework of the Thomas-Fermi-von Weizs\"acker (TFW) model. Our approach is based on a recent analysis of a related variance reduction method in stochastic homogenization of linear elliptic PDEs and the locality properties of the TFW model. Concerning the latter, we extend an exponential locality result by Nazar and Ortner to include point charges, a result that may be of independent interest.


title: Quantum generalized Kac--Moody algebras via Hall algebras of complexes

abstract: We establish an embedding of the quantum enveloping algebra of a symmetric generalized Kac--Moody algebra into a localized Hall algebra of $\mathbb Z_2$-graded complexes of representations of a quiver with (possible) loops. To overcome difficulties resulting from the existence of infinite dimensional projective objects, we consider the category of finitely-presented representations and the category of $\mathbb Z_2$-graded complexes of projectives with finite homology.


title: Characterizing dielectric properties of ultra-thin films using superconducting coplanar microwave resonators

abstract: We present an experimental approach for cryogenic dielectric measurements on ultra-thin insulating films. Based on a coplanar microwave waveguide design we implement superconducting quarter-wave resonators with inductive coupling, which allows us to determine the real part $\varepsilon_1$ of the dielectric function at GHz frequencies and for sample thicknesses down to a few nm. We perform simulations to optimize resonator coupling and sensitivity, and we demonstrate the possibility to quantify $\varepsilon_1$ with a conformal mapping technique in a wide sample-thickness and $\varepsilon_1$-regime. Experimentally we determine $\varepsilon_1$ for various thin-film samples (photoresist, MgF$_2$, and SiO$_2$) in the thickness regime of nm up to $\mu m$. We find good correspondence with nominative values and we identify the precision of the film thickness as our predominant error source. Additionally we present a temperature-dependent measurement for a SrTiO$_3$ bulk sample, using an in-situ reference method to compensate for the temperature dependence of the superconducting resonator properties.


title: Real-Time Digital Video Streaming at Low-VHF for Compact Autonomous Agents in Complex Scenes

abstract: This paper presents an experimental investigation of real-time digital video streaming in physically complex Non-Line-Of-Sight (NLoS) channels using a low-power, low-VHF system integrated on a compact robotic platform. Reliable video streaming in NLoS channels over infrastructure-poor ad-hoc radio networks is challenging due to multipath and shadow fading. In this effort, we focus on exploiting the near-ground low-VHF channel which has been shown to have improved penetration, reduced fading, and lower power requirements (which is critical for autonomous agents with limited power) compared to higher frequencies. Specifically, we develop a compact, low-power, low-VHF radio test-bed enabled by recent advances in efficient miniature antennas and off-the-shelf software-defined radios. Our main goal is to carry out an empirical study in realistic environments of how the improved propagation conditions at low-VHF affect the reliability of video-streaming with constraints stemming from the limited available bandwidth with electrically small low-VHF antennas. We show quantitative performance analysis of video streaming from a robotic platform navigating inside a large occupied building received by a node located outdoors: bit error rate (BER) and channel-induced Peak Signal-to-Noise Ratio (PSNR) degradation. The results show channel-effect-free-like video streaming with the low-VHF system in complex NLoS channels.


title: Anticipatory Thinking: A Metacognitive Capability

abstract: Anticipatory thinking is a complex cognitive process for assessing and managing risk in many contexts. Humans use anticipatory thinking to identify potential future issues and proactively take actions to manage their risks. In this paper we define a cognitive systems approach to anticipatory thinking as a metacognitive goal reasoning mechanism. The contributions of this paper include (1) defining anticipatory thinking in the MIDCA cognitive architecture, (2) operationalizing anticipatory thinking as a three step process for managing risk in plans, and (3) a numeric risk assessment calculating an expected cost-benefit ratio for modifying a plan with anticipatory actions.


title: Adaptation and learning over networks under subspace constraints -- Part II: Performance Analysis

abstract: Part I of this paper considered optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network to lie in low-dimensional subspaces. Starting from the centralized projected gradient descent, an iterative and distributed solution was proposed that responds to streaming data and employs stochastic approximations in place of actual gradient vectors, which are generally unavailable. We examined the second-order stability of the learning algorithm and we showed that, for small step-sizes $\mu$, the proposed strategy leads to small estimation errors on the order of $\mu$. This Part II examines steady-state performance. The results reveal explicitly the influence of the gradient noise, data characteristics, and subspace constraints, on the network performance. The results also show that in the small step-size regime, the iterates generated by the distributed algorithm achieve the centralized steady-state performance.


title: Engineering study on the use of Head-Mounted display for Brain- Computer Interface

abstract: In this article, we explore the availability of head-mounted display (HMD) devices which can be coupled in a seamless way with P300-based brain-computer interfaces (BCI) using electroencephalography (EEG). The P300 is an event-related potential appearing about 300ms after the onset of a stimulation. The recognition of this potential on the ongoing EEG requires the knowledge of the exact onset of the stimuli. In other words, the stimulations presented in the HMD must be perfectly synced with the acquisition of the EEG signal. This is done through a process called tagging. The tagging must be performed in a reliable and robust way so as to guarantee the recognition of the P300 and thus the performance of the BCI. An HMD device should also be able to render images fast enough to allow an accurate perception of the stimulations, and equally to not perturb the acquisition of the EEG signal. In addition, an affordable HMD device is needed for both research and entertainment purposes. In this study, we selected and tested two HMD configurations.


title: Algorithmic construction of SYM multiparticle superfields in the BCJ gauge

abstract: We write down closed formulas for all necessary steps to obtain multiparticle super Yang--Mills superfields in the so-called BCJ gauge. The superfields in this gauge have obvious applications in the quest for finding BCJ-satisfying representations of amplitudes. As a benefit of having these closed formulas, we identify the explicit finite gauge transformation responsible for attaining the BCJ gauge. To do this, several combinatorial maps on words are introduced and associated identities rigorously proven.


title: Structural phases of elemental Gallium: universal relations in type-I superconductors

abstract: The temperature dependent measurements of the thermodynamic critical field and the specific heat for the pressure stabilized Ga-II phase of elemental Gallium are presented. The discussion of these and other Ga phases data in the context of elemental and binary phonon-mediated type-I superconductors allowed to establish simple scaling relations between BCS quantities such as $B_{\rm c}(0)/T_{\rm c}\sqrt{\gamma_{\rm e}}$ and the specific heat jump at $T_{\rm c}$ versus the coupling strength $2\Delta/k_{\rm B} T_{\rm c}$ [$\Delta$ and $B_{\rm c}(0)$ are the zero-temperature values of the superconducting energy gap and the thermodynamic critical field, respectively, $T_{\rm c}$ is the transition temperature, and $\gamma_{\rm e}$ is the electronic specific heat]. The scaling relations can be analytically expressed by taking into account strong-coupling corrections to BCS theory. Such correlations can naturally explain the linear relation between $B_{\rm c}(0)$ and $T_{\rm c}$, which holds for type-I superconducting materials.


title: Zero-field propagation of spin waves in waveguides prepared by focused ion beam direct writing

abstract: Metastable face-centered-cubic Fe78Ni22 thin films grown on Cu(001) substrates are excellent candidates for focused ion beam direct writing of magnonic structures due to their favorable magnetic properties after ion-beam-induced transformation. The focused ion beam transforms the originally nonmagnetic fcc phase into the ferromagnetic bcc phase with additional control over the direction of uniaxial magnetic in-plane anisotropy. The magnetocrystalline anisotropy in transformed areas is strong enough to stabilize the magnetization in transverse direction to the long axis of narrow waveguides. Therefore, it is possible to propagate spin waves in these waveguides without the presence of an external magnetic field in the favorable Demon-Eshbach geometry. Phase-resolved micro-focused Brillouin light scattering yields the dispersion relation of these waveguides in zero as well as in nonzero external magnetic fields.


title: An Energy Stable BDF2 Fourier Pseudo-Spectral Numerical Scheme for the Square Phase Field Crystal Equation

abstract: In this paper we propose and analyze an energy stable numerical scheme for the square phase field crystal (SPFC) equation, a gradient flow modeling crystal dynamics at the atomic scale in space but on diffusive scales in time. In particular, a modification of the free energy potential to the standard phase field crystal model leads to a composition of the 4-Laplacian and the regular Laplacian operators. To overcome the difficulties associated with this highly nonlinear operator, we design numerical algorithms based on the structures of the individual energy terms. A Fourier pseudo-spectral approximation is taken in space, in such a way that the energy structure is respected, and summation-by-parts formulae enable us to study the discrete energy stability for such a high-order spatial discretization. In the temporal approximation, a second order BDF stencil is applied, combined with an appropriate extrapolation for the concave diffusion term(s). A second order artificial Douglas-Dupont-type regularization term is added to ensure energy stability, and a careful analysis leads to the artificial linear diffusion coming at an order lower that that of surface diffusion term. Such a choice leads to reduced numerical dissipation. At a theoretical level, the unique solvability, energy stability are established, and an optimal rate convergence analysis is derived in the $\ell^\infty (0,T; \ell^2) \cap \ell^2 (0,T; H_N^3)$ norm. In the numerical implementation, the preconditioned steepest descent (PSD) iteration is applied to solve for the composition of the highly nonlinear 4-Laplacian term and the standard Laplacian term, and a geometric convergence is assured for such an iteration. Finally, a few numerical experiments are presented, which confirm the robustness and accuracy of the proposed scheme.


title: The annealed spectral sample of Voronoi percolation

abstract: In this paper, we introduce and study the annealed spectral sample of Voronoi percolation, which is a continuous and finite point process in $\mathbb{R}^2$ whose definition is mostly inspired by the spectral sample of Bernoulli percolation introduced in [GPS10] by Garban, Pete and Schramm. We show a clustering effect as well as estimates on the full lower tail of this spectral object. Our main motivation is the study of two models of dynamical critical Voronoi percolation in the plane. In the first model, the Voronoi tiling does not evolve in time while the colors of the cells are resampled at rate $1$. In the second model, the centers of the cells move according to (independent) long range stable L\'evy processes but the colors do not evolve in time. We prove that for these two dynamical processes there exist almost surely exceptional times with an unbounded monochromatic component.


title: The origin of spin in binary black holes: Predicting the distributions of the main observables of Advanced LIGO

abstract: We study the formation of coalescing binary black holes via the evolution of isolated field binaries that go through the common envelope phase in order to obtain the combined distributions of the main observables of Advanced LIGO. We used a hybrid technique that combines the parametric binary population synthesis code COMPAS with detailed binary evolution simulations performed with the MESA code. We then convolved our binary evolution calculations with the redshift- and metallicity-dependent star-formation rate and the selection effects of gravitational-wave detectors to obtain predictions of observable properties. By assuming efficient angular momentum transport, we are able to present a model that is capable of simultaneously predicting the three main gravitational-wave observables: the effective inspiral spin parameter $\chi_{eff}$, the chirp mass $M_{chirp}$, and the cosmological redshift of merger $z_{merger}$. We find an excellent agreement between our model and the ten events from the first two advanced detector observing runs. We make predictions for the third observing run O3 and for Advanced LIGO design sensitivity. We expect around 80% of events with $\chi_{eff} < 0.1$, while the remaining 20% of events with $\chi_{eff} \ge 0.1$ are split into ~10% with $M_{chirp} < 15$ M$_\odot$ and ~10% with $M_{chirp} \ge 15$ M$_\odot$. In conclusion, the favorable comparison of the existing LIGO/Virgo observations with our model predictions gives support to the idea that the majority, if not all of the observed mergers, originate from the evolution of isolated binaries. The first-born black hole has negligible spin because it lost its envelope after it expanded to become a giant star, while the spin of the second-born black hole is determined by the tidal spin up of its naked helium star progenitor by the first-born black hole companion after the binary finished the common-envelope phase.


title: Astrophysical neutrinos: theory

abstract: In the era of multi-messenger astronomy, neutrinos are among the most important astronomical messengers, due to their interaction properties. In these lessons I briefly review the main issues concerning the theory on astrophysical neutrinos.


title: The warm Gaseous Disk and the Anisotropic Circumgalactic Medium of the Milky Way

abstract: The warm ($\log~T\approx5$) gas is an important gaseous component in the galaxy baryonic cycle. We built a 2-dimension disk-CGM model to study the warm gas distribution of the Milky Way (MW) using the absorption line surveys of Si IV and O VI. In this model, the disk component of both ions has the same density profile ($n(r, z)=n_0\exp(-|z|/z_0)\exp(-r/r_0)$) with a scale height of $z_0=2.6\pm0.4\rm~kpc$ and a scale length of $r_0=6.1\pm1.2\rm~kpc$. For this disk component, we calculate the warm gas mass of $\log(M/M_\odot)=(7.6\pm0.2)-\log\frac{Z}{Z_\odot}$. The similar disk density profiles and total masses of Si IV and O VI-bearing gas set constraints on the ionization mechanisms. We suggest that the warm gas disk might be dominated by the Galactic fountain mechanism, which ejects and recycles gas to set both the scale height and the scale length of the warm gas disk. The CGM component in our model has a dependence on Galactic latitude with a higher column density along the direction perpendicular to the Galactic plane ($b=90^\circ$) than the column density along the radial direction ($b=0^\circ$). The column density difference between these two directions is $0.82\pm0.32\rm~dex$ at $6.3\sigma$ for both ions. This difference may be due to the enrichment of Galactic feedback to the entire CGM, or an additional interaction layer between the warm gas disk and the CGM; existing data cannot distinguish between these two scenarios. If this higher column density at $b=90^\circ$ is for the entire CGM, the total warm CGM mass is $\log(M/M_\odot)\approx(9.5-9.8)-\log\frac{Z}{0.5Z_\odot}$ within the MW virial radius of $250\rm~kpc$.


title: Magnetic resonance imaging with optical preamplification and detection

abstract: Magnetic resonance (MR) imaging relies on conventional electronics that is increasingly challenged by the push for stronger magnetic fields and higher channel count. These problems can be avoided by utilizing optical technologies. As a replacement for the standard low-noise preamplifier, we have implemented a new transduction principle that upconverts an MR signal to the optical domain and imaged a phantom in a clinical 3 T scanner with signal-to-noise comparable to classical induction detection.


title: Clustering and Expected Seat-Share for District Maps

abstract: In the context of modern sampling methods for redistricting, we define a natural measurement of the clustering of a political party, and we study how clustering affects the expected election outcome. We first prove general results and then apply this framework to understand how the political geography in Pennsylvania affects the expected outcome of congressional elections.


title: Asteroseismology of solar-type stars

abstract: Until the last few decades, investigations of stellar interiors had been restricted to theoretical studies only constrained by observations of their global properties and external characteristics. However, in the last thirty years the field has been revolutionized by the ability to perform seismic investigations of stellar interiors. This revolution begun with the Sun, where helioseismology has been yielding information competing with what can be inferred about the Earth's interior from geoseismology. The last two decades have witnessed the advent of asteroseismology of solar-like stars, thanks to a dramatic development of new observing facilities providing the first reliable results on the interiors of distant stars. The coming years will see a huge development in this field. In this review we focus on solar-type stars, i.e., cool main-sequence stars where oscillations are stochastically excited by surface convection. After a short introduction and a historical overview of the discipline, we review the observational techniques generally used, and we describe the theory behind stellar oscillations in cool main-sequence stars. We continue with a complete description of the normal mode analyses through which it is possible to extract the physical information about the structure and dynamics of the stars. We then summarize the lessons that we have learned and discuss unsolved issues and questions that are still unanswered.


title: Compressing Flow Fields with Edge-aware Homogeneous Diffusion Inpainting

abstract: In spite of the fact that efficient compression methods for dense two-dimensional flow fields would be very useful for modern video codecs, hardly any research has been performed in this area so far. Our paper addresses this problem by proposing the first lossy diffusion-based codec for this purpose. It keeps only a few flow vectors on a coarse grid. Additionally stored edge locations ensure the accurate representation of discontinuities. In the decoding step, the missing information is recovered by homogeneous diffusion inpainting that incorporates the stored edges as reflecting boundary conditions. In spite of the simple nature of this codec, our experiments show that it achieves remarkable quality for compression ratios up to 800 : 1.


title: Accurate Robotic Pouring for Serving Drinks

abstract: Pouring is the second most frequently executed motion in cooking scenarios. In this work, we present our system of accurate pouring that generates the angular velocities of the source container using recurrent neural networks. We collected demonstrations of human pouring water. We made a physical system on which the velocities of the source container were generated at each time step and executed by a motor. We tested our system on pouring water from containers that are not used for training and achieved an error of as low as 4 milliliters. We also used the system to pour oil and syrup. The accuracy achieved with oil is slightly lower than but comparable with that of water.


title: Direct probe of the interior of an electric pion in a Cooper pair superinsulator

abstract: The nature of hadrons is one of the most fundamental mysteries of physics. It is generally agreed that they are made of "colored" quarks, which move nearly free at short scales but are confined inside hadrons by strong interactions at large distances. Because of confinement, quarks are never directly observable and, experimentally, their properties can be tested only indirectly, via high energy collisions. Here we show that superinsulating films realize a complete, one-color model system of hadron physics with Cooper pairs playing the role of quarks. We report measurements on highly controlled NbTiN films that provide a window into the interior of "Cooper pair mesons" and present the first direct evidence of asymptotic freedom, `t Hooft's dual superconductivity confinement mechanism, and magnetic monopoles.


title: Growing Action Spaces

abstract: In complex tasks, such as those with large combinatorial action spaces, random exploration may be too inefficient to achieve meaningful learning progress. In this work, we use a curriculum of progressively growing action spaces to accelerate learning. We assume the environment is out of our control, but that the agent may set an internal curriculum by initially restricting its action space. Our approach uses off-policy reinforcement learning to estimate optimal value functions for multiple action spaces simultaneously and efficiently transfers data, value estimates, and state representations from restricted action spaces to the full task. We show the efficacy of our approach in proof-of-concept control tasks and on challenging large-scale StarCraft micromanagement tasks with large, multi-agent action spaces.


title: Derived invariants from topological Hochschild homology

abstract: We consider derived invariants of varieties in positive characteristic arising from topological Hochschild homology. Using theory developed by Ekedahl and Illusie-Raynaud in their study of the slope spectral sequence, we examine the behavior under derived equivalences of various $p$-adic quantities related to Hodge-Witt and crystalline cohomology groups, including slope numbers, domino numbers, and Hodge-Witt numbers. As a consequence, we obtain restrictions on the Hodge numbers of derived equivalent varieties, partially extending results of Popa-Schell to positive characteristic.


title: Quantum periodicity and Kirillov-Reshetikhin modules

abstract: We give a proof of the periodicity of quantum $T$-systems of type $A_n\times A_\ell$ with certain spiral boundary conditions. Our proof is based on categorification of the $T$-system in terms of the representation theory of quantum affine algebras, more precisely on relations between classes of Kirillov-Reshetikhin modules and of evaluation modules.


title: Certifiable Robustness and Robust Training for Graph Convolutional Networks

abstract: Recent works show that Graph Neural Networks (GNNs) are highly non-robust with respect to adversarial attacks on both the graph structure and the node attributes, making their outcomes unreliable. We propose the first method for certifiable (non-)robustness of graph convolutional networks with respect to perturbations of the node attributes. We consider the case of binary node attributes (e.g. bag-of-words) and perturbations that are L_0-bounded. If a node has been certified with our method, it is guaranteed to be robust under any possible perturbation given the attack model. Likewise, we can certify non-robustness. Finally, we propose a robust semi-supervised training procedure that treats the labeled and unlabeled nodes jointly. As shown in our experimental evaluation, our method significantly improves the robustness of the GNN with only minimal effect on the predictive accuracy.


title: Control of magnons via ultrafast magnetization modulation

abstract: We demonstrate optical control of magnons using femtosecond laser pulses by performing ab-initio real-time time-dependent density functional theory (TDDFT) simulations. We predict that the spin-wave dynamics in Fe$_{50}$Ni$_{50}$ can be manipulated by tailoring the applied laser pulse via three distinct mechanisms: (1) element selective destruction of magnon modes depending on the laser intensity, (2) delay dependent freezing of the magnon mode into a transient non-collinear state (where delay is in the pulse peak with respect to the start of simulations), and (3) optically induced inter sublattice transfer (OISTR) driven renormalization of the optical magnon frequency. Harnessing such processes would significantly speed up magnonic devices.


title: Mapping different skyrmion phases in double wedges of Ta/FeCoB(tFeCoB)/Ta(tTa)Ox

abstract: Skyrmions are chiral magnetic textures that have immense potential for applications in spintronic devices. However, their formation is quite challenging and necessitates a subtle balance of the magnetic interactions at play. Here, we study Ta/FeCoB/TaOx trilayer using crossed double wedges i.e. thickness gradients of FeCoB and of top Ta, which is subsequently oxidized leading to an oxidation gradient. This enabled us to observe micron-sized skyrmions in the vicinity of different transition regions of the sample: from perpendicular magnetic anisotropy to paramagnetic phase and also from perpendicular to in-plane magnetic anisotropy. These observations can be explained by the isolated bubble model taking into account the different energy contributions at play namely anisotropy, exchange, Dzyaloshinskii-Moriya, dipolar and Zeeman. We also qualitatively compare the current-induced motion of skyrmions obtained in different transition regions. Our study not only provides an effective means to form skyrmions by tuning the interfacial magnetic properties but also highlights the differences pertaining to the skyrmions observed in different transition zones, which is extremely crucial for any envisaged application.


title: Weighing the Sun with five photographs

abstract: With only five photographs of the Sun at different dates we show that the mass of Sun can be calculated by using a telescope, a camera, and the Kepler's third law. With these photographs we are able to calculate the distance between Sun and Earth at different dates in a period of time of about three months. These distances allow us to obtain the correct elliptical orbit of Earth, proving the Kepler's first law. The analysis of the data extracted from photographs is performed by using an analytical optimization approach that allow us to find the parameters of the elliptical orbit. Also, it is shown that the five data points fit an ellipse using an geometrical scheme. The obtained parameters are in very good agreement with the ones for Earth's orbit, allowing us to foresee the future positions of Earth along its trajectory. The parameters for the orbit are used to calculate the Sun's mass by applying the Kepler's third law and Newton's law for gravitation. This method gives a result wich is in excellent agreement with the correct value for the Sun's mass. Thus, in a span of time of about three months, any student is capable to calculate the mass of the sun with only five photographs, a telescope and a camera.


title: Helium Variation Across Two Solar Cycles Reveals A Speed-Dependent Phase Lag

abstract: We study the relationship between solar wind helium to hydrogen abundance ratio ($A_\mathrm{He}$), solar wind speed ($v_\mathrm{SW}$), and sunspot number (SSN) over solar cycles 23 and 24. This is the first full 22-year Hale cycle measured with the Wind spacecraft covering a full cycle of the solar dynamo with two polarity reversals. While previous studies have established a strong correlation between $A_\mathrm{He}$ and SSN, we show that the phase delay between $A_\mathrm{He}$ and SSN is a monotonic increasing function of $v_\mathrm{SW}$. Correcting for this lag, $A_\mathrm{He}$ returns to the same value at a given SSN over all rising and falling phases and across solar wind speeds. We infer that this speed-dependent lag is a consequence of the mechanism that depletes slow wind $A_\mathrm{He}$ from its fast wind value during solar wind formation.


title: Reaching Stable Marriage via Divorces is Hard

abstract: We study the Reaching Stable Marriage via Divorces (DivorceSM) problem of deciding, given a Stable Marriage instance and an initial matching $M$ , whether there exists a stable matching which is reachable from $M$ by divorce operations as introduced by Knuth [12]. Towards answering an open question of Manlove [13] and Cechl\'arov\'a et al. [3], we show that for incomplete preferences without ties, DivorceSM is NP-hard. Our hardness reduction also implies that the problem remains parameterized intractable for the number $\kappa$ of allowed divorce operations. It remains NP-hard even if the maximum length $d$ of the preferences is a constant. For the combined parameter ($\kappa$, $d$), the problem is fixed-parameter tractable.


title: Coextension of scalars in operad theory

abstract: The functor between operadic algebras given by restriction along an operad map generally has a left adjoint. We give a necessary and sufficient condition for the restriction functor to admit a right adjoint. The condition is a factorization axiom which roughly says that operations in the codomain operad can be written essentially uniquely as operations in arity one followed by operations in the domain operad.


title: Resolving numerical star formation: A cautionary tale

abstract: Resolution studies of test problems set baselines and help define minimum resolution requirements, however, resolution studies must also be performed on scientific simulations to determine the effect of resolution on the specific scientific results. We perform a resolution study on the formation of a protostar by modelling the collapse of gas through 14 orders of magnitude in density. This is done using compressible radiative non-ideal magnetohydrodynamics. Our suite consists of an ideal magnetohydrodynamics (MHD) model and two non-ideal MHD models, and we test three resolutions for each model. The resulting structure of the ideal MHD model is approximately independent of resolution, although higher magnetic field strengths are realised in higher resolution models. The non-ideal MHD models are more dependent on resolution, specifically the magnetic field strength and structure. Stronger magnetic fields are realised in higher resolution models, and the evolution of detailed structures such as magnetic walls are only resolved in our highest resolution simulation. In several of the non-ideal MHD models, there is an off-set between the location of the maximum magnetic field strength and the maximum density, which is often obscured or lost at lower resolutions. Thus, understanding the effects of resolution on numerical star formation is imperative for understanding the formation of a star.


title: Above and beyond: Holographic tracking of axial displacements in holographic optical tweezers

abstract: How far a particle moves along the optical axis in a holographic optical trap is not simply dictated by the programmed motion of the trap, but rather depends on an interplay of the trap's changing shape and the particle's material properties. For the particular case of colloidal spheres in optical tweezers, holographic video microscopy reveals that trapped particles tend to move farther along the axial direction than the traps that are moving them and that different kinds of particles move by different amounts. These surprising and sizeable variations in axial placement can be explained by a dipole-order theory for optical forces. Their discovery highlights the need for real-time feedback to achieve precise control of colloidal assemblies in three dimensions and demonstrates that holographic microscopy can meet that need.


title: Peak Age of Information in Priority Queueing Systems

abstract: We consider a priority queueing system where a single processor serves k classes of packets that are generated randomly following Poisson processes. Our objective is to compute the expected Peak Age of Information (PAoI) under various scenarios. In particular, we consider two situations where the buffer size at each queue is one and infinite, and in the infinite buffer size case we consider First Come First Serve (FCFS) and Last Come First Serve (LCFS) as service disciplines. For the system with buffer size one at each queue, we derive PAoI exactly for the case of exponential service time and bounds (which are excellent approximations) for the case of general service time, with small k. For the system with infinite buffer size, we provide closed-form expressions of PAoI for both FCFS and LCFS where service time is general and k could be large. Using those results we investigated the effect of ordering of priorities and service disciplines for the various scenarios. We perform extensive numerical studies to validate our results and develop insights.


title: Motion Prediction with Recurrent Neural Network Dynamical Models and Trajectory Optimization

abstract: Predicting human motion in unstructured and dynamic environments is difficult as humans naturally exhibit complex behaviors that can change drastically from one environment to the next. In order to alleviate this issue, we propose to encode the lower level aspects of human motion separately from the higher level geometrical aspects, which we believe will generalize better over environments. In contrast to our prior work~\cite{kratzer2018}, we encode the short-term behavior by using a state-of-the-art recurrent neural network structure instead of a Gaussian process. In order to perform longer-term behavior predictions that account for variation in tasks and environments, we propose to make use of gradient-based trajectory optimization. Preliminary experiments on real motion data demonstrate the efficacy of the approach.


title: Learning Arbitration for Shared Autonomy by Hindsight Data Aggregation

abstract: In this paper we present a framework for the teleoperation of pick-and-place tasks. We define a shared control policy that allows to blend between direct user control and autonomous control based on user intent inference. One of the main challenges in shared autonomy systems is to define the arbitration function, which decides when to let the autonomous agent take over. In this work, we propose a model and training method to learn the arbitration function. Our model is based on a recurrent neural network that takes as input the state, intent prediction scores and user command to produce an arbitration between user and robot commands. This work extends our previous work on differentiable policies for shared autonomy. Differentiability of the policy is desirable to further train the shared autonomy system end-to-end. In this work we propose training of the arbitration function by using data from user performing the task with shared control. We present initial results by teleoperating a gripper in a virtual environment using pre-trained motion generation and intent prediction. We compare our data aggregation training procedure to a handcrafted arbitration function. Our preliminary results show the efficacy of the approach and shed light on limitations that we believe demonstrate the need for user adaptability in shared autonomy systems.


title: Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation

abstract: Stochastic approximation methods play a central role in maximum likelihood estimation problems involving intractable likelihood functions, such as marginal likelihoods arising in problems with missing or incomplete data, and in parametric empirical Bayesian estimation. Combined with Markov chain Monte Carlo algorithms, these stochastic optimisation methods have been successfully applied to a wide range of problems in science and industry. However, this strategy scales poorly to large problems because of methodological and theoretical difficulties related to using high-dimensional Markov chain Monte Carlo algorithms within a stochastic approximation scheme. This paper proposes to address these difficulties by using unadjusted Langevin algorithms to construct the stochastic approximation. This leads to a highly efficient stochastic optimisation methodology with favourable convergence properties that can be quantified explicitly and easily checked. The proposed methodology is demonstrated with three experiments, including a challenging application to high-dimensional statistical audio analysis and a sparse Bayesian logistic regression with random effects problem.


title: Synaptic Delays for Temporal Feature Detection in Dynamic Neuromorphic Processors

abstract: Spiking neural networks implemented in dynamic neuromorphic processors are well suited for spatiotemporal feature detection and learning, for example in ultra low-power embedded intelligence and deep edge applications. Such pattern recognition networks naturally involve a combination of dynamic delay mechanisms and coincidence detection. Inspired by an auditory feature detection circuit in crickets, featuring a delayed excitation by postinhibitory rebound, we investigate disynaptic delay elements formed by inhibitory-excitatory pairs of dynamic synapses. We configure such disynaptic delay elements in the DYNAP-SE neuromorphic processor and characterize the distribution of delayed excitations resulting from device mismatch. Furthermore, we present a network that mimics the auditory feature detection circuit of crickets and demonstrate how varying synapse weights, input noise and processor temperature affects the circuit. Interestingly, we find that the disynaptic delay elements can be configured such that the timing and magnitude of the delayed postsynaptic excitation depend mainly on the efficacy of the inhibitory and excitatory synapses, respectively. Delay elements of this kind can be implemented in other reconfigurable dynamic neuromorphic processors and opens up for synapse level temporal feature tuning with large fan-in and flexible delays of order 10-100 ms.


title: Numerical method for scattering problems in periodic waveguides

abstract: In this paper, we propose a new numerical method for scattering problems in periodic waveguide, based on the newly established contour integral representation of solutions in a previous paper by the author (see [Zhadf]). For this kind of problems, solutions are obtained via the Limiting Absorption Principle and we all them LAP solutions. Based on the Floquet-Bloch transform and analytic Fredholm theory, an LAP solution could be written explicitly as an integral of quasi-periodic solutions on a contour, which depends on the periodic structure. Compared to previous numerical methods for this kind of problems, we do not need to adopt the LAP for approximation, thus a standard error estimation is easily carried out. Based on this method, we also develop a numerical solver for the halfguide problems. This method is also based on the result from [Zhadf], which shows that any LAP solution of a halfguide problem could be extended into a fullguide problem with a non-vanishing source term(not uniquely!). So first we approximate the source term from the boundary data by a regularization method, and then the LAP solution could be obtained from the corresbonding fullguide problem. At the end of this paper, we also show some numerical results to present the efficiency of our numerical methods.


title: Widening the Representation Bottleneck in Neural Machine Translation with Lexical Shortcuts

abstract: The transformer is a state-of-the-art neural translation model that uses attention to iteratively refine lexical representations with information drawn from the surrounding context. Lexical features are fed into the first layer and propagated through a deep network of hidden layers. We argue that the need to represent and propagate lexical features in each layer limits the model's capacity for learning and representing other information relevant to the task. To alleviate this bottleneck, we introduce gated shortcut connections between the embedding layer and each subsequent layer within the encoder and decoder. This enables the model to access relevant lexical content dynamically, without expending limited resources on storing it within intermediate states. We show that the proposed modification yields consistent improvements over a baseline transformer on standard WMT translation tasks in 5 translation directions (0.9 BLEU on average) and reduces the amount of lexical information passed along the hidden layers. We furthermore evaluate different ways to integrate lexical connections into the transformer architecture and present ablation experiments exploring the effect of proposed shortcuts on model behavior.


title: Long-range vs. short-range effects in cold molecular ion-neutral collisions: Charge exchange of Rb with N$_2^+$ and O$_2^+$

abstract: We report a study of cold charge-transfer (CT) collisions of Rb atoms with N$_2^+$ and O$_2^+$ ions in the mK regime using a dynamic ion-neutral hybrid trapping experiment. State- and collision-energy- dependent reaction rate coefficients have been measured for both systems. We observe markedly different charge-transfer kinetics and dynamics for the different systems and reaction channels. While the kinetics in some channels are consistent with classical capture theory for the rate coefficient, others show distinct non-universal dynamics. The experimental results are interpreted with the help of classical capture, quasiclassical trajectory and quantum scattering calculations using state-of-the-art ab-initio potentials for the highly excited molecular states involved. The theoretical analysis reveals an intricate interplay between short- and long-range effects in the different reaction channels which ultimately determines the CT dynamics and rates. At short range, CT was found to occur via both single and multiple collision events with the latter typically showing pronounced large-amplitude internal motions of the collision complex. Our results illustrate salient mechanisms that determine the efficiency of cold molecular CT reactions.