title: Topological Magnetoelastic Excitations in Non-Collinear Antiferromagnets

abstract: We study the topological property of the magnetoelastic excitation in non-collinear antiferromagnets. As a toy model, we consider the magnon-phonon coupling in a triangular antiferromagnet with a $120^\circ$ N\`eel order. We find that in the presence of out-of-plane external magnetic field, the magnon-polaron bands, which arise from hybridization of magnons and phonons, can carry Chern number, even though the individual magnon and phonon bands are topologically trivial. Large Berry curvature is induced from the anti-crossing regions between the magnon and phonon bands, which renormalizes the thermal Hall conductivity of phonon bands. To compute the Berry curvature and Chern number of magnon-polarons, we give a simple algorithm to diagonalize magnetoelastic Hamiltonian without diagonalizing the phonon Hamiltonian, by mapping the problem to the diagonalization of bosonic Bogoliubov-de-Gennes (BdG) Hamiltonian. This is necessary because the contribution to the Berry curvature from phonon cannot be properly captured if we compute the Berry curvature from magnetoelastic Hamiltonian whose phonon sector has been already diagonalized.


title: Effects of Frustration on Fluctuation-dissipation Relations

abstract: We study numerically the aging properties of the two-dimensional Ising model with quenched disorder considered in our recent paper [Phys. Rev. E 95, 062136 (2017)], where frustration can be tuned by varying the fraction a of antiferromagnetic interactions. Specifically we focus on the scaling properties of the autocorrelation and linear response functions after a quench of the model to a low temperature. We find that the interplay between equilibrium and aging occurs differently in the various regions of the phase diagram of the model. When the quench is made into the ferromagnetic phase the two-time quantities are made by the sum of an equilibrium and an aging part, whereas in the paramagnetic phase these parts combine in a multiplicative way. Scaling forms are shown to be obeyed with good accuracy, and the corresponding exponents and scaling functions are determined and discussed in the framework of what is known in clean and disordered systems.


title: Tunneling of persistent currents in coupled ring-shaped Bose-Einstein condensates

abstract: Considerable progress in experimental studies of atomic gases in a toroidal geometry has opened up novel prospects for the investigation of fundamental properties of superfluid states and creation of new configurations for atomtronic circuits. In particular, atomic Bose-Einstein condensates loaded in a dual-ring trap suggest a possibility to consider the tunneling dynamics between coupled condensates with different angular momenta. Accordingly, we address the tunneling in a pair of coaxial ring-shaped condensates separated by a horizontal potential barrier. A weak-coupling truncated (finite-mode) Galerkin model and direct numerical simulations of the underlying three-dimensional Gross-Pitaevskii equation are used for the analysis of tunneling superflows driven by an initial imbalance in atomic populations of the rings. The superflows through the Bose-Josephson junction are strongly affected by persistent currents which are present in the rings. Josephson oscillations of the population imbalance and angular momenta in the coupled rings are obtained for co-rotating states and non-rotating ones. On the other hand, the azimuthal structure of the tunneling flow implies formation of Josephson vortices (fluxons) with zero net current through the junction for hybrid states, built of counter-rotating persistent currents in the coupled rings.


title: Photoacoustic image reconstruction from full field data in heterogeneous media

abstract: We consider image reconstruction in full-field photoacoustic tomography, where 2D projections of the full 3D acoustic pressure distribution at a given time T>0 are collected. We discuss existing results on the stability and uniqueness of the resulting image reconstruction problem and review existing reconstruction algorithms. Open challenges are also mentioned. Additionally, we introduce novel one-step reconstruction methods allowing for a variable speed of sound. We apply preconditioned iterative and variational regularization methods to the one-step formulation. Numerical results using the one-step formulation are presented, together with a comparison with the previous two-step approach for full-field photoacoustic tomography


title: Weak Keys and Cryptanalysis of a Cold War Block Cipher

abstract: T-310 is a cipher that was used for encryption of governmental communications in East Germany during the final years of the Cold War. Due to its complexity and the encryption process,there was no published attack for a period of more than 40 years until 2018 by Nicolas T. Courtois et al. in [10]. In this thesis we study the so called 'long term keys' that were used in the cipher, in order to expose weaknesses which will assist the design of various attacks on T-310.


title: Unusual Exchange Bias in Sr$_2$FeIrO$_6$/La$_{0.67}$Sr$_{0.33}$MnO$_3$ Multilayer

abstract: Here, we study an interface induced magnetic properties in 3$d$-5$d$ based multilayer made of La$_{0.67}$Sr$_{0.33}$MnO$_3$ and double perovskite Sr$_2$FeIrO$_6$, respectively. Bulk La$_{0.67}$Sr$_{0.33}$MnO$_3$ is metallic and shows ferromagnetic (FM) ordering above room temperature. In contrast, bulk Sr$_2$FeIrO$_6$, is an antiferromagnet (AFM) with N$\acute{e}$el temperature around 45 K ($T_N$) and exhibits an insulating behavior. Two set of multilayers have been grown on SrTiO$_3$ (100) crystal with varying thickness of FM layer. multilayer with equal thickness of La$_{0.67}$Sr$_{0.33}$MnO$_3$ and Sr$_2$FeIrO$_6$ ($\sim$ 10 nm) shows exchange bias (EB) effect both in conventionally field cooled (FC) as well as in zero field cooled (ZFC) magnetic hysteresis measurements which is rather unusual. The ZFC EB effect is weakened both with increasing maximum field during initial magnetization process at low temperature and with increasing temperature. Interestingly, multilayer with reduced thickness of La$_{0.67}$Sr$_{0.33}$MnO$_3$ ($\sim$ 5 nm) does not exhibit ZFC EB phenomenon, however, the FC EB effect is strengthened showing much higher value. We believe that an AFM type exchange coupling at interface and its evolution during initial application of magnetic field cause this unusual EB in present multilayers.


title: Photoacoustic image reconstruction via deep learning

abstract: Applying standard algorithms to sparse data problems in photoacoustic tomography (PAT) yields low-quality images containing severe under-sampling artifacts. To some extent, these artifacts can be reduced by iterative image reconstruction algorithms which allow to include prior knowledge such as smoothness, total variation (TV) or sparsity constraints. These algorithms tend to be time consuming as the forward and adjoint problems have to be solved repeatedly. Further, iterative algorithms have additional drawbacks. For example, the reconstruction quality strongly depends on a-priori model assumptions about the objects to be recovered, which are often not strictly satisfied in practical applications. To overcome these issues, in this paper, we develop direct and efficient reconstruction algorithms based on deep learning. As opposed to iterative algorithms, we apply a convolutional neural network, whose parameters are trained before the reconstruction process based on a set of training data. For actual image reconstruction, a single evaluation of the trained network yields the desired result. Our presented numerical results (using two different network architectures) demonstrate that the proposed deep learning approach reconstructs images with a quality comparable to state of the art iterative reconstruction methods.


title: Selected Chapters on Active Galactic Nuclei as Relativistic Systems

abstract: This volume presents an overview of selected aspects of physical processes occurring in the inner regions of Active Galactic Nuclei (AGN). The observational evidence suggests that strong gravitational fields play a significant role in governing the energy output of AGN and their influence on the surrounding medium, possibly due to the presence of a supermassive black hole. In order to reduce an unnecessary overlap with numerous reviews on the subject of AGN, here we focus on several selected topics.


title: Determination of centrality in nucleus-nucleus collisions on the MPD/NICA installation

abstract: Measurement of the number of spectators in nucleus-nucleus collisions could be used to determine the number of participant nucleons involved in the interaction, i.e. get information about collision centrality. However, at energies of the NICA collider, energy resolution of the forward hadron calorimeter is insufficient for separation amplitude corresponding to different number of spectators. Uncertainty in the number of spectators leads to a large error in determining centrality. For central events inaccuracy in determining the collision parameter is about 40%, for peripheral ones, no better than 30% at a beam energy of 2.5 AGeV. The multiplicity scintillator detector will allow to obtain more accurate data. A method is proposed for determining the centrality, taking into account the real MPD installation geometry.


title: A Consistent Set of Empirical Scaling Relations for Spiral Galaxies: The $(v_{\rm max},\,M_{\rm DM})$-$(\sigma_0,\,M_{\rm BH},\,\phi)$ Relations

abstract: Using the latest sample of 48 spiral galaxies having a directly measured supermassive black hole mass, $M_{BH}$, we determine how the maximum disk rotational velocity, $v_{max}$ (and the implied dark matter halo mass, $M_{DM}$), correlates with the (i) $M_{BH}$, (ii) central velocity dispersion, $\sigma_0$, and (iii) spiral-arm pitch angle, $\phi$. We find that $M_{BH}\propto v_{max}^{10.62\pm1.37}\propto M_{DM}^{4.35\pm0.66}$, significantly steeper than previously reported, and with a root mean square scatter ($0.58$ dex) similar to that about the $M_{BH}$-$\sigma_0$ relation for spiral galaxies - in stark disagreement with claims that $M_{BH}$ does not correlate with disks. Moreover, this $M_{BH}$-$v_{max}$ relation is consistent with the unification of the Tully-Fisher relation (involving the total stellar mass, $M_{*,tot}$) and the steep $M_{BH}\propto M_{*,tot}^{3.05\pm0.53}$ relation observed in spiral galaxies. We also find that $\sigma_0\propto v_{max}^{1.55\pm0.25}\propto M_{DM}^{0.63\pm0.11}$, consistent with past studies connecting stellar bulges (with $\sigma_0\gtrsim100\,{\rm km\,s}^{-1}$), dark matter halos, and a nonconstant $v_{max}/\sigma_0$ ratio. Finally, we report that $\tan|\phi|\propto(-1.18\pm0.19)\log{v_{max}}\propto(-0.48\pm0.09)\log M_{DM}$, providing a novel formulation between the geometry (i.e., the logarithmic spiral-arm pitch angle) and kinematics of spiral galaxy disks. While the $v_{max}$-$\phi$ relation may facilitate distance estimations to face-on spiral galaxies through the Tully-Fisher relation and using $\phi$ as a proxy for $v_{max}$, the $M_{DM}$-$\phi$ relation provides a path for determining dark matter halo masses from imaging data alone. Furthermore, based on a spiral galaxy sample size that is double the size used previously, the self-consistent relations presented here provide dramatically revised constraints for theory and simulations.


title: Deep learning versus $\ell^1$-minimization for compressed sensing photoacoustic tomography

abstract: We investigate compressed sensing (CS) techniques for reducing the number of measurements in photoacoustic tomography (PAT). High resolution imaging from CS data requires particular image reconstruction algorithms. The most established reconstruction techniques for that purpose use sparsity and $\ell^1$-minimization. Recently, deep learning appeared as a new paradigm for CS and other inverse problems. In this paper, we compare a recently invented joint $\ell^1$-minimization algorithm with two deep learning methods, namely a residual network and an approximate nullspace network. We present numerical results showing that all developed techniques perform well for deterministic sparse measurements as well as for random Bernoulli measurements. For the deterministic sampling, deep learning shows more accurate results, whereas for Bernoulli measurements the $\ell^1$-minimization algorithm performs best. Comparing the implemented deep learning approaches, we show that the nullspace network uniformly outperforms the residual network in terms of the mean squared error (MSE).


title: Non-equilibrium Markov state modeling of periodically driven biomolecules

abstract: Molecular dynamics simulations allow to study the structure and dynamics of single biomolecules in microscopic detail. However, many processes occur on time scales beyond the reach of fully atomistic simulations and require coarse-grained multiscale models. While systematic approaches to construct such models have become available, these typically rely on microscopic dynamics that obey detailed balance. In vivo, however, biomolecules are constantly driven away from equilibrium in order to perform specific functions and thus break detailed balance. Here we introduce a method to construct Markov state models for systems that are driven through periodically changing one (or several) external parameter. We illustrate the method for alanine dipeptide, a widely used benchmark molecule for computational methods, exposed to a time-dependent electric field.


title: A Geometric Method for Passivation and Cooperative Control of Equilibrium-Independent Passivity-Short Systems

abstract: Equilibrium-independent passive-short (EIPS) systems are a class of systems that satisfy a passivity-like dissipation inequality with respect to any forced equilibria with non-positive passivity indices. This paper presents a geometric approach for finding a passivizing transformation for such systems, relying on their steady-state input-output relation and the notion of projective quadratic inequalities (PQIs). We show that PQIs arise naturally from passivity-shortage characteristics of an EIPS system, and the set of their solutions can be explicitly expressed. We leverage this connection to build an input-output mapping that transforms the steady-state input-output relation to a monotone relation, and show that the same mapping passivizes the EIPS system. We show that the proposed transformation can be implemented through a combination of feedback, feed-through, post- and pre-multiplication gains. Furthermore, we consider an application of the presented passivation scheme for the analysis of networks comprised of EIPS systems. Numerous examples are provided to illustrate the theoretical findings.


title: The Laguerre calculus on the nilpotent Lie groups of step two

abstract: The Laguerre calculus is widely used for the inversion of differential operators on the Heisenberg group. We extend the Laguerre calculus for nilpotent groups of step two, and test it in the determining of the fundamental solution of the sub-Laplace operator. We also apply it to find the Szeg\"o kernels of the projection operators to a kind of regular functions on the quaternion Heisenberg group.


title: The RobotriX: An eXtremely Photorealistic and Very-Large-Scale Indoor Dataset of Sequences with Robot Trajectories and Interactions

abstract: Enter the RobotriX, an extremely photorealistic indoor dataset designed to enable the application of deep learning techniques to a wide variety of robotic vision problems. The RobotriX consists of hyperrealistic indoor scenes which are explored by robot agents which also interact with objects in a visually realistic manner in that simulated world. Photorealistic scenes and robots are rendered by Unreal Engine into a virtual reality headset which captures gaze so that a human operator can move the robot and use controllers for the robotic hands; scene information is dumped on a per-frame basis so that it can be reproduced offline to generate raw data and ground truth labels. By taking this approach, we were able to generate a dataset of 38 semantic classes totaling 8M stills recorded at +60 frames per second with full HD resolution. For each frame, RGB-D and 3D information is provided with full annotations in both spaces. Thanks to the high quality and quantity of both raw information and annotations, the RobotriX will serve as a new milestone for investigating 2D and 3D robotic vision tasks with large-scale data-driven techniques.


title: Polarimetry and strong gravity effects from spots orbiting near a black hole

abstract: We study the modulation of the observed radiation flux and the associated changes in the polarization degree and angle that are predicted by the orbiting spot model for flares from accreting black holes. The geometric shape of the emission region influences the resulting model lightcurves, namely, the emission region of a spiral shape can be distinguished from a simpler geometry of a small orbiting spot.


title: The adaptive interpolation method for proving replica formulas. Applications to the Curie-Weiss and Wigner spike models

abstract: In this contribution we give a pedagogic introduction to the newly introduced adaptive interpolation method to prove in a simple and unified way replica formulas for Bayesian optimal inference problems. Many aspects of this method can already be explained at the level of the simple Curie-Weiss spin system. This provides a new method of solution for this model which does not appear to be known. We then generalize this analysis to a paradigmatic inference problem, namely rank-one matrix estimation, also refered to as the Wigner spike model in statistics. We give many pointers to the recent literature where the method has been succesfully applied.

categories: cond-mat.dis-nn cs.IT math-ph math.IT math.MP math.PR


title: First and Second Order Necessary Optimality Conditions for Controlled Stochastic Evolution Equations with Control and State Constraints

abstract: The purpose of this paper is to establish first and second order necessary optimality conditions for optimal control problems of stochastic evolution equations with control and state constraints. The control acts both in the drift and diffusion terms and the control region is a nonempty closed subset of a separable Hilbert space. We employ some classical set-valued analysis tools and theories of the transposition solution of vector-valued backward stochastic evolution equations and the relaxed-transposition solution of operator-valued backward stochastic evolution equations to derive these optimality conditions. The correction part of the second order adjoint equation, which does not appear in the first order optimality condition, plays a fundamental role in the second order optimality condition.


title: Relativistic and Newtonian fluid tori with electric charge

abstract: We discuss the effects of electric charging on the equilibrium configurations of magnetized, rotating fluid tori around black holes of different mass. In the context of gaseous/dusty tori in galactic nuclei, the central black hole dominates the gravitational field and it remains electrically neutral, while the surrounding material acquires some electric charge and exhibits non-negligible self-gravitational effect on the torus structure. The structure of the torus is influenced by the balance between the gravitational and electromagnetic forces. A cusp may develop even in Newtonian tori due to the charge distribution.


title: Exact mathematical solution for nonlinear free transverse vibrations of beams

abstract: In the present paper, an exact mathematical solution has been obtained for nonlinear free transverse vibration of beams, for the first time. The nonlinear governing partial differential equation in un-deformed coordinates system has been converted in two coupled partial differential equations in deformed coordinates system. A mathematical explanation is obtained for nonlinear mode shapes as well as natural frequencies versus geometrical and material properties of beam. It is shown that as the th mode of transverse vibration excited, the mode 2 th of in-plane vibration will be developed. The result of present work is compared with those obtained from Galerkin method and the observed agreement confirms the exact mathematical solution. It is shown that the governing equation is linear in the time domain. As a parameter, the amplitude to length ratio has been proposed to show when the nonlinear terms become dominant in the behavior of structure.


title: Super-Massive Black Hole mass estimation from bright flares

abstract: Super-Massive Black Holes reside in galactic nuclei, where they exhibit episodic bright flares due to accretion events. Taking into account relativistic effects, namely, the boosting and lensing of X-ray flares, we further examine the possibility to constraint the mass of the SMBH from the predicted profiles of the observed light curves. To this end, we have studied four bright flares from Sagittarius A*, which exhibit an asymmetric shape consistent with a combination of two intrinsically separate peaks that occur with a specific time delay with respect to each other. We have thus proposed (Karssen et al. 2017, Mon. Not. R. Astron. Soc. 472, 4422) that an interplay of relativistic effects could be responsible for the shape of the observed light curves and we tested the reliability of the method.


title: Concentration of multi-overlaps for random ferromagnetic spin models

abstract: We consider ferromagnetic spin models on dilute random graphs and prove that, with suitable one-body infinitesimal perturbations added to the Hamiltonian, the multi-overlaps concentrate for all temperatures, both with respect to the thermal Gibbs average and the quenched randomness. Results of this nature have been known only for the lowest order overlaps, at high temperature or on the Nishimori line. Here we treat all multi-overlaps by a non-trivial application of Griffiths-Kelly-Sherman correlation inequalities. Our results apply in particular to the pure and mixed p-spin ferromagnets on random dilute Erdoes-R\'enyi hypergraphs. On physical grounds one expects that multi-overlap concentration directly implies the correctness of the cavity (or replica symmetric) formula for the pressure. The proof of this formula for the general p-spin ferromagnet on a random dilute hypergraph remains an open problem.


title: Asymptotic value in frequency-dependent games with separable payoffs: a differential approach

abstract: We study the asymptotic value of a frequency-dependent zero-sum game with separable payoff following a differential approach. The stage payoffs in such games depend on the current actions and on a linear function of the frequency of actions played so far. We associate to the repeated game, in a natural way, a differential game and although the latter presents an irregularity at the origin, we prove that it has a value. We conclude, using appropriate approximations, that the asymptotic value of the original game exists in both the n-stage and the {\lambda}-discounted games and that it coincides with the value of the continuous time game.


title: Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks

abstract: We study the training process of Deep Neural Networks (DNNs) from the Fourier analysis perspective. We demonstrate a very universal Frequency Principle (F-Principle) -- DNNs often fit target functions from low to high frequencies -- on high-dimensional benchmark datasets such as MNIST/CIFAR10 and deep neural networks such as VGG16. This F-Principle of DNNs is opposite to the behavior of most conventional iterative numerical schemes (e.g., Jacobi method), which exhibit faster convergence for higher frequencies for various scientific computing problems. With a simple theory, we illustrate that this F-Principle results from the regularity of the commonly used activation functions. The F-Principle implies an implicit bias that DNNs tend to fit training data by a low-frequency function. This understanding provides an explanation of good generalization of DNNs on most real datasets and bad generalization of DNNs on parity function or randomized dataset.


title: A Two-Layer Component-Based Allocation for Embedded Systems with GPUs

abstract: Component-based development is a software engineering paradigm that can facilitate the construction of embedded systems and tackle its complexities. The modern embedded systems have more and more demanding requirements. One way to cope with such versatile and growing set of requirements is to employ heterogeneous processing power, i.e., CPU-GPU architectures. The new CPU-GPU embedded boards deliver an increased performance but also introduce additional complexity and challenges. In this work, we address the component-to-hardware allocation for CPU-GPU embedded systems. The allocation for such systems is much complex due to the increased amount of GPU-related information. For example, while in traditional embedded systems the allocation mechanism may consider only the CPU memory usage of components to find an appropriate allocation scheme, in heterogeneous systems, the GPU memory usage needs also to be taken into account in the allocation process. This paper aims at decreasing the component-to-hardware allocation complexity by introducing a 2-layer component-based architecture for heterogeneous embedded systems. The detailed CPU-GPU information of the system is abstracted at a high-layer by compacting connected components into single units that behave as regular components. The allocator, based on the compacted information received from the high-level layer, computes, with a decreased complexity, feasible allocation schemes. In the last part of the paper, the 2-layer allocation method is evaluated using an existing embedded system demonstrator; namely, an underwater robot.


title: What Makes a Good Conversation? Challenges in Designing Truly Conversational Agents

abstract: Conversational agents promise conversational interaction but fail to deliver. Efforts often emulate functional rules from human speech, without considering key characteristics that conversation must encapsulate. Given its potential in supporting long-term human-agent relationships, it is paramount that HCI focuses efforts on delivering this promise. We aim to understand what people value in conversation and how this should manifest in agents. Findings from a series of semi-structured interviews show people make a clear dichotomy between social and functional roles of conversation, emphasising the long-term dynamics of bond and trust along with the importance of context and relationship stage in the types of conversations they have. People fundamentally questioned the need for bond and common ground in agent communication, shifting to more utilitarian definitions of conversational qualities. Drawing on these findings we discuss key challenges for conversational agent design, most notably the need to redefine the design parameters for conversational agent interaction.


title: Floating-Point Calculations on a Quantum Annealer: Division and Matrix Inversion

abstract: Systems of linear equations are employed almost universally across a wide range of disciplines, from physics and engineering to biology, chemistry and statistics. Traditional solution methods such as Gaussian elimination become very time consuming for large matrices, and more efficient computational methods are desired. In the twilight of Moore's Law, quantum computing is perhaps the most direct path out of the darkness. There are two complementary paradigms for quantum computing, namely, gated systems and quantum annealers. In this paper, we express floating point operations such as division and matrix inversion in terms of a quadratic unconstrained binary optimization (QUBO) problem, a formulation that is ideal for a quantum annealer. We first address floating point division, and then move on to matrix inversion. We provide a general algorithm for any number of dimensions, but we provide results from the D-Wave quantum anneler for $2\times 2$ and $3 \times 3$ general matrices. Our algorithm scales to very large numbers of linear equations. We should also mention that our algorithm provides the full solution the the matrix problem, while HHL provides only an expectation value.


title: One-Bit Sensing of Low-Rank and Bisparse Matrices

abstract: This note studies the worst-case recovery error of low-rank and bisparse matrices as a function of the number of one-bit measurements used to acquire them. First, by way of the concept of consistency width, precise estimates are given on how fast the recovery error can in theory decay. Next, an idealized recovery method is proved to reach the fourth-root of the optimal decay rate for Gaussian sensing schemes. This idealized method being impractical, an implementable recovery algorithm is finally proposed in the context of factorized Gaussian sensing schemes. It is shown to provide a recovery error decaying as the sixth-root of the optimal rate.


title: Image De-Noising For Salt and Pepper Noise by Introducing New Enhanced Filter

abstract: When an image is formed, factors such as lighting (spectra, source, and intensity) and camera characteristics (sensor response, lenses) affect the appearance of the image. Therefore, the prime factor that reduces the quality of the image is noise. It hides the important details and information of images. In order to enhance the qualities of the image, the removal of noises become imperative and that should not at the cost of any loss of image information. Noise removal is one of the pre-processing stages of image processing. In this paper a new method for the enhancement of grayscale images is introduced, when images are corrupted by fixed valued impulse noise (salt and pepper noise). The proposed methodology ensures a better output for the low and medium density of fixed value impulse noise as compared to the other famous filters like Standard Median Filter (SMF), Decision Based Median Filter (DBMF) and Modified Decision Based Median Filter (MDBMF) etc. The main objective of the proposed method was to improve peak signal to noise ratio (PSNR), visual perception and reduction in the blurring of the image. The proposed algorithm replaced the noisy pixel by trimmed mean value. When previous pixel values, 0s, and 255s are present in the particular window and all the pixel values are 0s and 255s then the remaining noisy pixels are replaced by mean value. The gray-scale image of mandrill and Lena were tested via the proposed method. The experimental result shows better peak signal to noise ratio (PSNR), mean square error values with better visual and human perception.


title: Comparative Performance Analysis of Image De-noising Techniques

abstract: Noise is an important factor which when get added to an image reduces its quality and appearance. So in order to enhance the image qualities, it has to be removed with preserving the textural information and structural features of image. There are different types of noises exist who corrupt the images. Selection of the denoising algorithm is application dependent. Hence, it is necessary to have knowledge about the noise present in the image so as to select the appropriate denoising algorithm. Objective of this paper is to present brief account on types of noises, its types and different noise removal algorithms. In the first section types of noises on the basis of their additive and multiplicative nature are being discussed. In second section a precise classification and analysis of the different potential image denoising algorithm is presented. At the end of paper, a comparative study of all these algorithms in context of performance evaluation is done and concluded with several promising directions for future research work.


title: The quantum algorithm for graph isomorphism problem

abstract: The graph isomorphism (GI) problem is the computational problem of finding a permutation of vertices of a given graph $G_1$ that transforms $G_1$ to another given graph $G_2$ and preserves the adjacency. In this work, we propose a quantum algorithm to determine whether there exists such a permutation. To find such a permutation, we introduce isomorphic equivalent graphs of the given graphs to be tested. We proof that the GI problem of the equivalent graphs is equivalent to the GI problem of the given graphs. The idea of the algorithm is to determine whether there exists a permutation can transform the eigenvectors of the adjacency matrix of the equivalent graphs each other. The cost time of the algorithm is polynomial.


title: An algorithm for stress and mixed control in Galerkin based FFT homogenization

abstract: A new algorithm is proposed to impose a macroscopic stress or mixed stress/deformation gradient history in the context of non-linear Galerkin based FFT homogenization. The method proposed is based in the definition of a modified projection operator in which the null frequencies enforce the type of control (stress or strain) for each component of either the macroscopic first Piola stress or the deformation gradient. The resulting problem is solved exactly as the original variational method and it does not require additional iterations compared to the strain control version, neither in the linear iterative solver, nor in the Newton scheme. The efficiency of the method proposed is demonstrated with a series of numerical examples, including a polycrystal and a particle reinforced hyperelastic material.


title: Non-minimal Higgs-gravity coupling and naturalness at the LHC and beyond

abstract: The non-minimal Higgs-gravity coupling, $\xi H^\dagger H R$, can play an interesting role in particle physics. We utilize the available LHC Run-2 data to obtain the bound on the coupling $\xi$ and discuss the prospects of constraining it at CEPC, FCC-ee and ILC. Also, we investigate its implication on the naturalness.


title: Degree sequence of the generalized Sierpinski graph

abstract: We determine the degree sequence of the generalized Sierpinski graph and its general first Zagreb index in terms of the same parameters of the base graph G.


title: Directed Intersection Representations and the Information Content of Digraphs

abstract: Consider a directed graph (digraph) in which vertices are assigned color sets, and two vertices are connected if and only if they share at least one color and the tail vertex has a strictly smaller color set than the head. We seek to determine the smallest possible size of the union of the color sets that allows for such a digraph representation. To address this problem, we introduce the new notion of a directed intersection representation of a digraph, and show that it is well-defined for all directed acyclic graphs (DAGs). We then proceed to introduce the directed intersection number (DIN), the smallest number of colors needed to represent a DAG. Our main results are upper bounds on the DIN of DAGs based on what we call the longest terminal path decomposition of the vertex set, and constructive lower bounds.


title: RDCSim: a GPU-Accelerated, Interactive Simulator for Reaction--Diffusion Chemistry

abstract: This paper presents RDCSim, an interactive simulator for reaction--diffusion chemistry (RDC) research, being developed as part of an ongoing project studying how humans interact with unconventional computing systems. While much research into the computational properties of RDC makes use of simulations, the development of multiple RDC simulations across different research groups can lead to results that are harder to reproduce. By automating the storage of parameter values alongside simulation results, RDCSim aims to make reproducing RDC results painless. This paper presents the functionality of RDCSim, and verifies the behaviour of the underlying chemical simulation using two seminal examples from the RDC literature: logical AND gates and chemical diodes.


title: Giant magneto-optical Kerr enhancement from films on SiC due to the optical properties of the substrate

abstract: We report a giant enhancement of the mid-infrared (MIR) magneto-optical complex Kerr angle (polarization change of reflected light) in a variety of materials grown on SiC. In epitaxially-grown multilayer graphene, the Kerr angle is enhanced by a factor of 68, which is in good agreement with Kerr signal modeling. Strong Kerr enhancement is also observed in Fe films grown on SiC and Al-doped bulk SiC. Our experiments and modelling indicate that the enhancement occurs at the high-energy edge of the SiC reststrahlen band where the real component of the complex refractive index n passes through unity. Furthermore, since the signal is greatly enhanced when n=1, the enhancement is predicted to exist over the entire visible/infrared (IR) spectrum for a free-standing film. We also predict similar giant enhancement in both Faraday (transmission) and Kerr rotation for thin films on a metamaterial substrate with refractive index n=-1. This work demonstrates that the substrate used in MOKE measurements must be carefully chosen when investigating magneto-optical materials with weak MOKE signals or when designing MOKE-based optoelectronic devices.


title: Deep-Learning-based Millimeter-Wave Massive MIMO for Hybrid Precoding

abstract: Millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) has been regarded to be an emerging solution for the next generation of communications, in which hybrid analog and digital precoding is an important method for reducing the hardware complexity and energy consumption associated with mixed signal components. However, the fundamental limitations of the existing hybrid precoding schemes is that they have high computational complexity and fail to fully exploit the spatial information. To overcome these limitations, this paper proposes, a deep-learning-enabled mmWave massive MIMO framework for effective hybrid precoding, in which each selection of the precoders for obtaining the optimized decoder is regarded as a mapping relation in the deep neural network (DNN). Specifically, the hybrid precoder is selected through training based on the DNN for optimizing precoding process of the mmWave massive MIMO. Additionally, we present extensive simulation results to validate the excellent performance of the proposed scheme. The results exhibit that the DNN-based approach is capable ofminimizing the bit error ratio (BER) and enhancing spectrum efficiency of the mmWave massive MIMO, which achieves better performance in hybrid precoding compared with conventional schemes while substantially reducing the required computational complexity.


title: B-Mode auto-bispectrum due to matter bounce

abstract: Primordial Gravitational waves leave polarization imprints on the Cosmic Microwave Background (CMB). In this article, we investigate polarization bispectrum, which is also referred to as the B-mode auto bispectrum, due to a matter bounce Universe. For simplicity, we consider a minimally coupled Einstein frame and obtain an analytical integral expression for the bispectrum and numerically perform the integration. We find that the signal-to-noise ratio is small, when compared with the same in the inflationary paradigm and hence quite difficult to detect in the future experiments. Thus a detection of tensor mode bispectrum in future will be helpful in ruling out matter bounce model. Also, to ease the numerical evaluation of the bispectrum, we develop and use various techniques. We believe that these techniques can be used in various other contexts.


title: $W$-Types in Categories of Coalgebras

abstract: We construct $W$-types in the category of coalgebras for a cartesian comonad. It generalizes the constructions of $W$-types in presheaf toposes and gluing toposes.


title: A Pre-Expectation Calculus for Probabilistic Sensitivity

abstract: Sensitivity properties describe how changes to the input of a program affect the output, typically by upper bounding the distance between the outputs of two runs by a monotone function of the distance between the corresponding inputs. When programs are probabilistic, the distance between outputs is a distance between distributions. The Kantorovich lifting provides a general way of defining a distance between distributions by lifting the distance of the underlying sample space; by choosing an appropriate distance on the base space, one can recover other usual probabilistic distances, such as the Total Variation distance. We develop a relational pre-expectation calculus to upper bound the Kantorovich distance between two executions of a probabilistic program. We illustrate our methods by proving algorithmic stability of a machine learning algorithm, convergence of a reinforcement learning algorithm, and fast mixing for card shuffling algorithms. We also consider some extensions: proving lower bounds on the Total Variation distance and convergence to the uniform distribution. Finally, we describe an asynchronous extension of our calculus to reason about pairs of program executions with different control flow.


title: Measurements of microwave vortex response in dc magnetic fields in Tl$_2$Ba$_2$CaCu$_2$O$_{8+x}$ films

abstract: There is a renewed interest in superconductors for high-frequency applications, leading to a reconsideration of already known low-$T_c$ and high-$T_c$ materials. In this view, we present an experimental investigation of the millimeter-wave response in moderate magnetic fields of Tl$_2$Ba$_2$CaCu$_2$O$_{8+x}$ superconducting films with the aim of identifying the mechanisms of the vortex-motion-induced response. We measure the dc magnetic-field-dependent change of the surface impedance, $\Delta Z_s(H) = \Delta R_s(H) + i\Delta X_s(H)$ at 48 GHz by means of the dielectric resonator method. We find that the overall response is made up of several contributions, with different weights depending on the temperature and field: a possible contribution from Josephson or Abrikosov-Josephson fluxons at low fields; a seemingly conventional vortex dynamics at higher fields; a significant pair breaking in the temperature region close to $T_c$. We extract the vortex motion depinning frequency $f_p$, which attains surprisingly high values. However, by exploiting the generalized model for relaxational dynamics we show that this result come from a combination of a pinning constant $k_p$ arising from moderate pinning, and a vortex viscosity $\eta$ with anomalously small values. This latter fact, implying large dissipation, is likely a result from a peculiar microscopic structure and thus poses severe limits to the application of Tl$_2$Ba$_2$CaCu$_2$O$_{8+x}$ in a magnetic field.


title: An improvement to a recent upper bound for synchronizing words of finite automata

abstract: It has been known since the 60's that any complete discrete $n$-state automaton admits a reset word of length not exceeding $\alpha n^3+o(n^3)$ for some absolute constant $\alpha$. J.-E. Pin and P. Frankl proved this statement with $\alpha=1/6=0.1666...$ in 1982, and this bound remained best known until 2017, when M. Szyku\l{}a decreased its value to $\alpha\approx0.1664$. In this note, we present a modification to the latest approach and develop a different counting argument which leads to a more substantial improvement of $\alpha\leqslant 0.1654$.


title: MOROCO: The Moldavian and Romanian Dialectal Corpus

abstract: In this work, we introduce the MOldavian and ROmanian Dialectal COrpus (MOROCO), which is freely available for download at https://github.com/butnaruandrei/MOROCO. The corpus contains 33564 samples of text (with over 10 million tokens) collected from the news domain. The samples belong to one of the following six topics: culture, finance, politics, science, sports and tech. The data set is divided into 21719 samples for training, 5921 samples for validation and another 5924 samples for testing. For each sample, we provide corresponding dialectal and category labels. This allows us to perform empirical studies on several classification tasks such as (i) binary discrimination of Moldavian versus Romanian text samples, (ii) intra-dialect multi-class categorization by topic and (iii) cross-dialect multi-class categorization by topic. We perform experiments using a shallow approach based on string kernels, as well as a novel deep approach based on character-level convolutional neural networks containing Squeeze-and-Excitation blocks. We also present and analyze the most discriminative features of our best performing model, before and after named entity removal.


title: Metrization of the Gromov-Hausdorff (-Prokhorov) Topology for Boundedly-Compact Metric Spaces

abstract: In this work, a metric is presented on the set of boundedly-compact pointed metric spaces that generates the Gromov-Hausdorff topology. A similar metric is defined for measured metric spaces that generates the Gromov-Hausdorff-Prokhorov topology. This extends previous works which consider only length spaces or discrete metric spaces. Completeness and separability are also proved for these metrics. Hence, they provide the measure theoretic requirements to study random (measured) boundedly-compact pointed metric spaces, which is the main motivation of this work. In addition, we present a generalization of the classical theorem of Strassen which is of independent interest. This generalization proves an equivalent formulation of the Prokhorov distance of two finite measures, having possibly different total masses, in term of approximate coupling. A Strassen-type result is also proved for the Gromov-Hausdorff-Prokhorov metric for compact spaces.


title: An Optimal Vector Clock Algorithm for Multithreaded Systems

abstract: Tracking causality (or happened-before relation) between events is useful for many applications such as debugging and recovery from failures. Consider a concurrent system with $n$ threads and $m$ objects. For such systems, either a vector clock of size $n$ is used with one component per thread or a vector clock of size $m$ is used with one component per object. A natural question is whether one can use a vector clock of size strictly less than the minimum of $m$ and $n$ to timestamp events. We give an algorithm in this paper that uses a hybrid of thread and object components. Our algorithm is guaranteed to return the minimum number of components necessary for vector clocks. We first consider the case when the interaction between objects and threads is statically known. This interaction is modeled by a thread-object bipartite graph. Our algorithm is based on finding the maximum bipartite matching of such a graph and then applying K\"{o}nig-Egerv\'{a}ry Theorem to compute the minimum vertex cover to determine the optimal number of components necessary for the vector clock. We also propose two mechanisms to compute such an vector clock when computation is revealed in an online fashion. Evaluation on different types of graphs indicates that our offline algorithm generates a size vector clock which is significantly less than the minimum of $m$ and $n$. These mechanisms are more effective when the underlying bipartite graph is not dense.


title: An unbiased spectral line survey observation toward the low-mass star-forming region L1527

abstract: An unbiased spectral line survey toward a solar-type Class 0/I protostar, IRAS04368+2557, in L1527 has been carried out in the 3 mm band with the Nobeyama 45 m telescope. L1527 is known as a warm carbon-chain chemistry (WCCC) source, which harbors abundant unsaturated organic species such as C$_n$H ($n = 3,\ 4,\ 5,\ldots$) in a warm and dense region near the protostar. The observation covers the frequency range from 80 to 116 GHz. A supplementary observation has also been conducted in the 70 GHz band to observe fundamental transitions of deuterated species. In total, 69 molecular species are identified, among which 27 species are carbon-chain species and their isomers, including their minor isotopologues. This spectral line survey provides us with a good template of the chemical composition of the WCCC source.


title: Moss' logic for ordered coalgebras

abstract: We present a finitary version of Moss' coalgebraic logic for $T$-coalgebras, where $T$ is a locally monotone endofunctor of the category of posets and monotone maps. The logic uses a single cover modality whose arity is given by the least finitary subfunctor of the dual of the coalgebra functor $T_\omega^\partial$, and the semantics of the modality is given by relation lifting. For the semantics to work, $T$ is required to preserve exact squares. For the finitary setting to work, $T_\omega^\partial$ is required to preserve finite intersections. We develop a notion of a base for subobjects of $T_\omega X$. This in particular allows us to talk about the finite poset of subformulas for a given formula. The notion of a base is introduced generally for a category equipped with a suitable factorisation system. We prove that the resulting logic has the Hennessy-Milner property for the notion of similarity based on the notion of relation lifting. We define a sequent proof system for the logic, and prove its completeness.


title: Computing Height-Optimal Tangles Faster

abstract: We study the following combinatorial problem. Given a set of $n$ y-monotone wires, a tangle determines the order of the wires on a number of horizontal layers such that the orders of the wires on any two consecutive layers differ only in swaps of neighboring wires. Given a multiset $L$ of swaps (that is, unordered pairs of numbers between 1 and $n$) and an initial order of the wires, a tangle realizes $L$ if each pair of wires changes its order exactly as many times as specified by $L$. The aim is to find a tangle that realizes $L$ using the smallest number of layers. We show that this problem is NP-hard, and we give an algorithm that computes an optimal tangle for $n$ wires and a given list $L$ of swaps in $O((2|L|/n^2+1)^{n^2/2} \cdot \varphi^n \cdot n)$ time, where $\varphi \approx 1.618$ is the golden ratio. We can treat lists where every swap occurs at most once in $O(n!\varphi^n)$ time. We implemented the algorithm for the general case and compared it to an existing algorithm. Finally, we discuss feasibility for lists with a simple structure.


title: On the Necessary Memory to Compute the Plurality in Multi-Agent Systems

abstract: We consider the Relative-Majority Problem (also known as Plurality), in which, given a multi-agent system where each agent is initially provided an input value out of a set of $k$ possible ones, each agent is required to eventually compute the input value with the highest frequency in the initial configuration. We consider the problem in the general Population Protocols model in which, given an underlying undirected connected graph whose nodes represent the agents, edges are selected by a globally fair scheduler. The state complexity that is required for solving the Plurality Problem (i.e., the minimum number of memory states that each agent needs to have in order to solve the problem), has been a long-standing open problem. The best protocol so far for the general multi-valued case requires polynomial memory: Salehkaleybar et al. (2015) devised a protocol that solves the problem by employing $O(k 2^k)$ states per agent, and they conjectured their upper bound to be optimal. On the other hand, under the strong assumption that agents initially agree on a total ordering of the initial input values, Gasieniec et al. (2017), provided an elegant logarithmic-memory plurality protocol. In this work, we refute Salehkaleybar et al.'s conjecture, by providing a plurality protocol which employs $O(k^{11})$ states per agent. Central to our result is an ordering protocol which allows to leverage on the plurality protocol by Gasieniec et al., of independent interest. We also provide a $\Omega(k^2)$-state lower bound on the necessary memory to solve the problem, proving that the Plurality Problem cannot be solved within the mere memory necessary to encode the output.


title: Lusin characterisation of Hardy spaces associated with Hermite operators

abstract: Let $d \in \{3, 4, 5, \ldots\}$ and $p \in (0,1]$. We consider the Hermite operator $L = -\Delta + |x|^2$ on its maximal domain in $L^2(\mathbb{R}^d)$. Let $H_L^p(\mathbb{R}^d)$ be the completion of $ \{ f \in L^2(\mathbb{R}^d): \mathcal{M}_L f \in L^p(\mathbb{R}^d) \} $ with respect to the quasi-norm $ \|\cdot\|_{H_L^p} = \|\mathcal{M}\cdot\|_{L^p}, $ where $\mathcal{M}_L f(\cdot) = \sup_{t > 0} |e^{-tL} f(\cdot)|$ for all $f \in L^2(\mathbb{R}^d)$. We characterise $H_L^p(\mathbb{R}^d)$ in terms of Lusin integrals associated with Hermite operator.


title: Synthesizing facial photometries and corresponding geometries using generative adversarial networks

abstract: Artificial data synthesis is currently a well studied topic with useful applications in data science, computer vision, graphics and many other fields. Generating realistic data is especially challenging since human perception is highly sensitive to non realistic appearance. In recent times, new levels of realism have been achieved by advances in GAN training procedures and architectures. These successful models, however, are tuned mostly for use with regularly sampled data such as images, audio and video. Despite the successful application of the architecture on these types of media, applying the same tools to geometric data poses a far greater challenge. The study of geometric deep learning is still a debated issue within the academic community as the lack of intrinsic parametrization inherent to geometric objects prohibits the direct use of convolutional filters, a main building block of today's machine learning systems. In this paper we propose a new method for generating realistic human facial geometries coupled with overlayed textures. We circumvent the parametrization issue by imposing a global mapping from our data to the unit rectangle. We further discuss how to design such a mapping to control the mapping distortion and conserve area within the mapped image. By representing geometric textures and geometries as images, we are able to use advanced GAN methodologies to generate new geometries. We address the often neglected topic of relation between texture and geometry and propose to use this correlation to match between generated textures and their corresponding geometries. We offer a new method for training GAN models on partially corrupted data. Finally, we provide empirical evidence demonstrating our generative model's ability to produce examples of new identities independent from the training data while maintaining a high level of realism, two traits that are often at odds.


title: Multiscale and multimodal network dynamics underpinning working memory

abstract: Working memory (WM) allows information to be stored and manipulated over short time scales. Performance on WM tasks is thought to be supported by the frontoparietal system (FPS), the default mode system (DMS), and interactions between them. Yet little is known about how these systems and their interactions relate to individual differences in WM performance. We address this gap in knowledge using functional MRI data acquired during the performance of a 2-back WM task, as well as diffusion tensor imaging data collected in the same individuals. We show that the strength of functional interactions between the FPS and DMS during task engagement is inversely correlated with WM performance, and that this strength is modulated by the activation of FPS regions but not DMS regions. Next, we use a clustering algorithm to identify two distinct subnetworks of the FPS, and find that these subnetworks display distinguishable patterns of gene expression. Activity in one subnetwork is positively associated with the strength of FPS-DMS functional interactions, while activity in the second subnetwork is negatively associated. Further, the pattern of structural linkages of these subnetworks explains their differential capacity to influence the strength of FPS-DMS functional interactions. To determine whether these observations could provide a mechanistic account of large-scale neural underpinnings of WM, we build a computational model of the system composed of coupled oscillators. Modulating the amplitude of the subnetworks in the model causes the expected change in the strength of FPS-DMS functional interactions, thereby offering support for a mechanism in which subnetwork activity tunes functional interactions. Broadly, our study presents a holistic account of how regional activity, functional interactions, and structural linkages together support individual differences in WM in humans.


title: Neuroflight: Next Generation Flight Control Firmware

abstract: Little innovation has been made to low-level attitude flight control used by uncrewed aerial vehicles (UAVs), which still predominantly uses the classical PID controller. In this work we introduce Neuroflight, the first open source neuro-flight controller firmware. We present our toolchain for training a neural network in simulation and compiling it to run on embedded hardware. Challenges faced jumping from simulation to reality are discussed along with our solutions. Our evaluation shows the neural network can execute at over 2.67kHz on an Arm Cortex-M7 processor and flight tests demonstrate a quadcopter running Neuroflight can achieve stable flight and execute aerobatic maneuvers.


title: Symplectic Coarse-Grained Dynamics: Chalkboard Motion in Classical and Quantum Mechanics

abstract: In the usual approaches to mechanics (classical or quantum) the primary object of interest is the Hamiltonian, from which one tries to deduce the solutions of the equations of motion (Hamilton or Schr\"odinger). In the present work we reverse this paradigm and view the motions themselves as being the primary objects. This is made possible by studying arbitrary phase space motions, not of points, but of (small) ellipsoids with the requirement that the symplectic capacity of these ellipsoids is preserved. This allows us to guide and control these motions as we like. In the classical case these ellipsoids correspond to a symplectic coarse graining of phase space, and in the quantum case they correspond to the "quantum blobs" we defined in previous work, and which can be viewed as minimum uncertainty phase space cells which are in a one-to-one correspondence with Gaussian pure states.

categories: math-ph astro-ph.IM hep-th math.MP math.SG quant-ph


title: Blobs, spiral arms, and a possible planet around HD 169142

abstract: Young planets are expected to cause perturbations in protostellar disks that may be used to infer their presence. Clear detection of still-forming planets embedded within gas-rich disks is rare. HD 169142 is a very young Herbig Ae-Be star surrounded by a pre-transitional disk, composed of at least three rings. While claims of sub-stellar objects around this star have been made previously, follow-up studies remain inconclusive. We used SPHERE at ESO VLT to obtain a sequence of high-contrast images of the immediate surroundings of this star over about three years. This enables a photometric and astrometric analysis of the structures in the disk. While we were unable to definitively confirm the previous claims of a massive sub-stellar object at 0.1-0.15 arcsec from the star, we found both spirals and blobs within the disk. The spiral pattern may be explained as due to the presence of a primary, a secondary, and a tertiary arm excited by a planet of a few Jupiter masses lying along the primary arm, likely in the cavities between the rings. The blobs orbit the star consistently with Keplerian motion, allowing a dynamical determination of the mass of the star. While most of these blobs are located within the rings, we found that one of them lies in the cavity between the rings, along the primary arm of the spiral design. This blob might be due to a planet that might also be responsible for the spiral pattern observed within the rings and for the cavity between the two rings. The planet itself is not detected at short wavelengths, where we only see a dust cloud illuminated by stellar light, but the planetary photosphere might be responsible for the emission observed in the K band. The mass of this putative planet may be constrained using photometric and dynamical arguments; it should be between 1 and 4 Jupiter masses. The brightest blobs are found at the 1:2 resonance with this putative planet


title: Methods to simplify cooling of liquid Helium cryostats

abstract: Liquid Helium is used widely, from hospitals to characterization of materials at low temperatures. Many experiments at low temperatures require liquid Helium, particularly when vibration isolation precludes the use of cryocoolers and when one needs to cool heavy equipment such as superconducting coils. Here we describe methods to simplify the operations required to use liquid Helium by eliminating the use of high pressure bottles, avoiding blockage and improving heating and cooling rates. First we show a simple and very low cost method to transfer liquid Helium from a transport container into a cryostat that uses a manual pump having pumping and pressurizing ports, giving a liquid Helium transfer rate of about 100 liters an hour. Second, we describe a closed cycle circuit of Helium gas cooled in an external liquid nitrogen bath that allows precooling a cryogenic experiment without inserting liquid nitrogen into the cryostat, eliminating problems associated to the presence of nitrogen around superconducting magnets. And third, we show a sliding seal assembly and an inner vacuum chamber design that allows inserting large experiments into liquid Helium.


title: Supersymmetric W-algebras

abstract: We develop a general theory of $W$-algebras in the context of supersymmetric vertex algebras. We describe the structure of $W$-algebras associated with odd nilpotent elements of Lie superalgebras in terms of their free generating sets. As an application, we produce explicit free generators of the $W$-algebra associated with the odd principal nilpotent element of the Lie superalgebra $\mathfrak{gl}(n+1|n).$


title: The Asymptotic Complexity of Coded-BKW with Sieving Using Increasing Reduction Factors

abstract: The Learning with Errors problem (LWE) is one of the main candidates for post-quantum cryptography. At Asiacrypt 2017, coded-BKW with sieving, an algorithm combining the Blum-Kalai-Wasserman algorithm (BKW) with lattice sieving techniques, was proposed. In this paper, we improve that algorithm by using different reduction factors in different steps of the sieving part of the algorithm. In the Regev setting, where $q = n^2$ and $\sigma = n^{1.5}/(\sqrt{2\pi}\log_2^2 n)$, the asymptotic complexity is $2^{0.8917n}$, improving the previously best complexity of $2^{{0.8927n}}$. When a quantum computer is assumed or the number of samples is limited, we get a similar level of improvement.


title: Cartan Actions of Higher Rank Abelian Groups and their Classification

abstract: We study $\mathbb{R}^k \times \mathbb{Z}^\ell$ actions on arbitrary compact manifolds with a projectively dense set of Anosov elements and 1-dimensional coarse Lyapunov foliations. Such actions are called totally Cartan actions. We completely classify such actions as built from low-dimensional Anosov flows and diffeomorphisms and affine actions, verifying the Katok-Spatzier conjecture for this class. This is achieved by introducing a new tool, the action of a dynamically defined topological group describing paths in coarse Lyapunov foliations, and understanding its generators and relations. We obtain applications to the Zimmer program.


title: Explaining Explanations to Society

abstract: There is a disconnect between explanatory artificial intelligence (XAI) methods and the types of explanations that are useful for and demanded by society (policy makers, government officials, etc.) Questions that experts in artificial intelligence (AI) ask opaque systems provide inside explanations, focused on debugging, reliability, and validation. These are different from those that society will ask of these systems to build trust and confidence in their decisions. Although explanatory AI systems can answer many questions that experts desire, they often don't explain why they made decisions in a way that is precise (true to the model) and understandable to humans. These outside explanations can be used to build trust, comply with regulatory and policy changes, and act as external validation. In this paper, we focus on XAI methods for deep neural networks (DNNs) because of DNNs' use in decision-making and inherent opacity. We explore the types of questions that explanatory DNN systems can answer and discuss challenges in building explanatory systems that provide outside explanations for societal requirements and benefit.


title: Cylindrical Systems in General Relativity

abstract: With the arrival of the era of gravitational wave astronomy, the strong gravitational field regime will be explored soon in various aspects. In this article, we provide a general review over cylindrical systems in Einstein's theory of general relativity. In particular, we first review the general properties, both local and global, of several important solutions of Einstein's field equations, including the Levi-Civita and Lewis solutions and their extensions to include the cosmological constant and matter fields, and pay particular attention to properties that represent the generic features of the theory, such as the formation of the observed extragalactic jets and gravitational Faraday rotation. We also review studies of cylindrical wormholes, gravitational collapse and Hoop conjecture, and polarizations of gravitational waves. In addition, by rigorously defining cylindrically symmetric spacetimes, we clarify various (incorrect) claims existing in the literature, regarding to the generality of such spacetimes.


title: Discrete time optimal control with frequency constraints for non-smooth systems

abstract: We present a Pontryagin maximum principle for discrete time optimal control problems with (a) pointwise constraints on the control actions and the states, (b) frequency constraints on the control and the state trajectories, and (c) nonsmooth dynamical systems. Pointwise constraints on the states and the control actions represent desired and/or physical limitations on the states and the control values; such constraints are important and are widely present in the optimal control literature. Constraints of the type (b), while less standard in the literature, effectively serve the purpose of describing important spectral properties of inertial actuators and systems. The conjunction of constraints of the type (a) and (b) is a relatively new phenomenon in optimal control but are important for the synthesis control trajectories with a high degree of fidelity. The maximum principle established here provides first order necessary conditions for optimality that serve as a starting point for the synthesis of control trajectories corresponding to a large class of constrained motion planning problems that have high accuracy in a computationally tractable fashion. Moreover, the ability to handle a reasonably large class of nonsmooth dynamical systems that arise in practice ensures broad applicability our theory, and we include several illustrations of our results on standard problems.


title: Consistent Optimization for Single-Shot Object Detection

abstract: We present consistent optimization for single stage object detection. Previous works of single stage object detectors usually rely on the regular, dense sampled anchors to generate hypothesis for the optimization of the model. Through an examination of the behavior of the detector, we observe that the misalignment between the optimization target and inference configurations has hindered the performance improvement. We propose to bride this gap by consistent optimization, which is an extension of the traditional single stage detector's optimization strategy. Consistent optimization focuses on matching the training hypotheses and the inference quality by utilizing of the refined anchors during training. To evaluate its effectiveness, we conduct various design choices based on the state-of-the-art RetinaNet detector. We demonstrate it is the consistent optimization, not the architecture design, that yields the performance boosts. Consistent optimization is nearly cost-free, and achieves stable performance gains independent of the model capacities or input scales. Specifically, utilizing consistent optimization improves RetinaNet from 39.1 AP to 40.1 AP on COCO dataset without any bells or whistles, which surpasses the accuracy of all existing state-of-the-art one-stage detectors when adopting ResNet-101 as backbone. The code will be made available.


title: Maximal abelian extension of $X_0(p)$ unramified outside cusps

abstract: Let $p$ be a prime number. Mazur proved that a geometrically maximal unramified abelian covering of $X_0(p)$ over $\mathbb Q$ is given by the Shimura covering $X_2(p) \to X_0(p)$, that is, a unique subcovering of $X_1(p) \to X_0(p)$ of degree $N_p := (p-1)/\gcd(p-1, 12)$. In this short paper, we show that a geometrically maximal abelian covering $X_2'(p) \to X_0(p)$ of $X_0(p)$ over $\mathbb Q$ unramified outside cusps is cyclic of degree $2N_p$. The main ingredient for the construction of $X_2'(p)$ is the generalized Dedelind eta functions.


title: Renormalized Onsager functions and merging of vortex clusters

abstract: In this letter we numerically investigate the merging mechanism between two clusters of point vortices. We introduce a concept of renormalized Onsager function, an elaboration of the solutions of the mean field equation, and use it to understand the shape of the single cluster observed as a result of the merging process. We finally discuss the potential implications for the inverse cascade 2D turbulence.


title: Overfitting Mechanism and Avoidance in Deep Neural Networks

abstract: Assisted by the availability of data and high performance computing, deep learning techniques have achieved breakthroughs and surpassed human performance empirically in difficult tasks, including object recognition, speech recognition, and natural language processing. As they are being used in critical applications, understanding underlying mechanisms for their successes and limitations is imperative. In this paper, we show that overfitting, one of the fundamental issues in deep neural networks, is due to continuous gradient updating and scale sensitiveness of cross entropy loss. By separating samples into correctly and incorrectly classified ones, we show that they behave very differently, where the loss decreases in the correct ones and increases in the incorrect ones. Furthermore, by analyzing dynamics during training, we propose a consensus-based classification algorithm that enables us to avoid overfitting and significantly improve the classification accuracy especially when the number of training samples is limited. As each trained neural network depends on extrinsic factors such as initial values as well as training data, requiring consensus among multiple models reduces extrinsic factors substantially; for statistically independent models, the reduction is exponential. Compared to ensemble algorithms, the proposed algorithm avoids overgeneralization by not classifying ambiguous inputs. Systematic experimental results demonstrate the effectiveness of the proposed algorithm. For example, using only 1000 training samples from MNIST dataset, the proposed algorithm achieves 95% accuracy, significantly higher than any of the individual models, with 90% of the test samples classified.


title: Tarski's relevance logic; Version 2

abstract: Tarski's relevance logic is defined and shown to contain many formulas and derived rules of inference. The definition arises from Tarski's work on first-order logic restricted to finitely many variables. It is a relevance logic because it contains the Basic Logic of Routley-Plumwood-Meyer-Brady, has Belnap's variable-sharing property, and avoids the paradoxes of implication. It does not include several formulas used as axioms in the Anderson-Belnap system $R$. For example, the Axiom of Contraposition is not in Tarski's relevance logic. On the other hand, the Rules of Contraposition and Disjunctive Syllogism are derived rules of inference in Tarski's relevance logic. It also contains a formula (not previously known or considered as an axiom for any relevance logic) that provides a counterexample to a completeness theorem of T. Kowalski (that the system $R$ is complete with respect to the class of dense commutative relation algebras).


title: SIR epidemics on evolving graphs

abstract: We consider evoSIR, a variant of the SIR model, on Erd\H os-Renyi random graphs in which susceptibles with an infected neighbor break that connection at rate $\rho$ and rewire to a randomly chosen individual. We compute the critical infection rate $\lambda_c$ and the probability of a large epidemic by showing that they are the same for the delSIR model in which $S-I$ connections are deleted instead of rewired. The final size of a large delSIR epidemic has a continuous transition. Simulations suggest that the final size of a large evoSIR epidemic is discontinuous at $\lambda_c$.


title: Learning retrosynthetic planning through self-play

abstract: The problem of retrosynthetic planning can be framed as one player game, in which the chemist (or a computer program) works backwards from a molecular target to simpler starting materials though a series of choices regarding which reactions to perform. This game is challenging as the combinatorial space of possible choices is astronomical, and the value of each choice remains uncertain until the synthesis plan is completed and its cost evaluated. Here, we address this problem using deep reinforcement learning to identify policies that make (near) optimal reaction choices during each step of retrosynthetic planning. Using simulated experience or self-play, we train neural networks to estimate the expected synthesis cost or value of any given molecule based on a representation of its molecular structure. We show that learned policies based on this value network outperform heuristic approaches in synthesizing unfamiliar molecules from available starting materials using the fewest number of reactions. We discuss how the learned policies described here can be incorporated into existing synthesis planning tools and how they can be adapted to changes in the synthesis cost objective or material availability.


title: Revising the stochastic iterative ensemble smoother

abstract: Ensemble randomized maximum likelihood (EnRML) is an iterative (stochastic) ensemble smoother, used for large and nonlinear inverse problems, such as history matching and data assimilation. Its current formulation is overly complicated and has issues with computational costs, noise, and covariance localization, even causing some practitioners to omit crucial prior information. This paper resolves these difficulties and streamlines the algorithm, without changing its output. These simplifications are achieved through the careful treatment of the linearizations and subspaces. For example, it is shown (a) how ensemble linearizations relate to average sensitivity, and (b) that the ensemble does not lose rank during updates. The paper also draws significantly on the theory of the (deterministic) iterative ensemble Kalman smoother (IEnKS). Comparative benchmarks are obtained with the Lorenz-96 model with these two smoothers and the ensemble smoother using multiple data assimilation (ES-MDA).


title: Partial cubes with pre-hull number at most 1

abstract: We prove that a connected bipartite graph G is a partial cube if and only if the set of attaching points of any copoint of G is convex. A consequence of this result is that any connected bipartite graph with pre-hull number at most 1 is a partial cube. We show that the class of partial cubes with pre-hull number at most 1 is closed under gated subgraphs, gated amalgams and cartesian products.


title: Moment-to-Moment Detection of Internal Thought from Eye Vergence Behaviour

abstract: Internal thought refers to the process of directing attention away from a primary visual task to internal cognitive processing. Internal thought is a pervasive mental activity and closely related to primary task performance. As such, automatic detection of internal thought has significant potential for user modelling in intelligent interfaces, particularly for e-learning applications. Despite the close link between the eyes and the human mind, only a few studies have investigated vergence behaviour during internal thought and none has studied moment-to-moment detection of internal thought from gaze. While prior studies relied on long-term data analysis and required a large number of gaze characteristics, we describe a novel method that is computationally light-weight and that only requires eye vergence information that is readily available from binocular eye trackers. We further propose a novel paradigm to obtain ground truth internal thought annotations that exploits human blur perception. We evaluate our method for three increasingly challenging detection tasks: (1) during a controlled math-solving task, (2) during natural viewing of lecture videos, and (3) during daily activities, such as coding, browsing, and reading. Results from these evaluations demonstrate the performance and robustness of vergence-based detection of internal thought and, as such, open up new directions for research on interfaces that adapt to shifts of mental attention.


title: Les Houches Lectures on Renormalization Theory and Effective Field Theories

abstract: These lectures review the formalism of renormalization in quantum field theories with special regard to effective quantum field theories. While renormalization theory is part of every advanced course on quantum field theory, for effective theories some more advanced topics become particularly important. This includes the renormalization of composite operators, operator mixing under scale evolution, and the resummation of large logarithms of scale ratios. This course thus sets the basis for many of the more specialized lecture courses delivered at the 2017 Les Houches Summer School.


title: The Avalanche Principle and negative curvature

abstract: We use the geometric structure of the hyperbolic upper half plane to provide a new proof of the Avalanche Principle introduced by M. Goldstein and W. Schlag in the context of $\mathrm{SL}_{2}(\mathbb{R})$ matrices. This approach allows to interpret and extend this result to arbitrary $\mathrm{CAT}(-1)$ metric spaces. Through the proof, we deduce a polygonal Schur theorem for these spaces.


title: How a moving passive observer can perceive its environment ? The Unruh effect revisited

abstract: We consider a point-like observer that moves in a medium illuminated by noise sources with Lorentz-invariant spectrum. We show that the autocorrelation function of the signal recorded by the observer allows it to perceive its environment. More precisely, we consider an observer with constant acceleration (along a Rindler trajectory) and we exploit the recent work on the emergence of the Green's function from the cross correlation of signals transmitted by noise sources. First we recover the result that the signal recorded by the observer has a constant Wigner transform, i.e. a constant local spectrum, when the medium is homogeneous (this is the classical analogue of the Unruh effect). We complete that result by showing that the Rindler trajectory is the only straight-line trajectory that satisfies this property. We also show that, in the presence of an obstacle in the form of an infinite perfect mirror, the Wigner transform is perturbed when the observer comes into the neighborhood of the obstacle. The perturbation makes it possible for the observer to determine its position relative to the obstacle once the entire trajectory has been traversed.


title: Towards Physically Safe Reinforcement Learning under Supervision

abstract: This paper addresses the question of how a previously available control policy $\pi_s$ can be used as a supervisor to more quickly and safely train a new learned control policy $\pi_L$ for a robot. A weighted average of the supervisor and learned policies is used during trials, with a heavier weight initially on the supervisor, in order to allow safe and useful physical trials while the learned policy is still ineffective. During the process, the weight is adjusted to favor the learned policy. As weights are adjusted, the learned network must compensate so as to give safe and reasonable outputs under the different weights. A pioneer network is introduced that pre-learns a policy that performs similarly to the current learned policy under the planned next step for new weights; this pioneer network then replaces the currently learned network in the next set of trials. Experiments in OpenAI Gym demonstrate the effectiveness of the proposed method.


title: The multi-scale nature of Wall shear stress fluctuations in turbulent Rayleigh-Benard convection

abstract: Measurements of wall shear-stress fluctuations on very long timescales ($\ge$ 1900 free-fall time units) are reported for turbulent Rayleigh-Benard (RB) convection in air at the heated bottom plate of a RB cell, 2.5 m in diameter and 2.5 m in height. The novel sensor simultaneously captures the fluctuations of the magnitude and the direction of the wall shear stress vector $\boldsymbol{\tau}(t)$ with high resolution in the slow air currents. The results show the persistence of a tumble-type structure, which is in a bi-stable state as it oscillates regularly about a mean orientation at a timescale that compares with the typical eddy turnover time. The mean orientation can persist almost hundreds of eddy turnovers, until a re-orientation of this structure in form of a slow precession sets in, while a critical weakening of the mean wall shear stress magnitude - respectively the mean wind - is observed. The amplitudes of turbulent fluctuations in the streamwise wall shear-stress $\tau_x$ along mean wind direction reveal a highly skewed Weibull distribution, while the fluctuations happening on larger time scales follow a symmetric Gaussian distribution. Extreme events such as local flow reversals with negative $\tau_x$ are recovered as rare events and correlate with a rapid angular twist of the wall shear-stress vector. Those events - linked to critical points in the skin friction field - correlate with the coincidence of signals at the tails in both probability distributions.


title: Bifurcations in Ratra-Peebles quintessence models and their extensions

abstract: We have used the dynamical system approach in order to investigate the dynamics of cosmological models of the flat Universe with a non-minimally coupled canonical and phantom scalar field and the Ratra-Peebles potential. Applying methods of the bifurcation theory we have found three cases for which the Universe undergoes a generic evolution emerging from either the deSitter or the static Universe state and finishing at the deSitter state, without the presence of the initial singularity. This generic class of solutions explains both the inflation and the late-time acceleration of the Universe. In this class inflation is an endogenous effect of dynamics itself.


title: Independent set and matching permutations

abstract: Let $G$ be a graph $G$ whose largest independent set has size $m$. A permutation $\pi$ of $\{1, \ldots, m\}$ is an {\em independent set permutation} of $G$ if $$ a_{\pi(1)}(G) \leq a_{\pi(2)}(G) \leq \cdots \leq a_{\pi(m)}(G) $$ where $a_k(G)$ is the number of independent sets of size $k$ in $G$. In 1987 Alavi, Malde, Schwenk and Erd\H{o}s proved that every permutation of $\{1, \ldots, m\}$ is an independent set permutation of some graph with $\alpha(G)=m$, i.e. with largest independent set having size $m$. They raised the question of determining, for each $m$, the smallest number $f(m)$ such that every permutation of $\{1, \ldots, m\}$ is an independent set permutation of some graph with $\alpha(G)=m$ and with at most $f(m)$ vertices, and they gave an upper bound on $f(m)$ of roughly $m^{2m}$. Here we settle the question, determining $f(m)=m^m$, and make progress on a related question, that of determining the smallest order such that every permutation of $\{1, \ldots, m\}$ is the {\em unique} independent set permutation of some graph of at most that order. More generally we consider an extension of independent set permutations to weak orders, and extend Alavi et al.'s main result to show that every weak order on $\{1, \ldots, m\}$ can be realized by the independent set sequence of some graph with $\alpha(G)=m$ and with at most $m^{m+2}$ vertices. Alavi et al. also considered {\em matching permutations}, defined analogously to independent set permutations. They observed that not every permutation of $\{1,\ldots,m\}$ is a matching permutation of some graph with largest matching having size $m$, putting an upper bound of $2^{m-1}$ on the number of matching permutations of $\{1,\ldots,m\}$. Confirming their speculation that this upper bound is not tight, we improve it to $O(2^m/\sqrt{m})$.


title: Design of Real-time Semantic Segmentation Decoder for Automated Driving

abstract: Semantic segmentation remains a computationally intensive algorithm for embedded deployment even with the rapid growth of computation power. Thus efficient network design is a critical aspect especially for applications like automated driving which requires real-time performance. Recently, there has been a lot of research on designing efficient encoders that are mostly task agnostic. Unlike image classification and bounding box object detection tasks, decoders are computationally expensive as well for semantic segmentation task. In this work, we focus on efficient design of the segmentation decoder and assume that an efficient encoder is already designed to provide shared features for a multi-task learning system. We design a novel efficient non-bottleneck layer and a family of decoders which fit into a small run-time budget using VGG10 as efficient encoder. We demonstrate in our dataset that experimentation with various design choices led to an improvement of 10\% from a baseline performance.


title: Approximation Algorithms for the A Priori TravelingRepairman

abstract: We consider the a priori traveling repairman problem, which is a stochastic version of the classic traveling repairman problem (also called the traveling deliveryman or minimum latency problem). Given a metric $(V,d)$ with a root $r\in V$, the traveling repairman problem (TRP) involves finding a tour originating from $r$ that minimizes the sum of arrival-times at all vertices. In its a priori version, we are also given independent probabilities of each vertex being active. We want to find a master tour $\tau$ originating from $r$ and visiting all vertices. The objective is to minimize the expected sum of arrival-times at all active vertices, when $\tau$ is shortcut over the inactive vertices. We obtain the first constant-factor approximation algorithm for a priori TRP under non-uniform probabilities. Previously, such a result was only known for uniform probabilities.


title: Inferring the parallax of Westerlund 1 from Gaia DR2

abstract: Westerlund 1 (Wd1) is potentially the largest star cluster in the Galaxy. That designation critically depends upon the distance to the cluster, yet the cluster is highly obscured, making luminosity-based distance estimates difficult. Using {\it Gaia} Data Release 2 (DR2) parallaxes and Bayesian inference, we infer a parallax of $0.35^{+0.07}_{-0.06}$ mas corresponding to a distance of $2.6^{+0.6}_{-0.4}$ kpc. To leverage the combined statistics of all stars in the direction of Wd1, we derive the Bayesian model for a cluster of stars hidden among Galactic field stars; this model includes the parallax zero-point. Previous estimates for the distance to Wd1 ranged from 1.0 to 5.5 kpc, although values around 5 kpc have usually been adopted. The {\it Gaia} DR2 parallaxes reduce the uncertainty from a factor of 3 to 18\% and rules out the most often quoted value of 5 kpc with 99\% confidence. This new distance allows for more accurate mass and age determinations for the stars in Wd1. For example, the previously inferred initial mass at the main-sequence turn-off was around 40 M$_{\odot}$; the new {\it Gaia} DR2 distance shifts this down to about 22 M$_{\odot}$. This has important implications for our understanding of the late stages of stellar evolution, including the initial mass of the magnetar and the LBV in Wd1. Similarly, the new distance suggests that the total cluster mass is about four times lower than previously calculated.


title: Resolving the nature of electronic excitations in resonant inelastic x-ray scattering

abstract: The study of elementary bosonic excitations is essential toward a complete description of quantum electronic solids. In this context, resonant inelastic X-ray scattering (RIXS) has recently risen to becoming a versatile probe of electronic excitations in strongly correlated electron systems. The nature of the radiation-matter interaction endows RIXS with the ability to resolve the charge, spin and orbital nature of individual excitations. However, this capability has been only marginally explored to date. Here, we demonstrate a systematic method for the extraction of the character of excitations as imprinted in the azimuthal dependence of the RIXS signal. Using this novel approach, we resolve the charge, spin, and orbital nature of elastic scattering, (para-)magnon/bimagnon modes, and higher energy dd excitations in magnetically-ordered and superconducting copper-oxide perovskites (Nd2CuO4 and YBa2Cu3O6.75). Our method derives from a direct application of scattering theory, enabling us to deconstruct the complex scattering tensor as a function of energy loss. In particular, we use the characteristic tensorial nature of each excitation to precisely and reliably disentangle the charge and spin contributions to the low energy RIXS spectrum. This procedure enables to separately track the evolution of spin and charge spectral distributions in cuprates with doping. Our results demonstrate a new capability that can be integrated into the RIXS toolset, and that promises to be widely applicable to materials with intertwined spin, orbital, and charge excitations.


title: Isotropic and Coisotropic Subvarieties of Grassmannians

abstract: We generalize the notion of coisotropic hypersurfaces to subvarieties of Grassmannians having arbitrary codimension. To every projective variety X, Gel'fand, Kapranov and Zelevinsky associate a series of coisotropic hypersurfaces in different Grassmannians. These include the Chow form and the Hurwitz form of X. Gel'fand, Kapranov and Zelevinsky characterized coisotropic hypersurfaces by a rank one condition on conormal spaces, which we use as the starting point for our generalization. We also study the dual notion of isotropic varieties by imposing rank one conditions on tangent spaces instead of conormal spaces.


title: Face Detection and Face Recognition In the Wild Using Off-the-Shelf Freely Available Components

abstract: This paper presents an easy and efficient face detection and face recognition approach using free software components from the internet. Face detection and face recognition problems have wide applications in home and office security. Therefore this work will helpful for those searching for a free face off-the-shelf face detection system. Using this system, faces can be detected in uncontrolled environments. In the detection phase, every individual face is detected and in the recognition phase the detected faces are compared with the faces in a given data set and recognized.


title: Segre indices and Welschinger weights as options for invariant count of real lines

abstract: In our previous paper we have elaborated a certain signed count of real lines on real projective n-dimensional hypersurfaces of degree 2n-1. Contrary to the honest "cardinal" count, it is independent of the choice of a hypersurface, and by this reason provides a strong lower bound on the honest count. In this count the contribution of a line is its local input to the Euler number of a certain auxiliary vector bundle. The aim of this paper is to present other, in a sense more geometric, interpretations of this local input. One of them results from a generalization of Segre species of real lines on cubic surfaces and another from a generalization of Welschinger weights of real lines on quintic threefolds.


title: Fitting ReLUs via SGD and Quantized SGD

abstract: In this paper we focus on the problem of finding the optimal weights of the shallowest of neural networks consisting of a single Rectified Linear Unit (ReLU). These functions are of the form $\mathbf{x}\rightarrow \max(0,\langle\mathbf{w},\mathbf{x}\rangle)$ with $\mathbf{w}\in\mathbb{R}^d$ denoting the weight vector. We focus on a planted model where the inputs are chosen i.i.d. from a Gaussian distribution and the labels are generated according to a planted weight vector. We first show that mini-batch stochastic gradient descent when suitably initialized, converges at a geometric rate to the planted model with a number of samples that is optimal up to numerical constants. Next we focus on a parallel implementation where in each iteration the mini-batch gradient is calculated in a distributed manner across multiple processors and then broadcast to a master or all other processors. To reduce the communication cost in this setting we utilize a Quanitzed Stochastic Gradient Scheme (QSGD) where the partial gradients are quantized. Perhaps unexpectedly, we show that QSGD maintains the fast convergence of SGD to a globally optimal model while significantly reducing the communication cost. We further corroborate our numerical findings via various experiments including distributed implementations over Amazon EC2.


title: Accumulation Bit-Width Scaling For Ultra-Low Precision Training Of Deep Networks

abstract: Efforts to reduce the numerical precision of computations in deep learning training have yielded systems that aggressively quantize weights and activations, yet employ wide high-precision accumulators for partial sums in inner-product operations to preserve the quality of convergence. The absence of any framework to analyze the precision requirements of partial sum accumulations results in conservative design choices. This imposes an upper-bound on the reduction of complexity of multiply-accumulate units. We present a statistical approach to analyze the impact of reduced accumulation precision on deep learning training. Observing that a bad choice for accumulation precision results in loss of information that manifests itself as a reduction in variance in an ensemble of partial sums, we derive a set of equations that relate this variance to the length of accumulation and the minimum number of bits needed for accumulation. We apply our analysis to three benchmark networks: CIFAR-10 ResNet 32, ImageNet ResNet 18 and ImageNet AlexNet. In each case, with accumulation precision set in accordance with our proposed equations, the networks successfully converge to the single precision floating-point baseline. We also show that reducing accumulation precision further degrades the quality of the trained network, proving that our equations produce tight bounds. Overall this analysis enables precise tailoring of computation hardware to the application, yielding area- and power-optimal systems.


title: Rendezvous with Sensitivity

abstract: Let $(X,d)$ be a compact metric space and $f:X \to X$ be a self-map. The compact dynamical system $(X,f)$ is called sensitive or sensitivity depends on initial conditions, if there is a positive constant $\delta$ such that in each non-empty open subset there are distinct points whose iterates will be $\delta-$apart at same instance. This dynamical property, though being a very weak one, brings in the essence of unpredictability in the system. In this article, we survey various sensitivities and some properties implied by and implying such sensitivities.


title: Characterization of 30 $^{76}$Ge enriched Broad Energy Ge detectors for GERDA Phase II

abstract: The GERmanium Detector Array (GERDA) is a low background experiment located at the Laboratori Nazionali del Gran Sasso in Italy, which searches for neutrinoless double beta decay of $^{76}$Ge into $^{76}$Se+2e$^-$. GERDA has been conceived in two phases. Phase II, which started in December 2015, features several novelties including 30 new Ge detectors. These were manufactured according to the Broad Energy Germanium (BEGe) detector design that has a better background discrimination capability and energy resolution compared to formerly widely-used types. Prior to their installation, the new BEGe detectors were mounted in vacuum cryostats and characterized in detail in the HADES underground laboratory in Belgium. This paper describes the properties and the overall performance of these detectors during operation in vacuum. The characterization campaign provided not only direct input for GERDA Phase II data collection and analyses, but also allowed to study detector phenomena, detector correlations as well as to test the strength of pulse shape simulation codes.


title: Enumeration of 3-regular one-face maps on orientable or non-orientable surface up to all symmetries

abstract: We obtain explicit formulas for enumerating $3$-regular one-face maps on orientable and non-orientable surfaces of a given genus $g$ up to all symmetries. We use recent analytical results obtained by Bernardi and Chapuy for counting rooted precubic maps on non-orientable surfaces together with more widely known formulas for counting precubic maps on orientable surfaces. To take into account all symmetries we use a result of Krasko and Omelchenko that allows to reduce this problem to the problem of counting rooted quotient maps on orbifolds.