title: The integration of variable generation and storage into electricity capacity markets

abstract: We show how to value both variable generation and energy storage to enable them to be integrated fairly and optimally into electricity capacity markets. We develop theory based on balancing expected energy unserved against costs of capacity procurement, and in which the optimal procurement is that necessary to meet an appropriate reliability standard. For conventional generation the theory reduces to that already in common use. Further the valuation of both variable generation and storage coincides with the traditional risk-based approach based on equivalent firm capacity. The determination of the equivalent firm capacity of storage requires particular care; this is due both to the flexibility with which storage added to an existing system may be scheduled, and also because, when any resource is added to an existing system, storage already within that system may be flexibly rescheduled. We illustrate the theory with an example based on the GB system.


title: Resolvability of Hamming Graphs

abstract: A subset of vertices in a graph is called resolving when the geodesic distances to those vertices uniquely distinguish every vertex in the graph. Here, we characterize the resolvability of Hamming graphs in terms of a constrained linear system and deduce a novel but straightforward characterization of resolvability for hypercubes. We propose an integer linear programming method to assess resolvability rapidly, and provide a more costly but definite method based on Gr\"obner bases to determine whether or not a set of vertices resolves an arbitrary Hamming graph. As proof of concept, we identify a resolving set of size 77 in the metric space of all octapeptides (i.e., proteins composed of eight amino acids) with respect to the Hamming distance; in particular, any octamer may be readily represented as a 77-dimensional real-vector. Representing k-mers as low-dimensional numerical vectors may enable new applications of machine learning algorithms to symbolic sequences.


title: Proper-time measurement in accelerated relativistic systems

abstract: Separate constituents of extended systems measure proper-times on different world-lines. Relating and comparing proper-time measurements along any two such world-lines requires that common simultaneity be possible, which in turn implies that the system is linearly-rigidly moving so that momentary rest frames are identifiable at any stage of the system's journey in space-time. Once momentary rest-frames have been identified, clocks moving on separate world-lines are synchronizable by light-signal communication. The synchronization relations for two clocks are explicitly computed using light-signals exchanged between them. Implications for the clock hypothesis are included. Also, since simultaneity is frame-dependent, incorrect usage of it leads to pseudo-paradoxes. Counter-examples are discussed.


title: Entropy-stable discontinuous Galerkin approximation with summation-by-parts property for the incompressible Navier-Stokes equations with variable density and artificial compressibility

abstract: We present a provably stable discontinuous Galerkin spectral element method for the incompressible Navier-Stokes equations with artificial compressibility and variable density. Stability proofs, which include boundary conditions, that follow a continuous entropy analysis are provided. We define a mathematical entropy function that combines the traditional kinetic energy and an additional energy term for the artificial compressiblity, and derive its associated entropy conservation law. The latter allows us to construct a provably stable split-form nodal Discontinuous Galerkin (DG) approximation that satisfies the summation-by-parts simultaneous-approximation-term (SBP-SAT) property. The scheme and the stability proof are presented for general curvilinear three-dimensional hexahedral meshes. We use the exact Riemann solver and the Bassi-Rebay 1 (BR1) scheme at the inter-element boundaries for inviscid and viscous fluxes respectively, and an explicit low storage Runge-Kutta RK3 scheme to integrate in time. We assess the accuracy and robustness of the method by solving the Kovasznay flow, the inviscid Taylor-Green vortex, and the Rayleigh-Taylor instability.


title: Diffraction-Based Interaction-Free Measurements

abstract: We introduce diffraction-based interaction-free measurements. In contrast with previous work where a set of discrete paths is engaged, good quality interaction-free measurements can be realized with a continuous set of paths, as is typical of optical propagation. If a bomb is present in a given spatial region -- so sensitive that a single photon will set it off -- its presence can still be detected without exploding it. This is possible because, by not absorbing the photon, the bomb causes the single photon to diffract around it. The resulting diffraction pattern can then be statistically distinguished from the bomb-free case. We work out the case of single- versus double- slit in detail, where the double-slit arises because of a bomb excluding the middle region.


title: Finite volume effects on quarkonium dissociation temperature in an impenetrable QGP sphere

abstract: The system of a quarkonium confined by an impenetrable spherical cavity filled with a hot quantum chromodynamics (QCD) medium is studied by solving the Schr\"{o}dinger equation. This is the first time this issue has been raised for discussion. The Schr\"{o}dinger equation with an appropriate boundary condition of a quarkonium in an impenetrable cavity filled with a hot medium is derived. The numerical results are obtained with the help of Gaussian Expansion Method. Binding energies and radii of the ground and low-excited states are obtained as a function of the medium temperature and the cavity radius. We find the behaviour of quarkonium in this cavity is different from that in infinite space. Our results show that the quarkonium dissociation temperature decreases as the cavity radius decreases and the finite volume effects on the ground state are more obvious than on the excited states. We also find that the less mass of the constituents and the bigger radius of the quarkonium lead the finite volume effects to become more obvious.


title: Ab initio modelling of spin relaxation lengths in disordered graphene nanoribbons{\dag}

abstract: The spin-dependent transport properties of armchair graphene nanoribbons in the presence of extrinsic spin-orbit coupling induced by a random distribution of Nickel adatoms is studied. By combining a recursive Green's function formalism with density functional theory, we explore the influence of ribbon length and metal adatom concentration on the conductance. At a given length, we observed a significant enhancement of the spin-flip channel around resonances and at energies right above the Fermi level. We also estimate the spin-relaxation length, finding values on the order of tens of micrometers at low Ni adatom concentrations. This study is conducted at singular ribbon lengths entirely from fully ab-initio methods, providing indirectly evidence that the Dyakonov-Perel spin relaxation mechanism might be the dominant at low concentrations as well as the observation of oscillations in the spin-polarization.


title: Convergence Analysis of Machine Learning Algorithms for the Numerical Solution of Mean Field Control and Games: I -- The Ergodic Case

abstract: We propose two algorithms for the solution of the optimal control of ergodic McKean-Vlasov dynamics. Both algorithms are based on approximations of the theoretical solutions by neural networks, the latter being characterized by their architecture and a set of parameters. This allows the use of modern machine learning tools, and efficient implementations of stochastic gradient descent.The first algorithm is based on the idiosyncrasies of the ergodic optimal control problem. We provide a mathematical proof of the convergence of the approximation scheme, and we analyze rigorously the approximation by controlling the different sources of error. The second method is an adaptation of the deep Galerkin method to the system of partial differential equations issued from the optimality condition. We demonstrate the efficiency of these algorithms on several numerical examples, some of them being chosen to show that our algorithms succeed where existing ones failed. We also argue that both methods can easily be applied to problems in dimensions larger than what can be found in the existing literature. Finally, we illustrate the fact that, although the first algorithm is specifically designed for mean field control problems, the second one is more general and can also be applied to the partial differential equation systems arising in the theory of mean field games.


title: Coloring invariants of knots and links are often intractable

abstract: Let $G$ be a nonabelian, simple group with a nontrivial conjugacy class $C \subseteq G$. Let $K$ be a diagram of an oriented knot in $S^3$, thought of as computational input. We show that for each such $G$ and $C$, the problem of counting homomorphisms $\pi_1(S^3\setminus K) \to G$ that send meridians of $K$ to $C$ is almost parsimoniously $\mathsf{\#P}$-complete. This work is a sequel to a previous result by the authors that counting homomorphisms from fundamental groups of integer homology 3-spheres to $G$ is almost parsimoniously $\mathsf{\#P}$-complete. Where we previously used mapping class groups actions on closed, unmarked surfaces, we now use braid group actions.


title: Learning Complex Basis Functions for Invariant Representations of Audio

abstract: Learning features from data has shown to be more successful than using hand-crafted features for many machine learning tasks. In music information retrieval (MIR), features learned from windowed spectrograms are highly variant to transformations like transposition or time-shift. Such variances are undesirable when they are irrelevant for the respective MIR task. We propose an architecture called Complex Autoencoder (CAE) which learns features invariant to orthogonal transformations. Mapping signals onto complex basis functions learned by the CAE results in a transformation-invariant "magnitude space" and a transformation-variant "phase space". The phase space is useful to infer transformations between data pairs. When exploiting the invariance-property of the magnitude space, we achieve state-of-the-art results in audio-to-score alignment and repeated section discovery for audio. A PyTorch implementation of the CAE, including the repeated section discovery method, is available online.


title: Topological magnetic-spin textures in two-dimensional van der Waals Cr2Ge2Te6

abstract: Two-dimensional (2D) van der Waals (vdW) materials show a range of profound physical properties that can be tailored through their incorporation in heterostructures and manipulated with external forces. The recent discovery of long-range ferromagnetic order down to atomic layers provides an additional degree of freedom in engineering 2D materials and their heterostructure devices for spintronics, valleytronics and magnetic tunnel junction switches. Here, using direct imaging by cryo-Lorentz transmission electron microscopy we show that topologically nontrivial magnetic-spin states, skyrmionic bubbles, can be realized in exfoliated insulating 2D vdW Cr2Ge2Te6. Due to the competition between dipolar interactions and uniaxial magnetic anisotropy, hexagonally-packed nanoscale bubble lattices emerge by field cooling with magnetic field applied along the out-of-plane direction. Despite a range of topological spin textures in stripe domains arising due to pair formation and annihilation of Bloch lines, bubble lattices with single chirality are prevalent. Our observation of topologically-nontrivial homochiral skyrmionic bubbles in exfoliated vdW materials provides a new avenue for novel quantum states in atomically-thin insulators for magneto-electronic and quantum devices.


title: Distributed Black-Box Optimization via Error Correcting Codes

abstract: We introduce a novel distributed derivative-free optimization framework that is resilient to stragglers. The proposed method employs coded search directions at which the objective function is evaluated, and a decoding step to find the next iterate. Our framework can be seen as an extension of evolution strategies and structured exploration methods where structured search directions were utilized. As an application, we consider black-box adversarial attacks on deep convolutional neural networks. Our numerical experiments demonstrate a significant improvement in the computation times.


title: Geodesic orbit Finsler space with $K\geq0$ and the (FP) condition

abstract: In this paper, we study the interaction between the geodesic orbit (g.o.~in short) property and certain flag curvature conditions. A Finsler manifold is called g.o.~if each constant speed geodesic is the orbit of a one-parameter subgroup. Besides the non-negatively curved condition, we also concern the (FP) condition for the flag curvature, i.e., in any flag we can find a flag pole, such that the flag curvature is positive. The main theorem we will prove is the following. If a g.o.~Finsler space $(M,F)$ has non-negative flag curvature and satisfies the (FP) condition, then $M$ must be compact. Further more, if we present $M$ as $G/H$ where $G$ has a compact Lie algebra, then we have the rank inequality $\mathrm{rk}\mathfrak{g}\leq\mathrm{rk}\mathfrak{h}+1$. As an application of the main theorem, we prove that any even dimensional g.o.~Finsler space which has non-negative flag curvature and satisfies the (FP) condition must be a smooth coset space admitting positively curved homogeneous Riemannian or Finsler metrics.


title: On the Differential Linear Connectivity Table of Vectorial Boolean Functions

abstract: Vectorial Boolean functions are crucial building blocks in symmetric ciphers. Different known attacks on block ciphers have resulted in diverse cryptographic criteria of vectorial Boolean functions,such as differential distribution table and nonlinearity. Very recently, Bar-On et al. introduced at Eurocrypt'19 a new tool, called the Differential-Linear Connectivity Table (DLCT).This paper is a follow-up work, which presents further theoretical characterization of the DLCT of vectorial Boolean functions and also investigates this new criterion of functions with certain forms. In this paper we introduce a generalized concept of the additive autocorrelation, which is extended from Boolean functions to the vectorial Boolean functions, and use it as a main tool to investigate the DLCT property of vectorial Boolean functions. Firstly, by establishing a connection between the DLCT and the additive autocorrelation, we characterize properties of DLCT by means of the Walsh transform and the differential distribution table, and present generic lower bounds on the differential-linear uniformity (DLU) of vectorial Boolean functions. Furthermore, we investigate the DLCT property of monomials, APN, plateaued and AB functions. Our study reveals that the DLCT of these special functions are closely related to other cryptographic criteria. Next, we prove that the DLU of vectorial Boolean functions is invariant underthe EA equivalence but not invariant under the CCZ equivalence, and that the DLCT spectrum is only invariant under affine equivalence. In addition, under affine equivalence, we exhaust the DLCT spectra and DLU of optimal S-boxes with $4$ bit by Magma. Finally, we investigate the DLCT spectra and DLU of some polynomials over $F_{2^n}$, including the inverse, Gold, Bracken-Leander power functions and all quadratic polynomials.


title: A possibility of interpretation of the cosmic ray kneenear 10 TV as a contribution of a single close source

abstract: This article presents a description of a cosmic rays diffusive propagationmodel of a close point-like flash lamp like source and an approximation ofexperimentally observed spectral irregularity with this model. We show thatthis spectral irregularity can be explained using the presented model andprovide the most probable characteristics of such a source as well as severalobserved and identified sources which can be candidates for this role.


title: ND-Wavelets Derived from Anti-symmetric Systems of Isolated Particles using the Determinant of Slater

abstract: Wavelets are known to be closely related to atomic orbital. A new approach of 2D, 3D and multidimensional wavelet system is proposed from a paralell with anti-symmetric systems of several isolated particles. The theory of fermionic states is used to generate new \textit{n}-dimensions wavelets, $n\ge2$, by the determinant of Slater. As pioneering paper in exchanging formalism between particle wave-functions and wavelets, it opens some perspectives for further adaptations derived from the physics of particles in the wavelet analysis scope.


title: Connection Cochain of Abelian Extensions and Connection $1$-Forms

abstract: In this paper, we consider the concept of connection cochain of central extensions introduced by Moriyoshi and apply it to the abelian case. We will show the relationship between connection cochain and connection $1$-form of a principal bundle whose structure group is abelian.


title: Delayed choice experiments and causality in quantum mechanics

abstract: Although it may seem The Delayed Choice experiments contradict causality and one could construct an experiment which could possibly affect the past, using Many World interpretation we prove it is not possible. We also find a mathematical background to Which-path information and show why its obtainability prevents system from interfering. We find a system which exhibit both interference and correlation and show why one-particle interference and correlations are complementary. Better visible interference pattern leads to worse correlations and vice versa. Then, using knowledge gained from Quantum Eraser and Delayed Choice experiments we prove there is not an objective reality in a sense of Einstein, Podolsky and Rosen. Furthermore, we discuss the difference between ``outer'' (non-interacting) and ``inner'' (interacting) observer. We find the mathematical relationship between the ``universal'' wave function used by ``outer'' observer and processes the ``inner'' observer sees, which is our small contribution to the measurement problem.


title: Local Distribution Obfuscation via Probability Coupling

abstract: We introduce a general model for the local obfuscation of probability distributions by probabilistic perturbation, e.g., by adding differentially private noise, and investigate its theoretical properties. Specifically, we relax a notion of distribution privacy (DistP) by generalizing it to divergence, and propose local obfuscation mechanisms that provide divergence distribution privacy. To provide f-divergence distribution privacy, we prove that probabilistic perturbation noise should be added proportionally to the Earth mover's distance between the probability distributions that we want to make indistinguishable. Furthermore, we introduce a local obfuscation mechanism, which we call a coupling mechanism, that provides divergence distribution privacy while optimizing the utility of obfuscated data by using exact/approximate auxiliary information on the input distributions we want to protect.


title: Analytically stable Higgs bundles on some non-K\"ahler manifolds

abstract: In this paper, we study Higgs bundles on non-compact Hermitian manifolds. Under some assumptions for the underlying Hermitian manifolds which are not necessarily K\"ahler, we solve the Hermitian-Einstein equation on analytically stable Higgs bundles.


title: Novel Remapping Approach for HR-EBSD based on Demons Registration

abstract: In this study, the possibility of utilizing a computer vision algorithm, i.e., demons registration, to accurately remap electron backscatter diffraction patterns for high resolution electron backscatter diffraction applications is presented. First, the angular resolution of demons registration is demonstrated to be lower than the conventional cross-correlation based method, particularly at misorientation angles > 9 degrees. In addition, GPU acceleration has been applied to significantly boost the speed of iterative registration between a pair of patterns with 10{\deg} misorientation to under 1s. Second, demons registration is implemented as a first-pass remapping, followed by a second pass cross-correlation method, which results in angular resolution of ~0.5*10-4 degrees, a phantom stress value of ~35MPa and phantom strain of ~2*10-4, on dynamically simulated patterns, without the need of implementing robust fitting or iterative remapping. Lastly, the new remapping method is applied to a large experimental dataset collected from an as-built additively-manufactured Inconel 625 cube, which shows significant residual stresses built-up near the large columnar grain region and regularly arranged GND structures.


title: Symmetric Bloch oscillations of matter waves

abstract: Cold atoms in an optical lattice provide an ideal platform for studying Bloch oscillations. Here, we extend Bloch oscillations to two superposed optical lattices that are accelerated away from one another, and for the first time show that these symmetric Bloch oscillations can split, reflect and recombine matter waves coherently. Using the momentum parity-symmetry of the Hamiltonian, we map out the energy band structure of the process and show that superpositions of momentum states are created by adiabatically following the ground state of the Hamiltonian. The relative phase and velocity of the two lattices completely determines the trajectories of different branches of the matter wave. Experimentally, we demonstrate symmetric Bloch oscillations using cold Cesium atoms where we form interferometers with up to $240\hbar k$ momentum splitting, one of the largest coherent momentum splittings achieved to date. This work has applications in macroscopic tests of quantum mechanics, measurements of fundamental constants, and searches for new physics.


title: Statistical Epistemic Logic

abstract: We introduce a modal logic for describing statistical knowledge, which we call statistical epistemic logic. We propose a Kripke model dealing with probability distributions and stochastic assignments, and show a stochastic semantics for the logic. To our knowledge, this is the first semantics for modal logic that can express the statistical knowledge dependent on non-deterministic inputs and the statistical significance of observed results. By using statistical epistemic logic, we express a notion of statistical secrecy with a confidence level. We also show that this logic is useful to formalize statistical hypothesis testing and differential privacy in a simple and abstract manner.


title: Harish-Chandra bimodules for type A rational Cherednik algebras

abstract: We study Harish-Chandra bimodules for the rational Cherednik algebra associated to the symmetric group $S_{n}$. In particular, we show that for any parameter $c \in \mathbb{C}$, the category of Harish-Chandra $H_{c}$-bimodules admits a fully faithful embedding into the category $\mathcal{O}_{c}$, and describe the irreducibles in the image. We also construct a duality on the category of Harish-Chandra bimodules, and in fact we do this in a greater generality of quantizations of Nakajima quiver varieties. We use this duality, along with induction and restriction functors, to describe, as an abelian category, the smallest Serre subcategory of the category of Harish-Chandra bimodules containing the regular bimodule, as well as to explicitly describe the tensor products of its irreducible objects.


title: Interfering pathways for photon blockade in cavity QED with one and two qubits

abstract: We theoretically study the quantum interference induced photon blockade phenomenon in atom cavity QED system, where the destructive interference between two different transition pathways prohibits the two-photon excitation. Here, we first explore the single atom cavity QED system via an atom or cavity drive. We show that the cavity-driven case will lead to the quantum interference induced photon blockade under a specific condition, but the atom driven case can't result in such interference induced photon blockade. Then, we investigate the two atoms case, and find that an additional transition pathway appears in the atom-driven case. We show that this additional transition pathway results in the quantum interference induced photon blockade only if the atomic resonant frequency is different from the cavity mode frequency. Moreover, in this case, the condition for realizing the interference induced photon blockade is independent of the system's intrinsic parameters, which can be used to generate antibunched photon source both in weak and strong coupling regimes.


title: Elemental abundances in the remnant of the ancient eruption of CK Vulpeculae

abstract: CK Vul or Nova 1670 is an enigmatic eruptive object which underwent a stellar-merger event recorded by seventeenth-century observers. Its remnant was recently recovered at submillimeter wavelengths, revealing gas of an extraordinary isotopic composition indicative of past processing in the CNO cycles and partial He burning. Here, we present long-slit optical spectra of the remnant acquired with X-shooter at the Very Large Telescope at an unprecedented sensitivity and spectral coverage. The spectra cover features of key elements - including H, He, C, N, and O - at ionization degrees I-III. A classical analysis of the spectra allows us to identify several spatio-kinematic components in the probed part of the nebula at electron temperatures of 10-15 kK and densities of 200-600 cm$^{-3}$. We find that the nebula is most likely excited by shocks rather than by direct radiation of the stellar remnant. We provide a detailed analysis of the elemental abundances in the remnant and find that helium is twice more abundant than in the Sun. Nitrogen is also overabundant with a N/O ratio ten times larger than the solar one. These anomalous abundances strongly indicate that the observed gas was processed in CNO cycles of H burning, consistent with the submillimeter studies. Additionally, sub-solar abundances of heavier elements, such as Ne, S, and Ar, suggest that the progenitor of CK Vul was formed from material poorer in metals than the Sun and was therefore an old stellar system before the 1670 eruption.


title: On the Bruhat-Tits stratification of a quaternionic unitary Shimura variety

abstract: In this note we study the special fiber of the Rapoport-Zink space attached to a quaternionic unitary group. The special fiber is described using the so called Bruhat-Tits stratification and is intimately related to the Bruhat-Tits building of a split symplectic group. As an application we describe the supersingular locus of the related Shimura variety.


title: Detection of Influenza A Virus Nucleoprotein Through the Self-Assembly of Nanoparticles in Magnetic Particle Spectroscopy-Based Bioassays: A Method for Rapid, Sensitive, and Wash-free Magnetic Immunoassays

abstract: Magnetic nanoparticles (MNPs) with proper surface functionalization have been extensively applied as labels for magnetic immunoassays, carriers for controlled drug/gene delivery, tracers and contrasts for magnetic imaging, etc. Here, we introduce a new biosensing scheme based on magnetic particle spectroscopy (MPS) and the self-assembly of MNPs to quantitatively detect H1N1 nucleoprotein molecules. MPS monitors the harmonics of oscillating MNPs as a metric for the freedom of rotational motion, thus indicating the bound states of MNPs. These harmonics can be readily collected from nanogram quantities of iron oxide nanoparticles within 10 s. H1N1 nucleoprotein molecule hosts multiple different epitopes that forms binding sites for many IgG polyclonal antibodies. Anchoring IgG polyclonal antibodies onto MNPs triggers the cross-linking between MNPs and H1N1 nucleoprotein molecules, thereby forming MNP self-assemblies. Using MPS and the self-assembly of MNPs, we achieved the sensitivity of 44 nM (442 pmole) for detecting H1N1 nucleoprotein. In addition, the morphologies and the hydrodynamic sizes of the MNP self-assemblies are characterized to verify the MPS results. Different MNP self-assembly models such as classical cluster, open ring tetramer, chain model as well as multimers (from dimer to pentamer) are proposed in this paper. Herein, we claim the feasibility of using MPS and the self-assembly of MNPs as a new biosensing scheme for detecting ultralow concentrations of target biomolecules, which can be employed as rapid, sensitive, and wash-free magnetic immunoassays.


title: The Two-Sided Game of Googol and Sample-Based Prophet Inequalities

abstract: The secretary problem or the game of Googol are classic models for online selection problems that have received significant attention in the last five decades. We consider a variant of the problem and explore its connections to data-driven online selection. Specifically, we are given $n$ cards with arbitrary non-negative numbers written on both sides. The cards are randomly placed on $n$ consecutive positions on a table, and for each card, the visible side is also selected at random. The player sees the visible side of all cards and wants to select the card with the maximum hidden value. To this end, the player flips the first card, sees its hidden value and decides whether to pick it or drop it and continue with the next card. We study algorithms for two natural objectives. In the first one, as in the secretary problem, the player wants to maximize the probability of selecting the maximum hidden value. We show that this can be done with probability at least $0.45292$. In the second one, similar to the prophet inequality, the player maximizes the expectation of the selected hidden value. We show a guarantee of at least $0.63518$ with respect to the expected maximum hidden value. Our algorithms result from combining three basic strategies. One is to stop whenever we see a value larger than the initial $n$ visible numbers. The second one is to stop the first time the last flipped card's value is the largest of the currently $n$ visible numbers in the table. And the third one is similar to the latter but it additionally requires that the last flipped value is larger than the value on the other side of its card. We apply our results to the prophet secretary problem with unknown distributions, but with access to a single sample from each distribution. Our guarantee improves upon $1-1/e$ for this problem, which is the currently best known guarantee and only works for the i.i.d. case.


title: Intelligent Reflecting Surface: Practical Phase Shift Model and Beamforming Optimization

abstract: Intelligent reflecting surface (IRS) that enables the control of the wireless propagation environment has been looked upon as a promising technology for boosting the spectrum and energy efficiency in future wireless communication systems. Prior works on IRS are mainly based on the ideal phase shift model assuming the full signal reflection by each of the elements regardless of its phase shift, which, however, is practically difficult to realize. In contrast, we propose in this paper a practical phase shift model that captures the phase-dependent amplitude variation in the element-wise reflection coefficient. Applying this new model to an IRS-aided wireless system, we formulate a problem to maximize its achievable rate by jointly optimizing the transmit beamforming and the IRS reflect beamforming. The formulated problem is non-convex and difficult to be optimally solved in general, for which we propose a low-complexity suboptimal solution based on the alternating optimization (AO) technique. Simulation results unveil a substantial performance gain achieved by the joint beamforming optimization based on the proposed phase shift model as compared to the conventional ideal model.


title: Further Inequalities for the Numerical Radius of Hilbert Space Operators

abstract: In this article, we present some new inequalities for numerical radius of Hilbert space operators via convex functions. Our results generalize and improve earlier results by El-Haddad and Kittaneh. Among several results, we show that if $A\in \mathbb{B}\left( \mathcal{H} \right)$ and $r\ge 2$, then \[{{w}^{r}}\left( A \right)\le {{\left\| A \right\|}^{r}}-\underset{\left\| x \right\|=1}{\mathop{\inf }}\,{{\left\| {{\left| \left| A \right|-w\left( A \right) \right|}^{\frac{r}{2}}}x \right\|}^{2}}\] where $w\left( \cdot \right)$ and $\left\| \cdot \right\|$ denote the numerical radius and usual operator norm, respectively.


title: Observation of many-body dynamics of Rydberg atoms based on antiblockade using two-color excitation

abstract: We investigate a long-range interaction between $64D_{5/2}$ Rydberg-atom pairs and antiblockade effect employing a two-color excitation scheme. The first color (pulse A) is set to resonantly excite the Rydberg transition and prepare a few seed atoms, which establish a blockade region due to strong long-range interaction between Rydberg-atom pairs. The second color (pulse B) is blue detuned relative to Rydberg transition and enables further Rydberg excitation of atoms by counteracting the blockade effect. It is found that a few seed atoms lead to a huge difference of the Rydberg excitation with pulse B. The dynamic evolution of antiblockade excitation by varying the pulse-B duration at 30-MHz blue detuning is also investigated. The evolution result reveals that a small amount of seed atoms can trigger an avalanche Rydberg excitation. A modified superatom model is used to simulate the antiblockade effect and relevant dynamic evolution. The simulations are consistent with the experimental measurements.


title: BeSense: Leveraging WiFi Channel Data and Computational Intelligence for Behavior Analysis

abstract: The ever evolving informatics technology has gradually bounded human and computer in a compact way. Understanding user behavior becomes a key enabler in many fields such as sedentary-related healthcare, human-computer interaction (HCI) and affective computing. Traditional sensor-based and vision-based user behavior analysis approaches are obtrusive in general, hindering their usage in realworld. Therefore, in this article, we first introduce WiFi signal as a new source instead of sensor and vision for unobtrusive user behaviors analysis. Then we design BeSense, a contactless behavior analysis system leveraging signal processing and computational intelligence over WiFi channel state information (CSI). We prototype BeSense on commodity low-cost WiFi devices and evaluate its performance in realworld environments. Experimental results have verified its effectiveness in recognizing user behaviors.


title: Fisher-Rao Geometry and Jeffreys Prior for Pareto Distribution

abstract: In this paper, we investigate the Fisher-Rao geometry of the two-parameter family of Pareto distribution. We prove that its geometrical structure is isometric to the Poincar\'e upper half-plane model, and then study the corresponding geometrical features by presenting explicit expressions for connection, curvature and geodesics. It is then applied to Bayesian inference by considering the Jeffreys prior determined by the volume form. In addition, the posterior distribution from the prior is computed, providing a systematic method to the Bayesian inference for Pareto distribution.


title: SynthText3D: Synthesizing Scene Text Images from 3D Virtual Worlds

abstract: With the development of deep neural networks, the demand for a significant amount of annotated training data becomes the performance bottlenecks in many fields of research and applications. Image synthesis can generate annotated images automatically and freely, which gains increasing attention recently. In this paper, we propose to synthesize scene text images from the 3D virtual worlds, where the precise descriptions of scenes, editable illumination/visibility, and realistic physics are provided. Different from the previous methods which paste the rendered text on static 2D images, our method can render the 3D virtual scene and text instances as an entirety. In this way, real-world variations, including complex perspective transformations, various illuminations, and occlusions, can be realized in our synthesized scene text images. Moreover, the same text instances with various viewpoints can be produced by randomly moving and rotating the virtual camera, which acts as human eyes. The experiments on the standard scene text detection benchmarks using the generated synthetic data demonstrate the effectiveness and superiority of the proposed method. The code and synthetic data is available at: https://github.com/MhLiao/SynthText3D


title: The automorphism groups of some token graphs

abstract: In this paper we obtain the automorphism groups of the token graphs of some graphs. In particular we obtain the automorphism group of the $k$-token graph of the path graph $P_n$, for $n\neq 2k$. Also, we obtain the automorphism group of the $2$-token graph of the following graphs: cycle, star, fan and wheel graphs.


title: On linear regression in three-dimensional Euclidean space

abstract: The three-dimensional linear regression problem is a problem of finding a spacial straight line best fitting a group of points in three-dimensional Euclidean space. This problem is considered in the present paper and a solution to it is given in a coordinate-free form.


title: The Futility of Bias-Free Learning and Search

abstract: Building on the view of machine learning as search, we demonstrate the necessity of bias in learning, quantifying the role of bias (measured relative to a collection of possible datasets, or more generally, information resources) in increasing the probability of success. For a given degree of bias towards a fixed target, we show that the proportion of favorable information resources is strictly bounded from above. Furthermore, we demonstrate that bias is a conserved quantity, such that no algorithm can be favorably biased towards many distinct targets simultaneously. Thus bias encodes trade-offs. The probability of success for a task can also be measured geometrically, as the angle of agreement between what holds for the actual task and what is assumed by the algorithm, represented in its bias. Lastly, finding a favorably biasing distribution over a fixed set of information resources is provably difficult, unless the set of resources itself is already favorable with respect to the given task and algorithm.


title: Extracting Interpretable Physical Parameters from Spatiotemporal Systems using Unsupervised Learning

abstract: Experimental data is often affected by uncontrolled variables that make analysis and interpretation difficult. For spatiotemporal systems, this problem is further exacerbated by their intricate dynamics. Modern machine learning methods are particularly well-suited for analyzing and modeling complex datasets, but to be effective in science, the result needs to be interpretable. We demonstrate an unsupervised learning technique for extracting interpretable physical parameters from noisy spatiotemporal data and for building a transferable model of the system. In particular, we implement a physics-informed architecture based on variational autoencoders that is designed for analyzing systems governed by partial differential equations (PDEs). The architecture is trained end-to-end and extracts latent parameters that parameterize the dynamics of a learned predictive model for the system. To test our method, we train our model on simulated data from a variety of PDEs with varying dynamical parameters that act as uncontrolled variables. Numerical experiments show that our method can accurately identify relevant parameters and extract them from raw and even noisy spatiotemporal data (tested with roughly 10% added noise). These extracted parameters correlate well (linearly with $R^2 > 0.95$) with the ground truth physical parameters used to generate the datasets. We then apply this method to nonlinear fiber propagation data, generated by an ab-initio simulation, to demonstrate its capabilities on a more realistic dataset. Our method for discovering interpretable latent parameters in spatiotemporal systems will allow us to better analyze and understand real-world phenomena and datasets, which often have unknown and uncontrolled variables that alter the system dynamics and cause varying behaviors that are difficult to disentangle.

categories: physics.comp-ph cs.LG physics.data-an stat.ML


title: Efficient methods to determine the reversibility of general 1D linear cellular automata in polynomial complexity

abstract: In this paper, we study reversibility of one-dimensional(1D) linear cellular automata(LCA) under null boundary condition, whose core problems have been divided into two main parts: calculating the period of reversibility and verifying the reversibility in a period. With existing methods, the time and space complexity of these two parts are still too expensive to be employed. So the process soon becomes totally incalculable with a slightly big size, which greatly limits its application. In this paper, we set out to solve these two problems using two efficient algorithms, which make it possible to solve reversible LCA of very large size. Furthermore, we provide an interesting perspective to conversely generate 1D LCA from a given period of reversibility. Due to our methods' efficiency, we can calculate the reversible LCA with large size, which has much potential to enhance security in cryptography system.


title: Motion Planning Networks: Bridging the Gap Between Learning-based and Classical Motion Planners

abstract: This paper describes Motion Planning Networks (MPNet), a computationally efficient, learning-based neural planner for solving motion planning problems. MPNet uses neural networks to learn general near-optimal heuristics for path planning in seen and unseen environments. It takes environment information such as raw point-cloud from depth sensors, as well as a robot's initial and desired goal configurations and recursively calls itself to bidirectionally generate connectable paths. In addition to finding directly connectable and near-optimal paths in a single pass, we show that worst-case theoretical guarantees can be proven if we merge this neural network strategy with classical sample-based planners in a hybrid approach while still retaining significant computational and optimality improvements. To train the MPNet models, we present an active continual learning approach that enables MPNet to learn from streaming data and actively ask for expert demonstrations when needed, drastically reducing data for training. We validate MPNet against gold-standard and state-of-the-art planning methods in a variety of problems from 2D to 7D robot configuration spaces in challenging and cluttered environments, with results showing significant and consistently stronger performance metrics, and motivating neural planning in general as a modern strategy for solving motion planning problems efficiently.


title: A Cost Effective Solution for Road Crack Inspection using Cameras and Deep Neural Networks

abstract: Automatic crack detection on pavement surfaces is an important research field in the scope of developing an intelligent transportation infrastructure system. In this paper, a cost effective solution for road crack inspection by mounting commercial grade sport camera, GoPro, on the rear of the moving vehicle is introduced. Also, a novel method called ConnCrack combining conditional Wasserstein generative adversarial network and connectivity maps is proposed for road crack detection. In this method, a 121-layer densely connected neural network with deconvolution layers for multi-level feature fusion is used as generator, and a 5-layer fully convolutional network is used as discriminator. To overcome the scattered output issue related to deconvolution layers, connectivity maps are introduced to represent the crack information within the proposed ConnCrack. The proposed method is tested on a publicly available dataset as well our collected data. The results show that the proposed method achieves state-of-the-art performance compared with other existing methods in terms of precision, recall and F1 score.


title: Cross section measurements of $e^{+}e^{-} \to K^{+}K^{-}K^{+}K^{-} $ and $ \phi K^{+}K^{-}$ at center-of-mass energies from 2.10 to 3.08 GeV

abstract: We measure the Born cross sections of the process $e^{+}e^{-} \to K^{+}K^{-}K^{+}K^{-}$ at center-of-mass (c.m.) energies, $\sqrt{s}$, between 2.100 and 3.080 GeV. The data were collected using the BESIII detector at the BEPCII collider. An enhancement at $\sqrt{s}= 2.232$ GeV is observed, very close to the $e^{+}e^{-} \to \Lambda \overline{\Lambda}$ production threshold. A similar enhancement at the same c.m. energy is observed in the $e^{+}e^{-} \to \phi K^{+}K^{-}$ cross section. The energy dependence of the $K^{+}K^{-}K^{+}K^{-}$ and $\phi K^{+}K^{-}$ cross sections differs significantly from that of $e^{+}e^{-} \to \phi \pi^{+}\pi^{-}$.


title: On products of primes and square-free integers in arithmetic progressions

abstract: We obtain an asymptotic formula for the number of ways to represent every reduced residue class as a product of a prime and square-free integer. This may be considered as a relaxed version of a conjecture of Erd\"os, Odlyzko, and S\'ark\"ozy.


title: Learn Spelling from Teachers: Transferring Knowledge from Language Models to Sequence-to-Sequence Speech Recognition

abstract: Integrating an external language model into a sequence-to-sequence speech recognition system is non-trivial. Previous works utilize linear interpolation or a fusion network to integrate external language models. However, these approaches introduce external components, and increase decoding computation. In this paper, we instead propose a knowledge distillation based training approach to integrating external language models into a sequence-to-sequence model. A recurrent neural network language model, which is trained on large scale external text, generates soft labels to guide the sequence-to-sequence model training. Thus, the language model plays the role of the teacher. This approach does not add any external component to the sequence-to-sequence model during testing. And this approach is flexible to be combined with shallow fusion technique together for decoding. The experiments are conducted on public Chinese datasets AISHELL-1 and CLMAD. Our approach achieves a character error rate of 9.3%, which is relatively reduced by 18.42% compared with the vanilla sequence-to-sequence model.


title: On the generalization of the exponential basis for tensor network representations of long-range interactions in two and three dimensions

abstract: In one dimension (1D), a general decaying long-range interaction can be fit to a sum of exponential interactions $e^{-\lambda r_{ij}}$ with varying exponents $\lambda$, each of which can be represented by a simple matrix product operator (MPO) with bond dimension $D=3$. Using this technique, efficient and accurate simulations of 1D quantum systems with long-range interactions can be performed using matrix product states (MPS). However, the extension of this construction to higher dimensions is not obvious. We report how to generalize the exponential basis to 2D and 3D by defining the basis functions as the Green's functions of the discretized Helmholtz equation for different Helmholtz parameters $\lambda$, a construction which is valid for lattices of any spatial dimension. Compact tensor network representations can then be found for the discretized Green's functions, by expressing them as correlation functions of auxiliary fermionic fields with nearest neighbor interactions via Grassmann Gaussian integration. Interestingly, this analytic construction in 3D yields a $D=4$ tensor network representation of correlation functions which (asymptotically) decay as the inverse distance ($r^{-1}_{ij}$), thus generating the (screened) Coulomb potential on a cubic lattice. These techniques will be useful in tensor network simulations of realistic materials.


title: Combinatorics in the exterior algebra and the Bollob\'{a}s Two Families Theorem

abstract: We investigate the combinatorial structure of subspaces of the exterior algebra of a finite-dimensional real vector space, working in parallel with the extremal combinatorics of hypergraphs. Using initial monomials, projections of the underlying vector space onto subspaces, and the interior product, we find analogues of local and global LYM inequalities, the Erd\H{o}s-Ko-Rado theorem, and the Ahlswede-Khachatrian bound for $t$-intersecting hypergraphs. Using these tools, we prove a new extension of the Two Families Theorem of Bollob\'{a}s, giving a weighted bound for subspace configurations satisfying a skew cross-intersection condition. We also verify a recent conjecture of Gerbner, Keszegh, Methuku, Abhishek, Nagy, Patk\'{o}s, Tompkins, and Xiao on pairs of set systems satisfying both an intersection and a cross-intersection condition.


title: Shape optimization for composite materials and scaffolds

abstract: This article combines shape optimization and homogenization techniques by looking for the optimal design of the microstructure in composite materials and of scaffolds. The development of materials with specific properties is of huge practical interest, for example, for medical applications or for the development of light weight structures in aeronautics. In particular, the optimal design of microstructures leads to fundamental questions for porous media: what is the sensitivity of homogenized coefficients with respect to the shape of the microstructure? We compute Hadamard's shape gradient for the problem of realizing a prescribed effective tensor and demonstrate the applicability and feasibility of our approach by numerical experiments.


title: Questaal: a package of electronic structure methods based on the linear muffin-tin orbital technique

abstract: This paper summarises the theory and functionality behind Questaal, an open-source suite of codes for calculating the electronic structure and related properties of materials from first principles. The formalism of the linearised muffin-tin orbital (LMTO) method is revisited in detail and developed further by the introduction of short-ranged tight-binding basis functions for full-potential calculations. The LMTO method is presented in both Green's function and wave function formulations for bulk and layered systems. The suite's full-potential LMTO code uses a sophisticated basis and augmentation method that allows an efficient and precise solution to the band problem at different levels of theory, most importantly density functional theory, LDA+U, quasi-particle self-consistent GW and combinations of these with dynamical mean field theory. This paper details the technical and theoretical bases of these methods, their implementation in Questaal, and provides an overview of the code's design and capabilities.


title: Multiscale Principle of Relevant Information for Hyperspectral Image Classification

abstract: This paper proposes a novel architecture, termed multiscale principle of relevant information (MPRI), to learn discriminative spectral-spatial features for hyperspectral image (HSI) classification. MPRI inherits the merits of the principle of relevant information (PRI) to effectively extract multiscale information embedded in the given data, and also takes advantage of the multilayer structure to learn representations in a coarse-to-fine manner. Specifically, MPRI performs spectral-spatial pixel characterization (using PRI) and feature dimensionality reduction (using regularized linear discriminant analysis) iteratively and successively. Extensive experiments on three benchmark data sets demonstrate that MPRI outperforms existing state-of-the-art methods (including deep learning based ones) qualitatively and quantitatively, especially in the scenario of limited training samples. Code of MPRI is available at \url{http://bit.ly/MPRI_HSI}.


title: Structure-Aware Residual Pyramid Network for Monocular Depth Estimation

abstract: Monocular depth estimation is an essential task for scene understanding. The underlying structure of objects and stuff in a complex scene is critical to recovering accurate and visually-pleasing depth maps. Global structure conveys scene layouts, while local structure reflects shape details. Recently developed approaches based on convolutional neural networks (CNNs) significantly improve the performance of depth estimation. However, few of them take into account multi-scale structures in complex scenes. In this paper, we propose a Structure-Aware Residual Pyramid Network (SARPN) to exploit multi-scale structures for accurate depth prediction. We propose a Residual Pyramid Decoder (RPD) which expresses global scene structure in upper levels to represent layouts, and local structure in lower levels to present shape details. At each level, we propose Residual Refinement Modules (RRM) that predict residual maps to progressively add finer structures on the coarser structure predicted at the upper level. In order to fully exploit multi-scale image features, an Adaptive Dense Feature Fusion (ADFF) module, which adaptively fuses effective features from all scales for inferring structures of each scale, is introduced. Experiment results on the challenging NYU-Depth v2 dataset demonstrate that our proposed approach achieves state-of-the-art performance in both qualitative and quantitative evaluation. The code is available at https://github.com/Xt-Chen/SARPN.


title: Stability of Bott--Samelson Classes in Algebraic Cobordism

abstract: In this paper, we construct stable Bott--Samelson classes in the projective limit of the algebraic cobordism rings of full flag varieties, upon an initial choice of a reduced word in a given dimension. Each stable Bott--Samelson class is represented by a bounded formal power series modulo symmetric functions in positive degree. We make some explicit computations for those power series in the case of infinitesimal cohomology. We also obtain a formula of the restriction of Bott--Samelson classes to smaller flag varieties.


title: Convex hypersurface theory in contact topology

abstract: We lay the foundations of convex hypersurface theory (CHT) in contact topology, extending the work of Giroux in dimension three. Specifically, we prove that any closed hypersurface in a contact manifold can be $C^0$-approximated by a convex one. We also prove that a $C^0$-generic family of mutually disjoint closed hypersurfaces parametrized by $t \in [0,1]$ is convex except at finitely many times $t_1, \dots, t_N$, and that crossing each $t_i$ corresponds to a bypass attachment. As applications of CHT, we prove the existence of compatible (relative) open book decompositions for contact manifolds and an existence h-principle for codimension 2 contact submanifolds.


title: The $B_\infty$-structure on the derived endomorphism algebra of the unit in a monoidal category

abstract: Consider a monoidal category which is at the same time abelian with enough projectives and such that projectives are flat on the right. We show that there is a $B_{\infty}$-algebra which is $A_{\infty}$-quasi-isomorphic to the derived endomorphism algebra of the tensor unit. This $B_{\infty}$-algebra is obtained as the co-Hochschild complex of a projective resolution of the tensor unit, endowed with a lifted $A_{\infty}$-coalgebra structure. We show that in the classical situation of the category of bimodules over an algebra, this newly defined $B_{\infty}$-algebra is isomorphic to the Hochschild complex of the algebra in the homotopy category of $B_{\infty}$-algebras.


title: Non-classicality of spin structures in condensed matter: An analysis of Sr$_{14}$Cu$_{24}$O$_{41}$

abstract: When two quantum systems are coupled via a mediator, their dynamics has traces of non-classical properties of the mediator. We show how this observation can be effectively utilised to study the quantum nature of materials without well-established structure. A concrete example considered is Sr$_{14}$Cu$_{24}$O$_{41}$. Measurements of low temperature magnetic and thermal properties of this compound were explained with long-range coupling of unpaired spins through dimerised spin chains. We first show that the required coupling is not provided by the spin chain alone and give alternative compact two-dimensional spin structures compatible with the experimental results. Then we argue that any mediator between the unpaired spins must share with them quantum correlations in the form of quantum discord and in many cases quantum entanglement. In conclusion, present data witnesses quantum mediators between unpaired spins in Sr$_{14}$Cu$_{24}$O$_{41}$.


title: An extensive-air-shower-like event registered with the TUS orbital detector

abstract: TUS (Tracking Ultraviolet Set-up) is the world's first orbital detector of ultra-high-energy cosmic rays (UHECRs). It was launched into orbit on 28th April 2016 as a part of the scientific payload of the Lomonosov satellite. The main aim of the mission was to test the technique of measuring the ultraviolet fluorescence and Cherenkov radiation of extensive air showers generated by primary cosmic rays with energies above ~100 EeV in the Earth atmosphere from space. During its operation for 1.5 years, TUS registered almost 80,000 events with a few of them satisfying conditions anticipated for extensive air showers (EASs) initiated by UHECRs. Here we discuss an event registered on 3rd October 2016. The event was measured in perfect observation conditions as an ultraviolet track in the nocturnal atmosphere of the Earth, with the kinematics and the light curve similar to those expected from an EAS. A reconstruction of parameters of a primary particle gave the zenith angle around 44$^\circ$ but an extreme energy not compatible with the cosmic ray energy spectrum obtained with ground-based experiments. We discuss in details all conditions of registering the event, explain the reconstruction procedure and its limitations and comment on possible sources of the signal, both of anthropogenic and astrophysical origin. We believe this detection represents a significant milestone in the space-based observation of UHECRs because it proves the capability of an orbital telescope to detect light signals with the apparent motion and light shape similar to what are expected from EASs. This is important for the on-going development of the future missions KLYPVE-EUSO and POEMMA, aimed for studying UHECRs from space.


title: Gait Generation using Intrinsically Stable MPC in the Presence of Persistent Disturbances

abstract: Maintaining balance while walking is not a simple task for a humanoid robot because of its complex dynamics. The presence of a persistent disturbance makes this task even more challenging, as it can cause a loss of balance and ultimately lead the the robot to a fall. In this paper, we extend our previously proposed Intrinsically Stable MPC (IS-MPC), which guarantees boundedness of the CoM with respect to the ZMP, to the case of persistent disturbances. This is achieved by designing a disturbance observer whose estimate is used to compute a modified stability constraint included in the QP problem formulation. The method is validated by MATLAB simulations for the LIP as well as dynamic simulations for a NAO humanoid in DART.


title: On the convergence rate of some nonlocal energies

abstract: We study the rate of convergence of some nonlocal functionals recently considered by Bourgain, Brezis and Mironescu. In particular we establish the $\Gamma$-convergence of the corresponding rate functionals, suitably rescaled, to a limit functional of second order.


title: High-performance super-capacity using activated glassy carbon foam

abstract: An urgent demand for new sustainable and efficient energy conversion and storage devices required the development of novel electrode materials with increased specific capacitance. However, low mass loading, poor scalability, and low working voltage always limited further practical application of most reported high-performance supercapacitors electrode materials. In this work, we demonstrated the preparation of activated glassy carbon foam as high-performance electrode via oxidizing commercial glassy carbon foam in HNO3 solution.


title: Minimal Sample Subspace Learning: Theory and Algorithms

abstract: Subspace segmentation or subspace learning is a challenging and complicated task in machine learning. This paper builds a primary frame and solid theoretical bases for the minimal subspace segmentation (MSS) of finite samples. Existence and conditional uniqueness of MSS are discussed with conditions generally satisfied in applications. Utilizing weak prior information of MSS, the minimality inspection of segments is further simplified to the prior detection of partitions. The MSS problem is then modeled as a computable optimization problem via self-expressiveness of samples. A closed form of representation matrices is first given for the self-expressiveness, and the connection of diagonal blocks is then addressed. The MSS model uses a rank restriction on the sum of segment ranks. Theoretically, it can retrieve the minimal sample subspaces that could be heavily intersected. The optimization problem is solved via a basic manifold conjugate gradient algorithm, alternative optimization and hybrid optimization, taking into account of solving both the primal MSS problem and its pseudo-dual problem. The MSS model is further modified for handling noisy data, and solved by an ADMM algorithm. The reported experiments show the strong ability of the MSS method on retrieving minimal sample subspaces that are heavily intersected.


title: Perfect sampling from spatial mixing

abstract: We introduce a new perfect sampling technique that can be applied to general Gibbs distributions and runs in linear time if the correlation decays faster than the neighborhood growth. In particular, in graphs with sub-exponential neighborhood growth like $\mathbb{Z}^d$, our algorithm achieves linear running time as long as Gibbs sampling is rapidly mixing. As concrete applications, we obtain the currently best perfect samplers for colorings and for monomer-dimer models in such graphs.


title: Towards Characterizing and Limiting Information Exposure in DNN Layers

abstract: Pre-trained Deep Neural Network (DNN) models are increasingly used in smartphones and other user devices to enable prediction services, leading to potential disclosures of (sensitive) information from training data captured inside these models. Based on the concept of generalization error, we propose a framework to measure the amount of sensitive information memorized in each layer of a DNN. Our results show that, when considered individually, the last layers encode a larger amount of information from the training data compared to the first layers. We find that, while the neuron of convolutional layers can expose more (sensitive) information than that of fully connected layers, the same DNN architecture trained with different datasets has similar exposure per layer. We evaluate an architecture to protect the most sensitive layers within the memory limits of Trusted Execution Environment (TEE) against potential white-box membership inference attacks without the significant computational overhead.


title: The Limit Behavior of the Second Grade Fluid

abstract: In the paper, the limit behavior of solutions to the second-grade fluid system with no-slip boundary conditions is studied as both $\nu$ and $\alpha$ tend to zero. More precisely, it is verified that the convergence from second-grade fluid system to Euler system holds as $\nu$ and $\alpha$ tend to zero independently under the radial symmetry case.


title: DBI in the IR

abstract: The IR limit of a planar static D3-brane in AdS5 x S5 is a tensionless D3-brane at the AdS horizon, with dynamics governed by a strong-field limit of the Dirac-Born-Infeld action analogous to that found from the Born-Infeld action by Bialynicki-Birula. As in that case, the field equations are those of an interacting 4D conformal invariant field theory with an Sl(2;R) electromagnetic duality invariance, but the D3-brane origin makes these properties manifest. We also find an Sl(2;R)-invariant action for these equations.


title: Parton distributions from lattice data: the nonsinglet case

abstract: We revise the relation between Parton Distribution Functions (PDFs) and matrix elements computable from lattice QCD, focusing on the quasi-Parton Distribution Functions (qPDFs) approach. We exploit the relation between PDFs and qPDFs in the case of the unpolarized isovector parton distribution to obtain a factorization formula relating the real and imaginary part of qPDFs matrix elements to specific nonsinglet distributions, and we propose a general framework to extract PDFs from the available lattice data, treating them on the same footing as experimental data. We implement the proposed approach within the NNPDF framework, and we study the potentiality of such lattice data in constraining PDFs, assuming some plausible scenarios to assess the unknown systematic uncertainties. We finally extract the two nonsinglet distributions involved in our analysis from a selection of the available lattice data.


title: M3D-RPN: Monocular 3D Region Proposal Network for Object Detection

abstract: Understanding the world in 3D is a critical component of urban autonomous driving. Generally, the combination of expensive LiDAR sensors and stereo RGB imaging has been paramount for successful 3D object detection algorithms, whereas monocular image-only methods experience drastically reduced performance. We propose to reduce the gap by reformulating the monocular 3D detection problem as a standalone 3D region proposal network. We leverage the geometric relationship of 2D and 3D perspectives, allowing 3D boxes to utilize well-known and powerful convolutional features generated in the image-space. To help address the strenuous 3D parameter estimations, we further design depth-aware convolutional layers which enable location specific feature development and in consequence improved 3D scene understanding. Compared to prior work in monocular 3D detection, our method consists of only the proposed 3D region proposal network rather than relying on external networks, data, or multiple stages. M3D-RPN is able to significantly improve the performance of both monocular 3D Object Detection and Bird's Eye View tasks within the KITTI urban autonomous driving dataset, while efficiently using a shared multi-class model.


title: Overcoming the structural surface effect with a realistic treatment of turbulent convection in 1D stellar models

abstract: State-of-the-art one-dimensional (1D) stellar evolution codes rely on simplifying assumptions, such as mixing length theory, in order to describe superadiabatic convection. As a result, 1D stellar structure models do not correctly recover the surface layers of the Sun and other stars with convective envelopes. We present a method that overcomes this structural drawback by employing three-dimensional (3D) hydrodynamic simulations of stellar envelopes: at every time-step of the evolution interpolated 3D envelopes are appended to the 1D structure and are used to supply realistic boundary conditions for the stellar interior. In contrast to previous attempts, our method includes mean 3D turbulent pressure. We apply our method to model the present Sun. The structural shortcomings of standard stellar models lead to systematic errors in the stellar oscillation frequencies inferred from the model. We show that our method fully corrects for this error. Furthermore, we show that our realistic treatment of superadiabatic convection alters the predicted evolution of the Sun. Our results hence have important implications for the characterization of stars. This has ramifications for neighbouring fields, such as exoplanet research and galactic archaeology, for which accurate stellar models play a key role.


title: Energy-Efficient Radio Resource Allocation for Federated Edge Learning

abstract: Edge machine learning involves the development of learning algorithms at the network edge to leverage massive distributed data and computation resources. Among others, the framework of federated edge learning (FEEL) is particularly promising for its data-privacy preservation. FEEL coordinates global model training at a server and local model training at edge devices over wireless links. In this work, we explore the new direction of energy-efficient radio resource management (RRM) for FEEL. To reduce devices' energy consumption, we propose energy-efficient strategies for bandwidth allocation and scheduling. They adapt to devices' channel states and computation capacities so as to reduce their sum energy consumption while warranting learning performance. In contrast with the traditional rate-maximization designs, the derived optimal policies allocate more bandwidth to those scheduled devices with weaker channels or poorer computation capacities, which are the bottlenecks of synchronized model updates in FEEL. On the other hand, the scheduling priority function derived in closed form gives preferences to devices with better channels and computation capacities. Substantial energy reduction contributed by the proposed strategies is demonstrated in learning experiments.


title: String Correlators: Recursive Expansion, Integration-by-Parts and Scattering Equations

abstract: We further elaborate on the general construction proposed in arXiv:1812.03369, which connects, via tree-level double copy, massless string amplitudes with color-ordered QFT amplitudes that are given by Cachazo-He-Yuan formulas. The current paper serves as a detailed study of the integration-by-parts procedure for any tree-level massless string correlator outlined in the previous letter. We present two new results in the context of heterotic and (compactified) bosonic string theories. First, we find a new recursive expansion of any multitrace mixed correlator in these theories into a logarithmic part corresponding to the CHY integrand for Yang-Mills-scalar amplitudes, plus correlators with the total number of traces and gluons decreased. By iterating the expansion, we systematically reduce string correlators with any number of subcycles to linear combinations of Parke-Taylor factors and similarly for the case with gluons. Based on this, we then derive a CHY formula for the corresponding $(DF)^2 + {\rm YM} + \phi^3$ amplitudes. It is the first closed-form result for such multitrace amplitudes and thus greatly extends our result for the single-trace case. As a byproduct, it gives a new CHY formula for all Yang-Mills-scalar amplitudes. We also study consistency checks of the formula such as factorizations on massless poles.


title: Cross-Lingual Transfer Learning for Question Answering

abstract: Deep learning based question answering (QA) on English documents has achieved success because there is a large amount of English training examples. However, for most languages, training examples for high-quality QA models are not available. In this paper, we explore the problem of cross-lingual transfer learning for QA, where a source language task with plentiful annotations is utilized to improve the performance of a QA model on a target language task with limited available annotations. We examine two different approaches. A machine translation (MT) based approach translates the source language into the target language, or vice versa. Although the MT-based approach brings improvement, it assumes the availability of a sentence-level translation system. A GAN-based approach incorporates a language discriminator to learn language-universal feature representations, and consequentially transfer knowledge from the source language. The GAN-based approach rivals the performance of the MT-based approach with fewer linguistic resources. Applying both approaches simultaneously yield the best results. We use two English benchmark datasets, SQuAD and NewsQA, as source language data, and show significant improvements over a number of established baselines on a Chinese QA task. We achieve the new state-of-the-art on the Chinese QA dataset.


title: Ihara's lemma for Shimura curves over totally real fields via patching

abstract: We prove Ihara's lemma for the mod $l$ cohomology of Shimura curves, localised at a maximal ideal of the Hecke algebra, under a large image hypothesis on the associated Galois representation. This was proved by Diamond and Taylor, for Shimura curves over $\mathbb{Q}$, under various assumptions on $l$. Our method is totally different and can avoid these assumptions, at the cost of imposing the large image hypothesis. It uses the Taylor--Wiles method, as improved by Diamond and Kisin, and the geometry of integral models of Shimura curves at an auxiliary prime.


title: Soil and soil CO2 magnify greenhouse effect

abstract: Soil has been recognized as an indirect driver of global warming by regulating atmospheric greenhouse gases. However, in view of the higher heat capacity and CO2 concentration in soil than those in atmosphere, the direct contributions of soil to greenhouse effect may be non-ignorable. Through field manipulation of CO2 concentration both in soil and atmosphere, we demonstrated that the soil-retained heat and its slow transmission process within soil may cause slower heat leaking from the earth. Furthermore, soil air temperature was non-linearly affected by soil CO2 concentration with the highest value under 7500 ppm CO2. This study indicates that the soil and soil CO2, together with atmospheric CO2, play indispensable roles in fueling the greenhouse effect. We proposed that anthropogenic changes in soils should be focused in understanding drivers of the globe warming.


title: Algorithms for computing with nilpotent matrix groups over infinite domains

abstract: We develop methods for computing with matrix groups defined over a range of infinite domains, and apply those methods to the design of algorithms for nilpotent groups. In particular, we provide a practical algorithm to test nilpotency of matrix groups over an infinite field. We also provide algorithms that answer a number of structural questions for a given nilpotent matrix group. The algorithms have been implemented in GAP and MAGMA.


title: An ultra-narrow line width levitated nano-oscillator for testing dissipative wavefunction collapse

abstract: Levitated nano-oscillators are seen as promising platforms for testing fundamental physics and testing quantum mechanics in a new high mass regime. Levitation allows extreme isolation from the environment, reducing the decoherence processes that are crucial for these sensitive experiments. A fundamental property of any oscillator is its line width and mechanical quality factor, Q. Narrow line widths in the microHertz regime and mechanical Q's as high as $10^{12}$ have been predicted for levitated systems, but to date, the poor stability of these oscillators over long periods have prevented direct measurement in high vacuum. Here we report on the measurement of an ultra-narrow line width levitated nano-oscillator, whose line width of $81\pm\,23\,\mu$Hz is only limited by residual gas pressure at high vacuum. This narrow line width allows us to put new experimental bounds on dissipative models of wavefunction collapse including continuous spontaneous localisation and Di\'{o}si-Penrose and illustrates its utility for future precision experiments that aim to test the macroscopic limits of quantum mechanics.


title: Semimodules over commutative semirings and modules over unitary commutative rings

abstract: We study the so-called closed and splitting subsemimodules and submodules of a given semimodule or module, respectively. We describe lattices of subsemimodules and of closed subsemimodules and posets of splitting subsemimodules and submodules. In the case of modules a natural bijective correspondence between these posets and posets of projections is established.


title: Multi-Element Long Distance Dependencies: Using SPk Languages to Explore the Characteristics of Long-Distance Dependencies

abstract: In order to successfully model Long Distance Dependencies (LDDs) it is necessary to understand the full-range of the characteristics of the LDDs exhibited in a target dataset. In this paper, we use Strictly k-Piecewise languages to generate datasets with various properties. We then compute the characteristics of the LDDs in these datasets using mutual information and analyze the impact of factors such as (i) k, (ii) length of LDDs, (iii) vocabulary size, (iv) forbidden subsequences, and (v) dataset size. This analysis reveal that the number of interacting elements in a dependency is an important characteristic of LDDs. This leads us to the challenge of modelling multi-element long-distance dependencies. Our results suggest that attention mechanisms in neural networks may aide in modeling datasets with multi-element long-distance dependencies. However, we conclude that there is a need to develop more efficient attention mechanisms to address this issue.


title: Distributed Kalman Filtering under Model Uncertainty

abstract: We study the problem of distributed Kalman filtering for sensor networks in the presence of model uncertainty. More precisely, we assume that the actual state-space model belongs to a ball, in the Kullback-Leibler topology, about the nominal state-space model and whose radius reflects the mismatch modeling budget allowed for each time step. We propose a distributed Kalman filter with diffusion step which is robust with respect to the aforementioned model uncertainty. Moreover, we derive the corresponding least favorable performance. Finally, we check the effectiveness of the proposed algorithm in the presence of uncertainty through a numerical example.


title: Metric results on summatory arithmetic functions on Beatty sets

abstract: Let $f\colon\mathbb{N}\rightarrow\mathbb{C}$ be an arithmetic function and consider the Beatty set $\mathcal{B}(\alpha) = \lbrace\, \lfloor n\alpha \rfloor : n\in\mathbb{N} \,\rbrace$ associated to a real number $\alpha$, where $\lfloor\xi\rfloor$ denotes the integer part of a real number $\xi$. We show that the asymptotic formula \[ \Bigl\lvert \sum_{\substack{ 1\leq m\leq x \\ m\in \mathcal{B}(\alpha) }} f(m) - \frac{1}{\alpha} \sum_{1\leq m\leq x} f(m) \Bigr\rvert^2 \ll_{f,\alpha,\varepsilon} (\log x) (\log\log x)^{3+\varepsilon} \sum_{1\leq m\leq x} \lvert f(m) \rvert^2 \] holds for almost all $\alpha>1$ with respect to the Lebesgue measure. This significantly improves an earlier result due to Abercrombie, Banks, and Shparlinski. The proof uses a recent Fourier-analytic result of Lewko and Radziwi{\l}{\l} based on the classical Carleson--Hunt inequality. Moreover, using a probabilistic argument, we establish the existence of functions $f\colon\mathbb{N}\to\lbrace\,\pm 1\,\rbrace$ for which the above error term is optimal up to logarithmic factors.


title: k-hop Graph Neural Networks

abstract: Graph neural networks (GNNs) have emerged recently as a powerful architecture for learning node and graph representations. Standard GNNs have the same expressive power as the Weisfeiler-Leman test of graph isomorphism in terms of distinguishing non-isomorphic graphs. However, it was recently shown that this test cannot identify fundamental graph properties such as connectivity and triangle freeness. We show that GNNs also suffer from the same limitation. To address this limitation, we propose a more expressive architecture, k-hop GNNs, which updates a node's representation by aggregating information not only from its direct neighbors, but from its k-hop neighborhood. We show that the proposed architecture can identify fundamental graph properties. We evaluate the proposed architecture on standard node classification and graph classification datasets. Our experimental evaluation confirms our theoretical findings since the proposed model achieves performance better or comparable to standard GNNs and to state-of-the-art algorithms.


title: Astro2020 Activities and Projects White Paper: Arecibo Observatory in the Next Decade

abstract: The white paper discusses Arecibo Observatory's plan for facility improvements and activities over the next decade. The facility improvements include: (a) improving the telescope surface, pointing and focusing to achieve superb performance up to ~12.5 GHz; (b) equip the telescope with ultrawide-band feeds; (c) upgrade the instrumentation with a 4 GHz bandwidth high dynamic range digital link and a universal backend and (d) augment the VLBI facility by integrating the 12m telescope for phase referencing. These upgrades to the Arecibo telescope are critical to keep the national facility in the forefront of research in radio astronomy while maintaining its dominance in radar studies of near-Earth asteroids, planets and satellites. In the next decade, the Arecibo telescope will play a synergistic role with the upcoming facilities such as ngVLA, SKA and the now commissioned FAST telescope. Further, the observatory will be actively engaged in mentoring and training programs for students from a diverse background.


title: Learning better generative models for dexterous, single-view grasping of novel objects

abstract: This paper concerns the problem of how to learn to grasp dexterously, so as to be able to then grasp novel objects seen only from a single view-point. Recently, progress has been made in data-efficient learning of generative grasp models which transfer well to novel objects. These generative grasp models are learned from demonstration (LfD). One weakness is that, as this paper shall show, grasp transfer under challenging single view conditions is unreliable. Second, the number of generative model elements rises linearly in the number of training examples. This, in turn, limits the potential of these generative models for generalisation and continual improvement. In this paper, it is shown how to address these problems. Several technical contributions are made: (i) a view-based model of a grasp; (ii) a method for combining and compressing multiple grasp models; (iii) a new way of evaluating contacts that is used both to generate and to score grasps. These, together, improve both grasp performance and reduce the number of models learned for grasp transfer. These advances, in turn, also allow the introduction of autonomous training, in which the robot learns from self-generated grasps. Evaluation on a challenging test set shows that, with innovations (i)-(iii) deployed, grasp transfer success rises from 55.1% to 81.6%. By adding autonomous training this rises to 87.8%. These differences are statistically significant. In total, across all experiments, 539 test grasps were executed on real objects.


title: Lower Bound for RIP Constants and Concentration of Sum of Top Order Statistics

abstract: Restricted Isometry Property (RIP) is of fundamental importance in the theory of compressed sensing and forms the base of many exact and robust recovery guarantees in this field. A quantitative description of RIP involves bounding the so-called RIP constants of measurement matrices. In this respect, it is noteworthy that most results in the literature concerning RIP are upper bounds of RIP constants, which can be interpreted as a theoretical guarantee of successful sparse recovery. On the contrary, the land of lower bounds for RIP constants remains uncultivated. Lower bounds of RIP constants, if exist, can be interpreted as the fundamental limit aspect of successful sparse recovery. In this paper, the lower bound of RIP constants Gaussian random matrices are derived, along with a guide for generalization to sub-Gaussian random matrices. This provides a new proof of the fundamental limit that the minimal number of measurements needed to enforce the RIP of order $s$ is $\Omega(s\log({\rm e}N/s))$, which is more straight-forward than the classical Gelfand width argument. Furthermore, in the proof, we propose a useful technical tool featuring the concentration phenomenon for top-$k$ sum of a sequence of i.i.d. random variables, which is closely related to mainstream problems in statistics and is of independent interest.


title: On the two-dimensional hyperbolic stochastic sine-Gordon equation

abstract: We study the two-dimensional stochastic sine-Gordon equation (SSG) in the hyperbolic setting. In particular, by introducing a suitable time-dependent renormalization for the relevant imaginary multiplicative Gaussian chaos, we prove local well-posedness of SSG for any value of a parameter $\beta^2 > 0$ in the nonlinearity. This exhibits sharp contrast with the parabolic case studied by Hairer and Shen (2016) and Chandra, Hairer, and Shen (2018), where the parameter is restricted to the subcritical range: $0 < \beta^2 < 8 \pi$. We also present a triviality result for the unrenormalized SSG.


title: Ghostly Damped Ly$\alpha$ Systems: Tracers of Gas Flows in the Close Vicinity of Quasars ?

abstract: We have searched the Sloan Digital Sky Survey Data Release 12 for ghostly Damped Ly$\alpha$ (DLA) systems. These systems, located at the redshift of the quasars, show strong absorption from low-ionization atomic species but reveal no HI Ly$\alpha$ absorption. Our search has, for the first time, resulted in a sample of 30 homogeneously selected ghostly DLAs with $z_{\rm QSO}$$>$2.0. Thirteen of the ghostly DLAs exhibit absorption from other HI Lyman series lines. The lack of Ly$\alpha$ absorption in these absorbers is consistent with them being dense and compact with projected sizes smaller than the broad line region (BLR) of the background quasar. Although uncertain, the estimated median HI column density of these absorbers is log$N$(HI)$\sim$21.0. We compare the properties of ghostly DLAs with those of eclipsing DLAs that are high column density absorbers, located within 1500 km/s of the quasar emission redshift and showing strong Ly$\alpha$ emission in their DLA trough. We discover an apparent sequence in the observed properties of these DLAs with ghostly DLAs showing wider HI kinematics, stronger absorptions from high-ionization species, CII and SiII excited states, and higher level of dust extinction. Since we estimate that all these DLAs have similar metallicities, log$Z/Z_{\odot}$$\sim$$-$1.0, we conclude that ghostly DLAs are part of the same population as eclipsing DLAs, except that they are denser and located closer to the central active galactic nuclei (AGNs).


title: Crumbling Abstract Machines

abstract: Extending the lambda-calculus with a construct for sharing, such as let expressions, enables a special representation of terms: iterated applications are decomposed by introducing sharing points in between any two of them, reducing to the case where applications have only values as immediate subterms. This work studies how such a crumbled representation of terms impacts on the design and the efficiency of abstract machines for call-by-value evaluation. About the design, it removes the need for data structures encoding the evaluation context, such as the applicative stack and the dump, that get encoded in the environment. About efficiency, we show that there is no slowdown, clarifying in particular a point raised by Kennedy, about the potential inefficiency of such a representation. Moreover, we prove that everything smoothly scales up to the delicate case of open terms, needed to implement proof assistants. Along the way, we also point out that continuation-passing style transformations--that may be alternatives to our representation--do not scale up to the open case.


title: Aggregate-Eliminate-Predict: Detecting Adverse Drug Events from Heterogeneous Electronic Health Records

abstract: We study the problem of detecting adverse drug events in electronic healthcare records. The challenge in this work is to aggregate heterogeneous data types involving diagnosis codes, drug codes, as well as lab measurements. An earlier framework proposed for the same problem demonstrated promising predictive performance for the random forest classifier by using only lab measurements as data features. We extend this framework, by additionally including diagnosis and drug prescription codes, concurrently. In addition, we employ a recursive feature selection mechanism on top, that extracts the top-k most important features. Our experimental evaluation on five medical datasets of adverse drug events and six different classifiers, suggests that the integration of these additional features provides substantial and statistically significant improvements in terms of AUC, while employing medically relevant features.


title: Quarkonium Masses in a hot QCD Medium Using Conformable Fractional of the Nikiforov-Uvarov Method

abstract: By using conformable fractional of the Nikiforov-Uvarov (CF-NU) method, the radial Schrodinger equation is analytically solved. The energy eigenvalues and corresponding functions are obtained, in which the dependent temperature potential is employed. The effect of fraction-order parameter is studied on heavy-quarkonium masses such as charmonium and bottomonium in a hot QCD medium in the 3D and the higher dimensional space. A comparison is studied with recent works. We conclude that the fractional-order plays an important role in a hot QCD medium in the 3D and higher-dimensional space.


title: Wetting-phase relative permeability in porous media with bi-modal pore size distributions

abstract: Modeling fluid flow in dual-porosity media with bi-modal pore size distributions has practical applications to understanding transport in multi-scale systems such as natural soils. Dual-porosity media are typically formed of two domains: (1) structure and (2) texture. The former mainly incorporates macropores, while the latter contains micropores. Although there exist models based on the series-parallel tubes approach, here we apply concepts from critical path analysis, a theoretical technique from statistical physics, to estimate water relative permeability (krw) in dual-porosity media. For this purpose, we use two datasets from the literature collected under two different cultivation conditions: (i) conventional tillage (CT) and (ii) non-tillage (NT). Each dataset consists of 13 soil samples for which capillary pressure curve and water relative permeability were measured at 500 data point over a wide range of water saturation. We estimate the water relative permeability from the measured capillary pressure curve using two methods: (1) critical path analysis (CPA), and (2) series-parallel tubes (vG-M), both models adapted for dual-porosity media. Comparing the theoretical estimations with the experimental measurements shows that CPA resulted in more accurate krw estimations than vG-M. We demonstrate that precise estimation of krw via CPA requires accurate characterization of capillary pressure curve and precise determination of the crossover point separating the structure domain from the texture one.


title: Galactic diffuse gamma-ray emission at TeV energy

abstract: Measuring the diffuse Galactic gamma-ray flux in the TeV range is difficult for ground-based gamma-ray telescopes because of the residual cosmic-ray background, which is higher than the gamma-ray flux by several orders of magnitude. Its detection is also challenging for space-based telescopes because of low signal statistics. We characterize the diffuse TeV flux from the Galaxy using decade-long exposures of the Fermi Large Area Telescope. Considering that the level of diffuse Galactic emission in the TeV band approaches the level of residual cosmic-ray background, we estimated the level of residual cosmic-ray background in the SOURCEVETO event selection and verified that the TeV diffuse Galactic emission flux is well above the residual cosmic-ray background up to high Galactic latitude regions. We study spectral and imaging properties of the diffuse TeV signal from the Galactic plane. We find much stronger emission from the inner Galactic plane than in previous HESS telescope estimates (lower bound). We also find a significant difference in the measurement of the Galactic longitude and latitude profiles of the signal measured by Fermi and HESS. These discrepancies are presumably explained by the fact that regions of background estimate in HESS have non-negligible gamma-ray flux. Comparing Fermi measurements with those of ARGO-YBJ, we find better agreement, with the notable exception of the Cygnus region, where we find much higher flux (by a factor 1.5). We also measure the TeV diffuse emission spectrum up to high Galactic latitude and show that the spectra of different regions of the sky have spectral slopes consistent with Gamma=2.34+/- 0.04. We discuss the possible origin of the hard slope of the TeV diffuse emission. Fermi/LAT provides reliable measurements of the diffuse Galactic emission spectrum in the TeV range.


title: Using dynamic routing to extract intermediate features for developing scalable capsule networks

abstract: Capsule networks have gained a lot of popularity in short time due to its unique approach to model equivariant class specific properties as capsules from images. However the dynamic routing algorithm comes with a steep computational complexity. In the proposed approach we aim to create scalable versions of the capsule networks that are much faster and provide better accuracy in problems with higher number of classes. By using dynamic routing to extract intermediate features instead of generating output class specific capsules, a large increase in the computational speed has been observed. Moreover, by extracting equivariant feature capsules instead of class specific capsules, the generalization capability of the network has also increased as a result of which there is a boost in accuracy.


title: Number Conservation via Particle Flow in One-dimensional Cellular Automata

abstract: A number-conserving cellular automaton is a simplified model for a system of interacting particles. This paper contains two related constructions by which one can find all one-dimensional number-conserving cellular automata with one kind of particle. The output of both methods is a "flow function", which describes the movement of the particles. In the first method, one puts increasingly stronger restrictions on the particle flow until a single flow function is specified. There are no dead ends, every choice of restriction steps ends with a flow. The second method uses the fact that the flow functions can be ordered and then form a lattice. This method consists of a recipe for the slowest flow that enforces a given minimal particle speed in one given neighbourhood. All other flow functions are then maxima of sets of these flows. Other questions, like that about the nature of non-deterministic number-conserving rules, are treated briefly at the end.


title: Image Evolution Trajectory Prediction and Classification from Baseline using Learning-based Patch Atlas Selection for Early Diagnosis

abstract: Patients initially diagnosed with early mild cognitive impairment (eMCI) are known to be a clinically heterogeneous group with very subtle patterns of brain atrophy. To examine the boarders between normal controls (NC) and eMCI, Magnetic Resonance Imaging (MRI) was extensively used as a non-invasive imaging modality to pin-down subtle changes in brain images of MCI patients. However, eMCI research remains limited by the number of available MRI acquisition timepoints. Ideally, one would learn how to diagnose MCI patients in an early stage from MRI data acquired at a single timepoint, while leveraging 'non-existing' follow-up observations. To this aim, we propose novel supervised and unsupervised frameworks that learn how to jointly predict and label the evolution trajectory of intensity patches, each seeded at a specific brain landmark, from a baseline intensity patch. Specifically, both strategies aim to identify the best training atlas patches at baseline timepoint to predict and classify the evolution trajectory of a given testing baseline patch. The supervised technique learns how to select the best atlas patches by training bidirectional mappings from the space of pairwise patch similarities to their corresponding prediction errors -when one patch was used to predict the other. On the other hand, the unsupervised technique learns a manifold of baseline atlas and testing patches using multiple kernels to well capture patch distributions at multiple scales. Once the best baseline atlas patches are selected, we retrieve their evolution trajectories and average them to predict the evolution trajectory of the testing baseline patch. Next, we input the predicted trajectories to an ensemble of linear classifiers, each trained at a specific landmark. Our classification accuracy increased by up to 10% points in comparison to single timepoint-based classification methods.


title: Bringing Giant Neural Networks Down to Earth with Unlabeled Data

abstract: Compressing giant neural networks has gained much attention for their extensive applications on edge devices such as cellphones. During the compressing process, one of the most important procedures is to retrain the pre-trained models using the original training dataset. However, due to the consideration of security, privacy or commercial profits, in practice, only a fraction of sample training data are made available, which makes the retraining infeasible. To solve this issue, this paper proposes to resort to unlabeled data in hand that can be cheaper to acquire. Specifically, we exploit the unlabeled data to mimic the classification characteristics of giant networks, so that the original capacity can be preserved nicely. Nevertheless, there exists a dataset bias between the labeled and unlabeled data, which may disturb the training and degrade the performance. We thus fix this bias by an adversarial loss to make an alignment on the distributions of their low-level feature representations. We further provide theoretical discussions about how the unlabeled data help compressed networks to generalize better. Experimental results demonstrate that the unlabeled data can significantly improve the performance of the compressed networks.