title: SL_2(R)-developments and Signature Asymptotics for Planar Paths with Bounded Variation

abstract: The signature transform, defined by the formal tensor series of global iterated path integrals, is a homomorphism between the path space and the tensor algebra that has been studied in geometry, control theory, number theory as well as stochastic analysis. An elegant isometry conjecture states that the length of a bounded variation path $\gamma$ can be recovered from the asymptotics of its normalised signature: $\text{Length}(\gamma)=\lim_{n\rightarrow\infty}\big\Vert n!\int_{0<t_{1}<\cdots<t_{n}<T}d\gamma_{t_{1}}\otimes\cdots\otimes d\gamma_{t_{n}}\big\Vert^{\frac{1}{n}}$. This property depends on a key topological non-degeneracy notion known as tree-reducedness (namely, with no tree-like pieces). Existing arguments have relied crucially on $\gamma$ having a continuous derivative under the unit speed parametrisation. In this article, we prove the above isometry conjecture for planar paths by assuming only local bounds on the angle of $\gamma'$ (which ensures the absence of tree-like pieces). Our technique is based on lifting the path onto the special linear group ${\rm SL}_{2}(\mathbb{R})$ and analysing the behaviour of the associated angle dynamics at a microscopic level.


title: Unital decompositions of the matrix algebra of order three

abstract: We classify all decompositions of $M_3(\mathbb{C})$ into a direct vector-space sum of two subalgebras such that one of the subalgebras contains the identity matrix.


title: Lipschitz-stability of Controlled Rough Paths and Rough Differential Equations

abstract: We provide an account for the existence and uniqueness of solutions to rough differential equations under the framework of controlled rough paths. The case when the driving path is $\beta$-H\"older continuous, for $\beta>1/3$, is widely available in the literature. In its extension to the case when $\beta\leqslant1/3,$ a main challenge and missing ingredient is to show that controlled roughs paths are closed under composition with Lipschitz transformations. Establishing such a property precisely, which has a strong algebraic nature, is a main purpose of the present article.


title: Existence and Uniqueness of viscosity solutions of Value function of Local Cahn-Hilliard-Navier-Stokes system

abstract: In this work, we consider the local Cahn-Hilliard-Navier-Stokes equation with regular potential in two dimensional bounded domain. We formulate distributed optimal control problem as the minimization of a suitable cost functional subject to the controlled local Cahn-Hilliard-Navier- Stokes system and define the associated value function. We prove the Dynamic Programming Principle satisfied by the value function. Due to the lack of smoothness properties for the value function, we use the method of viscosity solutions to obtain the corresponding solution of the infinite dimensional Hamilton-Jacobi-Bellman equation. We show that the value function is the unique viscosity solution of the Hamilton-Jacobi-Bellman equation. The uniqueness of the viscosity solution is established via comparison principle.


title: Optimal synthesis in the simplest time-optimal problem with a linear state constraint

abstract: We consider the time-optimal problem for a classical system of "double integrator" under the presence of a linear state constraint. By using the Maximum Principle of Dubovitskii and Milyutin, we determine a complete synthesis of optimal trajectories and qualitatively analyze the corresponding Lagrange multipliers.


title: PERF-Net: Pose Empowered RGB-Flow Net

abstract: In recent years, many works in the video action recognition literature have shown that two stream models (combining spatial and temporal input streams) are necessary for achieving state of the art performance. In this paper we show the benefits of including yet another stream based on human pose estimated from each frame -- specifically by rendering pose on input RGB frames. At first blush, this additional stream may seem redundant given that human pose is fully determined by RGB pixel values -- however we show (perhaps surprisingly) that this simple and flexible addition can provide complementary gains. Using this insight, we then propose a new model, which we dub PERF-Net (short for Pose Empowered RGB-Flow Net), which combines this new pose stream with the standard RGB and flow based input streams via distillation techniques and show that our model outperforms the state-of-the-art by a large margin in a number of human action recognition datasets while not requiring flow or pose to be explicitly computed at inference time. The proposed pose stream is also part of the winner solution of the ActivityNet Kinetics Challenge 2020.


title: Deep Reinforcement Learning for DER Cyber-Attack Mitigation

abstract: The increasing penetration of DER with smart-inverter functionality is set to transform the electrical distribution network from a passive system, with fixed injection/consumption, to an active network with hundreds of distributed controllers dynamically modulating their operating setpoints as a function of system conditions. This transition is being achieved through standardization of functionality through grid codes and/or international standards. DER, however, are unique in that they are typically neither owned nor operated by distribution utilities and, therefore, represent a new emerging attack vector for cyber-physical attacks. Within this work we consider deep reinforcement learning as a tool to learn the optimal parameters for the control logic of a set of uncompromised DER units to actively mitigate the effects of a cyber-attack on a subset of network DER.


title: Coupled dimer and bond-order-wave order in the quarter-filled one-dimensional Kondo lattice model

abstract: Motivated by the experiments on the organic compound $(Per)_{2}[Pt(mnt)_{2}]$, we study the ground state of the one-dimensional Kondo lattice model at quarter filling with the density matrix renormalization group method. We show a coupled dimer and bond-order-wave (BOW) state in the weak coupling regime for the localized spins and itinerant electrons, respectively. The quantum phase transitions for the dimer and the BOW orders occur at the same critical coupling parameter $J_{c}$, with the opening of a charge gap. The emergence of the combination of dimer and BOW order agrees with the experimental findings of the simultaneous Peierls and spin-Peierls transitions at low temperatures, which provides a theoretical understanding of such phase transition. We also show that the localized spins in this insulating state have quasi-long ranged spin correlations with collinear configurations, which resemble the classical dimer order in the absence of a magnetic order.


title: Digraph homomorphism problem and weak near unanimity polymorphism

abstract: We consider the problem of finding a homomorphism from an input digraph $G$ to a fixed digraph $H$. We show that if $H$ admits a weak near unanimity polymorphism $\phi$ then deciding whether $G$ admits a homomorphism to $H$ (HOM($H$)) is polynomial-time solvable. This gives proof of the dichotomy conjecture (now dichotomy theorem) by Feder and Vardi. Our approach is combinatorial, and it is simpler than the two algorithms found by Bulatov and Zhuk. We have implemented our algorithm and show some experimental results. We use our algorithm together with the recent result [38] for recognition of Maltsev polymorphisms and decide in polynomial time if a given relational structure $\mathcal{R}$ admits a weak near unanimity polymorphism.


title: Teacher turnover in Rwanda

abstract: Despite widely documented shortfalls of teacher skills and effort, there is little systematic evidence of rates of teacher turnover in low-income countries. I investigate the incidence and consequences of teacher turnover in Rwandan public primary schools over the period from 2016-2019. To do so, I combine the universe of teacher placement records with student enrollment figures and school-average Primary Leaving Exam scores in a nationally representative sample of 259 schools. Results highlight five features of teacher turnover. First, rates of teacher turnover are high: annually, 20 percent of teachers separate from their jobs, of which 11 percent exit from the public-sector teaching workforce. Second, the burden of teacher churn is higher in schools with low learning levels and, perhaps surprisingly, in low pupil-teacher-ratio schools. Third, teacher turnover is concentrated among early-career teachers, male teachers, and those assigned to teach Math. Fourth, replacing teachers quickly after they exit is a challenge; 23 percent of exiting teachers are not replaced the following year. And fifth, teacher turnover is associated with subsequent declines in learning outcomes. On average, the loss of a teacher is associated with a reduction in learning levels of 0.05 standard deviations. In addition to class-size increases, a possible mechanism for these learning outcomes is the prevalence of teachers teaching outside of their areas of subject expertise: in any given year, at least 21 percent of teachers teach in subjects in which they have not been trained. Taken together, these results suggest that the problem of teacher turnover is substantial in magnitude and consequential for learning outcomes in schools.


title: Learning Classifiers under Delayed Feedback with a Time Window Assumption

abstract: We consider training a binary classifier under delayed feedback (\emph{DF learning}). For example, in the conversion prediction in online ads, we initially receive negative samples that clicked the ads but did not buy an item; subsequently, some samples among them buy an item then change to positive. In the setting of DF learning, we observe samples over time, then learn a classifier at some point. We initially receive negative samples; subsequently, some samples among them change to positive. This problem is conceivable in various real-world applications such as online advertisements, where the user action takes place long after the first click. Owing to the delayed feedback, naive classification of the positive and negative samples returns a biased classifier. One solution is to use samples that have been observed for more than a certain time window assuming these samples are correctly labeled. However, existing studies reported that simply using a subset of all samples based on the time window assumption does not perform well, and that using all samples along with the time window assumption improves empirical performance. We extend these existing studies and propose a method with the unbiased and convex empirical risk that is constructed from all samples under the time window assumption. To demonstrate the soundness of the proposed method, we provide experimental results on a synthetic and open dataset that is the real traffic log datasets in online advertising.


title: f-Divergence Variational Inference

abstract: This paper introduces the $f$-divergence variational inference ($f$-VI) that generalizes variational inference to all $f$-divergences. Initiated from minimizing a crafty surrogate $f$-divergence that shares the statistical consistency with the $f$-divergence, the $f$-VI framework not only unifies a number of existing VI methods, e.g. Kullback-Leibler VI, R\'{e}nyi's $\alpha$-VI, and $\chi$-VI, but offers a standardized toolkit for VI subject to arbitrary divergences from $f$-divergence family. A general $f$-variational bound is derived and provides a sandwich estimate of marginal likelihood (or evidence). The development of the $f$-VI unfolds with a stochastic optimization scheme that utilizes the reparameterization trick, importance weighting and Monte Carlo approximation; a mean-field approximation scheme that generalizes the well-known coordinate ascent variational inference (CAVI) is also proposed for $f$-VI. Empirical examples, including variational autoencoders and Bayesian neural networks, are provided to demonstrate the effectiveness and the wide applicability of $f$-VI.


title: Improved generalization by noise enhancement

abstract: Recent studies have demonstrated that noise in stochastic gradient descent (SGD) is closely related to generalization: A larger SGD noise, if not too large, results in better generalization. Since the covariance of the SGD noise is proportional to $\eta^2/B$, where $\eta$ is the learning rate and $B$ is the minibatch size of SGD, the SGD noise has so far been controlled by changing $\eta$ and/or $B$. However, too large $\eta$ results in instability in the training dynamics and a small $B$ prevents scalable parallel computation. It is thus desirable to develop a method of controlling the SGD noise without changing $\eta$ and $B$. In this paper, we propose a method that achieves this goal using ``noise enhancement'', which is easily implemented in practice. We expound the underlying theoretical idea and demonstrate that the noise enhancement actually improves generalization for real datasets. It turns out that large-batch training with the noise enhancement even shows better generalization compared with small-batch training.


title: Dynamic mode decomposition to retrieve torsional Alfv\'{e}n waves

abstract: Dynamic mode decomposition (DMD) is utilised to identify the intrinsic signals arising from planetary interiors. Focusing on an axisymmetric quasi-geostrophic magnetohydrodynamic (MHD) wave -called torsional Alfv\'{e}n waves (TW) - we examine the utility of DMD in two types of MHD direct numerical simulations: Boussinesq magnetoconvection and anelastic convection-driven dynamos in rapidly rotating spherical shells, which model the dynamics in Earth's core and in Jupiter, respectively. We demonstrate that DMD is capable of distinguishing internal modes and boundary/interface-related modes from the timeseries of the internal velocity. Those internal modes may be realised as free TW, in terms of eigenvalues and eigenfunctions of their normal mode solutions. Meanwhile it turns out that, in order to account for the details, the global TW eigenvalue problems in spherical shells need to be further addressed.


title: Non-archimedean hyperbolicity of the moduli space of curves

abstract: Let $K$ be a complete algebraically closed non-archimedean valued field of characteristic zero, and let $X$ be a finite type scheme over $K$. We say $X$ is $K$-analytically Borel hyperbolic if, for every finite type reduced scheme $S$ over $K$, every rigid analytic morphism from the rigid analytification $S^{\mathrm{an}}$ of $S$ to the rigid analytification $X^{\mathrm{an}}$ of $X$ is algebraic. Using the Viehweg-Zuo construction and the $K$-analytic big Picard theorem of Cherry-Ru, we show that, for $N \geq 3$ and $g \geq 2$, the fine moduli space $\mathcal{M}^{[N]}_{g,K}$ over $K$ of genus $g$ curves with level $N$-structure is $K$-analytically Borel hyperbolic.


title: Hamilton-Jacobi-Bellman Equations for Maximum Entropy Optimal Control

abstract: Maximum entropy reinforcement learning (RL) methods have been successfully applied to a range of challenging sequential decision-making and control tasks. However, most of existing techniques are designed for discrete-time systems. As a first step toward their extension to continuous-time systems, this paper considers continuous-time deterministic optimal control problems with entropy regularization. Applying the dynamic programming principle, we derive a novel class of Hamilton-Jacobi-Bellman (HJB) equations and prove that the optimal value function of the maximum entropy control problem corresponds to the unique viscosity solution of the HJB equation. Our maximum entropy formulation is shown to enhance the regularity of the viscosity solution and to be asymptotically consistent as the effect of entropy regularization diminishes. A salient feature of the HJB equations is computational tractability. Generalized Hopf-Lax formulas can be used to solve the HJB equations in a tractable grid-free manner without the need for numerically optimizing the Hamiltonian. We further show that the optimal control is uniquely characterized as Gaussian in the case of control affine systems and that, for linear-quadratic problems, the HJB equation is reduced to a Riccati equation, which can be used to obtain an explicit expression of the optimal control. Lastly, we discuss how to extend our results to continuous-time model-free RL by taking an adaptive dynamic programming approach. To our knowledge, the resulting algorithms are the first data-driven control methods that use an information theoretic exploration mechanism in continuous time.


title: Matrix orthogonality in the plane versus scalar orthogonality in a Riemann surface

abstract: We consider a non-Hermitian matrix orthogonality on a contour in the complex plane. Given a diagonalizable and rational matrix valued weight, we show that the Christoffel--Darboux (CD) kernel, which is built in terms of matrix orthogonal polynomials, is equivalent to a scalar valued reproducing kernel of meromorphic functions in a Riemann surface. If this Riemann surface has genus $0$, then the matrix valued CD kernel is equivalent to a scalar reproducing kernel of polynomials in the plane. Interestingly, this scalar reproducing kernel is not necessarily a scalar CD kernel. As an application of our result, we show that the correlation kernel of certain doubly periodic lozenge tiling models admits a double contour integral representation involving only a scalar CD kernel. This simplifies a formula of Duits and Kuijlaars.


title: kMap.py: A Python program for simulation and data analysis in photoemission tomography

abstract: For organic molecules adsorbed as well-oriented ultra-thin films on metallic surfaces, angle-resolved photoemission spectroscopy has evolved into a technique called photoemission tomography (PT). By approximating the final state of the photoemitted electron as a free electron, PT uses the angular dependence of the photocurrent, a so-called momentum map or k-map, and interprets it as the Fourier transform of the initial state's molecular orbital, thereby gains insights into the geometric and electronic structure of organic/metal interfaces. In this contribution, we present kMap.py which is a Python program that enables the user, via a PyQt-based graphical user interface, to simulate photoemission momentum maps of molecular orbitals and to perform a one-to-one comparison between simulation and experiment. Based on the plane wave approximation for the final state, simulated momentum maps are computed numerically from a fast Fourier transform of real space molecular orbital distributions, which are used as program input and taken from density functional calculations. The program allows the user to vary a number of simulation parameters such as the final state kinetic energy, the molecular orientation or the polarization state of the incident light field. Moreover, also experimental photoemission data can be loaded into the program enabling a direct visual comparison as well as an automatic optimization procedure to determine structural parameters of the molecules or weights of molecular orbitals contributions. With an increasing number of experimental groups employing photoemission tomography to study adsorbate layers, we expect kMap.py to serve as an ideal analysis software to further extend the applicability of PT.


title: Existence and Construction of Exact FRG Flows of a UV-Interacting Scalar Field Theory

abstract: We prove the existence and give a construction procedure of Euclidean-invariant exact solutions to the Wetterich equation in $d > 2$ dimensions satisfying the naive boundary condition of a massive and interacting real scalar $\phi^4$ theory in the ultraviolet limit as well as a generalised free theory in the infrared limit. The construction produces the momentum-dependent correlation functions to all orders through an iterative scheme, based on a self-consistent ansatz for the four-point function. The resulting correlators are bounded at all regulator scales and we determine explicit bounds capturing the asymptotics in the UV and IR limits. Furthermore, the given construction principle may be extended to other systems and might become useful in the study of general properties of exact solutions.


title: Distillation of Weighted Automata from Recurrent Neural Networks using a Spectral Approach

abstract: This paper is an attempt to bridge the gap between deep learning and grammatical inference. Indeed, it provides an algorithm to extract a (stochastic) formal language from any recurrent neural network trained for language modelling. In detail, the algorithm uses the already trained network as an oracle -- and thus does not require the access to the inner representation of the black-box -- and applies a spectral approach to infer a weighted automaton. As weighted automata compute linear functions, they are computationally more efficient than neural networks and thus the nature of the approach is the one of knowledge distillation. We detail experiments on 62 data sets (both synthetic and from real-world applications) that allow an in-depth study of the abilities of the proposed algorithm. The results show the WA we extract are good approximations of the RNN, validating the approach. Moreover, we show how the process provides interesting insights toward the behavior of RNN learned on data, enlarging the scope of this work to the one of explainability of deep learning models.


title: Deep Transformers with Latent Depth

abstract: The Transformer model has achieved state-of-the-art performance in many sequence modeling tasks. However, how to leverage model capacity with large or variable depths is still an open challenge. We present a probabilistic framework to automatically learn which layer(s) to use by learning the posterior distributions of layer selection. As an extension of this framework, we propose a novel method to train one shared Transformer network for multilingual machine translation with different layer selection posteriors for each language pair. The proposed method alleviates the vanishing gradient issue and enables stable training of deep Transformers (e.g. 100 layers). We evaluate on WMT English-German machine translation and masked language modeling tasks, where our method outperforms existing approaches for training deeper Transformers. Experiments on multilingual machine translation demonstrate that this approach can effectively leverage increased model capacity and bring universal improvement for both many-to-one and one-to-many translation with diverse language pairs.


title: Predictors of Social Distancing and Mask-Wearing Behavior: Panel Survey in Seven U.S. States

abstract: This paper presents preliminary summary results from a longitudinal study of participants in seven U.S. states during the COVID-19 pandemic. In addition to standard socio-economic characteristics, we collect data on various economic preference parameters: time, risk, and social preferences, and risk perception biases. We pay special attention to predictors that are both important drivers of social distancing and are potentially malleable and susceptible to policy levers. We note three important findings: (1) demographic characteristics exert the largest influence on social distancing measures and mask-wearing, (2) we show that individual risk perception and cognitive biases exert a critical role in influencing the decision to adopt social distancing measures, (3) we identify important demographic groups that are most susceptible to changing their social distancing behaviors. These findings can help inform the design of policy interventions regarding targeting specific demographic groups, which can help reduce the transmission speed of the COVID-19 virus.


title: Ordinal Bayesian incentive compatibility in random assignment model

abstract: We explore the consequences of weakening the notion of incentive compatibility from strategy-proofness to ordinal Bayesian incentive compatibility (OBIC) in the random assignment model. If the common prior of the agents is a uniform prior, then a large class of random mechanisms are OBIC with respect to this prior -- this includes the probabilistic serial mechanism. We then introduce a robust version of OBIC: a mechanism is locally robust OBIC if it is OBIC with respect all independent priors in some neighborhood of a given independent prior. We show that every locally robust OBIC mechanism satisfying a mild property called elementary monotonicity is strategy-proof. This leads to a strengthening of the impossibility result in Bogomolnaia and Moulin (2001): if there are at least four agents, there is no locally robust OBIC and ordinally efficient mechanism satisfying equal treatment of equals.


title: Dynamical polarization and plasmons in noncentrosymmetric metals

abstract: We study the dynamical polarization function and plasmon modes for spin-orbit coupled noncentrosymmetric metals (NCMs). These systems have different Fermi surface topology for Fermi energies above and below the spin degenerate point which is also known as the band touching point (BTP). We calculate the exact dynamical polarization function numerically and also provide its analytical expression in the long wavelength limit. We obtain the plasmon dispersion within the framework of random phase approximation. In NCMs, there is a finite energy gap in between intra and interband particle hole continuum (PHC) for vanishing excitation wavevector. In the long wavelength limit, the width of interband PHC behaves differently for Fermi energies below and above the BTP as a clear signature of the Fermi surface topology change. We find a single undamped optical plasmon mode lying in between the intra and interband PHC for Fermi energies above and below the BTP. The plasmon mode below the BTP has smaller velocity than that of above the BTP. It is interesting to find that as we tune the Fermi energy around the BTP, the plasmon mode becomes damped within a range of e-e interaction strength. For Fermi energies above and below the BTP, we also obtain an approximate analytical result of plasma frequency and plasmon dispersion which match well with their numerical counterparts in the long wavelength limit. The plasmon dispersion is $\propto q^2$ with $q$ being the wave vector for plasmon excitation in the long wavelength limit. We find that varying the carrier density with fixed e-e interaction strength or vice versa does not change the number of undamped plasmon mode, although damped plasmon modes can be more in number for some values of these parameters. We demonstrate our results by calculating the loss function and optical conductivity which can be measured in experiments.


title: Extraction of Material Properties through Multi-fidelity Deep Learning from Molecular Dynamics Simulation

abstract: Simulation of reasonable timescales for any long physical process using molecular dynamics (MD) is a major challenge in computational physics. In this study, we have implemented an approach based on multi-fidelity physics informed neural network (MPINN) to achieve long-range MD simulation results over a large sample space with significantly less computational cost. The fidelity of our present multi-fidelity study is based on the integration timestep size of MD simulations. While MD simulations with larger timestep produce results with lower level of accuracy, it can provide enough computationally cheap training data for MPINN to learn an accurate relationship between these low-fidelity results and high-fidelity MD results obtained using smaller simulation timestep. We have performed two benchmark studies, involving one and two component LJ systems, to determine the optimum percentage of high-fidelity training data required to achieve accurate results with high computational saving. The results show that important system properties such as system energy per atom, system pressure and diffusion coefficients can be determined with high accuracy while saving 68% computational costs. Finally, as a demonstration of the applicability of our present methodology in practical MD studies, we have studied the viscosity of argon-copper nanofluid and its variation with temperature and volume fraction by MD simulation using MPINN. Then we have compared them with numerous previous studies and theoretical models. Our results indicate that MPINN can predict accurate nanofluid viscosity at a wide range of sample space with significantly small number of MD simulations. Our present methodology is the first implementation of MPINN in conjunction with MD simulation for predicting nanoscale properties. This can pave pathways to investigate more complex engineering problems that demand long-range MD simulations.


title: On characteristic forms of positive vector bundles, mixed discriminants and pushforward identities

abstract: We prove that Schur polynomials in Chern forms of Nakano and dual Nakano positive vector bundles are positive as differential forms. Moreover, modulo a statement about the positivity of a "double mixed discriminant" of linear operators on matrices, which preserve the cone of positive definite matrices, we establish that Schur polynomials in Chern forms of Griffiths positive vector bundles are weakly-positive as differential forms. This provides differential-geometric versions of Fulton-Lazarsfeld inequalities for ample vector bundles.An interpretation of positivity conditions for vector bundles through operator theory is in the core of our approach. Another important step in our proof is to establish a certain pushforward identity for characteristic forms, refining the determinantal formula of Kempf-Laksov for homolorphic vector bundles on the level of differential forms. In the same vein, we establish a local version of Jacobi-Trudi identity.Then we study the inverse problem and show that already for vector bundles over complex surfaces, one cannot characterize Griffiths positivity (and even ampleness) through the positivity of Schur polynomials, even if one takes into consideration all quotients of a vector bundle.


title: NITI: Training Integer Neural Networks Using Integer-only Arithmetic

abstract: While integer arithmetic has been widely adopted for improved performance in deep quantized neural network inference, training remains a task primarily executed using floating point arithmetic. This is because both high dynamic range and numerical accuracy are central to the success of most modern training algorithms. However, due to its potential for computational, storage and energy advantages in hardware accelerators, neural network training methods that can be implemented with low precision integer-only arithmetic remains an active research challenge. In this paper, we present NITI, an efficient deep neural network training framework that stores all parameters and intermediate values as integers, and computes exclusively with integer arithmetic. A pseudo stochastic rounding scheme that eliminates the need for external random number generation is proposed to facilitate conversion from wider intermediate results to low precision storage. Furthermore, a cross-entropy loss backpropagation scheme computed with integer-only arithmetic is proposed. A proof-of-concept open-source software implementation of NITI that utilizes native 8-bit integer operations in modern GPUs to achieve end-to-end training is presented. When compared with an equivalent training setup implemented with floating point storage and arithmetic, NITI achieves negligible accuracy degradation on the MNIST and CIFAR10 datasets using 8-bit integer storage and computation. On ImageNet, 16-bit integers are needed for weight accumulation with an 8-bit datapath. This achieves training results comparable to all-floating-point implementations.


title: Tuning the Ultrafast Response of Fano Resonances in Halide Perovskite Nanoparticles

abstract: The full control of the fundamental photophysics of nanosystems at frequencies as high as few THz is key for tunable and ultrafast nano-photonic devices and metamaterials. Here we combine geometrical and ultrafast control of the optical properties of halide perovskite nanoparticles, which constitute a prominent platform for nanophotonics. The pulsed photoinjection of free carriers across the semiconducting gap leads to a sub-picosecond modification of the far-field electromagnetic properties that is fully controlled by the geometry of the system. When the nanoparticle size is tuned so as to achieve the overlap between the narrowband excitons and the geometry-controlled Mie resonances, the ultrafast modulation of the transmittivity is completely reversed with respect to what is usually observed in nanoparticles with different sizes, in bulk systems and in thin films. The interplay between chemical, geometrical and ultrafast tuning offers an additional control parameter with impact on nano-antennas and ultrafast optical switches.


title: Squeezing-induced Topological Gap Opening on Bosonic Bogoliubov Excitations

abstract: We investigate the role of squeezing interaction in inducing topological Bogoliubov excitations of a bosonic system. We introduce a squeezing transformation which is capable of reducing the corresponding Bogoliubov-de Gennes Hamiltonian to an effective non-interacting one with the spectra and topology unchanged. In the weak interaction limit, we apply the perturbation theory to investigate the squeezing-induced topological gap opening on bosonic Bogoliubov excitations and find that the squeezing interaction plays an equivalent role as a spin-orbit or Zeeman-like coupling in the effective Hamiltonian. We thus apply this formalism to two existed models for providing deeper understandings of their topological structures. We also construct minimal models based on the elegant Clifford algebra for realizing bosonic topological Bogoliubov excitations. Our construction is potentially applicable for experiments in bosonic systems.


title: A proof of a Dodecahedron conjecture for distance sets

abstract: A finite subset of a Euclidean space is called an $s$-distance set if there exist exactly $s$ values of the Euclidean distances between two distinct points in the set. In this paper, we prove that the maximum cardinality among all 5-distance sets in $\mathbb{R}^3$ is 20, and every $5$-distance set in $\mathbb{R}^3$ with $20$ points is similar to the vertex set of a regular dodecahedron.


title: Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation

abstract: Vision-and-Language Navigation (VLN) is a natural language grounding task where an agent learns to follow language instructions and navigate to specified destinations in real-world environments. A key challenge is to recognize and stop at the correct location, especially for complicated outdoor environments. Existing methods treat the STOP action equally as other actions, which results in undesirable behaviors that the agent often fails to stop at the destination even though it might be on the right path. Therefore, we propose Learning to Stop (L2Stop), a simple yet effective policy module that differentiates STOP and other actions. Our approach achieves the new state of the art on a challenging urban VLN dataset Touchdown, outperforming the baseline by 6.89% (absolute improvement) on Success weighted by Edit Distance (SED).


title: Automated Identification of On-hold Self-admitted Technical Debt

abstract: Modern software is developed under considerable time pressure, which implies that developers more often than not have to resort to compromises when it comes to code that is well written and code that just does the job. This has led over the past decades to the concept of "technical debt", a short-term hack that potentially generates long-term maintenance problems. Self-admitted technical debt (SATD) is a particular form of technical debt: developers consciously perform the hack but also document it in the code by adding comments as a reminder (or as an admission of guilt). We focus on a specific type of SATD, namely "On-hold" SATD, in which developers document in their comments the need to halt an implementation task due to conditions outside of their scope of work (e.g., an open issue must be closed before a function can be implemented). We present an approach, based on regular expressions and machine learning, which is able to detect issues referenced in code comments, and to automatically classify the detected instances as either "On-hold" (the issue is referenced to indicate the need to wait for its resolution before completing a task), or as "cross-reference", (the issue is referenced to document the code, for example to explain the rationale behind an implementation choice). Our approach also mines the issue tracker of the projects to check if the On-hold SATD instances are "superfluous" and can be removed (i.e., the referenced issue has been closed, but the SATD is still in the code). Our evaluation confirms that our approach can indeed identify relevant instances of On-hold SATD. We illustrate its usefulness by identifying superfluous On-hold SATD instances in open source projects as confirmed by the original developers.


title: Isolating Patterns in Open Reaction-Diffusion Systems

abstract: Realistic examples of reaction-diffusion phenomena governing spatial and spatiotemporal pattern formation are rarely isolated systems, either chemically or thermodynamically. However, even formulations of `open' reaction-diffusion systems often neglect the role of domain boundaries. Most idealizations of closed reaction-diffusion systems employ no-flux boundary conditions, and often patterns will form up to, or along, these boundaries. Motivated by boundaries of patterning fields related to the emergence of spatial form in embryonic development, we propose a set of mixed boundary conditions for a two-species reaction-diffusion system which forms inhomogeneous solutions away from the boundary of the domain for a variety of different reaction kinetics, with a prescribed uniform state near the boundary. We show that these boundary conditions can be derived from a larger heterogeneous field, indicating that these conditions can arise naturally if cell signalling or other properties of the medium vary in space. We explain the basic mechanisms behind this pattern localization, and demonstrate that it can capture a large range of localized patterning in one, two, and three dimensions, and that this framework can be applied to systems involving more than two species. Furthermore, the boundary conditions proposed lead to more symmetrical patterns on the interior of the domain, and plausibly capture more realistic boundaries in developmental systems. Finally, we show that these isolated patterns are more robust to fluctuations in initial conditions, and that they allow intriguing possibilities of pattern selection via geometry, distinct from known selection mechanisms.


title: Prediction of giant and ideal Rashba-type splitting in ordered alloy monolayers grown on a polar surface

abstract: A large and ideal Rashba-type spin-orbit splitting is desired for the applications of materials in spintronic devices and the detection of Majorana Fermions in solids. Here, we propose an approach to achieve giant and ideal spin-orbit splittings through a combination of ordered surface alloying and interface engineering, that is, growing alloy monolayers on an insulating polar surface. We illustrate this unique strategy by means of first-principles calculations of buckled hexagonal monolayers of SbBi and PbBi supported on Al$_2$O$_3$(0001). Both systems display ideal Rashba-type states with giant SO splittings, characterized with energy offsets over 600 meV and momentum offsets over 0.3 $\AA^{-1}$, respectively. Our study thus points to an effective way of tuning spin-orbit splitting in low-dimensional materials to draw immediate experimental interest.


title: Neural Baselines for Word Alignment

abstract: Word alignments identify translational correspondences between words in a parallel sentence pair and is used, for instance, to learn bilingual dictionaries, to train statistical machine translation systems , or to perform quality estimation. In most areas of natural language processing, neural network models nowadays constitute the preferred approach, a situation that might also apply to word alignment models. In this work, we study and comprehensively evaluate neural models for unsupervised word alignment for four language pairs, contrasting several variants of neural models. We show that in most settings, neural versions of the IBM-1 and hidden Markov models vastly outperform their discrete counterparts. We also analyze typical alignment errors of the baselines that our models overcome to illustrate the benefits-and the limitations-of these new models for morphologically rich languages.


title: Generative latent neural models for automatic word alignment

abstract: Word alignments identify translational correspondences between words in a parallel sentence pair and are used, for instance, to learn bilingual dictionaries, to train statistical machine translation systems or to perform quality estimation. Variational autoencoders have been recently used in various of natural language processing to learn in an unsupervised way latent representations that are useful for language generation tasks. In this paper, we study these models for the task of word alignment and propose and assess several evolutions of a vanilla variational autoencoders. We demonstrate that these techniques can yield competitive results as compared to Giza++ and to a strong neural network alignment system for two language pairs.


title: RRPN++: Guidance Towards More Accurate Scene Text Detection

abstract: RRPN is among the outstanding scene text detection approaches, but the manually-designed anchor and coarse proposal refinement make the performance still far from perfection. In this paper, we propose RRPN++ to exploit the potential of RRPN-based model by several improvements. Based on RRPN, we propose the Anchor-free Pyramid Proposal Networks (APPN) to generate first-stage proposals, which adopts the anchor-free design to reduce proposal number and accelerate the inference speed. In our second stage, both the detection branch and the recognition branch are incorporated to perform multi-task learning. In inference stage, the detection branch outputs the proposal refinement and the recognition branch predicts the transcript of the refined text region. Further, the recognition branch also helps rescore the proposals and eliminate the false positive proposals by the jointing filtering strategy. With these enhancements, we boost the detection results by $6\%$ of F-measure in ICDAR2015 compared to RRPN. Experiments conducted on other benchmarks also illustrate the superior performance and efficiency of our model.


title: On totally split primes in high-degree torsion fields of elliptic curves

abstract: Analogously to primes in arithmetic progressions to large moduli, we can study primes that are totally split in extensions of $\mathbb{Q}$ of high degree. Motivated by a question of Kowalski we focus on the extensions $\mathbb{Q}(E[d])$ obtained by adjoining the coordinates of $d$-torsion points of a non-CM elliptic curve $E/\mathbb{Q}$. A prime $p$ is said to be an outside prime of $E$ if it is totally split in $\mathbb{Q}(E[d])$ for some $d$ with $p<|\text{Gal}(\mathbb{Q}(E[d])/\mathbb{Q})| = d^{4-o(1)}$ (so that $p$ is not accounted for by the expected main term in the Chebotarev Density Theorem). We show that for almost all integers $d$ there exists a non-CM elliptic curve $E/\mathbb{Q}$ and a prime $p<|\text{Gal}(\mathbb{Q}(E[d])/\mathbb{Q})|$ which is totally split in $\mathbb{Q}(E[d])$. Furthermore, we prove that for almost all $d$ that factorize suitably there exists a non-CM elliptic curve $E/\mathbb{Q}$ and a prime $p$ with $p^{0.2694} < d$ which is totally split in $\mathbb{Q}(E[d])$. To show this we use work of Kowalski to relate the question to the distribution of primes in certain residue classes modulo $d^2$. Hence, the barrier $p < d^4$ is related to the limit in the classical Bombieri-Vinogradov Theorem. To break past this we make use of the assumption that $d$ factorizes conveniently, similarly as in the works on primes in arithmetic progression to large moduli by Bombieri, Friedlander, Fouvry, and Iwaniec, and in the more recent works of Zhang, Polymath, and the author. In contrast to these works we do not require any of the deep exponential sum bounds (ie. sums of Kloosterman sums or Weil/Deligne bound). Instead, we only require the classical large sieve for multiplicative characters. We use Harman's sieve method to obtain a combinatorial decomposition for primes.


title: Medical Image Segmentation Using Deep Learning: A Survey

abstract: Deep learning has been widely used for medical image segmentation and a large number of papers has been presented recording the success of deep learning in the field. In this paper, we present a comprehensive thematic survey on medical image segmentation using deep learning techniques. This paper makes two original contributions. Firstly, compared to traditional surveys that directly divide literatures of deep learning on medical image segmentation into many groups and introduce literatures in detail for each group, we classify currently popular literatures according to a multi-level structure from coarse to fine. Secondly, this paper focuses on supervised and weakly supervised learning approaches, without including unsupervised approaches since they have been introduced in many old surveys and they are not popular currently. For supervised learning approaches, we analyze literatures in three aspects: the selection of backbone networks, the design of network blocks, and the improvement of loss functions. For weakly supervised learning approaches, we investigate literature according to data augmentation, transfer learning, and interactive segmentation, separately. Compared to existing surveys, this survey classifies the literatures very differently from before and is more convenient for readers to understand the relevant rationale and will guide them to think of appropriate improvements in medical image segmentation based on deep learning approaches.


title: Asymptotics of ODE's flow on the torus through a singleton condition and a perturbation result. Applications

abstract: This paper deals with the long time asymptotics X(t, x)/t of the flow X solution to the autonomous vector-valued ODE: X (t, x) = b(X(t, x)) for t $\in$ R, with X(0, x) = x a point of the torus Y d := R d /Z d. We assume that the vector field b reads as the product $\rho$ $\Phi$, where $\rho$ : Y d $\rightarrow$ [0, $\infty$) is a non negative regular function and $\Phi$ : Y d $\rightarrow$ R d is a non vanishing regular vector field. In this work, the singleton condition means that the rotation set C b composed of the average values of b with respect to the invariant probability measures for the flow X is a singleton {$\zeta$}, or equivalently, that lim t$\rightarrow$$\infty$ X(t, x)/t = $\zeta$ for any x $\in$ Y d. This combined with Liouville's theorem regarded as a divergence-curl lemma, first allows us to obtain the asymptotics of the flow X when b is a current field. Then, we prove a general perturbation result assuming that $\rho$ is the uniform limit in Y d of a positive sequence ($\rho$ n) n$\in$N satisfying for any n $\in$ N, $\rho$ $\le$ $\rho$ n and C $\rho$n$\Phi$ is a singleton {$\zeta$ n }. It turns out that the limit set C b either remains a singleton, or enlarges to the closed line set [0, lim n $\zeta$ n ] of R d. We provide various corollaries of this perturbation result involving or not the classical ergodic condition, according to the positivity or not of some harmonic means of $\rho$. These results are illustrated by different examples which show that the perturbation result is limited to the scalar perturbation of $\rho$, and which highlight the alternative satisfied by the rotation set C b. Finally, we prove that the singleton condition allows us to homogenize in any dimension the linear transport equation induced by the oscillating velocity b(x/$\epsilon$) beyond any ergodic condition satisfied by the flow X.


title: Topological and dynamical properties of Torelli groups of partitioned surfaces

abstract: Putman introduced a notion of a partitioned surface which is a surface with boundary with decoration restricting how the surface can be embedded into larger surfaces, and defined the Torelli group of the partitioned surfaces. In this paper, we study some topological and dynamical aspects of the Torelli groups of partitioned surfaces. More precisely, first we obtain upper and lower bounds on the cohomological dimension of Torelli groups of partitioned surfaces and show that those two bounds coincide when at most three boundary components are grouped together in the partition of the boundary. Second, we study the asymptotic translation lengths of Torelli groups of partitioned surfaces on the corresponding curve complexes. We show that the minimal asymptotic translation length asymptotically behaves almost like the reciprocal of the Euler characteristic of the surface. This generalizes the previous result of the first and second authors on Torelli groups for closed surfaces.


title: A Novel Ridge Detector for Nonstationary Multicomponent Signals: Development and Application to Robust Mode Retrieval

abstract: Time-frequency analysis is often used to study non stationary multicomponent signals, which can be viewed as the surperimposition of modes, associated with ridges in the TF plane. To understand such signals, it is essential to identify their constituent modes. This is often done by performing ridge detection in the time-frequency plane which is then followed by mode retrieval. Unfortunately, existing ridge detectors are often not enough robust to noise therefore hampering mode retrieval. In this paper, we therefore develop a novel approach to ridge detection and mode retrieval based on the analysis of the short-time Fourier transform of multicomponent signals in the presence of noise, which will prove to be much more robust than state-of-the-art methods based on the same time-frequency representation.


title: Pairs of Giant Shock Waves (N-Waves) in Merging Galaxy Clusters

abstract: When a subcluster merges with a larger galaxy cluster, a bow shock is driven ahead of the subcluster. At a later merger stage, this bow shock separates from the subcluster, becoming a "runaway" shock that propagates down the steep density gradient through the cluster outskirts and approximately maintains its strength and the Mach number. Such shocks are plausible candidates for producing radio relics in the periphery of clusters. We argue that, during the same merger stage, a secondary shock is formed much closer to the main cluster center. A close analog of this structure is known in the usual hydrodynamics as N-waves, where the trailing part of the "N" is the result of the non-linear evolution of a shock. In merging clusters, spherical geometry and stratification could further promote its development. Both the primary and the secondary shocks are the natural outcome of a single merger event and often both components of the pair should be present. However, in the radio band, the leading shock could be more prominent, while the trailing shock might conversely be more easily seen in X-rays. The latter argument implies that for some of the (trailing) shocks found in X-ray data, it might be difficult to identify their "partner" leading shocks or the merging subclusters, which are farther away from the cluster center. We argue that the Coma cluster and A2744 could be two examples in a post-merger state with such well-separated shock pairs.


title: A Superspace Dirac Operator in NCG and the "factorization" of the Ordinary Dirac Operator

abstract: We review a procedure of factorizing the Minkowski space Dirac operator over a~suitable superspace, discuss its Euclidean space version and apply the worked out formalism in the case od an almost-commutative Dirac operator. The presented framework is an attempt to reconcile non-commutative geometry and supersymmetry.


title: Rate-dependent bifurcation dodging in a thermoacoustic system driven by colored noise

abstract: Tipping in multistable systems occurs usually by varying the input slightly, resulting in the output switching to an often unsatisfactory state. This phenomenon is manifested in thermoacoustic systems. This thermoacoustic instability may lead to the disintegration of rocket engines, gas turbines and aeroengines, so it is necessary to design control measures for its suppression. It was speculated that such unwanted instability states may be dodged by changing quickly enough the bifurcation parameters. Thus, in this work, based on a fundamental mathematical model of thermoacoustic systems driven by colored noise, the corresponding Fokker-Planck-Kolmogorov equation of the amplitude is derived by using a stochastic averaging method. A transient dynamical behavior is identified through a probability density analysis. We find that the rate of change of parameters and the correlation time of the noise are helpful to dodge thermoacoustic instability, while a relatively large noise intensity is a disadvantageous factor. In addition, power-law relationships between the maximum amplitude and the noise parameters are explored, and the probability of successfully dodging a thermoacoustic instability is calculated. These results serve as a guide to the design of engines and to propose an effective control strategy, which is of great significance to aerospace-related fields.


title: Spherical normal forms for germs of parabolic line biholomorphisms

abstract: We address the inverse problem for holomorphic germs of a tangent-to-identity mapping of the complex line near a fixed point. We provide a preferred (family of) parabolic map $\Delta$ realizing a given Birkhoff--{\'E}calle-Voronin modulus $\psi$ and prove its uniqueness in the functional class we introduce. The germ is the time-1 map of a Gevrey formal vector field admitting meromorphic sums on a pair of infinite sectors covering the Riemann sphere. For that reason, the analytic continuation of $\Delta$ is a multivalued map admitting finitely many branch points with finite monodromy. In particular $\Delta$ is holomorphic and injective on an open slit sphere containing 0 (the initial fixed point) and $\infty$, where sits the companion parabolic point under the involution $\frac{-1}{\id}$. It turns out that the Birkhoff--{\'E}calle-Voronin modulus of the parabolic germ at $\infty$ is the inverse $\psi^{\circ-1}$ of that at 0.


title: The Complexity of Reachability in Parametric Markov Decision Processes

abstract: This article presents the complexity of reachability decision problems for parametric Markov decision processes (pMDPs), an extension to Markov decision processes (MDPs) where transitions probabilities are described by polynomials over a finite set of parameters. In particular, we study the complexity of finding values for these parameters such that the induced MDP satisfies some maximal or minimal reachability probability constraints. We discuss different variants depending on the comparison operator in the constraints and the domain of the parameter values. We improve all known lower bounds for this problem, and notably provide ETR-completeness results for distinct variants of this problem.


title: Statistical Inference on the Cure Time

abstract: In population-based cancer survival analysis, the net survival is important for government to assess health care programs. For decades, it is observed that the net survival reaches a plateau after long-term follow-up, this is so called ``statistical cure''. Several methods were proposed to address the statistical cure. Besides, the cure time can be used to evaluate the time period of a health care program for a specific patient population, and it also can be helpful for a clinician to explain the prognosis for patients, therefore the cure time is an important health care index. However, those proposed methods assume the cure time to be infinity, thus it is inconvenient to make inference on the cure time. In this dissertation, we define a more general concept of statistical cure via conditional survival. Based on the newly defined statistical cure, the cure time is well defined. We develop cure time model methodologies and show a variety of properties through simulation. In data analysis, cure times are estimated for 22 major cancers in Taiwan, we further use colorectal cancer data as an example to conduct statistical inference via cure time model with covariate sex, age group, and stage. This dissertation provides a methodology to obtain cure time estimate, which can contribute to public health policy making.


title: The layer number of grids

abstract: The peeling process is defined as follows: starting with a finite point set $X \subset \mathbb{R}^d$, we repeatedly remove the set of vertices of the convex hull of the current set of points. The number of peeling steps needed to completely delete the set $X$ is called the layer number of $X$. In this paper, we study the layer number of the $d$-dimensional integer grid $[n]^d$. We prove that for every $d \geq 1$, the layer number of $[n]^d$ is at least $\Omega\left(n^\frac{2d}{d+1}\right)$. On the other hand, we show that for every $d\geq 3$, it takes at most $O(n^{d - 9/11})$ steps to fully remove $[n]^d$. Our approach is based on an enhancement of the method used by Har-Peled and Lidick\'{y} for solving the 2-dimensional case.


title: Global well-posedness and nonlinear stability of a chemotaxis system modeling multiple sclerosis

abstract: We consider a system of reaction-diffusion equations including chemotaxis terms and coming out of the modeling of multiple sclerosis. The global existence of strong solutions to this system in any dimension is proved, and it is also shown that the solution is bounded uniformly in time. Finally, a nonlinear stability result is obtained when the chemotaxis term is not too big. We also perform numerical simulations to show the appearance of Turing patterns when the chemotaxis term is large.


title: On uniqueness of weak solutions of the incompressible Navier-Stokes equations

abstract: In this article the question on uniqueness of weak solution of the incompressible Navier-Stokes Equations in the 3-dimensional case is studied. Here the investigation is carried out with use of another approach. The uniqueness of velocity for the considered problem is proved for given functions from spaces that posseses some smoothness. Moreover, these spaces are dense in respective spaces of functions, under which were proved existence of the weak solutions. In addition here the solvability and uniqueness of the weak solutions of auxiliary problems associated with the main problem is investigated, and also one conditional result on uniqueness is proved.


title: A Testing Environment for Continuous Colormaps

abstract: Many computer science disciplines (e.g., combinatorial optimization, natural language processing, and information retrieval) use standard or established test suites for evaluating algorithms. In visualization, similar approaches have been adopted in some areas (e.g., volume visualization), while user testimonies and empirical studies have been the dominant means of evaluation in most other areas, such as designing colormaps. In this paper, we propose to establish a test suite for evaluating the design of colormaps. With such a suite, the users can observe the effects when different continuous colormaps are applied to planar scalar fields that may exhibit various characteristic features, such as jumps, local extrema, ridge or valley lines, different distributions of scalar values, different gradients, different signal frequencies, different levels of noise, and so on. The suite also includes an expansible collection of real-world data sets including the most popular data for colormap testing in the visualization literature. The test suite has been integrated into a web-based application for creating continuous colormaps (https://ccctool.com/), facilitating close inter-operation between design and evaluation processes. This new facility complements traditional evaluation methods such as user testimonies and empirical studies.


title: Interpretable Detail-Fidelity Attention Network for Single Image Super-Resolution

abstract: Benefiting from the strong capabilities of deep CNNs for feature representation and nonlinear mapping, deep-learning-based methods have achieved excellent performance in single image super-resolution. However, most existing SR methods depend on the high capacity of networks which is initially designed for visual recognition, and rarely consider the initial intention of super-resolution for detail fidelity. Aiming at pursuing this intention, there are two challenging issues to be solved: (1) learning appropriate operators which is adaptive to the diverse characteristics of smoothes and details; (2) improving the ability of model to preserve the low-frequency smoothes and reconstruct the high-frequency details. To solve them, we propose a purposeful and interpretable detail-fidelity attention network to progressively process these smoothes and details in divide-and-conquer manner, which is a novel and specific prospect of image super-resolution for the purpose on improving the detail fidelity, instead of blindly designing or employing the deep CNNs architectures for merely feature representation in local receptive fields. Particularly, we propose a Hessian filtering for interpretable feature representation which is high-profile for detail inference, a dilated encoder-decoder and a distribution alignment cell to improve the inferred Hessian features in morphological manner and statistical manner respectively. Extensive experiments demonstrate that the proposed methods achieve superior performances over the state-of-the-art methods quantitatively and qualitatively. Code is available at https://github.com/YuanfeiHuang/DeFiAN.


title: Integrated Communication and Localization in mmWave Systems

abstract: As the fifth-generation (5G) mobile communication system is being commercialized, extensive studies on the evolution of 5G and sixth-generation mobile communication systems have been conducted. Future mobile communication systems are evidently evolving towards a more intelligent and software-reconfigurable functionality paradigm that can provide ubiquitous communication and also sense, control, and optimize wireless environments. Thus, integrating communication and localization by utilizing the highly directional transmission characteristics of millimeter-wave (mmWave) is a promising route. This approach not only expands the localization capabilities of a communication system but also provides new concepts and opportunities to enhance communication. In this paper, we explain the integrated communication and localization in mmWave systems, in which these processes share the same set of hardware architecture and algorithm. We also perform an overview of the key enabling technologies and the basic knowledge on localization. Then, we provide two promising directions for studies on localization with extremely large antenna array and model-based neural networks. We also discuss a comprehensive guidance for location-assisted mmWave communications in terms of channel estimation, channel state information feedback, beam tracking, synchronization, interference control, resource allocation, and user selection. Finally, this paper outlines the future trends on the mutual assistance and enhancement of communication and localization in integrated systems.


title: Control of skyrmion chirality in Ta/FeCoB/TaOx trilayers by TaOx oxidation and FeCoB thickness

abstract: Skyrmions are magnetic bubbles with nontrivial topology envisioned as data bits for ultrafast and power-efficient spintronic memory and logic devices. They may be stabilized in heavy-metal/ferromagnetic/oxide trilayer systems. The skyrmion chirality is then determined by the sign of the interfacial Dzyaloshinskii-Moriya interaction (DMI). Nevertheless, for apparently identical systems, there is some controversy about the DMI sign. Here, we show that the degree of oxidation of the top interface and the thickness of the ferromagnetic layer play a major role. Using Brillouin light-scattering measurements in Ta/Fe-Co-B/TaOx trilayers, we demonstrate a sign change of the DMI with the degree of oxidation of the Fe-Co-B/TaOx interface. Using polar magneto-optical Kerr effect microscopy, we consistently observe a reversal of the direction of current-induced motion of skyrmions with the oxidation level of TaOx; this is attributed to their chirality reversal. In addition, a second chirality reversal is observed when changing the Fe-Co-B thickness, probably due to the proximity of the two Fe-Co-B interfaces in the ultrathin case. By properly tuning the chirality of the skyrmion, spin-transfer and spin-orbit torques combine constructively to enhance the skyrmion velocity. These observations thus allow us to envision an optimization of the material parameters to produce highly mobile skyrmions. Moreover, this chirality control enables a versatile manipulation of skyrmions and paves the way towards multidirectional devices.


title: The background field method and critical vector models

abstract: We use the background field method to systematically derive CFT data for the critical $\phi^6$ vector model in three dimensions, and the Gross-Neveu model in dimensions $2\leq d \leq 4$. Specifically, we calculate the OPE coefficients and anomalous dimensions of various operators, up to next-to-leading order in the $1/N$ expansion.


title: On the delay times of merging double neutron stars

abstract: The merging rate of double neutron stars (DNS) has a great impact on many astrophysical issues, including the interpretation of gravitational waves signals, of the short Gamma Ray Bursts (GRBs), and of the chemical properties of stars in galaxies. Such rate depends on the distribution of the delay times (DDT) of the merging events. In this paper we derive a theoretical DDT of merging DNS following from the characteristics of the clock controlling their evolution. We show that the shape of the DDT is governed by a few key parameters, primarily the lower limit and the slope of the distribution of the separation of the DNS systems at birth. With a parametric approach we investigate on the observational constraints on the DDT from the cosmic rate of short GRBs and the Europium to Iron ratio in Milky Way stars, taken as tracer of the products of the explosion. We find that the local rate of DNS merging requires that about 1 percent of neutron stars progenitors live in binary systems which end their evolution as merging DNS within a Hubble time. The redshift distribution of short GRBs does not yet provide a strong constraint on the shape of the DDT, although the best fitting models have a shallow DDT. The chemical pattern in Milky Way stars requires an additional source of Europium besides the products from merging DNS, which weakens the related requirement on the DDT. At present both constraints can be matched with the same DDT for merging DNS.


title: Preventing pressure oscillations does not fix local linear stability issues of entropy-based split-form high-order schemes

abstract: Recently, it was discovered that the entropy-conserving/dissipative high-order split-form discontinuous Galerkin discretizations have robustness issues when trying to solve the simple density wave propagation example for the compressible Euler equations. The issue is related to missing local linear stability, i.e. the stability of the discretization towards perturbations added to a stable base flow. This is strongly related to an anti-diffusion mechanism, that is inherent in entropy-conserving two-point fluxes, which are a key ingredient for the high-order discontinuous Galerkin extension. In this paper, we investigate if pressure equilibrium preservation is a remedy to these recently found local linear stability issues of entropy-conservative/dissipative high-order split-form discontinuous Galerkin methods for the compressible Euler equations. Pressure equilibrium preservation describes the property of a discretization to keep pressure and velocity constant for pure density wave propagation. We present the full theoretical derivation, analysis, and show corresponding numerical results to underline our findings. In addition, we characterize numerical fluxes for the Euler equations that are entropy-conservative, kinetic-energy-preserving, pressure-equilibrium-preserving, and have a density flux that does not depend on the pressure. The source code to reproduce all numerical experiments presented in this article is available online (DOI: 10.5281/zenodo.4054366).


title: Quantum computed moments correction to variational estimates

abstract: The variational principle of quantum mechanics is the backbone of hybrid quantum computing for a range of applications. However, as the problem size grows, quantum logic errors and the effect of barren plateaus overwhelm the quality of the results. There is now a clear focus on strategies that require fewer quantum circuit steps and are robust to device errors. Here we present an approach in which problem complexity is transferred to dynamic quantities computed on the quantum processor - Hamiltonian moments, $\langle H^n\rangle$. From these quantum computed moments, estimates of the ground-state energy are obtained using the "infinum" theorem from Lanczos cumulant expansions which manifestly correct the associated variational calculation. With system dynamics encoded in the moments the burden on the trial-state quantum circuit depth is eased. The method is introduced and demonstrated on 2D quantum magnetism models on lattices up to 5 $\times$ 5 (25 qubits) implemented on IBM Quantum superconducting qubit devices. Moments were quantum computed to fourth order with respect to a parameterised antiferromagnetic trial-state. A comprehensive comparison with benchmark variational calculations was performed, including over an ensemble of random coupling instances. The results showed that the infinum estimate consistently outperformed the benchmark variational approach for the same trial-state. These initial investigations suggest that the quantum computed moments approach has a high degree of stability against trial-state variation, quantum gate errors and shot noise, all of which bodes well for further investigation and applications of the approach.


title: Availability Evaluation of Multi-tenant Service Function Chaining Infrastructures by Multidimensional Universal Generating Function

abstract: The Network Function Virtualization (NFV) paradigm has been devised as an enabler of next generation network infrastructures by speeding up the provisioning and the composition of novel network services. The latter are implemented via a chain of virtualized network functions, a process known as Service Function Chaining. In this paper, we evaluate the availability of multi-tenant SFC infrastructures, where every network function is modeled as a multi-state system and is shared among different and independent tenants. To this aim, we propose a Universal Generating Function (UGF) approach, suitably extended to handle performance vectors, that we call Multidimensional UGF. This novel methodology is validated in a realistic multi-tenant telecommunication network scenario, where the service chain is composed by the network elements of an IP Multimedia Subsystem implemented via NFV. A steady-state availability evaluation of such an exemplary system is presented and a redundancy optimization problem is solved, so providing the SFC infrastructure which minimizes deployment cost while respecting a given availability requirement.


title: Cohomogeneity One Manifolds and Homogeneous Spaces of Positive Scalar Curvature

abstract: We characterize cohomogeneity one manifolds and homogeneous spaces with a compact Lie group action admitting an invariant metric with positive scalar curvature.


title: Eigenvector distribution in the critical regime of BBP transition

abstract: In this paper, we study the random matrix model of Gaussian Unitary Ensemble (GUE) with fixed-rank (aka spiked) external source. We will focus on the critical regime of the Baik-Ben Arous-P\'ech\'e (BBP) phase transition and establish the distribution of the eigenvectors associated with the leading eigenvalues. The distribution is given in terms of a determinantal point process with extended Airy kernel. Our result can be regarded as an eigenvector counterpart of the BBP eigenvalue phase transition (arXiv:math/0403022). The derivation of the distribution makes use of the recently re-discovered eigenvector-eigenvalue identity, together with the determinantal point process representation of the GUE minor process with external source.


title: Segmentation and Analysis of a Sketched Truss Frame Using Morphological Image Processing Techniques

abstract: Development of computational tools to analyze and assess the building capacities has had a major impact in civil engineering. The interaction with the structural software packages is becoming easier and the modeling tools are becoming smarter by automating the users role during their interaction with the software. One of the difficulties and the most time consuming steps involved in the structural modeling is defining the geometry of the structure to provide the analysis. This paper is dedicated to the development of a methodology to automate analysis of a hand sketched or computer generated truss frame drawn on a piece of paper. First, we focus on the segmentation methodologies for hand sketched truss components using the morphological image processing techniques, and then we provide a real time analysis of the truss. We visualize and augment the results on the input image to facilitate the public understanding of the truss geometry and internal forces. MATLAB is used as the programming language for the image processing purposes, and the truss is analyzed using Sap2000 API to integrate with MATLAB to provide a convenient structural analysis. This paper highlights the potential of the automation of the structural analysis using image processing to quickly assess the efficiency of structural systems. Further development of this framework is likely to revolutionize the way that structures are modeled and analyzed.


title: Adversarial Robustness of Stabilized NeuralODEs Might be from Obfuscated Gradients

abstract: In this paper we introduce a provably stable architecture for Neural Ordinary Differential Equations (ODEs) which achieves non-trivial adversarial robustness under white-box adversarial attacks even when the network is trained naturally. For most existing defense methods withstanding strong white-box attacks, to improve robustness of neural networks, they need to be trained adversarially, hence have to strike a trade-off between natural accuracy and adversarial robustness. Inspired by dynamical system theory, we design a stabilized neural ODE network named SONet whose ODE blocks are skew-symmetric and proved to be input-output stable. With natural training, SONet can achieve comparable robustness with the state-of-the-art adversarial defense methods, without sacrificing natural accuracy. Even replacing only the first layer of a ResNet by such a ODE block can exhibit further improvement in robustness, e.g., under PGD-20 ($\ell_\infty=0.031$) attack on CIFAR-10 dataset, it achieves 91.57\% and natural accuracy and 62.35\% robust accuracy, while a counterpart architecture of ResNet trained with TRADES achieves natural and robust accuracy 76.29\% and 45.24\%, respectively. To understand possible reasons behind this surprisingly good result, we further explore the possible mechanism underlying such an adversarial robustness. We show that the adaptive stepsize numerical ODE solver, DOPRI5, has a gradient masking effect that fails the PGD attacks which are sensitive to gradient information of training loss; on the other hand, it cannot fool the CW attack of robust gradients and the SPSA attack that is gradient-free. This provides a new explanation that the adversarial robustness of ODE-based networks mainly comes from the obfuscated gradients in numerical ODE solvers.


title: Amodal 3D Reconstruction for Robotic Manipulation via Stability and Connectivity

abstract: Learning-based 3D object reconstruction enables single- or few-shot estimation of 3D object models. For robotics, this holds the potential to allow model-based methods to rapidly adapt to novel objects and scenes. Existing 3D reconstruction techniques optimize for visual reconstruction fidelity, typically measured by chamfer distance or voxel IOU. We find that when applied to realistic, cluttered robotics environments, these systems produce reconstructions with low physical realism, resulting in poor task performance when used for model-based control. We propose ARM, an amodal 3D reconstruction system that introduces (1) a stability prior over object shapes, (2) a connectivity prior, and (3) a multi-channel input representation that allows for reasoning over relationships between groups of objects. By using these priors over the physical properties of objects, our system improves reconstruction quality not just by standard visual metrics, but also performance of model-based control on a variety of robotics manipulation tasks in challenging, cluttered environments. Code is available at github.com/wagnew3/ARM.


title: On an asymptotic characterisation of Griffiths semipositivity

abstract: We prove that certain possibly non-smooth Hermitian metrics are Griffiths-semipositively curved if and only if they satisfy an asymptotic extension property. This result answers a question of Deng--Ning--Wang--Zhou in the affirmative.


title: Automated Pancreas Segmentation Using Multi-institutional Collaborative Deep Learning

abstract: The performance of deep learning-based methods strongly relies on the number of datasets used for training. Many efforts have been made to increase the data in the medical image analysis field. However, unlike photography images, it is hard to generate centralized databases to collect medical images because of numerous technical, legal, and privacy issues. In this work, we study the use of federated learning between two institutions in a real-world setting to collaboratively train a model without sharing the raw data across national boundaries. We quantitatively compare the segmentation models obtained with federated learning and local training alone. Our experimental results show that federated learning models have higher generalizability than standalone training.


title: Statistical Assessment of IP Multimedia Subsystem in a Softwarized Environment: a Queueing Networks Approach

abstract: The Next Generation 5G Networks can greatly benefit from the synergy between virtualization paradigms, such as the Network Function Virtualization (NFV), and service provisioning platforms such as the IP Multimedia Subsystem (IMS). The NFV concept is evolving towards a lightweight solution based on containers that, by contrast to classic virtual machines, do not carry a whole operating system and result in more efficient and scalable deployments. On the other hand, IMS has become an integral part of the 5G core network, for instance, to provide advanced services like Voice over LTE (VoLTE). In this paper we combine these virtualization and service provisioning concepts, deriving a containerized IMS infrastructure, dubbed cIMS, providing its assessment through statistical characterization and experimental measurements. Specifically, we: i) model cIMS through the queueing networks methodology to characterize the utilization of virtual resources under constrained conditions; ii) draw an extended version of the Pollaczek-Khinchin formula, which is useful to deal with bulk arrivals; iii) afford an optimization problem focused at maximizing the whole cIMS performance in the presence of capacity constraints, thus providing new means for the service provider to manage service level agreements (SLAs); $iv)$ evaluate a range of cIMS scenarios, considering different queuing disciplines including also multiple job classes. An experimental testbed based on the open source platform Clearwater has been deployed to derive some realistic values of key parameters (e.g. arrival and service times).


title: Atomic-scale control of graphene magnetism using hydrogen atoms

abstract: Isolated hydrogen atoms absorbed on graphene are predicted to induce magnetic moments. Here we demonstrate that the adsorption of a single hydrogen atom on graphene induces a magnetic moment characterized by a ~20 meV spin-split state at the Fermi energy. Our scanning tunneling microscopy (STM) experiments, complemented by first-principles calculations, show that such a spin-polarized state is essentially localized on the carbon sublattice complementary to the one where the H atom is chemisorbed. This atomically modulated spin-texture, which extends several nanometers away from the H atom, drives the direct coupling between the magnetic moments at unusually long distances. Using the STM tip to manipulate H atoms with atomic precision, we demonstrate the possibility to tailor the magnetism of selected graphene regions.


title: Remark About T-duality of Dp-Branes

abstract: This note is devoted to the analysis of T-duality of Dp-brane when we perform T-duality along directions that are transverse to world-volume of Dp-brane.


title: Decisiveness of Stochastic Systems and its Application to Hybrid Models (Full Version)

abstract: In [ABM07], Abdulla et al. introduced the concept of decisiveness, an interesting tool for lifting good properties of finite Markov chains to denumerable ones. Later, this concept was extended to more general stochastic transition systems (STSs), allowing the design of various verification algorithms for large classes of (infinite) STSs. We further improve the understanding and utility of decisiveness in two ways. First, we provide a general criterion for proving decisiveness of general STSs. This criterion, which is very natural but whose proof is rather technical, (strictly) generalizes all known criteria from the literature. Second, we focus on stochastic hybrid systems (SHSs), a stochastic extension of hybrid systems. We establish the decisiveness of a large class of SHSs and, under a few classical hypotheses from mathematical logic, we show how to decide reachability problems in this class, even though they are undecidable for general SHSs. This provides a decidable stochastic extension of o-minimal hybrid systems. [ABM07] Parosh A. Abdulla, Noomene Ben Henda, and Richard Mayr. 2007. Decisive Markov Chains. Log. Methods Comput. Sci. 3, 4 (2007).


title: STR: Secure Computation on Additive Shares Using the Share-Transform-Reveal Strategy

abstract: The rapid development of cloud computing has probably benefited each of us. However, the privacy risks brought by untrustworthy cloud servers arise the attention of more and more people and legislatures. In the last two decades, plenty of works seek to outsource various specific tasks while ensuring the security of private data. The tasks to be outsourced are countless; however, the computations involved are similar. In this paper, we construct a series of novel protocols that support the secure computation of various functions on numbers (e.g., the basic elementary functions) and matrices (e.g., the calculation of eigenvectors and eigenvalues) in arbitrary $n\geq 2$ servers. All protocols only require constant rounds of interactions and achieve the low computation complexity. Moreover, the proposed $n$-party protocols ensure the security of private data even though $n-1$ servers collude. The convolutional neural network models are utilized as the case studies to verify the protocols. The theoretical analysis and experimental results demonstrate the correctness, efficiency, and security of the proposed protocols.


title: Balancing thermal comfort datasets: We GAN, but should we?

abstract: Thermal comfort assessment for the built environment has become more available to analysts and researchers due to the proliferation of sensors and subjective feedback methods. These data can be used for modeling comfort behavior to support design and operations towards energy efficiency and well-being. By nature, occupant subjective feedback is imbalanced as indoor conditions are designed for comfort, and responses indicating otherwise are less common. This situation creates a scenario for the machine learning workflow where class balancing as a pre-processing step might be valuable for developing predictive thermal comfort classification models with high-performance. This paper investigates the various thermal comfort dataset class balancing techniques from the literature and proposes a modified conditional Generative Adversarial Network (GAN), $\texttt{comfortGAN}$, to address this imbalance scenario. These approaches are applied to three publicly available datasets, ranging from 30 and 67 participants to a global collection of thermal comfort datasets, with 1,474; 2,067; and 66,397 data points, respectively. This work finds that a classification model trained on a balanced dataset, comprised of real and generated samples from $\texttt{comfortGAN}$, has higher performance (increase between 4% and 17% in classification accuracy) than other augmentation methods tested. However, when classes representing discomfort are merged and reduced to three, better imbalanced performance is expected, and the additional increase in performance by $\texttt{comfortGAN}$ shrinks to 1-2%. These results illustrate that class balancing for thermal comfort modeling is beneficial using advanced techniques such as GANs, but its value is diminished in certain scenarios. A discussion is provided to assist potential users in determining which scenarios this process is useful and which method works best.


title: Fitting Cyclic Experimental Load-Deformation Data to The Pivot Hysteresis Model Using Genetic Algorithm

abstract: Understanding the linear or nonlinear relationship between load and deformation in structural materials or structural frames is a key to a proper and a well-represented simulation. This research is dedicated to model a cyclic load-deformation hysteresis relationship, captured from experimental results, and utilize it to represent the cyclic hysteresis data. The Genetic Algorithm is used to find the best parameters to introduce the model and to minimize the deviation between the simulation and the experimental results. In other words, the parameters associated with the loading response of any displacement pattern, are found, while minimizing the deviation between simulation loading response and the loading data carried out from the experiment. First, to reduce the data size recorded with measuring devices or Linear Variable Differential Transformers (LVDTs in short), a data resampling technic is proposed. Second, the resampled data is used in Genetic Algorithm to seek for the best parameters to describe the model. This method could be used to train models to predict the capacity and performance of a materials and frames when they are exposed to any deformation patterns. Numerous examples are shown at the end of the paper.


title: Prediction and understanding of soft proton contamination in XMM-Newton: a machine learning approach

abstract: One of the major and unfortunately unforeseen sources of background for the current generation of X-ray telescopes are few tens to hundreds of keV (soft) protons concentrated by the mirrors. One such telescope is the European Space Agency's (ESA) X-ray Multi-Mirror Mission (XMM-Newton). Its observing time lost due to background contamination is about 40\%. This loss of observing time affects all the major broad science goals of this observatory, ranging from cosmology to astrophysics of neutron stars and black holes. The soft proton background could dramatically impact future large X-ray missions such as the ESA planned Athena mission (http://www.the-athena-x-ray-observatory.eu/). Physical processes that trigger this background are still poorly understood. We use a Machine Learning (ML) approach to delineate related important parameters and to develop a model to predict the background contamination using 12 years of XMM observations. As predictors we use the location of satellite, solar and geomagnetic activity parameters. We revealed that the contamination is most strongly related to the distance in southern direction, $Z$, (XMM observations were in the southern hemisphere), the solar wind radial velocity and the location on the magnetospheric magnetic field lines. We derived simple empirical models for the first two individual predictors and an ML model which utilizes an ensemble of the predictors (Extra Trees Regressor) and gives better performance. Based on our analysis, future missions should minimize observations during times associated with high solar wind speed and avoid closed magnetic field lines, especially at the dusk flank region in the southern hemisphere.


title: New classes of Picard operators

abstract: In this paper, we give new results concerning the existence of Picard operators on complete metric spaces.


title: Trainable Structure Tensors for Autonomous Baggage Threat Detection Under Extreme Occlusion

abstract: Detecting baggage threats is one of the most difficult tasks, even for expert officers. Many researchers have developed computer-aided screening systems to recognize these threats from the baggage X-ray scans. However, all of these frameworks are limited in identifying the contraband items under extreme occlusion. This paper presents a novel instance segmentation framework that utilizes trainable structure tensors to highlight the contours of the occluded and cluttered contraband items (by scanning multiple predominant orientations), while simultaneously suppressing the irrelevant baggage content. The proposed framework has been extensively tested on four publicly available X-ray datasets where it outperforms the state-of-the-art frameworks in terms of mean average precision scores. Furthermore, to the best of our knowledge, it is the only framework that has been validated on combined grayscale and colored scans obtained from four different types of X-ray scanners.


title: New Accurate Approximation for Average Error Probability Under $\kappa-\mu$ Shadowed Fading Channel

abstract: This paper proposes new accurate approximations for average error probability (AEP) of a communication system employing either $M$-phase-shift keying (PSK) or differential quaternary PSK with Gray coding (GC-DQPSK) modulation schemes over $\kappa-\mu$ shadowed fading channel. Firstly, new accurate approximations of error probability (EP) of both modulation schemes are derived over additive white Gaussian noise (AWGN) channel. Leveraging the trapezoidal integral method, a tight approximate expression of symbol error probability for $M$-PSK modulation is presented, while new upper and lower bounds for Marcum $Q$-function of the first order (MQF), and subsequently those for bit error probability (BER) under DQPSK scheme, are proposed. Next, these bounds are linearly combined to propose a highly refined and accurate BER's approximation. The key idea manifested in the decrease property of modified Bessel function $I_{v}$, strongly related to MQF, with its argument $v$. Finally, theses approximations are used to tackle AEP's approximation under $\kappa-\mu$ shadowed fading. Numerical results show the accuracy of the presented approximations compared to the exact ones.


title: The role of behavioural plasticity in finite vs infinite populations

abstract: Evolutionary game theory has proven to be an elegant framework providing many fruitful insights in population dynamics and human behaviour. Here, we focus on the aspect of behavioural plasticity and its effect on the evolution of populations. We consider games with only two strategies in both well-mixed infinite and finite populations settings. We assume that individuals might exhibit behavioural plasticity referred to as incompetence of players. We study the effect of such heterogeneity on the outcome of local interactions and, ultimately, on global competition. For instance, a strategy that was dominated before can become desirable from the selection perspective when behavioural plasticity is taken into account. Furthermore, it can ease conditions for a successful fixation in infinite populations' invasions. We demonstrate our findings on the examples of Prisoners' Dilemma and Snowdrift game, where we define conditions under which cooperation can be promoted.


title: Towards Heterogeneous Multi-Agent Reinforcement Learning with Graph Neural Networks

abstract: This work proposes a neural network architecture that learns policies for multiple agent classes in a heterogeneous multi-agent reinforcement setting. The proposed network uses directed labeled graph representations for states, encodes feature vectors of different sizes for different entity classes, uses relational graph convolution layers to model different communication channels between entity types and learns distinct policies for different agent classes, sharing parameters wherever possible. Results have shown that specializing the communication channels between entity classes is a promising step to achieve higher performance in environments composed of heterogeneous entities.


title: Determination of spin-orbit torques by thickness-dependent spin-orbit torque FMR measurement

abstract: Current induced spin-orbit torques (SOTs) in Fe/Pt bilayers have been investigated utilizing the spin-orbit torque ferromagnetic resonance (SOT-FMR) measurement. Characterization of thin films with different thicknesses indicates existence of a sizable field-like spin-orbit torque competing with the Oersted field induced torque (Oersted torque). The field-like torque is neglected in the standard SOT-FMR method and the presence of a strong field-like torque makes estimation of the spin Hall angle (SHA) problematic. Also, it is challenging to differentiate the field-like torque from the Oersted torque in a radiofrequency measurement. Based on the thickness dependence of field-like torque, anti-damping torque, and Oersted torque, the thickness-dependent SOT-FMR measurement is proposed as a more reliable, self-calibrated approach for characterization of spin-orbit torques.


title: Conditions for Regional Frequency Stability in Power System Scheduling -- Part I: Theory

abstract: This paper considers the phenomenon of distinct regional frequencies recently observed in some power systems. First, a reduced-order mathematical model describing this behaviour is developed. Then, techniques to solve the model are discussed, demonstrating that the post-fault frequency evolution in any given region is equal to the frequency evolution of the Centre Of Inertia plus certain inter-area oscillations. This finding leads to the deduction of conditions for guaranteeing frequency stability in all regions of a power system, a deduction performed using a mixed analytical-numerical approach that combines mathematical analysis with regression methods on simulation samples. The proposed stability conditions are linear inequalities that can be implemented in any optimisation routine allowing the co-optimisation of all existing ancillary services for frequency support: inertia, multi-speed frequency response, load damping and an optimised largest power infeed. This is the first reported mathematical framework with explicit conditions to maintain frequency stability in a power system exhibiting inter-area oscillations in frequency.


title: Conditions for Regional Frequency Stability in Power System Scheduling -- Part II: Application to Unit Commitment

abstract: In Part I of this paper we have introduced the closed-form conditions for guaranteeing regional frequency stability in a power system. Here we propose a methodology to represent these conditions in the form of linear constraints and demonstrate their applicability by implementing them in a generation-scheduling model. This model simultaneously optimises energy production and ancillary services for maintaining frequency stability in the event of a generation outage, by solving a frequency-secured Stochastic Unit Commitment (SUC). We consider the Great Britain system, characterised by two regions that create a non-uniform distribution of inertia: England in the South, where most of the load is located, and Scotland in the North, containing significant wind resources. Through several case studies, it is shown that inertia and frequency response cannot be considered as system-wide magnitudes in power systems that exhibit inter-area oscillations in frequency, as their location in a particular region is key to guarantee stability. In addition, securing against a medium-sized loss in the low-inertia region proves to cause significant wind curtailment, which could be alleviated through reinforced transmission corridors. In this context, the proposed constraints allow to find the optimal volume of ancillary services to be procured in each region.


title: Quantal synaptic dilution enhances sparse encoding and dropout regularisation in deep networks

abstract: Dropout is a technique that silences the activity of units stochastically while training deep networks to reduce overfitting. Here we introduce Quantal Synaptic Dilution (QSD), a biologically plausible model of dropout regularisation based on the quantal properties of neuronal synapses, that incorporates heterogeneities in response magnitudes and release probabilities for vesicular quanta. QSD outperforms standard dropout in ReLU multilayer perceptrons, with enhanced sparse encoding at test time when dropout masks are replaced with identity functions, without shifts in trainable weight or bias distributions. For convolutional networks, the method also improves generalisation in computer vision tasks with and without inclusion of additional forms of regularisation. QSD also outperforms standard dropout in recurrent networks for language modelling and sentiment analysis. An advantage of QSD over many variations of dropout is that it can be implemented generally in all conventional deep networks where standard dropout is applicable.