title: MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers

abstract: Pre-trained language models (e.g., BERT (Devlin et al., 2018) and its variants) have achieved remarkable success in varieties of NLP tasks. However, these models usually consist of hundreds of millions of parameters which brings challenges for fine-tuning and online serving in real-life applications due to latency and capacity constraints. In this work, we present a simple and effective approach to compress large Transformer (Vaswani et al., 2017) based pre-trained models, termed as deep self-attention distillation. The small model (student) is trained by deeply mimicking the self-attention module, which plays a vital role in Transformer networks, of the large model (teacher). Specifically, we propose distilling the self-attention module of the last Transformer layer of the teacher, which is effective and flexible for the student. Furthermore, we introduce the scaled dot-product between values in the self-attention module as the new deep self-attention knowledge, in addition to the attention distributions (i.e., the scaled dot-product of queries and keys) that have been used in existing works. Moreover, we show that introducing a teacher assistant (Mirzadeh et al., 2019) also helps the distillation of large pre-trained Transformer models. Experimental results demonstrate that our monolingual model outperforms state-of-the-art baselines in different parameter size of student models. In particular, it retains more than 99% accuracy on SQuAD 2.0 and several GLUE benchmark tasks using 50% of the Transformer parameters and computations of the teacher model. We also obtain competitive results in applying deep self-attention distillation to multilingual pre-trained models.


title: Improved Lower Bound for Competitive Graph Exploration

abstract: We give an improved lower bound of 10/3 on the competitive ratio for the exploration of an undirected, edge-weighted graph with a single agent that needs to return to the starting location after visiting all vertices. We assume that the agent has full knowledge of all edges incident to visited vertices, and, in particular, vertices have unique identifiers. Our bound improves a lower bound of 2.5 by Dobrev et al. [SIROCCO'12] and also holds for planar graphs, where it complements an upper bound of 16 by Kalyanasundaram and Pruhs[TCS'94]. The question whether a constant competitive ratio can be achieved in general remains open.


title: A more abstractive summarization model

abstract: Pointer-generator network is an extremely popular method of text summarization. More recent works in this domain still build on top of the baseline pointer generator by augmenting a content selection phase, or by decomposing the decoder into a contextual network and a language model. However, all such models that are based on the pointer-generator base architecture cannot generate novel words in the summary and mostly copy words from the source text. In our work, we first thoroughly investigate why the pointer-generator network is unable to generate novel words, and then address that by adding an Out-of-vocabulary (OOV) penalty. This enables us to improve the amount of novelty/abstraction significantly. We use normalized n-gram novelty scores as a metric for determining the level of abstraction. Moreover, we also report rouge scores of our model since most summarization models are evaluated with R-1, R-2, R-L scores.


title: Mass formula and Oort's conjecture for supersingular abelian threefolds

abstract: Using the theory of polarised flag type quotients, we determine mass formulae for all principally polarised supersingular abelian threefolds defined over an algebraically closed field $k$ of characteristic $p$. We combine these results with computations of the automorphism groups to study Oort's conjecture; we prove that every generic three-dimensional principally polarised supersingular abelian variety over $k$ of characteristic $\neq 2$ has automorphism group $\{ \pm 1 \}$.


title: GW170817 and GW190425 as Hybrid Stars of Dark and Nuclear Matters

abstract: We propose three scenarios for compact hybrid stars composed of nuclear and dark matter. These hybrid stars could provide alternative interpretations to the LIGO/Virgo events GW170817 and GW190425. To demonstrate our proposal, we solve the Tolman-Oppenheimer-Volkoff configurations of hybrid stars by using the SLy4, APR4, and SKb equations of state (EoS) for nuclear matter, and an EoS for a bosonic self interacting dark matter (SIDM) proposed by Colpi et al \cite{Colpi:1986ye}. We then obtain their mass-radius and tidal Love number (TLN)-mass relations, and further examine the possible saddle instability of these compact objects by the generalized Bardeen-Thorne-Meltzer (BTM) criteria. Our results show that the hybrid star scenarios are able to explain GW170817 and GW190425. Some hybrid stars can have compact neutron or mixed cores around 10 km while possessing thick dark matter shells, thus they can be more massive than the maximum mass of the typical neutron stars but are electromagnetically detected with about the same size of neutron stars. Reversely, we also infer the dark matter model from the parameter estimation of GW190425. Our proposed hybrid stars can be further tested by the coming LIGO/Virgo O3 events.


title: The DURATIONS randomised trial design: estimation targets, analysis methods and operating characteristics

abstract: Background. Designing trials to reduce treatment duration is important in several therapeutic areas, including TB and antibiotics. We recently proposed a new randomised trial design to overcome some of the limitations of standard two-arm non-inferiority trials. This DURATIONS design involves randomising patients to a number of duration arms, and modelling the so-called duration-response curve. This article investigates the operating characteristics (type-1 and type-2 errors) of different statistical methods of drawing inference from the estimated curve. Methods. Our first estimation target is the shortest duration non-inferior to the control (maximum) duration within a specific risk difference margin. We compare different methods of estimating this quantity, including using model confidence bands, the delta method and bootstrap. We then explore the generalisability of results to estimation targets which focus on absolute event rates, risk ratio and gradient of the curve. Results. We show through simulations that, in most scenarios and for most of the estimation targets, using the bootstrap to estimate variability around the target duration leads to good results for DURATIONS design-appropriate quantities analogous to power and type-1 error. Using model confidence bands is not recommended, while the delta method leads to inflated type-1 error in some scenarios, particularly when the optimal duration is very close to one of the randomised durations. Conclusions. Using the bootstrap to estimate the optimal duration in a DURATIONS design has good operating characteristics in a wide range of scenarios, and can be used with confidence by researchers wishing to design a DURATIONS trial to reduce treatment duration. Uncertainty around several different targets can be estimated with this bootstrap approach.


title: Topological characteristic factors and independence along arithmetic progressions

abstract: Let $\pi: (X,T)\rightarrow (Y,T)$ be a factor map of topological dynamics and $d\in {\mathbb {N}}$. $(Y,T)$ is said to be a $d$-step topological characteristic factor if there exists a dense $G_\delta$ set $X_0$ of $X$ such that for each $x\in X_0$ the orbit closure $\overline{\mathcal O}((x, \ldots,x), T\times T^2\times \ldots \times T^d)$ is $\pi\times \ldots \times \pi$ ($d$ times) saturated. In 1994 Eli Glasner studied the topological characteristic factor for minimal systems. For example, it is shown that for a distal minimal system, its largest distal factor of order $d-1$ is its $d$-step topological characteristic factor. In this paper, we generalize Glasner's work to the product system of finitely many minimal systems and give its relative version. To prove these results, we need to deal with $(X,T^m)$ for $m\in {\mathbb {N}}$. We will study the structure theorem of $(X,T^m)$. We show that though for a minimal system $(X,T)$ and $m\in {\mathbb {N}}$, $(X,T^m)$ may not be minimal, but we still can have PI-tower for $(X,T^m)$ and in fact it looks the same as the PI tower of $(X,T)$. We give some applications of the results developed. For example, we show that if a minimal system has no nontrivial independent pair along arithmetic progressions of order $d$, then up to a canonically defined proximal extension, it is PI of order $d$; if a minimal system $(X,T)$ has a nontrivial $d$-step topological characteristic factor, then there exist ``many'' $\Delta$-transitive sets of order $d$.


title: Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANs

abstract: Generative adversarial networks (GANs) have shown outstanding performance on a wide range of problems in computer vision, graphics, and machine learning, but often require numerous training data and heavy computational resources. To tackle this issue, several methods introduce a transfer learning technique in GAN training. They, however, are either prone to overfitting or limited to learning small distribution shifts. In this paper, we show that simple fine-tuning of GANs with frozen lower layers of the discriminator performs surprisingly well. This simple baseline, FreezeD, significantly outperforms previous techniques used in both unconditional and conditional GANs. We demonstrate the consistent effect using StyleGAN and SNGAN-projection architectures on several datasets of Animal Face, Anime Face, Oxford Flower, CUB-200-2011, and Caltech-256 datasets. The code and results are available at https://github.com/sangwoomo/FreezeD.


title: IRS-aided Large-Scale MIMO Systems with Passive Constant Envelope Precoding

abstract: In this paper, an intelligent reflecting surface (IRS)-aided large-scale MIMO system is investigated in which constant envelope precoding (CEP) is utilized at each base station (BS). It is both cost-effective and energy-efficient to implement CEP in a large-scale antenna array. We aim to optimize the discrete phase shifts at both the BS and the IRS to minimize the sum power of multi-user interference (MUI) in the system via our proposed three algorithms. For the sake of simplicity, a simple single-cell scenario is considered, where the optimization of the BS and IRS phase shifts is solved by a low-complexity trellis-based algorithm. Then, this algorithm is extended to a multi-cell scenario, where the precoding operation in each BS is performed individually. With the aid of stochastic optimization method, a low-overhead trellis-based solution is proposed which has better performance than the first one. Finally, we solve the optimization problem via the semi-definite relaxation (SDR) scheme, to serve as a performance benchmark for the proposed algorithms. Meanwhile, interference and complexity analysis is provided for the proposed algorithms. Numerical results demonstrate that while the performance of the trellis-based algorithms is negligibly lower than that of the continuous-phase SDR-based solution, the computational complexity and the implementation cost of the former is much lower than the latter, which is appealing for practical applications.


title: Graph-based Faulted Line Identification Using Micro-PMU Data in Distribution Systems

abstract: Motivated by increasing penetration of distributed generators (DGs) and fast development of micro-phasor measurement units ({\mu}PMUs), this paper proposes a novel graph-based faulted line identification algorithm using a limited number of {\mu}PMUs in distribution networks. The core of the proposed method is to apply advanced distribution system state estimation (DSSE) techniques integrating {\mu}PMU data to the fault location. We propose a distributed DSSE algorithm to efficiently restrict the searching region for the fault source in the feeder between two adjacent {\mu}PMUs. Based on the graph model of the feeder in the reduced searching region, we further perform the DSSE in a hierarchical structure and identify the location of the fault source. Also, the proposed approach captures the impact of DGs on distribution system operation and remains robust against high-level noises in measurements. Numerical simulations verify the accuracy and efficiency of the proposed method under various fault scenarios covering multiple fault types and fault impedances.


title: Evidence of presolar SiC in the Allende Curious Marie calcium aluminum rich inclusion

abstract: Calcium aluminum rich inclusions (CAIs) are one of the first solids to have condensed in the solar nebula, while presolar grains formed in various evolved stellar environments. It is generally accepted that CAIs formed close to the Sun at temperatures above 1500 K, where presolar grains could not survive, and were then transported to other regions of the nebula where the accretion of planetesimals took place. In this context, a commonly held view is that presolar grains are found solely in the fine-grained rims surrounding chondrules and in the low-temperature fine-grained matrix that binds the various meteoritic components together. Here we demonstrate, based on noble gas isotopic signatures, that presolar SiC have been incorporated into fine-grained CAIs in the Allende carbonaceous chondrite at the time of their formation, and have survived parent body processing. This finding provides new clues on the conditions in the nascent solar system at the condensation of first solids.


title: Maple's Quantum Chemistry Package in the Chemistry Classroom

abstract: An introduction to the Quantum Chemistry Package (QCP), implemented in the computer algebra system Maple, is presented. The QCP combines sophisticated electronic structure methods and Maple's easy-to-use graphical interface to enable computation and visualization of the electronic energies and properties of molecules. Here we describe how the QCP can be used in the chemistry classroom using lessons provided within the package. In particular, the calculation and visualization of molecular orbitals of hydrogen fluoride, the application of the particle in a box to conjugated dyes, the use of geometry optimization and normal mode analysis for hypochlorous acid, and the thermodynamics of combustion of methane.


title: Generalized Heisenberg Ferromagnet type Equation and Modified Camassa-Holm Equation: Geometric Formulation, Soliton Solutions and Equivalence

abstract: We study the integrability and equivalence of a generalized Heisenberg ferromagnet-type equation (GHFE). The different forms of this equation as well as its reduction are presented. The Lax representation (LR) of the equation is obtained. We observe that the geometrical and gauge equivalent counterpart of the GHFE is the modified Camassa-Holm equation (mCHE) with an arbitrary parameter $\kappa$. Finally, the 1-soliton solution of the GHFE is obtained.


title: Dynamic neutron imaging of argon bubble flow in liquid gallium in external magnetic field

abstract: This paper presents detailed results of neutron imaging of argon bubble flows in a rectangular liquid gallium vessel with and without the application of external horizontal magnetic field. The developed image processing algorithm is presented and its capability to extract physical information from images of low signal-to-noise ratio is demonstrated. Bubble parameters, velocity components, trajectories and relevant statistics were computed and analysed. A simpler version of the code was applied to the output of computational fluid dynamics simulations that reproduced the experiment. This work serves to further validate the neutron radiography as a suitable method for monitoring gas bubble flow in liquid metals, as well as to outline procedures that might help others to extract data from neutron radiography images with a low signal-to-noise ratio resulting from high frame rate acquisitions required to resolve rapid bubble motion.


title: Role of Intrinsic Motivation in User Interface Design to Enhance Worker Performance in Amazon MTurk

abstract: Biologists and scientists have been tackling the problem of marine life monitoring and fish stock estimation for many years now. Efforts are now directed to move towards non-intrusive methods, by utilizing specially designed underwater robots to collect images of the marine population. Training machine learning algorithms on the images collected, we can now estimate the population. This in turn helps to impose regulations to control overfishing. To train these models, however, we need annotated images. Annotation of large sets of images collected over a decade is quite challenging. Hence, we resort to Amazon Mechanical Turk (MTurk), a crowdsourcing platform, for the image annotation task. Although it is fast to get work done in MTurk, the work obtained is often of poor quality. This work aims to understand the human factors in designing Human Intelligence Tasks (HITs), from the perspective of the Self-Determination Theory. Applying elements from the theory, we design an HIT to increase the competence and motivation of the workers. Within our experimental framework, we find that the new interface significantly improves the accuracy of worker performance.


title: MGD Dirac stars

abstract: The method of geometric deformation (MGD) is here employed to study compact stellar configurations, which are solutions of the effective Einstein-Dirac coupled field equations on fluid branes. Non-linear, self-interacting, fermionic fields are then employed to derive MGD Dirac stars, whose properties are analyzed and discussed. The MGD Dirac star maximal mass is shown to increase as an specific function of the spinor self-interaction coupling constant, in a realistic model involving the most strict phenomenological current bounds for the brane tension.


title: Weighted PCL over product valuation monoids

abstract: We introduce a weighted propositional configuration logic over a product valuation monoid. Our logic is intended to serve as a specification language for software architectures with quantitative features such as the average of all interactions' costs of the architecture and the maximum cost among all costs occurring most frequently within a specific number of components in an architecture. We provide formulas of our logic which describe well-known architectures equipped with quantitative characteristics. Moreover, we prove an efficient construction of a full normal form which leads to decidability of equivalence of formulas in this logic.


title: Fault Diagnosis in Microelectronics Attachment via Deep Learning Analysis of 3D Laser Scans

abstract: A common source of defects in manufacturing miniature Printed Circuits Boards (PCB) is the attachment of silicon die or other wire bondable components on a Liquid Crystal Polymer (LCP) substrate. Typically, a conductive glue is dispensed prior to attachment with defects caused either by insufficient or excessive glue. The current practice in electronics industry is to examine the deposited glue by a human operator a process that is both time consuming and inefficient especially in preproduction runs where the error rate is high. In this paper we propose a system that automates fault diagnosis by accurately estimating the volume of glue deposits before and even after die attachment. To this end a modular scanning system is deployed that produces high resolution point clouds whereas the actual estimation of glue volume is performed by (R)egression-Net (RNet), a 3D Convolutional Neural Network (3DCNN). RNet outperforms other deep architectures and is able to estimate the volume either directly from the point cloud of a glue deposit or more interestingly after die attachment when only a small part of glue is visible around each die. The entire methodology is evaluated under operational conditions where the proposed system achieves accurate results without delaying the manufacturing process.


title: Uncertainty estimation in equality-constrained MAP and maximum likelihood estimation with applications to system identification and state estimation

abstract: In unconstrained maximum a posteriori (MAP) and maximum likelihood estimation, the inverse of minus the merit-function Hessian matrix is an approximation of the estimate covariance matrix. In the Bayesian context of MAP estimation, it is the covariance of a normal approximation of the posterior around the mode; while in maximum likelihood estimation, it an approximation of the inverse Fisher information matrix, to which the covariance of efficient estimators converge. These measures are routinely used in system identification to evaluate the estimate uncertainties and diagnose problems such as overparametrization, improper excitation and unidentifiability. A wide variety of estimation problems in systems and control, however, can be formulated as equality-constrained optimizations with additional decision variables to exploit parallelism in computer hardware, simplify implementation and increase the convergence basin and efficiency of the nonlinear program solver. The introduction of the extra variables, however, dissociates the inverse Hessian from the covariance matrix. Instead, submatrices of the inverse Hessian of the constrained-problem's Lagrangian must be used. In this paper, we derive these relationships, showing how the estimates' covariance can be estimated directly from the augmented problem. Application examples are shown in system identification with the output-error method and joint state-path and parameter estimation.


title: Non-density of points of small arithmetic degrees

abstract: Given a surjective endomorphism $f: X \to X$ on a projective variety over a number field, one can define the arithmetic degree $\alpha_f(x)$ of $f$ at a point $x$ in $X$. The Kawaguchi - Silverman Conjecture (KSC) predicts that any forward $f$-orbit of a point $x$ in $X$ at which the arithmetic degree $\alpha_f(x)$ is strictly smaller than the first dynamical degree $\delta_f$ of $f$ is not Zariski dense. We extend the KSC to sAND (= small Arithmetic Non-Density) Conjecture that the locus $Z_f(d)$ of all points of small arithmetic degree is not Zariski dense, and verify this sAND Conjecture for endomorphisms on projective varieties including surfaces, HyperK\"ahler varieties, abelian varieties, Mori dream spaces, simply connected smooth varieties admitting int-amplified endomorphisms, smooth threefolds admitting int-amplified endomorphisms, and some fibre spaces. We show the equivalence of the sAND Conjecture and another conjecture on the periodic subvarieties of small dynamical degree; we also show the close relations between the sAND Conjecture and the Uniform Boundedness Conjecture of Morton and Silverman on endomorphisms of projective spaces and another long standing conjecture on Uniform Boundedness of torsion points in abelian varieties.


title: The importance of substrates for the visibility of "dark" plasmonic modes

abstract: Dark plasmonic modes have interesting properties, such as a longer lifetime and a narrower linewidth than their radiative counterpart, as well as little to no radiative losses. However, they have not been extensively studied yet due to their optical inaccessibility. Using electron-energy loss (EEL) and cathodoluminescence (CL) spectroscopy, the dark radial breathing modes (RBMs) in thin, monochrystalline gold nanodisks are systematically investigated in this work. It is found that the RBMs can be detected in a CL set-up despite only collecting the far-field. Their visibility in CL is attributed to the breaking of the mirror symmetry by the high-index substrate, creating an effective dipole moment. The outcoupling into the far-field is demonstrated to be enhanced by a factor of 4 by increasing the thickness of the supporting SiN membrane from 5 to 50 nm due to the increased net electric dipole moment in the substrate. Furthermore, it is shown that the resonance energy of RBMs can be easily tuned by varying the diameter of the nanodisk, making them promising candidates for nanophotonic applications.


title: A practical guide to Prabhakar fractional calculus

abstract: The Mittag-Leffler function is universally acclaimed as the Queen function of fractional calculus. The aim of this work is to survey the key results and applications emerging from the three-parameter generalization of this function, known as the Prabhakar function. Specifically, after reviewing key historical events that led to the discovery and modern development of this peculiar function, we discuss how the latter allows one to introduce an enhanced scheme for fractional calculus. Then, we summarize the progress in the application of this new general framework to physics and renewal processes. We also provide a collection of results on the numerical evaluation of the Prabhakar function.


title: MagnifierNet: Towards Semantic Adversary and Fusion for Person Re-identification

abstract: Although person re-identification (ReID) has achieved significant improvement recently by enforcing part alignment, it is still a challenging task when it comes to distinguishing visually similar identities or identifying the occluded person. In these scenarios, magnifying details in each part features and selectively fusing them together may provide a feasible solution. In this work, we propose MagnifierNet, a triple-branch network which accurately mines details from whole to parts. Firstly, the holistic salient features are encoded by a global branch. Secondly, to enhance detailed representation for each semantic region, the "Semantic Adversarial Branch" is designed to learn from dynamically generated semantic-occluded samples during training. Meanwhile, we introduce "Semantic Fusion Branch" to filter out irrelevant noises by selectively fusing semantic region information sequentially. To further improve feature diversity, we introduce a novel loss function "Semantic Diversity Loss" to remove redundant overlaps across learned semantic representations. State-of-the-art performance has been achieved on three benchmarks by large margins. Specifically, the mAP score is improved by 6% and 5% on the most challenging CUHK03-L and CUHK03-D benchmarks.


title: On structures induced by the power sequences of $($\mathbb{Z}/ m\mathbb{Z}$, \cdot)$

abstract: In this paper, we explore the structure of $\mathbb{Z}/ m\mathbb{Z}$ in terms of its orbits under modular exponentiation, illustrating this with a sequential power graph that is naturally derived from the orbits by connecting elements of $\mathbb{Z}/ m\mathbb{Z}$ in the orbit order in which they appear. We find that this graph has a great deal of fascinating algebraic structure. The connected components are composed of orbits that all share at least one element. The vertex sets of the connected components are shown to depend on the factorization of $m$; in fact, the connected components are completely determined by the units of $\mathbb{Z}/ m\mathbb{Z}$, the idempotents of $\mathbb{Z}/ m\mathbb{Z}$ and the square-free divisors of $m$. Both tails and non-tails of the components can be described explicitly and algebraically in terms of these elements of $\mathbb{Z}/ m\mathbb{Z}$. Finally, a lattice of components can be used to show homomorphisms between the non-tails of any two comparable components in the lattice. This extensive structure is used here to prove an algebraic identity on the roots of an idempotent mod $m$, and may be exploited to prove other identities as well.


title: AutoFoley: Artificial Synthesis of Synchronized Sound Tracks for Silent Videos with Deep Learning

abstract: In movie productions, the Foley Artist is responsible for creating an overlay soundtrack that helps the movie come alive for the audience. This requires the artist to first identify the sounds that will enhance the experience for the listener thereby reinforcing the Directors's intention for a given scene. In this paper, we present AutoFoley, a fully-automated deep learning tool that can be used to synthesize a representative audio track for videos. AutoFoley can be used in the applications where there is either no corresponding audio file associated with the video or in cases where there is a need to identify critical scenarios and provide a synthesized, reinforced soundtrack. An important performance criterion of the synthesized soundtrack is to be time-synchronized with the input video, which provides for a realistic and believable portrayal of the synthesized sound. Unlike existing sound prediction and generation architectures, our algorithm is capable of precise recognition of actions as well as inter-frame relations in fast moving video clips by incorporating an interpolation technique and Temporal Relationship Networks (TRN). We employ a robust multi-scale Recurrent Neural Network (RNN) associated with a Convolutional Neural Network (CNN) for a better understanding of the intricate input-to-output associations over time. To evaluate AutoFoley, we create and introduce a large scale audio-video dataset containing a variety of sounds frequently used as Foley effects in movies. Our experiments show that the synthesized sounds are realistically portrayed with accurate temporal synchronization of the associated visual inputs. Human qualitative testing of AutoFoley show over 73% of the test subjects considered the generated soundtrack as original, which is a noteworthy improvement in cross-modal research in sound synthesis.


title: Random horizon principal-agent problems

abstract: We consider a general formulation of the random horizon Principal-Agent problem with a continuous payment and a lump-sum payment at termination. In the European version of the problem, the random horizon is chosen solely by the principal with no other possible action from the agent than exerting effort on the dynamics of the output process. We also consider the American version of the contract, which covers the seminal Sannikov's model, where the agent can also quit by optimally choosing the termination time of the contract. Our main result reduces such non-zero-sum stochastic differential games to appropriate stochastic control problems which may be solved by standard methods of stochastic control theory. This reduction is obtained by following Sannikov's approach, further developed by Cvitanic, Possamai, and Touzi. We first introduce an appropriate class of contracts for which the agent's optimal effort is immediately characterized by the standard verification argument in stochastic control theory. We then show that this class of contracts is dense in an appropriate sense so that the optimization over this restricted family of contracts represents no loss of generality. The result is obtained by using the recent well-posedness result of random horizon second-order backward SDE.


title: Updates and New Results in Models with Reduced Couplings

abstract: The idea of reduction of couplings consists in searching for renormalization group invariant relations between parameters of a renormalizable theory that hold to all orders of perturbation theory. Based on the principle of the reduction of couplings, one can construct Finite Unified Theories (FUTs) which are $N=1$ supersymmetric Grand Unified Theories that can be made all-order finite. The prediction of the top quark mass well in advance of its experimental discovery and the prediction of the light Higgs boson mass in the range $\sim 121-126$ GeV much earlier than its experimental discovery are among the celebrated successes of such models. Here, after a brief review of the reduction of couplings method and the properties of the resulting finiteness in supersymmetric theories, we analyse four phenomenologically favoured models: a minimal version of the $N=1$ $SU(5)$, a finite $N=1$ $SU(5)$, a $N=1$ finite $SU(3)\otimes SU(3)\otimes SU(3)$ model and a reduced version of the Minimal Supersymmetric Standard Model (MSSM). A relevant update in the phenomenological evaluation has been the improved light Higgs-boson mass prediction as provided by the latest version of $\texttt{FeynHiggs}$. All four models predict relatively heavy supersymmetric spectra that start just below or above the TeV scale, consistent with the non-observation LHC results. Depending on the model, the lighter regions of the spectra could be accessible at CLIC, while the FCC-hh will be able to test large parts of predicted spectrum of each model. The lightest supersymmetric particle (LSP), which is a neutralino, is considered as a cold dark matter candidate and put to test using the latest $\texttt{MicrOMEGAs}$ code.


title: Helicity, low-dimensional distributed chaos and scaling in MHD turbulence

abstract: It is shown that the second-order moment of helicity distribution (the Levich-Tsinober invariant of inviscid hydrodynamics) can be preserved as an adiabatic invariant in magnetohydrodynamics. The distributed chaos approach and inertial range phenomenology have been developed for the magnetohydrodynamic processes dominated by this adiabatic invariant, and some consequences of the theoretical consideration have been compared with results of direct numerical simulations and measurements in the solar wind. Helical scaling in interstellar MHD turbulence has been also briefly discussed in this context.


title: Investigation of the magnetic ground state of the ordered double perovskite Sr2YbRuO6: a tale of two transitions

abstract: Comprehensive muon spin rotation/relaxation (muSR) and neutron powder diffraction (NPD) studies supported via bulk measurements have been performed on the ordered double perovskite Sr2YbRuO6 to investigate the nature of the magnetic ground state. Two sharp transitions at TN1 ~ 42 K and TN2 ~ 36 K have been observed in the static and dynamic magnetization measurements, coinciding with the heat capacity data. In order to confirm the origin of the observed phase transitions and the magnetic ground state, microscopic evidences are presented here. An initial indication of long-range magnetic ordering comes from a sharp drop in the muon initial asymmetry and a peak in the relaxation rate near TN1. NPD confirms that the magnetic ground state of Sr2YbRuO6 consists of an antiferromagnetic (AFM) structure with interpenetrating lattices of parallel Yb3+ and Ru5+ moments lying in the ab-plane and adopting a A-type AFM structure. Intriguingly, a small but remarkable change is observed in the long-range ordering parameters at TN2 confirming the presence of a weak spin reorientation (i.e. change in spin configuration) transition of Ru and Yb moments, as well as a change in the magnetic moment evolution of the Yb3+ spins at TN2. The temperature dependent behaviour of the Yb3+ and Ru5+ moments suggests that the 4d-electrons of Ru5+ play a dominating role in stabilizing the long range ordered magnetic ground state in the double perovskite Sr2YbRuO6 whereas only the Yb3+ moments show an arrest at TN2. The observed magnetic structure and the presence of a ferromagnetic interaction between Ru- and Yb- ions are explained with use of the Goodenough-Kanamori-Anderson (GKA) rules. Possible reasons for the presence of the second magnetic phase transition and of a compensation point in the magnetization data are linked to competing mechanisms of magnetic anisotropy.


title: A Deep Learning Framework for Simulation and Defect Prediction Applied in Microelectronics

abstract: The prediction of upcoming events in industrial processes has been a long-standing research goal since it enables optimization of manufacturing parameters, planning of equipment maintenance and more importantly prediction and eventually prevention of defects. While existing approaches have accomplished substantial progress, they are mostly limited to processing of one dimensional signals or require parameter tuning to model environmental parameters. In this paper, we propose an alternative approach based on deep neural networks that simulates changes in the 3D structure of a monitored object in a batch based on previous 3D measurements. In particular, we propose an architecture based on 3D Convolutional Neural Networks (3DCNN) in order to model the geometric variations in manufacturing parameters and predict upcoming events related to sub-optimal performance. We validate our framework on a microelectronics use-case using the recently published PCB scans dataset where we simulate changes on the shape and volume of glue deposited on an Liquid Crystal Polymer (LCP) substrate before the attachment of integrated circuits (IC). Experimental evaluation examines the impact of different choices in the cost function during training and shows that the proposed method can be efficiently used for defect prediction.


title: A note on semiorthogonal decompositions for Fano fibrations

abstract: Fano fibrations arise naturally in the birational classification of algebraic varieties. We show that these morphisms always induce a semiorthogonal decomposition on the derived category of the fibred space, extending classic results such as Orlov's projective bundle formula to the non-flat and singular case.


title: An LSTM Based Architecture to Relate Speech Stimulus to EEG

abstract: Modeling the relationship between natural speech and a recorded electroencephalogram (EEG) helps us understand how the brain processes speech and has various applications in neuroscience and brain-computer interfaces. In this context, so far mainly linear models have been used. However, the decoding performance of the linear model is limited due to the complex and highly non-linear nature of the auditory processing in the human brain. We present a novel Long Short-Term Memory (LSTM)-based architecture as a non-linear model for the classification problem of whether a given pair of (EEG, speech envelope) correspond to each other or not. The model maps short segments of the EEG and the envelope to a common embedding space using a CNN in the EEG path and an LSTM in the speech path. The latter also compensates for the brain response delay. In addition, we use transfer learning to fine-tune the model for each subject. The mean classification accuracy of the proposed model reaches 85%, which is significantly higher than that of a state of the art Convolutional Neural Network (CNN)-based model (73%) and the linear model (69%).


title: Linear response theory and entropic fluctuations in repeated interaction quantum systems

abstract: We study Linear Response Theory and Entropic Fluctuations of finite dimensional non-equilibrium repeated interaction systems (RIS). More precisely, in a situation where the temperatures of the probes can take a finite number of different values, we prove analogs of the Green-Kubo fluctuation-dissipation formula and Onsager reciprocity relations on energy flux observables. Then we prove a Large Deviation Principle, or Fluctuation Theorem, and a Central Limit Theorem on the full counting statistics of entropy fluxes. We consider two types of non-equilibrium RIS: either the temperatures of the probes are deterministic and arrive in a cyclic way, or the temperatures of the probes are described by a sequence of i.i.d. random variables with uniform distribution over a finite set.


title: G-Learner and GIRL: Goal Based Wealth Management with Reinforcement Learning

abstract: We present a reinforcement learning approach to goal based wealth management problems such as optimization of retirement plans or target dated funds. In such problems, an investor seeks to achieve a financial goal by making periodic investments in the portfolio while being employed, and periodically draws from the account when in retirement, in addition to the ability to re-balance the portfolio by selling and buying different assets (e.g. stocks). Instead of relying on a utility of consumption, we present G-Learner: a reinforcement learning algorithm that operates with explicitly defined one-step rewards, does not assume a data generation process, and is suitable for noisy data. Our approach is based on G-learning - a probabilistic extension of the Q-learning method of reinforcement learning. In this paper, we demonstrate how G-learning, when applied to a quadratic reward and Gaussian reference policy, gives an entropy-regulated Linear Quadratic Regulator (LQR). This critical insight provides a novel and computationally tractable tool for wealth management tasks which scales to high dimensional portfolios. In addition to the solution of the direct problem of G-learning, we also present a new algorithm, GIRL, that extends our goal-based G-learning approach to the setting of Inverse Reinforcement Learning (IRL) where rewards collected by the agent are not observed, and should instead be inferred. We demonstrate that GIRL can successfully learn the reward parameters of a G-Learner agent and thus imitate its behavior. Finally, we discuss potential applications of the G-Learner and GIRL algorithms for wealth management and robo-advising.


title: GPU-Acceleration of the ELPA2 Distributed Eigensolver for Dense Symmetric and Hermitian Eigenproblems

abstract: The solution of eigenproblems is often a key computational bottleneck that limits the tractable system size of numerical algorithms, among them electronic structure theory in chemistry and in condensed matter physics. Large eigenproblems can easily exceed the capacity of a single compute node, thus must be solved on distributed-memory parallel computers. We here present GPU-oriented optimizations of the ELPA two-stage tridiagonalization eigensolver (ELPA2). On top of cuBLAS-based GPU offloading, we add a CUDA kernel to speed up the back-transformation of eigenvectors, which can be the computationally most expensive part of the two-stage tridiagonalization algorithm. We benchmark the performance of this GPU-accelerated eigensolver on two hybrid CPU-GPU architectures, namely a compute cluster based on Intel Xeon Gold CPUs and NVIDIA Volta GPUs, and the Summit supercomputer based on IBM POWER9 CPUs and NVIDIA Volta GPUs. Consistent with previous benchmarks on CPU-only architectures, the GPU-accelerated two-stage solver exhibits a parallel performance superior to the one-stage counterpart. Finally, we demonstrate the performance of the GPU-accelerated eigensolver developed in this work for routine semi-local KS-DFT calculations comprising thousands of atoms.


title: Migration Networks: Applications of Network Analysis to Macroscale Migration Patterns

abstract: An emerging area of research is the study of macroscale migration patterns as a network of nodes that represent places (e.g., countries, cities, and rural areas) and edges that encode migration ties that connect those places. In this chapter, we first review advances in the study of migration networks and recent work that has employed network analysis to examine such networks at different geographical scales. In our discussion, we focus in particular on global scale migration networks. We then propose ways to leverage network analysis in concert with digital technologies and online geolocated data to examine the structure and dynamics of migration networks. The implementation of such approaches for studying migration networks faces many challenges, including ethical ones, methodological ones, socio-technological ones (e.g., data availability and reuse), and research reproducibility. We detail these challenges, and we then consider possible ways of linking digital geolocated data to administrative and survey data as a way of harnessing new technologies to construct increasingly realistic migration networks (e.g., using multiplex networks). We also briefly discuss new methods (e.g., multilayer network analysis) in network analysis and adjacent fields (e.g., machine learning) that can help advance understanding of macroscale patterns of migration.


title: Renormalization Scale Setting for Heavy Quark Pair Production in $e^+e^-$ Annihilation near the Threshold Region

abstract: Heavy fermion pair production in $e^+e^-$ annihilation is a fundamental process in hadron physics and is of considerable interest for various phenomena. In this paper, we will apply the Principle of Maximum Conformality (PMC) to provide a comprehensive analysis of these processes. The PMC provides a systematic, unambiguous method for determining the renormalization scales of the QCD coupling constant for single-scale and multiple-scale applications. The resulting predictions eliminate any renormalization scheme-and-scale ambiguities, eliminate the factorial renormalon divergences, and are consistent with the requirements of the renormalization group. It is remarkable that two distinctly different scales are determined by using the PMC for heavy fermion pair production near the threshold region. One scale is the order of the fermion mass $m_f$, which enters the hard virtual corrections, and the other scale is of order $ v\,m_f$, where $v$ is the quark velocity, which enters the Coulomb rescattering amplitude. The PMC scales yield the correct physical behavior and reflect the virtuality of the propagating gluons (photons) for the QCD (QED) processes. Moreover, we demonstrate the consistency of PMC scale setting from QCD to QED. Perfect agreement between the Abelian unambiguous Gell-Mann-Low and the PMC scale-setting methods in the limit of zero number of colors is demonstrated.


title: Recalibrating 3D ConvNets with Project & Excite

abstract: Fully Convolutional Neural Networks (F-CNNs) achieve state-of-the-art performance for segmentation tasks in computer vision and medical imaging. Recently, computational blocks termed squeeze and excitation (SE) have been introduced to recalibrate F-CNN feature maps both channel- and spatial-wise, boosting segmentation performance while only minimally increasing the model complexity. So far, the development of SE blocks has focused on 2D architectures. For volumetric medical images, however, 3D F-CNNs are a natural choice. In this article, we extend existing 2D recalibration methods to 3D and propose a generic compress-process-recalibrate pipeline for easy comparison of such blocks. We further introduce Project & Excite (PE) modules, customized for 3D networks. In contrast to existing modules, Project \& Excite does not perform global average pooling but compresses feature maps along different spatial dimensions of the tensor separately to retain more spatial information that is subsequently used in the excitation step. We evaluate the modules on two challenging tasks, whole-brain segmentation of MRI scans and whole-body segmentation of CT scans. We demonstrate that PE modules can be easily integrated into 3D F-CNNs, boosting performance up to 0.3 in Dice Score and outperforming 3D extensions of other recalibration blocks, while only marginally increasing the model complexity. Our code is publicly available on https://github.com/ai-med/squeeze_and_excitation .


title: Classification of smooth factorial affine surfaces of Kodaira dimension zero with trivial units

abstract: We give a corrected statement of the theorem of Gurjar and Miyanishi, which classifies smooth affine surfaces of Kodaira dimension zero, whose coordinate ring is factorial and has trivial units. Denote the class of such surfaces by $\mathcal{S}_{0}$. An infinite series of surfaces in $\mathcal{S}_{0}$, not listed by Gurjar and Miyanishi, was recently obtained by Freudenburg, Kojima and Nagamine as affine modifications of the plane. We complete their list to a series containing arbitrarily high-dimensional families of pairwise non-isomorphic surfaces in $\mathcal{S}_{0}$. Moreover, we classify them up to a diffeomorphism, showing that each occurs as an interior of a 4-manifold whose boundary is an exceptional surgery on a 2-bridge knot. In particular, we show that $\mathcal{S}_{0}$ contains countably many pairwise non-homeomorphic surfaces.


title: Shear thickening and jamming of dense suspensions: the "roll" of friction

abstract: Particle-based simulations of discontinuous shear thickening (DST) and shear jamming (SJ) suspensions are used to study the role of stress-activated constraints, with an emphasis on resistance to gear-like rolling. Rolling friction decreases the volume fraction required for DST and SJ, in quantitative agreement with real-life suspensions with adhesive surface chemistries and "rough" particle shapes. It sets a distinct structure of the frictional force network compared to only sliding friction, and from a dynamical perspective leads to an increase in the velocity correlation length, in part responsible for the increased viscosity. The physics of rolling friction is thus a key element in achieving a comprehensive understanding of strongly shear-thickening materials.


title: Continuous-time multi-state capture-recapture models

abstract: Multi-state capture-recapture data comprise individual-specific sighting histories together with information on individuals' states related, for example, to breeding status, infection level, or geographical location. Such data are often analysed using the Arnason-Schwarz model, where transitions between states are modelled using a discrete-time Markov chain, making the model most easily applicable to regular time series. When time intervals between capture occasions are not of equal length, more complex time-dependent constructions may be required, increasing the number of parameters to estimate, decreasing interpretability, and potentially leading to reduced precision. Here we develop a novel continuous-time multi-state model that can be regarded as an analogue of the Arnason-Schwarz model for irregularly sampled data. Statistical inference is carried out by regarding the capture-recapture data as realisations from a continuous-time hidden Markov model, which allows the associated efficient algorithms to be used for maximum likelihood estimation and state decoding. To illustrate the feasibility of the modelling framework, we use a long-term survey of bottlenose dolphins where capture occasion are not regularly spaced through time. Here we are particularly interested in seasonal effects on the movement rates of the dolphins along the Scottish east coast. The results reveal seasonal movement patterns between two core areas of their range, providing information that will inform conservation management.


title: A Visual Analytics System for Multi-model Comparison on Clinical Data Predictions

abstract: There is a growing trend of applying machine learning methods to medical datasets in order to predict patients' future status. Although some of these methods achieve high performance, challenges still exist in comparing and evaluating different models through their interpretable information. Such analytics can help clinicians improve evidence-based medical decision making. In this work, we develop a visual analytics system that compares multiple models' prediction criteria and evaluates their consistency. With our system, users can generate knowledge on different models' inner criteria and how confidently we can rely on each model's prediction for a certain patient. Through a case study of a publicly available clinical dataset, we demonstrate the effectiveness of our visual analytics system to assist clinicians and researchers in comparing and quantitatively evaluating different machine learning methods.


title: Non-Gaussian Chance-Constrained Trajectory Planning for Autonomous Vehicles under Agent Uncertainty

abstract: Agent behavior is arguably the greatest source of uncertainty in trajectory planning for autonomous vehicles. This problem has motivated significant amounts of work in the behavior prediction community on learning rich distributions of the future states and actions of agents. However, most current works on chance-constrained trajectory planning under agent or obstacle uncertainty either assume Gaussian uncertainty or linear constraints, which is limiting, or requires sampling, which can be computationally intractable to encode in an optimization problem. In this paper, we extend the state-of-the-art by presenting a methodology to upper-bound chance-constraints defined by polynomials and mixture models with potentially non-Gaussian components. Our method achieves its generality by using statistical moments of the distributions in concentration inequalities to upper-bound the probability of constraint violation. With this method, optimization-based trajectory planners can plan trajectories that are chance-constrained with respect to a wide range of distributions representing predictions of agent future positions. In experiments, we show that the resulting optimization problem can be solved with state-of-the-art nonlinear program solvers to plan trajectories fast enough for use online.


title: Distributed Ledger for Provenance Tracking of Artificial Intelligence Assets

abstract: High availability of data is responsible for the current trends in Artificial Intelligence (AI) and Machine Learning (ML). However, high-grade datasets are reluctantly shared between actors because of lacking trust and fear of losing control. Provenance tracing systems are a possible measure to build trust by improving transparency. Especially the tracing of AI assets along complete AI value chains bears various challenges such as trust, privacy, confidentiality, traceability, and fair remuneration. In this paper we design a graph-based provenance model for AI assets and their relations within an AI value chain. Moreover, we propose a protocol to exchange AI assets securely to selected parties. The provenance model and exchange protocol are then combined and implemented as a smart contract on a permission-less blockchain. We show how the smart contract enables the tracing of AI assets in an existing industry use case while solving all challenges. Consequently, our smart contract helps to increase traceability and transparency, encourages trust between actors and thus fosters collaboration between them.


title: An improved Trudinger-Moser inequality involving N-Finsler-Laplacian and L^p norm

abstract: Suppose $F: \mathbb{R}^{N} \rightarrow [0, +\infty)$ be a convex function of class $C^{2}(\mathbb{R}^{N} \backslash \{0\})$ which is even and positively homogeneous of degree 1. We denote $\gamma_1=\inf\limits_{u\in W^{1, N}_{0}(\Omega)\backslash \{0\}}\frac{\int_{\Omega}F^{N}(\nabla u)dx}{\| u\|_p^N},$ and define the norm $\|u\|_{N,F,\gamma, p}=\bigg(\int_{\Omega}F^{N}(\nabla u)dx-\gamma\| u\|_p^N\bigg)^{\frac{1}{N}}.$ Let $\Omega\subset \mathbb{R}^{N}(N\geq 2)$ be a smooth bounded domain. Then for $p> 1$ and $0\leq \gamma <\gamma_1$, we have $$ \sup_{u\in W^{1, N}_{0}(\Omega), \|u\|_{N,F,\gamma, p}\leq 1}\int_{\Omega}e^{\lambda |u|^{\frac{N}{N-1}}}dx<+\infty, $$ where $0<\lambda \leq \lambda_{N}=N^{\frac{N}{N-1}} \kappa_{N}^{\frac{1}{N-1}}$ and $\kappa_{N}$ is the volume of a unit Wulff ball. Moreover, by using blow-up analysis and capacity technique, we prove that the supremum can be attained for any $0 \leq\gamma <\gamma_1$.


title: Turning 30: New Ideas in Inductive Logic Programming

abstract: Common criticisms of state-of-the-art machine learning include poor generalisation, a lack of interpretability, and a need for large amounts of training data. We survey recent work in inductive logic programming (ILP), a form of machine learning that induces logic programs from data, which has shown promise at addressing these limitations. We focus on new methods for learning recursive programs that generalise from few examples, a shift from using hand-crafted background knowledge to \emph{learning} background knowledge, and the use of different technologies, notably answer set programming and neural networks. As ILP approaches 30, we also discuss directions for future research.


title: Atomic Precision Advanced Manufacturing for Digital Electronics

abstract: An exponential increase in the performance of silicon microelectronics and the demand to manufacture in great volumes has created an ecosystem that requires increasingly complex tools to fabricate and characterize the next generation of chips. However, the cost to develop and produce the next generation of these tools has also risen exponentially, to the point where the risk associated with progressing to smaller feature sizes has created pain points throughout the ecosystem. The present challenge includes shrinking the smallest features from nanometers to atoms (10 nm corresponds to 30 silicon atoms). Relaxing the requirement for achieving scalable manufacturing creates the opportunity to evaluate ideas not one or two generations into the future, but at the absolute physical limit of atoms themselves. This article describes recent advances in atomic precision advanced manufacturing (APAM) that open the possibility of exploring opportunities in digital electronics. Doing so will require advancing the complexity of APAM devices and integrating APAM with CMOS.


title: Language-Independent Tokenisation Rivals Language-Specific Tokenisation for Word Similarity Prediction

abstract: Language-independent tokenisation (LIT) methods that do not require labelled language resources or lexicons have recently gained popularity because of their applicability in resource-poor languages. Moreover, they compactly represent a language using a fixed size vocabulary and can efficiently handle unseen or rare words. On the other hand, language-specific tokenisation (LST) methods have a long and established history, and are developed using carefully created lexicons and training resources. Unlike subtokens produced by LIT methods, LST methods produce valid morphological subwords. Despite the contrasting trade-offs between LIT vs. LST methods, their performance on downstream NLP tasks remain unclear. In this paper, we empirically compare the two approaches using semantic similarity measurement as an evaluation task across a diverse set of languages. Our experimental results covering eight languages show that LST consistently outperforms LIT when the vocabulary size is large, but LIT can produce comparable or better results than LST in many languages with comparatively smaller (i.e. less than 100K words) vocabulary sizes, encouraging the use of LIT when language-specific resources are unavailable, incomplete or a smaller model is required. Moreover, we find that smoothed inverse frequency (SIF) to be an accurate method to create word embeddings from subword embeddings for multilingual semantic similarity prediction tasks. Further analysis of the nearest neighbours of tokens show that semantically and syntactically related tokens are closely embedded in subword embedding spaces


title: Adaptive Distributed Stochastic Gradient Descent for Minimizing Delay in the Presence of Stragglers

abstract: We consider the setting where a master wants to run a distributed stochastic gradient descent (SGD) algorithm on $n$ workers each having a subset of the data. Distributed SGD may suffer from the effect of stragglers, i.e., slow or unresponsive workers who cause delays. One solution studied in the literature is to wait at each iteration for the responses of the fastest $k<n$ workers before updating the model, where $k$ is a fixed parameter. The choice of the value of $k$ presents a trade-off between the runtime (i.e., convergence rate) of SGD and the error of the model. Towards optimizing the error-runtime trade-off, we investigate distributed SGD with adaptive $k$. We first design an adaptive policy for varying $k$ that optimizes this trade-off based on an upper bound on the error as a function of the wall-clock time which we derive. Then, we propose an algorithm for adaptive distributed SGD that is based on a statistical heuristic. We implement our algorithm and provide numerical simulations which confirm our intuition and theoretical analysis.


title: Transient chaotic dimensionality expansion by recurrent networks

abstract: Neurons in the brain communicate with spikes, which are discrete events in time and value. Functional network models often employ rate units that are continuously coupled by analog signals. Is there a qualitative difference implied by these two forms of signaling? We develop a unified mean-field theory for large random networks to show that first- and second-order statistics in rate and binary networks are in fact identical if rate neurons receive the right amount of noise. Their response to presented stimuli, however, can be radically different. We quantify these differences by studying how nearby state trajectories evolve over time, asking to what extent the dynamics is chaotic. Chaos in the two models is found to be qualitatively different. In binary networks we find a network-size-dependent transition to chaos and a chaotic submanifold whose dimensionality expands stereotypically with time, while rate networks with matched statistics are nonchaotic. Dimensionality expansion in chaotic binary networks aids classification in reservoir computing and optimal performance is reached within about a single activation per neuron; a fast mechanism for computation that we demonstrate also in spiking networks. A generalization of this mechanism extends to rate networks in their respective chaotic regimes.


title: Sharp large deviations for hyperbolic flows

abstract: For hyperbolic flows $\varphi_t$ we examine the Gibbs measure of points $w$ for which $$\int_0^T G(\varphi_t w) dt - a T \in (- e^{-\epsilon n}, e^{- \epsilon n})$$ as $n \to \infty$ and $T \geq n$, provided $\epsilon > 0$ is sufficiently small. This is similar to local central limit theorems. The fact that the interval $(- e^{-\epsilon n}, e^{- \epsilon n})$ is exponentially shrinking as $n \to \infty$ leads to several difficulties. Under some geometric assumptions we establish a sharp large deviation result with leading term $C(a) \epsilon_n e^{\gamma(a) T}$ and rate function $\gamma(a) \leq 0.$ The proof is based on the spectral estimates for the iterations of the Ruelle operators with two complex parameters and on a new Tauberian theorem for sequence of functions $g_n(t)$ having an asymptotic as $ n \to \infty$ and $t \geq n.$


title: Towards Scalable Bosonic Quantum Error Correction

abstract: We review some of the recent efforts in devising and engineering bosonic qubits for superconducting devices, with emphasis on the Gottesman-Kitaev-Preskill (GKP) qubit. We present some new results on decoding repeated GKP error correction using finitely-squeezed GKP ancilla qubits, exhibiting differences with previously studied stochastic error models. We discuss circuit-QED ways to realize CZ gates between GKP qubits and we discuss different scenario's for using GKP and regular qubits as building blocks in a scalable superconducting surface code architecture.


title: An X-ray activity cycle on the young solar-like star $\epsilon \ \rm Eridani$

abstract: In 2015 we started the XMM-Newton monitoring of the young solar-like star Epsilon Eridani (440 Myr), one of the youngest solar-like stars with a known chromospheric CaII cycle. By analyzing the most recent Mount Wilson S-index CaII data of this star, we found that the chromospheric cycle lasts 2.92 +/- 0.02 yr, in agreement with past results. From the long-term X-ray lightcurve, we find clear and systematic X-ray variability of our target, consistent with the chromospheric CaII cycle. The average X-ray luminosity results to be 2 x 10^28 erg/s, with an amplitude that is only a factor 2 throughout the cycle. We apply a new method to describe the evolution of the coronal emission measure distribution of Epsilon Eridani in terms of solar magnetic structures: active regions, cores of active regions and flares covering the stellar surface at varying filling fractions. Combinations of these magnetic structures can describe the observed X-ray emission measure of Epsilon Eridani only if the solar flare emission measure distribution is restricted to events in the decay phase. The interpretation is that flares in the corona of Epsilon Eridani last longer than their solar counterparts. We ascribe this to the lower metallicity of Epsilon Eridani. Our analysis revealed also that the X-ray cycle of Epsilon Eridani is strongly dominated by cores of active regions. The coverage fraction of cores throughout the cycle changes by the same factor as the X-ray luminosity. The maxima of the cycle are characterized by a high percentage of covering fraction of the flares, consistent with the fact that flaring events are seen in the corresponding short-term X-ray lightcurves predominately at the cycle maxima. The high X-ray emission throughout the cycle of Epsilon Eridani is thus explained by the high percentage of magnetic structures on its surface.


title: Bigness of the tangent bundle of del Pezzo surfaces and $D$-simplicity

abstract: We consider the question of simplicity of a ring $R$ under the action of its ring of differential operators $D_R$. We give examples to show that even when $R$ is Gorenstein and has rational singularities $R$ need not be a simple $D_R$-module; for example, this is the case when $R$ is the homogeneous coordinate ring of a smooth cubic surface. Our examples are homogeneous coordinate rings of smooth Fano varieties, and our proof proceeds by showing that the tangent bundle of such a variety need not be big. We also give a partial converse showing that when $R$ is the homogeneous coordinate ring of a smooth projective variety $X$, embedded by some multiple of its canonical divisor, then simplicity of $R$ as a $D_R$-module implies that $X$ is Fano and thus $R$ has rational singularities.


title: A Taxonomy of Data Attacks in Power Systems

abstract: In a macro-economic system, all major sectors: agriculture, extraction of natural resources, manufacturing, construction, transport, communication and health services, are dependent on a reliable supply of electricity. Targeted attacks on power networks can lead to disruption in operations, causing significant economic and social losses. When cyber networks in power system are compromised, time-critical data can be dropped and modified, which can impede real time operations and decision making. This paper tracks the progress of research in power system cyber security over the last decade and presents a taxonomy of data attacks. Nineteen different attack models against major operation and control blocks are classified into four areas: steady state control, transient and auxiliary control, substation control and load control. For each class, a comprehensive review of mathematical attack models is presented. The goal is to provide a theoretically balanced approach to cyber attacks and their impacts on the reliable functioning of the electric grid.


title: Duality for compact group actions on operator algebras and applications: irreducible inclusions and Galois correspondence

abstract: We consider compact group actions on C*- and W*- algebras. We prove results that relate the duality property of the action (as defined in the Introduction) with other relevant properties of the system such as the relative commutant of the fixed point algebras being trivial (called the irreducibility of the inclusion) and also to the Galois correspondence between invariant C*-subalgebras containing the fixed point algebra and the class of closed normal subgroups of the compact group.


title: On the propensity of Asn-Gly-containing heptapeptides to form $\beta$-turn structures : comparison between ab initio quantum mechanical calculations and Molecular Dynamics simulations

abstract: Both molecular mechanical and quantum mechanical calculations play an important role in describing the behavior and structure of molecules. In this work, we compare for the same peptide systems the results obtained from folding molecular dynamics simulations with previously reported results from quantum mechanical calculations. More specifically, three molecular dynamics simulations of 5 $\mu$s each in explicit water solvent were carried out for three Asn-Gly-containing heptapeptides, in order to study their folding and dynamics. Previous data, based on quantum mechanical calculations and the DFT methods have shown that these peptides adopt $\beta$-turn structures in aqueous solution, with type I' $\beta$-turn being the most preferred motif. The results from our analyses indicate that for the given system the two methods diverge in their predictions. The possibility of a force field-dependent deficiency is examined as a possible source of the observed discrepancy.


title: First discovery of an ultra-cool white dwarf benchmark in common proper motion with an M dwarf

abstract: Ultra-cool white dwarfs are among the oldest stellar remnants in the Universe. Their efficient gravitational settling and low effective temperatures are responsible for the smooth spectra they exhibit. For that reason, it is not possible to derive their radial velocities or to find the chemistry of the progenitors. The best that can be done is to infer such properties from associated sources, which are coeval. The simplest form of such a system is a common proper motion pair where one star is an evolved degenerate and the other a main-sequence star. In this work, we present the discovery of the first of such a system, the M dwarf LHS 6328 and the ultra-cool white dwarf PSO J1801+625, from the Pan-STARRS 1 3$\pi$ survey and the $Gaia$ Data Release 2. Follow-up spectra were collected covering a usable wavelength range of 3750-24500 {\AA}. Their spectra show that the white dwarf has an effective temperature of 3550K and surface gravity of $\log g = 7.45 \pm 0.13$ or $\log g = 7.49 \pm 0.13$ for a CO or He core, respectively, when compared against synthetic spectra of ultra-cool white dwarf atmosphere models. The system has slightly subsolar metallicity with -0.25 < [Fe/H] < 0.0, and a spatial velocity of (U, V, W) = ($-114.26 \pm 0.24$, $222.94 \pm 0.60$, $10.25 \pm 0.34$) km s $^{-1}$ the first radial velocity and metallicity measurements of an ultra-cool white dwarf. This makes it the first and only benchmark of its kind to date.


title: Parabolic frequency on manifolds

abstract: We prove monotonicity of a parabolic frequency on manifolds. This is a parabolic analog of Almgren's frequency function. Remarkably we get monotonicity on all manifolds and no curvature assumption is needed. When the manifold is Euclidean space and the drift operator is the Ornstein-Uhlenbeck operator this can been seen to imply Poon's frequency monotonicity for the ordinary heat equation. Monotonicity of frequency is a parabolic analog of the 19th century Hadamard three circles theorem about log convexity of holomorphic functions on $\CC$. From the monotonicity, we get parabolic unique continuation and backward uniqueness.


title: Divisorial contractions to codimension three orbits

abstract: Let $G$ be a connected algebraic group. We study $G$-equivariant extremal contractions whose centre is a codimension three $G$-simply connected orbit. In the spirit of an important result by Kawakita in 2001, we prove that those contractions are weighted blow-ups.


title: A Practical Approach to Social Learning

abstract: Models of social learning feature either binary signals or abstract signal structures often deprived of micro-foundations. Both models are limited when analyzing interim results or performing empirical analysis. We present a method of generating signal structures which are richer than the binary model, yet are tractable enough to perform simulations and empirical analysis. We demonstrate the method's usability by revisiting two classical papers: (1) we discuss the economic significance of unbounded signals Smith and Sorensen (2000); (2) we use experimental data from Anderson and Holt (1997) to perform econometric analysis. Additionally, we provide a necessary and sufficient condition for the occurrence of action cascades.


title: Breaking Batch Normalization for better explainability of Deep Neural Networks through Layer-wise Relevance Propagation

abstract: The lack of transparency of neural networks stays a major break for their use. The Layerwise Relevance Propagation technique builds heat-maps representing the relevance of each input in the model s decision. The relevance spreads backward from the last to the first layer of the Deep Neural Network. Layer-wise Relevance Propagation does not manage normalization layers, in this work we suggest a method to include normalization layers. Specifically, we build an equivalent network fusing normalization layers and convolutional or fully connected layers. Heatmaps obtained with our method on MNIST and CIFAR 10 datasets are more accurate for convolutional layers. Our study also prevents from using Layerwise Relevance Propagation with networks including a combination of connected layers and normalization layer.


title: On coherent and incoherent scattering of fast charged particles in ultrathin crystals

abstract: We consider the fast charged particles scattering in ultrathin crystals on the base of the Born approxima-tion of quantum electrodynamics. The main attention is paid to the question of the scattering cross section splitting into coherent and incoherent components when one of the crystallographic axes and planes is orient-ed along the direction of particle motion. It is shown that both the coherent and the incoherent components of the scattering cross section considerably depend on the orientation of the crystallographic axes relatively to the incident beam. In particular, it was shown that when particles are scattered by the crystal planes of atoms, the incoherent scattering cross section does not contain the Debye-Waller factor.


title: See, Attend and Brake: An Attention-based Saliency Map Prediction Model for End-to-End Driving

abstract: Visual perception is the most critical input for driving decisions. In this study, our aim is to understand relationship between saliency and driving decisions. We present a novel attention-based saliency map prediction model for making braking decisions This approach constructs a holistic model to the driving task and can be extended for other driving decisions like steering and acceleration. The proposed model is a deep neural network model that feeds extracted features from input image to a recurrent neural network with an attention mechanism. Then predicted saliency map is used to make braking decision. We trained and evaluated using driving attention dataset BDD-A, and saliency dataset CAT2000.


title: SNIFF: Reverse Engineering of Neural Networks with Fault Attacks

abstract: Neural networks have been shown to be vulnerable against fault injection attacks. These attacks change the physical behavior of the device during the computation, resulting in a change of value that is currently being computed. They can be realized by various fault injection techniques, ranging from clock/voltage glitching to application of lasers to rowhammer. In this paper we explore the possibility to reverse engineer neural networks with the usage of fault attacks. SNIFF stands for sign bit flip fault, which enables the reverse engineering by changing the sign of intermediate values. We develop the first exact extraction method on deep-layer feature extractor networks that provably allows the recovery of the model parameters. Our experiments with Keras library show that the precision error for the parameter recovery for the tested networks is less than $10^{-13}$ with the usage of 64-bit floats, which improves the current state of the art by 6 orders of magnitude. Additionally, we discuss the protection techniques against fault injection attacks that can be applied to enhance the fault resistance.


title: Beyond Dropout: Feature Map Distortion to Regularize Deep Neural Networks

abstract: Deep neural networks often consist of a great number of trainable parameters for extracting powerful features from given datasets. On one hand, massive trainable parameters significantly enhance the performance of these deep networks. On the other hand, they bring the problem of over-fitting. To this end, dropout based methods disable some elements in the output feature maps during the training phase for reducing the co-adaptation of neurons. Although the generalization ability of the resulting models can be enhanced by these approaches, the conventional binary dropout is not the optimal solution. Therefore, we investigate the empirical Rademacher complexity related to intermediate layers of deep neural networks and propose a feature distortion method (Disout) for addressing the aforementioned problem. In the training period, randomly selected elements in the feature maps will be replaced with specific values by exploiting the generalization error bound. The superiority of the proposed feature map distortion for producing deep neural network with higher testing performance is analyzed and demonstrated on several benchmark image datasets.


title: Semantic Relatedness for Keyword Disambiguation: Exploiting Different Embeddings

abstract: Understanding the meaning of words is crucial for many tasks that involve human-machine interaction. This has been tackled by research in Word Sense Disambiguation (WSD) in the Natural Language Processing (NLP) field. Recently, WSD and many other NLP tasks have taken advantage of embeddings-based representation of words, sentences, and documents. However, when it comes to WSD, most embeddings models suffer from ambiguity as they do not capture the different possible meanings of the words. Even when they do, the list of possible meanings for a word (sense inventory) has to be known in advance at training time to be included in the embeddings space. Unfortunately, there are situations in which such a sense inventory is not known in advance (e.g., an ontology selected at run-time), or it evolves with time and its status diverges from the one at training time. This hampers the use of embeddings models for WSD. Furthermore, traditional WSD techniques do not perform well in situations in which the available linguistic information is very scarce, such as the case of keyword-based queries. In this paper, we propose an approach to keyword disambiguation which grounds on a semantic relatedness between words and senses provided by an external inventory (ontology) that is not known at training time. Building on previous works, we present a semantic relatedness measure that uses word embeddings, and explore different disambiguation algorithms to also exploit both word and sentence representations. Experimental results show that this approach achieves results comparable with the state of the art when applied for WSD, without training for a particular domain.


title: Non-invasive nanoscale potentiometry and ballistic transport in epigraphene nanoribbons

abstract: The recent observation of non-classical electron transport regimes in two-dimensional materials has called for new high-resolution non-invasive techniques to locally probe electronic properties. We introduce a novel hybrid scanning probe technique to map the local resistance and electrochemical potential with nm- and $\mu$V resolution, and we apply it to study epigraphene nanoribbons grown on the sidewalls of SiC substrate steps. Remarkably, the potential drop is non uniform along the ribbons, and $\mu$m-long segments show no potential variation with distance. The potential maps are in excellent agreement with measurements of the local resistance. This reveals ballistic transport in ambient condition, compatible with micrometer-long room-temperature electronic mean free paths.


title: New bounds for perfect $k$-hashing

abstract: Let $C\subseteq \{1,\ldots,k\}^n$ be such that for any $k$ distinct elements of $C$ there exists a coordinate where they all differ simultaneously. Fredman and Koml\'os studied upper and lower bounds on the largest cardinality of such a set $C$, in particular proving that as $n\to\infty$, $|C|\leq \exp(n k!/k^{k-1}+o(n))$. Improvements over this result where first derived by different authors for $k=4$. More recently, Guruswami and Riazanov showed that the coefficient $k!/k^{k-1}$ is certainly not tight for any $k>3$, although they could only determine explicit improvements for $k=5,6$. For larger $k$, their method gives numerical values modulo a conjecture on the maxima of certain polynomials. In this paper, we first prove their conjecture, completing the explicit computation of an improvement over the Fredman-Koml\'os bound for any $k$. Then, we develop a different method which gives substantial improvements for $k=5,6$.


title: Orientation-dependent electric transport and band filling in hole co-doped epitaxial diamond films

abstract: Diamond, a well-known wide-bandgap insulator, becomes a low-temperature superconductor upon substitutional doping of carbon with boron. However, limited boron solubility and significant lattice disorder introduced by boron doping prevent attaining the theoretically-predicted high-temperature superconductivity. Here we present an alternative co-doping approach, based on the combination of ionic gating and boron substitution, in hydrogenated thin films epitaxially grown on (111)- and (110)-oriented single crystals. Gate-dependent electric transport measurements show that the effect of boron doping strongly depends on the crystal orientation. In the (111) surface, it strongly suppresses the charge-carrier mobility and moderately increases the gate-induced doping, while in the (110) surface it strongly increases the gate-induced doping with a moderate reduction in mobility. In both cases the maximum total carrier density remains below $2{\cdot}10^{14}\,$cm$^{-2}$, three times lower than the value theoretically required for high-temperature superconductivity. Density-functional theory calculations show that this strongly orientation-dependent effect is due to the specific energy-dependence of the density of states in the two surfaces. Our results allow to determine the band filling and doping-dependence of the hole scattering lifetime in the two surfaces, showing the occurrence of a frustrated insulator-to-metal transition in the (110) surface and of a re-entrant insulator-to-metal transition in the (111) surface.


title: A "String Art" approach to the design and manufacturing of optimal composite materials and structures

abstract: In this paper we report a new promising idea on the design and manufacturing of ply composite structures, tailored to exhibit maximum stiffness under given weight constraints and loading conditions. It is based on the idea behind an artistic technique known as "string art" - the representation of an image with a single thread, tensioned between pins on the flat frame. A discrete optimization algorithm has been employed recently to formalize the process of finding a configuration of thread windings that fuses into a given greyscale image. We demonstrate how this algorithm can be employed to approximate the two-dimensional distribution of isotropic material, computed by a conventional topology optimization algorithm. An optimal composite design is thus found as a result of the following two-stage process. At the first stage, topology optimization procedure produces regular grid of greyscale values of stiffness. At the second stage, this distribution is approximated with a polyline, representing the stiff reinforcement fiber in a soft matrix, according to ``string art'' optimization algorithm. The efficiency of the proposed approach is illustrated with few simple numerical examples. Our development opens a wide avenue for the industrial design of the new generation of fibrous composite structures.


title: An Empirical Study of Usages, Updates and Risks of Third-Party Libraries in Java Projects

abstract: Third-party libraries are a central building block to develop software systems. However, outdated third-party libraries are commonly used, and developers are usually less aware of the potential risks. Therefore, a quantitative and holistic study on usages, updates and risks of third-party libraries can provide practical insights to improve the ecosystem sustainably. In this paper, we conduct such a study in the Java ecosystem. Specifically, we conduct a library usage analysis (e.g., usage intensity and outdatedness) and a library update analysis (e.g., update intensity and delay) using 806 open-source projects. The two analyses aim to quantify usage and update practices holistically from the perspective of both open-source projects and third-party libraries. Then, we conduct a library risk analysis (e.g., potential risk and developer response) in terms of bugs with 15 popularly-used third-party libraries. This analysis aims to quantify the potential risk of using outdated libraries and the developer response to the risk. Our findings from the three analyses provide practical insights to developers and researchers on problems and potential solutions in maintaining third-party libraries (e.g., smart alerting and automated updating of outdated libraries). To demonstrate the usefulness of our findings, we propose a bug-driven alerting system for assisting developers to make confident decisions in updating third-party library versions. We have released our dataset to foster valuable applications and improve the ecosystem.


title: Flowing emulsions through disorder: Critical depinning and smectic rivers

abstract: During the past sixty minutes only, oil companies have extracted six trillions liters of oil from the ground, i.e. the volume of about two hundreds Olympic swimming pools. This phenomenal number gives a striking illustration of the impact of multiphase flows on the world economy and environment. From a fundamental perspective, we now clearly understand the large-scale patterns formed when liquid interfaces are driven through heterogeneous environments. In stark contrast, the displacement of fragmented fluids through disordered media remains limited to isolated droplets and bubbles. Here, we elucidate the collective dynamics of emulsions hydrodynamically driven through disordered environments. Advecting hundreds of thousands of microfluidic droplets through random lattices of pinning sites, we establish that the mobilization of confined emulsions is a critical dynamical transition. Unlike contact-line depinning, emulsion mobilization is not triggered by large-scale avalanches but merely requires the coordinated motion of small groups of particles. Criticality arises from the correlations of seemingly erratic depinning events over system-spanning scales along smectic river networks. We elucidate the microscopic origin of these self-organized flow patterns: contact interactions and hydrodynamic focusing conspire to mobilize emulsion out of disorder. We close our article commenting on the similarities (and profound differences) with the plastic depinning transitions of driven flux lines in high-$T_{\rm c}$ superconductors, and grain transport in eroded sand beds.


title: Functional renormalization group for a large moir\'e unit cell

abstract: Layers of two-dimensional materials arranged at a twist angle with respect to each other lead to enlarged unit cells with potentially strongly altered band structures, offering a new arena for novel and engineered many-body ground states. For the exploration of these, renormalization group methods are an appropriate, flexible tool that take into account the mutual influence of competing tendencies. Here we show that, within reasonable, non-trivial approximations, the functional renormalization group known from simpler two-dimensional systems can be employed for the large-unit cell moir\'e superlattices with more than 10.000 bands, remedying the need to employ ad hoc restrictions to effective low-energy theories of a few bands and/or effective continuum theories. This provides a description on the atomic scale, allowing one to absorb available ab-initio information on the model parameters and therefore lending the analysis a more concrete quantitative character. For the case of twisted bilayer graphene models, we explore the leading ordering tendencies depending on the band filling and the range of interactions. The results indicate a delicate balance between distinct magnetically ordered ground states, as well as the occurrence of a charge modulation within the moir\'e unit cell for sufficiently non-local repulsive interaction.


title: Central wavelengths and profile shapes of diffuse interstellar bands vs. physical parameters of intervening clouds

abstract: This paper tries to establish whether there are variations of the central wavelengths or the profile shapes of diffuse interstellar bands (DIBs) and whether these variations are caused by different physical parameters of translucent clouds. For this purpose we used spectra of two stars seen through two different single clouds: HD34078 (AE Aur) \& HD73882 acquired using two different instruments: the MIKE spectrograph, fed with the 6.5 m Magellan telescope at Las Campanas Observatory, and the UVES, fed with the 8 m Kueyen telescope at the Paranal observatory. The wavelength displacements of the DIBs at 6196, 6203, 6376, 6379 and 6614 \AA\ with respect to the well known interstellar atomic and molecular lines (K{\sc i} and CH) have been measured. The mentioned shift is seemingly absent in the DIBs at 4726, 4964, 4763, and 4780 \AA. In addition the considered profiles may show (in HD34078) extended red wings. The observed phenomena are likely related to physical parameters of intervening clouds (rotational temperatures of molecular species) and may help in the identification of the DIB carriers.


title: Effect of chemical structure on the ultrafast spin dynamics in core-excited states

abstract: Recent developments of the sources of intense and ultrashort X-ray pulses stimulate theoretical studies of phenomena occurring on ultrafast timescales. In the present study, spin-flip dynamics in transition metal complexes triggered by sub-femtosecond X-ray pulses are addressed theoretically using a density matrix-based time-dependent configuration interaction approach. The influence of different central metal ions and ligands on the character and efficiency of spin-flip dynamics is put in focus. According to our results, slight variations in the coordination sphere do not lead to qualitative differences in dynamics, whereas the nature of the central ion is more critical. However, the behavior in a row of transition metals demonstrates trends that are not consistent with general expectations. Thus, the peculiarities of spin dynamics have to be analyzed on a case-to-case basis.


title: Irrational periods of Hilbert Eisenstein series via toroidal compactification

abstract: We show that the periods of the holomorphic Eisenstein series of level 1, parallel weight 2, on a Hilbert modular surface are not rational, even up to scaling. This is deduced from a study of the mixed Hodge structure on the cohomology of the Hilbert modular surface, where we find extension classes related to the units of the real quadratic field. We prove similar results for Hilbert modular varieties of all dimensions, and produce extensions of Galois representations in \'etale cohomology. The key point is to study the restriction of the canonical extension of the Hodge bundle to the boundary of a smooth toroidal compactification.


title: Lying on networks: The role of structure and topology in promoting honesty

abstract: Lies can have a negating impact on governments, companies, and the society as a whole. Understanding the dynamics of lying is therefore of crucial importance across different fields of research. While lying has been studied before in well-mixed populations, it is a fact that real interactions are rarely well-mixed. Indeed, they are usually structured and thus best described by networks. Here we therefore use the Monte Carlo method to study the evolution of lying in the sender-receiver game in a one-parameter family of networks, systematically covering complete networks, small-world networks, and one-dimensional rings. We show that lies which benefit the sender at a cost to the receiver, the so-called black lies, are less likely to proliferate on networks than they do in well-mixed populations. Honesty is thus more likely to evolve, but only when the benefit for the sender is smaller than the cost for the receiver. Moreover, this effect is particularly strong in small-world networks, but less so in the one-dimensional ring. For lies that favor the receiver at a cost to the sender, the so-called altruistic white lies, we show that honesty is also more likely to evolve than it is in well-mixed populations. But contrary to black lies, this effect is more expressed in the one-dimensional ring, whereas in small-world networks it is present only when the cost to the sender is greater than the benefit for the receiver. Lastly, for lies that benefit both the sender and the receiver, the so-called Pareto white lies, we show that the network structure actually favors the evolution of lying, but this only when the benefit for the sender is slightly greater than the benefit for the receiver. In this case again the small-world topology acts as an amplifier of the effect, while other network topologies fail to do the same.


title: Sinai billiard maps with Ruelle resonances

abstract: We construct families of two-dimensional Sinai billiards whose transfer operators have Ruelle resonances arbitrarily close to 1. Our method involves taking a large enough cover of an initial billiard table, and relating the transfer operator of the covering table to twisted transfer operators of the initial table. We also study the distribution of these resonances which are close to 1.


title: Planet gap opening across stellar masses

abstract: Annular structures in proto-planetary discs, such as gaps and rings, are now ubiquitously found by high-resolution ALMA observations. Under the hypothesis that they are opened by planets, in this paper we investigate how the minimum planet mass needed to open a gap varies across different stellar host masses and distances from the star. The dependence on the stellar host mass is particularly interesting because, at least in principle, gap opening around low mass stars should be possible for lower mass planets, giving us a look into the young, low mass planet population. Using dusty hydrodynamical simulations, we find however the opposite behaviour, as a result of the fact that discs around low mass stars are geometrically thicker: gap opening around low mass stars can require more massive planets. Depending on the theoretical isochrone employed to predict the relationship between stellar mass and luminosity, the gap opening planet mass could also be independent of stellar mass, but in no case we find that gap opening becomes easier around low mass stars. This would lead to the expectation of a {\it lower} incidence of such structures in lower mass stars, since exoplanet surveys show that low mass stars have a lower fraction of giant planets. More generally, our study enables future imaging observations as a function of stellar mass to be interpreted using information on the mass vs. luminosity relations of the observed samples.


title: Design Optimisation of Power-Efficient Submarine Line through Machine Learning

abstract: An optimised subsea system design for energy-efficient SDM operation is demonstrated using machine learning. The removal of gain-flattening filters employed in submarine optical amplifiers can result in capacity gains at no additional overall repeater cost.


title: Analysing Multibeam, Cooperative, Ground Based Radar in a Bistatic Configuration

abstract: Recent advances in digital beam forming for phased arrays in combination with digital signal processing should enable the development of multibeam radar in a bistatic configuration. In the bistatic setting, the pulse travelling outward from the transmitter should be followed or "chased" by the receiver. During transmission, depending on the location of the transmitter, receiver, and pulse, the number of digital beams and their location at the transmitter vary. In this paper, we analyse the geometrically depending number of digital beams and the beam switching rate of the receiver needed for pulse chasing. In addition, we derive the pulse repetition frequency (PRF) for the bistatic configuration based on the desired detection range. It is shown that the PRF in the bistatic case can be increased compared to its monostatic counterpart when the distance between the transmitter and the receiver is increased. Our results are applied on the scenario of an air traffic control radar to show the feasibility of a multibeam, ground based bistatic surveillance radar. It will be demonstrated that the maximum PRF can almost be doubled and an adaptive sensing and tracking paradigm can lead to a maximum of 64 simultaneous receiver beams for the bistatic surveillance and tracking setting.


title: A study of resting-state EEG biomarkers for depression recognition

abstract: Background: Depression has become a major health burden worldwide, and effective detection depression is a great public-health challenge. This Electroencephalography (EEG)-based research is to explore the effective biomarkers for depression recognition. Methods: Resting state EEG data was collected from 24 major depressive patients (MDD) and 29 normal controls using 128 channel HydroCel Geodesic Sensor Net (HCGSN). To better identify depression, we extracted different types of EEG features including linear features, nonlinear features and functional connectivity features phase lagging index (PLI) to comprehensively analyze the EEG signals in patients with MDD. And using different feature selection methods and classifiers to evaluate the optimal feature sets. Results: Functional connectivity feature PLI is superior to the linear features and nonlinear features. And when combining all the types of features to classify MDD patients, we can obtain the highest classification accuracy 82.31% using ReliefF feature selection method and logistic regression (LR) classifier. Analyzing the distribution of optimal feature set, it was found that intrahemispheric connection edges of PLI were much more than the interhemispheric connection edges, and the intrahemispheric connection edges had a significant differences between two groups. Conclusion: Functional connectivity feature PLI plays an important role in depression recognition. Especially, intrahemispheric connection edges of PLI might be an effective biomarker to identify depression. And statistic results suggested that MDD patients might exist functional dysfunction in left hemisphere.