title: When OT meets MoM: Robust estimation of Wasserstein Distance

abstract: Issued from Optimal Transport, the Wasserstein distance has gained importance in Machine Learning due to its appealing geometrical properties and the increasing availability of efficient approximations. In this work, we consider the problem of estimating the Wasserstein distance between two probability distributions when observations are polluted by outliers. To that end, we investigate how to leverage Medians of Means (MoM) estimators to robustify the estimation of Wasserstein distance. Exploiting the dual Kantorovitch formulation of Wasserstein distance, we introduce and discuss novel MoM-based robust estimators whose consistency is studied under a data contamination model and for which convergence rates are provided. These MoM estimators enable to make Wasserstein Generative Adversarial Network (WGAN) robust to outliers, as witnessed by an empirical study on two benchmarks CIFAR10 and Fashion MNIST. Eventually, we discuss how to combine MoM with the entropy-regularized approximation of the Wasserstein distance and propose a simple MoM-based re-weighting scheme that could be used in conjunction with the Sinkhorn algorithm.


title: The square root of a parabolic operator

abstract: Let L(t) = --div (A(x, t)$\nabla$ x) for t $\in$ (0, $\tau$) be a uniformly elliptic operator with boundary conditions on a domain $\Omega$ of R d and $\partial$ = $\partial$ $\partial$t. Define the parabolic operator L = $\partial$ + L on L 2 (0, $\tau$, L 2 ($\Omega$)) by (Lu)(t) := $\partial$u(t) $\partial$t + L(t)u(t). We assume a very little of regularity for the boundary of $\Omega$ and assume that the coefficients A(x, t) are measurable in x and piecewise C $\alpha$ in t for some $\alpha$ > 1 2. We prove the Kato square root property for $\sqrt$ L and the estimate $\sqrt$ L u L 2 (0,$\tau$,L 2 ($\Omega$)) $\approx$ $\nabla$ x u L 2 (0,$\tau$,L 2 ($\Omega$)) + u H 1 2 (0,$\tau$,L 2 ($\Omega$)) + $\tau$ 0 u(t) 2 L 2 ($\Omega$) dt t 1/2. We also prove L p-versions of this result. Keywords: elliptic and parabolic operators, the Kato square root property, maximal regularity, the holomorphic functional calculus, non-autonomous evolution equations.


title: On a conjecture about profiles of finite connected racks

abstract: A rack is a set with a binary operation such that left multiplications are automorphisms of the set and a quandle is a rack satisfying a certain condition. For a finite connected rack the cycle type of the permutation defined by left multiplication by an element is independent from the chosen element. This cycle type is called the profile of the rack. Hayashi conjectured, in the profile of a finite connected quandle, the length of a cycle must divide the length of the largest cycle. In this paper, we prove Hayashi's Conjecture in some particular cases.


title: What binary systems are the most likely sources for periodically repeating FRBs?

abstract: The newly discovered 16.35 days period for repeating FRB 180916.J0158+65 provides an essential clue for understanding the sources and emission mechanism of repeating FRBs. Many models propose that the periodically repeating FRBs might be related to binary star systems that contain at least one neutron star (NSC-FRB system). It has been suggested that the NS "combed" by the strong wind from a companion star might provide a solution. Following the "Binary Comb" model, we use the population synthesis method to study in detail the properties of the companion stars and the nature of NSC-FRB systems. Our main findings are: 1) the companion star is most likely to be a B-type star; 2) the period of 16 days of FRB 180916 happens to fall in the most probable period range, which may explain why FRB 180916 was the first detected periodically repeating FRB, and we expect to observe more periodically repeating FRBs with periods around 10-30 days; 3) the birth rate for NSC-FRB system is large enough to fulfill the event rate requirement set by the observation of FRB 180916, which supports the proposal that NSC-FRB can provide one significant channel for producing periodically repeating FRBs.


title: Spectroscopic signature of the Stark-shifted Tamm-type surface state of La(0001)

abstract: We have studied the Tamm-type surface state of La(0001) by tunneling spectroscopy within a wide range of tunneling currents from 0.1 nA to 8000 nA, thereby tuning the electric-field strength in a tip-vacuum-sample tunnel junction. We observe a significant shift of the unoccupied Tamm-type surface state toward the Fermi energy with increasing electric-field strength, accompanied by a broadening of the width of the resonance peak indicating a decrease of the surface-state lifetime. Our experimental results are contrary to previous reports for Stark-shifted Shockley-type surface states of noble metal (111) surfaces.


title: A Shooting Formulation of Deep Learning

abstract: Continuous-depth neural networks can be viewed as deep limits of discrete neural networks whose dynamics resemble a discretization of an ordinary differential equation (ODE). Although important steps have been taken to realize the advantages of such continuous formulations, most current techniques are not truly continuous-depth as they assume \textit{identical} layers. Indeed, existing works throw into relief the myriad difficulties presented by an infinite-dimensional parameter space in learning a continuous-depth neural ODE. To this end, we introduce a shooting formulation which shifts the perspective from parameterizing a network layer-by-layer to parameterizing over optimal networks described only by a set of initial conditions. For scalability, we propose a novel particle-ensemble parametrization which fully specifies the optimal weight trajectory of the continuous-depth neural network. Our experiments show that our particle-ensemble shooting formulation can achieve competitive performance, especially on long-range forecasting tasks. Finally, though the current work is inspired by continuous-depth neural networks, the particle-ensemble shooting formulation also applies to discrete-time networks and may lead to a new fertile area of research in deep learning parametrization.


title: MMCGAN: Generative Adversarial Network with Explicit Manifold Prior

abstract: Generative Adversarial Network(GAN) provides a good generative framework to produce realistic samples, but suffers from two recognized issues as mode collapse and unstable training. In this work, we propose to employ explicit manifold learning as prior to alleviate mode collapse and stabilize training of GAN. Since the basic assumption of conventional manifold learning fails in case of sparse and uneven data distribution, we introduce a new target, Minimum Manifold Coding (MMC), for manifold learning to encourage simple and unfolded manifold. In essence, MMC is the general case of the shortest Hamiltonian Path problem and pursues manifold with minimum Riemann volume. Using the standardized code from MMC as prior, GAN is guaranteed to recover a simple and unfolded manifold covering all the training data. Our experiments on both the toy data and real datasets show the effectiveness of MMCGAN in alleviating mode collapse, stabilizing training, and improving the quality of generated samples.


title: Approaching Prosumer Social Optimum via Energy Sharing with Proof of Convergence

abstract: With the advent of prosumers, the traditional centralized operation may become impracticable due to computational burden, privacy concerns, and conflicting interests. In this paper, an energy sharing mechanism is proposed to accommodate prosumers' strategic decision-making on their self-production and demand in the presence of capacity constraints. Under this setting, prosumers play a generalized Nash game. We prove main properties of the game: an equilibrium exists and is partially unique; no prosumer is worse off by energy sharing and the price-of-anarchy is 1-O(1/I) where I is the number of prosumers. In particular, the PoA tends to 1 with a growing number of prosumers, meaning that the resulting total cost under the proposed energy sharing approaches social optimum. We prove that the corresponding prosumers' strategies converge to the social optimal solution as well. Finally we propose a bidding process and prove that it converges to the energy sharing equilibrium under mild conditions. Illustrative examples are provided to validate the results.


title: A discrete-event simulation model for driver performance assessment: application to autonomous vehicle cockpit design optimization

abstract: The latest advances in the design of vehicles with the adaptive level of automation pose new challenges in the vehicle-driver interaction. Safety requirements underline the need to explore optimal cockpit architectures with regard to driver cognitive and perceptual workload, eyes-off-the-road time and situation awareness. We propose to integrate existing task analysis approaches into system architecture evaluation for the early-stage design optimization. We built the discrete-event simulation tool and applied it within the multi-sensory (sight, sound, touch) cockpit design industrial project.


title: Extraction and Evaluation of Formulaic Expressions Used in Scholarly Papers

abstract: Formulaic expressions, such as 'in this paper we propose', are helpful for authors of scholarly papers because they convey communicative functions; in the above, it is showing the aim of this paper'. Thus, resources of formulaic expressions, such as a dictionary, that could be looked up easily would be useful. However, forms of formulaic expressions can often vary to a great extent. For example, 'in this paper we propose', 'in this study we propose' and 'in this paper we propose a new method to' are all regarded as formulaic expressions. Such a diversity of spans and forms causes problems in both extraction and evaluation of formulaic expressions. In this paper, we propose a new approach that is robust to variation of spans and forms of formulaic expressions. Our approach regards a sentence as consisting of a formulaic part and non-formulaic part. Then, instead of trying to extract formulaic expressions from a whole corpus, by extracting them from each sentence, different forms can be dealt with at once. Based on this formulation, to avoid the diversity problem, we propose evaluating extraction methods by how much they convey specific communicative functions rather than by comparing extracted expressions to an existing lexicon. We also propose a new extraction method that utilises named entities and dependency structures to remove the non-formulaic part from a sentence. Experimental results show that the proposed extraction method achieved the best performance compared to other existing methods.


title: On existence of PI-exponents of unital algebras

abstract: We construct a family of unital non-associative algebras $\{T_\alpha\vert~ 2<\alpha\in\mathbb R\}$ such that $\underline{exp}(T_\alpha)=2$, whereas $\alpha\le\overline{exp}(T_\alpha)\le\alpha+1$. In particular, it follows that ordinary PI-exponent of codimension growth of algebra $T_\alpha$ does not exist for any $\alpha> 2$. This is the first example of a unital algebra whose PI-exponent does not exist.


title: Cascaded Regression Tracking: Towards Online Hard Distractor Discrimination

abstract: Visual tracking can be easily disturbed by similar surrounding objects. Such objects as hard distractors, even though being the minority among negative samples, increase the risk of target drift and model corruption, which deserve additional attention in online tracking and model update. To enhance the tracking robustness, in this paper, we propose a cascaded regression tracker with two sequential stages. In the first stage, we filter out abundant easily-identified negative candidates via an efficient convolutional regression. In the second stage, a discrete sampling based ridge regression is designed to double-check the remaining ambiguous hard samples, which serves as an alternative of fully-connected layers and benefits from the closed-form solver for efficient learning. Extensive experiments are conducted on 11 challenging tracking benchmarks including OTB-2013, OTB-2015, VOT2018, VOT2019, UAV123, Temple-Color, NfS, TrackingNet, LaSOT, UAV20L, and OxUvA. The proposed method achieves state-of-the-art performance on prevalent benchmarks, while running in a real-time speed.


title: Category-Specific CNN for Visual-aware CTR Prediction at JD.com

abstract: As one of the largest B2C e-commerce platforms in China, JD com also powers a leading advertising system, serving millions of advertisers with fingertip connection to hundreds of millions of customers. In our system, as well as most e-commerce scenarios, ads are displayed with images.This makes visual-aware Click Through Rate (CTR) prediction of crucial importance to both business effectiveness and user experience. Existing algorithms usually extract visual features using off-the-shelf Convolutional Neural Networks (CNNs) and late fuse the visual and non-visual features for the finally predicted CTR. Despite being extensively studied, this field still face two key challenges. First, although encouraging progress has been made in offline studies, applying CNNs in real systems remains non-trivial, due to the strict requirements for efficient end-to-end training and low-latency online serving. Second, the off-the-shelf CNNs and late fusion architectures are suboptimal. Specifically, off-the-shelf CNNs were designed for classification thus never take categories as input features. While in e-commerce, categories are precisely labeled and contain abundant visual priors that will help the visual modeling. Unaware of the ad category, these CNNs may extract some unnecessary category-unrelated features, wasting CNN's limited expression ability. To overcome the two challenges, we propose Category-specific CNN (CSCNN) specially for CTR prediction. CSCNN early incorporates the category knowledge with a light-weighted attention-module on each convolutional layer. This enables CSCNN to extract expressive category-specific visual patterns that benefit the CTR prediction. Offline experiments on benchmark and a 10 billion scale real production dataset from JD, together with an Online A/B test show that CSCNN outperforms all compared state-of-the-art algorithms.


title: Semiclassical states for fractional logarithmic Schr\"{o}dinger equations

abstract: In this paper, we consider the following fractional logarithmic Schr\"odinger equation \begin{equation*} \varepsilon^{2s}(-\Delta)^s u + V(x)u=u\log |u|^2\ \ \text{in}\ \R^N, \end{equation*} where $\varepsilon>0$, $N\ge 1$, $V(x)\in C(\R^N,[-1,+\infty))$. By introducing an interesting penalized function, we show that the problem has a positive solution $u_{\varepsilon}$ concentrating at a local minimum of $V$ as $\varepsilon\to 0$. There is no restriction on decay rates of $V$, especially it can be compactly supported.


title: Erd\H{o}s-Ko-Rado problems for permutation groups

abstract: In this paper, we study intersecting sets in primitive and quasiprimitive permutation groups. Let $G \leqslant \mathrm{Sym}(\Omega)$ be a transitive permutation group, and ${S}$ an intersecting set. Previous results show that if $G$ is either 2-transitive or a Frobenius group, then $|{S}|\leqslant|G_{\omega}|$ (for some $\omega \in \Omega$). Furthermore, for some 2-transitive groups, $|{S}|=|G_{\omega}|$ if and only if ${S}$ is a coset of a stabilizer. In this paper, we prove that these statements are far from the truth for general transitive groups. In particular, we show that in the case of primitive groups, there is even no absolute constant $c$ such that $|{S}|\leqslant c|G_\omega|$. In the case $G$ is a primitive permutation group isomorphic to $\mathrm{PSL(2,p)}$, we characterize the subgroups of $G$ which are intersecting sets. We also show that if $G \leqslant \mathrm{Sym}(\Omega)$ is a permutation group of prime power degree, then for any intersecting set $S$, we have $|S|\leq |G_{\omega}|$ (for some $\omega \in \Omega$). This proves a part of a conjecture in \cite{MRS}.


title: Perfectly Matched Layers on Cubic Domains forPauli's Equations

abstract: This article proves the well posedness of the boundary value problemthat arises when PML algorithms are applied to Pauli's equationswith a three dimensional rectangle as computational domain. The absorptionsare positive near the boundary and zero far from the boundary so are always x-dependent. At the flat parts of the boundary of the rectangle, the natural absorbing boundary conditions are imposed.The difficulty addressed is the analysis of the resulting variable coeffi-cient problem on the rectanglar solid with its edges and corners. TheLaplace transform is analysed. It turns on the analysis of a boundaryvalue problem formally obtained by complex stretching. Existence isproved by deriving a boundary value problems for a complex stretchedHelmholtz equation on smoothed domains. This is the first stabilityproof with x-dependent absorptions on a bounded domain whoseboundary is not smooth.


title: Variance linearity for real Gaussian zeros

abstract: We investigate the zero set of a stationary Gaussian process on the real line, and in particular give lower bounds for the variance of the number of points on a large interval, in all generality. We prove that this point process is never hyperuniform, i.e. the variance is at least linear, and give necessary conditions to have linear variance, which are close to be sharp. We study the class of symmetric Bernoulli convolutions and give an example where the zero set is super rigid, weakly mixing, and not hyperuniform.


title: Qualitative indicator functions for imaging crack networks using acoustic waves

abstract: We consider the problem of imaging a crack network embedded in some homogeneous background from measured multi-static far field data generated by acoustic plane waves. We propose two novel approaches that can be seen as extensions of linear sampling-type methods and that provide indicator functions which are sensitive to local cracks densities. The first approach uses multiple frequencies data to compute spectral signatures associated with artificially embedded localized obstacles. The second approach also exploits the idea of incorporating an artificial background but uses data for a single frequency. The indicator function is built using a similar concept as for differential sampling methods: compare the solution of the interior transmission problem for healthy inclusion with the one with embedded cracks. The performance of the methods is tested and discussed on synthetic examples and the numerical results are compared with the ones obtained using the classical factorization method.


title: Advances in Black-Box VI: Normalizing Flows, Importance Weighting, and Optimization

abstract: Recent research has seen several advances relevant to black-box VI, but the current state of automatic posterior inference is unclear. One such advance is the use of normalizing flows to define flexible posterior densities for deep latent variable models. Another direction is the integration of Monte-Carlo methods to serve two purposes; first, to obtain tighter variational objectives for optimization, and second, to define enriched variational families through sampling. However, both flows and variational Monte-Carlo methods remain relatively unexplored for black-box VI. Moreover, on a pragmatic front, there are several optimization considerations like step-size scheme, parameter initialization, and choice of gradient estimators, for which there are no clear guidance in the existing literature. In this paper, we postulate that black-box VI is best addressed through a careful combination of numerous algorithmic components. We evaluate components relating to optimization, flows, and Monte-Carlo methods on a benchmark of 30 models from the Stan model library. The combination of these algorithmic components significantly advances the state-of-the-art "out of the box" variational inference.


title: Multiplicative orders of Gauss periods and the arithmetic of real quadratic fields

abstract: We obtain divisibility conditions on the multiplicative orders of elements of the form $\zeta + \zeta^{-1}$ in a finite field by exploiting a link to the arithmetic of real quadratic fields.


title: Quantifying Assurance in Learning-enabled Systems

abstract: Dependability assurance of systems embedding machine learning(ML) components---so called learning-enabled systems (LESs)---is a key step for their use in safety-critical applications. In emerging standardization and guidance efforts, there is a growing consensus in the value of using assurance cases for that purpose. This paper develops a quantitative notion of assurance that an LES is dependable, as a core component of its assurance case, also extending our prior work that applied to ML components. Specifically, we characterize LES assurance in the form of assurance measures: a probabilistic quantification of confidence that an LES possesses system-level properties associated with functional capabilities and dependability attributes. We illustrate the utility of assurance measures by application to a real world autonomous aviation system, also describing their role both in i) guiding high-level, runtime risk mitigation decisions and ii) as a core component of the associated dynamic assurance case.


title: Matched wavelets for equidistant points

abstract: Matched wavelets interpolating equidistant data are designed. These wavelets form Riesz bases. Meyer wavelets that interpolate data on a particular uniform lattice are found.


title: Automated Radiological Report Generation For Chest X-Rays With Weakly-Supervised End-to-End Deep Learning

abstract: The chest X-Ray (CXR) is the one of the most common clinical exam used to diagnose thoracic diseases and abnormalities. The volume of CXR scans generated daily in hospitals is huge. Therefore, an automated diagnosis system able to save the effort of doctors is of great value. At present, the applications of artificial intelligence in CXR diagnosis usually use pattern recognition to classify the scans. However, such methods rely on labeled databases, which are costly and usually have large error rates. In this work, we built a database containing more than 12,000 CXR scans and radiological reports, and developed a model based on deep convolutional neural network and recurrent network with attention mechanism. The model learns features from the CXR scans and the associated raw radiological reports directly; no additional labeling of the scans are needed. The model provides automated recognition of given scans and generation of reports. The quality of the generated reports was evaluated with both the CIDEr scores and by radiologists as well. The CIDEr scores are found to be around 5.8 on average for the testing dataset. Further blind evaluation suggested a comparable performance against human radiologist.


title: Radio interferometry applied to the observation of cosmic-ray induced extensive air showers

abstract: We developed a radio interferometric technique for the observation of extensive air showers initiated by cosmic particles. In this proof-of-principle study we show that properties of extensive air showers can be derived with high accuracy in a straightforward manner. When time synchronisation below $\sim$1 ns between different receivers can be achieved, direction reconstruction resolution of $< 0.2^\circ$ and resolution on the depth of shower maximum of $<10$ g/cm$^2$ are obtained over the full parameter range studied, with even higher accuracy for inclined incoming directions. In addition, by applying the developed method to dense arrays of radio antennas, the energy threshold for the radio detection of extensive air showers can be significantly lowered. The proposed method can be incorporated in operational and future cosmic particle observatories and with its high accuracy it has the potential to play a crucial role in unravelling the composition of the ultra-high-energy cosmic-particle flux.


title: The equation $(x-d)^5 + x^5 + (x+d)^5 = y^n$

abstract: In this paper, we solve the equation of the title under the assumption that $\gcd(x,d)=1$ and $n\geq 2$. This generalizes earlier work of the first author, Patel and Siksek [BPS16]. Our main tools include Frey-Hellegouarch curves and associated modular forms, and an assortment of Chabauty-type techniques for determining rational points on curves of small positive genus.


title: Kernel methods through the roof: handling billions of points efficiently

abstract: Kernel methods provide an elegant and principled approach to nonparametric learning, but so far could hardly be used in large scale problems, since na\"ive implementations scale poorly with data size. Recent advances have shown the benefits of a number of algorithmic ideas, for example combining optimization, numerical linear algebra and random projections. Here, we push these efforts further to develop and test a solver that takes full advantage of GPU hardware. Towards this end, we designed a preconditioned gradient solver for kernel methods exploiting both GPU acceleration and parallelization with multiple GPUs, implementing out-of-core variants of common linear algebra operations to guarantee optimal hardware utilization. Further, we optimize the numerical precision of different operations and maximize efficiency of matrix-vector multiplications. As a result we can experimentally show dramatic speedups on datasets with billions of points, while still guaranteeing state of the art performance. Additionally, we make our software available as an easy to use library.


title: Reconstruction of finite volume solution for parameter-dependent linear hyperbolic conservation laws

abstract: This paper is concerned with the development of suitable numerical method for the approximation of discontinuous solutions of parameter-dependent linear hyperbolic conservation laws. The objective is to reconstruct such approximation, for new instances of the parameter values for any time, from a transformation of pre-computed snapshots of the solution trajectories for new parameter values. In a finite volume setting, a Reconstruct-Transform-Average (RTA) algorithm inspired from the Reconstruct-Evolve-Average one of Godunov's method is proposed. It allows to perform, in three steps, a transformation of the snapshots with piecewise constant reconstruction. The method is fully detailed and analyzed for solving a parameter-dependent transport equation for which the spatial transformation is related to the characteristic intrinsic to the problem. Numerical results for transport equation and linear elastodynamics equations illustrate the good behavior of the proposed approach.


title: Properties of Berwald scalar curvature

abstract: In this short paper, we prove that a Finsler manifold with vanishing Berwald scalar curvature has zero $\mathbf{E}$-curvature. As a consequence, Landsberg manifolds with vanishing Berwald scalar curvature are Berwald manifolds. This improves a previous result in \cite{Li}. For $(\alpha,\beta)$-metrics on manifold of dimension greater than 2, if the mean Landsberg curvature and the Berwald scalar curvature both vanish, the Berwald curvature also vanishes.


title: Magnetodynamic Finite-Element Simulation of Accelerator Magnets

abstract: This lecture note describes how to set up and what is behind a magnetodynamic field simulation for an accelerator magnet. The relevant formulation of Maxwell's equations is derived. The formulation is discretized in space by the finite-element method and in time by a standard time integration method. The steps for setting up the accelerator-magnet model are described. An exemplary simulation of the GSI SIS-100 magnet is given as illustration. Finally, some extensions to the standard FE method, dedicated to accelerator magnets, are discussed.


title: Smoothing effects and infinite time blowup for reaction-diffusion equations: an approach via Sobolev and Poincar\'e inequalities

abstract: We consider reaction-diffusion equations either posed on Riemannian manifolds or in the Euclidean weighted setting, with pow\-er-type nonlinearity and slow diffusion of porous medium time. We consider the particularly delicate case $p<m$ in problem (1.1), a case largely left open in [21] even when the initial datum is smooth and compactly supported. We prove global existence for L$^m$ data, and a smoothing effect for the evolution, i.e. that solutions corresponding to such data are bounded at all positive times with a quantitative bound on their L$^\infty$ norm. As a consequence of this fact and of a result of [21], it follows that on Cartan-Hadamard manifolds with curvature pinched between two strictly negative constants, solutions corresponding to sufficiently large L$^m$ data give rise to solutions that blow up pointwise everywhere in infinite time, a fact that has no Euclidean analogue. The methods of proof of the smoothing effect are functional analytic in character, as they depend solely on the validity of the Sobolev inequality and on the fact that the L$^2$ spectrum of $\Delta$ on $M$ is bounded away from zero (namely on the validity of a Poincar\'{e} inequality on $M$). As such, they are applicable to different situations, among which we single out the case of (mass) weighted reaction-diffusion equation in the Euclidean setting. In this latter setting, a modification of the methods of [37] allows to deal also, with stronger results for large times, with the case of globally integrable weights.


title: DrNAS: Dirichlet Neural Architecture Search

abstract: This paper proposes a novel differentiable architecture search method by formulating it into a distribution learning problem. We treat the continuously relaxed architecture mixing weight as random variables, modeled by Dirichlet distribution. With recently developed pathwise derivatives, the Dirichlet parameters can be easily optimized with gradient-based optimizer in an end-to-end manner. This formulation improves the generalization ability and induces stochasticity that naturally encourages exploration in the search space. Furthermore, to alleviate the large memory consumption of differentiable NAS, we propose a simple yet effective progressive learning scheme that enables searching directly on large-scale tasks, eliminating the gap between search and evaluation phases. Extensive experiments demonstrate the effectiveness of our method. Specifically, we obtain a test error of 2.46% for CIFAR-10, 23.7% for ImageNet under the mobile setting. On NAS-Bench-201, we also achieve state-of-the-art results on all three datasets and provide insights for the effective design of neural architecture search algorithms.


title: Learning by Repetition: Stochastic Multi-armed Bandits under Priming Effect

abstract: We study the effect of persistence of engagement on learning in a stochastic multi-armed bandit setting. In advertising and recommendation systems, repetition effect includes a wear-in period, where the user's propensity to reward the platform via a click or purchase depends on how frequently they see the recommendation in the recent past. It also includes a counteracting wear-out period, where the user's propensity to respond positively is dampened if the recommendation was shown too many times recently. Priming effect can be naturally modelled as a temporal constraint on the strategy space, since the reward for the current action depends on historical actions taken by the platform. We provide novel algorithms that achieves sublinear regret in time and the relevant wear-in/wear-out parameters. The effect of priming on the regret upper bound is also additive, and we get back a guarantee that matches popular algorithms such as the UCB1 and Thompson sampling when there is no priming effect. Our work complements recent work on modeling time varying rewards, delays and corruptions in bandits, and extends the usage of rich behavior models in sequential decision making settings.


title: The topology of higher-order complexes associated with brain-function hubs in human connectomes

abstract: Higher-order connectivity in complex systems described by simplexes of different orders provides a geometry for simplex-based dynamical variables and interactions. Simplicial complexes that constitute a functional geometry of the human connectome can be crucial for the brain complex dynamics. In this context, the best-connected brain areas, designated as hub nodes, play a central role in supporting integrated brain function. Here, we study the structure of simplicial complexes attached to eight global hubs in the female and male connectomes and identify the core networks among the affected brain regions. These eight hubs (Putamen, Caudate, Hippocampus and Thalamus-Proper in the left and right cerebral hemisphere) are the highest-ranking according to their topological dimension, defined as the number of simplexes of all orders in which the node participates. Furthermore, we analyse the weight-dependent heterogeneity of simplexes. We demonstrate changes in the structure of identified core networks and topological entropy when the threshold weight is gradually increased. These results highlight the role of higher-order interactions in human brain networks and provide additional evidence for (dis)similarity between the female and male connectomes.


title: Cloud detection in Landsat-8 imagery in Google Earth Engine based on a deep neural network

abstract: Google Earth Engine (GEE) provides a convenient platform for applications based on optical satellite imagery of large areas. With such data sets, the detection of cloud is often a necessary prerequisite step. Recently, deep learning-based cloud detection methods have shown their potential for cloud detection but they can only be applied locally, leading to inefficient data downloading time and storage problems. This letter proposes a method to directly perform cloud detection in Landsat-8 imagery in GEE based on deep learning (DeepGEE-CD). A deep neural network (DNN) was first trained locally, and then the trained DNN was deployed in the JavaScript client of GEE. An experiment was undertaken to validate the proposed method with a set of Landsat-8 images and the results show that DeepGEE-CD outperformed the widely used function of mask (Fmask) algorithm. The proposed DeepGEE-CD approach can accurately detect cloud in Landsat-8 imagery without downloading it, making it a promising method for routine cloud detection of Landsat-8 imagery in GEE.


title: Bottomonium suppression in PbPb collision at energies available at the CERN large hadron collider

abstract: We had been gradually working towards building a comprehensive quarkonia suppression formalism to explain all 3 dependencies of quarkonium suppression obtained from heavy-ion collision experiments. We present here the improved version of quarkonia suppression framework. It assumes bottomonia produced in the early stage which dissociates due to color screening, gluonic dissociation, and collisional damping in addition to the shadowing as an initial state effect. The QGP medium formed in the collisions is assumed to evolve under ($3+1$)-dimensional relativistic viscous hydrodynamics which is modeled using ECHO-QGP. This replaces the Bjorken's hydrodynamics which we had used in our earlier work where we determined the centrality and transverse momentum dependent suppression. The correlated bottom quark and bottom anti-quark could recombine in the plasma. A rate equation is employed, whose solution gives the final number of bottomonium after dissociation and recombination under $(3+1)$-dimensional expansion of the QGP medium. The Shadowing effect, which is the dominant Cold Nuclear Matter effect at LHC energies, has now been modified by employing the most recent parton distribution functions obtained from CT14 global analysis and shadowing factors from EPPS16. Using this improved formalism we determine the centrality, transverse momentum, and rapidity, dependencies of bottomonium suppression for $\Upsilon(1S)$, and $\Upsilon(2S)$ at the LHC's energies of $2.76$ TeV and $5.02$ TeV. We find a fairly good agreement between theoretically calculated survival probability and the measured nuclear modification factor($R_{AA}$) at the two energies.


title: Hadamard's variational formula and the energy-momentum tensor

abstract: The Hadamard variational formula for the Green function is formulated in terms of a polarized energy-momentum tensor and a strain tensor. This is elaborated in a general setting of subdomains of a Riemannian manifold in arbitrary dimension and linked to the way the energy-momentum tensor in general field theory appears as a result of varying the metric tensor in a Lagrangian function.


title: A 3/2--approximation for big two-bar charts packing

abstract: We consider a Two-Bar Charts Packing Problem (2-BCPP), in which it is necessary to pack two-bar charts (2-BCs) in a unit-height strip of minimum length. The problem is a generalization of the Bin Packing Problem (BPP). Earlier, we proposed an $O(n^2)$-time algorithm that constructs the packing which length at most $2\cdot OPT+1$, where $OPT$ is the minimum length of the packing of $n$ 2-BCs. In this paper, we propose an $O(n^4)$-time 3/2-approximate algorithm when each BC has at least one bar greater than 1/2.


title: Height pairings of 1-motives

abstract: The purpose of this work is to generalize, in the context of 1-motives, the $p$-adic height pairings constructed by B. Mazur and J. Tate on abelian varieties. Following their approach, we define a global pairing between the rational points of a 1-motive and its dual. We also provide local pairings between zero-cycles and divisors on a curve, which is done by considering its Picard and Albanese 1-motives.


title: Cell-Free Massive MIMO with Nonorthogonal Pilots for Internet of Things

abstract: We consider Internet of Things (IoT) organized on the principles of cell-free massive MIMO. Since the number of things is very large, orthogonal pilots cannot be assigned to all of them even if the things are stationary. This results in an unavoidable pilot contamination problem, worsened by the fact that, for IoT, since the things are operating at very low transmit power. To mitigate this problem and achieve a high throughput, we use cell-free systems with optimal linear minimum mean squared error (LMMSE) channel estimation, while traditionally simple suboptimal estimators have been used in such systems. We further derive the analytical uplink and downlink signal-to-interference-plus-noise ratio (SINR) expressions for this scenario, which depends only on large scale fading coefficients. This allows us to design new power control algorithms that require only infrequent transmit power adaptation. Simulation results show a 40% improvement in uplink and downlink throughputs and 95% in energy efficiency over existing cell-free wireless systems and at least a three-fold uplink improvement over known IoT systems based on small-cell systems.


title: On the Parameterized Approximability of Contraction to Classes of Chordal Graphs

abstract: A graph operation that {\em contracts edges} is one of the fundamental operations in the theory of graph minors. Parameterized Complexity of editing to a family of graphs by contracting $k$ edges has recently gained substantial scientific attention, and several new results have been obtained. Some important families of graphs, namely the subfamilies of chordal graphs, in the context of edge contractions, have proven to be significantly difficult than one might expect. In this paper, we study the \textsc{$\cal F$-Contraction} problem, where $\cal F$ is a subfamily of chordal graphs, in the realm of parameterized approximation. Formally, given a graph $G$ and an integer $k$, \textsc{ $\cal F$-Contraction} asks whether there exists $X \subseteq E(G)$ such that $G/X \in \cal F$ and $|X| \leq k$. Here, $G/X$ is the graph obtained from $G$ by contracting edges in $X$. We obtain the following results for the \textsc{ $\cal F$-Contraction} problem. $(1)$ We show that \textsc{Clique Contraction} admits a polynomial-size approximate kernelization scheme (\textsf{PSAKS}). $(2)$ We give a $(2+\epsilon)$-approximate polynomial kernel for \textsc{Split Contraction} (which also implies a factor $(2+\epsilon)$-\FPT-approximation algorithm for \textsc{ Split Contraction}). Furthermore, we show that, assuming \textsf{ Gap-ETH}, there is no $\left(\frac{5}{4}-\delta \right)$-\FPT-approximation algorithm for \textsc{Split Contraction}. Here, $\epsilon, \delta>0$ are fixed constants. $(3)$ \textsc{Chordal Contraction} is known to be \WTH. We complement this result by observing that the existing \textsf{W[2]-hardness} reduction can be adapted to show that, assuming \FPT $\neq$ \textsf{W[1]}, there is no $F(k)$-\FPT-approximation algorithm for \textsc{Chordal Contraction}. Here, $F(k)$ is an arbitrary function depending on $k$ alone.


title: Efficient Planar Two-Center Algorithms

abstract: We consider the planar Euclidean two-center problem in which given $n$ points in the plane we are to find two congruent disks of the smallest radius covering the points. We present a deterministic $O(n \log n)$-time algorithm for the case that the centers of the two optimal disks are close to each other, that is, the overlap of the two optimal disks is a constant fraction of the disk area. We also present a deterministic $O(n\log n)$-time algorithm for the case that the input points are in convex position. Both results improve the previous best $O(n\log n\log\log n)$ bound on the problems.


title: A Mechanical Screwing Tool for 2-Finger Parallel Grippers -- Design, Optimization, and Manipulation Policies

abstract: This paper develops a mechanical tool as well as its manipulation policies for 2-finger parallel robotic grippers. It primarily focuses on a mechanism that converts the gripping motion of 2-finger parallel grippers into a continuous rotation to realize tasks like fastening screws. The essential structure of the tool comprises a Scissor-Like Element (SLE) mechanism and a double-ratchet mechanism. They together convert repeated linear motion into continuous rotating motion. At the joints of the SLE mechanism, elastic elements are attached to provide resisting force for holding the tool as well as for producing torque output when a gripper releases the tool. The tool is entirely mechanical, allowing robots to use the tool without any peripherals and power supply. The paper presents the details of the tool design, optimizes its dimensions and effective stroke lengths, and studies the contacts and forces to achieve stable grasping and screwing. Besides the design, the paper develops manipulation policies for the tool. The policies include visual recognition, picking-up and manipulation, and exchanging tooltips. The developed tool produces clockwise rotation at the front end and counter-clockwise rotation at the back end. Various tooltips can be installed at both two ends. Robots may employ the developed manipulation policies to exchange the tooltips and rotating directions following the needs of specific fastening or loosening tasks. Robots can also reorient the tool using pick-and-place or handover, and move the tool to work poses using the policies. The designed tool, together with the developed manipulation policies, are analyzed and verified in several real-world applications. The tool is small, cordless, convenient, and has good robustness and adaptability.


title: Vacuum Acceptance Tests for Particle Accelerator Equipment

abstract: The effective and reliable operation of particle accelerator machines is strongly related to obtaining and keeping the required ultra-high vacuum level. This paper briefly presents some generic requirements to take in consideration for components that need to be installed in a particle accelerator like design constraints, materials choices, chemical cleaning process, outgassing rate, and their possible mitigation. Moreover, it will discuss vacuum acceptance tests put in place in the CERN accelerator complex for both, baked and unbaked system.


title: Twisted sheaves and $\mathrm{SU}(r) / \mathbb{Z}_r$ Vafa-Witten theory

abstract: The $\mathrm{SU}(r)$ Vafa-Witten partition function, which virtually counts Higgs pairs on a projective surface $S$, was mathematically defined by Tanaka-Thomas. On the Langlands dual side, the first-named author recently introduced virtual counts of Higgs pairs on $\mu_r$-gerbes. In this paper, we instead use Yoshioka's moduli spaces of twisted sheaves. Using Chern character twisted by rational $B$-field, we give a new mathematical definition of the $\mathrm{SU}(r) / \mathbb{Z}_r$ Vafa-Witten partition function when $r$ is prime. Our definition uses the period-index theorem of de Jong. $S$-duality, a concept from physics, predicts that the $\mathrm{SU}(r)$ and $\mathrm{SU}(r) / \mathbb{Z}_r$ partitions functions are related by a modular transformation. We turn this into a mathematical conjecture, which we prove for all $K3$ surfaces and prime numbers $r$.


title: Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation

abstract: Much recent effort has been invested in non-autoregressive neural machine translation, which appears to be an efficient alternative to state-of-the-art autoregressive machine translation on modern GPUs. In contrast to the latter, where generation is sequential, the former allows generation to be parallelized across target token positions. Some of the latest non-autoregressive models have achieved impressive translation quality-speed tradeoffs compared to autoregressive baselines. In this work, we reexamine this tradeoff and argue that autoregressive baselines can be substantially sped up without loss in accuracy. Specifically, we study autoregressive models with encoders and decoders of varied depths. Our extensive experiments show that given a sufficiently deep encoder, a single-layer autoregressive decoder can substantially outperform strong non-autoregressive models with comparable inference speed. We show that the speed disadvantage for autoregressive baselines compared to non-autoregressive methods has been overestimated in three aspects: suboptimal layer allocation, insufficient speed measurement, and lack of knowledge distillation. Our results establish a new protocol for future research toward fast, accurate machine translation. Our code is available at https://github.com/jungokasai/deep-shallow.


title: On the Robustness of Active Learning

abstract: Active Learning is concerned with the question of how to identify the most useful samples for a Machine Learning algorithm to be trained with. When applied correctly, it can be a very powerful tool to counteract the immense data requirements of Artificial Neural Networks. However, we find that it is often applied with not enough care and domain knowledge. As a consequence, unrealistic hopes are raised and transfer of the experimental results from one dataset to another becomes unnecessarily hard. In this work we analyse the robustness of different Active Learning methods with respect to classifier capacity, exchangeability and type, as well as hyperparameters and falsely labelled data. Experiments reveal possible biases towards the architecture used for sample selection, resulting in suboptimal performance for other classifiers. We further propose the new "Sum of Squared Logits" method based on the Simpson diversity index and investigate the effect of using the confusion matrix for balancing in sample selection.


title: Conformal Moduli of Symmetric Circular Quadrilaterals With Cusps

abstract: We investigate moduli of planar circular quadrilaterals symmetric with respect to both the coordinate axes. First we develop an analytic approach which reduces this problem to ODEs and devise a numeric method to find out the accessory parameters. This method uses the Schwarz equation to determine conformal mapping of the unit disk onto a given circular quadrilateral. We also give an example of a circular quadrilateral for which the value of the conformal modulus can be found in the analytic form; this example is used to validate the numeric calculations. We also use another method, so called hpFEM, for the numeric calculation of the moduli. These two different approaches provide results agreeing with high accuracy.


title: Weighted Cuntz Algebras

abstract: We study the $C^*$-algebra $\mathcal{T}/\mathcal{K}$ where $\mathcal{T}$ is the $C^*$-algebra generated by $d$ weighted shifts on the Fock space of $\mathbb{C}^d$, $\mathcal{F}(\mathbb{C}^d)$, ( where the weights are given by a sequence $\{Z_k\}$ of matrices $Z_k\in M_{d^k}(\mathbb{C})$) and $\mathcal{K}$ is the algebra of compact operators on the Fock space. If $Z_k=I$ for every $k$, $\mathcal{T}/\mathcal{K}$ is the Cuntz algebra $\mathcal{O}_d$. We show that $\mathcal{T}/\mathcal{K}$ is isomorphic to a Cuntz-Pimsner algebra and use it to find conditions for the algebra to be simple. We present examples of simple and of non simple algebras of this type. We also describe the $C^*$-representations of $\mathcal{T}/\mathcal{K}$.


title: On Frequency Response Function Identification for Advanced Motion Control

abstract: A key step in control of precision mechatronic systems is Frequency Response Function (FRF) identification. The aim of this paper is to illustrate relevant developments and solutions for FRF identification for advanced motion control. Specifically dealing with transient and/or closed-loop conditions that can normally lead to inaccurate estimation results. This yields essential insights for FRF identification for advanced motion control that are illustrated through a simulation study and validated on an experimental setup.


title: Prediction of a Feshbach Resonance in the Below-the-Barrier Reactive Scattering of Vibrationally Excited HD with H

abstract: Quantum reactive scattering calculations on the vibrational quenching of HD due to collisions with H were carried out employing an accurate potential energy surface. The state-to-state cross sections for the chemical reaction HD ($v=1, \ j=0$) + H $\rightarrow$ D + H$_2$ ($v'=0, \ j'$) at collision energies between 1 and 10,000 cm$^{-1}$ are presented, and a Feshbach resonance in the low-energy regime, below the reaction barrier, is observed for the first time. The resonance is attributed to coupling with the vibrationally adiabatic potential correlating to the $v=1, \ j=1$ level of the HD molecule, and it is dominated by the contribution from a single partial wave. The properties of the resonance, such as its dynamic behavior, phase behavior, and lifetime, are discussed.


title: On the comparison of spans and bisets

abstract: We compare the bicategory of spans with that of bisets (a.k.a. bimodules, distributors, profunctors) in the context of finite groupoids. We construct in particular a well-behaved pseudo-functor from spans to bisets. This yields an application to the axiomatic representation theory of finite groups, namely a new proof and a strengthening of Ganter and Nakaoka's identification of Bouc's category of biset functors as a reflective subcategory of global Mackey functors. To this end, we also prove a tensor-monadicity result for linear functor categories.


title: The Weather Impacts the Outbreak of COVID-19 in Mainland China

abstract: Recent literature has suggested that climate conditions have considerably significant influences on the transmission of coronavirus COVID-19. However, there is a lack of comprehensive study that investigates the relationships between multiple weather factors and the development of COVID-19 pandemic while excluding the impact of social factors. In this paper, we study the relationships between six main weather factors and the infection statistics of COVID-19 on 250 cities in Mainland China. Our correlation analysis using weather and infection statistics indicates that all the studied weather factors are correlated with the spread of COVID-19, where precipitation shows the strongest correlation. We also build a weather-aware predictive model that forecasts the number of infected cases should there be a second wave of the outbreak in Mainland China. Our predicted results show that cities located in different geographical areas are likely to be challenged with the second wave of COVID-19 at very different time periods and the severity of the outbreak varies to a large degree, in correspondence with the varying weather conditions.


title: Stable glassy configurations of the Kob-Andersen model using swap Monte Carlo

abstract: The swap Monte Carlo algorithm allows the preparation of highly stable glassy configurations for a number of glass-formers, but is inefficient for some models, such as the much studied binary Kob-Andersen (KA) mixture. We have recently developed generalisations to the KA model where swap can be very effective. Here, we show that these models can in turn be used to considerably enhance the stability of glassy configurations in the original KA model at no computational cost. We successfully develop several numerical strategies both in and out of equilibrium to achieve this goal and show how to optimise them. We provide several physical measurements indicating that the proposed algorithms considerably enhance mechanical and thermodynamic stability in the KA model, including a transition towards brittle yielding behaviour. Our results thus pave the way for future studies of stable glasses using the KA model.


title: Geodesic Loewner paths with varying boundary conditions

abstract: Equations of the Loewner class subject to non-constant boundary conditions along the real axis, are formulated and solved giving the geodesic paths of slits growing in the upper half complex plane. The problem is motivated by Laplacian growth in which the slits represent thin fingers growing in a diffusion field. A single finger follows a curved path determined by the forcing function appearing in Loewner's equation. This function is found by solving an ordinary differential equation whose terms depend on curvature properties of the streamlines of the diffusive field in the conformally mapped `mathematical' plane. The effect of boundary conditions specifying either piecewise constant values of the field variable along the real axis, or a dipole placed on the real axis, reveal a range of behaviours for the growing slit. These include regions along the real axis from which no slit growth is possible, regions where paths grow to infinity, or regions where paths curve back toward the real axis terminating in finite time. Symmetric pairs of paths subject to the piecewise constant boundary condition along the real axis are also computed, demonstrating that paths which grow to infinity evolve asymptotically toward an angle of bifurcation of $\pi/5$.


title: Temperature-Dependent Modeling of Thermoelectric Elements

abstract: Active thermal control is crucial in achieving the required accuracy and throughput in many industrial applications, e.g., in the medical industry, high-power lighting industry, and semiconductor industry. Thermoelectric Modules (TEMs) can be used to both heat and cool, alleviating some of the challenges associated with traditional electric heater based control. However, the dynamic behavior of these modules is non-affine in their inputs and state, complicating their implementation. To facilitate advanced control approaches a high fidelity model is required. In this work an approach is presented that increases the modeling accuracy by incorporating temperature dependent parameters. Using an experimental identification procedure, the parameters are estimated under different operating conditions. The resulting model achieves superior accuracy for a wide range of temperatures, demonstrated using experimental validation measurements.


title: Video Semantic Segmentation with Distortion-Aware Feature Correction

abstract: Video semantic segmentation is active in recent years benefited from the great progress of image semantic segmentation. For such a task, the per-frame image segmentation is generally unacceptable in practice due to high computation cost. To tackle this issue, many works use the flow-based feature propagation to reuse the features of previous frames. However, the optical flow estimation inevitably suffers inaccuracy and then causes the propagated features distorted. In this paper, we propose distortion-aware feature correction to alleviate the issue, which improves video segmentation performance by correcting distorted propagated features. To be specific, we firstly propose to transfer distortion patterns from feature into image space and conduct effective distortion map prediction. Benefited from the guidance of distortion maps, we proposed Feature Correction Module (FCM) to rectify propagated features in the distorted areas. Our proposed method can significantly boost the accuracy of video semantic segmentation at a low price. The extensive experimental results on Cityscapes and CamVid show that our method outperforms the recent state-of-the-art methods.


title: Exact dynamics of concurrence-based entanglement in a system of four spin-1/2 particles on a triangular ladder structure

abstract: Motivated by the ability of triangular spin ladders to implement quantum information processing, we propose a type of such systems whose Hamiltonian includes the XX Heisenberg interaction on the rungs and DzyaloshinskiiMoriya (DM) coupling over the legs. In this work, we discuss how tuning the magnetic interactions between elements of a nanomagnetic cell of a triangular ladder which contains four qubits influences on the dynamical behavior of entanglement shared between any pairs of the system. In this work, we make use of concurrence for monitoring entanglement. It is realized that the generation of quantum W states is an important feature of the present model when the system evolves unitarily with time. In general, coincidence with the emergence of W states, the concurrences of all pairs are equal to $N/2$, where N is the number of system's qubits. We also obtain the precise relationship between the incidence of such states and the value of DM interaction as well as the time of entanglement transfer. Finally, by studying the two-point quantum correlations and expectation values of different spin variables, we find that xx and yy correlations bring the entanglement to a maximum value for W states, whereas for these states, zz correlation between any pairs completely quenches. Our results reveal that although $S^{tot}_{z}$ does not commute with the system's Hamiltonian, its expectation value remains constant during time evolution which is a generic property of quantum W states.


title: No projective 16-divisible binary linear code of length 131 exists

abstract: We show that no projective 16-divisible binary linear code of length 131 exists. This implies several improved upper bounds for constant-dimension codes, used in random linear network coding, and partial spreads.


title: 3D Pipe Network Reconstruction Based on Structure from Motion with Incremental Conic Shape Detection and Cylindrical Constraint

abstract: Pipe inspection is a critical task for many industries and infrastructure of a city. The 3D information of a pipe can be used for revealing the deformation of the pipe surface and position of the camera during the inspection. In this paper, we propose a 3D pipe reconstruction system using sequential images captured by a monocular endoscopic camera. Our work extends a state-of-the-art incremental Structure-from-Motion (SfM) method to incorporate prior constraints given by the target shape into bundle adjustment (BA). Using this constraint, we can minimize the scale-drift that is the general problem in SfM. Moreover, our method can reconstruct a pipe network composed of multiple parts including straight pipes, elbows, and tees. In the experiments, we show that the proposed system enables more accurate and robust pipe mapping from a monocular camera in comparison with existing state-of-the-art methods.


title: Much ado about nothing: cosmological and anthropic limits of quantum fluctuations

abstract: This paper deals with the philosophical issues of the notion of nothingness and pre-inflationary stage of the universe in physical cosmology. We presuppose that, in addition to cosmological limits, there may be both anthropic and computational limits for our ability to understand and replicate the conditions before the Big Bang. That is, the very notion of nothingness and pre-Big Bang state may be conceptually, but not computationally grasped.


title: Topology synthesis of a 3-kink contact-aided compliant switch

abstract: A topology synthesis approach to design 2D Contact-aided Compliant Mechanisms (CCMs) to trace output paths with three or more kinks is presented. Synthesis process uses three different types of external, rigid contact surfaces: circular, elliptical and rectangular: which in combination, offer intricate local curvatures that CCMs can benefit from, to deliver desired, complex output characteristics. A network of line elements is employed to generate topologies. A set of circular subregions is laid over this network, and external contact surfaces are generated within each subregion. Both, discrete and continuous design variables are employed: the former set controls the CCM topology, appearance and type of external contact surfaces, whereas the latter set governs shapes and sizes of the CCM constituents, and sizes of contact surfaces. All contact types are permitted with contact modeling made significantly easier through identification of outer and inner loops. Line topologies are fleshed out via a user-defined number of quadrilateral elements along lateral and longitudinal directions. Candidate CCM designs are carefully preprocessed before analysis via a commercial software and evolution using a stochastic search. The process is exemplified via a contact-aided, 3-kink mechanical switch which is thoroughly analysed in presence of friction and wear.


title: SceneAdapt: Scene-based domain adaptation for semantic segmentation using adversarial learning

abstract: Semantic segmentation methods have achieved outstanding performance thanks to deep learning. Nevertheless, when such algorithms are deployed to new contexts not seen during training, it is necessary to collect and label scene-specific data in order to adapt them to the new domain using fine-tuning. This process is required whenever an already installed camera is moved or a new camera is introduced in a camera network due to the different scene layouts induced by the different viewpoints. To limit the amount of additional training data to be collected, it would be ideal to train a semantic segmentation method using labeled data already available and only unlabeled data coming from the new camera. We formalize this problem as a domain adaptation task and introduce a novel dataset of urban scenes with the related semantic labels. As a first approach to address this challenging task, we propose SceneAdapt, a method for scene adaptation of semantic segmentation algorithms based on adversarial learning. Experiments and comparisons with state-of-the-art approaches to domain adaptation highlight that promising performance can be achieved using adversarial learning both when the two scenes have different but points of view, and when they comprise images of completely different scenes. To encourage research on this topic, we made our code available at our web page: https://iplab.dmi.unict.it/ParkSmartSceneAdaptation/.


title: A Theory of Black-Box Tests

abstract: The purpose of testing a system with respect to a requirement is to refute the hypothesis that the system satisfies the requirement. We build a theory of tests and refutation based on the elementary notions of satisfaction and refinement. We use this theory to characterize the requirements that can be refuted through black-box testing and, dually, verified through such tests. We consider refutation in finite time and obtain the finite falsifiability of hyper-safety temporal requirements as a special case. We extend our theory with computational constraints and separate refutation from enforcement in the context of temporal hyper-properties. Overall, our theory provides a basis to analyze the scope and reach of black-box tests and to bridge results from diverse areas including testing, verification, and enforcement.


title: Self-supervised Learning for Speech Enhancement

abstract: Supervised learning for single-channel speech enhancement requires carefully labeled training examples where the noisy mixture is input into the network and the network is trained to produce an output close to the ideal target. To relax the conditions on the training data, we consider the task of training speech enhancement networks in a self-supervised manner. We first use a limited training set of clean speech sounds and learn a latent representation by autoencoding on their magnitude spectrograms. We then autoencode on speech mixtures recorded in noisy environments and train the resulting autoencoder to share a latent representation with the clean examples. We show that using this training schema, we can now map noisy speech to its clean version using a network that is autonomously trainable without requiring labeled training examples or human intervention.


title: Interactive Recommender System via Knowledge Graph-enhanced Reinforcement Learning

abstract: Interactive recommender system (IRS) has drawn huge attention because of its flexible recommendation strategy and the consideration of optimal long-term user experiences. To deal with the dynamic user preference and optimize accumulative utilities, researchers have introduced reinforcement learning (RL) into IRS. However, RL methods share a common issue of sample efficiency, i.e., huge amount of interaction data is required to train an effective recommendation policy, which is caused by the sparse user responses and the large action space consisting of a large number of candidate items. Moreover, it is infeasible to collect much data with explorative policies in online environments, which will probably harm user experience. In this work, we investigate the potential of leveraging knowledge graph (KG) in dealing with these issues of RL methods for IRS, which provides rich side information for recommendation decision making. Instead of learning RL policies from scratch, we make use of the prior knowledge of the item correlation learned from KG to (i) guide the candidate selection for better candidate item retrieval, (ii) enrich the representation of items and user states, and (iii) propagate user preferences among the correlated items over KG to deal with the sparsity of user feedback. Comprehensive experiments have been conducted on two real-world datasets, which demonstrate the superiority of our approach with significant improvements against state-of-the-arts.


title: Appearance Learning for Image-based Motion Estimation in Tomography

abstract: In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Geometric information within this process is usually depending on the system setting only, i. e., the scanner position or readout direction. Patient motion therefore corrupts the geometry alignment in the reconstruction process resulting in motion artifacts. We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object. To this end, we train a siamese triplet network to predict the reprojection error (RPE) for the complete acquisition as well as an approximate distribution of the RPE along the single views from the reconstructed volume in a multi-task learning approach. The RPE measures the motioninduced geometric deviations independent of the object based on virtual marker positions, which are available during training. We train our network using 27 patients and deploy a 21-4-2 split for training, validation and testing. In average, we achieve a residual mean RPE of 0.013mm with an inter-patient standard deviation of 0.022 mm. This is twice the accuracy compared to previously published results. In a motion estimation benchmark the proposed approach achieves superior results in comparison with two state-of-the-art measures in nine out of twelve experiments. The clinical applicability of the proposed method is demonstrated on a motion-affected clinical dataset.


title: Non-Hermiticity and topological invariants of magnon Bogoliubov-de Gennes systems

abstract: Since the theoretical prediction and experimental observation of the thermal Hall effect of magnons, a variety of novel phenomena that may occur in magnonic systems have been proposed. In this paper, we review the recent advances in the study of topological phases of magnon Bogoliubov-de Gennes (BdG) systems. After giving an overview of the previous works on electronic topological insulators and the thermal Hall effect of magnons, we provide the necessary background for bosonic BdG systems, with a particular emphasis on their non-Hermiticity arising from the diagonalization of the BdG Hamiltonian. After that, we introduce the definitions of $ \mathbb{Z}_2 $ topological invariants for bosonic systems with pseudo-time-reversal symmetry, which ensures the existence of bosonic counterparts of "Kramers pairs". Because of the intrinsic non-Hermiticity of the bosonic BdG systems, these topological invariants have to be defined in terms of the bosonic Berry connection and curvature. We then introduce theoretical models that can be thought of as magnonic analogues of two- and three-dimensional topological insulators in class AII. We demonstrate analytically and numerically that the $ \mathbb{Z}_2 $ topological invariants precisely characterize the presence of gapless edge/surface states. We also predict that bilayer CrI$_3$ with a particular stacking would be an ideal candidate for realization of a two-dimensional magnon system characterized by a nontrivial $ \mathbb{Z}_2 $ topological invariant. For three-dimensional topological magnon systems, the thermal Hall effect of magnons is expected to occur when a magnetic field is applied to the surface.


title: Microscopic Calculation of $\Lambda-\alpha$ Folding Potential

abstract: We construct a folding potential between the $\alpha$ and $\Lambda$ particles based on underlying nucleon-nucleon and hyperon-nucleon interactions. Starting from a phenomenological $\Lambda$-N potential and a Gaussian form of the $\alpha$-particle wave function we obtain for the built $\alpha$-$\Lambda$ interaction a bound $^5_\Lambda$He state with the binding energy (3.10 MeV), which is consistent with recent experimental data $3.12 \pm 0.02$ MeV. When in turn an exact solution of the four-body Faddeev-Yakubovsky equation for the $\alpha$-particle calculated with the CDBonn, Nijmegen or Argonne V18 realistic nucleon-nucleon potential is used and the phenomenological Gaussian $\Lambda$-N potential is replaced by the realistic (Nijmegen NSC97f) potential approximated by a rank-1 separable form, then $^5_\Lambda$He is overbound. In particular, its binding energy given by the folding potential generated with the $\alpha$ particle wave function based on the CDBonn potential is 7.47 MeV. Although the rank-1 separable $\Lambda$-N potential reproduces the exact scattering length and the effective range of the original $\Lambda$-N potential, the overbinding results from the lack of the required repulsive properties in the assumed separable form.


title: A general relation between stacking order and Chern index: a topological map of minimally twisted bilayer graphene

abstract: We derive a general relation between the stacking vector ${\bf u}$ describing the relative shift of two layers of bilayer graphene and the Chern index. We find $C = \nu - \text{sign}\left(|V_{AB}|-|V_{BA}|\right)$, where $\nu$ is a valley index and $|V_{\alpha\beta}|$ the absolute value of stacking potentials that depend on ${\bf u}$ and that uniquely determine the interlayer interaction; AA stacking plays no role in the topological character. With this expression we show that while ideal and relaxed minimally twisted bilayer graphene appear so distinct as to be almost different materials, their Chern index maps are, remarkably, identical. The topological physics of this material is thus strongly robust to lattice relaxations.


title: Bulk-to-surface misorientation and the spin texture of topological insulators

abstract: Weak topological insulators possess a symmetry related set of Dirac-Weyl cones in the surface Brillouin zone, implying misorientation between the principle axis of the low energy manifold of the bulk and the surface normal. We show that this feature of weak topological insulators comes with a hidden richness of surface spin textures, and that by misorientation a helical texture can become an unusual hyperbolic spin texture. We illustrate this effect by comparison of the $M$-point and $\Gamma$-point Dirac-Weyl cones on the (111) surface of the crystalline topological insulator SnTe.


title: Spin texture in weak topological insulators: the role of bulk states and band bending

abstract: We derive the spin texture of a weak topological insulator via a supersymmetric approach that includes the roles of the bulk gap edge states and surface band bending. We find the spin texture can take one of four forms: (i) helical, (ii) hyperbolic, (iii) hedgehog, with spins normal to the Dirac-Weyl cone of the surface state, and (iv) hyperbolic hedgehog. Band bending determines the winding number in the case of a helical texture, and for all textures can be used to tune the spin texture polarization to zero. For the weak topological insulator SnTe, we show that inclusion of band bending is crucial to obtain the correct texture winding number for the (111) surface facet $\Gamma$-point Dirac-Weyl cone. We argue that hedgehogs will be found only in low symmetry situations.


title: OMBA: User-Guided Product Representations for Online Market Basket Analysis

abstract: Market Basket Analysis (MBA) is a popular technique to identify associations between products, which is crucial for business decision making. Previous studies typically adopt conventional frequent itemset mining algorithms to perform MBA. However, they generally fail to uncover rarely occurring associations among the products at their most granular level. Also, they have limited ability to capture temporal dynamics in associations between products. Hence, we propose OMBA, a novel representation learning technique for Online Market Basket Analysis. OMBA jointly learns representations for products and users such that they preserve the temporal dynamics of product-to-product and user-to-product associations. Subsequently, OMBA proposes a scalable yet effective online method to generate products' associations using their representations. Our extensive experiments on three real-world datasets show that OMBA outperforms state-of-the-art methods by as much as 21%, while emphasizing rarely occurring strong associations and effectively capturing temporal changes in associations.


title: Steady three-dimensional ideal flows with nonvanishing vorticity in domains with edges

abstract: We prove an existence result for solutions to the stationary Euler equations in a domain with nonsmooth boundary. This is an extension of a previous existence result in smooth domains by Alber (1992). The domains we consider have a boundary consisting of three parts, one where fluid flows into the domain, one where the fluid flows out, and one which no fluid passes through. These three parts meet at right angles. An example of this would be a right cylinder with fluid flowing in at one end and out at the other, with no fluid going through the mantle. A large part of the proof is dedicated to studying the Poisson equation and the related compatibility conditions required for solvability in this kind of domain.


title: Leveraging Model Inherent Variable Importance for Stable Online Feature Selection

abstract: Feature selection can be a crucial factor in obtaining robust and accurate predictions. Online feature selection models, however, operate under considerable restrictions; they need to efficiently extract salient input features based on a bounded set of observations, while enabling robust and accurate predictions. In this work, we introduce FIRES, a novel framework for online feature selection. The proposed feature weighting mechanism leverages the importance information inherent in the parameters of a predictive model. By treating model parameters as random variables, we can penalize features with high uncertainty and thus generate more stable feature sets. Our framework is generic in that it leaves the choice of the underlying model to the user. Strikingly, experiments suggest that the model complexity has only a minor effect on the discriminative power and stability of the selected feature sets. In fact, using a simple linear model, FIRES obtains feature sets that compete with state-of-the-art methods, while dramatically reducing computation time. In addition, experiments show that the proposed framework is clearly superior in terms of feature selection stability.


title: The anisotropy of the power spectrum in periodic cosmological simulations

abstract: The classical gravitational force on a torus is anisotropic and always lower than Newton's $1/r^2$ law. We demonstrate the effects of periodicity in dark matter only $N$-body simulations of spherical collapse and standard $\Lambda$CDM initial conditions. Periodic boundary conditions cause an overall negative and anisotropic bias in cosmological simulations of cosmic structure formation. The lower amplitude of power spectra of small periodic simulations are a consequence of the missing large scale modes and the equally important smaller periodic forces. The effect is most significant when the largest mildly non-linear scales are comparable to the linear size of the simulation box, as often is the case for high-resolution hydrodynamical simulations. Spherical collapse morphs into a shape similar to an octahedron. The anisotropic growth distorts the large-scale $\Lambda$CDM dark matter structures. We introduce the direction-dependent power spectrum invariant under the octahedral group of the simulation volume and show that the results break spherical symmetry.


title: Median Matrix Completion: from Embarrassment to Optimality

abstract: In this paper, we consider matrix completion with absolute deviation loss and obtain an estimator of the median matrix. Despite several appealing properties of median, the non-smooth absolute deviation loss leads to computational challenge for large-scale data sets which are increasingly common among matrix completion problems. A simple solution to large-scale problems is parallel computing. However, embarrassingly parallel fashion often leads to inefficient estimators. Based on the idea of pseudo data, we propose a novel refinement step, which turns such inefficient estimators into a rate (near-)optimal matrix completion procedure. The refined estimator is an approximation of a regularized least median estimator, and therefore not an ordinary regularized empirical risk estimator. This leads to a non-standard analysis of asymptotic behaviors. Empirical results are also provided to confirm the effectiveness of the proposed method.


title: Moderate parts in regenerative compositions: the case of regular variation

abstract: A regenerative random composition of integer $n$ is constructed by allocating $n$ standard exponential points over a countable number of intervals, comprising the complement of the closed range of a subordinator $S$. Assuming that the L\'{e}vy measure of $S$ is infinite and regularly varying at zero of index $-\alpha$, $\alpha\in(0,\,1)$, we find an explicit threshold $r=r(n)$, such that the number $K_{n,\,r(n)}$ of blocks of size $r(n)$ converges in distribution without any normalization to a mixed Poisson distribution. The sequence $(r(n))$ turns out to be regularly varying with index $\alpha/(\alpha+1)$ and the mixing distribution is that of the exponential functional of $S$. The result is derived as a consequence of a general Poisson limit theorem for an infinite occupancy scheme with power-like decay of the frequencies. We also discuss asymptotic behavior of $K_{n,\,w(n)}$ in cases when $w(n)$ diverges but grows slower than $r(n)$. Our findings complement previously known strong laws of large numbers for $K_{n,\,r}$ in case of a fixed $r\in\mathbb{N}$. As a key tool we employ new Abelian theorems for Laplace--Stiletjes transforms of regularly varying functions with the indexes of regular variation diverging to infinity.


title: Arbitrary polarization conversion for pure vortex generation with a single metasurface

abstract: The purity of an optical vortex beam depends on the spread of its energy among different azimuthal and radial modes. The smaller is this spread, the higher is the vortex purity and the more efficient are its creation and detection. There are several methods to generate vortex beams with well-defined orbital angular momentum but only few exist allowing to select a pure radial mode. These typically consist of many optical elements with rather complex arrangements, including active cavity resonators. Here we show that it is possible to generate pure vortex beams using a single metasurface plate in combination with a polarizer. We generalize an existing theory of independent phase and amplitude control with birefringent nanopillars considering arbitrary input polarization states. The high purity, sizeable creation efficiency and impassable compactness make the presented approach a powerful complex amplitude modulation tool for pure vortex generation, even in the case of large topological charges.


title: Primitive stability and the Bowditch conditions revisited

abstract: The equivalence of two conditions on the primitive elements in an $SL(2,\mathbb C)$ representation of the free group $F_2 = <a,b>$, namely Minsky's condition of primitive stability and the $BQ$-conditions introduced by Bowditch and generalised by Tan, Wong and Zhang, has been proved by Lee and Xu and independently by the author in arXiv:1901.01396. This note is a revised version of our original proof, which is greatly simplified by incorporating some of the ideas introduced by Lee and Xu, combined with the language of the Bowditch tree.


title: Clustering of fast Coronal Mass Ejections during the solar cycles 23 and 24 and implications for CME-CME interactions

abstract: We study the clustering properties of fast Coronal Mass Ejections (CMEs) that occurred during solar cycles 23 and 24. We apply two methods: the Max spectrum method can detect the predominant clusters and the de-clustering threshold time method provides details on the typical clustering properties and time scales. Our analysis shows that during the different phases of solar cycles 23 and 24, CMEs with speed $\geq 1000\ km/s$ preferentially occur as isolated events and in clusters with on average two members. However, clusters with more members appear particularly during the maximum phases of the solar cycles. Over the total period and in the maximum phases of solar cycles 23 and 24, about 50% are isolated events, 18% (12%) occur in clusters with 2 (3) members, and another 20% in larger clusters $\geq 4$, whereas in solar minimum fast CMEs tend to occur more frequently as isolated events (62%). During different solar cycle phases, the typical de-clustering time scales of fast CMEs are $\tau_c=28-32\ hrs$, irrespective of the very different occurrence frequencies of CMEs during solar minimum and maximum. These findings suggest that $\tau_c$ for extreme events may reflect the characteristic energy build-up time for large flare and CME-prolific active ARs. Associating statistically the clustering properties of fast CMEs with the Disturbance storm index Dst at Earth suggests that fast CMEs occuring in clusters tend to produce larger geomagnetic storms than isolated fast CMEs. This may be related to CME-CME interaction producing a more complex and stronger interaction with the Earth magnetosphere.


title: Toward a quantum-enhanced strontium optical lattice clock at INRIM

abstract: The new strontium atomic clock at INRIM seeks to establish a new frontier in quantum measurement by joining state-of-the-art optical lattice clocks and the quantized electromagnetic field provided by a cavity QED setup. The goal of our experiment is to apply advanced quantum techniques to state-of-the-art optical lattice clocks, demonstrating enhanced sensitivity while preserving long coherence times and the highest accuracy. In this paper we describe the current status of the experiment and the prospected sensitivity gain for the designed cavity QED setup.


title: Fourth-Order Anisotropic Diffusion for Inpainting and Image Compression

abstract: Edge-enhancing diffusion (EED) can reconstruct a close approximation of an original image from a small subset of its pixels. This makes it an attractive foundation for PDE based image compression. In this work, we generalize second-order EED to a fourth-order counterpart. It involves a fourth-order diffusion tensor that is constructed from the regularized image gradient in a similar way as in traditional second-order EED, permitting diffusion along edges, while applying a non-linear diffusivity function across them. We show that our fourth-order diffusion tensor formalism provides a unifying framework for all previous anisotropic fourth-order diffusion based methods, and that it provides additional flexibility. We achieve an efficient implementation using a fast semi-iterative scheme. Experimental results on natural and medical images suggest that our novel fourth-order method produces more accurate reconstructions compared to the existing second-order EED.


title: Self-and-Mixed Attention Decoder with Deep Acoustic Structure for Transformer-based LVCSR

abstract: The Transformer has shown impressive performance in automatic speech recognition. It uses the encoder-decoder structure with self-attention to learn the relationship between the high-level representation of the source inputs and embedding of the target outputs. In this paper, we propose a novel decoder structure that features a self-and-mixed attention decoder (SMAD) with a deep acoustic structure (DAS) to improve the acoustic representation of Transformer-based LVCSR. Specifically, we introduce a self-attention mechanism to learn a multi-layer deep acoustic structure for multiple levels of acoustic abstraction. We also design a mixed attention mechanism that learns the alignment between different levels of acoustic abstraction and its corresponding linguistic information simultaneously in a shared embedding space. The ASR experiments on Aishell-1 shown that the proposed structure achieves CERs of 4.8% on the dev set and 5.1% on the test set, which are the best results obtained on this task to the best of our knowledge.


title: Overcoming Classifier Imbalance for Long-tail Object Detection with Balanced Group Softmax

abstract: Solving long-tail large vocabulary object detection with deep learning based models is a challenging and demanding task, which is however under-explored.In this work, we provide the first systematic analysis on the underperformance of state-of-the-art models in front of long-tail distribution. We find existing detection methods are unable to model few-shot classes when the dataset is extremely skewed, which can result in classifier imbalance in terms of parameter magnitude. Directly adapting long-tail classification models to detection frameworks can not solve this problem due to the intrinsic difference between detection and classification.In this work, we propose a novel balanced group softmax (BAGS) module for balancing the classifiers within the detection frameworks through group-wise training. It implicitly modulates the training process for the head and tail classes and ensures they are both sufficiently trained, without requiring any extra sampling for the instances from the tail classes.Extensive experiments on the very recent long-tail large vocabulary object recognition benchmark LVIS show that our proposed BAGS significantly improves the performance of detectors with various backbones and frameworks on both object detection and instance segmentation. It beats all state-of-the-art methods transferred from long-tail image classification and establishes new state-of-the-art.Code is available at https://github.com/FishYuLi/BalancedGroupSoftmax.


title: A softwarized perspective of the 5G networks

abstract: The main goal of this article is to present the fundamental theoretical concepts for the tutorial presented in IEEE NetSoft 2020. The article explores the use of software in the 5G system composed of the Radio Access Network (RAN) and the core components, following the standards defined by 3GPP, particularly the Release 15. The article provides a brief overview of mobile cellular networks, including basic concepts, operations, and evolution through the called `generations' of mobile networks. From a software perspective, RAN is presented in the context of 4G and 5G networks, which includes the virtualization and disaggregation concepts. A significant part of the article is dedicated to 5G networks and beyond, focusing on core, i.e., considering the Service-Based Architecture (SBA), due to its relevance and totally softwarized approach. Finally, the article briefly describes the demonstrations presented in IEEE NetSoft 2020, providing the link for the repository that has all material employed in the tutorial.


title: DREAM: Deep Regret minimization with Advantage baselines and Model-free learning

abstract: We introduce DREAM, a deep reinforcement learning algorithm that finds optimal strategies in imperfect-information games with multiple agents. Formally, DREAM converges to a Nash Equilibrium in two-player zero-sum games and to an extensive-form coarse correlated equilibrium in all other games. Our primary innovation is an effective algorithm that, in contrast to other regret-based deep learning algorithms, does not require access to a perfect simulator of the game to achieve good performance. We show that DREAM empirically achieves state-of-the-art performance among model-free algorithms in popular benchmark games, and is even competitive with algorithms that do use a perfect simulator.


title: Sparse bottleneck neural networks for exploratory non-linear visualization of Patch-seq data

abstract: Patch-seq, a recently developed experimental technique, allows neuroscientists to obtain transcriptomic and electrophysiological information from the same neurons. Efficiently analyzing and visualizing such paired multivariate data in order to extract biologically meaningful interpretations has, however, remained a challenge. Here, we use sparse deep neural networks with and without a two-dimensional bottleneck to predict electrophysiological features from the transcriptomic ones using a group lasso penalty, yielding concise and biologically interpretable two-dimensional visualizations. In two large example data sets, this visualization reveals known neural classes and their marker genes without biological prior knowledge. We also demonstrate that our method is applicable to other kinds of multimodal data, such as paired transcriptomic and proteomic measurements provided by CITE-seq.


title: Towards Open Ad Hoc Teamwork Using Graph-based Policy Learning

abstract: Ad hoc teamwork is the challenging problem of designing an autonomous agent which can adapt quickly to collaborate with teammates without prior coordination mechanisms, including joint training. Prior work in this area has focused on closed teams in which the number of agents is fixed. In this work, we consider open teams by allowing agents with different fixed policies to enter and leave the environment without prior notification. Our solution builds on graph neural networks to learn agent models and joint-action value models under varying team compositions. We contribute a novel action-value computation that integrates the agent model and joint-action value model to produce action-value estimates. We empirically demonstrate that our approach successfully models the effects other agents have on the learner, leading to policies that robustly adapt to dynamic team compositions and significantly outperform several alternative methods.


title: Are Pretrained Language Models Symbolic Reasoners Over Knowledge?

abstract: How can pretrained language models (PLMs) learn factual knowledge from the training set? We investigate the two most important mechanisms: reasoning and memorization. Prior work has attempted to quantify the number of facts PLMs learn, but we present, using synthetic data, the first study that investigates the causal relation between facts present in training and facts learned by the PLM. For reasoning, we show that PLMs seem to learn to apply some symbolic reasoning rules correctly but struggle with others, including two-hop reasoning. Further analysis suggests that even the application of learned reasoning rules is flawed. For memorization, we identify schema conformity (facts systematically supported by other facts) and frequency as key factors for its success.


title: Multi-Encoder-Decoder Transformer for Code-Switching Speech Recognition

abstract: Code-switching (CS) occurs when a speaker alternates words of two or more languages within a single sentence or across sentences. Automatic speech recognition (ASR) of CS speech has to deal with two or more languages at the same time. In this study, we propose a Transformer-based architecture with two symmetric language-specific encoders to capture the individual language attributes, that improve the acoustic representation of each language. These representations are combined using a language-specific multi-head attention mechanism in the decoder module. Each encoder and its corresponding attention module in the decoder are pre-trained using a large monolingual corpus aiming to alleviate the impact of limited CS training data. We call such a network a multi-encoder-decoder (MED) architecture. Experiments on the SEAME corpus show that the proposed MED architecture achieves 10.2% and 10.8% relative error rate reduction on the CS evaluation sets with Mandarin and English as the matrix language respectively.


title: Axion helioscopes as solar magnetometers

abstract: Axion helioscopes search for solar axions and axion-like particles via inverse Primakoff conversion in strong laboratory magnets pointed at the Sun. Anticipating the detection of solar axions, we determine the potential for the planned next-generation helioscope, the International Axion Observatory (IAXO), to measure or constrain the solar magnetic field. To do this we consider a previously neglected component of the solar axion flux at sub-keV energies arising from the conversion of longitudinal plasmons. This flux is sensitively dependent to the magnetic field profile of the Sun, with lower energies corresponding to axions converting into photons at larger solar radii. If the detector technology eventually installed in IAXO has an energy resolution better than 200 eV, then solar axions could become an even more powerful messenger than neutrinos of the magnetic field in the core of the Sun. For energy resolutions better than 10 eV, IAXO could access the inner 70% of the Sun and begin to constrain the field at the tachocline: the boundary between the radiative and convective zones. The longitudinal plasmon flux from a toroidal magnetic field also has an additional 2% geometric modulation effect which could be used to measure the angular dependence of the magnetic field.


title: Stochastic modelling of collective motor protein transport through a crossing of microtubules

abstract: The cytoskeleton in eukaryotic cells plays several crucial roles. In terms of intracellular transport, motor proteins use the cytoskeletal filaments as a backbone along which they can actively transport biological cargos such as vesicles carrying biochemical reactants. Crossings between such filaments constitute a key element, as they may serve to alter the destination of such payload. Although motor proteins are known to display a rich behaviour at such crossings, the latter have so far only been modelled as simple branching points. Here we explore a model for a crossing between two microtubules which retains the individual tracks consisting of protofilaments, and we construct a schematic representation of the transport paths. We study collective transport exemplified by the Totally Asymmetric Simple Exclusion Process (TASEP), and provide a full analysis of the transport features and the associated phase diagram, by a generic mean-field approach which we confirm through particle-based stochastic simulations. In particular we show that transport through such a compound crossing cannot be approximated from a coarse-grained structure with a simple branching point. Instead, it gives rise to entirely new and counterintuitive features: the fundamental current-density relation for traffic flow is no longer a single-valued function, and it furthermore differs according to whether it is observed upstream or downstream from the crossing. We argue that these novel features may be directly relevant for interpreting experimental measurements.


title: Deep Dense and Convolutional Autoencoders for Unsupervised Anomaly Detection in Machine Condition Sounds

abstract: This technical report describes two methods that were developed for Task 2 of the DCASE 2020 challenge. The challenge involves an unsupervised learning to detect anomalous sounds, thus only normal machine working condition samples are available during the training process. The two methods involve deep autoencoders, based on dense and convolutional architectures that use melspectogram processed sound features. Experiments were held, using the six machine type datasets of the challenge. Overall, competitive results were achieved by the proposed dense and convolutional AE, outperforming the baseline challenge method.


title: The norm of a skew polynomial

abstract: Let $D$ be a finite-dimensional division algebra over its center and $R=D[t;\sigma,\delta]$ a skew polynomial ring. Under certain assumptions on $\delta$ and $\sigma$, the ring of central quotients $D(t;\sigma,\delta) = \{f/g \,|\, f \in D[t;\sigma,\delta], g \in C(D[t;\sigma,\delta])\}$ of $D[t;\sigma,\delta]$ is a central simple algebra with reduced norm $N$. We calculate the norm $N(f)$ for some skew polynomials $f\in R$ and investigate when and how the reducibility of $N(f)$ reflects the reducibility of $f$.