title: Wave propagation in semi-convective regions of giant planets

abstract: Recent observations of Jupiter and Saturn suggest that heavy elements may be diluted in the gaseous envelope, providing a compositional gradient that could stabilise ordinary convection and produce a stably-stratified layer near the core of these planets. This region could consist of semi-convective layers with a staircase-like density profile, which have multiple convective zones separated by thin stably-stratified interfaces, as a result of double-diffusive convection. These layers could have important effects on wave propagation and tidal dissipation that have not been fully explored. We analyse the effects of these layers on the propagation and transmission of internal waves within giant planets, extending prior work in a local Cartesian model. We adopt a simplified global Boussinesq planetary model in which we explore the internal waves in a non-rotating spherical body. We begin by studying the free modes of a region containing semi-convective layers. We then analyse the transmission of internal waves through such a region. The free modes depend strongly on the staircase properties, and consist of modes with both internal and interfacial gravity wave-like behaviour. We determine the frequency shifts of these waves as a function of the number of steps to explore their potential to probe planetary internal structures. We also find that wave transmission is strongly affected by the presence of a staircase. Very large-wavelength waves are transmitted efficiently, but small-scale waves are only transmitted if they are resonant with one of the free modes. The effective size of the core is therefore larger for non-resonant modes.


title: Diminished Fermat-type arrangements and unexpected curves

abstract: The purpose of this note is to present and study a new series of the so-called unexpected curves. They enjoy a surprising property to the effect that their degree grows to infinity, whereas the multiplicity at a general fat point remains constant, equal $3$, which is the least possible number appearing as the multiplicity of an unexpected curve at its singular point. We show that additionally the BMSS dual curves inherits the same pattern of behaviour.


title: AI outperformed every dermatologist: Improved dermoscopic melanoma diagnosis through customizing batch logic and loss function in an optimized Deep CNN architecture

abstract: Melanoma, one of most dangerous types of skin cancer, re-sults in a very high mortality rate. Early detection and resection are two key points for a successful cure. Recent research has used artificial intelligence to classify melanoma and nevus and to compare the assessment of these algorithms to that of dermatologists. However, an imbalance of sensitivity and specificity measures affected the performance of existing models. This study proposes a method using deep convolutional neural networks aiming to detect melanoma as a binary classification problem. It involves 3 key features, namely customized batch logic, customized loss function and reformed fully connected layers. The training dataset is kept up to date including 17,302 images of melanoma and nevus; this is the largest dataset by far. The model performance is compared to that of 157 dermatologists from 12 university hospitals in Germany based on MClass-D dataset. The model outperformed all 157 dermatologists and achieved state-of-the-art performance with AUC at 94.4% with sensitivity of 85.0% and specificity of 95.0% using a prediction threshold of 0.5 on the MClass-D dataset of 100 dermoscopic images. Moreover, a threshold of 0.40858 showed the most balanced measure compared to other researches, and is promisingly application to medical diagnosis, with sensitivity of 90.0% and specificity of 93.8%.


title: Shape Reconstruction in Linear Elasticity: Standard and Linearized Monotonicity Method

abstract: In this paper, we deal with the inverse problem of the shape reconstruction of inclusions in elastic bodies. The main idea of this reconstruction is based on the monotonicity property of the Neumann-to-Dirichlet operator presented in a former article of the authors. Thus, we introduce the so-called standard as well as linearized monotonicity tests in order to detect and reconstruct inclusions. In addition, we compare these methods with each other and present several numerical test examples.


title: An Incremental Explanation of Inference in Hybrid Bayesian Networks for Increasing Model Trustworthiness and Supporting Clinical Decision Making

abstract: Various AI models are increasingly being considered as part of clinical decision-support tools. However, the trustworthiness of such models is rarely considered. Clinicians are more likely to use a model if they can understand and trust its predictions. Key to this is if its underlying reasoning can be explained. A Bayesian network (BN) model has the advantage that it is not a black-box and its reasoning can be explained. In this paper, we propose an incremental explanation of inference that can be applied to hybrid BNs, i.e. those that contain both discrete and continuous nodes. The key questions that we answer are: (1) which important evidence supports or contradicts the prediction, and (2) through which intermediate variables does the information flow. The explanation is illustrated using a real clinical case study. A small evaluation study is also conducted.


title: A symplectic integrator for molecular dynamics on a hypersphere

abstract: We present a reversible and symplectic algorithm called ROLL, for integrating the equations of motion in molecular dynamics simulations of simple fluids on a hypersphere $\mathcal{S}^d$ of arbitrary dimension $d$. It is derived in the framework of geometric algebra and shown to be mathematically equivalent to algorithm RATTLE. An application to molecular dynamics simulation of the one component plasma is briefly discussed.


title: Fuzzy k-Nearest Neighbors with monotonicity constraints: Moving towards the robustness of monotonic noise

abstract: This paper proposes a new model based on Fuzzy k-Nearest Neighbors for classification with monotonic constraints, Monotonic Fuzzy k-NN (MonFkNN). Real-life data-sets often do not comply with monotonic constraints due to class noise. MonFkNN incorporates a new calculation of fuzzy memberships, which increases robustness against monotonic noise without the need for relabeling. Our proposal has been designed to be adaptable to the different needs of the problem being tackled. In several experimental studies, we show significant improvements in accuracy while matching the best degree of monotonicity obtained by comparable methods. We also show that MonFkNN empirically achieves improved performance compared with Monotonic k-NN in the presence of large amounts of class noise.


title: Nowhere vanishing primitive of a symplectic form

abstract: Let $M$ be a manifold with an exact symplectic form $\omega$. Then there is a nowhere vanishing primitive $\beta$ for $\omega$, i.e. $\omega=\mathrm{d}\beta$.


title: Microservice Decomposition via Static and Dynamic Analysis of the Monolith

abstract: Migrating monolithic software systems into microservices requires the application of decomposition techniquesto find and select appropriate service boundaries. These techniques are often based on domain knowledge, static code analysis, and non-functional requirements such as maintainability. In this paper, we present our experience with an approach that extends static analysis with dynamic analysis of a legacy software system's runtime behavior, including the live trace visualization to support the decomposition into microservices. Overall, our approach combines established analysis techniques for microservice decomposition, such as the bounded context pattern of domain-driven design, and enriches the collected information via dynamic software visualization to identify appropriate microservice boundaries. In collaboration with the German IT service provider adesso SE, we applied our approach to their real-word, legacy lottery application in|FOCUS to identify good microservice decompositions for this layered monolithic Enterprise Java system.


title: BARK: Open Behavior Benchmarking in Multi-Agent Environments

abstract: Predicting and planning interactive behaviors in complex traffic situations presents a challenging task. Especially in scenarios involving multiple traffic participants that interact densely, autonomous vehicles still struggle to interpret situations and to eventually achieve their own mission goal. As driving tests are costly and challenging scenarios are hard to find and reproduce, simulation is widely used to develop, test, and benchmark behavior models. However, most simulations rely on datasets and simplistic behavior models for traffic participants and do not cover the full variety of real-world, interactive human behaviors. In this work, we introduce BARK, an open-source behavior benchmarking environment designed to mitigate the shortcomings stated above. In BARK, behavior models are (re-)used for planning, prediction, and simulation. A range of models is currently available, such as Monte-Carlo Tree Search and Reinforcement Learning-based behavior models. We use a public dataset and sampling-based scenario generation to show the inter-exchangeability of behavior models in BARK. We evaluate how well the models used cope with interactions and how robust they are towards exchanging behavior models. Our evaluation shows that BARK provides a suitable framework for a systematic development of behavior models.


title: Dynamic Approximate Maximum Independent Set of Intervals, Hypercubes and Hyperrectangles

abstract: Independent set is a fundamental problem in combinatorial optimization. While in general graphs the problem is essentially inapproximable, for many important graph classes there are approximation algorithms known in the offline setting. These graph classes include interval graphs and geometric intersection graphs, where vertices correspond to intervals/geometric objects and an edge indicates that the two corresponding objects intersect. We present dynamic approximation algorithms for independent set of intervals, hypercubes and hyperrectangles in $d$ dimensions. They work in the fully dynamic model where each update inserts or deletes a geometric object. All our algorithms are deterministic and have worst-case update times that are polylogarithmic for constant $d$ and $\epsilon> 0$, assuming that the coordinates of all input objects are in $[0, N]^d$ and each of their edges has length at least 1. We obtain the following results: $\bullet$ For weighted intervals, we maintain a $(1+\epsilon)$-approximate solution. $\bullet$ For $d$-dimensional hypercubes we maintain a $(1+\epsilon)2^{d}$-approximate solution in the unweighted case and a $O(2^{d})$-approximate solution in the weighted case. Also, we show that for maintaining an unweighted $(1+\epsilon)$-approximate solution one needs polynomial update time for $d\ge2$ if the ETH holds. $\bullet$ For weighted $d$-dimensional hyperrectangles we present a dynamic algorithm with approximation ratio $(1+\epsilon)\log^{d-1}N$.


title: Nonlinear Coherent States of the Fokas-Lagerstrom Potential

abstract: In this paper, we introduce an algebraic approach to construct Fokas-Lagerstrom coherent states. To do so, we define deformed creation and annihilation operators associated to this system and investigate their algebra. We show that these operators satisfy the $f$-deformed Weyl-Heisenberg algebra. Then, we propose a theoretical scheme to generate the aforementioned coherent states. The present contribution shows that the Fokas-Lagerstrom nonlinear coherent states possess some non-classical features.


title: Insight into perovskite antiferroelectric phases: Landau theory and phase field study

abstract: Understanding the appearance of commensurate and incommensurate modulations in perovskite antiferroelectrics (AFEs) is of great importance for material design and engineering. The dielectric and elastic properties of the AFE domain boundaries are lack of investigation. In this work, a novel Landau theory is proposed to understand the transformation of AFE commensurate and incommensurate phases, by considering the coupling between the oxygen octahedral tilt mode and the polar mode. The derived relationship between the modulation periodicity and temperature is in good agreement with the experimental results. Using the phase field study, we show that the polarization is suppressed at the AFE domain boundaries, contributing to a remnant polarization and local elastic stress field in AFE incommensurate phases.


title: Competition between decoherence and purification: quaternionic representation and quaternionic fractals

abstract: We consider the competition between decoherence processes and an iterated quantum purification protocol. We show that this competition can be modelled by a nonlinear map onto the quaternion space. This nonlinear map has complicated behaviours, inducing a fractal border between the area of the quantum states dominated by the effects of the purification and the area of the quantum states dominated by the effects of the decoherence. The states on the border are unstable. The embedding in a 3D space of this border is like a quaternionic Julia set or a Mandelbulb with a fractal inner structure.


title: UAV Coverage Path Planning under Varying Power Constraints using Deep Reinforcement Learning

abstract: Coverage path planning (CPP) is the task of designing a trajectory that enables a mobile agent to travel over every point of an area of interest. We propose a new method to control an unmanned aerial vehicle (UAV) carrying a camera on a CPP mission with random start positions and multiple options for landing positions in an environment containing no-fly zones. While numerous approaches have been proposed to solve similar CPP problems, we leverage end-to-end reinforcement learning (RL) to learn a control policy that generalizes over varying power constraints for the UAV. Despite recent improvements in battery technology, the maximum flying range of small UAVs is still a severe constraint, which is exacerbated by variations in the UAV's power consumption that are hard to predict. By using map-like input channels to feed spatial information through convolutional network layers to the agent, we are able to train a double deep Q-network (DDQN) to make control decisions for the UAV, balancing limited power budget and coverage goal. The proposed method can be applied to a wide variety of environments and harmonizes complex goal structures with system constraints.


title: Amplitude of waves in the Kelvin-wave cascade

abstract: Development of experimental techniques to study superfluid dynamics, in particular, application of nanomechanical oscillators to drive vortex lines, enables potential observation of the Kelvin-wave cascade on quantized vortices. One of the first questions which then arises in analysis of the experimental results is the relation between the energy flux in the cascade and the amplitude of the Kelvin waves. We provide such relation based on the L'vov-Nazarenko picture of the cascade. Remarkably, the amplitude of the waves depends on the energy flux extermely weakly, as power one tenth.


title: Subhalo sinking and off-center massive black holes in dwarf galaxies

abstract: Using fully GPU $N$-body simulations, we demonstrate for the first time that subhalos sink and transfer energy via dynamical friction into the centres of dwarf galaxies. This dynamical heating kicks any central massive black hole (MBH) out to tens of parsecs, especially at early epochs ($z$=1.5-3). This mechanism helps explain the observed off-center BHs in dwarf galaxies and also predicts that off-center BHs are more common in higher mass dwarf galaxies since dynamical friction becomes significantly weaker and BHs take more time to sink back towards the centres of their host galaxies. One consequence of off-center BHs during early epochs of dwarf galaxies is to quench any BH feedback.


title: New singularity invariants : the sheaf $\beta_X^\bullet$

abstract: The graded coherent sheaf $\alpha_X^\bullet$ constructed in [B.18] for any reduced pure dimensional complex space $X$ is stable by exterior product but not by the de Rham differential. We construct here a new graded coherent sheaf $\alpha_X^\bullet$ containing $\alpha_X^\bullet$ and stable both by exterior product and by the de Rham differential. We show that it has again the ``pull-back property'' for holomorphic maps $f : X \to Y$ between irreducible complex spaces such that $f(X)$ is not contained in the singular set of $Y$. Moreover, this graded coherent sheaf $\alpha_X^\bullet$ comes with a natural coherent exhaustive filtration and this filtration is also compatible with the pull-back by such holomorphic maps. These sheaves define new invariants on singular complex spaces. We show on some simple examples that these invariants are new.


title: Nonrelativistic strings on $ R \times S^2 $ and integrable systems

abstract: We show that the (torsional) nonrelativistic string sigma models on $ R\times S^2 $ can be mapped into \emph{deformed} Rosochatius like integrable models in one dimension. We also explore the associated Hamiltonian constrained structure by introducing appropriate Dirac brackets. These results show some solid evidence of the underlying integrable structure in the nonrelativistic sector of the gauge/string duality.


title: Exponential a.s. synchronization of one-dimensional diffusions with non-regular coefficients

abstract: We study the asymptotic behaviour of a real-valued diffusion whose non-regular drift is given as a sum of a dissipative term and a bounded measurable one. We prove that two trajectories of that diffusion converge a.s. to one another at an exponential explicit rate as soon as the dissipative coefficient is large enough. A similar result in $L_p$ is obtained.


title: Hadath: From Social Media Mapping to Multi-Resolution Event-Enriched Maps

abstract: Publicly available data is increasing rapidly, and will continue to grow with the advancement of technologies in sensors, smartphones and the Internet of Things. Data from multiple sources can improve coverage and provide more relevant knowledge about surrounding events and points of Interest. The strength of one source of data can compensate for the shortcomings of another source by providing supplementary information. Maps are also getting popular day-by-day and people are using it to achieve their daily task smoothly and efficiently. Starting from paper maps hundred years ago, multiple type of maps are available with point of interest, real-time traffic update or displaying micro-blogs from social media. In this paper, we introduce Hadath, a system that displays multi-resolution live events of interest from a variety of available data sources. The system has been designed to be able to handle multiple type of inputs by encapsulating incoming unstructured data into generic data packets. System extracts local events of interest from generic data packets and identify their spatio-temporal scope to display such events on a map, so that as a user changes the zoom level, only events of appropriate scope are displayed. This allows us to show live events in correspondence to the scale of view - when viewing at a city scale, we see events of higher significance, while zooming in to a neighbourhood, events of a more local interest are highlighted. The final output creates a unique and dynamic map browsing experience. Finally, to validate our proposed system, we conducted experiments on social media data.


title: Entropy increases at linear order in scalar-hairy Lovelock gravity

abstract: In this paper, we investigate the second law of the black holes in Lovelock gravity sourced by a conformally coupled scalar field under the first-order approximation when the perturbation matter fields satisfy the null energy condition. First of all, we show that the Wald entropy of this theory does not obey the linearized second law for the scalar-hairy Lovelock gravity which contains the higher curvature terms even if we replace the gravitational part of Wald entropy with Jacobson-Myers (JM) entropy. This implies that we cannot naively add the scalar field term of the Wald entropy to the JM entropy of the purely Lovelock gravity to get a valid linearized second law. By rescaling the metric, the action of the scalar field can be written as a purely Lovelock action with another metric. Using this property, by analogy with the JM entropy of the purely Lovelock gravity, we introduce a new formula of the entropy in the scalar-hairy Lovelock gravity. Then, we show that this new JM entropy increases along the event horizon for Vaidya-like black hole solutions and therefore it obeys a linearized second law. Moreover, we show that different from the entropy in $F($Riemann$)$ gravity, the difference between the JM entropy and Wald entropy also contains some additional corrections from the scalar field.


title: Channel Estimation in C-V2X using Deep Learning

abstract: Channel estimation forms one of the central component in current OFDM systems that aims to eliminate the inter-symbol interference by calculating the CSI using the pilot symbols and interpolating them across the entire time-frequency grid. It is also one of the most researched field in the PHY with LS and MMSE being the two most used methods. In this work, we investigate the performance of deep neural network architecture based on CNN for channel estimation in vehicular environments used in 3GPP Rel.14 CV2X technology. To this end, we compare the performance of the proposed DL architectures to the legacy LS channel estimation currently employed in C-V2X. Initial investigations prove that the proposed DL architecture outperform the legacy CV2X channel estimation methods especially at high mobile speeds


title: Convexity and the Hele-Shaw equation

abstract: Walter Craig's seminal works on the water-waves problem established the importance of several exact identities: Zakharov's hamiltonian formulation, shape derivative formula for the Dirichlet-to-Neumann operator, normal forms transformations. In this paper, we introduce several identities for the Hele-Shaw equation which are inspired by his nonlinear approach. Firstly, we study convex changes of unknowns and obtain a large class of strong Lyapounov functions; in addition to be non-increasing, these Lyapounov functions are convex functions of time. The analysis relies on a simple elliptic formulation of the Hele-Shaw equation, which is of independent interest. Then we study the role of convexity to control the spatial derivatives of the solutions. We consider the evolution equation for the Rayleigh-Taylor coefficient $a$ (this is a positive function proportional to the opposite of the normal derivative of the pressure at the free surface). Inspired by the study of entropies for elliptic or parabolic equations, we consider the special function $\varphi(x)=x\log x$ and find that $\varphi(1/\sqrt{a})$ is a sub-solution of a well-posed equation. As an application, we give another proof of the maximum principe for $1/a$ obtained with Nicolas Meunier and Didier Smets.


title: Measuring the Quality of B Abstract Machines with ISO/IEC 25010

abstract: The B method has facilitated the development of software by specifying the design of software as abstract machines and formally verifying the correctness of the abstract machines. The quality of B abstract machines can significantly impact the quality of final software products. In this paper, we propose a set of criteria for measuring the quality of B abstract machines based on ISO/IEC 25010, which is one of the latest international standards for evaluating software quality in software engineering. These criteria evaluate abstract machines using a number of general-purpose and domain-independent equations and model checking techniques, so that the quality of abstract machines can be quantified as vectors. The proposed criteria are implemented as a B model quality evaluator, and they are explained and justified using a number of examples.


title: Symmetric Function Theory and Unitary Invariant Ensembles

abstract: Representation theory and the theory of symmetric functions have played a central role in Random Matrix Theory in the computation of quantities such as joint moments of traces and joint moments of characteristic polynomials of matrices drawn from the Circular Unitary Ensemble and other Circular Ensembles related to the classical compact groups. The reason is that they enable the derivation of exact formulae, which then provide a route to calculating the large-matrix asymptotics of these quantities. We develop a parallel theory for the Gaussian Unitary Ensemble of random matrices, and other related unitary invariant matrix ensembles. This allows us to write down exact formulae in these cases for the joint moments of the traces and the joint moments of the characteristic polynomials in terms of appropriately defined symmetric functions. As an example of an application, for the joint moments of the traces we derive explicit asymptotic formulae for the rate of convergence of the moments of polynomial functions of GUE matrices to those of a standard normal distribution when the matrix size tends to infinity.


title: Topological Interface between Pfaffian and anti-Pfaffian Order in $\nu=5/2$ Quantum Hall Effect

abstract: Recent thermal Hall experiment pumped new energy into the problem of $\nu=5/2$ quantum Hall effect, which motivated novel interpretations based on formation of mesoscopic puddles made of Pfaffian and anti-Pfaffian topological orders. Here, we study an interface between the Pfaffian and anti-Pfaffian states, which may play crucial roles in thermal transport, by means of state-of-the-art density-matrix renormalization group simulations on the cylinder geometry. We provide compelling evidences that indicate the edge modes of the Pfaffian and anti-Pfaffian state strongly hybridize with each other around the interface. Moreover, we demonstrate an intrinsic electric dipole moment emerges at the interface, similar to the "p-n" junction sandwiched between N-type and P-type semiconductor. Importantly, we elucidate the topological origin of this dipole moment, whose formation is to counterbalance the mismatch of guiding-center Hall viscosity of bulk Pfaffian and anti-Pfaffian state.


title: Towards Effective Human-AI Collaboration in GUI-Based Interactive Task Learning Agents

abstract: We argue that a key challenge in enabling usable and useful interactive task learning for intelligent agents is to facilitate effective Human-AI collaboration. We reflect on our past 5 years of efforts on designing, developing and studying the SUGILITE system, discuss the issues on incorporating recent advances in AI with HCI principles in mixed-initiative interactions and multi-modal interactions, and summarize the lessons we learned. Lastly, we identify several challenges and opportunities, and describe our ongoing work


title: Unsupervised Neural Universal Denoiser for Finite-Input General-Output Noisy Channel

abstract: We devise a novel neural network-based universal denoiser for the finite-input, general-output (FIGO) channel. Based on the assumption of known noisy channel densities, which is realistic in many practical scenarios, we train the network such that it can denoise as well as the best sliding window denoiser for any given underlying clean source data. Our algorithm, dubbed as Generalized CUDE (Gen-CUDE), enjoys several desirable properties; it can be trained in an unsupervised manner (solely based on the noisy observation data), has much smaller computational complexity compared to the previously developed universal denoiser for the same setting, and has much tighter upper bound on the denoising performance, which is obtained by a theoretical analysis. In our experiments, we show such tighter upper bound is also realized in practice by showing that Gen-CUDE achieves much better denoising results compared to other strong baselines for both synthetic and real underlying clean sequences.


title: Synchronization of Coupled Oscillators -- Phase Transitions and Entropies

abstract: Over the last half century the liquid-gas phase transition and the magnetization phase transition have come to be well understood. After an order parameter, $r$, is defined, it can be derived how $r=0$ for $T>T_c$ and how $r \propto (T_c - T)^\gamma$ at lowest order for $T < T_c$. The value of $\gamma$ appears to not depend on physical details of the system, but very much on dimensionality. No phase transitions exist for one-dimensional systems. For systems of four or more dimensions, each unit is interacting with sufficiently many neighbors to warrant a mean-field approach. The mean-field approximation leads to $\gamma = 1/2$. In this article we formulate a realistic system of coupled oscillators. Each oscillator moves forward through a cyclic 1D array of $n$ states and the rate at which an oscillator proceeds from state $i$ to state $i+1$ depends on the populations in states $i+1$ and $i-1$. We study how the phase transitions occur from a homogeneous distribution over the states to a clustered distribution. A clustered distribution means that oscillators have synchronized. We define an order parameter and we find that the critical exponent takes on the mean-field value of 1/2 for any $n$. However, as the number of states increases, the phase transition occurs for ever smaller values of $T_c$. We present rigorous mathematics and simple approximations to develop an understanding of the phase transitions in this system. We explain why and how the critical exponent value of 1/2 is expected to be robust and we discuss a wet-lab experimental setup to substantiate our findings.


title: Berry phase for a Bose gas on a one-dimensional ring

abstract: We study a system of strongly interacting one-dimensional (1D) bosons on a ring pierced by a synthetic magnetic flux tube. By the Fermi-Bose mapping, this system is related to the system of spin-polarized non-interacting electrons confined on a ring and pierced by a solenoid (magnetic flux tube). On the ring there is an external localized delta-function potential barrier $V(\phi)=g \delta(\phi-\phi_0)$. We study the Berry phase associated to the adiabatic motion of delta-function barrier around the ring as a function of the strength of the potential $g$ and the number of particles $N$. The behavior of the Berry phase can be explained via quantum mechanical reflection and tunneling through the moving barrier which pushes the particles around the ring. The barrier produces a cusp in the density to which one can associate a missing charge $\Delta q$ (missing density) for the case of electrons (bosons, respectively). We show that the Berry phase (i.e., the Aharonov-Bohm phase) cannot be identified with the quantity $\Delta q/\hbar \oint \mathbf{A}\cdot d\mathbf{l}$. This means that the missing charge cannot be identified as a (quasi)hole. We point out to the connection of this result and recent studies of synthetic anyons in noninteracting systems. In addition, for bosons we study the weakly-interacting regime, which is related to the strongly interacting electrons via Fermi-Bose duality in 1D systems.


title: Seeding Approach to nucleation in the NVT ensemble: the case of bubble cavitation in overstretched Lennard Jones fluids

abstract: Simulations are widely used to study nucleation in first order phase transitions due to the fact that they have access to the relevant length and time scales. However, simulations face the problem that nucleation is an activated process. Therefore, rare event simulation techniques are needed to promote the formation of the critical nucleus. The Seeding method, where the simulations are started with the nucleus already formed, has proven quite useful in efficiently providing estimates of the nucleation rate for a wide range of orders of magnitude. So far, Seeding has been employed in the NPT ensemble, where the nucleus either grows or redissolves. Thus, several trajectories have to be run in order to find the thermodynamic conditions that make the seeded nucleus critical. Moreover, the nucleus lifetime is short and the statistics for obtaining its properties is consequently poor. To deal with these shortcomings we extend the Seeding method to the NVT ensemble. We focus on the problem of bubble nucleation in a mestastable Lennard Jones fluid. We show that, in the NVT ensemble, it is possible to equilibrate and stabilise critical bubbles for a long time. The nucleation rate inferred from NVT-Seeding is fully consistent with that coming from NPT-Seeding. The former is quite suitable to obtain the nucleation rate along isotherms, whereas the latter is preferable if the dependence of the rate with temperature at constant pressure is required. Care should be taken with finite size effects when using NVT-Seeding. Further work is required to extend NVT seeding to other sorts of phase transitions.


title: Spin-3 fields in Mielke-Baekler gravity

abstract: Mielke-Baekler gravity consists in the usual Einstein-Hilbert action with a cosmological term and rotational and translational Chern-Simons terms with arbitrary couplings. For a particular choice of these couplings, we can obtain Einstein-Hilbert action, its teleparallel equivalent, and the exotic Witten's gravity. In this work, we use the Chern-Simons formalism to generalize the three dimensional Mielke-Baekler gravity theory in order to introduce spin-3 fields. We study its asymptotic symmetries, black hole solution, and also analyse its canonical structure at its singular point.


title: Phoenix: A Low-Precision Floating-Point Quantization Oriented Architecture for Convolutional Neural Networks

abstract: Convolutional neural networks (CNNs) achieve state-of-the-art performance at the cost of becoming deeper and larger. Although quantization (both fixed-point and floating-point) has proven effective for reducing storage and memory access, two challenges -- 1) accuracy loss caused by quantization without calibration, fine-tuning or re-training for deep CNNs and 2) hardware inefficiency caused by floating-point quantization -- prevent processors from completely leveraging the benefits. In this paper, we propose a low-precision floating-point quantization oriented processor, named Phoenix, to address the above challenges. We primarily have three key observations: 1) 8-bit floating-point quantization incurs less error than 8-bit fixed-point quantization; 2) without using any calibration, fine-tuning or re-training techniques, normalization before quantization further reduces accuracy degradation; 3) 8-bit floating-point multiplier achieves higher hardware efficiency than 8-bit fixed-point multiplier if the full-precision product is applied. Based on these key observations, we propose a normalization-oriented 8-bit floating-point quantization method to reduce storage and memory access with negligible accuracy loss (within 0.5%/0.3% for top-1/top-5 accuracy, respectively). We further design a hardware processor to address the hardware inefficiency caused by floating-point multiplier. Compared with a state-of-the-art accelerator, Phoenix is 3.32x and 7.45x better in performance with the same core area for AlexNet and VGG16, respectively.


title: $MC^2RAM$: Markov Chain Monte Carlo Sampling in SRAM for Fast Bayesian Inference

abstract: This work discusses the implementation of Markov Chain Monte Carlo (MCMC) sampling from an arbitrary Gaussian mixture model (GMM) within SRAM. We show a novel architecture of SRAM by embedding it with random number generators (RNGs), digital-to-analog converters (DACs), and analog-to-digital converters (ADCs) so that SRAM arrays can be used for high performance Metropolis-Hastings (MH) algorithm-based MCMC sampling. Most of the expensive computations are performed within the SRAM and can be parallelized for high speed sampling. Our iterative compute flow minimizes data movement during sampling. We characterize power-performance trade-off of our design by simulating on 45 nm CMOS technology. For a two-dimensional, two mixture GMM, the implementation consumes ~ 91 micro-Watts power per sampling iteration and produces 500 samples in 2000 clock cycles on an average at 1 GHz clock frequency. Our study highlights interesting insights on how low-level hardware non-idealities can affect high-level sampling characteristics, and recommends ways to optimally operate SRAM within area/power constraints for high performance sampling.


title: Discrepancies of measured SAR between traditional and fast measuring systems

abstract: Human exposure to mobile devices is traditionally measured by a system in which the human body (or head) is modelled by a phantom and the energy absorbed from the device is estimated based on the electric fields measured with a single probe. Such a system suffers from low efficiency due to repeated volumetric scanning within the phantom needed to capture the absorbed energy throughout the volume. To speed up the measurement, fast SAR (specific absorption rate) measuring systems have been developed. However, discrepancies of measured results are observed between traditional and fast measuring systems. In this paper, the discrepancies in terms of post-processing procedures after the measurement of electric field (or its amplitude) are investigated. Here, the concerned fast measuring system estimates SAR based on the reconstructed field of the region of interest while the amplitude and phase of electric field are measured on a single plane with a probe array. The numerical results presented indicate that the fast SAR measuring system has the potential to yield more accurate estimations than the traditional system, but no conclusion can be made on which kind of system is superior without knowledge of the field-reconstruction algorithms and the emitting source.


title: Machine Learning for Predictive Deployment of UAVs with Multiple Access

abstract: In this paper, a machine learning based deployment framework of unmanned aerial vehicles (UAVs) is studied. In the considered model, UAVs are deployed as flying base stations (BS) to offload heavy traffic from ground BSs. Due to time-varying traffic distribution, a long short-term memory (LSTM) based prediction algorithm is introduced to predict the future cellular traffic. To predict the user service distribution, a KEG algorithm, which is a joint K-means and expectation maximization (EM) algorithm based on Gaussian mixture model (GMM), is proposed for determining the service area of each UAV. Based on the predicted traffic, the optimal UAV positions are derived and three multi-access techniques are compared so as to minimize the total transmit power. Simulation results show that the proposed method can reduce up to 24\% of the total power consumption compared to the conventional method without traffic prediction. Besides, rate splitting multiple access (RSMA) has the lower required transmit power compared to frequency domain multiple access (FDMA) and time domain multiple access (TDMA).


title: STAR: Spatio-Temporal Prediction of Air Quality Using A Multimodal Approach

abstract: With the increase of global economic activities and high energy demand, many countries have raised concerns about air pollution. However, air quality prediction is a challenging issue due to the complex interaction of many factors. In this paper, we propose a multimodal approach for spatio-temporal air quality prediction. Our model learns the multimodal fusion of critical factors to predict future air quality levels. Based on the analyses of data, we also assessed the impacts of critical factors on air quality prediction. We conducted experiments on two real-world air pollution datasets. For Seoul dataset, our method achieved 11% and 8.2% improvement of the mean absolute error in long-term predictions of PM2.5 and PM10, respectively, compared to baselines. Our method also reduced the mean absolute error of PM2.5 predictions by 20% compared to the previous state-of-the-art results on China 1-year dataset.


title: Inline Vector Compression for Computational Physics

abstract: A novel inline data compression method is presented for single-precision vectors in three dimensions. The primary application of the method is for accelerating computational physics calculations where the throughput is bound by memory bandwidth. The scheme employs spherical polar coordinates, angle quantisation, and a bespoke floating-point representation of the magnitude to achieve a fixed compression ratio of 1.5. The anisotropy of this method is considered, along with companding and fractional splitting techniques to improve the efficiency of the representation. We evaluate the scheme numerically within the context of high-order computational fluid dynamics. For both the isentropic convecting vortex and the Taylor--Green vortex test cases, the results are found to be comparable to those without compression. Performance is evaluated for a vector addition kernel on an NVIDIA Titan V GPU; it is demonstrated that a speedup of 1.5 can be achieved.


title: Dimensionality Reduction of Movement Primitives in Parameter Space

abstract: Movement primitives are an important policy class for real-world robotics. However, the high dimensionality of their parametrization makes the policy optimization expensive both in terms of samples and computation. Enabling an efficient representation of movement primitives facilitates the application of machine learning techniques such as reinforcement on robotics. Motions, especially in highly redundant kinematic structures, exhibit high correlation in the configuration space. For these reasons, prior work has mainly focused on the application of dimensionality reduction techniques in the configuration space. In this paper, we investigate the application of dimensionality reduction in the parameter space, identifying principal movements. The resulting approach is enriched with a probabilistic treatment of the parameters, inheriting all the properties of the Probabilistic Movement Primitives. We test the proposed technique both on a real robotic task and on a database of complex human movements. The empirical analysis shows that the dimensionality reduction in parameter space is more effective than in configuration space, as it enables the representation of the movements with a significant reduction of parameters.


title: Neural network based terramechanics modeling and estimation for deformable terrains

abstract: In this work, a neural network based terramechanics model and terrain estimator are presented with an outlook for optimal control applications such as model predictive control. Recognizing the limitations of the state-of-the-art terramechanics models in terms of operating conditions, computational cost, and continuous differentiability for gradient-based optimization, an efficient and twice continuously differentiable terramechanics model is developed using neural networks for dynamic operations on deformable terrains. It is demonstrated that the neural network terramechanics model is able to predict the lateral tire forces accurately and efficiently compared to the Soil Contact Model as a state-of-the-art model. Furthermore, the neural network terramechanics model is implemented within a terrain estimator and it is shown that using this model the estimator converges within around 2% of the true terrain parameter. Finally, with model predictive control applications in mind, which typically rely on bicycle models for their predictions, it is demonstrated that utilizing the estimated terrain parameter can reduce prediction errors of a bicycle model by orders of magnitude. The result is an efficient, dynamic, twice continuously differentiable terramechanics model and estimator that has inherent advantages for implementation in model predictive control as compared to previously established models.


title: Scalable Multi-Task Imitation Learning with Autonomous Improvement

abstract: While robot learning has demonstrated promising results for enabling robots to automatically acquire new skills, a critical challenge in deploying learning-based systems is scale: acquiring enough data for the robot to effectively generalize broadly. Imitation learning, in particular, has remained a stable and powerful approach for robot learning, but critically relies on expert operators for data collection. In this work, we target this challenge, aiming to build an imitation learning system that can continuously improve through autonomous data collection, while simultaneously avoiding the explicit use of reinforcement learning, to maintain the stability, simplicity, and scalability of supervised imitation. To accomplish this, we cast the problem of imitation with autonomous improvement into a multi-task setting. We utilize the insight that, in a multi-task setting, a failed attempt at one task might represent a successful attempt at another task. This allows us to leverage the robot's own trials as demonstrations for tasks other than the one that the robot actually attempted. Using an initial dataset of multi-task demonstration data, the robot autonomously collects trials which are only sparsely labeled with a binary indication of whether the trial accomplished any useful task or not. We then embed the trials into a learned latent space of tasks, trained using only the initial demonstration dataset, to draw similarities between various trials, enabling the robot to achieve one-shot generalization to new tasks. In contrast to prior imitation learning approaches, our method can autonomously collect data with sparse supervision for continuous improvement, and in contrast to reinforcement learning algorithms, our method can effectively improve from sparse, task-agnostic reward signals.


title: Whole-Body Control of a Mobile Manipulator using End-to-End Reinforcement Learning

abstract: Mobile manipulation is usually achieved by sequentially executing base and manipulator movements. This simplification, however, leads to a loss in efficiency and in some cases a reduction of workspace size. Even though different methods have been proposed to solve Whole-Body Control (WBC) online, they are either limited by a kinematic model or do not allow for reactive, online obstacle avoidance. In order to overcome these drawbacks, in this work, we propose an end-to-end Reinforcement Learning (RL) approach to WBC. We compared our learned controller against a state-of-the-art sampling-based method in simulation and achieved faster overall mission times. In addition, we validated the learned policy on our mobile manipulator RoyalPanda in challenging narrow corridor environments.


title: Metric-Based Imitation Learning Between Two Dissimilar Anthropomorphic Robotic Arms

abstract: The development of autonomous robotic systems that can learn from human demonstrations to imitate a desired behavior - rather than being manually programmed - has huge technological potential. One major challenge in imitation learning is the correspondence problem: how to establish corresponding states and actions between expert and learner, when the embodiments of the agents are different (morphology, dynamics, degrees of freedom, etc.). Many existing approaches in imitation learning circumvent the correspondence problem, for example, kinesthetic teaching or teleoperation, which are performed on the robot. In this work we explicitly address the correspondence problem by introducing a distance measure between dissimilar embodiments. This measure is then used as a loss function for static pose imitation and as a feedback signal within a model-free deep reinforcement learning framework for dynamic movement imitation between two anthropomorphic robotic arms in simulation. We find that the measure is well suited for describing the similarity between embodiments and for learning imitation policies by distance minimization.


title: Phase transitions in a decentralized graph-based approach to human language

abstract: Zipf's law establishes a scaling behavior for word-frequencies in large text corpora. The appearance of Zipfian properties in human language has been previously explained as an optimization problem for the interests of speakers and hearers. On the other hand, human-like vocabularies can be viewed as bipartite graphs. The aim here is double: within a bipartite-graph approach to human vocabularies, to propose a decentralized language game model for the formation of Zipfian properties. To do this, we define a language game, in which a population of artificial agents is involved in idealized linguistic interactions. Numerical simulations show the appearance of a phase transition from an initially disordered state to three possible phases for language formation. Our results suggest that Zipfian properties in language seem to arise partly from decentralized linguistic interactions between agents endowed with bipartite word-meaning mappings.


title: Learning the sense of touch in simulation: a sim-to-real strategy for vision-based tactile sensing

abstract: Data-driven approaches to tactile sensing aim to overcome the complexity of accurately modeling contact with soft materials. However, their widespread adoption is impaired by concerns about data efficiency and the capability to generalize when applied to various tasks. This paper focuses on both these aspects with regard to a vision-based tactile sensor, which aims to reconstruct the distribution of the three-dimensional contact forces applied on its soft surface. Accurate models for the soft materials and the camera projection, derived via state-of-the-art techniques in the respective domains, are employed to generate a dataset in simulation. A strategy is proposed to train a tailored deep neural network entirely from the simulation data. The resulting learning architecture is directly transferable across multiple tactile sensors without further training and yields accurate predictions on real data, while showing promising generalization capabilities to unseen contact conditions.


title: Dimensionality Reduction and Motion Clustering during Activities of Daily Living: 3, 4, and 7 Degree-of-Freedom Arm Movements

abstract: The wide variety of motions performed by the human arm during daily tasks makes it desirable to find representative subsets to reduce the dimensionality of these movements for a variety of applications, including the design and control of robotic and prosthetic devices. This paper presents a novel method and the results of an extensive human subjects study to obtain representative arm joint angle trajectories that span naturalistic motions during Activities of Daily Living (ADLs). In particular, we seek to identify sets of useful motion trajectories of the upper limb that are functions of a single variable, allowing, for instance, an entire prosthetic or robotic arm to be controlled with a single input from a user, along with a means to select between motions for different tasks. Data driven approaches are used to obtain clusters as well as representative motion averages for the full-arm 7 degree of freedom (DOF), elbow-wrist 4 DOF, and wrist-only 3 DOF motions. The proposed method makes use of well-known techniques such as dynamic time warping (DTW) to obtain a divergence measure between motion segments, DTW barycenter averaging (DBA) to obtain averages, Ward's distance criterion to build hierarchical trees, batch-DTW to simultaneously align multiple motion data, and functional principal component analysis (fPCA) to evaluate cluster variability. The clusters that emerge associate various recorded motions into primarily hand start and end location for the full-arm system, motion direction for the wrist-only system, and an intermediate between the two qualities for the elbow-wrist system. The proposed clustering methodology is justified by comparing results against alternative approaches.


title: Deep Learning in Memristive Nanowire Networks

abstract: Analog crossbar architectures for accelerating neural network training and inference have made tremendous progress over the past several years. These architectures are ideal for dense layers with fewer than roughly a thousand neurons. However, for large sparse layers, crossbar architectures are highly inefficient. A new hardware architecture, dubbed the MN3 (Memristive Nanowire Neural Network), was recently described as an efficient architecture for simulating very wide, sparse neural network layers, on the order of millions of neurons per layer. The MN3 utilizes a high-density memristive nanowire mesh to efficiently connect large numbers of silicon neurons with modifiable weights. Here, in order to explore the MN3's ability to function as a deep neural network, we describe one algorithm for training deep MN3 models and benchmark simulations of the architecture on two deep learning tasks. We utilize a simple piecewise linear memristor model, since we seek to demonstrate that training is, in principle, possible for randomized nanowire architectures. In future work, we intend on utilizing more realistic memristor models, and we will adapt the presented algorithm appropriately. We show that the MN3 is capable of performing composition, gradient propagation, and weight updates, which together allow it to function as a deep neural network. We show that a simulated multilayer perceptron (MLP), built from MN3 networks, can obtain a 1.61% error rate on the popular MNIST dataset, comparable to equivalently sized software-based network. This work represents, to the authors' knowledge, the first randomized nanowire architecture capable of reproducing the backpropagation algorithm.


title: Deep Reinforcement Learning for QoS-Constrained Resource Allocation in Multiservice Networks

abstract: In this article, we study a Radio Resource Allocation (RRA) that was formulated as a non-convex optimization problem whose main aim is to maximize the spectral efficiency subject to satisfaction guarantees in multiservice wireless systems. This problem has already been previously investigated in the literature and efficient heuristics have been proposed. However, in order to assess the performance of Machine Learning (ML) algorithms when solving optimization problems in the context of RRA, we revisit that problem and propose a solution based on a Reinforcement Learning (RL) framework. Specifically, a distributed optimization method based on multi-agent deep RL is developed, where each agent makes its decisions to find a policy by interacting with the local environment, until reaching convergence. Thus, this article focuses on an application of RL and our main proposal consists in a new deep RL based approach to jointly deal with RRA, satisfaction guarantees and Quality of Service (QoS) constraints in multiservice celular networks. Lastly, through computational simulations we compare the state-of-art solutions of the literature with our proposal and we show a near optimal performance of the latter in terms of throughput and outage rate.


title: Immediate smoothing and global solutions for initial data in $L^1\times W^{1,2}$ in a Keller-Segel system with logistic terms in 2D

abstract: This article deals with the logistic Keller-Segel model \[ \begin{cases} u_t = \Delta u - \chi \nabla\cdot(u\nabla v) + \kappa u - \mu u^2, \\ \\ v_t = \Delta v - v + u \end{cases} \] in bounded two-dimensional domains (with homogeneous Neumann boundary conditions and for parameters $\chi, \kappa\in \mathbb{R}$ and $\mu>0$), and shows that any nonnegative initial data $(u_0,v_0)\in L^1\times W^{1,2}$ lead to global solutions that are smooth in $\bar{\Omega}\times(0,\infty)$.


title: SentenceMIM: A Latent Variable Language Model

abstract: SentenceMIM is a probabilistic auto-encoder for language data, trained with Mutual Information Machine (MIM) learning to provide a fixed length representation of variable length language observations (i.e., similar to VAE). Previous attempts to learn VAEs for language data faced challenges due to posterior collapse. MIM learning encourages high mutual information between observations and latent variables, and is robust against posterior collapse. As such, it learns informative representations whose dimension can be an order of magnitude higher than existing language VAEs. Importantly, the SentenceMIM loss has no hyper-parameters, simplifying optimization. We compare sentenceMIM with VAE, and AE on multiple datasets. SentenceMIM yields excellent reconstruction, comparable to AEs, with a rich structured latent space, comparable to VAEs. The structured latent representation is demonstrated with interpolation between sentences of different lengths. We demonstrate the versatility of sentenceMIM by utilizing a trained model for question-answering and transfer learning, without fine-tuning, outperforming VAE and AE with similar architectures.


title: Spinor field solutions in $F\left(B^2\right)$ modified Weyl gravity

abstract: We consider modified Weyl gravity where a Dirac spinor field is nonminimally coupled to gravity. It is assumed that such modified gravity is some approximation for the description of quantum gravitational effects related to the gravitating spinor field. It is shown that such a theory contains solutions for a class of metrics which are conformally equivalent to the Hopf metric on the Hopf fibration. For this case, we obtain a full discrete spectrum of the solutions and show that they can be related to the Hopf invariant on the Hopf fibration. The expression for the spin operator in the Hopf coordinates is obtained. It is demonstrated that this class of conformally equivalent metrics contains: (a) a metric describing a toroidal wormhole without exotic matter; (b) a cosmological solution with a bounce and inflation; and (c) a transition with a change in metric signature. A physical discussion of the results is given. \end{abstract}


title: Watch and learn -- a generalized approach for transferrable learning in deep neural networks via physical principles

abstract: Transfer learning refers to the use of knowledge gained while solving a machine learning task and applying it to the solution of a closely related problem. Such an approach has enabled scientific breakthroughs in computer vision and natural language processing where the weights learned in state-of-the-art models can be used to initialize models for other tasks which dramatically improve their performance and save computational time. Here we demonstrate an unsupervised learning approach augmented with basic physical principles that achieves fully transferrable learning for problems in statistical physics across different physical regimes. By coupling a sequence model based on a recurrent neural network to an extensive deep neural network, we are able to learn the equilibrium probability distributions and inter-particle interaction models of classical statistical mechanical systems. Our approach, distribution-consistent learning, DCL, is a general strategy that works for a variety of canonical statistical mechanical models (Ising and Potts) as well as disordered (spin-glass) interaction potentials. Using data collected from a single set of observation conditions, DCL successfully extrapolates across all temperatures, thermodynamic phases, and can be applied to different length-scales. This constitutes a fully transferrable physics-based learning in a generalizable approach.


title: Robust numerical computation of the 3D scalar potential field of the cubic Galileon gravity model at solar system scales

abstract: Direct detection of dark energy or modified gravity may finally be within reach due to ultrasensitive instrumentation such as atom interferometry capable of detecting incredibly small scale accelerations. Forecasts, constraints and measurement bounds can now too perhaps be estimated from accurate numerical simulations of the fifth force and its Laplacian field at solar system scales. The cubic Galileon gravity scalar field model (CGG), which derives from the DGP braneworld model, describes modified gravity incorporating a Vainshtein screening mechanism. The nonlinear derivative interactions in the CGG equation suppress the field near regions of high density, thereby restoring general relativity (GR) while far from such regions, field enhancement is comparable to GR and the equation is dominated by a linear term. This feature of the governing PDE poses some numerical challenges for computation of the scalar potential, force and Laplacian fields even under stationary conditions. Here we present a numerical method based on finite differences for solution of the static CGG scalar field for a 2D axisymmetric Sun-Earth system and a 3D Cartesian Sun-Earth-Moon system. The method relies on gradient descent of an integrated residual based on the normal attractive branch of the CGG equation. The algorithm is shown to be stable, accurate and rapidly convergent toward the global minimum state. We hope this numerical study, which can easily be extended to include smaller bodies such as detection satellites, will prove useful to future measurement of modified gravity force fields at solar system scales.


title: An Audio-Based Fault Diagnosis Method for Quadrotors Using Convolutional Neural Network and Transfer Learning

abstract: Quadrotor unmanned aerial vehicles (UAVs) have been developed and applied into several types of workplaces, such as warehouses, which usually involve human workers. The co-existence of human and UAVs brings new challenges to UAVs: potential failure of UAVs may cause risk and danger to surrounding human. Effective and efficient detection of such failure may provide early warning to the surrounding human workers and reduce such risk to human beings as much as possible. One of the commonest reasons that cause the failure of the UAV's flight is the physical damage to the propellers. This paper presents a method to detect the propellers' damage only based on the audio noise caused by the UAV's flight. The diagnostic model is developed based on convolutional neural network (CNN) and transfer learning techniques. The audio data is collected from the UAVs in real time, transformed into the time-frequency spectrogram, and used to train the CNN-based diagnostic model. The developed model is able to detect the abnormal features of the spectrogram and thus the physical damage of the propellers. To reduce the data dependence on the UAV's dynamic models and enable the utilization of the training data from UAVs with different dynamic models, the CNN-based diagnostic model is further augmented by transfer learning. As such, the refinement of the well-trained diagnostic model ground on other UAVs only requires a small amount of UAV's training data. Experimental tests are conducted to validate the diagnostic model with an accuracy of higher than 90%.


title: Learning in the Sky: An Efficient 3D Placement of UAVs

abstract: Deployment of unmanned aerial vehicles (UAVs) as aerial base stations can deliver a fast and flexible solution for serving varying traffic demand. In order to adequately benefit of UAVs deployment, their efficient placement is of utmost importance, and requires to intelligently adapt to the environment changes. In this paper, we propose a learning-based mechanism for the three-dimensional deployment of UAVs assisting terrestrial cellular networks in the downlink. The problem is modeled as a non-cooperative game among UAVs in satisfaction form. To solve the game, we utilize a low complexity algorithm, in which unsatisfied UAVs update their locations based on a learning algorithm. Simulation results reveal that the proposed UAV placement algorithm yields significant performance gains up to about 52% and 74% in terms of throughput and the number of dropped users, respectively, compared to an optimized baseline algorithm.


title: Learning-Based Link Scheduling in Millimeter-wave Multi-connectivity Scenarios

abstract: Multi-connectivity is emerging as a promising solution to provide reliable communications and seamless connectivity for the millimeter-wave frequency range. Due to the blockage sensitivity at such high frequencies, connectivity with multiple cells can drastically increase the network performance in terms of throughput and reliability. However, an inefficient link scheduling, i.e., over and under-provisioning of connections, can lead either to high interference and energy consumption or to unsatisfied user's quality of service (QoS) requirements. In this work, we present a learning-based solution that is able to learn and then to predict the optimal link scheduling to satisfy users' QoS requirements while avoiding communication interruptions. Moreover, we compare the proposed approach with two base line methods and the genie-aided link scheduling that assumes perfect channel knowledge. We show that the learning-based solution approaches the optimum and outperforms the base line methods.


title: On a Fundamental Task of Diophantine Geometric Figures

abstract: The goal of the work is to take on and study one of the fundamental tasks studying Diophantine n-gons (the author of the paper considers an integral n-gon is Diophantine as far as determination of combinatorial properties of each of them requires solution of a certain Diophantine equation (equation sets)).


title: Modified Bee Colony optimization algorithm for computational parameter identification for pore scale transport in periodic porous media

abstract: This paper discusses an optimization method called Modified Bee Colony algorithm (MBC) based on a particular intelligent behavior of honeybee swarms. The algorithm was checked in a few benchmarks like Shekel, Rozenbroke, Himmelblau and Rastrigin functions, then was applied to parameter identification for reactive flow problems in periodic porous media. The simulation results show that the performance and efficiency of MBC algorithm are comparable to the other parameter identification methods and strategies, at the same time it is able to better capture local minima for the considered class of problems. The proposed identification approach is applicable for different geometries (random and periodic) and for a range of process parameters. In this paper the potential of the approach is demonstrated in identifying parameters of Langmuir isotherm for low Peclet and high Damkoler numbers reactive flow in a 2D periodic porous media with circular inclusions. Finite element approximation in space and implicit time discretization are exploited.


title: Absorbed relativistic jets in radio-quiet narrow-line Seyfert 1 galaxies

abstract: Narrow-line Seyfert 1 (NLS1) galaxies are peculiar active galactic nuclei (AGN). Most of them do not show strong radio emission, but recently seven radio-quiet (or -silent) NLS1s have been detected flaring multiple times at 37 GHz by the Mets\"ahovi Radio Telescope, indicating the presence of relativistic jets in these peculiar sources. We observed them with the Karl G. Jansky Very Large Array (JVLA) in A configuration at 1.6, 5.2, and 9.0 GHz. Our results show that these sources are either extremely faint or not detected in the JVLA bands. At those frequencies, the radio emission from their relativistic jet must be absorbed, either via synchrotron self-absorption as it occurs in gigahertz-peaked sources or, more likely, via free-free absorption by a screen of ionized gas associated with starburst activity or shocks. Our findings cast new shadows on the radio-loudness criterion, which seems to be more and more frequently a misleading parameter. New high-frequency and high-resolution radio observations are essential to test our hypotheses.


title: PPMC RL Training Algorithm: Rough Terrain Intelligent Robots through Reinforcement Learning

abstract: Robots can now learn how to make decisions and control themselves, generalizing learned behaviors to unseen scenarios. In particular, AI powered robots show promise in rough environments like the lunar surface, due to the environmental uncertainties. We address this critical generalization aspect for robot locomotion in rough terrain through a training algorithm we have created called the Path Planning and Motion Control (PPMC) Training Algorithm. This algorithm is coupled with any generic reinforcement learning algorithm to teach robots how to respond to user commands and to travel to designated locations on a single neural network. In this paper, we show that the algorithm works independent of the robot structure, demonstrating that it works on a wheeled rover in addition the past results on a quadruped walking robot. Further, we take several big steps towards real world practicality by introducing a rough highly uneven terrain. Critically, we show through experiments that the robot learns to generalize to new rough terrain maps, retaining a 100% success rate. To the best of our knowledge, this is the first paper to introduce a generic training algorithm teaching generalized PPMC in rough environments to any robot, with just the use of reinforcement learning.


title: Machine Learning Framework for RF-Based Drone Detection and Identification System

abstract: The emergence of drones has added new dimension to privacy and security issues. There are little or no strict regulations on the people that can purchase or own a drone. For this reason, people can take advantage of these aircraft to intrude into restricted or private areas. A Drone Detection and Identification (DDI) system is one of the ways of detecting and identifying the presence of a drone in an area. DDI systems can employ different sensing technique such radio frequency (RF) signals, video, sounds and thermal for detecting an intruding drone. In this work, we propose a machine learning RF-based DDI system that uses low band RF signals from drone-to-flight controller communication. We develop three machine learning models using the XGBoost algorithm to detect and identify the presence of a drone, the type of drones and the operational mode of drones. For these three XGBoost models, we evaluated the models using 10-fold cross validation and we achieve average accuracy of 99.96%, 90.73% and 70.09% respectively.


title: Multi-Scale Neural network for EEG Representation Learning in BCI

abstract: Recent advances in deep learning have had a methodological and practical impact on brain-computer interface research. Among the various deep network architectures, convolutional neural networks have been well suited for spatio-spectral-temporal electroencephalogram signal representation learning. Most of the existing CNN-based methods described in the literature extract features at a sequential level of abstraction with repetitive nonlinear operations and involve densely connected layers for classification. However, studies in neurophysiology have revealed that EEG signals carry information in different ranges of frequency components. To better reflect these multi-frequency properties in EEGs, we propose a novel deep multi-scale neural network that discovers feature representations in multiple frequency/time ranges and extracts relationships among electrodes, i.e., spatial representations, for subject intention/condition identification. Furthermore, by completely representing EEG signals with spatio-spectral-temporal information, the proposed method can be utilized for diverse paradigms in both active and passive BCIs, contrary to existing methods that are primarily focused on single-paradigm BCIs. To demonstrate the validity of our proposed method, we conducted experiments on various paradigms of active/passive BCI datasets. Our experimental results demonstrated that the proposed method achieved performance improvements when judged against comparable state-of-the-art methods. Additionally, we analyzed the proposed method using different techniques, such as PSD curves and relevance score inspection to validate the multi-scale EEG signal information capturing ability, activation pattern maps for investigating the learned spatial filters, and t-SNE plotting for visualizing represented features. Finally, we also demonstrated our method's application to real-world problems.


title: SLEIPNIR: Deterministic and Provably Accurate Feature Expansion for Gaussian Process Regression with Derivatives

abstract: Gaussian processes are an important regression tool with excellent analytic properties which allow for direct integration of derivative observations. However, vanilla GP methods scale cubically in the amount of observations. In this work, we propose a novel approach for scaling GP regression with derivatives based on quadrature Fourier features. We then prove deterministic, non-asymptotic and exponentially fast decaying error bounds which apply for both the approximated kernel as well as the approximated posterior. To furthermore illustrate the practical applicability of our method, we then apply it to ODIN, a recently developed algorithm for ODE parameter inference. In an extensive experiments section, all results are empirically validated, demonstrating the speed, accuracy, and practical applicability of this approach.


title: On the Linear Convergence Rate of the Distributed Block Proximal Method

abstract: The recently developed Distributed Block Proximal Method, for solving stochastic big-data convex optimization problems, is studied in this paper under the assumption of constant stepsizes and strongly convex (possibly non-smooth) local objective functions. This class of problems arises in many learning and classification problems in which, for example, strongly-convex regularizing functions are included in the objective function, the decision variable is extremely high dimensional, and large datasets are employed. The algorithm produces local estimates by means of block-wise updates and communication among the agents. The expected distance from the (global) optimum, in terms of cost value, is shown to decay linearly to a constant value which is proportional to the selected local stepsizes. A numerical example involving a classification problem corroborates the theoretical results.


title: Moduli spaces of codimension-one subspaces in a linear variety and their tropicalization

abstract: We study the moduli space of $d$-dimensional linear subspaces contained in a fixed $(d+1)$-dimensional linear variety $X$, and its tropicalization. We prove that these moduli spaces are linear subspaces themselves, and thus their tropicalization is completely determined by their associated (valuated) matroids. We show that these matroids can be interpreted as the matroid of lines of the hyperplane arrangement corresponding to $X$, and generically are equal to a Dilworth truncation of the free matroid. In this way, we can describe combinatorially tropicalized Fano schemes and tropicalizations of moduli spaces of stable maps of degree $1$ to a plane.


title: Comment on "Enhanced deuterium-tritium fusion cross sections in the presence of strong electromagnetic fields"

abstract: In their article [Phys.\ Rev.\ C {\bf 100}, 064610 (2019)], Lv, Duan, and Liu study the enhancement of deuterium-tritium fusion reactions by the electromagnetic field of an x-ray free-electron laser (XFEL). While we support the general idea (which was put forward earlier in our rapid communication [Phys.\ Rev.\ C {\bf 100}, 041601(R) (2019)]), we find that the time-averaged potential approximation used by Lv, Duan, and Liu is not justified in this regime and does not take into account important effects. Due to those effects, the enhancement mechanism may actually be more efficient than predicted by Lv, Duan, and Liu.


title: Implementation of a Natural User Interface to Command a Drone

abstract: In this work, we propose the use of a Natural User Interface (NUI) through body gestures using the open source library OpenPose, looking for a more dynamic and intuitive way to control a drone. For the implementation, we use the Robotic Operative System (ROS) to control and manage the different components of the project. Wrapped inside ROS, OpenPose (OP) processes the video obtained in real-time by a commercial drone, allowing to obtain the user's pose. Finally, the keypoints from OpenPose are obtained and translated, using geometric constraints, to specify high-level commands to the drone. Real-time experiments validate the full strategy.


title: Constant payoff in absorbing games

abstract: In this paper, we solve the constant-payoff conjecture formulated by Sorin, Venel and Vigeral (2010), for absorbing games with an arbitrary evaluation of the stage rewards. That is, the existence of a pair of asymptotically optimal strategies, indexed by the evaluation of the stage rewards, so that the average rewards are constant on any fraction of the game. That the constant-payoff conjecture holds for stochastic games with an arbitrary evaluation is still open.


title: A new proof of the AM-GM-HM inequality

abstract: In the current note, we present a new, short proof of the famous AM-GM-HM inequality using only induction and basic calculus.


title: On multiplicity of positive solutions for nonlocal equations with critical nonlinearity

abstract: This paper deals with existence and multiplicity of positive solutions to the following class of nonlocal equations with critical nonlinearity: \begin{equation} \tag{$\mathcal E$} (-\Delta)^s u = a(x) |u|^{2^*_s-2}u+f(x)\;\;\text{in}\;\mathbb{R}^{N}, \quad u \in \dot{H}^s(\mathbb{R}^{N}), \end{equation} where $s \in (0,1)$, $N>2s$, $2_s^*:=\frac{2N}{N-2s}$, $0< a\in L^\infty(\mathbb{R}^{N})$ and $f$ is a nonnegative nontrivial functional in the dual space of $\dot{H}^s$. We prove existence of a positive solution whose energy is negative. Further, under the additional assumption that $a$ is a continuous function, $a(x)\geq 1$ in $\mathbb{R}^{N}$, $a(x)\to 1$ as $|x|\to\infty$ and $\|f\|_{\dot{H}^s(\mathbb{R}^{N})'}$ is small enough (but $f\not\equiv 0$), we establish existence of at least two positive solutions to ($\mathcal E$).


title: Univariate ReLU neural network and its application in nonlinear system identification

abstract: ReLU (rectified linear units) neural network has received significant attention since its emergence. In this paper, a univariate ReLU (UReLU) neural network is proposed to both modelling the nonlinear dynamic system and revealing insights about the system. Specifically, the neural network consists of neurons with linear and UReLU activation functions, and the UReLU functions are defined as the ReLU functions respect to each dimension. The UReLU neural network is a single hidden layer neural network, and the structure is relatively simple. The initialization of the neural network employs the decoupling method, which provides a good initialization and some insight into the nonlinear system. Compared with normal ReLU neural network, the number of parameters of UReLU network is less, but it still provide a good approximation of the nonlinear dynamic system. The performance of the UReLU neural network is shown through a Hysteretic benchmark system: the Bouc-Wen system. Simulation results verify the effectiveness of the proposed method.


title: Light $Z^\prime$ and Dark Matter from U(1)$_X$ Gauge Symmetry

abstract: We consider a U(1)$_X$ gauge symmetry extension of the Standard Model (SM) with a $Z^\prime$-portal Majorana fermion dark matter that allows for a relatively light gauge boson $Z^\prime$ with mass of 10 MeV$-$ a few GeV and a much heavier dark matter through the freeze-in mechanism. In a second scenario the roles are reversed, and the dark matter mass, in the keV range or so, lies well below the $Z^\prime$ mass, say, $\sim 1$ GeV. We outline the parameter space that can be explored for these two scenarios at the future Lifetime Frontier experiments including Belle-II, FASER, LDMX and SHiP.


title: Minimal non-odd-transversal hypergraphs and minimal non-odd-bipartite hypergraphs

abstract: Among all uniform hypergraphs with even uniformity, the odd-transversal or odd-bipartite hypergraphs are more close to bipartite simple graphs from the viewpoint of both structure and spectrum. A hypergraph is called minimal non-odd-transversal if it is non-odd-transversal but deleting any edge results in an odd-transversal hypergraph. In this paper we give an equivalent characterization of the minimal non-odd-transversal hypergraphs by the degrees and the rank of its incidence matrix over $\mathbb{Z}_2$. If a minimal non-odd-transversal hypergraph is uniform, then it has even uniformity, and hence is minimal non-odd-bipartite. We characterize $2$-regular uniform minimal non-odd-bipartite hypergraphs, and give some examples of $d$-regular uniform hypergraphs which are minimal non-odd-bipartite. Finally we give upper bounds for the least H-eigenvalue of the adjacency tensor of minimal non-odd-bipartite hypergraphs.


title: Rapidly Evolving Transients from the Hyper Suprime-Cam SSP Transient Survey

abstract: Rapidly evolving transients form a new class of transients which show shorter timescales of the light curves than those of typical core-collapse and thermonuclear supernovae. We performed a systematic search for rapidly evolving transients using the deep data taken with the Hyper Suprime-Cam Subaru Strategic Program Transient Survey. By measuring the timescales of the light curves of 1824 transients, we identified 5 rapidly evolving transients. Our samples are found in a wide range of redshifts (0.3 $\le$ z $\le$ 1.5) and peak absolute magnitudes ($-$17 $\ge$ $M_i$ $\ge$ $-$20). The properties of the light curves are similar to those of the previously discovered rapidly evolving transients. They show a relatively blue spectral energy distribution, with the best-fit blackbody of 8,000 - 18,000 K. We show that some of the transients require power sources other than the radioactive decays of $^{56}$Ni because of their high peak luminosities and short timescales. The host galaxies of all the samples are star-forming galaxies, suggesting a massive star origin for the rapidly evolving transients. The event rate is roughly estimated to be $\sim$4,000 events yr$^{-1}$ Gpc$^{-3}$, which is about 1 $\%$ of core-collapse supernovae.


title: Energy-dissipation in a coupled system of Allen-Cahn type equation and Kobayashi-Warren-Carter type model of grain boundary motion

abstract: In this paper, we consider a system of initial boundary value problems for parabolic equations, as a generalized version of the "$ \phi $-$ \eta $-$ \theta $ model" of grain boundary motion, proposed by Kobayashi [16]. The system is a coupled system of: an Allen--Cahn type equation as in (1.1) with a given temperature source; and a phase-field model of grain boundary motion, known as "Kobayashi--Warren--Carter type model". The focus of the study is on a special kind of solution, called energy-dissipative solution, which is to reproduce the energy-dissipation of the governing energy in time. Under suitable assumptions, two Main Theorems, concerned with: the existence of energy-dissipative solution; and the large-time behavior; will be demonstrated as the results of this paper.


title: Hybrid modeling: Applications in real-time diagnosis

abstract: Reduced-order models that accurately abstract high fidelity models and enable faster simulation is vital for real-time, model-based diagnosis applications. In this paper, we outline a novel hybrid modeling approach that combines machine learning inspired models and physics-based models to generate reduced-order models from high fidelity models. We are using such models for real-time diagnosis applications. Specifically, we have developed machine learning inspired representations to generate reduced order component models that preserve, in part, the physical interpretation of the original high fidelity component models. To ensure the accuracy, scalability and numerical stability of the learning algorithms when training the reduced-order models we use optimization platforms featuring automatic differentiation. Training data is generated by simulating the high-fidelity model. We showcase our approach in the context of fault diagnosis of a rail switch system. Three new model abstractions whose complexities are two orders of magnitude smaller than the complexity of the high fidelity model, both in the number of equations and simulation time are shown. The numerical experiments and results demonstrate the efficacy of the proposed hybrid modeling approach.


title: Modeling the Popularity of Twitter Hashtags with Master Equations

abstract: In this work we introduce a model based on master equations to describe the time evolution of the popularity of topics and hashtags on the Twitter social network. Specifically, we model the number of times a certain hashtag appears on the network as a function of time. In our model, the behavior of this quantity depends on the degree distribution of the network and the extrinsic interest the community has for the topic or hashtag. From the master equation, we are able to obtain explicit solutions for the mean and variance. We propose a gamma kernel function to model the topic popularity, which is quite simple and yields reasonable results. Finally, we validate the plausibility of the model by analyzing actual Twitter data obtained through the public API.


title: On Random Graph Properties

abstract: We consider 15 properties of labeled random graphs that are of interest in the graph-theoretical and the graph mining literature, such as clustering coefficients, centrality measures, spectral radius, degree assortativity, treedepth, treewidth, etc. We analyze relationships and correlations between these properties. Whereas for graphs on a small number of vertices we can exactly compute the average values and range for each property of interest, this becomes infeasible for larger graphs. We show that graphs generated by the \ErdosRenyi graph generator with $p = 1/2$ model well the underlying space of all labeled graphs with a fixed number of vertices. The later observation allows us to analyze properties and correlations between these properties for larger graphs. We then use linear and non-linear models to predict a given property based on the others and for each property, we find the most predictive subset. We experimentally show that pairs and triples of properties have high predictive power, making it possible to estimate computationally expensive to compute properties with ones for which there are efficient algorithms.


title: Transferring Axial Molecular Chirality Through a Sequence of On-Surface Reactions

abstract: Fine management of chiral processes on solid surfaces has progressed over the years, yet still faces the need for the controlled and selective production of advanced chiral materials. Here, we report on the use of enantiomerically enriched molecular building blocks to demonstrate the transmission of their intrinsic chirality along a sequence of on-surface reactions. Triggered by thermal annealing, the on-surface reac-tions induced in this experiment involve firstly the coupling of the chiral reactants into chiral polymers and subsequently their transformation into planar prochiral graphene nanoribbons. Our study reveals that the axial chirality of the reactant is not only transferred to the polymers, but also to the planar chirality of the graphene nanoribbon end products. Such chirality transfer consequently allows, starting from ad-equate enantioenriched reactants, for the controlled production of chiral and prochiral organic nanoarchi-tectures with pre-defined handedness.


title: An almost-entirely precise empirical estimation for various chemical potentials

abstract: The transverse momentum spectra of the well-identified produced particles, $\pi^+$, $\pi^-$, $K^+$, $K^-$, $p$, $\bar{p}$, $K_s^0$, $\Lambda$, $\bar{\Lambda}$, $\Xi^-$, and $\Xi^+$ are analyzed in a statistical approach. From the partition function of grand-canonical ensemble, we propose a generic expression for the dependence of the generic chemical potential $\mu$ on the rapidity $y$. Then, by fitting this expression to the experimental results on the most central $p_{\perp}$ and $d^2 N/2 \pi p_{\bot} dp_{\bot} dy$, at energies ranging from $7.7$ to $200~$GeV, we have introduced a generic expression for the rapidity dependence of $\mu$, at different energies, namely $\mu=a+b y^2$, where $a$ and $b$ is constants. We find that the resulting energy dependence $\sqrt{s_{\mathtt{NN}}}=c[(\mu-a)/b]^{d/2}$ agrees well with the statistical thermal models. We also present precise estimations of various types of chemical potentials, $\mu_B$, $\mu_S$, and $\mu_Q$, the baryon, the strangeness, and the charge chemical potential, respectively.


title: Optimizing Joint Probabilistic Caching and Channel Access for Clustered D2D Networks

abstract: Caching at mobile devices and leveraging device-to-device (D2D) communication are two promising approaches to support massive content delivery over wireless networks. Analysis of such D2D caching networks based on a physical interference model is usually carried out by assuming uniformly distributed devices. However, this approach does not capture the notion of device clustering. In this regard, this paper proposes a joint communication and caching optimization framework for clustered D2D networks. Devices are spatially distributed into disjoint clusters and are assumed to have a surplus memory that is utilized to proactively cache files, following a random probabilistic caching scheme. The cache offloading gain is maximized by jointly optimizing channel access and caching scheme. A closed-form caching solution is obtained and bisection search method is adopted to heuristically obtain the optimal channel access probability. Results show significant improvement in the offloading gain reaching up to 10% compared to the Zipf caching baseline.


title: Hadamard type fractional time-delay semilinear differential equations: Delayed Mittag-Leffler function approach

abstract: We propose a delayed Mittag-Leffler type matrix function with logarithm, which is an extension of the classical Mittag-Leffler type matrix function with logarithm and delayed Mittag-Leffler type matrix function. With the help of the delayed Mittag-Leffler type matrix function with logarithm, we give an explicit form a of solutions to nonhomogeneous Hadamard type fractional time-delay linear differential equations. Moreover, we study existence uniqueness and stability in Ulam-Hyers sense of the Hadamard type fractional time-delay nonlinear equations.


title: Logistic regression with total variation regularization

abstract: We study logistic regression with total variation penalty on the canonical parameter and show that the resulting estimator satisfies a sharp oracle inequality: the excess risk of the estimator is adaptive to the number of jumps of the underlying signal or an approximation thereof. In particular when there are finitely many jumps, and jumps up are sufficiently separated from jumps down, then the estimator converges with a parametric rate up to a logarithmic term $\log n / n$, provided the tuning parameter is chosen appropriately of order $1/ \sqrt n$. Our results extend earlier results for quadratic loss to logistic loss. We do not assume any a priori known bounds on the canonical parameter but instead only make use of the local curvature of the theoretical risk.


title: On the Ehrhart Polynomial of Minimal Matroids

abstract: We provide a formula for the Ehrhart polynomial of the connected matroid of size $n$ and rank $k$ with the least number of bases, also known as a minimal matroid. We prove that their polytopes are Ehrhart positive and $h^*$-real-rooted (and hence unimodal). We prove that the operation of circuit-hyperplane relaxation relates minimal matroids and matroid polytopes subdivisions, and also preserves Ehrhart positivity. We state two conjectures: that indeed all matroids are $h^*$-real-rooted, and that the coefficients of the Ehrhart polynomial of a connected matroid of fixed rank and cardinality are bounded by those of the corresponding minimal matroid and the corresponding uniform matroid.


title: Atomic data for calculation of the intensities of Stark components of excited hydrogen atoms in fusion plasmas

abstract: Motional Stark effect (MSE) spectroscopy represents a unique diagnostic tool capable of determining the magnitude of the magnetic field and its direction in the core of fusion plasmas. The primary excitation channel for fast hydrogen atoms in injected neutral beams, with energy in the range of 25-1000 keV, is due to collisions with protons and impurity ions (e.g., He$^{2+}$ and heavier impurities). As a result of such excitation, at the particle density of 10$^{13}$-10$^{14}$ cm$^{-3}$, the line intensities of the Stark multiplets do not follow statistical expectations (i.e., the populations of fine-structure levels within the same principal quantum number $n$ are not proportional to their statistical weights). Hence, any realistic modeling of MSE spectra has to include the relevant collisional atomic data. In this paper we provide a general expression for the excitation cross sections in parabolic states within $n$=3 for an arbitrary orientation between the direction of the motion-induced electric field and the proton-atom collisional axis. The calculations make use of the density matrix obtained with the atomic orbital close coupling method and the method can be applied to other collisional systems (e.g., He$^{2+}$, Be$^{4+}$, C$^{6+}$, etc.). The resulting cross sections are given as simple fits that can be directly applied to spectral modeling. For illustration we note that the asymmetry detected in the first classical cathode ray experiments between the red- and blue-shifted spectral components can be quantitatively studied using the proposed approach.


title: Stochastic Linear Contextual Bandits with Diverse Contexts

abstract: In this paper, we investigate the impact of context diversity on stochastic linear contextual bandits. As opposed to the previous view that contexts lead to more difficult bandit learning, we show that when the contexts are sufficiently diverse, the learner is able to utilize the information obtained during exploitation to shorten the exploration process, thus achieving reduced regret. We design the LinUCB-d algorithm, and propose a novel approach to analyze its regret performance. The main theoretical result is that under the diverse context assumption, the cumulative expected regret of LinUCB-d is bounded by a constant. As a by-product, our results improve the previous understanding of LinUCB and strengthen its performance guarantee.


title: Backward CUSUM for Testing and Monitoring Structural Change with an Application to COVID-19 Pandemic Data

abstract: It is well known that the conventional cumulative sum (CUSUM) test suffers from low power and large detection delay. In order to improve the power of the test, we propose two alternative statistics. The backward CUSUM detector considers the recursive residuals in reverse chronological order, whereas the stacked backward CUSUM detector sequentially cumulates a triangular array of backwardly cumulated residuals. A multivariate invariance principle for partial sums of recursive residuals is given, and the limiting distributions of the test statistics are derived under local alternatives. In the retrospective context, the local power of the tests is shown to be substantially higher than that of the conventional CUSUM test if a break occurs in the middle or at the end of the sample. When applied to monitoring schemes, the detection delay of the stacked backward CUSUM is found to be much shorter than that of the conventional monitoring CUSUM procedure. Furthermore, we propose an estimator of the break date based on the backward CUSUM detector and show that in monitoring exercises this estimator tends to outperform the usual maximum likelihood estimator. Finally, an application of the methodology to COVID-19 data is presented.


title: SketchyCOCO: Image Generation from Freehand Scene Sketches

abstract: We introduce the first method for automatic image generation from scene-level freehand sketches. Our model allows for controllable image generation by specifying the synthesis goal via freehand sketches. The key contribution is an attribute vector bridged Generative Adversarial Network called EdgeGAN, which supports high visual-quality object-level image content generation without using freehand sketches as training data. We have built a large-scale composite dataset called SketchyCOCO to support and evaluate the solution. We validate our approach on the tasks of both object-level and scene-level image generation on SketchyCOCO. Through quantitative, qualitative results, human evaluation and ablation studies, we demonstrate the method's capacity to generate realistic complex scene-level images from various freehand sketches.


title: A stochastic subspace approach to gradient-free optimization in high dimensions

abstract: We present a stochastic descent algorithm for unconstrained optimization that is particularly efficient when the objective function is slow to evaluate and gradients are not easily obtained, as in some PDE-constrained optimization and machine learning problems. The algorithm maps the gradient onto a low-dimensional random subspace of dimension $\ell$ at each iteration, similar to coordinate descent but without restricting directional derivatives to be along the axes. Without requiring a full gradient, this mapping can be performed by computing $\ell$ directional derivatives (e.g., via forward-mode automatic differentiation). We give proofs for convergence in expectation under various convexity assumptions as well as probabilistic convergence results under strong-convexity. Our method extends the well-known Gaussian smoothing technique to descent in subspaces of dimension greater than one, opening the doors to new analysis of Gaussian smoothing when more than one directional derivative is used at each iteration. We also provide a finite-dimensional variant of a special case of the Johnson-Lindenstrauss lemma. Experimentally, we show that our method compares favorably to coordinate descent, Gaussian smoothing, gradient descent and BFGS (when gradients are calculated via forward-mode automatic differentiation) on problems from the machine learning and shape optimization literature.