title: Magnetically-induced local lattice anomalies and low-frequency nematic fluctuations in the Mott insulator La$_2$O$_3$Fe$_2$Se$_2$

abstract: We report a study of the Mott insulator La$_2$O$_3$Fe$_2$Se$_2$ by means of $^{139}$La nuclear quadrupole resonance (NQR). The NQR spectra evidence a single La site in the paramagnetic phase and two inequivalent La sites, La1 and La2, in the antiferromagnetically-ordered phase (N\'eel temperature $T_{\rm{N}} \simeq 90$ K). These two sites are characterized by different quadrupole couplings, indicative of distinct lattice and/or charge configurations likely segregated in domains. The dependence of the quadrupole coupling for La2 on temperature suggests that the magnetic order parameter drives the structural distortion. The nuclear spin-lattice and transverse relaxation rates, $1/T_1$ and $1/T_2$, evidence fluctuations in the paramagnetic phase with characteristic frequencies well below the Heisenberg exchange frequency, likely associated with nematic fluctuations.


title: DOTS: Decoupling Operation and Topology in Differentiable Architecture Search

abstract: Differentiable Architecture Search (DARTS) has attracted extensive attention due to its efficiency in searching for cell structures. DARTS mainly focuses on the operation search and derives the cell topology from the operation weights. However, the operation weights can not indicate the importance of cell topology and result in poor topology rating correctness. To tackle this, we propose to Decouple the Operation and Topology Search (DOTS), which decouples the topology representation from operation weights and makes an explicit topology search. DOTS is achieved by introducing a topology search space that contains combinations of candidate edges. The proposed search space directly reflects the search objective and can be easily extended to support a flexible number of edges in the searched cell. Existing gradient-based NAS methods can be incorporated into DOTS for further improvement by the topology search. Considering that some operations (e.g., Skip-Connection) can affect the topology, we propose a group operation search scheme to preserve topology-related operations for a better topology search. The experiments on CIFAR10/100 and ImageNet demonstrate that DOTS is an effective solution for differentiable NAS.


title: Tight Approximation Guarantees for Concave Coverage Problems

abstract: In the maximum coverage problem, we are given subsets $T_1, \ldots, T_m$ of a universe $[n]$ along with an integer $k$ and the objective is to find a subset $S \subseteq [m]$ of size $k$ that maximizes $C(S) := \Big|\bigcup_{i \in S} T_i\Big|$. It is a classic result that the greedy algorithm for this problem achieves an optimal approximation ratio of $1-e^{-1}$. In this work we consider a generalization of this problem wherein an element $a$ can contribute by an amount that depends on the number of times it is covered. Given a concave, nondecreasing function $\varphi$, we define $C^{\varphi}(S) := \sum_{a \in [n]}w_a\varphi(|S|_a)$, where $|S|_a = |\{i \in S : a \in T_i\}|$. The standard maximum coverage problem corresponds to taking $\varphi(j) = \min\{j,1\}$. For any such $\varphi$, we provide an efficient algorithm that achieves an approximation ratio equal to the Poisson concavity ratio of $\varphi$, defined by $\alpha_{\varphi} := \min_{x \in \mathbb{N}^*} \frac{\mathbb{E}[\varphi(\text{Poi}(x))]}{\varphi(\mathbb{E}[\text{Poi}(x)])}$. Complementing this approximation guarantee, we establish a matching NP-hardness result when $\varphi$ grows in a sublinear way. As special cases, we improve the result of [Barman et al., IPCO, 2020] about maximum multi-coverage, that was based on the unique games conjecture, and we recover the result of [Dudycz et al., IJCAI, 2020] on multi-winner approval-based voting for geometrically dominant rules. Our result goes beyond these special cases and we illustrate it with applications to distributed resource allocation problems, welfare maximization problems and approval-based voting for general rules.


title: A hybrid simulation of gravitational wave production in first-order phase transitions

abstract: The LISA telescope will provide the first opportunity to probe the scenario of a first-order phase transition happening close to the electroweak scale. By now, it is evident that the main contribution to the GW spectrum comes from the sound waves propagating through the plasma. Current estimates of the GW spectrum are based on numerical simulations of a scalar field interacting with the plasma or on analytical approximations -- the so-called sound shell model. In this work we present a novel setup to calculate the GW spectra from sound waves. We use a hybrid method that uses a 1d simulation (with spherical symmetry) to evolve the velocity and enthalpy profiles of a single bubble after collision and embed it in a 3d realization of multiple bubble collisions, assuming linear superposition of the velocity and enthalpy. The main advantage of our method compared to 3d hydrodynamic simulations is that it does not require to resolve the scale of bubble wall thickness. This makes our simulations more economical and the only two relevant physical length scales that enter are the bubble size and the shell thickness (that are in turn enclosed by the box size and the grid spacing). The reduced costs allow for extensive parameter studies and we provide a parametrization of the final GW spectrum as a function of the wall velocity and the fluid kinetic energy.


title: 6G Cellular Networks and Connected Autonomous Vehicles

abstract: With 5G mobile communication systems been commercially rolled out, research discussions on next generation mobile systems, i.e., 6G, have started. On the other hand, vehicular technologies are also evolving rapidly, from connected vehicles as coined by V2X (vehicle to everything) to autonomous vehicles to the combination of the two, i.e., the networks of connected autonomous vehicles (CAV). How fast the evolution of these two areas will go head-in-head is of great importance, which is the focus of this paper. Based on a brief overview on the technological evolution of V2X to CAV and 6G key technologies, this paper explores two complementary research directions, namely, 6G for CAVs versus CAVs for 6G. The former investigates how various 6G key enablers, such as THz, cell free communication and artificial intelligence (AI), can be utilized to provide CAV mission-critical services. The latter discusses how CAVs can facilitate effective deployment and operation of 6G systems. This paper attempts to investigate the interactions between the two technologies to spark more research efforts in these areas.


title: RISA-Net: Rotation-Invariant Structure-Aware Network for Fine-Grained 3D Shape Retrieval

abstract: Fine-grained 3D shape retrieval aims to retrieve 3D shapes similar to a query shape in a repository with models belonging to the same class, which requires shape descriptors to be capable of representing detailed geometric information to discriminate shapes with globally similar structures. Moreover, 3D objects can be placed with arbitrary position and orientation in real-world applications, which further requires shape descriptors to be robust to rigid transformations. The shape descriptions used in existing 3D shape retrieval systems fail to meet the above two criteria. In this paper, we introduce a novel deep architecture, RISA-Net, which learns rotation invariant 3D shape descriptors that are capable of encoding fine-grained geometric information and structural information, and thus achieve accurate results on the task of fine-grained 3D object retrieval. RISA-Net extracts a set of compact and detailed geometric features part-wisely and discriminatively estimates the contribution of each semantic part to shape representation. Furthermore, our method is able to learn the importance of geometric and structural information of all the parts when generating the final compact latent feature of a 3D shape for fine-grained retrieval. We also build and publish a new 3D shape dataset with sub-class labels for validating the performance of fine-grained 3D shape retrieval methods. Qualitative and quantitative experiments show that our RISA-Net outperforms state-of-the-art methods on the fine-grained object retrieval task, demonstrating its capability in geometric detail extraction. The code and dataset are available at: https://github.com/IGLICT/RisaNET.


title: Computation of invariant sets via immersion for discrete-time nonlinear systems

abstract: In this paper, we propose an approach for computing invariant sets of discrete-time nonlinear systems by lifting the nonlinear dynamics into a higher dimensional linear model. In particular, we focus on the \emph{maximal admissible invariant set} contained in some given constraint set. For special types of nonlinear systems, which can be exactly immersed into higher dimensional linear systems with state transformations, invariant sets of the original nonlinear system can be characterized using the higher dimensional linear representation. For general nonlinear systems without the immersibility property, \emph{approximate immersions} are defined in a local region within some tolerance and linear approximations are computed by leveraging the fixed-point iteration technique for invariant sets. Given the bound on the mismatch between the linear approximation and the original system, we provide an invariant inner approximation of the \emph{maximal admissible invariant set} by a tightening procedure.


title: Taking Modality-free Human Identification as Zero-shot Learning

abstract: Human identification is an important topic in event detection, person tracking, and public security. There have been numerous methods proposed for human identification, such as face identification, person re-identification, and gait identification. Typically, existing methods predominantly classify a queried image to a specific identity in an image gallery set (I2I). This is seriously limited for the scenario where only a textual description of the query or an attribute gallery set is available in a wide range of video surveillance applications (A2I or I2A). However, very few efforts have been devoted towards modality-free identification, i.e., identifying a query in a gallery set in a scalable way. In this work, we take an initial attempt, and formulate such a novel Modality-Free Human Identification (named MFHI) task as a generic zero-shot learning model in a scalable way. Meanwhile, it is capable of bridging the visual and semantic modalities by learning a discriminative prototype of each identity. In addition, the semantics-guided spatial attention is enforced on visual modality to obtain representations with both high global category-level and local attribute-level discrimination. Finally, we design and conduct an extensive group of experiments on two common challenging identification tasks, including face identification and person re-identification, demonstrating that our method outperforms a wide variety of state-of-the-art methods on modality-free human identification.


title: Multiple bounded variation solutions for a prescribed mean curvature equation with Neumann boundary conditions

abstract: We prove the existence of multiple positive BV-solutions of the Neumann problem $$ \begin{cases} \displaystyle -\left(\frac{u'}{\sqrt{1+u'^2}}\right)'=a(x)f(u)\quad&\mbox{in }(0,1), u'(0)=u'(1)=0,& {cases} $$ where $a(x) > 0$ and $f$ belongs to a class of nonlinear functions whose prototype example is given by $f(u) = -\lambda u + u^p$, for $\lambda > 0$ and $p > 1$. In particular, $f(0)=0$ and $f$ has a unique positive zero, denoted by $u_0$. Solutions are distinguished by the number of intersections (in a generalized sense) with the constant solution $u = u_0$. We further prove that the solutions found have continuous energy and we also give sufficient conditions on the nonlinearity to get classical solutions. The analysis is performed using an approximation of the mean curvature operator and the shooting method.


title: Group Equivariant Stand-Alone Self-Attention For Vision

abstract: We provide a general self-attention formulation to impose group equivariance to arbitrary symmetry groups. This is achieved by defining positional encodings that are invariant to the action of the group considered. Since the group acts on the positional encoding directly, group equivariant self-attention networks (GSA-Nets) are steerable by nature. Our experiments on vision benchmarks demonstrate consistent improvements of GSA-Nets over non-equivariant self-attention networks.


title: Orthogonality in Banach Spaces via projective tensor product

abstract: Let $X$ be a complex Banach space and $x,y\in X$. By definition, we say that $x$ is Birkhoff-James orthogonal to $y$ if $ \|x+\lambda y\|_{X} \geq \|x\|_{X}$ for all $\lambda \in \mathbb{C}$. We prove that $x$ is Birkhoff-James orthogonal to $y$ if and only if there exists a semi-inner product $\varphi$ on $X$ such that $\|\varphi\| = 1$, $\varphi(x,x)=\|x\|^2$ and $\varphi(x,y)=0$. A similar result holds for $C^*$-algebras. A key point in our approach to orthogonality is the representations of bounded bilinear maps via projective tensor product spaces.


title: BOSS: Bayesian Optimization over String Spaces

abstract: This article develops a Bayesian optimization (BO) method which acts directly over raw strings, proposing the first uses of string kernels and genetic algorithms within BO loops. Recent applications of BO over strings have been hindered by the need to map inputs into a smooth and unconstrained latent space. Learning this projection is computationally and data-intensive. Our approach instead builds a powerful Gaussian process surrogate model based on string kernels, naturally supporting variable length inputs, and performs efficient acquisition function maximization for spaces with syntactical constraints. Experiments demonstrate considerably improved optimization over existing approaches across a broad range of constraints, including the popular setting where syntax is governed by a context-free grammar.


title: MultiCQA: Zero-Shot Transfer of Self-Supervised Text Matching Models on a Massive Scale

abstract: We study the zero-shot transfer capabilities of text matching models on a massive scale, by self-supervised training on 140 source domains from community question answering forums in English. We investigate the model performances on nine benchmarks of answer selection and question similarity tasks, and show that all 140 models transfer surprisingly well, where the large majority of models substantially outperforms common IR baselines. We also demonstrate that considering a broad selection of source domains is crucial for obtaining the best zero-shot transfer performances, which contrasts the standard procedure that merely relies on the largest and most similar domains. In addition, we extensively study how to best combine multiple source domains. We propose to incorporate self-supervised with supervised multi-task learning on all available source domains. Our best zero-shot transfer model considerably outperforms in-domain BERT and the previous state of the art on six benchmarks. Fine-tuning of our model with in-domain data results in additional large gains and achieves the new state of the art on all nine benchmarks.


title: Equation of state of strongly magnetized matter with hyperons and $\Delta$-resonances

abstract: We construct a new equation of state for the baryonic matter under an intense magnetic field within the framework of covariant density functional theory. The composition of matter includes hyperons as well as $ \Delta$-resonances. The extension of the nucleonic functional to the hypernuclear sector is constrained by the experimental data on $\Lambda$ and $\Xi$-hypernuclei. We find that the equation of state stiffens with the inclusion of the magnetic field, which increases the maximum mass of neutron star compared to the non-magnetic case. In addition, the strangeness fraction in the matter is enhanced. Several observables, like the Dirac effective mass, particle abundances, etc show typical oscillatory behavior as a function of the magnetic field and/or density which is traced back to the occupation pattern of Landau levels.


title: Physical limits of wind energy within the atmosphere and its use as renewable energy: From the theoretical basis to practical implications

abstract: How much wind energy does the atmosphere generate, and how much of it can at best be used as renewable energy? This review aims to give first-order estimates and sensitivities to answer these questions that are consistent with those obtained from numerical simulation models. The first part describes how thermodynamics determines how much wind energy the atmosphere is physically capable of generating at large scales from the solar radiative forcing. The work done to generate and maintain large-scale atmospheric motion can be seen as the consequence of an atmospheric heat engine, which is driven by the difference in solar radiative heating between the tropics and the poles. The resulting motion transports heat, which depletes this differential solar heating and the associated, large-scale temperature difference. This interaction between the thermodynamic driver and the resulting dynamics leads to a maximum in the global mean kinetic energy generation rate of about 1.7 W m$^{-2}$, which matches rates inferred from observations of about 2.1 - 2.5 W m$^{-2}$ very well. The second part focuses on the limits of converting the kinetic energy of the atmosphere into renewable energy. The momentum balance of the lower atmosphere shows that at large-scales, only a fraction of about 26% of the kinetic energy can at most be converted to renewable energy, yielding a typical resource potential of about 0.5 W m$^{-2}$ per surface area. The apparent discrepancy with much higher yields of small wind farms can be explained by the spatial scale of about 100 km at which kinetic energy near the surface is being dissipated and replenished. I close with a discussion of how these insights are compatible to established meteorological concepts, inform practical applications, and can set the basis for doing climate science in a simple, analytical, and transparent way.


title: The search for magnetic fields in two Wolf-Rayet stars and the discovery of a variable magnetic field in WR55

abstract: Magnetic fields in Wolf-Rayet (WR) stars are not well explored, although there is indirect evidence, e.g. from spectral variability and X-ray emission, that magnetic fields should be present in these stars. Being in an advanced stage of their evolution, WR stars have lost their hydrogen envelope, but their dense winds make the stellar core almost unobservable. To substantiate the expectations on the presence of magnetic fields in the most-evolved massive stars, we selected two WR stars, WR46 and WR55, for the search of the presence of magnetic fields using FORS2 spectropolarimetric observations. We achieve a formally definite detection of a variable mean longitudinal magnetic field of the order of a few hundred Gauss in WR55. The field detection in this star, which is associated with the ring nebula RCW78 and the molecular environment, is of exceptional importance for our understanding of star formation. No field detection at a significance level of 3sigma was achieved for WR46, but the variability of the measured field strengths can be rather well phased with the rotation period of 15.5h previously suggested by FUSE observations.


title: An Empirical Study of DNNs Robustification Inefficacy in Protecting Visual Recommenders

abstract: Visual-based recommender systems (VRSs) enhance recommendation performance by integrating users' feedback with the visual features of product images extracted from a deep neural network (DNN). Recently, human-imperceptible images perturbations, defined \textit{adversarial attacks}, have been demonstrated to alter the VRSs recommendation performance, e.g., pushing/nuking category of products. However, since adversarial training techniques have proven to successfully robustify DNNs in preserving classification accuracy, to the best of our knowledge, two important questions have not been investigated yet: 1) How well can these defensive mechanisms protect the VRSs performance? 2) What are the reasons behind ineffective/effective defenses? To answer these questions, we define a set of defense and attack settings, as well as recommender models, to empirically investigate the efficacy of defensive mechanisms. The results indicate alarming risks in protecting a VRS through the DNN robustification. Our experiments shed light on the importance of visual features in very effective attack scenarios. Given the financial impact of VRSs on many companies, we believe this work might rise the need to investigate how to successfully protect visual-based recommenders. Source code and data are available at https://anonymous.4open.science/r/868f87ca-c8a4-41ba-9af9-20c41de33029/.


title: Kalman Filtering Attention for User Behavior Modeling in CTR Prediction

abstract: Click-through rate (CTR) prediction is one of the fundamental tasks for e-commerce search engines. As search becomes more personalized, it is necessary to capture the user interest from rich behavior data. Existing user behavior modeling algorithms develop different attention mechanisms to emphasize query-relevant behaviors and suppress irrelevant ones. Despite being extensively studied, these attentions still suffer from two limitations. First, conventional attentions mostly limit the attention field only to a single user's behaviors, which is not suitable in e-commerce where users often hunt for new demands that are irrelevant to any historical behaviors. Second, these attentions are usually biased towards frequent behaviors, which is unreasonable since high frequency does not necessarily indicate great importance. To tackle the two limitations, we propose a novel attention mechanism, termed Kalman Filtering Attention (KFAtt), that considers the weighted pooling in attention as a maximum a posteriori (MAP) estimation. By incorporating a priori, KFAtt resorts to global statistics when few user behaviors are relevant. Moreover, a frequency capping mechanism is incorporated to correct the bias towards frequent behaviors. Offline experiments on both benchmark and a 10 billion scale real production dataset, together with an Online A/B test, show that KFAtt outperforms all compared state-of-the-arts. KFAtt has been deployed in the ranking system of a leading e commerce website, serving the main traffic of hundreds of millions of active users everyday.


title: Big Bang Nucleosynthesis constraints on Barrow entropy

abstract: We use Big Bang Nucleosynthesis (BBN) data in order to impose constraints on the exponent of Barrow entropy. The latter is an extended entropy relation arising from the incorporation of quantum-gravitational effects on the black-hole structure, parameterized effectively by the new parameter $\Delta$. When considered in a cosmological framework and under the light of the gravity-thermodynamics conjecture, Barrow entropy leads to modified cosmological scenarios whose Friedmann equations contain extra terms. We perform a detailed analysis of the BBN era and we calculate the deviation of the freeze-out temperature comparing to the result of standard cosmology. We use the observationally determined bound on $ |\frac{\delta {T}_f}{{T}_f}|$ in order to extract the upper bound on $\Delta$. As we find, the Barrow exponent should be inside the bound $\Delta\lesssim 1.4\times 10^{-4}$ in order not to spoil the BBN epoch, which shows that the deformation from standard Bekenstein-Hawking expression should be small as expected.


title: Quantitative assessment of linear noise-reduction filters for spectroscopy

abstract: Linear noise-reduction filters used in spectroscopy must strike a balance between reducing noise and preserving lineshapes, the two conflicting requirements of interest.


title: Uncertainty driven probabilistic voxel selection for image registration

abstract: This paper presents a novel probabilistic voxel selection strategy for medical image registration in time-sensitive contexts, where the goal is aggressive voxel sampling (e.g. using less than 1% of the total number) while maintaining registration accuracy and low failure rate. We develop a Bayesian framework whereby, first, a voxel sampling probability field (VSPF) is built based on the uncertainty on the transformation parameters. We then describe a practical, multi-scale registration algorithm, where, at each optimization iteration, different voxel subsets are sampled based on the VSPF. The approach maximizes accuracy without committing to a particular fixed subset of voxels. The probabilistic sampling scheme developed is shown to manage the tradeoff between the robustness of traditional random voxel selection (by permitting more exploration) and the accuracy of fixed voxel selection (by permitting a greater proportion of informative voxels).


title: Knowledge Graph Embeddings in Geometric Algebras

abstract: Knowledge graph (KG) embedding aims at embedding entities and relations in a KG into a lowdimensional latent representation space. Existing KG embedding approaches model entities andrelations in a KG by utilizing real-valued , complex-valued, or hypercomplex-valued (Quaternionor Octonion) representations, all of which are subsumed into a geometric algebra. In this work,we introduce a novel geometric algebra-based KG embedding framework, GeomE, which uti-lizes multivector representations and the geometric product to model entities and relations. Ourframework subsumes several state-of-the-art KG embedding approaches and is advantageouswith its ability of modeling various key relation patterns, including (anti-)symmetry, inversionand composition, rich expressiveness with higher degree of freedom as well as good general-ization capacity. Experimental results on multiple benchmark knowledge graphs show that theproposed approach outperforms existing state-of-the-art models for link prediction.


title: An alternative proof of the vulnerability of retrieval in high intrinsic dimensionality neighborhood

abstract: This paper investigates the vulnerability of the nearest neighbors search, which is a pivotal tool in data analysis and machine learning. The vulnerability is gauged as the relative amount of perturbation that an attacker needs to add onto a dataset point in order to modify its neighbor rank w.r.t. a query. The statistical distribution of this quantity is derived from simple assumptions. Experiments on six large scale datasets validate this model up to some outliers which are explained in term of violations of the assumptions.


title: RDCNet: Instance segmentation with a minimalist recurrent residual network

abstract: Instance segmentation is a key step for quantitative microscopy. While several machine learning based methods have been proposed for this problem, most of them rely on computationally complex models that are trained on surrogate tasks. Building on recent developments towards end-to-end trainable instance segmentation, we propose a minimalist recurrent network called recurrent dilated convolutional network (RDCNet), consisting of a shared stacked dilated convolution (sSDC) layer that iteratively refines its output and thereby generates interpretable intermediate predictions. It is light-weight and has few critical hyperparameters, which can be related to physical aspects such as object size or density.We perform a sensitivity analysis of its main parameters and we demonstrate its versatility on 3 tasks with different imaging modalities: nuclear segmentation of H&E slides, of 3D anisotropic stacks from light-sheet fluorescence microscopy and leaf segmentation of top-view images of plants. It achieves state-of-the-art on 2 of the 3 datasets.


title: Mass-Velocity Dispersion Relation in HIFLUGCS Galaxy Clusters

abstract: We investigate the mass-velocity dispersion relation (MVDR) in 29 galaxy clusters in the HIghest X-ray FLUx Galaxy Cluster Sample (HIFLUGCS). We measure the spatially resolved, line-of-sight velocity dispersion profiles of these clusters, which we find to be mostly flat at large radii, reminiscent of the rotation curves of galaxies. We discover a tight empirical relation between the baryonic mass $M_\mathrm{bar}$ and the flat velocity dispersion $\sigma$ of the member galaxies, i.e. MVDR, $\log(M_\mathrm{bar}/M_\odot)=4.1^{+0.4}_{-0.4}\,\log(\sigma/\mathrm{km}\,\mathrm{s}^{-1})+1.6^{+1.0}_{-1.3}$, with the lognormal intrinsic scatter of $12^{+3}_{-3}\%$. The residuals of the MVDR are uncorrelated with other cluster properties like temperature, cluster radius, baryonic mass surface density, and redshift. These characteristics are reminiscent of the MVDR for individual galaxies, albeit about ten times larger characteristic acceleration scale. The cluster baryon fraction falls short of the cosmic value, exposing a problem: the discrepancy increases systematically for clusters of lower mass and lower baryonic acceleration.


title: MADRaS : Multi Agent Driving Simulator

abstract: In this work, we present MADRaS, an open-source multi-agent driving simulator for use in the design and evaluation of motion planning algorithms for autonomous driving. MADRaS provides a platform for constructing a wide variety of highway and track driving scenarios where multiple driving agents can train for motion planning tasks using reinforcement learning and other machine learning algorithms. MADRaS is built on TORCS, an open-source car-racing simulator. TORCS offers a variety of cars with different dynamic properties and driving tracks with different geometries and surface properties. MADRaS inherits these functionalities from TORCS and introduces support for multi-agent training, inter-vehicular communication, noisy observations, stochastic actions, and custom traffic cars whose behaviours can be programmed to simulate challenging traffic conditions encountered in the real world. MADRaS can be used to create driving tasks whose complexities can be tuned along eight axes in well-defined steps. This makes it particularly suited for curriculum and continual learning. MADRaS is lightweight and it provides a convenient OpenAI Gym interface for independent control of each car. Apart from the primitive steering-acceleration-brake control mode of TORCS, MADRaS offers a hierarchical track-position -- speed control that can potentially be used to achieve better generalization. MADRaS uses multiprocessing to run each agent as a parallel process for efficiency and integrates well with popular reinforcement learning libraries like RLLib.


title: A local geometry of hyperedges in hypergraphs, and its applications to social networks

abstract: In many real world datasets arising from social networks, there are hidden higher order relations among data points which cannot be captured using graph modeling. It is natural to use a more general notion of hypergraphs to model such social networks. In this paper, we introduce a new local geometry of hyperdges in hypergraphs which allows to capture higher order relations among data points. Furthermore based on this new geometry, we also introduce new methodology--the nearest neighbors method in hypergraphs--for analyzing datasets arising from sociology.


title: Understanding the Predictability of Gesture Parameters from Speech and their Perceptual Importance

abstract: Gesture behavior is a natural part of human conversation. Much work has focused on removing the need for tedious hand-animation to create embodied conversational agents by designing speech-driven gesture generators. However, these generators often work in a black-box manner, assuming a general relationship between input speech and output motion. As their success remains limited, we investigate in more detail how speech may relate to different aspects of gesture motion. We determine a number of parameters characterizing gesture, such as speed and gesture size, and explore their relationship to the speech signal in a two-fold manner. First, we train multiple recurrent networks to predict the gesture parameters from speech to understand how well gesture attributes can be modeled from speech alone. We find that gesture parameters can be partially predicted from speech, and some parameters, such as path length, being predicted more accurately than others, like velocity. Second, we design a perceptual study to assess the importance of each gesture parameter for producing motion that people perceive as appropriate for the speech. Results show that a degradation in any parameter was viewed negatively, but some changes, such as hand shape, are more impactful than others. A video summarization can be found at https://youtu.be/aw6-_5kmLjY.


title: 3-Dimensional QCD Phase Diagrams for Strange Matter

abstract: In this work, we examine in detail the difference between constraining the electric charge fraction and isospin fraction when calculating the deconfinement phase transition in the presence of net strangeness. We present relations among charge and isospin fractions and the corresponding chemical potentials and draw 3-dimensional QCD phase diagrams for matter out of weak equilibrium. Finally, we briefly discuss how our results can be applied to comparisons of matter created in heavy ion collisions and binary neutron star mergers.


title: A data-driven approach to constraining the atmospheric temperature structure of KELT-9b

abstract: Context. Observationally constraining the atmospheric temperature-pressure (TP) profile of exoplanets is an important step forward for improving planetary atmosphere models, further enabling one to place the detection of spectral features and the measurement of atomic and molecular abundances through transmission and emission spectroscopy on solid ground. Aims. The aim is to constrain the TP profile of the ultra-hot Jupiter KELT-9b by fitting synthetic spectra to the observed H$\alpha$ and H$\beta$ lines and identify why self-consistent planetary TP models are unable to fit the observations. Methods. We construct 126 one-dimensional TP profiles varying the lower and upper atmospheric temperatures, as well as the location and gradient of the temperature rise. For each TP profile, we compute transmission spectra of the H$\alpha$ and H$\beta$ lines employing the Cloudy radiative transfer code, which self-consistently accounts for non-local thermodynamic equilibrium (NLTE) effects. Results. The TP profiles leading to best fit the observations are characterised by an upper atmospheric temperature of 10000-11000 K and by an inverted temperature profile at pressures higher than 10$^{-4}$ bar. We find that the assumption of local thermodynamic equilibrium (LTE) leads to overestimate the level population of excited hydrogen by several orders of magnitude, and hence to significantly overestimate the strength of the Balmer lines. The chemical composition of the best fitting models indicate that the high upper atmospheric temperature is most likely driven by metal photoionisation and that FeII and FeIII have comparable abundances at pressures lower than 10$^{-6}$ bar, possibly making the latter detectable. Conclusions. Modelling the atmospheres of ultra-hot Jupiters requires one to account for metal photoionisation. [abridged]


title: An alternative response to the off-shell quantum fluctuations: A step forward in resolution of the Casimir puzzle

abstract: The spatially nonlocal response functions are proposed which nearly coincide with the commonly used local response for electromagnetic fields and fluctuations on the mass shell, but differ significantly for the off-shell fluctuating field. It is shown that the fundamental Lifshitz theory using the suggested response functions comes to an agreement with the measurement data for the Casimir force without neglecting the dissipation of free electrons. We demonstrate that reflectances of the on-shell electromagnetic waves calculated using the nonlocal and commonly employed local responses differ only slightly. The Kramers-Kronig relations for nonlocal response functions possessing the first- and second-order poles at zero frequency are derived, i.e., the proposed response satisfies the principle of causality. An application of these results to resolution of the Casimir puzzle, which lies in the fact that the Lifshitz theory is experimentally consistent only with discarded dissipation, is discussed.


title: Orbital variability of the optical linear polarization of the $\gamma$-ray binary LS I +61 303 and new constraints on the orbital parameters

abstract: We studied the variability of the linear polarization and brightness of the $\gamma$-ray binary LS I +61 303. High-precision BVR photopolarimetric observations were carried out with the Dipol-2 polarimeter on the 2.2 m remotely controlled UH88 telescope at Mauna Kea Observatory and the 60 cm Tohoku telescope at Haleakala Observatory (Hawaii) over 140 nights in 2016--2019. We determined the position angle of the intrinsic polarization $\theta \simeq 11^\circ$, which can either be associated with the projection of the Be star's decretion disk axis on the plane of sky, or can differ from it by $90^\circ$. Using the Lomb-Scargle method, we performed timing analyses and period searches of our polarimetric and photometric data. We found statistically significant periodic variability of the normalized Stokes parameters $q$ and $u$ in all passbands. The most significant period of variability, $P_\text{Pol} = 13.244 \pm 0.012$ d, is equal to one half of the orbital period $P_\text{orb} = 26.496$ d. Using a model of Thomson scattering by a cloud that orbits the Be star, we obtained constraints on the orbital parameters, including a small eccentricity $e<0.2$ and periastron phase of $\phi_\text{p}\approx 0.6$, which coincides with the peaks in the radio, X-ray, and TeV emission. These constraints are independent of the assumption about the orientation of the decretion disk plane on the sky. We also extensively discuss the apparent inconsistency with the previous measurements of the orbital parameters from radial velocities. By folding the photometry data acquired during a three-year time span with the orbital period, we found a linear phase shift of the moments of the brightness maximum, confirming the possible existence of superorbital variability.


title: Going-up theorems for simultaneous Diophantine approximation

abstract: We establish several new inequalities linking classical exponents of Diophantine approximation associated to a real vector $\underline{\xi}=(\xi,\xi^{2},\ldots,\xi^{N})$, in various dimensions $N$. We thereby obtain variants, and partly refinements, of recent results of Badziahin and Bugeaud. We further implicitly recover inequalities of Bugeaud and Laurent as special cases, with new proofs. Similar estimates concerning general real vectors (not on the Veronese curve) with $\mathbb{Q}$-linearly independent coordinates are addressed as well. Our method is based on Minkowski's Second Convex Body Theorem, applied in the framework of parametric geometry of numbers introduced by Schmidt and Summerer. We also frequently employ Mahler's Duality result on polar convex bodies.


title: The 2019 eruption of recurrent nova V3890 Sgr: observations by Swift, NICER and SMARTS

abstract: V3890 Sgr is a recurrent nova which has been seen in outburst three times so far, with the most recent eruption occurring on 2019 August 27 UT. This latest outburst was followed in detail by the Neil Gehrels Swift Observatory, from less than a day after the eruption until the nova entered the Sun observing constraint, with a small number of additional observations after the constraint ended. The X-ray light-curve shows initial hard shock emission, followed by an early start of the super-soft source phase around day 8.5, with the soft emission ceasing by day 26. Together with the peak blackbody temperature of the super-soft spectrum being ~100 eV, these timings suggest the white dwarf mass to be high, ~1.3 M_sun. The UV photometric light-curve decays monotonically, with the decay rate changing a number of times, approximately simultaneously with variations in the X-ray emission. The UV grism spectra show both line and continuum emission, with emission lines of N, C, Mg and O being notable. These UV spectra are best dereddened using an SMC extinction law. Optical spectra from SMARTS show evidence of interaction between the nova ejecta and wind from the donor star, as well as the extended atmosphere of the red giant being flash-ionized by the super-soft X-ray photons. Data from NICER reveal a transient 83 s quasi-periodic oscillation, with a modulation amplitude of 5 per cent, adding to the sample of novae which show such short variabilities during their super-soft phase.


title: A 5G-NR Satellite Extension for the QuaDRiGa Channel Model

abstract: Low Earth orbit (LEO) satellite networks will become an integral part of the global telecommunication infrastructure. Modeling the radio-links of these networks and their interaction with existing terrestrial systems is crucial for the design, planning and scaling of these networks. The 3rd generation partnership project (3GPP) addressed this by providing guideline for such a radio-channel model. However, the proposed model lacks a satellite orbit model and has some inconsistencies in the provided parameters. This is addressed in this paper. We provide a non-geostationary-satellite model that can be integrated into geometry-based stochastic channel models (GSCMs) such as QuaDRiGa. We then use this model to obtain the GSCM parameters from a simplified environment model and compare the results to the 3GPP parameter-set. This solves the inconsistencies, but our simplified approach does not consider many propagation effects. Future work must therefore rely on measurements or accurate Ray-tracing models to obtain the parameters.


title: Differentiable Weighted Finite-State Transducers

abstract: We introduce a framework for automatic differentiation with weighted finite-state transducers (WFSTs) allowing them to be used dynamically at training time. Through the separation of graphs from operations on graphs, this framework enables the exploration of new structured loss functions which in turn eases the encoding of prior knowledge into learning algorithms. We show how the framework can combine pruning and back-off in transition models with various sequence-level loss functions. We also show how to learn over the latent decomposition of phrases into word pieces. Finally, to demonstrate that WFSTs can be used in the interior of a deep neural network, we propose a convolutional WFST layer which maps lower-level representations to higher-level representations and can be used as a drop-in replacement for a traditional convolution. We validate these algorithms with experiments in handwriting recognition and speech recognition.


title: Multiobjectivization of Local Search: Single-Objective Optimization Benefits From Multi-Objective Gradient Descent

abstract: Multimodality is one of the biggest difficulties for optimization as local optima are often preventing algorithms from making progress. This does not only challenge local strategies that can get stuck. It also hinders meta-heuristics like evolutionary algorithms in convergence to the global optimum. In this paper we present a new concept of gradient descent, which is able to escape local traps. It relies on multiobjectivization of the original problem and applies the recently proposed and here slightly modified multi-objective local search mechanism MOGSA. We use a sophisticated visualization technique for multi-objective problems to prove the working principle of our idea. As such, this work highlights the transfer of new insights from the multi-objective to the single-objective domain and provides first visual evidence that multiobjectivization can link single-objective local optima in multimodal landscapes.


title: DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction Detection

abstract: Recent years, human-object interaction (HOI) detection has achieved impressive advances. However, conventional two-stage methods are usually slow in inference. On the other hand, existing one-stage methods mainly focus on the union regions of interactions, which introduce unnecessary visual information as disturbances to HOI detection. To tackle the problems above, we propose a novel one-stage HOI detection approach DIRV in this paper, based on a new concept called interaction region for the HOI problem. Unlike previous methods, our approach concentrates on the densely sampled interaction regions across different scales for each human-object pair, so as to capture the subtle visual features that is most essential to the interaction. Moreover, in order to compensate for the detection flaws of a single interaction region, we introduce a novel voting strategy that makes full use of those overlapped interaction regions in place of conventional Non-Maximal Suppression (NMS). Extensive experiments on two popular benchmarks: V-COCO and HICO-DET show that our approach outperforms existing state-of-the-arts by a large margin with the highest inference speed and lightest network architecture. We achieved 56.1 mAP on V-COCO without addtional input. Our code is publicly available at: https://github.com/MVIG-SJTU/DIRV


title: Morphomechanical model of the torsional c-looping in the embryonic heart

abstract: Before septation processes shape its four chambers, the embryonic heart is a straight tube that spontaneously bends and twists breaking the left-right symmetry. In particular, the heart tube is subjected to a cell remodelling inducing ventral bending and dextral torsion during the c-looping phase. In this work we propose a morphomechanical model for the torsion of the heart tube, that behaves as a nonlinear elastic body. We hypothesize that this spontaneous looping can be modeled as a mechanical instability due to accumulation of residual stresses induced by the geometrical frustration of tissue remodelling, which mimics the cellular rearrangement within the heart tube. Thus, we perform a linear stability analysis of the resulting nonlinear elastic boundary value problem to determine the onset of c-looping as a function of the aspect ratios of the tube and of the internal remodelling rate. We perform numerical simulations to study the fully nonlinear morphological transition, showing that the soft tube develops a realistic self-contacting looped shape in the physiological range of geometrical parameters.


title: DecAug: Augmenting HOI Detection via Decomposition

abstract: Human-object interaction (HOI) detection requires a large amount of annotated data. Current algorithms suffer from insufficient training samples and category imbalance within datasets. To increase data efficiency, in this paper, we propose an efficient and effective data augmentation method called DecAug for HOI detection. Based on our proposed object state similarity metric, object patterns across different HOIs are shared to augment local object appearance features without changing their state. Further, we shift spatial correlation between humans and objects to other feasible configurations with the aid of a pose-guided Gaussian Mixture Model while preserving their interactions. Experiments show that our method brings up to 3.3 mAP and 1.6 mAP improvements on V-COCO and HICODET dataset for two advanced models. Specifically, interactions with fewer samples enjoy more notable improvement. Our method can be easily integrated into various HOI detection models with negligible extra computational consumption. Our code will be made publicly available.


title: On $q$-series for principal characters of standard $A_2^{(2)}$-modules

abstract: We present sum-sides for principal characters of all standard (i.e., integrable and highest-weight) irreducible modules for the affine Lie algebra $A_2^{(2)}$. We use modifications of five known Bailey pairs; three of these are sufficient to obtain all the necessary principal characters. We then use the technique of Bailey lattice appropriately extended to include "out-of-bounds" values of one of the parameters, namely, $i$. We demonstrate how the sum-sides break into six families depending on the level of the modules modulo 6, confirming a conjecture of McLaughlin--Sills.


title: Generalized Self-Concordant Analysis of Frank-Wolfe algorithms

abstract: Projection-free optimization via different variants of the Frank-Wolfe (FW) method has become one of the cornerstones in large scale optimization for machine learning and computational statistics. Numerous applications within these fields involve the minimization of functions with self-concordance like properties. Such generalized self-concordant (GSC) functions do not necessarily feature a Lipschitz continuous gradient, nor are they strongly convex. Indeed, in a number of applications, e.g. inverse covariance estimation or distance-weighted discrimination problems in support vector machines, the loss is given by a GSC function having unbounded curvature, implying absence of theoretical guarantees for the existing FW methods. This paper closes this apparent gap in the literature by developing provably convergent FW algorithms with standard O(1/k) convergence rate guarantees. If the problem formulation allows the efficient construction of a local linear minimization oracle, we develop a FW method with linear convergence rate.


title: Tracking control for underactuated non-minimum phase multibody systems

abstract: We consider tracking control for multibody systems which are modelled using holonomic and nonholonomic constraints. Furthermore, the systems may be underactuated and contain kinematic loops and are thus described by a set of differential-algebraic equations that cannot be reformulated as ordinary differential equations in general. We propose a control strategy which combines a feedforward controller based on the servo-constraints approach with a feedback controller based on a recent funnel control design. As an important tool for both approaches we present a new procedure to derive the internal dynamics of a multibody system. Furthermore, we present a feasible set of coordinates for the internal dynamics avoiding the effort involved with the computation of the Byrnes-Isidori form. The control design is demonstrated by a simulation for a nonlinear non-minimum phase multi-input, multi-output robotic manipulator with kinematic loop.


title: Deep Convolutional Transform Learning -- Extended version

abstract: This work introduces a new unsupervised representation learning technique called Deep Convolutional Transform Learning (DCTL). By stacking convolutional transforms, our approach is able to learn a set of independent kernels at different layers. The features extracted in an unsupervised manner can then be used to perform machine learning tasks, such as classification and clustering. The learning technique relies on a well-sounded alternating proximal minimization scheme with established convergence guarantees. Our experimental results show that the proposed DCTL technique outperforms its shallow version CTL, on several benchmark datasets.


title: Multigraded minimal free resolutions of simplicial subclutters

abstract: This paper concerns the study of a class of clutters called simplicial subclutters. Given a clutter $\mathcal{C}$ and its simplicial subclutter $\mathcal{D}$, we compare some algebraic properties and invariants of the ideals $I, J$ associated to these two clutters, respectively. We give a formula for computing the (multi)graded Betti numbers of $J$ in terms of those of $I$ and some combinatorial data about $\mathcal{D}$. As a result, we see that if $\mathcal{C}$ admits a simplicial subclutter, then there exists a monomial $u \notin I$ such that the (multi)graded Betti numbers of $I+(u)$ can be computed through those of $I$. It is proved that the Betti sequence of any graded ideal with linear resolution is the Betti sequence of an ideal associated to a simplicial subclutter of the complete clutter. These ideals turn out to have linear quotients. However, they do not form all the equigenerated square-free monomial ideals with linear quotients. If $\mathcal{C}$ admits $\varnothing$ as a simplicial subclutter, then $I$ has linear resolution over all fields. Examples show that the converse is not true.


title: Scientific Objectivity and its Limits

abstract: Measurement outcomes provide data for a physical theory. Unless they are objective they support no objective scientific knowledge. So the outcome of a quantum measurement must be an objective physical fact. But recent arguments purport to show that if quantum theory is universally applicable then there is no such fact. This calls for a reappraisal of the notions of fact and objectivity. If quantum theory is universally applicable the facts about the physical world include a fact about each quantum measurement outcome. These physical facts lack an ideal kind of objectivity but their more modest objectivity is all that science needs.


title: POMDPs in Continuous Time and Discrete Spaces

abstract: Many processes, such as discrete event systems in engineering or population dynamics in biology, evolve in discrete space and continuous time. We consider the problem of optimal decision making in such discrete state and action space systems under partial observability. This places our work at the intersection of optimal filtering and optimal control. At the current state of research, a mathematical description for simultaneous decision making and filtering in continuous time with finite state and action spaces is still missing. In this paper, we give a mathematical description of a continuous-time partial observable Markov decision process (POMDP). By leveraging optimal filtering theory we derive a Hamilton-Jacobi-Bellman (HJB) type equation that characterizes the optimal solution. Using techniques from deep learning we approximately solve the resulting partial integro-differential equation. We present (i) an approach solving the decision problem offline by learning an approximation of the value function and (ii) an online algorithm which provides a solution in belief space using deep reinforcement learning. We show the applicability on a set of toy examples which pave the way for future methods providing solutions for high dimensional problems.


title: Search for phenomena beyond the Standard Model in events with large $b$-jet multiplicity using the ATLAS detector at the LHC

abstract: A search is presented for new phenomena in events characterised by high jet multiplicity, no leptons (electrons or muons), and four or more jets originating from the fragmentation of $b$-quarks ($b$-jets). The search uses 139 fb$^{-1}$ of $\sqrt{s}$ = 13 TeV proton-proton collision data collected by the ATLAS experiment at the Large Hadron Collider during Run 2. The dominant Standard Model background originates from multijet production and is estimated using a data-driven technique based on an extrapolation from events with low $b$-jet multiplicity to the high $b$-jet multiplicities used in the search. No significant excess over the Standard Model expectation is observed and 95% confidence-level limits that constrain simplified models of R-parity-violating supersymmetry are determined. The exclusion limits reach 950 GeV in top-squark mass in the models considered.


title: Spin-boson quantum phase transition in multilevel superconducting qubits

abstract: Superconducting circuits are currently developed as a versatile platform for the exploration of many-body physics, by building on non-linear elements that are often idealized as two-level qubits. A classic example is given by a charge qubit that is capacitively coupled to a transmission line, which leads to the celebrated spin-boson description of quantum dissipation. We show that the intrinsic multilevel structure of superconducting qubits drastically restricts the validity of the spin-boson paradigm due to phase localization, which spreads the wavefunction over many charge states. Numerical Renormalization Group simulations also show that the quantum critical point moves out of the physically accessible range in the multilevel regime. Imposing charge discreteness in a simple variational state accounts for these multilevel effects, that are relevant for a large class of devices.


title: Practical One-Shot Federated Learning for Cross-Silo Setting

abstract: Federated learning enables multiple parties to collaboratively learn a model without exchanging their data. While most existing federated learning algorithms need many rounds to converge, one-shot federated learning (i.e., federated learning with a single communication round) is a promising approach to make federated learning applicable in cross-silo setting in practice. However, existing one-shot algorithms only support specific models and do not provide any privacy guarantees, which significantly limit the applications in practice. In this paper, we propose a practical one-shot federated learning algorithm named FedKT. By utilizing the knowledge transfer technique, FedKT can be applied to any classification models and can flexibly achieve differential privacy guarantees. Our experiments on various tasks show that FedKT can significantly outperform the other state-of-the-art federated learning algorithms with a single communication round.


title: Debunking Rumors in Networks

abstract: We study the diffusion of a true and a false message (the rumor) in a social network. Upon hearing a message, individuals may believe it, disbelieve it, or debunk it through costly verification. Whenever the truth survives in steady state, so does the rumor. Communication intensity in itself is irrelevant for relative rumor prevalence, and the effect of homophily depends on the exact verification process and equilibrium verification rates. Our model highlights that successful policies in the fight against rumors increase individuals' incentives to verify.


title: Generalized Centrality Aggregation and Exclusive Centrality

abstract: There are several applications that benefit from a definition of centrality which is applicable to sets of vertices, rather than individual vertices. However, existing definitions might not be able to help us in answering several network analysis questions. In this paper, we study generalizing aggregation of centralities of individual vertices, to the centrality of the set consisting of these vertices. In particular, we propose exclusive betweenness centrality, defined as the number of shortest paths passing over exactly one of the vertices in the set, and discuss how this can be useful in determining the proper center of a network. We mathematically formulate the relationship between exclusive betweenness centrality and the existing notions of set centrality, and use this relation to present an exact algorithm for computing exclusive betweenness centrality. Since it is usually practically intractable to compute exact centrality scores for large real-world networks, we also present approximate algorithms for estimating exclusive betweenness centrality. In the end, we evaluate the empirical efficiency of exclusive betweenness centrality computation over several real-world networks. Moreover, we empirically study the correlations between exclusive betweenness centrality and the existing set centrality notions.


title: Singular magnetic anisotropy in the nematic phase of FeSe

abstract: FeSe is arguably the simplest, yet the most enigmatic, iron-based superconductor. Its nematic but non-magnetic ground state is unprecedented in this class of materials and stands out as a current puzzle. Here, our NMR measurements in the nematic state of mechanically detwinned FeSe reveal that both the Knight shift and the spin-lattice relaxation rate 1/T_1 possess an in-plane anisotropy opposite to that of the iron pnictides LaFeAsO and BaFe2As2. Using a microscopic electron model that includes spin-orbit coupling, our calculations show that an opposite quasiparticle weight ratio between the d_xz and d_yz orbitals leads to an opposite anisotropy of the orbital magnetic susceptibility, which explains our Knight shift results. We attribute this property to a different nature of nematic order in the two compounds, predominantly bond-type in FeSe and onsite ferro-orbital in pnictides. The T_1 anisotropy is found to be inconsistent with existing neutron scattering data in FeSe, showing that the spin fluctuation spectrum reveals surprises at low energy, possibly from fluctuations that do not break C_4 symmetry. Therefore, our results reveal that important information is hidden in these anisotropies and they place stringent constraints on the low-energy spin correlations as well as on the nature of nematicity in FeSe.


title: Real-Smooth Hypersurfaces in $\mathbb{C}^{N+1}$

abstract: It is constructed a formal normal form, using an iterative normalization procedure, for a large class of Real-Smooth Hypersurfaces in Complex Spaces.


title: Self-similar measures associated to a homogeneous system of three maps

abstract: We study the dimension of self-similar measures associated to a homogeneous iterated function system of three contracting similarities on $\bf R$ and other more general IFS's. We extend some of the theory recently developed for Bernoulli convolutions to this setting. In the setting of three maps a new phenomenon occurs, which has been highlighted by recent examples of Baker, and B\'ar\'any, K\"aenm\"aki. To overcome the difficulties stemming form these, we develop novel techniques, including an extension of Hochman's entropy increase method to a function field setup.


title: Real-time Collaboration Between Mixed Reality Users in Geo-referenced Virtual Environment

abstract: Collaboration using mixed reality technology is an active area of research, where significant research is done to virtually bridge physical distances. There exist a diverse set of platforms and devices that can be used for a mixed-reality collaboration, and is largely focused for indoor scenarios, where, a stable tracking can be assumed. We focus on supporting collaboration between VR and AR users, where AR user is mobile outdoors, and VR user is immersed in true-sized digital twin. This cross-platform solution requires new user experiences for interaction, accurate modelling of the real-world, and working with noisy outdoor tracking sensor such as GPS. In this paper, we present our results and observations of real-time collaboration between cross-platform users, in the context of a geo-referenced virtual environment. We propose a solution for using GPS measurement in VSLAM to localize the AR user in an outdoor environment. The client applications enable VR and AR user to collaborate across the heterogeneous platforms seamlessly. The user can place or load dynamic contents tagged to a geolocation and share their experience with remote users in real-time.


title: Memory Clustering using Persistent Homology for Multimodality- and Discontinuity-Sensitive Learning of Optimal Control Warm-starts

abstract: Shooting methods are an efficient approach to solving nonlinear optimal control problems. As they use local optimization, they exhibit favorable convergence when initialized with a good warm-start but may not converge at all if provided with a poor initial guess. Recent work has focused on providing an initial guess from a learned model trained on samples generated during an offline exploration of the problem space. However, in practice the solutions contain discontinuities introduced by system dynamics or the environment. Additionally, in many cases multiple equally suitable, i.e., multi-modal, solutions exist to solve a problem. Classic learning approaches smooth across the boundary of these discontinuities and thus generalize poorly. In this work, we apply tools from algebraic topology to extract information on the underlying structure of the solution space. In particular, we introduce a method based on persistent homology to automatically cluster the dataset of precomputed solutions to obtain different candidate initial guesses. We then train a Mixture-of-Experts within each cluster to predict state and control trajectories to warm-start the optimal control solver and provide a comparison with modality-agnostic learning. We demonstrate our method on a cart-pole toy problem and a quadrotor avoiding obstacles, and show that clustering samples based on inherent structure improves the warm-start quality.


title: Loss channels affecting lithium niobate phononic crystal resonators at cryogenic temperature

abstract: We investigate the performance of microwave-frequency phononic crystal resonators fabricated on thin-film lithium niobate for integration with superconducting quantum circuits. For different design geometries at millikelvin temperatures, we achieve mechanical internal quality factors $Q_i$ above $10^5 - 10^6$ at high microwave drive power, corresponding to $5\times10^6$ phonons inside the resonator. By sweeping the defect size of resonators with identical mirror cell designs, we are able to indirectly observe signatures of the complete phononic bandgap via the resonators' internal quality factors. Examination of quality factors' temperature dependence shows how superconducting and two-level system (TLS) loss channels impact device performance. Finally, we observe an anomalous low-temperature frequency shift consistent with resonant TLS decay and find that material choice can help to mitigate these losses.


title: Restriction of irreducible unitary representations of Spin(N,1) to parabolic subgroups

abstract: In this paper, we obtain explicit branching laws for all irreducible unitary representations of $\Spin(N,1)$ restricted to a parabolic subgroup $P$. The restriction turns out to be a finite direct sum of irreducible unitary representations of $P$. We also verify Duflo's conjecture for the branching law of tempered representations of $\Spin(N,1)$ with respect to a parabolic subgroup $P$. That is to show: in the framework of the orbit method, the branching law of a tempered representation is determined by the behavior of the moment map from the corresponding coadjoint orbit. A few key tools used in this work include: Fourier transform, Knapp-Stein intertwining operator, Casselman-Wallach globalization, Zuckerman translation principle, du Cloux's results for smooth representations of semi-algebraic groups.


title: Beyond Chemical 1D knowledge using Transformers

abstract: In the present paper we evaluated efficiency of the recent Transformer-CNN models to predict target properties based on the augmented stereochemical SMILES. We selected a well-known Cliff activity dataset as well as a Dipole moment dataset and compared the effect of three representations for R/S stereochemistry in SMILES. The considered representations were SMILES without stereochemistry (noChiSMI), classical relative stereochemistry encoding (RelChiSMI) and an alternative version with absolute stereochemistry encoding (AbsChiSMI). The inclusion of R/S in SMILES representation allowed simplify the assignment of the respective information based on SMILES representation, but did not always show advantages on regression or classification tasks. Interestingly, we did not see degradation of the performance of Transformer-CNN models when the stereochemical information was not present in SMILES. Moreover, these models showed higher or similar performance compared to descriptor-based models based on 3D structures. These observations are an important step in NLP modeling of 3D chemical tasks. An open challenge remains whether Transformer-CNN can efficiently embed 3D knowledge from SMILES input and whether a better representation could further increase the accuracy of this approach.


title: Hard Negative Mixing for Contrastive Learning

abstract: Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images apart, one can train highly transferable visual representations. As revealed by recent studies, heavy data augmentation and large sets of negatives are both crucial in learning such representations. At the same time, data mixing strategies either at the image or the feature level improve both supervised and semi-supervised learning by synthesizing novel examples, forcing networks to learn more robust features. In this paper, we argue that an important aspect of contrastive learning, i.e., the effect of hard negatives, has so far been neglected. To get more meaningful negative samples, current top contrastive self-supervised learning approaches either substantially increase the batch sizes, or keep very large memory banks; increasing the memory size, however, leads to diminishing returns in terms of performance. We therefore start by delving deeper into a top-performing framework and show evidence that harder negatives are needed to facilitate better and faster learning. Based on these observations, and motivated by the success of data mixing, we propose hard negative mixing strategies at the feature level, that can be computed on-the-fly with a minimal computational overhead. We exhaustively ablate our approach on linear classification, object detection and instance segmentation and show that employing our hard negative mixing procedure improves the quality of visual representations learned by a state-of-the-art self-supervised learning method.


title: TeRo: A Time-aware Knowledge Graph Embedding via Temporal Rotation

abstract: In the last few years, there has been a surge of interest in learning representations of entitiesand relations in knowledge graph (KG). However, the recent availability of temporal knowledgegraphs (TKGs) that contain time information for each fact created the need for reasoning overtime in such TKGs. In this regard, we present a new approach of TKG embedding, TeRo, which defines the temporal evolution of entity embedding as a rotation from the initial time to the currenttime in the complex vector space. Specially, for facts involving time intervals, each relation isrepresented as a pair of dual complex embeddings to handle the beginning and the end of therelation, respectively. We show our proposed model overcomes the limitations of the existing KG embedding models and TKG embedding models and has the ability of learning and inferringvarious relation patterns over time. Experimental results on four different TKGs show that TeRo significantly outperforms existing state-of-the-art models for link prediction. In addition, we analyze the effect of time granularity on link prediction over TKGs, which as far as we know hasnot been investigated in previous literature.


title: Machine-learning-enhanced time-of-flight mass spectrometry analysis

abstract: Mass spectrometry is a widespread approach to work out what are the constituents of a material. Atoms and molecules are removed from the material and collected, and subsequently, a critical step is to infer their correct identities based from patterns formed in their mass-to-charge ratios and relative isotopic abundances. However, this identification step still mainly relies on individual user's expertise, making its standardization challenging, and hindering efficient data processing. Here, we introduce an approach that leverages modern machine learning technique to identify peak patterns in time-of-flight mass spectra within microseconds, outperforming human users without loss of accuracy. Our approach is cross-validated on mass spectra generated from different time-of-flight mass spectrometry(ToF-MS) techniques, offering the ToF-MS community an open-source, intelligent mass spectra analysis.


title: Knowledge Discovery in Cryptocurrency Transactions: A Survey

abstract: Cryptocurrencies gain trust in users by publicly disclosing the full creation and transaction history. In return, the transaction history faithfully records the whole spectrum of cryptocurrency user behaviors. This article analyzes and summarizes the existing research on knowledge discovery in the cryptocurrency transactions using data mining techniques. Specifically, we classify the existing research into three aspects, i.e., transaction tracings and blockchain address linking, the analyses of collective user behaviors, and the study of individual user behaviors. For each aspect, we present the problems, summarize the methodologies, and discuss major findings in the literature. Furthermore, an enumeration of transaction data parsing and visualization tools and services is also provided. Finally, we outline several future directions in this research area, such as the current rapid development of Decentralized Finance (De-Fi) and digital fiat money.


title: How Far Are We From an Optimal, Adaptive DE?

abstract: We consider how an (almost) optimal parameter adaptation process for an adaptive DE might behave, and compare the behavior and performance of this approximately optimal process to that of existing, adaptive mechanisms for DE. An optimal parameter adaptation process is an useful notion for analyzing the parameter adaptation methods in adaptive DE as well as other adaptive evolutionary algorithms, but it cannot be known generally. Thus, we propose a Greedy Approximate Oracle method (GAO) which approximates an optimal parameter adaptation process. We compare the behavior of GAODE, a DE algorithm with GAO, to typical adaptive DEs on six benchmark functions and the BBOB benchmarks, and show that GAO can be used to (1) explore how much room for improvement there is in the performance of the adaptive DEs, and (2) obtain hints for developing future, effective parameter adaptation methods for adaptive DEs.


title: Numerical Methods to Compute the Coriolis Matrix and Christoffel Symbols for Rigid-Body Systems

abstract: This article presents methods to efficiently compute the Coriolis matrix and underlying Christoffel symbols (of the first kind) for tree-structure rigid-body systems. The algorithms can be executed purely numerically, without requiring partial derivatives as in unscalable symbolic techniques. The computations share a recursive structure in common with classical methods such as the Composite-Rigid-Body Algorithm and are of the lowest possible order: $O(Nd)$ for the Coriolis matrix and $O(Nd^2)$ for the Christoffel symbols, where $N$ is the number of bodies and $d$ is the depth of the kinematic tree. Implementation in C/C++ shows computation times on the order of 10-20 $\mu$s for the Coriolis matrix and 40-120 $\mu$s for the Christoffel symbols on systems with 20 degrees of freedom. The results demonstrate feasibility for the adoption of these algorithms within high-rate ($>$1kHz) loops for model-based control applications.


title: Understanding Realistic Attacks on Airborne Collision Avoidance Systems

abstract: Airborne collision avoidance systems provide an onboard safety net should normal air traffic control procedures fail to keep aircraft separated. These systems are widely deployed and have been constantly refined over the past three decades, usually in response to near misses or mid-air collisions. Recent years have seen security research increasingly focus on aviation, identifying that key wireless links---some of which are used in collision avoidance---are vulnerable to attack. In this paper, we go one step further to understand whether an attacker can remotely trigger false collision avoidance alarms. Primarily considering the next-generation Airborne Collision Avoidance System X (ACAS X), we adopt a modelling approach to extract attacker constraints from technical standards before simulating collision avoidance attacks against standardized ACAS X code. We find that in 44% of cases, an attacker can successfully trigger a collision avoidance alert which on average results in a 590 ft altitude deviation; when the aircraft is at lower altitudes, this success rate rises considerably to 79%. Furthermore, we show how our simulation approach can be used to help defend against attacks by identifying where attackers are most likely to be successful.


title: Reviewing and Benchmarking Parameter Control Methods in Differential Evolution

abstract: Many Differential Evolution (DE) algorithms with various parameter control methods (PCMs) have been proposed. However, previous studies usually considered PCMs to be an integral component of a complex DE algorithm. Thus the characteristics and performance of each method are poorly understood. We present an in-depth review of 24 PCMs for the scale factor and crossover rate in DE and a large scale benchmarking study. We carefully extract the 24 PCMs from their original, complex algorithms and describe them according to a systematic manner. Our review facilitates the understanding of similarities and differences between existing, representative PCMs. The performance of DEs with the 24 PCMs and 16 variation operators is investigated on 24 black-box benchmark functions. Our benchmarking results reveal which methods exhibit high performance when embedded in a standardized framework under 16 different conditions, independent from their original, complex algorithms. We also investigate how much room there is for further improvement of PCMs by comparing the 24 methods with an oracle-based model, which can be considered to be a conservative lower bound on the performance of an optimal method.


title: Powers Of Generators On Dirichlet Spaces And Applications To Harnack Principles

abstract: We provide a general framework for the realization of powers or functions of suitable operators on Dirichlet spaces. The first contribution is to unify the available results dealing with specific geometries; a second one is to provide new results on rather general metric measured spaces that were not considered before and fall naturally in the theory of Dirichlet spaces. The main tool is using the approach based on subordination and semi-groups by Stinga and Torrea. Assuming more on the Dirichlet space, we derive several applications to PDEs such as Harnack and Boundary Harnack principles.


title: Encoded Prior Sliced Wasserstein AutoEncoder for learning latent manifold representations

abstract: While variational autoencoders have been successful in several tasks, the use of conventional priors are limited in their ability to encode the underlying structure of input data. We introduce an Encoded Prior Sliced Wasserstein AutoEncoder wherein an additional prior-encoder network learns an embedding of the data manifold which preserves topological and geometric properties of the data, thus improving the structure of latent space. The autoencoder and prior-encoder networks are iteratively trained using the Sliced Wasserstein distance. The effectiveness of the learned manifold encoding is explored by traversing latent space through interpolations along geodesics which generate samples that lie on the data manifold and hence are more realistic compared to Euclidean interpolation. To this end, we introduce a graph-based algorithm for exploring the data manifold and interpolating along network-geodesics in latent space by maximizing the density of samples along the path while minimizing total energy. We use the 3D-spiral data to show that the prior encodes the geometry underlying the data unlike conventional autoencoders, and to demonstrate the exploration of the embedded data manifold through the network algorithm. We apply our framework to benchmarked image datasets to demonstrate the advantages of learning data representations in outlier generation, latent structure, and geodesic interpolation.


title: Estimating longterm power spectral densities in AGN from simulations

abstract: The power spectral density (PSD) represents a key property quantifying the stochastic or random noise type fluctuations in variable sources like Active Galactic Nuclei (AGN). In recent years, estimates of the PSD have been refined by improvements in both, the quality of observed lightcurves and modeling them with simulations. This has aided in quantifying the variability including evaluating the significance of quasi-periodic oscillations. A central assumption in making such estimates is that of weak non-stationarity. This is violated for sources with a power-law PSD index steeper than one as the integral power diverges. As a consequence, estimates of the flux probability density function (PDF) and PSD are interlinked. In general, for evaluating parameters of both properties from lightcurves, one cannot avoid a multi-dimensional, multi-parameter model which is complex and computationally expensive, as well as harder to constrain and interpret. However, if we only wish to compute the PSD index as is often the case, we can use a simpler model. We explore a bending power-law model instead of a simple power-law as input to time-series simulations to test the quality of reconstruction. Examining the longterm variability of the classical blazar Mrk 421, extending to multiple years as is typical of Fermi-LAT or Swift-BAT lightcurves, we find that a transition from pink (PSD index one) to white noise at a characteristic timescale, $t_b \sim 500-1000$ years, comparable to the viscous timescale at the disk truncation radius, seems to provide a good model for simulations. This is both a physically motivated as well as a computationally efficient model that can be used to compute the PSD index.


title: Query complexity of adversarial attacks

abstract: There are two main attack models considered in the adversarial robustness literature: black-box and white-box. We consider these threat models as two ends of a fine-grained spectrum, indexed by the number of queries the adversary can ask. Using this point of view we investigate how many queries the adversary needs to make to design an attack that is comparable to the best possible attack in the white-box model. We give a lower bound on that number of queries in terms of entropy of decision boundaries of the classifier. Using this result we analyze two classical learning algorithms on two synthetic tasks for which we prove meaningful security guarantees. The obtained bounds suggest that some learning algorithms are inherently more robust against query-bounded adversaries than others.


title: Attention-Based Clustering: Learning a Kernel from Context

abstract: In machine learning, no data point stands alone. We believe that context is an underappreciated concept in many machine learning methods. We propose Attention-Based Clustering (ABC), a neural architecture based on the attention mechanism, which is designed to learn latent representations that adapt to context within an input set, and which is inherently agnostic to input sizes and number of clusters. By learning a similarity kernel, our method directly combines with any out-of-the-box kernel-based clustering approach. We present competitive results for clustering Omniglot characters and include analytical evidence of the effectiveness of an attention-based approach for clustering.


title: Homography Estimation with Convolutional Neural Networks Under Conditions of Variance

abstract: Planar homography estimation is foundational to many computer vision problems, such as Simultaneous Localization and Mapping (SLAM) and Augmented Reality (AR). However, conditions of high variance confound even the state-of-the-art algorithms. In this report, we analyze the performance of two recently published methods using Convolutional Neural Networks (CNNs) that are meant to replace the more traditional feature-matching based approaches to the estimation of homography. Our evaluation of the CNN based methods focuses particularly on measuring the performance under conditions of significant noise, illumination shift, and occlusion. We also measure the benefits of training CNNs to varying degrees of noise. Additionally, we compare the effect of using color images instead of grayscale images for inputs to CNNs. Finally, we compare the results against baseline feature-matching based homography estimation methods using SIFT, SURF, and ORB. We find that CNNs can be trained to be more robust against noise, but at a small cost to accuracy in the noiseless case. Additionally, CNNs perform significantly better in conditions of extreme variance than their feature-matching based counterparts. With regard to color inputs, we conclude that with no change in the CNN architecture to take advantage of the additional information in the color planes, the difference in performance using color inputs or grayscale inputs is negligible. About the CNNs trained with noise-corrupted inputs, we show that training a CNN to a specific magnitude of noise leads to a "Goldilocks Zone" with regard to the noise levels where that CNN performs best.


title: Self-generated ultraviolet radiation in molecular shock waves I. Effects of Lyman $\alpha$, Lyman $\beta$, and two-photon continuum

abstract: Shocks are ubiquitous in the interstellar and intergalactic media, where their chemical and radiative signatures reveal the physical conditions in which they arise. Detailed astrochemical models of shocks at all velocities are necessary to understand the physics of many environments including protostellar outflows, supernova remnants, and galactic outflows. We present an accurate treatment of the self-generated UV radiation in intermediate velocity, stationary, weakly magnetised, J-type, molecular shocks. Shock solutions computed with the Paris-Durham shock code are post-processed using a multi-level accelerated $\Lambda$-iteration radiative transfer algorithm to compute Ly$\alpha$, Ly$\beta$, and 2-photon continuum emission. The subsequent impacts on the ionisation and dissociation of key atomic and molecular species as well as on the heating by the photoelectric effect take the wavelength dependent cross-sections and the fluid velocity profile into account. We analyse shock models with velocities $V=25-60$ km/s, propagating in dense ($n \geq 10^4$ ${\rm cm}^{-3}$), shielded gas. Self-absorption traps Ly$\alpha$ photons in a small region in the shock, though a large fraction escapes into the line wings. We find a critical velocity $V\sim 30$ km/s above which shocks produce a Ly$\alpha$ photon flux exceeding that of the standard ISRF. The escaping photons generate a warm slab (T~100 K) ahead of the shock as well as pre-ionise C and S. These shocks are traced by bright atomic fine structure (e.g. O and S) and metastable (e.g. O and C) lines, substantive molecular emission (e.g. H2, OH, and CO), enhanced column densities of several species (e.g. CH+ and HCO+), as well as a severe destruction of H2O. As much as 13-21% of the initial kinetic energy of the shock escapes in Ly$\alpha$ and Ly$\beta$ photons if the dust opacity in the radiative precursor allows it.


title: Preventing crash in stock market: The role of economic policy uncertainty during COVID-19

abstract: This paper investigates the impact of economic policy uncertainty (EPU) on the crash risk of US stock market during the COVID-19 pandemic. To this end, we use the GARCH-S (GARCH with skewness) model to estimate daily skewness as a proxy for the stock market crash risk. The empirical results show the significantly negative correlation between EPU and stock market crash risk, indicating the aggravation of EPU increase the crash risk. Moreover, the negative correlation gets stronger after the global COVID-19 outbreak, which shows the crash risk of the US stock market will be more affected by EPU during the pandemic.


title: Multilevel quasi-Monte Carlo for random elliptic eigenvalue problems I: Regularity and error analysis

abstract: Stochastic PDE eigenvalue problems are useful models for quantifying the uncertainty in several applications from the physical sciences and engineering, e.g., structural vibration analysis, the criticality of a nuclear reactor or photonic crystal structures. In this paper we present a multilevel quasi-Monte Carlo (MLQMC) method for approximating the expectation of the minimal eigenvalue of an elliptic eigenvalue problem with coefficients that are given as a series expansion of countably-many stochastic parameters. The MLQMC algorithm is based on a hierarchy of discretisations of the spatial domain and truncations of the dimension of the stochastic parameter domain. To approximate the expectations, randomly shifted lattice rules are employed. This paper is primarily dedicated to giving a rigorous analysis of the error of this algorithm. A key step in the error analysis requires bounds on the mixed derivatives of the eigenfunction with respect to both the stochastic and spatial variables simultaneously. Under stronger smoothness assumptions on the parametric dependence, our analysis also extends to multilevel higher-order quasi-Monte Carlo rules. An accompanying paper [Gilbert and Scheichl, 2022], focusses on practical extensions of the MLQMC algorithm to improve efficiency, and presents numerical results.


title: Open Set Domain Adaptation using Optimal Transport

abstract: We present a 2-step optimal transport approach that performs a mapping from a source distribution to a target distribution. Here, the target has the particularity to present new classes not present in the source domain. The first step of the approach aims at rejecting the samples issued from these new classes using an optimal transport plan. The second step solves the target (class ratio) shift still as an optimal transport problem. We develop a dual approach to solve the optimization problem involved at each step and we prove that our results outperform recent state-of-the-art performances. We further apply the approach to the setting where the source and target distributions present both a label-shift and an increasing covariate (features) shift to show its robustness.


title: On "Efficiency versus Instability in plasma accelerators"

abstract: Recently in a paper by Lebedev et al it was demonstrated that the efficiency of the energy transfer from the drive bunch to the witness bunch in the plasma wakefield accelerator has a limit due to the BBU instability of the witness bunch. It was stated that the efficiency-instability relation is universal and thus should be considered as a fundamental limit. In this note, we show that recent results on the short-range wakefields indicate that this relation should be modified and conclusions of the paper by Lebedev et al should be reconsidered. In particular, we argue that the efficiency-instability relation produces only the lower bound for efficiency and thus does not produce a fundamental limit.


title: Relaxing the Constraints on Predictive Coding Models

abstract: Predictive coding is an influential theory of cortical function which posits that the principal computation the brain performs, which underlies both perception and learning, is the minimization of prediction errors. While motivated by high-level notions of variational inference, detailed neurophysiological models of cortical microcircuits which can implements its computations have been developed. Moreover, under certain conditions, predictive coding has been shown to approximate the backpropagation of error algorithm, and thus provides a relatively biologically plausible credit-assignment mechanism for training deep networks. However, standard implementations of the algorithm still involve potentially neurally implausible features such as identical forward and backward weights, backward nonlinear derivatives, and 1-1 error unit connectivity. In this paper, we show that these features are not integral to the algorithm and can be removed either directly or through learning additional sets of parameters with Hebbian update rules without noticeable harm to learning performance. Our work thus relaxes current constraints on potential microcircuit designs and hopefully opens up new regions of the design-space for neuromorphic implementations of predictive coding.


title: The Efficacy of $L_1$ Regularization in Two-Layer Neural Networks

abstract: A crucial problem in neural networks is to select the most appropriate number of hidden neurons and obtain tight statistical risk bounds. In this work, we present a new perspective towards the bias-variance tradeoff in neural networks. As an alternative to selecting the number of neurons, we theoretically show that $L_1$ regularization can control the generalization error and sparsify the input dimension. In particular, with an appropriate $L_1$ regularization on the output layer, the network can produce a statistical risk that is near minimax optimal. Moreover, an appropriate $L_1$ regularization on the input layer leads to a risk bound that does not involve the input data dimension. Our analysis is based on a new amalgamation of dimension-based and norm-based complexity analysis to bound the generalization error. A consequent observation from our results is that an excessively large number of neurons do not necessarily inflate generalization errors under a suitable regularization.


title: Geometry and symmetry in biochemical reaction systems

abstract: Complex systems of intracellular biochemical reactions have a central role in regulating cell identities and functions. Biochemical reaction systems are typically studied using the language and tools of graph theory. However, graph representations only describe pairwise interactions between molecular species, and so are not well suited to modelling complex sets of reactions that may involve numerous reactants and/or products. Here we make use of a recently-developed hypergraph theory of chemical reactions that naturally allows for higher-order interactions to explore the geometry and quantify functional redundancy in biochemical reactions systems. Our results constitute a general theory of automorphisms for oriented hypergraphs and describe the effect of automorphism group structure on hypergraph Laplacian spectra.


title: Model-Free Reinforcement Learning for Stochastic Games with Linear Temporal Logic Objectives

abstract: We study the problem of synthesizing control strategies for Linear Temporal Logic (LTL) objectives in unknown environments. We model this problem as a turn-based zero-sum stochastic game between the controller and the environment, where the transition probabilities and the model topology are fully unknown. The winning condition for the controller in this game is the satisfaction of the given LTL specification, which can be captured by the acceptance condition of a deterministic Rabin automaton (DRA) directly derived from the LTL specification. We introduce a model-free reinforcement learning (RL) methodology to find a strategy that maximizes the probability of satisfying a given LTL specification when the Rabin condition of the derived DRA has a single accepting pair. We then generalize this approach to LTL formulas for which the Rabin condition has a larger number of accepting pairs, providing a lower bound on the satisfaction probability. Finally, we illustrate applicability of our RL method on two motion planning case studies.


title: Neural Bootstrapper

abstract: Bootstrapping has been a primary tool for ensemble and uncertainty quantification in machine learning and statistics. However, due to its nature of multiple training and resampling, bootstrapping deep neural networks is computationally burdensome; hence it has difficulties in practical application to the uncertainty estimation and related tasks. To overcome this computational bottleneck, we propose a novel approach called \emph{Neural Bootstrapper} (NeuBoots), which learns to generate bootstrapped neural networks through single model training. NeuBoots injects the bootstrap weights into the high-level feature layers of the backbone network and outputs the bootstrapped predictions of the target, without additional parameters and the repetitive computations from scratch. We apply NeuBoots to various machine learning tasks related to uncertainty quantification, including prediction calibrations in image classification and semantic segmentation, active learning, and detection of out-of-distribution samples. Our empirical results show that NeuBoots outperforms other bagging based methods under a much lower computational cost without losing the validity of bootstrapping.


title: Joint data imputation and mechanistic modelling for simulating heart-brain interactions in incomplete datasets

abstract: The use of mechanistic models in clinical studies is limited by the lack of multi-modal patients data representing different anatomical and physiological processes. For example, neuroimaging datasets do not provide a sufficient representation of heart features for the modeling of cardiovascular factors in brain disorders. To tackle this problem we introduce a probabilistic framework for joint cardiac data imputation and personalisation of cardiovascular mechanistic models, with application to brain studies with incomplete heart data. Our approach is based on a variational framework for the joint inference of an imputation model of cardiac information from the available features, along with a Gaussian Process emulator that can faithfully reproduce personalised cardiovascular dynamics. Experimental results on UK Biobank show that our model allows accurate imputation of missing cardiac features in datasets containing minimal heart information, e.g. systolic and diastolic blood pressures only, while jointly estimating the emulated parameters of the lumped model. This allows a novel exploration of the heart-brain joint relationship through simulation of realistic cardiac dynamics corresponding to different conditions of brain anatomy.