title: Learning for Detecting Norm Violation in Online Communities

abstract: In this paper, we focus on normative systems for online communities. The paper addresses the issue that arises when different community members interpret these norms in different ways, possibly leading to unexpected behavior in interactions, usually with norm violations that affect the individual and community experiences. To address this issue, we propose a framework capable of detecting norm violations and providing the violator with information about the features of their action that makes this action violate a norm. We build our framework using Machine Learning, with Logistic Model Trees as the classification algorithm. Since norm violations can be highly contextual, we train our model using data from the Wikipedia online community, namely data on Wikipedia edits. Our work is then evaluated with the Wikipedia use case where we focus on the norm that prohibits vandalism in Wikipedia edits.


title: Nearest-Neighbor-based Collision Avoidance for Quadrotors via Reinforcement Learning

abstract: Collision avoidance algorithms are of central interest to many drone applications. In particular, decentralized approaches may be the key to enabling robust drone swarm solutions in cases where centralized communication becomes computationally prohibitive. In this work, we draw biological inspiration from flocks of starlings (Sturnus vulgaris) and apply the insight to end-to-end learned decentralized collision avoidance. More specifically, we propose a new, scalable observation model following a biomimetic nearest-neighbor information constraint that leads to fast learning and good collision avoidance behavior. By proposing a general reinforcement learning approach, we obtain an end-to-end learning-based approach to integrating collision avoidance with arbitrary tasks such as package collection and formation change. To validate the generality of this approach, we successfully apply our methodology through motion models of medium complexity, modeling momentum and nonetheless allowing direct application to real world quadrotors in conjunction with a standard PID controller. In contrast to prior works, we find that in our sufficiently rich motion model, nearest-neighbor information is indeed enough to learn effective collision avoidance behavior. Our learned policies are tested in simulation and subsequently transferred to real-world drones to validate their real-world applicability.


title: Learning Multi-Granular Hypergraphs for Video-Based Person Re-Identification

abstract: Video-based person re-identification (re-ID) is an important research topic in computer vision. The key to tackling the challenging task is to exploit both spatial and temporal clues in video sequences. In this work, we propose a novel graph-based framework, namely Multi-Granular Hypergraph (MGH), to pursue better representational capabilities by modeling spatiotemporal dependencies in terms of multiple granularities. Specifically, hypergraphs with different spatial granularities are constructed using various levels of part-based features across the video sequence. In each hypergraph, different temporal granularities are captured by hyperedges that connect a set of graph nodes (i.e., part-based features) across different temporal ranges. Two critical issues (misalignment and occlusion) are explicitly addressed by the proposed hypergraph propagation and feature aggregation schemes. Finally, we further enhance the overall video representation by learning more diversified graph-level representations of multiple granularities based on mutual information minimization. Extensive experiments on three widely adopted benchmarks clearly demonstrate the effectiveness of the proposed framework. Notably, 90.0% top-1 accuracy on MARS is achieved using MGH, outperforming the state-of-the-arts. Code is available at https://github.com/daodaofr/hypergraph_reid.


title: BERT Meets Relational DB: Contextual Representations of Relational Databases

abstract: In this paper, we address the problem of learning low dimension representation of entities on relational databases consisting of multiple tables. Embeddings help to capture semantics encoded in the database and can be used in a variety of settings like auto-completion of tables, fully-neural query processing of relational joins queries, seamlessly handling missing values, and more. Current work is restricted to working with just single table, or using pretrained embeddings over an external corpus making them unsuitable for use in real-world databases. In this work, we look into ways of using these attention-based model to learn embeddings for entities in the relational database. We are inspired by BERT style pretraining methods and are interested in observing how they can be extended for representation learning on structured databases. We evaluate our approach of the autocompletion of relational databases and achieve improvement over standard baselines.


title: A numerical exploration of signal detector arrangement in a spin-wave reservoir computing device

abstract: This paper studies numerically how the signal detector arrangement influences the performance of reservoir computing using spin waves excited in a ferrimagnetic garnet film. This investigation is essentially important since the input information is not only conveyed but also transformed by the spin waves into high-dimensional information space when the waves propagate in the film in a spatially distributed manner. This spatiotemporal dynamics realizes a rich reservoir-computational functionality. First, we simulate spin waves in a rectangular garnet film with two input electrodes to obtain spatial distributions of the reservoir states in response to input signals, which are represented as spin vectors and used for a machine-learning waveform classification task. The detected reservoir states are combined through readout connection weights to generate a final output. We visualize the spatial distribution of the weights after training to discuss the number and positions of the output electrodes by arranging them at grid points, equiangularly circular points or at random. We evaluate the classification accuracy by changing the number of the output electrodes, and find that a high accuracy ($>$ 90\%) is achieved with only several tens of output electrodes regardless of grid, circular or random arrangement. These results suggest that the spin waves possess sufficiently complex and rich dynamics for this type of tasks. Then we investigate in which area useful information is distributed more by arranging the electrodes locally on the chip. Finally, we show that this device has generalization ability for input wave-signal frequency in a certain frequency range. These results will lead to practical design of spin-wave reservoir devices for low-power intelligent computing in the near future.


title: Solutions to a cubic Schr\"odinger system with mixed attractive and repulsive forces in a critical regime

abstract: We study the existence of solutions to the cubic Schr\"odinger system $$ -\Delta u_i = \sum_{j =1}^m \beta_{ij} u_j^2u_i + \lambda_i u_i\ \hbox{in}\ \Omega,\ u_i=0\ \hbox{on}\ \partial\Omega,\ i =1,\dots,m, $$ when $\Omega$ is a bounded domain in $\mathbb R^4, $ $\lambda_i$ are positive small numbers, $\beta_{ij}$ are real numbers so that $\beta_{ii}>0$ and $\beta_{ij}=\beta_{ji}$, $i\neq j$. We assemble the components $u_i$ in groups so that all the interaction forces $\beta_{ij}$ among components of the same group are attractive, i.e. $\beta_{ij}>0$, while forces among components of different groups are repulsive or weakly attractive, i.e. $\beta_{ij}<\overline\beta$ for some $\overline\beta$ small. We find solutions such that each component within a given group blows-up around the same point and the different groups blow-up around different points, as all the parameters $\lambda_i$'s approach zero.


title: Dynamic Graph Convolutional Recurrent Network for Traffic Prediction: Benchmark and Solution

abstract: Traffic prediction is the cornerstone of an intelligent transportation system. Accurate traffic forecasting is essential for the applications of smart cities, i.e., intelligent traffic management and urban planning. Although various methods are proposed for spatio-temporal modeling, they ignore the dynamic characteristics of correlations among locations on road networks. Meanwhile, most Recurrent Neural Network (RNN) based works are not efficient enough due to their recurrent operations. Additionally, there is a severe lack of fair comparison among different methods on the same datasets. To address the above challenges, in this paper, we propose a novel traffic prediction framework, named Dynamic Graph Convolutional Recurrent Network (DGCRN). In DGCRN, hyper-networks are designed to leverage and extract dynamic characteristics from node attributes, while the parameters of dynamic filters are generated at each time step. We filter the node embeddings and then use them to generate a dynamic graph, which is integrated with a pre-defined static graph. As far as we know, we are the first to employ a generation method to model fine topology of dynamic graph at each time step. Further, to enhance efficiency and performance, we employ a training strategy for DGCRN by restricting the iteration number of decoder during forward and backward propagation. Finally, a reproducible standardized benchmark and a brand new representative traffic dataset are opened for fair comparison and further research. Extensive experiments on three datasets demonstrate that our model outperforms 15 baselines consistently.


title: Subdiffusion equation with Caputo fractional derivative with respect to another function

abstract: We show an application of a subdiffusion equation with Caputo fractional time derivative with respect to another function $g$ to describe subdiffusion in a medium having a structure evolving over time. In this case a continuous transition from subdiffusion to other type of diffusion may occur. The process can be interpreted as "ordinary" subdiffusion with fixed subdiffusion parameter (subdiffusion exponent) $\alpha$ in which time scale is changed by the function $g$. As example, we consider the transition from "ordinary" subdiffusion to ultraslow diffusion. The function $g$ generates the additional aging process superimposed on the "standard" aging generated by "ordinary" subdiffusion. The aging process is analyzed using coefficient of relative aging of $g$--subdiffusion with respect to "ordinary" subdiffusion. The method of solving the $g$-subdiffusion equation is also presented.


title: Privacy-Preserving Co-synthesis Against Sensor-Actuator Eavesdropping Intruder

abstract: In this work, we investigate the problem of privacy-preserving supervisory control against an external passive intruder via co-synthesis of dynamic mask, edit function, and supervisor for opacity enforcement and requirement satisfaction. We attempt to achieve the following goals: 1) the system secret cannot be inferred by the intruder, i.e., opacity of secrets against the intruder, and the existence of the dynamic mask and the edit function should not be discovered by the intruder, i.e., covertness of dynamic mask and edit function against the intruder; 2) the closed-loop system behaviors should satisfy some safety and nonblockingness requirement. We assume the intruder can eavesdrop both the sensing information generated by the sensors and the control commands issued to the actuators, and we refer to such an intruder as a sensor-actuator eavesdropping intruder. Our approach is to model the co-synthesis problem as a distributed supervisor synthesis problem in the Ramadge-Wonham supervisory control framework, and we propose an incremental synthesis heuristic to incrementally synthesize a dynamic mask, an edit function, and a supervisor, which consists of three steps: 1) we first synthesize an ensemble ME of dynamic mask and edit function to ensure the opacity and the covertness against a sensor eavesdropping but command non-eavesdropping intruder, and marker-reachability; 2) we then decompose ME into a dynamic mask and an edit function by using a constraint-based approach, with the help of a Boolean satisfiability (SAT) solver; 3) finally, we synthesize a supervisor such that opacity and covertness can be ensured against the sensor-actuator eavesdropping intruder, and at the same time safety and nonblockingness requirement can be ensured. The effectiveness of our approach is illustrated on an example about the enforcement of location privacy for an autonomous vehicle.


title: Transient effects in double quantum dot sandwiched laterally between superconducting and metallic leads

abstract: We study the transient phenomena appearing in a subgap region of the double quantum dot coupled in series between the superconducting and normal metallic leads, focusing on the development of the superconducting proximity effect. For the uncorrelated nanostructure we derive explicit expressions of the time-dependent occupancies in both quantum dots, charge currents, and electron pairing induced on individual dots and between them. We show that the initial configurations substantially affect the dynamical processes, in which the in-gap bound states emerge upon coupling the double quantum dot to superconducting reservoir. In particular, the superconducting proximity effect would be temporarily blocked whenever the quantum dots are initially singly occupied. Such {\it triplet}/{\it Andreev blockade} has been recently reported experimentally for double quantum dots embedded in the Josephson [D. Bouman et al., Phys. Rev. B 102, 220505 (2020)] and Andreev [P. Zhang et al., arXiv:2102.03283 (2021)] junctions. We also address the role of correlation effects within the lowest-order decoupling scheme and by the time-dependent numerical renormalization group calculations. Competition of the repulsive Coulomb interactions with the superconducting proximity effect leads to renormalization of the in-gap quasiparticles, speeding up the quantum oscillations and narrowing a region of transient phenomena, whereas the dynamical Andreev blockade is well pronounced in the weak inter-dot coupling limit. We propose feasible methods for detecting the characteristic time-scales that could be observable by the Andreev spectroscopy.


title: Crackle Detection In Lung Sounds Using Transfer Learning And Multi-Input Convolitional Neural Networks

abstract: Large annotated lung sound databases are publicly available and might be used to train algorithms for diagnosis systems. However, it might be a challenge to develop a well-performing algorithm for small non-public data, which have only a few subjects and show differences in recording devices and setup. In this paper, we use transfer learning to tackle the mismatch of the recording setup. This allows us to transfer knowledge from one dataset to another dataset for crackle detection in lung sounds. In particular, a single input convolutional neural network (CNN) model is pre-trained on a source domain using ICBHI 2017, the largest publicly available database of lung sounds. We use log-mel spectrogram features of respiratory cycles of lung sounds. The pre-trained network is used to build a multi-input CNN model, which shares the same network architecture for respiratory cycles and their corresponding respiratory phases. The multi-input model is then fine-tuned on the target domain of our self-collected lung sound database for classifying crackles and normal lung sounds. Our experimental results show significant performance improvements of 9.84% (absolute) in F-score on the target domain using the multi-input CNN model based on transfer learning for crackle detection in adventitious lung sound classification task.


title: Design and experimental investigation of a planar metamaterial Silicon based lenslet

abstract: The next generations of ground-based cosmic microwave background experiments will require polarisation sensitive, multichroic pixels of large focal planes comprising several thousand detectors operating at the photon noise limit. One approach to achieve this goal is to couple light from the telescope to a polarisation sensitive antenna structure connected to a superconducting diplexer network where the desired frequency bands are filtered before being fed to individual ultra-sensitive detectors such as Transition Edge Sensors. Traditionally, arrays constituted of horn antennas, planar phased antennas or anti-reflection coated micro-lenses have been placed in front of planar antenna structures to achieve the gain required to couple efficiently to the telescope optics. In this paper are presented the design concept and a preliminary analysis of the measured performances of a phase-engineered metamaterial flat-lenslet. The flat lens design is inherently matched to free space, avoiding the necessity of an anti-reflection coating layer. It can be fabricated lithographically, making scaling to large format arrays relatively simple. Furthermore, this technology is compatible with the fabrication process required for the production of large-format lumped element kinetic inductance detector arrays which have already demonstrated the required sensitivity along with multiplexing ratios of order 1000 detectors/channel.


title: A Comparison of Model-Free Phase I Dose Escalation Designs for Dual-Agent Combination Therapies

abstract: It is increasingly common for therapies in oncology to be given in combination. In some cases, patients can benefit from the interaction between two drugs, although often at the risk of higher toxicity. A large number of designs to conduct phase I trials in this setting are available, where the objective is to select the maximum tolerated dose combination (MTC). Recently, a number of model-free (also called model-assisted) designs have provoked interest, providing several practical advantages over the more conventional approaches of rule-based or model-based designs. In this paper, we demonstrate a novel calibration procedure for model-free designs to determine their most desirable parameters. Under the calibration procedure, we compare the behaviour of model-free designs to a model-based approach in a comprehensive simulation study, covering a number of clinically plausible scenarios. It is found that model-free designs are competitive with the model-based design in terms of the proportion of correct selections of the MTC. However, there are a number of scenarios in which model-free designs offer a safer alternative. This is also illustrated in the application of the designs to a case study using data from a phase I oncology trial.


title: Entanglement in the Quantum Game of Life

abstract: We investigate the quantum dynamics of a spin chain that implements a quantum analog of Conway's game of life. We solve the time-dependent Schr\"odinger equation starting with initial separable states and analyse the evolution of quantum correlations across the lattice. We report examples of evolutions leading to all-entangled chains and/or to time oscillating entangling structures and characterize them by means of entanglement and network measures. The quantum patterns result to be quite different from the classical ones, even in the dynamics of local observables. A peculiar instance is a structure behaving as the quantum analog of a blinker, but that has no classical counterpart.


title: Word-Level Alignment of Paper Documents with their Electronic Full-Text Counterparts

abstract: We describe a simple procedure for the automatic creation of word-level alignments between printed documents and their respective full-text versions. The procedure is unsupervised, uses standard, off-the-shelf components only, and reaches an F-score of 85.01 in the basic setup and up to 86.63 when using pre- and post-processing. Potential areas of application are manual database curation (incl. document triage) and biomedical expression OCR.


title: Slepton and Electroweakino pair production with aNNLO+NNLL precision

abstract: The level of experimental precision that will be achieved with LHC Run-III data and in the forthcoming High Luminosity stage calls for equally accurate theoretical predictions to compare with. Here we present updated cross section calculations for the electroweak production of SUSY particles at the LHC with aNNLO+NNLL (approximate next-to-next-to-leading-order plus next-to-next-to-leading-logarithmic) accuracy. Results are shown for slepton pair production and for electroweakinos pair production in their mostly higgsino or gaugino configuration, finding a further significant reduction of the factorisation and renormalisation scale dependence that stabilises the predictions to the permil level.


title: Equivariant bundles and absorption

abstract: For a locally compact group $G$ and a strongly self-absorbing $G$-algebra $(\mathcal{D},\delta)$, we obtain a new characterization of absorption of a strongly self-absorbing action using almost equivariant completely positive maps into the underlying algebra. The main technical tool to obtain this characterization is the existence of almost equivariant lifts for equivariant completely positive maps, proved in recent work of the authors. This characterization is then used to show that an equivariant $C_0(X)$-algebra with $\mathrm{dim}_{\mathrm{cov}}(X)<\infty$ is $(\mathcal{D},\delta)$-stable if and only if all of its fibers are, extending a result of Hirshberg, R{\o}rdam and Winter to the equivariant setting. The condition on the dimension of $X$ is known to be necessary, and we show that it can be removed if, for example, the bundle is locally trivial.


title: Certifying Emergency Landing for Safe Urban UAV

abstract: Unmanned Aerial Vehicles (UAVs) have the potential to be used for many applications in urban environments. However, allowing UAVs to fly above densely populated areas raises concerns regarding safety. One of the main safety issues is the possibility for a failure to cause the loss of navigation capabilities, which can result in the UAV falling/landing in hazardous areas such as busy roads, where it can cause fatal accidents. Current standards, such as the SORA published in 2019, do not consider applicable mitigation techniques to handle this kind of hazardous situations. Consequently, certifying UAV urban operations implies to demonstrate very high levels of integrity, which results in prohibitive development costs. To address this issue, this paper explores the concept of Emergency Landing (EL). A safety analysis is conducted on an urban UAV case study, and requirements are proposed to enable the integration of EL as an acceptable mitigation mean in the SORA. Based on these requirements, an EL implementation was developed, together with a runtime monitoring architecture to enhance confidence in the system. Preliminary qualitative results are presented and the monitor seem to be able to detect errors of the EL system effectively.


title: On In-network learning. A Comparative Study with Federated and Split Learning

abstract: In this paper, we consider a problem in which distributively extracted features are used for performing inference in wireless networks. We elaborate on our proposed architecture, which we herein refer to as "in-network learning", provide a suitable loss function and discuss its optimization using neural networks. We compare its performance with both Federated- and Split learning; and show that this architecture offers both better accuracy and bandwidth savings.


title: Infinite families of non-left-orderable L-spaces

abstract: For each connected alternating tangle, we provide an infinite family of non-left-orderable L-spaces. This gives further support for Conjecture [3] of Boyer, Gordon, and Watson that is a rational homology 3-sphere is an L-space if and only if it is non-left-orderable. These 3-manifolds are obtained as Dehn fillings of the double branched covering of any alternating encircled tangle. We give a presentation of these non-left-orderable L-spaces as double branched coverings of S^3, branched over some specified links that turn out to be hyperbolic. We show that the obtained families include many non-Seifert fibered spaces. We also show that these families include many Seifert fibered spaces and give a surgery description for some of them. In the process we give another way to prove that the torus knots T(2, 2m+1) are L-space-knots as has already been shown by Ozsv\'ath and Szab\'o in [24].


title: Hyperbolic plasmon modes in tilted Dirac cone phases of borophene

abstract: Hyperbolic materials are receiving significant attention due to their ability to support electromagnetic fields with arbitrarily high momenta and, hence, to achieve very strong light confinement. Here, based on first-principles calculations and many-body perturbation theory, we explore the characteristic of two-dimensional plasmon modes and its hyperbolic properties for two phases of single layer boron hosting tilted Dirac cone, namely, the $hr$-$sB$ and $8Pmmn$ borophene. In-plane anisotropy in borophene is manifested in the structural, electronic, vibrational and optical properties. We find two hyperbolic regimes for both phases of borophene, where the high-energy one is located in the visible range. The $hr$-$sB$ borophene is characterised with an intrinsic high carrier density and it supports strong hyperbolic plasmon modes in the visible part of the spectrum. The $8Pmmn$ borophene, on the other hand, resembles the prototypical Dirac material graphene, and upon carrier doping acquires anisotropic Dirac plasmons in the mid-infrared. We have also investigated the impact of the electron-phonon coupling and Landau damping on these hyperbolic plasmon modes. Our results show that borophene, having high anisotropy, intrinsic high carrier concentration, low-loss hyperbolic Dirac plasmon modes, and high confinement can represent a promising candidate for low-loss broad band surface plasmon polariton devices.


title: A numerical characterisation of unconfined strength of weakly consolidated granular packs and its effect on fluid-driven fracture behaviour

abstract: Soft or weakly-consolidated sand refers to porous materials composed of particles (or grains) weakly held together to form a solid but that can be easily broken when subjected to stress. These materials do not behave as conventional brittle, linear elastic materials and the transition between these two regimes cannot usually be described using poro-elastic models. Furthermore, conventional geotechnical sampling techniques often result in the destruction of the cementation and recovery of sufficient intact core is, therefore, difficult. This paper studies a numerical model that allows us to introduce weak consolidation in granular packs. The model, based on the LIGGGHTS open source project, simply adds an attractive contribution to particles in contact. This simple model allow us to reproduce key elements of the behaviour of the stress observed in compacted sands and clay, as well as in poorly consolidated sandstones. The paper finishes by inspecting the effect of different consolidation levels in fluid-driven fracture behaviour. Numerical results are compared against experimental results on bio-cemented sandstones.


title: Solution properties of the incompressible Euler system with rough path advection

abstract: The present paper aims to establish the local well-posedness of Euler's fluid equations on geometric rough paths. In particular, we consider the Euler equations for the incompressible flow of an ideal fluid whose Lagrangian transport velocity possesses an additional rough-in-time, divergence-free vector field. In recent work, we have demonstrated that this system can be derived from Clebsch and Hamilton-Pontryagin variational principles that possess a perturbative geometric rough path Lie-advection constraint. In this paper, we prove the local well-posedness of the system in $L^2$-Sobolev spaces $H^m$ with integer regularity $m\ge \lfloor d/2\rfloor+2$ and establish a Beale-Kato-Majda (BKM) blow-up criterion in terms of the $L^1_tL^\infty_x$-norm of the vorticity. In dimension two, we show that the $L^p$-norms of the vorticity are conserved, which yields global well-posedness and a Wong-Zakai approximation theorem for the stochastic version of the equation.


title: Control of stripe domain wall magnetization in perpendicular anisotropy multilayers

abstract: We report on the controlled switching of domain wall (DW) magnetization in aligned stripe domain structures, stabilized in [Co (0.44 nm)/Pt (0.7 nm)]$_X$ ($X = 48$, 100, 150) multilayers with perpendicular magnetic anisotropy. The switching process, induced by an external magnetic field, is monitored by measuring the evolution of the in-plane magnetization. % We show that the remanent in-plane magnetization originates from the polarization of the Bloch-type DWs. With micromagnetic simulations, we reveal that the reversal of the DW polarization is the result of the emergence and collapse of horizontal Bloch lines within the DWs at particular strengths of the external magnetic field, applied opposite to the DW polarization. Our findings are relevant for DW-based magnonics and bubble skyrmion applications in magnetic multilayers.


title: Complementation in t-perfect graphs

abstract: Inspired by applications of perfect graphs in combinatorial optimization, Chv\'{a}tal defined t-perfect graphs in 1970s. The long efforts of characterizing t-perfect graphs started immediately, but embarrassingly, even a working conjecture on it is still missing after nearly 50 years. Unlike perfect graphs, t-perfect graphs are not closed under substitution or complementation. A full characterization of t-perfection with respect to substitution has been obtained by Benchetrit in his Ph.D. thesis. Through the present work we attempt to understand t-perfection with respect to complementation. In particular, we show that there are only five pairs of graphs such that both the graphs and their complements are minimally t-imperfect.


title: Low-Rank Autoregressive Tensor Completion for Spatiotemporal Traffic Data Imputation

abstract: Spatiotemporal traffic time series (e.g., traffic volume/speed) collected from sensing systems are often incomplete with considerable corruption and large amounts of missing values, preventing users from harnessing the full power of the data. Missing data imputation has been a long-standing research topic and critical application for real-world intelligent transportation systems. A widely applied imputation method is low-rank matrix/tensor completion; however, the low-rank assumption only preserves the global structure while ignores the strong local consistency in spatiotemporal data. In this paper, we propose a low-rank autoregressive tensor completion (LATC) framework by introducing \textit{temporal variation} as a new regularization term into the completion of a third-order (sensor $\times$ time of day $\times$ day) tensor. The third-order tensor structure allows us to better capture the global consistency of traffic data, such as the inherent seasonality and day-to-day similarity. To achieve local consistency, we design the temporal variation by imposing an AR($p$) model for each time series with coefficients as learnable parameters. Different from previous spatial and temporal regularization schemes, the minimization of temporal variation can better characterize temporal generative mechanisms beyond local smoothness, allowing us to deal with more challenging scenarios such "blackout" missing. To solve the optimization problem in LATC, we introduce an alternating minimization scheme that estimates the low-rank tensor and autoregressive coefficients iteratively. We conduct extensive numerical experiments on several real-world traffic data sets, and our results demonstrate the effectiveness of LATC in diverse missing scenarios.


title: Federated Learning with Fair Averaging

abstract: Fairness has emerged as a critical problem in federated learning (FL). In this work, we identify a cause of unfairness in FL -- conflicting gradients with large differences in the magnitudes. To address this issue, we propose the federated fair averaging (FedFV) algorithm to mitigate potential conflicts among clients before averaging their gradients. We first use the cosine similarity to detect gradient conflicts, and then iteratively eliminate such conflicts by modifying both the direction and the magnitude of the gradients. We further show the theoretical foundation of FedFV to mitigate the issue conflicting gradients and converge to Pareto stationary solutions. Extensive experiments on a suite of federated datasets confirm that FedFV compares favorably against state-of-the-art methods in terms of fairness, accuracy and efficiency. The source code is available at https://github.com/WwZzz/easyFL.


title: Super Odometry: IMU-centric LiDAR-Visual-Inertial Estimator for Challenging Environments

abstract: We propose Super Odometry, a high-precision multi-modal sensor fusion framework, providing a simple but effective way to fuse multiple sensors such as LiDAR, camera, and IMU sensors and achieve robust state estimation in perceptually-degraded environments. Different from traditional sensor-fusion methods, Super Odometry employs an IMU-centric data processing pipeline, which combines the advantages of loosely coupled methods with tightly coupled methods and recovers motion in a coarse-to-fine manner. The proposed framework is composed of three parts: IMU odometry, visual-inertial odometry, and laser-inertial odometry. The visual-inertial odometry and laser-inertial odometry provide the pose prior to constrain the IMU bias and receive the motion prediction from IMU odometry. To ensure high performance in real-time, we apply a dynamic octree that only consumes 10 % of the running time compared with a static KD-tree. The proposed system was deployed on drones and ground robots, as part of Team Explorer's effort to the DARPA Subterranean Challenge where the team won $1^{st}$ and $2^{nd}$ place in the Tunnel and Urban Circuits, respectively.


title: Evaluating Contrastive Models for Instance-based Image Retrieval

abstract: In this work, we evaluate contrastive models for the task of image retrieval. We hypothesise that models that are learned to encode semantic similarity among instances via discriminative learning should perform well on the task of image retrieval, where relevancy is defined in terms of instances of the same object. Through our extensive evaluation, we find that representations from models trained using contrastive methods perform on-par with (and outperforms) a pre-trained supervised baseline trained on the ImageNet labels in retrieval tasks under various configurations. This is remarkable given that the contrastive models require no explicit supervision. Thus, we conclude that these models can be used to bootstrap base models to build more robust image retrieval engines.


title: Eigenstate Thermalisation on Average

abstract: We consider conditions under which an isolated quantum system approaches a microcanonical equilibrium state. A key component is the eigenstate thermalisation hypothesis, which proposes that all energy eigenstates appear thermal. We introduce a weaker version of this requirement, applying only to the average distinguishability of eigenstates from the thermal state, and investigate its necessity and sufficiency for thermalisation.


title: On a linear stability issue of split form schemes for compressible flows

abstract: Split form schemes for Euler and Navier-Stokes equations are useful for computation of turbulent flows due to their better robustness. This is because they satisfy additional conservation properties of the governing equations like kinetic energy preservation leading to a reduction in aliasing errors at high orders. Recently, linear stability issues have been pointed out for these schemes for a density wave problem and we investigate this behaviour for some standard split forms. By deriving linearized equations of split form schemes, we show that most existing schemes do not satisfy a perturbation energy equation that holds at the continuous level. A simple modification to the energy flux of some existing schemes is shown to yield a scheme that is consistent with the energy perturbation equation. Numerical tests are given using a discontinuous Galerkin method to demonstrate these results.

categories: math.NA cs.NA physics.comp-ph physics.flu-dyn


title: Four-mode squeezed states: two-field quantum systems and the symplectic group $\mathrm{Sp}(4,\mathbb{R})$

abstract: We construct the four-mode squeezed states and study their physical properties. These states describe two linearly-coupled quantum scalar fields, which makes them physically relevant in various contexts such as cosmology. They are shown to generalise the usual two-mode squeezed states of single-field systems, with additional transfers of quanta between the fields. To build them in the Fock space, we use the symplectic structure of the phase space. For this reason, we first present a pedagogical analysis of the symplectic group $\mathrm{Sp}(4,\mathbb{R})$ and its Lie algebra, from which we construct the four-mode squeezed states and discuss their structure. We also study the reduced single-field system obtained by tracing out one of the two fields. This procedure being easier in the phase space, it motivates the use of the Wigner function which we introduce as an alternative description of the state. It allows us to discuss environmental effects in the case of linear interactions. In particular, we find that there is always a range of interaction coupling for which decoherence occurs without substantially affecting the power spectra (hence the observables) of the system.


title: DNA Origami Catenanes Templated by Gold Nanoparticles

abstract: Mechanically interlocked molecules have marked a breakthrough in the field of topological chemistry and boosted the vigorous development of molecular machinery. As an archetypal example of the interlocked molecules, catenanes comprise macrocycles that are threaded through one another like links in a chain. Inspired by the transition metal-templated approach of catenanes synthesis, the hierarchical assembly of DNA origami catenanes templated by gold nanoparticles is demonstrated in this work. DNA origami catenanes, which contain two, three or four interlocked rings are successfully created. In particular, the origami rings within the individual catenanes can be set free with respect to one another by releasing the interconnecting gold nanoparticles. This work will set the basis for rich progress toward DNA-based molecular architectures with unique structural programmability and well-defined topology.


title: A Review on Bio-Cyber Interfaces for Intrabody Molecular Communications Systems

abstract: The recent advancements in bio-engineering and wireless communications systems have motivated researchers to propose novel applications for telemedicine, therapeutics and human health monitoring. For instance, through wireless medical telemetry a healthcare worker can remotely measure biological signals and control certain processes in the organism required for the maintenance of the patient's health state. This technology can be further extended to use Bio-Nano devices to promote a real-time monitoring of the human health and storage of the gathered data in the cloud. This brings new challenges and opportunities for the development of biosensing network, which will depend on the extension of the current intrabody devices functionalities. In this paper we will cover the recent progress made on implantable micro-scale devices and introduce the perspective of improve them to foster the development of new theranostics based on data collected at the nanoscale level.


title: Anomaly Detection with Prototype-Guided Discriminative Latent Embeddings

abstract: Recent efforts towards video anomaly detection (VAD) try to learn a deep autoencoder to describe normal event patterns with small reconstruction errors. The video inputs with large reconstruction errors are regarded as anomalies at the test time. However, these methods sometimes reconstruct abnormal inputs well because of the powerful generalization ability of deep autoencoder. To address this problem, we present a novel approach for anomaly detection, which utilizes discriminative prototypes of normal data to reconstruct video frames. In this way, the model will favor the reconstruction of normal events and distort the reconstruction of abnormal events. Specifically, we use a prototype-guided memory module to perform discriminative latent embedding. We introduce a new discriminative criterion for the memory module, as well as a loss function correspondingly, which can encourage memory items to record the representative embeddings of normal data, i.e. prototypes. Besides, we design a novel two-branch autoencoder, which is composed of a future frame prediction network and an RGB difference generation network that share the same encoder. The stacked RGB difference contains motion information just like optical flow, so our model can learn temporal regularity. We evaluate the effectiveness of our method on three benchmark datasets and experimental results demonstrate the proposed method outperforms the state-of-the-art.


title: On the leading constant in the Manin-type conjecture for Campana points

abstract: We compare the Manin-type conjecture for Campana points recently formulated by Pieropan, Smeets, Tanimoto and V\'{a}rilly-Alvarado with an alternative prediction of Browning and Van Valckenborgh in the special case of the orbifold $(\mathbb{P}^1,D)$, where $D = \frac{1}{2}[0]+\frac{1}{2}[1]+\frac{1}{2}[\infty]$. We find that the two predicted leading constants do not agree, and we discuss whether thin sets could explain this discrepancy. Motivated by this, we provide a counterexample to the Manin-type conjecture for Campana points, by considering orbifolds corresponding to squareful values of binary quadratic forms.


title: A Hurwitz divisor on the Moduli of Prym curves

abstract: For genus $g=2i\geq4$ and the length $g-1$ partition $\mu = (4,2,\ldots,2,-2,\ldots,-2)$ of 0, we compute the first coefficients of the class of $\overline{D}(\mu)$ in $\mathrm{Pic}_\mathbb{Q}(\overline{\mathcal{R}}_g)$, where $D(\mu)$ is the divisor consisting of pairs $[C,\eta]\in \mathcal{R}_g$ with $\eta \cong \mathcal{O}_C(2x_1+x_2+\cdots + x_{i-1}-x_i-\cdots-x_{2i-1})$ for some points $x_1,\ldots, x_{2i-1}$ on $C$. We further provide several enumerative results that will be used for this computation.


title: The conformal Einstein field equations and the local extension of future null infinity

abstract: We make use of an improved existence result for the characteristic initial value problem for the conformal Einstein equations to show that given initial data on two null hypersurfaces $\mathcal{N}_\star$ and $\mathcal{N}'_\star$ such that the conformal factor (but not its gradient) vanishes on a section of $\mathcal{N}_\star$ one recovers a portion of null infinity. This result combined with the theory of the hyperboloidal initial value problem for the conformal Einstein field equations allows to show the semi-global stability of the Minkowski spacetime from characteristic initial data.


title: Automatically Differentiable Quantum Circuit for Many-qubit State Preparation

abstract: Constructing quantum circuits for efficient state preparation belongs to the central topics in the field of quantum information and computation. As the number of qubits grows fast, methods to derive large-scale quantum circuits are strongly desired. In this work, we propose the automatically differentiable quantum circuit (ADQC) approach to efficiently prepare arbitrary quantum many-qubit states. A key ingredient is to introduce the latent gates whose decompositions give the unitary gates that form the quantum circuit. The circuit is optimized by updating the latent gates using back propagation to minimize the distance between the evolved and target states. Taking the ground states of quantum lattice models and random matrix product states as examples, with the number of qubits where processing the full coefficients is unlikely, ADQC obtains high fidelities with small numbers of layers $N_L \sim O(1)$. Superior accuracy is reached compared with the existing state-preparation approach based on the matrix product disentangler. The parameter complexity of MPS can be significantly reduced by ADQC with the compression ratio $r \sim O(10^{-3})$. Our work sheds light on the "intelligent construction" of quantum circuits for many-qubit systems by combining with the machine learning methods.

categories: quant-ph cond-mat.str-el cs.LG physics.comp-ph


title: Random Walks in Dirichlet Random Environments on $\mathbb{Z}$ with Bounded Jumps

abstract: We examine a class of random walks in random environments on $\mathbb{Z}$ with bounded jumps, a generalization of the classic one-dimensional model. The environments we study have i.i.d. transition probability vectors drawn from Dirichlet distributions. For this model, we characterize recurrence and transience, and in the transient case we characterize ballisticity. For ballisticity, we give two parameters, $\kappa_0$ and $\kappa_1$. The parameter $\kappa_0$ governs finite trapping effects, and $\kappa_1$ governs repeated traversals of arbitrarily large regions of the graph. We show that the walk is right-transient if and only if $\kappa_1>0$, and in that case it is ballistic if and only if $\min(\kappa_0,\kappa_1)>1$.


title: SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models

abstract: Single image super-resolution (SISR) aims to reconstruct high-resolution (HR) images from the given low-resolution (LR) ones, which is an ill-posed problem because one LR image corresponds to multiple HR images. Recently, learning-based SISR methods have greatly outperformed traditional ones, while suffering from over-smoothing, mode collapse or large model footprint issues for PSNR-oriented, GAN-driven and flow-based methods respectively. To solve these problems, we propose a novel single image super-resolution diffusion probabilistic model (SRDiff), which is the first diffusion-based model for SISR. SRDiff is optimized with a variant of the variational bound on the data likelihood and can provide diverse and realistic SR predictions by gradually transforming the Gaussian noise into a super-resolution (SR) image conditioned on an LR input through a Markov chain. In addition, we introduce residual prediction to the whole framework to speed up convergence. Our extensive experiments on facial and general benchmarks (CelebA and DIV2K datasets) show that 1) SRDiff can generate diverse SR results in rich details with state-of-the-art performance, given only one LR input; 2) SRDiff is easy to train with a small footprint; and 3) SRDiff can perform flexible image manipulation including latent space interpolation and content fusion.


title: Network Recovery from Unlabeled Noisy Samples

abstract: There is a growing literature on the statistical analysis of multiple networks in which the network is the fundamental data object. However, most of this work requires networks on a shared set of labeled vertices. In this work, we consider the question of recovering a parent network based on noisy unlabeled samples. We identify a specific regime in the noisy network literature for recovery that is asymptotically unbiased and computationally tractable based on a three-stage recovery procedure: first, we align the networks via a sequential pairwise graph matching procedure; next, we compute the sample average of the aligned networks; finally, we obtain an estimate of the parent by thresholding the sample average. Previous work on multiple unlabeled networks is only possible for trivial networks due to the complexity of brute-force computations.


title: Magnesium-Based Metasurfaces for Dual-Function Switching between Dynamic Holography and Dynamic Color Display

abstract: Metasurface-based color display and holography have greatly advanced the state of the art display technologies. To further enrich the metasurface functionalities, recently a lot of research endeavors have been made to combine these two display functions within a single device. However, so far such metasurfaces have remained static and lack tunability once the devices are fabricated. In this work, we demonstrate a dynamic dual-function metasurface device at visible frequencies. It allows for switching between dynamic holography and dynamic color display, taking advantage of the reversible phase transition of magnesium through hydrogenation and dehydrogenation. Spatially arranged stepwise nanocavity pixels are employed to accurately control the amplitude and phase of light, enabling the generation of high-quality color prints and holograms. Our work represents a paradigm toward compact and multifunctional optical elements for future display technologies.


title: Analysis of Molecular Communications on the Growth Structure of Glioblastoma Multiforme

abstract: In this paper we consider the influence of intercellular communication on the development and progression of Glioblastoma Multiforme (GBM), a grade IV malignant glioma which is defined by an interplay Grow i.e. self renewal and Go i.e. invasiveness potential of multiple malignant glioma stem cells. Firstly, we performed wet lab experiments with U87 malignant glioma cells to study the node-stem growth pattern of GBM. Next we develop a model accounting for the structural influence of multiple transmitter and receiver glioma stem cells resulting in the node-stem growth structure of GBM tumour. By using information theory we study different properties associated with this communication model to show that the growth of GBM in a particular direction (node to stem) is related to an increase in mutual information. We further show that information flow between glioblastoma cells for different levels of invasiveness vary at different points between node and stem. These findings are expected to contribute significantly in the design of future therapeutic mechanisms for GBM.


title: Higher order parabolic boundary Harnack inequality in $C^1$ and $C^{k,\alpha}$ domains

abstract: We study the boundary behaviour of solutions to second order parabolic linear equations in moving domains. Our main result is a higher order boundary Harnack inequality in $C^1$ and $C^{k,\alpha}$ domains, providing that the quotient of two solutions vanishing on the boundary of the domain is as smooth as the boundary. As a consequence of our result, we provide a new proof of higher order regularity of the free boundary in the parabolic obstacle problem.


title: Methodological Foundation of a Numerical Taxonomy of Urban Form

abstract: Cities are complex products of human culture, characterised by a startling diversity of visible traits. Their form is constantly evolving, reflecting changing human needs and local contingencies, manifested in space by many urban patterns. Urban Morphology laid the foundation for understanding many such patterns, largely relying on qualitative research methods to extract distinct spatial identities of urban areas. However, the manual, labour-intensive and subjective nature of such approaches represents an impediment to the development of a scalable, replicable and data-driven urban form characterisation. Recently, advances in Geographic Data Science and the availability of digital mapping products, open the opportunity to overcome such limitations. And yet, our current capacity to systematically capture the heterogeneity of spatial patterns remains limited in terms of spatial parameters included in the analysis and hardly scalable due to the highly labour-intensive nature of the task. In this paper, we present a method for numerical taxonomy of urban form derived from biological systematics, which allows the rigorous detection and classification of urban types. Initially, we produce a rich numerical characterisation of urban space from minimal data input, minimizing limitations due to inconsistent data quality and availability. These are street network, building footprint, and morphological tessellation, a spatial unit derivative of Voronoi tessellation, obtained from building footprints. Hence, we derive homogeneous urban tissue types and, by determining overall morphological similarity between them, generate a hierarchical classification of urban form. After framing and presenting the method, we test it on two cities - Prague and Amsterdam - and discuss potential applications and further developments.


title: A Riemannian Newton Trust-Region Method for Fitting Gaussian Mixture Models

abstract: Gaussian Mixture Models are a powerful tool in Data Science and Statistics that are mainly used for clustering and density approximation. The task of estimating the model parameters is in practice often solved by the Expectation Maximization (EM) algorithm which has its benefits in its simplicity and low per-iteration costs. However, the EM converges slowly if there is a large share of hidden information or overlapping clusters. Recent advances in manifold optimization for Gaussian Mixture Models have gained increasing interest. We introduce an explicit formula for the Riemannian Hessian for Gaussian Mixture Models. On top, we propose a new Riemannian Newton Trust-Region method which outperforms current approaches both in terms of runtime and number of iterations. We apply our method on clustering problems and density approximation tasks. Our method is very powerful for data with a large share of hidden information compared to existing methods.


title: Assessment of the influence of features on a classification problem: an application to COVID-19 patients

abstract: This paper deals with an important subject in classification problems addressed by machine learning techniques: the evaluation of the influence of each of the features on the classification of individuals. Specifically, a measure of that influence is introduced using the Shapley value of cooperative games. In addition, an axiomatic characterisation of the proposed measure is provided based on properties of efficiency and balanced contributions. Furthermore, some experiments have been designed in order to validate the appropriate performance of such measure. Finally, the methodology introduced is applied to a sample of COVID-19 patients to study the influence of certain demographic or risk factors on various events of interest related to the evolution of the disease.


title: Continuous normalizing flows on manifolds

abstract: Normalizing flows are a powerful technique for obtaining reparameterizable samples from complex multimodal distributions. Unfortunately, current approaches are only available for the most basic geometries and fall short when the underlying space has a nontrivial topology, limiting their applicability for most real-world data. Using fundamental ideas from differential geometry and geometric control theory, we describe how the recently introduced Neural ODEs and continuous normalizing flows can be extended to arbitrary smooth manifolds. We propose a general methodology for parameterizing vector fields on these spaces and demonstrate how gradient-based learning can be performed. Additionally, we provide a scalable unbiased estimator for the divergence in this generalized setting. Experiments on a diverse selection of spaces empirically showcase the defined framework's ability to obtain reparameterizable samples from complex distributions.


title: Signatures of coronal hole substructure in the solar wind: combined Solar Orbiter remote sensing and in situ measurements

abstract: Context. The Sun's complex corona is the source of the solar wind and interplanetary magnetic field. While the large scale morphology is well understood, the impact of variations in coronal properties on the scale of a few degrees on properties of the interplanetary medium is not known. Solar Orbiter, carrying both remote sensing and in situ instruments into the inner solar system, is intended to make these connections better than ever before. Aims. We combine remote sensing and in situ measurements from Solar Orbiter's first perihelion at 0.5 AU to study the fine scale structure of the solar wind from the equatorward edge of a polar coronal hole with the aim of identifying characteristics of the corona which can explain the in situ variations. Methods. We use in situ measurements of the magnetic field, density and solar wind speed to identify structures on scales of hours at the spacecraft. Using Potential Field Source Surface mapping we estimate the source locations of the measured solar wind as a function of time and use EUI images to characterise these solar sources. Results. We identify small scale stream interactions in the solar wind with compressed magnetic field and density along with speed variations which are associated with corrugations in the edge of the coronal hole on scales of several degrees, demonstrating that fine scale coronal structure can directly influence solar wind properties and drive variations within individual streams. Conclusions. This early analysis already demonstrates the power of Solar Orbiter's combined remote sensing and in situ payload and shows that with future, closer perihelia it will be possible dramatically to improve our knowledge of the coronal sources of fine scale solar wind structure, which is important both for understanding the phenomena driving the solar wind and predicting its impacts at the Earth and elsewhere.


title: Revisiting Citizen Science Through the Lens of Hybrid Intelligence

abstract: Artificial Intelligence (AI) can augment and sometimes even replace human cognition. Inspired by efforts to value human agency alongside productivity, we discuss the benefits of solving Citizen Science (CS) tasks with Hybrid Intelligence (HI), a synergetic mixture of human and artificial intelligence. Currently there is no clear framework or methodology on how to create such an effective mixture. Due to the unique participant-centered set of values and the abundance of tasks drawing upon both human common sense and complex 21st century skills, we believe that the field of CS offers an invaluable testbed for the development of HI and human-centered AI of the 21st century, while benefiting CS as well. In order to investigate this potential, we first relate CS to adjacent computational disciplines. Then, we demonstrate that CS projects can be grouped according to their potential for HI-enhancement by examining two key dimensions: the level of digitization and the amount of knowledge or experience required for participation. Finally, we propose a framework for types of human-AI interaction in CS based on established criteria of HI. This "HI lens" provides the CS community with an overview of several ways to utilize the combination of AI and human intelligence in their projects. It also allows the AI community to gain ideas on how developing AI in CS projects can further their own field.


title: PSEUDo: Interactive Pattern Search in Multivariate Time Series with Locality-Sensitive Hashing and Relevance Feedback

abstract: We present PSEUDo, an adaptive feature learning technique for exploring visual patterns in multi-track sequential data. Our approach is designed with the primary focus to overcome the uneconomic retraining requirements and inflexible representation learning in current deep learning-based systems. Multi-track time series data are generated on an unprecedented scale due to increased sensors and data storage. These datasets hold valuable patterns, like in neuromarketing, where researchers try to link patterns in multivariate sequential data from physiological sensors to the purchase behavior of products and services. But a lack of ground truth and high variance make automatic pattern detection unreliable. Our advancements are based on a novel query-aware locality-sensitive hashing technique to create a feature-based representation of multivariate time series windows. Most importantly, our algorithm features sub-linear training and inference time. We can even accomplish both the modeling and comparison of 10,000 different 64-track time series, each with 100 time steps (a typical EEG dataset) under 0.8 seconds. This performance gain allows for a rapid relevance feedback-driven adaption of the underlying pattern similarity model and enables the user to modify the speed-vs-accuracy trade-off gradually. We demonstrate superiority of PSEUDo in terms of efficiency, accuracy, and steerability through a quantitative performance comparison and a qualitative visual quality comparison to the state-of-the-art algorithms in the field. Moreover, we showcase the usability of PSEUDo through a case study demonstrating our visual pattern retrieval concepts in a large meteorological dataset. We find that our adaptive models can accurately capture the user's notion of similarity and allow for an understandable exploratory visual pattern retrieval in large multivariate time series datasets.


title: Determining Chess Game State From an Image

abstract: Identifying the configuration of chess pieces from an image of a chessboard is a problem in computer vision that has not yet been solved accurately. However, it is important for helping amateur chess players improve their games by facilitating automatic computer analysis without the overhead of manually entering the pieces. Current approaches are limited by the lack of large datasets and are not designed to adapt to unseen chess sets. This paper puts forth a new dataset synthesised from a 3D model that is an order of magnitude larger than existing ones. Trained on this dataset, a novel end-to-end chess recognition system is presented that combines traditional computer vision techniques with deep learning. It localises the chessboard using a RANSAC-based algorithm that computes a projective transformation of the board onto a regular grid. Using two convolutional neural networks, it then predicts an occupancy mask for the squares in the warped image and finally classifies the pieces. The described system achieves an error rate of 0.23% per square on the test set, 28 times better than the current state of the art. Further, a few-shot transfer learning approach is developed that is able to adapt the inference system to a previously unseen chess set using just two photos of the starting position, obtaining a per-square accuracy of 99.83% on images of that new chess set. The code, dataset, and trained models are made available online.


title: Deep learning with self-supervision and uncertainty regularization to count fish in underwater images

abstract: Effective conservation actions require effective population monitoring. However, accurately counting animals in the wild to inform conservation decision-making is difficult. Monitoring populations through image sampling has made data collection cheaper, wide-reaching and less intrusive but created a need to process and analyse this data efficiently. Counting animals from such data is challenging, particularly when densely packed in noisy images. Attempting this manually is slow and expensive, while traditional computer vision methods are limited in their generalisability. Deep learning is the state-of-the-art method for many computer vision tasks, but it has yet to be properly explored to count animals. To this end, we employ deep learning, with a density-based regression approach, to count fish in low-resolution sonar images. We introduce a large dataset of sonar videos, deployed to record wild mullet schools (Mugil liza), with a subset of 500 labelled images. We utilise abundant unlabelled data in a self-supervised task to improve the supervised counting task. For the first time in this context, by introducing uncertainty quantification, we improve model training and provide an accompanying measure of prediction uncertainty for more informed biological decision-making. Finally, we demonstrate the generalisability of our proposed counting framework through testing it on a recent benchmark dataset of high-resolution annotated underwater images from varying habitats (DeepFish). From experiments on both contrasting datasets, we demonstrate our network outperforms the few other deep learning models implemented for solving this task. By providing an open-source framework along with training data, our study puts forth an efficient deep learning template for crowd counting aquatic animals thereby contributing effective methods to assess natural populations from the ever-increasing visual data.


title: Unsupervised data augmentation for object detection

abstract: Data augmentation has always been an effective way to overcome overfitting issue when the dataset is small. There are already lots of augmentation operations such as horizontal flip, random crop or even Mixup. However, unlike image classification task, we cannot simply perform these operations for object detection task because of the lack of labeled bounding boxes information for corresponding generated images. To address this challenge, we propose a framework making use of Generative Adversarial Networks(GAN) to perform unsupervised data augmentation. To be specific, based on the recently supreme performance of YOLOv4, we propose a two-step pipeline that enables us to generate an image where the object lies in a certain position. In this way, we can accomplish the goal that generating an image with bounding box label.


title: Disentangling the frequency content in optoacoustics

abstract: Signals acquired by optoacoustic tomography systems have broadband frequency content that encodes information about structures on different physical scales. Concurrent processing and rendering of such broadband signals may result in images with poor contrast and fidelity due to a bias towards low frequency contributions from larger structures. This problem cannot be addressed by filtering different frequency bands and reconstructing them individually, as this procedure leads to artefacts due to its incompatibility with the entangled frequency content of signals generated by structures of different sizes. Here we introduce frequency-band model-based (fbMB) reconstruction to separate frequency-band-specific optoacoustic image components during image formation, thereby enabling structures of all sizes to be rendered with high fidelity. In order to disentangle the overlapping frequency content of image components, fbMB uses soft priors to achieve an optimal trade-off between localization of the components in frequency bands and their structural integrity. We demonstrate that fbMB produces optoacoustic images with improved contrast and fidelity, which reveal anatomical structures in in vivo images of mice in unprecedented detail. These enhancements further improve the accuracy of spectral unmixing in small vasculature. By offering a precise treatment of the frequency components of optoacoustic signals, fbMB improves the quality, accuracy, and quantification of optoacoustic images and provides a method of choice for optoacoustic reconstructions.


title: On the spectra of Commuting Graphs

abstract: We describe the complete spectra of Laplacian, signless Laplacian, and adjacency matrices associated with the commuting graphs of a finite group using group theoretic information. We provide a method to find the center of a group by only using the Laplacian of the commuting graph of the group. The graph invariants (such as diameter, clique number, and mean distance) of the commuting graph associated with a finite group are determined. We produce a number of examples to illustrate the applications of our results.


title: Stabilizing $\gamma$-MgH$_2$ at Nanotwins in Mechanically Constrained Nanoparticles

abstract: Reversible hydrogen uptake and the metal/dielectric transition make the Mg/MgH$_2$ system a prime candidate for solid state hydrogen storage and dynamic plasmonics. However, high dehydrogenation temperatures and slow dehydrogenation hamper broad applicability. One promising strategy to improve dehydrogenation is the formation of metastable $\gamma$-MgH$_2$. A nanoparticle (NP) design, where $\gamma$-MgH$_2$ forms intrinsically during hydrogenation is presented and a formation mechanism based on transmission electron microscopy results is proposed.Volume expansion during hydrogenation causes compressive stress within the confined, anisotropic NPs, leading to plastic deformation of $\beta$-MgH$_2$ via (301) $\beta$ twinning. It is proposed that these twins nucleate $\gamma$-MgH$_2$ nanolamellas, which are stabilized by residual compressive stress. Understanding this mechanism is a crucial step toward cycle-stable, Mg-based dynamic plasmonic and hydrogen-storage materials with improved dehydrogenation. It is envisioned that a more general design of confined NPs utilizes the inherent volume expansion to reform $\gamma$-MgH$_2$ during each rehydrogenation


title: Chiral anomaly induced nonlinear Hall effect in multi-Weyl semimetals

abstract: After the experimental realization, the Berry curvature dipole (BCD) induced nonlinear Hall effect (NLHE) has attracted tremendous interest to the condensed matter community. Here, we investigate another family of Hall effect, namely, chiral anomaly induced nonlinear Hall effect (CNHE) in multi-Weyl semimetal (mWSM). In contrast to the BCD induced NLHE, CNHE appears because of the combination of both chiral anomaly and anomalous velocity due to non-trivial Berry curvature. Using the semiclassical Boltzmann theory within the relaxation time approximation, we show that, in contrast to the chiral anomaly induced linear Hall effect, the magnitude of CNHE decreases with the topological charge n. Interestingly, we find that unlike the case of n=1, the CNHE has different behaviors in different planes. Our prediction on the behavior of CNHE in mWSM can directly be checked in experiments.


title: Using brain inspired principles to unsupervisedly learn good representations for visual pattern recognition

abstract: Although deep learning has solved difficult problems in visual pattern recognition, it is mostly successful in tasks where there are lots of labeled training data available. Furthermore, the global back-propagation based training rule and the amount of employed layers represents a departure from biological inspiration. The brain is able to perform most of these tasks in a very general way from limited to no labeled data. For these reasons it is still a key research question to look into computational principles in the brain that can help guide models to unsupervisedly learn good representations which can then be used to perform tasks like classification. In this work we explore some of these principles to generate such representations for the MNIST data set. We compare the obtained results with similar recent works and verify extremely competitive results.


title: Regularization of differential equations by two fractional noises

abstract: In this paper we show the existence and uniqueness of a solution for a stochastic differential equation driven by an additive noise which is the sum of two fractional Brownian motions with different Hurst parameters. The proofs are based on the techniques of fractional calculus and Girsanov theorem. In particular, we show that the regularization effect of the fractional Brownian motion with the smaller Hurst index dominates.


title: The 10 parsec sample in the Gaia era

abstract: The nearest stars provide a fundamental constraint for our understanding of stellar physics and the Galaxy. The nearby sample serves as an anchor where all objects can be seen and understood with precise data. This work is triggered by the most recent data release of the astrometric space mission Gaia and uses its unprecedented high precision parallax measurements to review the census of objects within 10 pc. The first aim of this work was to compile all stars and brown dwarfs within 10 pc observable by Gaia, and compare it with the Gaia Catalogue of Nearby Stars as a quality assurance test. We complement the list to get a full 10 pc census, including bright stars, brown dwarfs, and exoplanets. We started our compilation from a query on all objects with a parallax larger than 100 mas using SIMBAD. We completed the census by adding companions, brown dwarfs with recent parallax measurements not in SIMBAD yet, and vetted exoplanets. The compilation combines astrometry and photometry from the recent Gaia Early Data Release 3 with literature magnitudes, spectral types and line-of-sight velocities. We give a description of the astrophysical content of the 10 pc sample. We find a multiplicity frequency of around 28%. Among the stars and brown dwarfs, we estimate that around 61% are M stars and more than half of the M stars are within the range M3.0 V to M5.0 V. We give an overview of the brown dwarfs and exoplanets that should be detected in the next Gaia data releases along with future developments. We provide a catalogue of 540 stars, brown dwarfs, and exoplanets in 339 systems, within 10 pc from the Sun. This list is as volume-complete as possible from current knowledge and provides benchmark stars that can be used, for instance, to define calibration samples and to test the quality of the forthcoming Gaia releases. It also has a strong outreach potential.


title: Uniform in time weak propagation of chaos on the torus

abstract: We address the long time behaviour of weakly interacting diffusive particle systems on the d-dimensional torus. Our main result is to show that, under certain regularity conditions, the weak error between the empirical distribution of the particle system and the theoretical law of the limiting process (governed by a McKean-Vlasov stochastic differential equation) is of the order O(1/N), uniform in time on [0, infinity), where N is the number of particles in the interacting diffusion. This comprises general interaction terms with a small enough mean-field dependence together with interactions terms driven by an H-stable potential. Our approach relies on a systematic analysis of the long-time behaviour of the derivatives of the semigroup generated by the McKean-Vlasov SDE, which may be explicitly computed through the linearised Fokker-Planck equation. Ergodic estimates for the latter hence play a key role in our analysis. We believe that this strategy is flexible enough to cover a wider broad of situations. To wit, we succeed in adapting it to the super-critical Kuramoto model, for which the corresponding McKean-Vlasov equation has several invariant measures.


title: Variation operators for semigroups associated with Fourier-Bessel expansions

abstract: In this paper we establish $L^p$-boundedness properties for variation operators defined by semigroups associated with Fourier-Bessel expansions.


title: Intelligent Decision Method for Main Control Parameters of Tunnel Boring Machine based on Multi-Objective Optimization of Excavation Efficiency and Cost

abstract: Timely and reasonable matching of the control parameters and geological conditions of the rock mass in tunnel excavation is crucial for hard rock tunnel boring machines (TBMs). Therefore, this paper proposes an intelligent decision method for the main control parameters of the TBM based on the multi-objective optimization of excavation efficiency and cost. The main objectives of this method are to obtain the most important parameters of the rock mass and machine, determine the optimization objective, and establish the objective function. In this study, muck information was included as an important parameter in the traditional rock mass and machine parameter database. The rock-machine interaction model was established through an improved neural network algorithm. Using 250 sets of data collected in the field, the validity of the rock-machine interaction relationship model was verified. Then, taking the cost as the optimization objective, the cost calculation model related to tunneling and the cutter was obtained. Subsequently, combined with rock-machine interaction model, the objective function of control parameter optimization based on cost was established. Finally, a tunneling test was carried out at the engineering site, and the main TBM control parameters (thrust and torque) after the optimization decision were used to excavate the test section. Compared with the values in the section where the TBM operators relied on experience, the average penetration rate of the TBM increased by 11.10%, and the average cutter life increased by 15.62%. The results indicate that this method can play an effective role in TBM tunneling in the test section.


title: Comparing Power Processing System Approaches in Second-Use Battery Energy Buffering for Electric Vehicle Charging

abstract: The heterogeneity in pack voltages and capacity of aged packs limits the performance and economic viability of second-use battery energy storage systems (2-BESS) due to issues of reliability and available energy. Overcoming these limitations could enable extended use of batteries and improve the environmental impacts of electric vehicles by reducing the number of batteries produced. This paper compares Lite-Sparse Hierarchical Partial Power Processing (LS-HiPPP), a new method for power processing in 2-BESS, to conventional power processing architectures using a stochastic EV charging plaza model. This method for performance evaluation allows a fair comparison among power processing architectures for 2-BESS. Results show that LS-HiPPP increases the battery energy utilization to 94% as compared to 78% for conventional partial power processing (C-PPP) and 23% for full power processing. These results were obtained with 25% heterogeneity in individual battery capacities and 20% power processing within the 2-BESS. Derating and captured value are two derived performance metrics for comparing LS-HiPPP and C-PPP in this work. The derating for LS-HiPPP is 84.3% in comparison to 63.1% for C-PPP. The captured value for LS-HiPPP is 79.8% versus 51% for C-PPP.


title: Linear Convergence of the Subspace Constrained Mean Shift Algorithm: From Euclidean to Directional Data

abstract: This paper studies the linear convergence of the subspace constrained mean shift (SCMS) algorithm, a well-known algorithm for identifying a density ridge defined by a kernel density estimator. By arguing that the SCMS algorithm is a special variant of a subspace constrained gradient ascent (SCGA) algorithm with an adaptive step size, we derive the linear convergence of such SCGA algorithm. While the existing research focuses mainly on density ridges in the Euclidean space, we generalize density ridges and the SCMS algorithm to directional data. In particular, we establish the stability theorem of density ridges with directional data and prove the linear convergence of our proposed directional SCMS algorithm.


title: A comparative study of neural network techniques for automatic software vulnerability detection

abstract: Software vulnerabilities are usually caused by design flaws or implementation errors, which could be exploited to cause damage to the security of the system. At present, the most commonly used method for detecting software vulnerabilities is static analysis. Most of the related technologies work based on rules or code similarity (source code level) and rely on manually defined vulnerability features. However, these rules and vulnerability features are difficult to be defined and designed accurately, which makes static analysis face many challenges in practical applications. To alleviate this problem, some researchers have proposed to use neural networks that have the ability of automatic feature extraction to improve the intelligence of detection. However, there are many types of neural networks, and different data preprocessing methods will have a significant impact on model performance. It is a great challenge for engineers and researchers to choose a proper neural network and data preprocessing method for a given problem. To solve this problem, we have conducted extensive experiments to test the performance of the two most typical neural networks (i.e., Bi-LSTM and RVFL) with the two most classical data preprocessing methods (i.e., the vector representation and the program symbolization methods) on software vulnerability detection problems and obtained a series of interesting research conclusions, which can provide valuable guidelines for researchers and engineers. Specifically, we found that 1) the training speed of RVFL is always faster than BiLSTM, but the prediction accuracy of Bi-LSTM model is higher than RVFL; 2) using doc2vec for vector representation can make the model have faster training speed and generalization ability than using word2vec; and 3) multi-level symbolization is helpful to improve the precision of neural network models.


title: Dark matter in Actor-Network Theory context (La materia oscura en el contexto de la teor\'ia del actor-red)

abstract: The aim of this work is to use some categories of Actor-Network Theory (ANT) developed by Bruno Latour in the book Reassembling the Social -- An Introduction to Actor-Network Theory to analyze a current controversy that occurs in the area of cosmology: the dark matter existence and its characteristics. The central idea of this article is to try to decipher which type of agent is the dark matter and open the discussion about this topic from a sociological perspective.


title: Machine Learning based System for Vessel Turnaround Time Prediction

abstract: In this paper, we present a novel system for predicting vessel turnaround time, based on machine learning and standardized port call data. We also investigate the use of specific external maritime big data, to enhance the accuracy of the available data and improve the performance of the developed system. An extensive evaluation is performed in Port of Bordeaux, where we report the results on 11 years of historical port call data and provide verification on live, operational data from the port. The proposed automated data-driven turnaround time prediction system is able to perform with increased accuracy, in comparison with the current manual expert-based system in Port of Bordeaux.


title: Exploring Unconventional Features Of Light Dynamics In Aubrey-Andre-Harper Model Based Quasi-periodic Optical Lattices

abstract: We report an Aubrey-Andre-Harper (AAH) model based quasi-periodic lossless evanescently coupled waveguide lattice to study the unconventional physics of light localization. We present an exclusive methodical analysis of the band-topology of a tight-binding discrete lattice and accordingly study the modal characteristics to reveal the fact that a higher value of quasi-periodic modulation strength is imperative for observing a signature of fully localized light states having higher eigenenergy. This analytical concept has numerically been implemented in the proposed topological lattice to achieve light localization, where we have shown that the supported states not only depend on topological parameters, but also on the specific location of excitation which is supported by the violation of bulk-edge correspondence due to quasi-periodicity. Furthermore, we have investigated a unique effect of the presence of disorder on light localization phenomenon, where it has been reported that the presence of off-diagonal disorder, which is otherwise detrimental, favours light localization in the proposed structure due to topological protection. The findings indeed have the potential to open up a fertile platform to manipulate light in topologically aided passive photonic devices.


title: Modelling and design of lanthanide ion doped chalcogenide fiber lasers: progress towards the practical realization of the first MIR chalcogenide fiber laser

abstract: This paper presents the progress in the fields of the modelling and design of lanthanide ion doped chalcogenide glass fiber lasers. It presents the laser cavity designs that have been developed in order to optimize the performance of lanthanide ion doped chalcogenide glass fiber lasers. Also various numerical algorithms that have been applied for the optimization of chalcogenide glass lasers are reviewed and compared. The comparison shows that a combination of less accurate but more robust algorithms with more accurate ones gives the most promising performance.


title: A study of MIR photoluminescence from Pr$^{3+}$ doped chalcogenide fibers pumped at near-infrared wavelengths

abstract: We perform a numerical analysis of mid-infrared photoluminescence emitted by praseodymium (III) doped chalcogenide selenide glass pumped at near-infrared wavelengths. The results obtained show that an effective inversion of level populations can be achieved using both 1480 nm and 1595 nm laser diodes. The rate of the spontaneous emission achieved when pumping at 1480 nm and 1595 nm is comparable to this achieved using the standard pumping wavelength of 2040 nm.


title: CAT: Cross-Attention Transformer for One-Shot Object Detection

abstract: Given a query patch from a novel class, one-shot object detection aims to detect all instances of that class in a target image through the semantic similarity comparison. However, due to the extremely limited guidance in the novel class as well as the unseen appearance difference between query and target instances, it is difficult to appropriately exploit their semantic similarity and generalize well. To mitigate this problem, we present a universal Cross-Attention Transformer (CAT) module for accurate and efficient semantic similarity comparison in one-shot object detection. The proposed CAT utilizes transformer mechanism to comprehensively capture bi-directional correspondence between any paired pixels from the query and the target image, which empowers us to sufficiently exploit their semantic characteristics for accurate similarity comparison. In addition, the proposed CAT enables feature dimensionality compression for inference speedup without performance loss. Extensive experiments on COCO, VOC, and FSOD under one-shot settings demonstrate the effectiveness and efficiency of our method, e.g., it surpasses CoAE, a major baseline in this task by 1.0% in AP on COCO and runs nearly 2.5 times faster. Code will be available in the future.


title: A Path to Smart Radio Environments: An Industrial Viewpoint on Reconfigurable Intelligent Surfaces

abstract: With both the standardization and commercialization completed in an unforeseen pace for the 5th generation (5G) wireless network, researchers, engineers and executives from the academia and the industry have turned their sights on candidate technologies to support the next generation wireless networks. Reconfigurable intelligent surfaces (RIS), sometimes referred to as intelligent reflecting surfaces (IRS), have been identified to be potential components of the future wireless networks because they can reconfigure the propagation environment for wireless signals with low-cost passive devices. In doing so, the coverage of a cell can be expected to increase significantly as well as the overall throughput of the network. RIS has not only become an attractive research area but also triggered a couple of projects to develop appropriate solutions to enable the set-up of hardware demonstrations and prototypes. In parallel, technical discussions and activities towards standardization already took off in some regions. Promoting RIS to be integrated into future commercial networks and become a commercial success requires significant standardization work taken place both at regional level standards developing organizations (SDO) and international SDOs such as the 3rd Generation Partnership Project (3GPP). While many research papers study how RIS can be used and optimized, few effort is devoted to analyzing the challenges to commercialize RIS and how RIS can be standardized. This paper intends to shed some light on RIS from an industrial viewpoint and provide a clear roadmap to make RIS industrially feasible.


title: Property (T) in density-type models of random groups

abstract: We study Property (T) in the $\Gamma(n,k,d)$ model of random groups: as $k$ tends to infinity this gives the Gromov density model, introduced in [Gro93]. We provide bounds for Property (T) in the $k$-angular model of random groups, i.e. the $ \Gamma (n,k,d)$ model where $k$ is fixed and $n$ tends to infinity. We also prove that for $d>1\slash 3$, a random group in the $\Gamma(n,k,d)$ model has Property (T) with probability tending to $1$ as $k$ tends to infinity, strengthening the results of \.{Z}uk and Kotowski--Kotowski, who consider only groups in the $\Gamma (n,3k,d)$ model.


title: Emulating complex dynamical simulators with random Fourier features

abstract: A Gaussian process (GP)-based methodology is proposed to emulate complex dynamical computer models (or simulators). The method relies on emulating the numerical flow map of the system over an initial (short) time step, where the flow map is a function that describes the evolution of the system from an initial condition to a subsequent value at the next time step. This yields a probabilistic distribution over the entire flow map function, with each draw offering an approximation to the flow map. The model output times series is then predicted (under the Markov assumption) by drawing a sample from the emulated flow map (i.e., its posterior distribution) and using it to iterate from the initial condition ahead in time. Repeating this procedure with multiple such draws creates a distribution over the time series. The mean and variance of this distribution at a specific time point serve as the model output prediction and the associated uncertainty, respectively. However, drawing a GP posterior sample that represents the underlying function across its entire domain is computationally infeasible, given the infinite-dimensional nature of this object. To overcome this limitation, one can generate such a sample in an approximate manner using random Fourier features (RFF). RFF is an efficient technique for approximating the kernel and generating GP samples, offering both computational efficiency and theoretical guarantees. The proposed method is applied to emulate several dynamic nonlinear simulators including the well-known Lorenz and van der Pol models. The results suggest that our approach has a promising predictive performance and the associated uncertainty can capture the dynamics of the system appropriately.


title: Temporal Stream Logic modulo Theories (Full Version)

abstract: Temporal stream logic (TSL) extends LTL with updates and predicates over arbitrary function terms. This allows for specifying data-intensive systems for which LTL is not expressive enough. In the semantics of TSL, functions and predicates are left uninterpreted. In this paper, we extend TSL with first-order theories, enabling us to specify systems using interpreted functions and predicates such as incrementation or equality. We investigate the satisfiability problem of TSL modulo the standard underlying theory of uninterpreted functions as well as with respect to Presburger arithmetic and the theory of equality: For all three theories, TSL satisfiability is highly undecidable. Nevertheless, we identify three fragments of TSL for which the satisfiability problem is (semi-)decidable in the theory of uninterpreted functions. Despite the high undecidability, we present an algorithm - which is not guaranteed to terminate - for checking the satisfiability of a TSL formula in the theory of uninterpreted functions and evaluate it: It scales well and is able to validate assumptions in a real-world system design.


title: A purely infinite Cuntz-like Banach $*$-algebra with no purely infinite ultrapowers

abstract: We continue our investigation, from \cite{dh}, of the ring-theoretic infiniteness properties of ultrapowers of Banach algebras, studying in this paper the notion of being purely infinite. It is well known that a $C^*$-algebra is purely infinite if and only if any of its ultrapowers are. We find examples of Banach algebras, as algebras of operators on Banach spaces, which do have purely infinite ultrapowers. Our main contribution is the construction of a "Cuntz-like" Banach $*$-algebra which is purely infinite, but whose ultrapowers are not even simple, and hence not purely infinite. This algebra is a naturally occurring analogue of the Cuntz algebra, and of the $L^p$-analogues introduced by Phillips. However, our proof of being purely infinite is combinatorial, but direct, and so differs from existing proofs. We show that there are non-zero traces on our algebra, which in particular implies that our algebra is not isomorphic to any of the $L^p$-analogues of the Cuntz algebra.


title: Impact of lockdowns and winter temperatures on natural gas consumption in Europe

abstract: As the COVID-19 virus spread over the world, governments restricted mobility to slow transmission. Public health measures had different intensities across European countries but all had significant impact on peoples daily lives and economic activities, causing a drop of CO2 emissions of about 10% for the whole year 2020. Here, we analyze changes in natural gas use in the industry and built environment sectors during the first half of year 2020 with daily gas flows data from pipeline and storage facilities in Europe. We find that reductions of industrial gas use reflect decreases in industrial production across most countries. Surprisingly, natural gas use in buildings also decreased despite most people being confined at home and cold spells in March 2020. Those reductions that we attribute to the impacts of COVID-19 remain of comparable magnitude to previous variations induced by cold or warm climate anomalies in the cold season. We conclude that climate variations played a larger role than COVID-19 induced stay-home orders in natural gas consumption across Europe.


title: Recovering point sources for the inhomogeneous Helmholtz equation

abstract: The paper is concerned with an inverse point source problem for the Helmholtz equation. It consists of recovering the locations and amplitudes of a finite number of radiative point sources inside a given inhomogeneous medium from the knowledge of a single boundary measurement. The main result of the paper is a new H\"{o}lder type stability estimate for the inversion under the assumption that the point sources are well separated. The proof of the stability is based on a combination of Carleman estimates and a technique for proving uniqueness of the Cauchy problem.


title: Reducing electron beam damage through alternative STEM scanning strategies. Part II -- Attempt towards an empirical model describing the damage process

abstract: In this second part of a series we attempt to construct an empirical model that can mimick all experimental observations made regarding the role of an alternative interleaved scan pattern in STEM imaging on the beam damage in a specific zeolite sample. We make use of a 2D diffusion model that describes the dissipation of the deposited beam energy in the sequence of probe positions that are visited during the scan pattern. The diffusion process allows for the concept of trying to outrun the beam damage by carefully tuning the dwell time and distance between consecutively visited probe positions. We add a non linear function to include a threshold effect and evaluate the accumulated damage in each part of the image as a function of scan pattern details. Together, these ingredients are able to describe qualitatively all aspects of the experimental data and provide us with a model that could guide a further optimisation towards even lower beam damage without lowering the applied electron dose. We deliberately remain vague on what is diffusing here which avoids introducing too many sample specific details. This provides hope that the model can be applied also in sample classes that were not yet studied in such great detail by adjusting higher level parameters: a sample dependent diffusion constant and damage threshold.


title: FIPAC: Thwarting Fault- and Software-Induced Control-Flow Attacks with ARM Pointer Authentication

abstract: With the improvements of computing technology, more and more applications embed powerful ARM processors into their devices. These systems can be attacked by redirecting the control-flow of a program to bypass critical pieces of code such as privilege checks or signature verifications. Control-flow hijacks can be performed using classical software vulnerabilities, physical fault attacks, or software-induced fault attacks. To cope with this threat and to protect the control-flow, dedicated countermeasures are needed. To counteract control-flow hijacks, control-flow integrity~(CFI) aims to be a generic solution. However, software-based CFI typically either protects against software or fault attacks, but not against both. While hardware-assisted CFI can mitigate both types of attacks, they require extensive hardware modifications. As hardware changes are unrealistic for existing ARM architectures, a wide range of systems remains unprotected and vulnerable to control-flow attacks. In this work, we present FIPAC, an efficient software-based CFI scheme protecting the execution at basic block granularity of ARM-based devices against software and fault attacks. FIPAC exploits ARM pointer authentication of ARMv8.6-A to implement a cryptographically signed control-flow graph. We cryptographically link the correct sequence of executed basic blocks to enforce CFI at this granularity. We use an LLVM-based toolchain to automatically instrument programs. The evaluation on SPEC2017 with different security policies shows a code overhead between 54-97\% and a runtime overhead between 35-105%. While these overheads are higher than for countermeasures against software attacks, FIPAC outperforms related work protecting the control-flow against fault attacks. FIPAC is an efficient solution to provide protection against software- and fault-based CFI attacks on basic block level on modern ARM devices.