title: Mars Rover Localization Based on A2G Obstacle Distribution Pattern Matching

abstract: Rover localization is one of the perquisites for large scale rover exploration. In NASA's Mars 2020 mission, the Ingenuity helicopter is carried together with the rover, which is capable of obtaining high-resolution imagery of Mars terrain, and it is possible to perform localization based on aerial-to-ground (A2G) imagery correspondence. However, considering the low-texture nature of the Mars terrain, and large perspective changes between UAV and rover imagery, traditional image matching methods will struggle to obtain valid image correspondence. In this paper we propose a novel pipeline for Mars rover localization. An algorithm combing image-based rock detection and rock distribution pattern matching is used to acquire A2G imagery correspondence, thus establishing the rover position in a UAV-generated ground map. Feasibility of this method is evaluated on sample data from a Mars analogue environment. The proposed method can serve as a reliable assist in future Mars missions.


title: Maximizing the Mostar index for bipartite graphs and split graphs

abstract: Do\v{s}li\'{c} et al.~defined the Mostar index of a graph $G$ as $\sum\limits_{uv\in E(G)}|n_G(u,v)-n_G(v,u)|$, where, for an edge $uv$ of $G$, the term $n_G(u,v)$ denotes the number of vertices of $G$ that have a smaller distance in $G$ to $u$ than to $v$. Contributing to conjectures posed by Do\v{s}li\'{c} et al., we show that the Mostar index of bipartite graphs of order $n$ is at most $\frac{\sqrt{3}}{18}n^3$, and that the Mostar index of split graphs of order $n$ is at most $\frac{4}{27}n^3$.


title: Computational imaging with the human brain

abstract: Brain-computer interfaces (BCIs) are enabling a range of new possibilities and routes for augmenting human capability. Here, we propose BCIs as a route towards forms of computation, i.e. computational imaging, that blend the brain with external silicon processing. We demonstrate ghost imaging of a hidden scene using the human visual system that is combined with an adaptive computational imaging scheme. This is achieved through a projection pattern `carving' technique that relies on real-time feedback from the brain to modify patterns at the light projector, thus enabling more efficient and higher resolution imaging. This brain-computer connectivity demonstrates a form of augmented human computation that could in the future extend the sensing range of human vision and provide new approaches to the study of the neurophysics of human perception. As an example, we illustrate a simple experiment whereby image reconstruction quality is affected by simultaneous conscious processing and readout of the perceived light intensities.


title: Harrison center and products of sums of powers

abstract: This paper is mainly concerned with identities like \[ (x_1^d + x_2^d + \cdots + x_r^d) (y_1^d + y_2^d + \cdots y_n^d) = z_1^d + z_2^d + \cdots + z_n^d \] where $d>2,$ $x=(x_1, x_2, \dots, x_r)$ and $y=(y_1, y_2, \dots, y_n)$ are systems of indeterminates and each $z_k$ is a linear form in $y$ with coefficients in the rational function field $\k (x)$ over any field $\k$ of characteristic $0$ or greater than $d.$ These identities are higher degree analogue of the well-known composition formulas of sums of squares of Hurwitz, Radon and Pfister. We show that such composition identities of sums of powers of degree at least $3$ are trivial, i.e., if $d>2,$ then $r=1.$ Our proof is simple and elementary, in which the crux is Harrison's center theory of homogeneous polynomials.


title: Research on Self-adaptive Online Vehicle Velocity Prediction Strategy Considering Traffic Information Fusion

abstract: In order to increase the prediction accuracy of the online vehicle velocity prediction (VVP) strategy, a self-adaptive velocity prediction algorithm fused with traffic information was presented for the multiple scenarios. Initially, traffic scenarios were established inside the co-simulation environment. In addition, the algorithm of a general regressive neural network (GRNN) paired with datasets of the ego-vehicle, the front vehicle, and traffic lights was used in traffic scenarios, which increasingly improved the prediction accuracy. To ameliorate the robustness of the algorithm, then the strategy was optimized by particle swarm optimization (PSO) and k-fold cross-validation to find the optimal parameters of the neural network in real-time, which constructed a self-adaptive online PSO-GRNN VVP strategy with multi-information fusion to adapt with different operating situations. The self-adaptive online PSO-GRNN VVP strategy was then deployed to a variety of simulated scenarios to test its efficacy under various operating situations. Finally, the simulation results reveal that in urban and highway scenarios, the prediction accuracy is separately increased by 27.8% and 54.5% when compared to the traditional GRNN VVP strategy with fixed parameters utilizing only the historical ego-vehicle velocity dataset.


title: TAN Without a Burn: Scaling Laws of DP-SGD

abstract: Differentially Private methods for training Deep Neural Networks (DNNs) have progressed recently, in particular with the use of massive batches and aggregated data augmentations for a large number of training steps. These techniques require much more computing resources than their non-private counterparts, shifting the traditional privacy-accuracy trade-off to a privacy-accuracy-compute trade-off and making hyper-parameter search virtually impossible for realistic scenarios. In this work, we decouple privacy analysis and experimental behavior of noisy training to explore the trade-off with minimal computational requirements. We first use the tools of R\'enyi Differential Privacy (RDP) to highlight that the privacy budget, when not overcharged, only depends on the total amount of noise (TAN) injected throughout training. We then derive scaling laws for training models with DP-SGD to optimize hyper-parameters with more than a $100\times$ reduction in computational budget. We apply the proposed method on CIFAR-10 and ImageNet and, in particular, strongly improve the state-of-the-art on ImageNet with a +9 points gain in top-1 accuracy for a privacy budget epsilon=8.


title: Quantifying Political Bias in News Articles

abstract: Search bias analysis is getting more attention in recent years since search results could affect In this work, we aim to establish an automated model for evaluating ideological bias in online news articles. The dataset is composed of news articles in search results as well as the newspaper articles. The current automated model results show that model capability is not sufficient to be exploited for annotating the documents automatically, thereby computing bias in search results.


title: PARAGEN : A Parallel Generation Toolkit

abstract: PARAGEN is a PyTorch-based NLP toolkit for further development on parallel generation. PARAGEN provides thirteen types of customizable plugins, helping users to experiment quickly with novel ideas across model architectures, optimization, and learning strategies. We implement various features, such as unlimited data loading and automatic model selection, to enhance its industrial usage. ParaGen is now deployed to support various research and industry applications at ByteDance. PARAGEN is available at https://github.com/bytedance/ParaGen.


title: An arithmetic valuative criterion for proper maps of tame algebraic stacks

abstract: The valuative criterion for proper maps of schemes has many applications in arithmetic, e.g. specializing $\mathbb{Q}_{p}$-points to $\mathbb{F}_{p}$-points. For algebraic stacks, the usual valuative criterion for proper maps is ill-suited for these kind of arguments, since it only gives a specialization point defined over an extension of the residue field, e.g. a $\mathbb{Q}_{p}$-point will specialize to an $\mathbb{F}_{p^{n}}$-point for some $n$. We give a new valuative criterion for proper maps of tame stacks which solves this problem and is well-suited for arithmetic applications. As a consequence, we prove that the Lang-Nishimura theorem holds for tame stacks.


title: Une introduction aux p\'eriodes

abstract: This survey article is the outgrowth of two talks given at the Journ\'ees X-UPS "P\'eriodes et transcendance" at \'Ecole polytechnique. Periods are complex numbers whose real and imaginary parts can be written as integrals of rational functions over domains defined by polynomial inequalities, everything with rational coefficients. According to a conjecture by Kontsevich-Zagier, every algebraic relation among these numbers should follow from the obvious rules of calculus: additivity, change of variables, Stokes's formula. I first explain the definition of periods and some ensuing elementary properties, by illustrating them with a host of examples. Then I gently move to the interpretation of these numbers as entries of the integration pairing between algebraic de Rham cohomology and singular homology of algebraic varieties defined over $\mathbf{Q}$, the point of view which is at the origin of all recent breakthroughs in their study.


title: Steiner representations of hypersurfaces

abstract: Let $X\subseteq{\mathbb P}^{n+1}$ be an integral hypersurface of degree $d$. We show that each locally Cohen-Macaulay instanton sheaf $\mathcal E$ on $X$ with respect to $\mathcal O_X\otimes\mathcal O_{\mathbb P^{n+1}}(1)$ in the sense of Definition 1.3 in arXiv:2205.04767 [math.AG] yields the existence of Steiner bundles $\mathcal G$ and $\mathcal F$ on $\mathbb P^{n+1}$ of the same rank $r$ and a morphism $\varphi\colon \mathcal G(-1)\to\mathcal F^\vee$ such that the form defining $X$ to the power $\mathrm{rk}(\mathcal E)$ is exactly $\det(\varphi)$. We inspect several examples for low values of $d$, $n$ and $\mathrm{rk}(\mathcal E)$. In particular, we show that the form defining a smooth integral surface in $\mathbb P^3$ is the pfaffian of some skew-symmetric morphism $\varphi\colon \mathcal F(-1)\to\mathcal F^\vee$, where $\mathcal F$ is a suitable Steiner bundle on $\mathbb P^3$ of sufficiently large even rank.


title: The dipole formalism for massive initial-state particles and its application to dark matter calculations

abstract: The dark matter abundance plays a crucial role in the determination of the valid parameter space of models both in the case of a discovery of dark matter and in the context of exclusion limits. Reliable theoretical predictions of the dark matter relic density require technically demanding precision calculations, which were so far limited in their automation due to challenges in the treatment of infrared divergences appearing in higher order calculations. In particular, massive initial states need to be considered in early Universe computations, so that the known dipole subtraction methods could not be directly exploited. We therefore provide a full generalization of the dipole subtraction method by Catani and Seymour to supersymmetric (SUSY) QCD with massive initial states. All dipole splitting functions and their integrated counterparts are given explicitly for four different dimensional schemes. To showcase their application, we apply our results to dark matter (co)annihilation processes in the context of the minimal supersymmetric Standard Model. We also demonstrate the accuracy of the dipole method by comparing our numerical results with those obtained with the phase space slicing method. Our analytical results will facilitate future automation of dark matter abundance calculations at next-to-leading order for both SUSY and non-SUSY models.


title: The Power of Small Coalitions under Two-Tier Majority on Regular Graphs

abstract: In this paper, we study the following problem. Consider a setting where a proposal is offered to the vertices of a given network $G$, and the vertices must conduct a vote and decide whether to accept the proposal or reject it. Each vertex $v$ has its own valuation of the proposal; we say that $v$ is ``happy'' if its valuation is positive (i.e., it expects to gain from adopting the proposal) and ``sad'' if its valuation is negative. However, vertices do not base their vote merely on their own valuation. Rather, a vertex $v$ is a \emph{proponent} of the proposal if the majority of its neighbors are happy with it and an \emph{opponent} in the opposite case. At the end of the vote, the network collectively accepts the proposal whenever the majority of its vertices are proponents. We study this problem for regular graphs with loops. Specifically, we consider the class $\mathcal{G}_{n|d|h}$ of $d$-regular graphs of odd order $n$ with all $n$ loops and $h$ happy vertices. We are interested in establishing necessary and sufficient conditions for the class $\mathcal{G}_{n|d|h}$ to contain a labeled graph accepting the proposal, as well as conditions to contain a graph rejecting the proposal. We also discuss connections to the existing literature, including that on majority domination, and investigate the properties of the obtained conditions.


title: Reusability Report: Comparing gradient descent and monte carlo tree search optimization of quantum annealing schedules

abstract: We provide a reusability report of the method presented by Chen et al. in "Optimizing quantum annealing schedules with Monte Carlo tree search enhanced with neural networks" and add further benchmarks on Max-Cut problems.


title: The Trajectory PHD Filter for Coexisting Point and Extended Target Tracking

abstract: This paper develops a general trajectory probability hypothesis density (TPHD) filter, which uses a general density for target-generated measurements and is able to estimate trajectories of coexisting point and extended targets. First, we provide a derivation of this general TPHD filter based on finding the best Poisson posterior approximation by minimizing the Kullback-Leibler divergence, without using probability generating functionals. Second, we adopt an efficient implementation of this filter, where Gaussian densities correspond to point targets and Gamma Gaussian Inverse Wishart densities for extended targets. The L-scan approximation is also proposed as a simplified version to mitigate the huge computational cost. Simulation and experimental results show that the proposed filter is able to classify targets correctly and obtain accurate trajectory estimation.


title: Removing Qualified Names in Modular Languages

abstract: Although the notion of qualified names is popular in module systems, it causes severe complications. In this paper, we propose an alternative to qualified names. The key idea is to import the declarations in other modules to the current module before they are used. In this way, all the declarations can be accessed locally. However, this approach is not efficient in memory usage. Our contribution is the {\it module weakening} scheme which allows us to import the minimal parts. As an example of this approach, we propose a module system for functional languages.


title: Partial-rogue waves that come from nowhere but leave with a trace in the Sasa-Satsuma equation

abstract: Partial-rogue waves, i.e., waves that ``come from nowhere but leave with a trace", are analytically predicted and numerically confirmed in the Sasa-Satsuma equation. We show that, among a class of rational solutions in this equation that can be expressed through determinants of 3-reduced Schur polynomials, partial-rogue waves would arise if these rational solutions are of certain orders, where the associated generalized Okamoto polynomials have real but not imaginary roots, or imaginary but not real roots. We further show that, at large negative time, these partial-rogue waves approach the constant-amplitude background, but at large positive time, they split into several fundamental rational solitons, whose numbers are determined by the number of real or imaginary roots in the underlying generalized Okamoto polynomial. Our asymptotic predictions are compared to true solutions, and excellent agreement is observed.


title: Defects in Halide Perovskites: Does It Help to Switch from 3D to 2D?

abstract: Ruddlesden-Popper hybrid iodide 2D perovskites are put forward as stable alternatives to their 3D counterparts. Using first-principles calculations, we demonstrate that equilibrium concentrations of point defects in the 2D perovskites PEA$_2$PbI$_4$, BA$_2$PbI$_4$, and PEA$_2$SnI$_4$ (PEA: phenethyl ammonium, BA: butylammonium), are much lower than in comparable 3D perovskites. Bonding disruptions by defects are more detrimental in 2D than in 3D networks, making defect formation energetically more costly. The stability of 2D Sn iodide perovskites can be further enhanced by alloying with Pb. Should, however, point defects emerge in sizable concentrations as a result of nonequilibrium growth conditions, for instance, then those defects hamper the optoelectronic performance of the 2D perovskites, as they introduce deep traps. We suggest that trap levels are responsible for the broad sub-bandgap emission in 2D perovskites observed in experiments.


title: Detailed Annotations of Chest X-Rays via CT Projection for Report Understanding

abstract: In clinical radiology reports, doctors capture important information about the patient's health status. They convey their observations from raw medical imaging data about the inner structures of a patient. As such, formulating reports requires medical experts to possess wide-ranging knowledge about anatomical regions with their normal, healthy appearance as well as the ability to recognize abnormalities. This explicit grasp on both the patient's anatomy and their appearance is missing in current medical image-processing systems as annotations are especially difficult to gather. This renders the models to be narrow experts e.g. for identifying specific diseases. In this work, we recover this missing link by adding human anatomy into the mix and enable the association of content in medical reports to their occurrence in associated imagery (medical phrase grounding). To exploit anatomical structures in this scenario, we present a sophisticated automatic pipeline to gather and integrate human bodily structures from computed tomography datasets, which we incorporate in our PAXRay: A Projected dataset for the segmentation of Anatomical structures in X-Ray data. Our evaluation shows that methods that take advantage of anatomical information benefit heavily in visually grounding radiologists' findings, as our anatomical segmentations allow for up to absolute 50% better grounding results on the OpenI dataset as compared to commonly used region proposals. The PAXRay dataset is available at https://constantinseibold.github.io/paxray/.


title: A Simple Plugin for Transforming Images to Arbitrary Scales

abstract: Existing models on super-resolution often specialized for one scale, fundamentally limiting their use in practical scenarios. In this paper, we aim to develop a general plugin that can be inserted into existing super-resolution models, conveniently augmenting their ability towards Arbitrary Resolution Image Scaling, thus termed ARIS. We make the following contributions: (i) we propose a transformer-based plugin module, which uses spatial coordinates as query, iteratively attend the low-resolution image feature through cross-attention, and output visual feature for the queried spatial location, resembling an implicit representation for images; (ii) we introduce a novel self-supervised training scheme, that exploits consistency constraints to effectively augment the model's ability for upsampling images towards unseen scales, i.e. ground-truth high-resolution images are not available; (iii) without loss of generality, we inject the proposed ARIS plugin module into several existing models, namely, IPT, SwinIR, and HAT, showing that the resulting models can not only maintain their original performance on fixed scale factor but also extrapolate to unseen scales, substantially outperforming existing any-scale super-resolution models on standard benchmarks, e.g. Urban100, DIV2K, etc.


title: Data-driven probability density forecast for stochastic dynamical systems

abstract: In this paper, a data-driven nonparametric approach is presented for forecasting the probability density evolution of stochastic dynamical systems. The method is based on stochastic Koopman operator and extended dynamic mode decomposition (EDMD). To approximate the finite-dimensional eigendecomposition of the stochastic Koopman operator, EDMD is applied to the training data set sampled from the stationary distribution of the underlying stochastic dynamical system. The family of the Koopman operators form a semigroup, which is generated by the infinitesimal generator of the stochastic dynamical system. A significant connection between the generator and Fokker-Planck operator provides a way to construct an orthonormal basis of a weighted Hilbert space. A spectral decomposition of the probability density function is accomplished in this weighted space. This approach is a data-driven method and used to predict the probability density evolution and real-time moment estimation. In the limit of the large number of snapshots and observables, the data-driven probability density approximation converges to the Galerkin projection of the semigroup solution of Fokker-Planck equation on a basis adapted to an invariant measure. The proposed method shares the similar idea to diffusion forecast, but renders more accurate probability density than the diffusion forecast does. A few numerical examples are presented to illustrate the performance of the data-driven probability density forecast.


title: Event Extraction: A Survey

abstract: Extracting the reported events from text is one of the key research themes in natural language processing. This process includes several tasks such as event detection, argument extraction, role labeling. As one of the most important topics in natural language processing and natural language understanding, the applications of event extraction spans across a wide range of domains such as newswire, biomedical domain, history and humanity, and cyber security. This report presents a comprehensive survey for event detection from textual documents. In this report, we provide the task definition, the evaluation method, as well as the benchmark datasets and a taxonomy of methodologies for event extraction. We also present our vision of future research direction in event detection.


title: Anisotropic magnetic properties and tunable conductivity in two-dimensional layered NaCrX2 (X=Te,Se,S) single crystals

abstract: Monolayer NaCrX2 (X=Te,Se,S) were theoretically proposed to be two-dimensional intrinsic ferromagnetic semiconductors while their physical properties have not been thoroughly investigated in bulk single crystals. We report the single-crystal growth, structural, magnetic and electronic transport properties of NaCr(Te1-xSex)2 (0 6 x 6 1) and NaCrS2. For NaCr(Te1-xSex)2, the strong perpendicular magnetic anisotropy of NaCrTe2 can be gradually tuned to be a nearly isotropic one by Se-doping. Meanwhile, a systematic change in the conductivity with increasing x is observed, displaying a doping-induced metal-insulator-like transition. Under magnetic field larger than 30 koe, both NaCrTe2 and NaCrSe2 can be polarized to a ferromagnetic state. While for NaCrS2, robust antiferromagnetism is observed up to 70 kOe and two field-induced metamagnetic transitions are identified along H||ab. These intriguing properties together with the potential to be exfoliated down to few-layer thickness make NaCrX2 (X=Te,Se,S) promising for exploring spintronic applications.

categories: cond-mat.mtrl-sci cond-mat.mes-hall cond-mat.str-el cond-mat.supr-con


title: Semi-quantum private comparison and its generalization to the key agreement, summation, and anonymous ranking

abstract: Semi-quantum protocols construct connections between quantum users and ``classical'' users who can only perform certain ``classical'' operations. In this paper, we present a new semi-quantum private comparison protocol based on entangled states and single particles, which does not require pre-shared keys between the ``classical'' users to guarantee the security of their private data. By utilizing multi-particle entangled states and single particles, our protocol can be easily extended to multi-party scenarios to meet the requirements of multiple ``classical'' users who want to compare their private data. The security analysis shows that the protocol can effectively prevent attacks from outside eavesdroppers and adversarial participants. Besides, we generalize the proposed protocol to other semi-quantum protocols such as semi-quantum key agreement, semi-quantum summation, and semi-quantum anonymous ranking protocols. We compare and discuss the proposed protocols with previous similar protocols. The results show that our protocols satisfy the demands of their respective counterparts separately. Therefore, our protocols have a wide range of application scenarios.


title: SpaceQA: Answering Questions about the Design of Space Missions and Space Craft Concepts

abstract: We present SpaceQA, to the best of our knowledge the first open-domain QA system in Space mission design. SpaceQA is part of an initiative by the European Space Agency (ESA) to facilitate the access, sharing and reuse of information about Space mission design within the agency and with the public. We adopt a state-of-the-art architecture consisting of a dense retriever and a neural reader and opt for an approach based on transfer learning rather than fine-tuning due to the lack of domain-specific annotated data. Our evaluation on a test set produced by ESA is largely consistent with the results originally reported by the evaluated retrievers and confirms the need of fine tuning for reading comprehension. As of writing this paper, ESA is piloting SpaceQA internally.


title: When is Spring coming? A Security Analysis of Avalanche Consensus

abstract: Avalanche is a blockchain consensus protocol with exceptionally low latency and high throughput. This has swiftly established the corresponding token as a top-tier cryptocurrency. Avalanche achieves such remarkable metrics by substituting proof of work with a random sampling mechanism. The protocol also differs from Bitcoin, Ethereum, and many others by forming a directed acyclic graph (DAG) instead of a chain. It does not totally order all transactions, establishes a partial order among them, and accepts transactions in the DAG that satisfy specific properties. Such parallelism is widely regarded as a technique that increases the efficiency of consensus. Despite its success, Avalanche consensus lacks a complete abstract specification and a matching formal analysis. To address this drawback, this work provides first a detailed formulation of Avalanche through pseudocode. This includes features that are omitted from the original whitepaper or are only vaguely explained in the documentation. Second, the paper gives an analysis of the formal properties fulfilled by Avalanche in the sense of a generic broadcast protocol that only orders related transactions. Last but not least, the analysis reveals a vulnerability that affects the liveness of the protocol. A possible solution that addresses the problem is also proposed.


title: Kalman-Bucy-Informed Neural Network for System Identification

abstract: Identifying parameters in a system of nonlinear, ordinary differential equations is vital for designing a robust controller. However, if the system is stochastic in its nature or if only noisy measurements are available, standard optimization algorithms for system identification usually fail. We present a new approach that combines the recent advances in physics-informed neural networks and the well-known achievements of Kalman filters in order to find parameters in a continuous-time system with noisy measurements. In doing so, our approach allows estimating the parameters together with the mean value and covariance matrix of the system's state vector. We show that the method works for complex systems by identifying the parameters of a double pendulum.


title: Risk-averse optimal control of random elliptic variational inequalities

abstract: We consider a risk-averse optimal control problem governed by an elliptic variational inequality (VI) subject to random inputs. By deriving KKT-type optimality conditions for a penalised and smoothed problem and studying convergence of the stationary points with respect to the penalisation parameter, we obtain two forms of stationarity conditions. The lack of regularity with respect to the uncertain parameters and complexities induced by the presence of the risk measure give rise to new challenges unique to the stochastic setting. We also propose a path-following stochastic approximation algorithm using variance reduction techniques and demonstrate the algorithm on a modified benchmark problem.


title: Certified machine learning: Rigorous a posteriori error bounds for PDE defined PINNs

abstract: Prediction error quantification in machine learning has been left out of most methodological investigations of neural networks, for both purely data-driven and physics-informed approaches. Beyond statistical investigations and generic results on the approximation capabilities of neural networks, we present a rigorous upper bound on the prediction error of physics-informed neural networks. This bound can be calculated without the knowledge of the true solution and only with a priori available information about the characteristics of the underlying dynamical system governed by a partial differential equation. We apply this a posteriori error bound exemplarily to four problems: the transport equation, the heat equation, the Navier-Stokes equation and the Klein-Gordon equation.


title: Generating Quizzes to Support Training on Quality Management and Assurance in Space Science and Engineering

abstract: Quality management and assurance is key for space agencies to guarantee the success of space missions, which are high-risk and extremely costly. In this paper, we present a system to generate quizzes, a common resource to evaluate the effectiveness of training sessions, from documents about quality assurance procedures in the Space domain. Our system leverages state of the art auto-regressive models like T5 and BART to generate questions, and a RoBERTa model to extract answers for such questions, thus verifying their suitability.


title: Missing Modality meets Meta Sampling (M3S): An Efficient Universal Approach for Multimodal Sentiment Analysis with Missing Modality

abstract: Multimodal sentiment analysis (MSA) is an important way of observing mental activities with the help of data captured from multiple modalities. However, due to the recording or transmission error, some modalities may include incomplete data. Most existing works that address missing modalities usually assume a particular modality is completely missing and seldom consider a mixture of missing across multiple modalities. In this paper, we propose a simple yet effective meta-sampling approach for multimodal sentiment analysis with missing modalities, namely Missing Modality-based Meta Sampling (M3S). To be specific, M3S formulates a missing modality sampling strategy into the modal agnostic meta-learning (MAML) framework. M3S can be treated as an efficient add-on training component on existing models and significantly improve their performances on multimodal data with a mixture of missing modalities. We conduct experiments on IEMOCAP, SIMS and CMU-MOSI datasets, and superior performance is achieved compared with recent state-of-the-art methods.


title: Adversarially Robust Prototypical Few-shot Segmentation with Neural-ODEs

abstract: Few-shot Learning (FSL) methods are being adopted in settings where data is not abundantly available. This is especially seen in medical domains where the annotations are expensive to obtain. Deep Neural Networks have been shown to be vulnerable to adversarial attacks. This is even more severe in the case of FSL due to the lack of a large number of training examples. In this paper, we provide a framework to make few-shot segmentation models adversarially robust in the medical domain where such attacks can severely impact the decisions made by clinicians who use them. We propose a novel robust few-shot segmentation framework, Prototypical Neural Ordinary Differential Equation (PNODE), that provides defense against gradient-based adversarial attacks. We show that our framework is more robust compared to traditional adversarial defense mechanisms such as adversarial training. Adversarial training involves increased training time and shows robustness to limited types of attacks depending on the type of adversarial examples seen during training. Our proposed framework generalises well to common adversarial attacks like FGSM, PGD and SMIA while having the model parameters comparable to the existing few-shot segmentation models. We show the effectiveness of our proposed approach on three publicly available multi-organ segmentation datasets in both in-domain and cross-domain settings by attacking the support and query sets without the need for ad-hoc adversarial training.


title: Monitoring MBE substrate deoxidation via RHEED image-sequence analysis by deep learning

abstract: Reflection high-energy electron diffraction (RHEED) is a powerful tool in molecular beam epitaxy (MBE), but RHEED images are often difficult to interpret, requiring experienced operators. We present an approach for automated surveillance of GaAs substrate deoxidation in MBE reactors using deep learning based RHEED image-sequence classification. Our approach consists of an non-supervised auto-encoder (AE) for feature extraction, combined with a supervised convolutional classifier network. We demonstrate that our lightweight network model can accurately identify the exact deoxidation moment. Furthermore we show that the approach is very robust and allows accurate deoxidation detection during months without requiring re-training. The main advantage of the approach is that it can be applied to raw RHEED images without requiring further information such as the rotation angle, temperature, etc.


title: High Resolution Spatio-Temporal Model for Room-Level Airborne Pandemic Spread

abstract: Airborne pandemics have caused millions of deaths worldwide, large-scale economic losses, and catastrophic sociological shifts in human history. Researchers have developed multiple mathematical models and computational frameworks to investigate and predict the pandemic spread on various levels and scales such as countries, cities, large social events, and even buildings. However, modeling attempts of airborne pandemic dynamics on the smallest scale, a single room, have been mostly neglected. As time indoors increases due to global urbanization processes, more infections occur in shared rooms. In this study, a high-resolution spatio-temporal epidemiological model with airflow dynamics to evaluate airborne pandemic spread is proposed. The model is implemented using high-resolution 3D data obtained using a light detection and ranging (LiDAR) device and computing the model based on the Computational Fluid Dynamics (CFD) model for the airflow and the Susceptible-Exposed-Infected (SEI) model for the epidemiological dynamics. The pandemic spread is evaluated in four types of rooms, showing significant differences even for a short exposure duration. We show that the room's topology and individual distribution in the room define the ability of air ventilation to reduce pandemic spread throughout breathing zone infection.


title: Femto-Containers: Lightweight Virtualization and Fault Isolation For Small Software Functions on Low-Power IoT Microcontrollers

abstract: Low-power operating system runtimes used on IoT microcontrollers typically provide rudimentary APIs, basic connectivity and, sometimes, a (secure) firmware update mechanism. In contrast, on less constrained hardware, networked software has entered the age of serverless, microservices and agility. With a view to bridge this gap, in the paper we design Femto-Containers, a new middleware runtime which can be embedded on heterogeneous low-power IoT devices. Femto-Containers enable the secure deployment, execution and isolation of small virtual software functions on low-power IoT devices, over the network. We implement Femto-Containers, and provide integration in RIOT, a popular open source IoT operating system. We then evaluate the performance of our implementation, which was formally verified for fault-isolation, guaranteeing that RIOT is shielded from logic loaded and executed in a Femto-Container. Our experiments on various popular microcontroller architectures (Arm Cortex-M, ESP32 and RISC-V) show that Femto-Containers offer an attractive trade-off in terms of memory footprint overhead, energy consumption, and security


title: PS-ARM: An End-to-End Attention-aware Relation Mixer Network for Person Search

abstract: Person search is a challenging problem with various real-world applications, that aims at joint person detection and re-identification of a query person from uncropped gallery images. Although, the previous study focuses on rich feature information learning, it is still hard to retrieve the query person due to the occurrence of appearance deformations and background distractors. In this paper, we propose a novel attention-aware relation mixer (ARM) module for person search, which exploits the global relation between different local regions within RoI of a person and make it robust against various appearance deformations and occlusion. The proposed ARM is composed of a relation mixer block and a spatio-channel attention layer. The relation mixer block introduces a spatially attended spatial mixing and a channel-wise attended channel mixing for effectively capturing discriminative relation features within an RoI. These discriminative relation features are further enriched by introducing a spatio-channel attention where the foreground and background discriminability is empowered in a joint spatio-channel space. Our ARM module is generic and it does not rely on fine-grained supervision or topological assumptions, hence being easily integrated into any Faster R-CNN based person search methods. Comprehensive experiments are performed on two challenging benchmark datasets: CUHKSYSU and PRW. Our PS-ARM achieves state-of-the-art performance on both datasets. On the challenging PRW dataset, our PS-ARM achieves an absolute gain of 5 in the mAP score over SeqNet, while operating at a comparable speed.


title: Optical Polarimetry of the May 2022 Lunar Eclipse

abstract: The sunlight reflected from the Moon during a total lunar eclipse has been transmitted through the Earth's atmosphere on the way to the Moon. The combination of multiple scattering and inhomogeneous atmospheric characteristics during that transmission can potentially polarize that light. A similar (although much smaller) effect should also be observable from the atmosphere of a transiting exoplanet. We present the results of polarization observations during the first 15 minutes of totality of the lunar eclipse of 2022 May 16. We find degrees of polarization of 2.1 +/- 0.4 per cent in B, 1.2 +/- 0.3 per cent in V, 0.5 +/- 0.2 per cent in R and 0.2 +/- 0.2 per cent in I. Our polarization values lie in the middle of the range of those reported for previous eclipses, providing further evidence that the induced polarization can change from event to event. We found no significant polarization difference (<0.02 per cent) between a region of dark Mare and nearby bright uplands or between the lunar limb and regions closer to the disk centre due to the different angle of incidence. This further strengthens the interpretation of the polarization's origin being due to scattering in the Earth's atmosphere rather than by the lunar regolith.


title: IDPL: Intra-subdomain adaptation adversarial learning segmentation method based on Dynamic Pseudo Labels

abstract: Unsupervised domain adaptation(UDA) has been applied to image semantic segmentation to solve the problem of domain offset. However, in some difficult categories with poor recognition accuracy, the segmentation effects are still not ideal. To this end, in this paper, Intra-subdomain adaptation adversarial learning segmentation method based on Dynamic Pseudo Labels(IDPL) is proposed. The whole process consists of 3 steps: Firstly, the instance-level pseudo label dynamic generation module is proposed, which fuses the class matching information in global classes and local instances, thus adaptively generating the optimal threshold for each class, obtaining high-quality pseudo labels. Secondly, the subdomain classifier module based on instance confidence is constructed, which can dynamically divide the target domain into easy and difficult subdomains according to the relative proportion of easy and difficult instances. Finally, the subdomain adversarial learning module based on self-attention is proposed. It uses multi-head self-attention to confront the easy and difficult subdomains at the class level with the help of generated high-quality pseudo labels, so as to focus on mining the features of difficult categories in the high-entropy region of target domain images, which promotes class-level conditional distribution alignment between the subdomains, improving the segmentation performance of difficult categories. For the difficult categories, the experimental results show that the performance of IDPL is significantly improved compared with other latest mainstream methods.


title: Trans2k: Unlocking the Power of Deep Models for Transparent Object Tracking

abstract: Visual object tracking has focused predominantly on opaque objects, while transparent object tracking received very little attention. Motivated by the uniqueness of transparent objects in that their appearance is directly affected by the background, the first dedicated evaluation dataset has emerged recently. We contribute to this effort by proposing the first transparent object tracking training dataset Trans2k that consists of over 2k sequences with 104,343 images overall, annotated by bounding boxes and segmentation masks. Noting that transparent objects can be realistically rendered by modern renderers, we quantify domain-specific attributes and render the dataset containing visual attributes and tracking situations not covered in the existing object training datasets. We observe a consistent performance boost (up to 16%) across a diverse set of modern tracking architectures when trained using Trans2k, and show insights not previously possible due to the lack of appropriate training sets. The dataset and the rendering engine will be publicly released to unlock the power of modern learning-based trackers and foster new designs in transparent object tracking.


title: KRF: Keypoint Refinement with Fusion Network for 6D Pose Estimation

abstract: Existing refinement methods gradually lose their ability to further improve pose estimation methods' accuracy. In this paper, we propose a new refinement pipeline, Keypoint Refinement with Fusion Network (KRF), for 6D pose estimation, especially for objects with serious occlusion. The pipeline consists of two steps. It first completes the input point clouds via a novel point completion network. The network uses both local and global features, considering the pose information during point completion. Then, it registers the completed object point cloud with corresponding target point cloud by Color supported Iterative KeyPoint (CIKP). The CIKP method introduces color information into registration and registers point cloud around each keypoint to increase stability. The KRF pipeline can be integrated with existing popular 6D pose estimation methods, e.g. the full flow bidirectional fusion network, to further improved their pose estimation accuracy. Experiments show that our method outperforms the state-of-the-art method from 93.9\% to 94.4\% on YCB-Video dataset and from 64.4\% to 66.8\% on Occlusion LineMOD dataset. Our source code is available at https://github.com/zhanhz/KRF.


title: Analytic pseudo-rotations

abstract: We construct analytic symplectomorphisms of the cylinder or the sphere with zero or exactly two periodic points and which are not conjugated to a rotation. In the case of the cylinder, we show that these symplectomorphisms can be chosen ergodic or to the contrary with local emergence of maximal order. In particular, this disproves a conjecture of Birkhoff (1941) and solve a problem of Herman (1998). One aspect of the proof provides a new approximation theorem, it enables in particular to implement the Anosov-Katok scheme in new analytic settings.


title: Computing the Minimum-Time Interception of a Moving Target

abstract: In this study, we propose an algorithmic framework for solving a class of optimal control problems. This class is associated with the minimum-time interception of moving target problems, where a plant with a given state equation must approach a moving target whose trajectory is known a priori. Our framework employs an analytical description of the distance from an arbitrary point to the reachable set of the plant. The proposed algorithm is always convergent and cannot be improved without losing the guarantee of its convergence to the correct solution for arbitrary Lipschitz continuous trajectories of the moving target. In practice, it is difficult to obtain an analytical description of the distance to the reachable set for the sophisticated state equation of the plant. Nevertheless, it was shown that the distance can be obtained for some widely used models, such as the Dubins car, in an explicit form. Finally, we illustrate the generality and effectiveness of the proposed framework for simple motions and the Dubins model.


title: Learning for Perturbation-Based Fiber Nonlinearity Compensation

abstract: Several machine learning inspired methods for perturbation-based fiber nonlinearity (PBNLC) compensation have been presented in recent literature. We critically revisit acclaimed benefits of those over non-learned methods. Numerical results suggest that learned linear processing of perturbation triplets of PB-NLC is preferable over feedforward neural-network solutions.


title: Decentralized Vision-Based Byzantine Agent Detection in Multi-Robot Systems with IOTA Smart Contracts

abstract: Multiple opportunities lie at the intersection of multi-robot systems and distributed ledger technologies (DLTs). In this work, we investigate the potential of new DLT solutions such as IOTA, for detecting anomalies and byzantine agents in multi-robot systems in a decentralized manner. Traditional blockchain approaches are not applicable to real-world networked and decentralized robotic systems where connectivity conditions are not ideal. To address this, we leverage recent advances in partition-tolerant and byzantine-tolerant collaborative decision-making processes with IOTA smart contracts. We show how our work in vision-based anomaly and change detection can be applied to detecting byzantine agents within multiple robots operating in the same environment. We show that IOTA smart contracts add a low computational overhead while allowing to build trust within the multi-robot system. The proposed approach effectively enables byzantine robot detection based on the comparison of images submitted by the different robots and detection of anomalies and changes between them.


title: Contact Optimization for Non-Prehensile Loco-Manipulation via Hierarchical Model Predictive Control

abstract: Recent studies on quadruped robots have focused on either locomotion or mobile manipulation using a robotic arm. Legged robots can manipulate heavier and larger objects using non-prehensile manipulation primitives, such as planar pushing, to drive the object to the desired location. In this paper, we present a novel hierarchical model predictive control (MPC) for contact optimization of the manipulation task. Using two cascading MPCs, we split the loco-manipulation problem into two parts: the first to optimize both contact force and contact location between the robot and the object, and the second to regulate the desired interaction force through the robot locomotion. Our method is successfully validated in both simulation and hardware experiments. While the baseline locomotion MPC fails to follow the desired trajectory of the object, our proposed approach can effectively control both object's position and orientation with minimal tracking error. This capability also allows us to perform obstacle avoidance for both the robot and the object during the loco-manipulation task.


title: Modified Hawking temperatures of black holes in Lorentz violation theory

abstract: In this paper, the tunneling of scalar particles near the event horizons of Riemann space time, BTZ black hole and Schwarzschild-de Sitter black hole are investigated by applying Hamilton-Jacobi equation with Lorentz violation theory in curved space time. The modified Hamilton-Jacobi equation is derived from Klein-Gordon equation of scalar particles induced by Lorentz violation theory in curved space time. The Hawking temperatures of Riemann space time and the BTZ black hole are modified due to the effect of Lorentz violation theory. Moreover, the Bekenstein-Hawking entropy near the event horizon of Schwarzschild-de Sitter black hole is also modified due to Lorentz violation theory. It is observed that the modified values of Hawking temperatures and change in Bekenstein-Hawking entropy depend upon the ether-like vectors $u^\alpha$.


title: Depersonalized Federated Learning: Tackling Statistical Heterogeneity by Alternating Stochastic Gradient Descent

abstract: Federated learning (FL), which has gained increasing attention recently, enables distributed devices to train a common machine learning (ML) model for intelligent inference cooperatively without data sharing. However, problems in practical networks, such as non-independent-and-identically-distributed (non-iid) raw data and limited bandwidth, give rise to slow and unstable convergence of the FL training process. To address these issues, we propose a new FL method that can significantly mitigate statistical heterogeneity through the depersonalization mechanism. Particularly, we decouple the global and local optimization objectives by alternating stochastic gradient descent, thus reducing the accumulated variance in local update phases to accelerate the FL convergence. Then we analyze the proposed method detailedly to show the proposed method converging at a sublinear speed in the general non-convex setting. Finally, numerical results are conducted with experiments on public datasets to verify the effectiveness of our proposed method.


title: Experimental and observational tests of antigravity

abstract: Whereas repulsive gravity was considered as a fringe concept until the mid-1990's, the growingexperimental evidence since this epoch for repulsive gravity, in what is now called Dark Energy,for lack of a better understanding of its nature, has led to a vast literature in order to attemptto characterize this repulsive component, and notably its equation of state. In the following, Iwill show that we can use cosmology to test the hypothesis that antimatter is at the origin ofrepulsive gravity, may play the role of a Dark Energy component and, more surprisingly, maymimic the presence of Dark Matter, and justify the MOND phenomenology. More directly,three experiments, AEgIS, ALPHA-g and Gbar, are attempting to measure the action ofgravitation on cold atoms of antihydrogen at CERN in a near future. Finally, I note thatCP violation might be explained by antigravity and I briefly recall the motivations for thisassertion.


title: Low-latency adiabatic quantum-flux-parametron circuit integrated with a hybrid serializer/deserializer

abstract: Adiabatic quantum-flux-parametron (AQFP) logic is an ultra-low-power superconductor logic family. AQFP logic gates are powered and clocked by dedicated clocking schemes using ac excitation currents to implement an energy-efficient switching process, adiabatic switching. We have proposed a low-latency clocking scheme, delay-line clocking, and demonstrated basic AQFP logic gates. In order to test more complex circuits, a serializer/deserializer (SerDes) should be incorporated into the AQFP circuit under test, since the number of input/output (I/O) cables is limited by equipment. Therefore, in the present study we propose and develop a novel SerDes for testing delay-line-clocked AQFP circuits by combining AQFP and rapid single-flux-quantum (RSFQ) logic families, which we refer to as the AQFP/RSFQ hybrid SerDes. The hybrid SerDes comprises RSFQ shift registers to facilitate the data storage during serial-to-parallel and parallel-to-serial conversion. Furthermore, all the component circuits in the hybrid SerDes are clocked by the identical excitation current to synchronize the AQFP and RSFQ parts. We fabricate and demonstrate a delay-line-clocked AQFP circuit (8-to-3 encoder, which is the largest delay-line-clocked circuit ever designed) integrated with the hybrid SerDes at 4.2 K up to 4.5 GHz. Our measurement results indicate that the hybrid SerDes enables the testing of delay-line-clocked AQFP circuits with only a few I/O cables and is thus a powerful tool for the development of very large-scale integration AQFP circuits.


title: The Infinity-Potential in the Square

abstract: A representation formula for the solution of the $\infty$-Laplace equation is constructed in a punctured square, the prescribed boundary values being $u=0$ on the sides and $u=1$ at the centre. This so-called $\infty$-potential is obtained with a hodograph method. The heat equation is used and one of Jacobi's Theta functions appears. The formula disproves a conjecture.


title: Quasi-classical Ground States. II. Standard Model of Non-relativistic QED

abstract: We consider a non-relativistic electron bound by an external potential and coupled to the quantized electromagnetic field in the standard model of non-relativistic QED. We compute the energy functional of product states of the form $u\otimes \Psi_f$, where $u$ is a normalized state for the electron and $\Psi_f$ is a coherent state in Fock space for the photon field. The minimization of this functional yields a Maxwell--Schr{\"o}dinger system up to a trivial renormalization. We prove the existence of a ground state under general conditions on the external potential and the coupling. In particular, neither an ultraviolet cutoff nor an infrared cutoff needs to be imposed. Our results provide the convergence in the ultraviolet limit and the second-order asymptotic expansion in the coupling constant of the ground state energy of Maxwell--Schr\"odinger systems.


title: Group-covariant extreme and quasi-extreme channels

abstract: Constructing all extreme instances of the set of completely positive trace-preserving (CPTP) maps, i.e., quantum channels, is a challenging valuable open problem in quantum information theory. Here we introduce a systematic approach that enables us to construct exactly those extreme channels that are covariant with respect to a finite discrete group or a compact connected Lie group. Innovative labeling of quantum channels by group representations enables us to identify the subset of group-covariant channels whose elements are group-covariant generalized-extreme channels. Furthermore, we exploit essentials of group representation theory to introduce equivalence classes for the labels and also partition the set of group-covariant channels. As a result we show that it is enough to construct one representative of each partition. We construct Kraus operators for group-covariant generalized-extreme channels by solving systems of linear and quadratic equations for all candidates satisfying the necessary condition for being group-covariant generalized-extreme channels. Deciding whether these constructed instances are extreme or quasi-extreme is accomplished by solving system of linear equations. We formalize the problem of constructing and classifying group-covariant generalized extreme channels, thereby yielding an algorithmic approach to solving, which we express as pseudocode. To illustrate the application and value of our method, we solve for explicit examples of group-covariant extreme channels. With unbounded computational resources to execute our algorithm, our method always delivers a description of an extreme channel for any finite-dimensional Hilbert-space and furthermore guarantees a description of a group-covariant extreme channel for any dimension and for any finite-discrete or compact connected Lie group if such an extreme channel exists.


title: Total stability and integral action for discrete-time nonlinear systems

abstract: Robustness guarantees are important properties to be looked for during control design. They ensure stability of closed-loop systems in face of uncertainties, unmodeled effects and bounded disturbances. While the theory on robust stability is well established in the continuous-time nonlinear framework, the same cannot be stated for its discrete-time counterpart. In this paper, we propose the discrete-time parallel of total stability results for continuous-time nonlinear system. This enables the analysis of robustness properties via simple model difference in the discrete-time context. First, we study how existence of equilibria for a nominal model transfers to sufficiently similar ones. Then, we provide results on the


title: H\"older Regularity for Domains of Fractional Powers of Elliptic Operators with Mixed Boundary Conditions

abstract: This work is about global H\"older regularity for solutions to elliptic partial differential equations subject to mixed boundary conditions on irregular domains. There are two main results. In the first, we show that if the domain of the realization of an elliptic differential operator in a negative Sobolev space with integrability $q > d$ embeds into a space of H\"older continuous functions, then so do the domains of suitable fractional powers of this operator. The second main result then establishes that the premise of the first is indeed satisfied. The proof goes along the classical techniques of localization, transformation and reflection which allows to fall back to the classical results of Ladyzhenskaya or Kinderlehrer. One of the main features of our approach is that we do not require Lipschitz charts for the Dirichlet boundary part, but only an intriguing metric/measure-theoretic condition on the interface of Dirichlet- and Neumann boundary parts. A similar condition was posed in a related work by ter Elst and Rehberg in 2015, but the present proof is much simpler, if only restricted to space dimension up to 4.


title: Coulomb-mediated antibunching of an electron pair surfing on sound

abstract: Electron flying qubits are envisioned as potential information link within a quantum computer, but also promise -- alike photonic approaches -- a self-standing quantum processing unit. In contrast to its photonic counterpart, electron-quantum-optics implementations are subject to Coulomb interaction, which provide a direct route to entangle the orbital or spin degree of freedom. However, the controlled interaction of flying electrons at the single particle level has not yet been established experimentally. Here we report antibunching of a pair of single electrons that is synchronously shuttled through a circuit of coupled quantum rails by means of a surface acoustic wave. The in-flight partitioning process exhibits a reciprocal gating effect which allows us to ascribe the observed repulsion predominantly to Coulomb interaction. Our single-shot experiment marks an important milestone on the route to realise a controlled-phase gate for in-flight quantum manipulations.


title: Key Information Extraction in Purchase Documents using Deep Learning and Rule-based Corrections

abstract: Deep Learning (DL) is dominating the fields of Natural Language Processing (NLP) and Computer Vision (CV) in the recent times. However, DL commonly relies on the availability of large data annotations, so other alternative or complementary pattern-based techniques can help to improve results. In this paper, we build upon Key Information Extraction (KIE) in purchase documents using both DL and rule-based corrections. Our system initially trusts on Optical Character Recognition (OCR) and text understanding based on entity tagging to identify purchase facts of interest (e.g., product codes, descriptions, quantities, or prices). These facts are then linked to a same product group, which is recognized by means of line detection and some grouping heuristics. Once these DL approaches are processed, we contribute several mechanisms consisting of rule-based corrections for improving the baseline DL predictions. We prove the enhancements provided by these rule-based corrections over the baseline DL results in the presented experiments for purchase documents from public and NielsenIQ datasets.


title: DABERT: Dual Attention Enhanced BERT for Semantic Matching

abstract: Transformer-based pre-trained language models such as BERT have achieved remarkable results in Semantic Sentence Matching. However, existing models still suffer from insufficient ability to capture subtle differences. Minor noise like word addition, deletion, and modification of sentences may cause flipped predictions. To alleviate this problem, we propose a novel Dual Attention Enhanced BERT (DABERT) to enhance the ability of BERT to capture fine-grained differences in sentence pairs. DABERT comprises (1) Dual Attention module, which measures soft word matches by introducing a new dual channel alignment mechanism to model affinity and difference attention. (2) Adaptive Fusion module, this module uses attention to learn the aggregation of difference and affinity features, and generates a vector describing the matching details of sentence pairs. We conduct extensive experiments on well-studied semantic matching and robustness test datasets, and the experimental results show the effectiveness of our proposed method.


title: Advice Conformance Verification by Reinforcement Learning agents for Human-in-the-Loop

abstract: Human-in-the-loop (HiL) reinforcement learning is gaining traction in domains with large action and state spaces, and sparse rewards by allowing the agent to take advice from HiL. Beyond advice accommodation, a sequential decision-making agent must be able to express the extent to which it was able to utilize the human advice. Subsequently, the agent should provide a means for the HiL to inspect parts of advice that it had to reject in favor of the overall environment objective. We introduce the problem of Advice-Conformance Verification which requires reinforcement learning (RL) agents to provide assurances to the human in the loop regarding how much of their advice is being conformed to. We then propose a Tree-based lingua-franca to support this communication, called a Preference Tree. We study two cases of good and bad advice scenarios in MuJoCo's Humanoid environment. Through our experiments, we show that our method can provide an interpretable means of solving the Advice-Conformance Verification problem by conveying whether or not the agent is using the human's advice. Finally, we present a human-user study with 20 participants that validates our method.


title: Okubo algebras with isotropic norm

abstract: Okubo algebras form an important class of nonunital composition algebras of dimension 8. Contrary to what happens for unital composition algebras, they are not determined by their multiplicative norms. Okubo algebras with isotropic norm are characterized here by the existence of a special grading. In the split case, and under some restrictions on the ground field, the automorphism group of the most symmetric of these gradings is the projective unitary group PU(3,4), whose structure is showcased by the grading.


title: Bressoud-Subbarao type weighted partition identities for a generalized divisor function

abstract: In 1984, Bressoud and Subbarao obtained an interesting weighted partition identity for a generalized divisor function, by means of combinatorial arguments. Recently, the last three named authors found an analytic proof of the aforementioned identity of Bressoud and Subbarao starting from a $q$-series identity of Ramanujan. In the present paper, we revisit the combinatorial arguments of Bressoud and Subbarao, and derive a more general weighted partition identity. Furthermore, with the help of a fractional differential operator, we establish a few more Bressoud-Subbarao type weighted partition identities beginning from an identity of Andrews, Garvan and Liang. We also found a one-variable generalization of an identity of Uchimura related to Bell polynomials.


title: PAC Privacy: Automatic Privacy Measurement and Control of Data Processing

abstract: We propose and study a new privacy definition, termed Probably Approximately Correct (PAC) Privacy. PAC Privacy characterizes the information-theoretic hardness to recover sensitive data given arbitrary information disclosure/leakage during/after any processing. Unlike the classic cryptographic definition and Differential Privacy (DP), which consider the adversarial (input-independent) worst case, PAC Privacy is a simulatable metric that quantifies the instance-based impossibility of inference. A fully automatic analysis and proof generation framework is proposed: security parameters can be produced with arbitrarily high confidence via Monte-Carlo simulation for any black-box data processing oracle. This appealing automation property enables analysis of complicated data processing, where the worst-case proof in the classic privacy regime could be loose or even intractable. Moreover, we show that the produced PAC Privacy guarantees enjoy simple composition bounds and the automatic analysis framework can be implemented in an online fashion to analyze the composite PAC Privacy loss even under correlated randomness. On the utility side, the magnitude of (necessary) perturbation required in PAC Privacy is not lower bounded by Theta(\sqrt{d}) for a d-dimensional release but could be O(1) for many practical data processing tasks, which is in contrast to the input-independent worst-case information-theoretic lower bound. Example applications of PAC Privacy are included with comparisons to existing works.


title: Mutual Learning of Single- and Multi-Channel End-to-End Neural Diarization

abstract: Due to the high performance of multi-channel speech processing, we can use the outputs from a multi-channel model as teacher labels when training a single-channel model with knowledge distillation. To the contrary, it is also known that single-channel speech data can benefit multi-channel models by mixing it with multi-channel speech data during training or by using it for model pretraining. This paper focuses on speaker diarization and proposes to conduct the above bi-directional knowledge transfer alternately. We first introduce an end-to-end neural diarization model that can handle both single- and multi-channel inputs. Using this model, we alternately conduct i) knowledge distillation from a multi-channel model to a single-channel model and ii) finetuning from the distilled single-channel model to a multi-channel model. Experimental results on two-speaker data show that the proposed method mutually improved single- and multi-channel speaker diarization performances.


title: Flexible Alignment Super-Resolution Network for Multi-Contrast MRI

abstract: Magnetic resonance imaging plays an essential role in clinical diagnosis by acquiring the structural information of biological tissue. Recently, many multi-contrast MRI super-resolution networks achieve good effects. However, most studies ignore the impact of the inappropriate foreground scale and patch size of multi-contrast MRI, which probably leads to inappropriate feature alignment. To tackle this problem, we propose the Flexible Alignment Super-Resolution Network (FASR-Net) for multi-contrast MRI Super-Resolution. The Flexible Alignment module of FASR-Net consists of two modules for feature alignment. (1) The Single-Multi Pyramid Alignment(S-A) module solves the situation where low-resolution (LR) images and reference (Ref) images have different scales. (2) The Multi-Multi Pyramid Alignment(M-A) module solves the situation where LR and Ref images have the same scale. Besides, we propose the Cross-Hierarchical Progressive Fusion (CHPF) module aiming at fusing the features effectively, further improving the image quality. Compared with other state-of-the-art methods, FASR-net achieves the most competitive results on FastMRI and IXI datasets. Our code will be available at \href{https://github.com/yimingliu123/FASR-Net}{https://github.com/yimingliu123/FASR-Net}.


title: FastCLIPstyler: Optimisation-free Text-based Image Style Transfer Using Style Representations

abstract: In recent years, language-driven artistic style transfer has emerged as a new type of style transfer technique, eliminating the need for a reference style image by using natural language descriptions of the style. The first model to achieve this, called CLIPstyler, has demonstrated impressive stylisation results. However, its lengthy optimisation procedure at runtime for each query limits its suitability for many practical applications. In this work, we present FastCLIPstyler, a generalised text-based image style transfer model capable of stylising images in a single forward pass for arbitrary text inputs. Furthermore, we introduce EdgeCLIPstyler, a lightweight model designed for compatibility with resource-constrained devices. Through quantitative and qualitative comparisons with state-of-the-art approaches, we demonstrate that our models achieve superior stylisation quality based on measurable metrics while offering significantly improved runtime efficiency, particularly on edge devices.


title: Strichartz estimates for Klein-Gordon equations with moving potentials

abstract: We study linear Klein-Gordon equations with moving potentials motivated by the stability analysis of traveling waves and multi-solitons. In this paper, Strichartz estimates, local energy decay and the scattering theory for these models are established. The results and estimates obtained in this paper will be used to study the interaction of solitons and the stability of multisolitons of nonlinear Klein-Gordon equations.


title: Small Coupling Expansion for Multiple Sequence Alignment

abstract: The alignment of biological sequences such as DNA, RNA, and proteins, is one of the basic tools that allow to detect evolutionary patterns, as well as functional/structural characterizations between homologous sequences in different organisms. Typically, state-of-the-art bioinformatics tools are based on profile models that assume the statistical independence of the different sites of the sequences. Over the last years, it has become increasingly clear that homologous sequences show complex patterns of long-range correlations over the primary sequence as a consequence of the natural evolution process that selects genetic variants under the constraint of preserving the functional/structural determinants of the sequence. Here, we present a new alignment algorithm based on message passing techniques that overcomes the limitations of profile models. Our method is based on a new perturbative small-coupling expansion of the free energy of the model that assumes a linear chain approximation as the $0^\mathrm{th}$-order of the expansion. We test the potentiality of the algorithm against standard competing strategies on several biological sequences.

categories: q-bio.QM cond-mat.dis-nn physics.bio-ph q-bio.BM


title: Relativistic effects in a mildly recycled pulsar binary: PSR J1952+2630

abstract: We report the results of timing observations of PSR J1952+2630, a 20.7 ms pulsar in orbit with a massive white dwarf companion. With the increased timing baseline, we obtain improved estimates for astrometric, spin, and binary parameters for this system. We get an improvement of an order of magnitude on the proper motion, and, for the first time, we detect three post-Keplerian parameters in this system: the advance of periastron, the orbital decay, and the Shapiro delay. We constrain the pulsar mass to 1.20$^{+0.28}_{-0.29}\rm M_{\odot}$ and the mass of its companion to 0.97$^{+0.16}_{-0.13}\rm M_{\odot}$. The current value of $\dot{P}_{\rm b}$ is consistent with GR expectation for the masses obtained using $\dot{\omega}$ and $h_3$. The excess represents a limit on the emission of dipolar GWs from this system. This results in a limit on the difference in effective scalar couplings for the pulsar and companion (predicted by scalar-tensor theories of gravity; STTs) of $|\alpha_{\rm p}-\alpha_{\rm c}| < 4.8 \times 10^{-3}$, which does not yield a competitive test for STTs. However, our simulations of future campaigns of this system show that by 2032, the precision of $\dot{P}_{\rm b}$ and $\dot{\omega}$ will allow for much more precise masses and much tighter constraints on the orbital decay contribution from dipolar GWs, resulting in $|\alpha_{\rm p}-\alpha_{\rm c}|<1.3 \times 10^{-3}$. We also present the constraints this system will place on the $\{\alpha_0,\beta_0\}$ parameters of DEF gravity by 2032. They are comparable to those of PSR J1738+0333. Unlike PSR J1738+0333, PSR J1952+2630 will not be limited in its mass measurement and has the potential to place even more restrictive limits on DEF gravity in the future. Further improvements to this test will likely be limited by uncertainties in the kinematic contributions to $\dot{P}_{\rm b}$ due to lack of precise distance measurements.


title: Physics inspired compact modelling of BiFeO$_3$ based memristors for hardware security applications

abstract: With the advent of the Internet of Things, nanoelectronic devices or memristors have been the subject of significant interest for use as new hardware security primitives. Among the several available memristors, BiFe$\rm O_{3}$ (BFO)-based electroforming-free memristors have attracted considerable attention due to their excellent properties, such as long retention time, self-rectification, intrinsic stochasticity, and fast switching. They have been actively investigated for use in physical unclonable function (PUF) key storage modules, artificial synapses in neural networks, nonvolatile resistive switches, and reconfigurable logic applications. In this work, we present a physics-inspired 1D compact model of a BFO memristor to understand its implementation for such applications (mainly PUFs) and perform circuit simulations. The resistive switching based on electric field-driven vacancy migration and intrinsic stochastic behaviour of the BFO memristor are modelled using the cloud-in-a-cell scheme. The experimental current-voltage characteristics of the BFO memristor are successfully reproduced. The response of the BFO memristor to changes in electrical properties, environmental properties (such as temperature) and stress are analyzed and consistent with experimental results.

categories: cs.ET cond-mat.mes-hall cs.CR physics.comp-ph


title: Latent Neural ODEs with Sparse Bayesian Multiple Shooting

abstract: Training dynamic models, such as neural ODEs, on long trajectories is a hard problem that requires using various tricks, such as trajectory splitting, to make model training work in practice. These methods are often heuristics with poor theoretical justifications, and require iterative manual tuning. We propose a principled multiple shooting technique for neural ODEs that splits the trajectories into manageable short segments, which are optimised in parallel, while ensuring probabilistic control on continuity over consecutive segments. We derive variational inference for our shooting-based latent neural ODE models and propose amortized encodings of irregularly sampled trajectories with a transformer-based recognition network with temporal attention and relative positional encoding. We demonstrate efficient and stable training, and state-of-the-art performance on multiple large-scale benchmark datasets.


title: Emergence of Biaxiality in Nematic Liquid Crystals with Magnetic Inclusions: Some Theoretical Insights

abstract: The biaxial phase in nematic liquid crystals has been elusive for several decades after its prediction in the 1970s. A recent experimental breakthrough was achieved by Liu et al. [PNAS 113, 10479 (2016)] in a liquid crystalline medium with magnetic nanoparticles (MNPs). They exploited the different length scales of dipolar and magneto-nematic interactions to obtain an equilibrium state where the magnetic moments are at an angle to the nematic director. This tilt introduces a second distinguished direction for orientational ordering or biaxiality in the two-component system. Using coarse-grained Ginzburg-Landau free energy models for the nematic and magnetic fields, we provide a theoretical framework which allows for the manipulation of morphologies and quantitative estimates of biaxial order.


title: Quantum cylindrical integrability in magnetic fields

abstract: We present the classification of quadratically integrable systems of the cylindrical type with magnetic fields in quantum mechanics. Following the direct method used in classical mechanics by [F Fournier et al 2020 J. Phys. A: Math. Theor. 53 085203] to facilitate the comparison, the cases which may a priori differ yield 2 systems without any correction and 2 with it. In all of them, the magnetic field $B$ coincides with the classical one, only the scalar potential $W$ may contain a $\hbar^2$-dependent correction. Two of the systems have both cylindrical integrals quadratic in momenta and are therefore not separable. These results form a basis for a prospective study of superintegrability.


title: Algorithmic Trading Using Continuous Action Space Deep Reinforcement Learning

abstract: Price movement prediction has always been one of the traders' concerns in financial market trading. In order to increase their profit, they can analyze the historical data and predict the price movement. The large size of the data and complex relations between them lead us to use algorithmic trading and artificial intelligence. This paper aims to offer an approach using Twin-Delayed DDPG (TD3) and the daily close price in order to achieve a trading strategy in the stock and cryptocurrency markets. Unlike previous studies using a discrete action space reinforcement learning algorithm, the TD3 is continuous, offering both position and the number of trading shares. Both the stock (Amazon) and cryptocurrency (Bitcoin) markets are addressed in this research to evaluate the performance of the proposed algorithm. The achieved strategy using the TD3 is compared with some algorithms using technical analysis, reinforcement learning, stochastic, and deterministic strategies through two standard metrics, Return and Sharpe ratio. The results indicate that employing both position and the number of trading shares can improve the performance of a trading system based on the mentioned metrics.


title: Perspective: "Relativity + Correlation + QED = Experiment''

abstract: The ultimate goal of electronic structure calculations is to make the left and right hand sides of the titled ``equation'' as close as possible. This requires high-precision treatment of relativistic, correlation, and quantum electrodynamics (QED) effects simultaneously. While both relativistic and QED effects can readily be built into the many-electron Hamiltonian, electron correlation is more difficult to describe due to the exponential growth of the number of parameters in the wave function. Compared with the spin-free case, spin-orbit interaction results in the loss of spin symmetry and concomitant complex algebra, thereby rendering the treatment of electron correlation even more difficult. Possible solutions to these issues are highlighted here.


title: Investigation of a candidate spin-$\frac{1}{2}$ hidden-charm triple strange pentaquark state $P_{csss}$

abstract: A candidate triple strange pentaquark state, $P_{csss}$, is investigated through its strong decay channel $P_{csss} \rightarrow \Omega^-J/\psi $. To calculate the relevant strong coupling constants, two possible interpolating currents with spin-parity $J^P=\frac{1}{2}^{-}$ are used. Though the chosen currents for the state under consideration have spin-parity quantum numbers $J^P=\frac{1}{2}^{-}$, they couple to both the positive and negative parity states simultaneously and the corresponding decay widths are obtained for both parities. These widths are obtained as $\Gamma(P_{csss} \rightarrow J/\psi \Omega^-)=201.4\pm 82.5~\mathrm{MeV}$ for the negative and $\Gamma(\widetilde{P}_{csss} \rightarrow J/\psi \Omega^-)=316.4\pm 107.8~\mathrm{MeV}$ for the positive parity state when the first current is used. For the second current, we obtain $\Gamma(P_{csss} \rightarrow J/\psi \Omega^-)=252.5\pm 116.7~\mathrm{MeV}$ for the negative and $\Gamma(\widetilde{P}_{csss} \rightarrow J/\psi \Omega^-)=361.1\pm 98.4~\mathrm{MeV}$ for the positive parity state. These results may provide insights into future experimental observations of such candidate states and help to distinguish and fix their properties.


title: Effective low energy Hamiltonians and unconventional Landau level spectrum of monolayer C$_3$N

abstract: We derive a low-energy effective $\mathbf{k}\cdot\mathbf{p}$ Hamiltonians for monolayer C$_{3}$N at the $ \Gamma $ and $ M $ points of the Brillouin zone where the band edge in the conduction and valence band can be found. Our analysis of the electronic band symmetries helps to better understand several results of recent ab-initio calculations[1,2] for the optical properties of this material. We also calculate the Landau level spectrum. We find that the Landau level spectrum in the degenerate conduction bands at the $ \Gamma $ point acquires properties that are reminiscent of the corresponding results in bilayer graphene, but there are important differences as well. Moreover, because of the heavy effective mass, $n$-doped samples may host interesting electron-electron interaction effects.


title: Time-resolved Coulomb collision of single electrons

abstract: Precise control over interactions between ballistic electrons will enable us to exploit Coulomb interactions in novel ways, to develop high-speed sensing, to reach a non-linear regime in electron quantum optics and to realise schemes for fundamental two-qubit operations on flying electrons. Time-resolved collisions between electrons have been used to probe the indistinguishability, Wigner function and decoherence of single electron wavepackets. Due to the effects of screening, none of these experiments were performed in a regime where Coulomb interactions were particularly strong. Here we explore the Coulomb collision of two high energy electrons in counter-propagating ballistic edge states. We show that, in this kind of unscreened device, the partitioning probabilities at different electron arrival times and barrier height are shaped by Coulomb repulsion between the electrons. This prevents the wavepacket overlap required for the manifestation of fermionic exchange statistics but suggests a new class of devices for studying and manipulating interactions of ballistic single electrons.


title: To the theory of generalized Stieltjes transforms

abstract: We identify measures arising in the representations of products of generalized Stieltjes transforms as generalized Stieltjes transforms, provide optimal estimates for the size of those measures, and address a similar issue for generalized Cauchy transforms. In the latter case, in two particular settings, we give criteria ensuring that the measures are positive. On this way, we also obtain new, applicable conditions for representability of functions as generalized Stieltjes transforms, thus providing a partial answer to a problem posed by Sokal and shedding a light at spectral multipliers emerged recently in probabilistic studies. As a byproduct of our approach, we improve several known results on Stieltjes and Hilbert transforms.


title: Winner Takes It All: Training Performant RL Populations for Combinatorial Optimization

abstract: Applying reinforcement learning (RL) to combinatorial optimization problems is attractive as it removes the need for expert knowledge or pre-solved instances. However, it is unrealistic to expect an agent to solve these (often NP-)hard problems in a single shot at inference due to their inherent complexity. Thus, leading approaches often implement additional search strategies, from stochastic sampling and beam search to explicit fine-tuning. In this paper, we argue for the benefits of learning a population of complementary policies, which can be simultaneously rolled out at inference. To this end, we introduce Poppy, a simple training procedure for populations. Instead of relying on a predefined or hand-crafted notion of diversity, Poppy induces an unsupervised specialization targeted solely at maximizing the performance of the population. We show that Poppy produces a set of complementary policies, and obtains state-of-the-art RL results on four popular NP-hard problems: traveling salesman, capacitated vehicle routing, 0-1 knapsack, and job-shop scheduling.


title: Implications for primordial black holes from cosmological constraints on scalar-induced gravitational wave

abstract: Sufficiently large scalar perturbations in the early Universe can create over-dense regions that collapse into primordial black holes (PBH). This process is accompanied by the emission of scalar-induced gravitational waves (SIGW) that behave like an extra radiation component, thus contributing to the relativistic degrees of freedom ($N_{\rm{eff}}$). We show that the cosmological constraints on $N_{\rm{eff}}$ can be used to pose stringent limits on PBHs created from this particular scenario as well as the relevant small-scale curvature perturbation ($\mathcal{P}_{\mathcal{R}}(k)$). We show that the combination of cosmic microwave background (CMB), baryon acoustic oscillation (BAO) and Big-Bang nucleosynthesis (BBN) datasets can exclude supermassive PBHs with peak mass $M_{\bullet} \in [5 \times 10^{5}, 5 \times 10^{10}]\,{\rm M}_{\odot}$ as the major component of dark matter, while the detailed constraints depend on the shape of the PBHs mass distribution. The future CMB mission like CMB-S4 can broaden this constraint window to a much larger range $M_{\bullet} \in [8 \times 10^{-5}, 5 \times 10^{10}]\,{\rm M}_{\odot}$, covering sub-stellar masses. These limits on PBH correspond to a tightened constraint on $\mathcal{P}_{\mathcal{R}}$ on scales of $k \in [10, 10^{22}]\ {\rm{Mpc^{-1}}}$, much smaller than those probed by direct CMB and large-scale structure power spectra.


title: IDa-Det: An Information Discrepancy-aware Distillation for 1-bit Detectors

abstract: Knowledge distillation (KD) has been proven to be useful for training compact object detection models. However, we observe that KD is often effective when the teacher model and student counterpart share similar proposal information. This explains why existing KD methods are less effective for 1-bit detectors, caused by a significant information discrepancy between the real-valued teacher and the 1-bit student. This paper presents an Information Discrepancy-aware strategy (IDa-Det) to distill 1-bit detectors that can effectively eliminate information discrepancies and significantly reduce the performance gap between a 1-bit detector and its real-valued counterpart. We formulate the distillation process as a bi-level optimization formulation. At the inner level, we select the representative proposals with maximum information discrepancy. We then introduce a novel entropy distillation loss to reduce the disparity based on the selected proposals. Extensive experiments demonstrate IDa-Det's superiority over state-of-the-art 1-bit detectors and KD methods on both PASCAL VOC and COCO datasets. IDa-Det achieves a 76.9% mAP for a 1-bit Faster-RCNN with ResNet-18 backbone. Our code is open-sourced on https://github.com/SteveTsui/IDa-Det.


title: On the extended randomized multiple row method for solving linear least-squares problems

abstract: The randomized row method is a popular representative of the iterative algorithm because of its efficiency in solving the overdetermined and consistent systems of linear equations. In this paper, we present an extended randomized multiple row method to solve a given overdetermined and inconsistent linear system and analyze its computational complexities at each iteration. We prove that the proposed method can linearly converge in the mean square to the least-squares solution with a minimum Euclidean norm. Several numerical studies are presented to corroborate our theoretical findings. The real-world applications, such as image reconstruction and large noisy data fitting in computer-aided geometric design, are also presented for illustration purposes.


title: Hate Speech and Offensive Language Detection in Bengali

abstract: Social media often serves as a breeding ground for various hateful and offensive content. Identifying such content on social media is crucial due to its impact on the race, gender, or religion in an unprejudiced society. However, while there is extensive research in hate speech detection in English, there is a gap in hateful content detection in low-resource languages like Bengali. Besides, a current trend on social media is the use of Romanized Bengali for regular interactions. To overcome the existing research's limitations, in this study, we develop an annotated dataset of 10K Bengali posts consisting of 5K actual and 5K Romanized Bengali tweets. We implement several baseline models for the classification of such hateful posts. We further explore the interlingual transfer mechanism to boost classification performance. Finally, we perform an in-depth error analysis by looking into the misclassified posts by the models. While training actual and Romanized datasets separately, we observe that XLM-Roberta performs the best. Further, we witness that on joint training and few-shot training, MuRIL outperforms other models by interpreting the semantic expressions better. We make our code and dataset public for others.


title: Moir\'e Engineering in 2D Heterostructures with Process-Induced Strain

abstract: We report deterministic control over moir\'e superlattice interference pattern in twisted bilayer graphene by implementing designable device-level heterostrain with process-induced strain engineering, a widely used technique in industrial silicon nanofabrication processes. By depositing stressed thin films onto our twisted bilayer graphene samples, heterostrain magnitude and strain directionality can be controlled by stressor film force (film stress x film thickness) and patterned stressor geometry, respectively. We examine strain and moir\'e interference with Raman spectroscopy through in-plane and moir\'e-activated phonon mode shifts. Results support systematic C$_{3}$ rotational symmetry breaking and tunable periodicity in moir\'e superlattices under the application of uniaxial or biaxial heterostrain. Experimental results are validated by molecular statics simulations and density functional theory based first principles calculations. This provides a method to not only tune moir\'e interference without additional twisting, but also allows for a systematic pathway to explore different van der Waals based moir\'e superlattice symmetries by deterministic design.


title: Neighbor Regularized Bayesian Optimization for Hyperparameter Optimization

abstract: Bayesian Optimization (BO) is a common solution to search optimal hyperparameters based on sample observations of a machine learning model. Existing BO algorithms could converge slowly even collapse when the potential observation noise misdirects the optimization. In this paper, we propose a novel BO algorithm called Neighbor Regularized Bayesian Optimization (NRBO) to solve the problem. We first propose a neighbor-based regularization to smooth each sample observation, which could reduce the observation noise efficiently without any extra training cost. Since the neighbor regularization highly depends on the sample density of a neighbor area, we further design a density-based acquisition function to adjust the acquisition reward and obtain more stable statistics. In addition, we design a adjustment mechanism to ensure the framework maintains a reasonable regularization strength and density reward conditioned on remaining computation resources. We conduct experiments on the bayesmark benchmark and important computer vision benchmarks such as ImageNet and COCO. Extensive experiments demonstrate the effectiveness of NRBO and it consistently outperforms other state-of-the-art methods.


title: CLAD: A realistic Continual Learning benchmark for Autonomous Driving

abstract: In this paper we describe the design and the ideas motivating a new Continual Learning benchmark for Autonomous Driving (CLAD), that focuses on the problems of object classification and object detection. The benchmark utilises SODA10M, a recently released large-scale dataset that concerns autonomous driving related problems. First, we review and discuss existing continual learning benchmarks, how they are related, and show that most are extreme cases of continual learning. To this end, we survey the benchmarks used in continual learning papers at three highly ranked computer vision conferences. Next, we introduce CLAD-C, an online classification benchmark realised through a chronological data stream that poses both class and domain incremental challenges; and CLAD-D, a domain incremental continual object detection benchmark. We examine the inherent difficulties and challenges posed by the benchmark, through a survey of the techniques and methods used by the top-3 participants in a CLAD-challenge workshop at ICCV 2021. We conclude with possible pathways to improve the current continual learning state of the art, and which directions we deem promising for future research.


title: Quantum Wasserstein distance of order 1 between channels

abstract: We set up a general theory for a quantum Wasserstein distance of order 1 in an operator algebraic framework, extending recent work in finite dimensions. In addition, this theory applies not only to states, but also to channels, giving a metric on the set of channels from one composite system to another. The additivity and stability properties of this metric are studied.


title: Multi-objective and multi-fidelity Bayesian optimization of laser-plasma acceleration

abstract: Beam parameter optimization in accelerators involves multiple, sometimes competing objectives. Condensing these individual objectives into a single figure of merit unavoidably results in a bias towards particular outcomes, in absence of prior knowledge often in a non-desired way. Finding an optimal objective definition then requires operators to iterate over many possible objective weights and definitions, a process that can take many times longer than the optimization itself. A more versatile approach is multi-objective optimization, which establishes the trade-off curve or Pareto front between objectives. Here we present the first results on multi-objective Bayesian optimization of a simulated laser-plasma accelerator. We find that multi-objective optimization reaches comparable performance to its single-objective counterparts while allowing for instant evaluation of entirely new objectives. This dramatically reduces the time required to find appropriate objective definitions for new problems. Additionally, our multi-objective, multi-fidelity method reduces the time required for an optimization run by an order of magnitude. It does so by dynamically choosing simulation resolution and box size, requiring fewer slow and expensive simulations as it learns about the Pareto-optimal solutions from fast low-resolution runs. The techniques demonstrated in this paper can easily be translated into many different computational and experimental use cases beyond accelerator optimization.


title: Gradient-based optimisation of the conditional-value-at-risk using the multi-level Monte Carlo method

abstract: In this work, we tackle the problem of minimising the Conditional-Value-at-Risk (CVaR) of output quantities of complex differential models with random input data, using gradient-based approaches in combination with the Multi-Level Monte Carlo (MLMC) method. In particular, we consider the framework of multi-level Monte Carlo for parametric expectations and propose modifications of the MLMC estimator, error estimation procedure, and adaptive MLMC parameter selection to ensure the estimation of the CVaR and sensitivities for a given design with a prescribed accuracy. We then propose combining the MLMC framework with an alternating inexact minimisation-gradient descent algorithm, for which we prove exponential convergence in the optimisation iterations under the assumptions of strong convexity and Lipschitz continuity of the gradient of the objective function. We demonstrate the performance of our approach on two numerical examples of practical relevance, which evidence the same optimal asymptotic cost-tolerance behaviour as standard MLMC methods for fixed design computations of output expectations.