title: Multi-modal Motion Prediction with Transformer-based Neural Network for Autonomous Driving

abstract: Predicting the behaviors of other agents on the road is critical for autonomous driving to ensure safety and efficiency. However, the challenging part is how to represent the social interactions between agents and output different possible trajectories with interpretability. In this paper, we introduce a neural prediction framework based on the Transformer structure to model the relationship among the interacting agents and extract the attention of the target agent on the map waypoints. Specifically, we organize the interacting agents into a graph and utilize the multi-head attention Transformer encoder to extract the relations between them. To address the multi-modality of motion prediction, we propose a multi-modal attention Transformer encoder, which modifies the multi-head attention mechanism to multi-modal attention, and each predicted trajectory is conditioned on an independent attention mode. The proposed model is validated on the Argoverse motion forecasting dataset and shows state-of-the-art prediction accuracy while maintaining a small model size and a simple training process. We also demonstrate that the multi-modal attention module can automatically identify different modes of the target agent's attention on the map, which improves the interpretability of the model.


title: 1/f Noise Analysis for FAST HI Intensity Mapping Drift-Scan Experiment

abstract: We investigate the 1/f noise of the Five-hundred-meter Aperture Spherical Telescope (FAST) receiver system using drift-scan data from an intensity mapping pilot survey. All the 19 beams have 1/f fluctuations with similar structures. Both the temporal and the 2D power spectrum densities are estimated. The correlations directly seen in the time series data at low frequency $f$ are associated with the sky signal, perhaps due to a coupling between the foreground and the system response. We use Singular Value Decomposition (SVD) to subtract the foreground. By removing the strongest components, the measured 1/f noise power can be reduced significantly. With 20 modes subtraction, the knee frequency of the 1/f noise in a 10 MHz band is reduced to $1.8 \times 10^{-3}\Hz$, well below the thermal noise over 500-seconds time scale. The 2D power spectra show that the 1/f-type variations are restricted to a small region in the time-frequency space and the correlations in frequency can be suppressed with SVD modes subtraction. The residual 1/f noise after the SVD mode subtraction is uncorrelated in frequency, and a simple noise diode frequency-independent calibration of the receiver gain at 8s interval does not affect the results. The 1/f noise can be important for HI intensity mapping, we estimate that the 1/f noise has a knee frequency $(f_{k}) \sim$ 6 $\times$ 10$^{-4}$Hz, and time and frequency correlation spectral indices $(\alpha) \sim 0.65$, $(\beta) \sim 0.8$ after the SVD subtraction of 30 modes. This can bias the HI power spectrum measurement by 10 percent.


title: Tesla-Rapture: A Lightweight Gesture Recognition System from mmWave Radar Point Clouds

abstract: We present Tesla-Rapture, a gesture recognition interface for point clouds generated by mmWave Radars. State of the art gesture recognition models are either too resource consuming or not sufficiently accurate for integration into real-life scenarios using wearable or constrained equipment such as IoT devices (e.g. Raspberry PI), XR hardware (e.g. HoloLens), or smart-phones. To tackle this issue, we developed Tesla, a Message Passing Neural Network (MPNN) graph convolution approach for mmWave radar point clouds. The model outperforms the state of the art on two datasets in terms of accuracy while reducing the computational complexity and, hence, the execution time. In particular, the approach, is able to predict a gesture almost 8 times faster than the most accurate competitor. Our performance evaluation in different scenarios (environments, angles, distances) shows that Tesla generalizes well and improves the accuracy up to 20% in challenging scenarios like a through-wall setting and sensing at extreme angles. Utilizing Tesla, we develop Tesla-Rapture, a real-time implementation using a mmWave Radar on a Raspberry PI 4 and evaluate its accuracy and time-complexity. We also publish the source code, the trained models, and the implementation of the model for embedded devices.


title: Deep hierarchical reinforcement agents for automated penetration testing

abstract: Penetration testing the organised attack of a computer system in order to test existing defences has been used extensively to evaluate network security. This is a time consuming process and requires in-depth knowledge for the establishment of a strategy that resembles a real cyber-attack. This paper presents a novel deep reinforcement learning architecture with hierarchically structured agents called HA-DRL, which employs an algebraic action decomposition strategy to address the large discrete action space of an autonomous penetration testing simulator where the number of actions is exponentially increased with the complexity of the designed cybersecurity network. The proposed architecture is shown to find the optimal attacking policy faster and more stably than a conventional deep Q-learning agent which is commonly used as a method to apply artificial intelligence in automatic penetration testing.


title: A machine-learning framework for daylight and visual comfort assessment in early design stages

abstract: This research is mainly focused on the assessment of machine learning algorithms in the prediction of daylight and visual comfort metrics in the early design stages. A dataset was primarily developed from 2880 simulations derived from Honeybee for Grasshopper. The simulations were done for a shoebox space with a one side window. The alternatives emerged from different physical features, including room dimensions, interior surfaces reflectance, window dimensions and orientations, number of windows, and shading states. 5 metrics were used for daylight evaluations, including UDI, sDA, mDA, ASE, and sVD. Quality Views were analyzed for the same shoebox spaces via a grasshopper-based algorithm, developed from the LEED v4 evaluation framework for Quality Views. The dataset was further analyzed with an Artificial Neural Network algorithm written in Python. The accuracy of the predictions was estimated at 97% on average. The developed model could be used in early design stages analyses without the need for time-consuming simulations in previously used platforms and programs.


title: Moduli of genus one curves with two marked points as a weighted blow-up

abstract: We give an explicit description of $\overline{\mathcal{M}}_{1,2}$ as a weighted blow-up of a weighted projective stack. We use this description to compute the Brauer group of $\overline{\mathcal{M}}_{1,2;S}$ over any base scheme $S$ where 6 is invertible, and the integral Chow rings of $\overline{\mathcal{M}}_{1,2}$ and $\mathcal{M}_{1,2}$.


title: Spiking Neural Networks for Visual Place Recognition via Weighted Neuronal Assignments

abstract: Spiking neural networks (SNNs) offer both compelling potential advantages, including energy efficiency and low latencies and challenges including the non-differentiable nature of event spikes. Much of the initial research in this area has converted deep neural networks to equivalent SNNs, but this conversion approach potentially negates some of the advantages of SNN-based approaches developed from scratch. One promising area for high-performance SNNs is template matching and image recognition. This research introduces the first high-performance SNN for the Visual Place Recognition (VPR) task: given a query image, the SNN has to find the closest match out of a list of reference images. At the core of this new system is a novel assignment scheme that implements a form of ambiguity-informed salience, by up-weighting single-place-encoding neurons and down-weighting "ambiguous" neurons that respond to multiple different reference places. In a range of experiments on the challenging Nordland, Oxford RobotCar, SPEDTest, Synthia, and St Lucia datasets, we show that our SNN achieves comparable VPR performance to state-of-the-art and classical techniques, and degrades gracefully in performance with an increasing number of reference places. Our results provide a significant milestone towards SNNs that can provide robust, energy-efficient, and low latency robot localization.


title: Vaccination strategies and transmission of COVID-19: evidence across advanced countries

abstract: Given limited supply of approved vaccines and constrained medical resources, design of a vaccination strategy to control a pandemic is an economic problem. We use time-series and panel methods with real-world country-level data to estimate effects on COVID-19 cases and deaths of two key elements of mass vaccination - time between doses and vaccine type. We find that new infections and deaths are both significantly negatively associated with the fraction of the population vaccinated with at least one dose. Conditional on first-dose coverage, an increased fraction with two doses appears to offer no further reductions in new cases and deaths. For vaccines from China, however, we find significant effects on both health outcomes only after two doses. Our results support a policy of extending the interval between first and second doses of vaccines developed in Europe and the US. As vaccination progresses, population mobility increases, which partially offsets the direct effects of vaccination. This suggests that non-pharmaceutical interventions remain important to contain transmission as vaccination is rolled out.


title: Determination of the magnetic q vectors in the heavy fermion superconductor Ce3PtIn11

abstract: An analysis with transferred hyperfine field has been performed on the spectra of the $^{115}$In nuclear quadrupole resonance experiments of heavy fermion superconductor Ce$_{3}$PtIn$_{11}$ exhibiting co-occurrence of two successive antiferromagnetic orderings ($T_{\rm N1}$ = 2.2 K and $T_{\rm N2}$ = 2.0 K) followed by superconducting transition ($T_{\rm c}$ = 0.32 K). The spectral changes at magnetic transition temperatures $T_{\rm N1}$ and $T_{\rm N2}$ indicate that the Ce(2) site has the dominant magnetic contribution, with a small magnetic moment, but not negligible, at the Ce(1) site. Our analysis using transferred hyperfine field which overcomes the previous simple dipolar model evinces that for $T_{\rm N2} < T < T_{\rm N1 } $, the propagation vectors at the Ce(1) and Ce(2) sublattices are q1 = q2 = (1/2, 1/2, 0 or 1/2), whereas for $T < T_{\rm N2 }$, the propagation vectors are q1 = (1/2,~1/2, 1/6 or 1/3) and q2 = (1/2, 1/2, 1/2 or 0), respectively.


title: Exact coherent structures and phase space geometry of pre-turbulent 2D active nematic channel flow

abstract: Confined active nematics exhibit rich dynamical behavior, including spontaneous flows, periodic defect dynamics, and chaotic `active turbulence'. Here, we study these phenomena using the framework of Exact Coherent Structures, which has been successful in characterizing the routes to high Reynolds number turbulence of passive fluids. Exact Coherent Structures are stationary, periodic, quasiperiodic, or traveling wave solutions of the hydrodynamic equations that, together with their invariant manifolds, serve as an organizing template of the dynamics. We compute the dominant Exact Coherent Structures and connecting orbits in a pre-turbulent active nematic channel flow, which enables a fully nonlinear but highly reduced order description in terms of a directed graph. Using this reduced representation, we compute instantaneous perturbations that switch the system between disparate spatiotemporal states occupying distant regions of the infinite dimensional phase space. Our results lay the groundwork for a systematic means of understanding and controlling active nematic flows in the moderate to high activity regime.

categories: cond-mat.soft math.DS nlin.PS physics.flu-dyn


title: Constraints on compact dark matter from gravitational wave microlensing

abstract: If a significant fraction of dark matter is in the form of compact objects, they will cause microlensing effects in the gravitational wave (GW) signals observable by LIGO and Virgo. From the non-observation of microlensing signatures in the binary black hole events from the first two observing runs and the first half of the third observing run, we constrain the fraction of compact dark matter in the mass range $10^2-10^5~{M_\odot}$ to be less than $\simeq 50-80\%$ (details depend on the assumed source population properties and the Bayesian priors). These modest constraints will be significantly improved in the next few years with the expected detection of thousands of binary black hole events, providing a new avenue to probe the nature of dark matter.


title: Gravitational wave trispectrum in the axion-SU(2) model

abstract: We study the trispectrum of the gravitational waves (GWs) generated through the dynamics of an axionic spectator field and SU(2) gauge fields during inflation. In non-Abelian gauge theory, the gauge fields have four-point self-interactions, which induce the tree-level GW trispectrum. We formulate this type of the GW trispectrum including the non-dynamical contributions and evaluate it in the equilateral limit as a unique signal of this model. We find that the ratio of the GW trispectrum to the cube of the scalar power spectrum can be as large as $\mathcal{O}(10^6)$ in the viable parameter space, which could be captured in the CMB observations.


title: Exploring the Connection between Knowledge Distillation and Logits Matching

abstract: Knowledge distillation is a generalized logits matching technique for model compression. Their equivalence is previously established on the condition of $\textit{infinity temperature}$ and $\textit{zero-mean normalization}$. In this paper, we prove that with only $\textit{infinity temperature}$, the effect of knowledge distillation equals to logits matching with an extra regularization. Furthermore, we reveal that an additional weaker condition -- $\textit{equal-mean initialization}$ rather than the $\textit{zero-mean normalization}$ already suffices to set up the equivalence. The key to our proof is we realize that in neural networks with the cross-entropy loss and softmax activation, the mean of back-propagated gradient on logits always keeps zero.


title: A Machine-learning Framework for Acoustic Design Assessment in Early Design Stages

abstract: In time-cost scale model studies, predicting acoustic performance by using simulation methods is a commonly used method that is preferred. In this field, building acoustic simulation tools are complicated by several challenges, including the high cost of acoustic tools, the need for acoustic expertise, and the time-consuming process of acoustic simulation. The goal of this project is to introduce a simple model with a short calculation time to estimate the room acoustic condition in the early design stages of the building. This paper presents a working prototype for a new method of machine learning (ML) to approximate a series of typical room acoustic parameters using only geometric data as input characteristics. A novel dataset consisting of acoustical simulations of a single room with 2916 different configurations are used to train and test the proposed model. In the stimulation process, features that include room dimensions, window size, material absorption coefficient, furniture, and shading type have been analysed by using Pachyderm acoustic software. The mentioned dataset is used as the input of seven machine-learning models based on fully connected Deep Neural Networks (DNN). The average error of ML models is between 1% to 3%, and the average error of the new predicted samples after the validation process is between 2% to 12%.


title: Ultrafast Optical Spectroscopy Evidence of Pseudogap and Electron-Phonon Coupling in an Iron-Based Superconductor KCa$_2$Fe$_4$As$_4$F$_2$

abstract: We use ultrafast optical spectroscopy to study the nonequilibrium quasiparticle relaxation dynamics of the iron-based superconductor KCa$_2$Fe$_4$As$_4$F$_2$ with $T_c=33.5$ K. Our results reveal a possible pseudogap ($\Delta_{PG}$ = 2.4 $\pm$ 0.1 meV) below $T^*\approx 50$ K but prior to the opening of a superconducting gap ($\Delta_{SC}$(0) $\approx$ 4.3 $\pm$ 0.1 meV). Measurements under high pump fluence real two distinct, coherent phonon oscillations with 1.95 and 5.51 THz frequencies, respectively. The high-frequency $A_{1g}$(2) mode corresponds to the $c-$axis polarized vibrations of FeAs planes with a nominal electron-phonon coupling constant $\lambda_{A_{1g}(2)}$ = 0.194 $\pm$ 0.02. Our findings suggest that the pseudogap is likely a precursor of superconductivity, and the electron-phonon coupling may play an essential role in the superconducting pairing in KCa$_2$Fe$_4$As$_4$F$_2$.


title: Exact order of extreme $L_p$ discrepancy of infinite sequences in arbitrary dimension

abstract: We study the extreme $L_p$ discrepancy of infinite sequences in the $d$-dimensional unit cube, which uses arbitrary sub-intervals of the unit cube as test sets. This is in contrast to the classical star $L_p$ discrepancy, which uses exclusively intervals that are anchored in the origin as test sets. We show that for any dimension $d$ and any $p>1$ the extreme $L_p$ discrepancy of every infinite sequence in $[0,1)^d$ is at least of order of magnitude $(\log N)^{d/2}$, where $N$ is the number of considered initial terms of the sequence. For $p \in (1,\infty)$ this order of magnitude is best possible.


title: Molecules with ALMA at Planet-forming Scales (MAPS). X. Studying deuteration at high angular resolution toward protoplanetary disks

abstract: Deuterium fractionation is dependent on various physical and chemical parameters. Thus, the formation location and thermal history of material in the solar system is often studied by measuring its D/H ratio. This requires knowledge about the deuteration processes operating during the planet formation era. We aim to study these processes by radially resolving the DCN/HCN (at 0.3" resolution) and N$_2$D$^+$/N$_2$H$^+$ (0.3 to 0.9") column density ratios toward the five protoplanetary disks observed by the Molecules with ALMA at Planet-forming scales (MAPS) Large Program. DCN is detected in all five sources, with one newly reported detection. N$_2$D$^+$ is detected in four sources, two of which are newly reported detections. We derive column density profiles that allow us to study the spatial variation of the DCN/HCN and N$_2$D$^+$/N$_2$H$^+$ ratios at high resolution. DCN/HCN varies considerably for different parts of the disks, ranging from $10^{-3}$ to $10^{-1}$. In particular, the inner disk regions generally show significantly lower HCN deuteration compared with the outer disk. In addition, our analysis confirms that two deuterium fractionation channels are active, which can alter the D/H ratio within the pool of organic molecules. N$_2$D$^+$ is found in the cold outer regions beyond $\sim$50 au, with N$_2$D$^+$/N$_2$H$^+$ ranging between $10^{-2}$ and 1 across the disk sample. This is consistent with the theoretical expectation that N$_2$H$^+$ deuteration proceeds via the low-temperature channel only. This paper is part of the MAPS special issue of the Astrophysical Journal Supplement.


title: Sine-square deformation applied to classical Ising models

abstract: Sine-square deformation (SSD) is a treatment proposed in quantum systems, which spatially modifies a Hamiltonian, gradually decreasing the local energy scale from the center of the system toward the edges by a sine-squared envelope function. It is known to serve as a good boundary condition as well as to provide physical quantities reproducing those of the infinite-size systems. We apply the SSD to one- and two-dimensional classical Ising models. Based on the analytical calculations and Monte Carlo simulations, we find that the classical SSD system is regarded as an extended canonical ensemble of a local subsystem each characterized by its own effective temperature. This effective temperature is defined by normalizing the system temperature by the deformed local energy scale. A single calculation for a fixed system temperature provides a set of physical quantities of various temperatures that quantitatively reproduce well those of the uniform system.


title: The bundle of KMS state spaces for flows on a unital C*-algebra

abstract: It is shown that any bundle of KMS state spaces which can occur for a flow on a unital separable C*-algebra with a trace state can also be realized by a flow on any given unital infinite-dimensional simple AF algebra with a tracial state space affinely homeomorphic to the fiber in the bundle over 0.


title: Nambu-Jona-Lasinio model correlation functions from QCD

abstract: We treat quantum chromodynamics (QCD) using a set of Dyson-Schwinger equations derived, in differential form, with the Bender-Milton-Savage technique. In this way, we are able to derive the low energy limit that assumes the form of a non-local Nambu-Jona-Lasinio model with all the parameters properly fixed by the QCD Lagrangian and the determination of the mass gap of the gluon sector.


title: Task-adaptive Pre-training and Self-training are Complementary for Natural Language Understanding

abstract: Task-adaptive pre-training (TAPT) and Self-training (ST) have emerged as the major semi-supervised approaches to improve natural language understanding (NLU) tasks with massive amount of unlabeled data. However, it's unclear whether they learn similar representations or they can be effectively combined. In this paper, we show that TAPT and ST can be complementary with simple TFS protocol by following TAPT -> Finetuning -> Self-training (TFS) process. Experimental results show that TFS protocol can effectively utilize unlabeled data to achieve strong combined gains consistently across six datasets covering sentiment classification, paraphrase identification, natural language inference, named entity recognition and dialogue slot classification. We investigate various semi-supervised settings and consistently show that gains from TAPT and ST can be strongly additive by following TFS procedure. We hope that TFS could serve as an important semi-supervised baseline for future NLP studies.


title: Dodging Attack Using Carefully Crafted Natural Makeup

abstract: Deep learning face recognition models are used by state-of-the-art surveillance systems to identify individuals passing through public areas (e.g., airports). Previous studies have demonstrated the use of adversarial machine learning (AML) attacks to successfully evade identification by such systems, both in the digital and physical domains. Attacks in the physical domain, however, require significant manipulation to the human participant's face, which can raise suspicion by human observers (e.g. airport security officers). In this study, we present a novel black-box AML attack which carefully crafts natural makeup, which, when applied on a human participant, prevents the participant from being identified by facial recognition models. We evaluated our proposed attack against the ArcFace face recognition model, with 20 participants in a real-world setup that includes two cameras, different shooting angles, and different lighting conditions. The evaluation results show that in the digital domain, the face recognition system was unable to identify all of the participants, while in the physical domain, the face recognition system was able to identify the participants in only 1.22% of the frames (compared to 47.57% without makeup and 33.73% with random natural makeup), which is below a reasonable threshold of a realistic operational environment.


title: Virtual classes via vanishing cycles

abstract: We develop a new method to construct the virtual fundamental classes for quasi-smooth derived schemes using the perverse sheaves of vanishing cycles on their $-1$-shifted contangent spaces. It is based on the author's previous work that can be regarded as a version of the Thom isomorphism for $-1$-shifted cotangent spaces. We use the Fourier-Sato transform to prove that our classes coincide with the virtual fundamental classes introduced by the work of Behrend-Fantechi and Li-Tian, under the quasi-projectivity assumption. We also discuss an approach to construct DT4 virtual classes for $-2$-shifted symplectic derived schemes using the perverse sheaves of vanishing cycles.


title: Deep Denerative Models for Drug Design and Response

abstract: Designing new chemical compounds with desired pharmaceutical properties is a challenging task and takes years of development and testing. Still, a majority of new drugs fail to prove efficient. Recent success of deep generative modeling holds promises of generation and optimization of new molecules. In this review paper, we provide an overview of the current generative models, and describe necessary biological and chemical terminology, including molecular representations needed to understand the field of drug design and drug response. We present commonly used chemical and biological databases, and tools for generative modeling. Finally, we summarize the current state of generative modeling for drug design and drug response prediction, highlighting the state-of-art approaches and limitations the field is currently facing.


title: Fermion propagator diagonalization and eigenvalue problem

abstract: We discuss diagonalization of propagator for mixing fermions system based on the eigenvalue problem. The similarity transformation converting matrix propagator into diagonal form is obtained. The suggested diagonalization has simple algebraic properties for on-shell fermions and can be used in renormalization of fermion mixing matrix.


title: Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimization

abstract: Being able to reply with a related, fluent, and informative response is an indispensable requirement for building high-quality conversational agents. In order to generate better responses, some approaches have been proposed, such as feeding extra information by collecting large-scale datasets with human annotations, designing neural conversational models (NCMs) with complex architecture and loss functions, or filtering out untrustworthy samples based on a dialogue attribute, e.g., Relatedness or Genericness. In this paper, we follow the third research branch and present a data filtering method for open-domain dialogues, which identifies untrustworthy samples from training data with a quality measure that linearly combines seven dialogue attributes. The attribute weights are obtained via Bayesian Optimization (BayesOpt) that aims to optimize an objective function for dialogue generation iteratively on the validation set. Then we score training samples with the quality measure, sort them in descending order, and filter out those at the bottom. Furthermore, to accelerate the "filter-train-evaluate" iterations involved in BayesOpt on large-scale datasets, we propose a training framework that integrates maximum likelihood estimation (MLE) and negative training method (NEG). The training method updates parameters of a trained NCMs on two small sets with newly maintained and removed samples, respectively. Specifically, MLE is applied to maximize the log-likelihood of newly maintained samples, while NEG is used to minimize the log-likelihood of newly removed ones. Experimental results on two datasets show that our method can effectively identify untrustworthy samples, and NCMs trained on the filtered datasets achieve better performance.


title: Limits for realizing single photons

abstract: Exact single photons cannot be generated on demand due to their infinite tails. To quantify how close realizable optical states can be to some target single photon in one dimension, we argue that there are two natural but incompatible ways to specify the target state. Either it can be expressed as a photon with a chosen positive-frequency spectrum, or it can be described as an (unphysical) photon in a chosen positive-time pulse. The results show that for sufficiently short target pulses, the closest realizable states contain substantial multiphoton components. Upper and lower bounds for the maximum fidelity are derived and are expressed as functions of the size of the target state's tail, for negative time or negative frequency, respectively. We also generalize the bounds to arbitrary photon-number states.


title: Position Paper on Simulating Privacy Dynamics in Recommender Systems

abstract: In this position paper, we discuss the merits of simulating privacy dynamics in recommender systems. We study this issue at hand from two perspectives: Firstly, we present a conceptual approach to integrate privacy into recommender system simulations, whose key elements are privacy agents. These agents can enhance users' profiles with different privacy preferences, e.g., their inclination to disclose data to the recommender system. Plus, they can protect users' privacy by guarding all actions that could be a threat to privacy. For example, agents can prohibit a user's privacy-threatening actions or apply privacy-enhancing techniques, e.g., Differential Privacy, to make actions less threatening. Secondly, we identify three critical topics for future research in privacy-aware recommender system simulations: (i) How could we model users' privacy preferences and protect users from performing any privacy-threatening actions? (ii) To what extent do privacy agents modify the users' document preferences? (iii) How do privacy preferences and privacy protections impact recommendations and privacy of others? Our conceptual privacy-aware simulation approach makes it possible to investigate the impact of privacy preferences and privacy protection on the micro-level, i.e., a single user, but also on the macro-level, i.e., all recommender system users. With this work, we hope to present perspectives on how privacy-aware simulations could be realized, such that they enable researchers to study the dynamics of privacy within a recommender system.


title: Space Time Recurrent Memory Network

abstract: Transformers have recently been popular for learning and inference in the spatial-temporal domain. However, their performance relies on storing and applying attention to the feature tensor of each frame in video. Hence, their space and time complexity increase linearly as the length of video grows, which could be very costly for long videos. We propose a novel visual memory network architecture for the learning and inference problem in the spatial-temporal domain. We maintain a fixed set of memory slots in our memory network and propose an algorithm based on Gumbel-Softmax to learn an adaptive strategy to update this memory. Finally, this architecture is benchmarked on the video object segmentation (VOS) and video prediction problems. We demonstrate that our memory architecture achieves state-of-the-art results, outperforming transformer-based methods on VOS and other recent methods on video prediction while maintaining constant memory capacity independent of the sequence length.


title: A duality between vertex superalgebras $L_{-3/2}(\mathfrak{osp}(1\vert 2))$ and $\mathcal V^{(2)}$ and generalizations to logarithmic vertex algebras

abstract: We introduce a subalgebra $\overline F$ of the Clifford vertex superalgebra ($bc$ system) which is completely reducible as a $L^{Vir} (-2,0)$-module, $C_2$-cofinite, but it is not conformal and it is not isomorphic to the symplectic fermion algebra $\mathcal{SF}(1)$. We show that $\mathcal{SF}(1)$ and $\overline{F}$ are in an interesting duality, since $\overline{F}$ can be equipped with the structure of a $\mathcal{SF}(1)$-module and vice versa. Using the decomposition of $\overline F$ and a free-field realization from arXiv:1711.11342, we decompose $L_k(\mathfrak{osp}(1\vert 2))$ at the critical level $k=-3/2$ as a module for $L_k(\mathfrak{sl}(2))$. The decomposition of $L_k(\mathfrak{osp}(1\vert 2))$ is exactly the same as of the $N=4$ superconformal vertex algebra with central charge $c=-9$, denoted by $\mathcal V^{(2)}$. Using the duality between $\overline{F}$ and $\mathcal{SF}(1)$, we prove that $L_k(\mathfrak{osp}(1\vert 2))$ and $\mathcal V^{(2)}$ are in the duality of the same type. As an application, we construct and classify all irreducible $L_k(\mathfrak{osp}(1\vert 2))$-modules in the category $\mathcal O$ and the category $\mathcal R$ which includes relaxed highest weight modules. We also describe the structure of the parafermion algebra $N_{-3/2}(\mathfrak{osp}(1\vert 2))$ as a $N_{-3/2}(\mathfrak{sl}(2))$-module. We extend this example, and for each $p \ge 2$, we introduce a non-conformal vertex algebra $\mathcal A^{(p)}_{new}$ and show that $\mathcal A^{(p)}_{new} $ is isomorphic to the doublet vertex algebra as a module for the Virasoro algebra. We also construct the vertex algebra $ \mathcal V^{(p)} _{new}$ which is isomorphic to the logarithmic vertex algebra $\mathcal V^{(p)}$ as a module for $\widehat{\mathfrak{sl}}(2)$.


title: Starburst Energy Feedback Seen Through HCO$^+$/HOC$^+$ Emission in NGC 253 from ALCHEMI

abstract: Molecular abundances are sensitive to UV-photon flux and cosmic-ray ionization rate. In starburst environments, the effects of high-energy photons and particles are expected to be stronger. We examine these astrochemical signatures through multiple transitions of HCO$^+$ and its metastable isomer HOC$^+$ in the center of the starburst galaxy NGC 253 using data from the ALMA large program ALCHEMI. The distribution of the HOC$^+$(1-0) integrated intensity shows its association with "superbubbles", cavities created either by supernovae or expanding HII regions. The observed HCO$^+$/HOC$^+$ abundance ratios are $\sim 10-150$, and the fractional abundance of HOC$^+$ relative to H$_2$ is $\sim 1.5\times 10^{-11} - 6\times 10^{-10}$, which implies that the HOC$^+$ abundance in the center of NGC 253 is significantly higher than in quiescent spiral-arm dark clouds in the Galaxy and the Galactic center clouds. Comparison with chemical models implies either an interstellar radiation field of $G_0\gtrsim 10^3$ if the maximum visual extinction is $\gtrsim 5$, or a cosmic-ray ionization rate of $\zeta \gtrsim 10^{-14}$ s$^{-1}$ (3-4 orders of magnitude higher than that within clouds in the Galactic spiral-arms) to reproduce the observed results. From the difference in formation routes of HOC$^+$, we propose that a low-excitation line of HOC$^+$ traces cosmic-ray dominated regions, while high-excitation lines trace photodissociation regions. Our results suggest that the interstellar medium in the center of NGC 253 is significantly affected by energy input from UV-photons and cosmic rays, sources of energy feedback.


title: Quillen Suslin theory for algebraic fundamental group

abstract: In this paper, we attempt to develop the Quillen Suslin theory for the algebraic fundamental group of a ring. We give a surjective group homomorphism from the algebraic fundamental group of the field of the real numbers to the group of integers. At the end of the paper, we also propose some problems related to the algebraic fundamental group of some particular type of rings.


title: Specification and Validation of Autonomous Driving Systems: A Multilevel Semantic Framework

abstract: Autonomous Driving Systems (ADS) are critical dynamic reconfigurable agent systems whose specification and validation raises extremely challenging problems. The paper presents a multilevel semantic framework for the specification of ADS and discusses associated validation problems. The framework relies on a formal definition of maps modeling the physical environment in which vehicles evolve. Maps are directed metric graphs whose nodes represent positions and edges represent segments of roads. We study basic properties of maps including their geometric consistency. Furthermore, we study position refinement and segment abstraction relations allowing multilevel representation from purely topological to detailed geometric. We progressively define first order logics for modeling families of maps and distributions of vehicles over maps. These are Configuration Logics, which in addition to the usual logical connectives are equipped with a coalescing operator to build configurations of models. We study their semantics and basic properties. We illustrate their use for the specification of traffic rules and scenarios characterizing sequences of scenes. We study various aspects of the validation problem including run-time verification and satisfiability of specifications. Finally, we show links of our framework with practical validation needs for ADS and advocate its adequacy for addressing the many facets of this challenge.


title: Large-scale Autonomous Flight with Real-time Semantic SLAM under Dense Forest Canopy

abstract: Semantic maps represent the environment using a set of semantically meaningful objects. This representation is storage-efficient, less ambiguous, and more informative, thus facilitating large-scale autonomy and the acquisition of actionable information in highly unstructured, GPS-denied environments. In this letter, we propose an integrated system that can perform large-scale autonomous flights and real-time semantic mapping in challenging under-canopy environments. We detect and model tree trunks and ground planes from LiDAR data, which are associated across scans and used to constrain robot poses as well as tree trunk models. The autonomous navigation module utilizes a multi-level planning and mapping framework and computes dynamically feasible trajectories that lead the UAV to build a semantic map of the user-defined region of interest in a computationally and storage efficient manner. A drift-compensation mechanism is designed to minimize the odometry drift using semantic SLAM outputs in real time, while maintaining planner optimality and controller stability. This leads the UAV to execute its mission accurately and safely at scale.


title: Logic-level Evidence Retrieval and Graph-based Verification Network for Table-based Fact Verification

abstract: Table-based fact verification task aims to verify whether the given statement is supported by the given semi-structured table. Symbolic reasoning with logical operations plays a crucial role in this task. Existing methods leverage programs that contain rich logical information to enhance the verification process. However, due to the lack of fully supervised signals in the program generation process, spurious programs can be derived and employed, which leads to the inability of the model to catch helpful logical operations. To address the aforementioned problems, in this work, we formulate the table-based fact verification task as an evidence retrieval and reasoning framework, proposing the Logic-level Evidence Retrieval and Graph-based Verification network (LERGV). Specifically, we first retrieve logic-level program-like evidence from the given table and statement as supplementary evidence for the table. After that, we construct a logic-level graph to capture the logical relations between entities and functions in the retrieved evidence, and design a graph-based verification network to perform logic-level graph-based reasoning based on the constructed graph to classify the final entailment relation. Experimental results on the large-scale benchmark TABFACT show the effectiveness of the proposed approach.


title: AligNART: Non-autoregressive Neural Machine Translation by Jointly Learning to Estimate Alignment and Translate

abstract: Non-autoregressive neural machine translation (NART) models suffer from the multi-modality problem which causes translation inconsistency such as token repetition. Most recent approaches have attempted to solve this problem by implicitly modeling dependencies between outputs. In this paper, we introduce AligNART, which leverages full alignment information to explicitly reduce the modality of the target distribution. AligNART divides the machine translation task into $(i)$ alignment estimation and $(ii)$ translation with aligned decoder inputs, guiding the decoder to focus on simplified one-to-one translation. To alleviate the alignment estimation problem, we further propose a novel alignment decomposition method. Our experiments show that AligNART outperforms previous non-iterative NART models that focus on explicit modality reduction on WMT14 En$\leftrightarrow$De and WMT16 Ro$\rightarrow$En. Furthermore, AligNART achieves BLEU scores comparable to those of the state-of-the-art connectionist temporal classification based models on WMT14 En$\leftrightarrow$De. We also observe that AligNART effectively addresses the token repetition problem even without sequence-level knowledge distillation.


title: Norm principle for even K-groups of number fields

abstract: We investigate the norm maps of algebraic even $K$-groups of finite extensions of number fields. Namely, we show that they are surjective in most situations. In the event that they are not surjective, we give a criterion in determining when an element in the even $K$-group of the base field comes from a norm of an element from the even $K$-groups of the extension field. This latter criterion is only reliant on the real primes of the base field.


title: Overlap-aware low-latency online speaker diarization based on end-to-end local segmentation

abstract: We propose to address online speaker diarization as a combination of incremental clustering and local diarization applied to a rolling buffer updated every 500ms. Every single step of the proposed pipeline is designed to take full advantage of the strong ability of a recently proposed end-to-end overlap-aware segmentation to detect and separate overlapping speakers. In particular, we propose a modified version of the statistics pooling layer (initially introduced in the x-vector architecture) to give less weight to frames where the segmentation model predicts simultaneous speakers. Furthermore, we derive cannot-link constraints from the initial segmentation step to prevent two local speakers from being wrongfully merged during the incremental clustering step. Finally, we show how the latency of the proposed approach can be adjusted between 500ms and 5s to match the requirements of a particular use case, and we provide a systematic analysis of the influence of latency on the overall performance (on AMI, DIHARD and VoxConverse).


title: An Accurate Comprehensive Approach to Substructure: I. Accreted Subhaloes

abstract: This is the first of a series of three Papers devoted to the study of halo substructure in hierarchical cosmologies by means of the CUSP formalism. In the present Paper we derive the properties of subhaloes and diffuse dark matter (dDM) accreted onto haloes and their progenitors. Specifically, we relate the dDM present at any time in the inter-halo medium of the real Universe or a cosmological simulation with the corresponding free-streaming mass or the halo resolution mass, respectively, and establish the link between subhaloes and their seeds in the initial density field. By monitoring the collapse and virialisation of haloes, we derive from first principles and with no single free parameter the abundance and radial distribution of dDM and subhaloes accreted onto them. Our predictions are in excellent agreement with the results of simulations, but for the predicted fraction of accreted dDM, which is larger than reported in previous works as they only count the dDM accreted onto the final halo, not onto its progenitors. The derivation pursued here clarifies the origin of some key features of substructure. Overall, our results demonstrate that CUSP is a powerful tool for understanding halo substructure and extending the results of simulations to haloes with arbitrary masses, redshifts and formation times in any hierarchical cosmology endowed with random Gaussian density perturbations.


title: Coo: Rethink Data Anomalies In Databases

abstract: Transaction processing technology has three important contents: data anomalies, isolation levels, and concurrent control algorithms. Concurrent control algorithms are used to eliminate some or all data anomalies at different isolation levels to ensure data consistency. Isolation levels in the current ANSI standard are defined by disallowing certain kinds of data anomalies. Yet, the definitions of data anomalies in the ANSI standard are controversial. On one hand, the definitions lack a mathematical formalization and cause ambiguous interpretations. On the other hand, the definitions are made in a case-by-case manner and lead to a situation that even a senior DBA could not have infallible knowledge of data anomalies, due to a lack of a full understanding of its nature. While revised definitions in existing literature propose various mathematical formalizations to correct the former argument, how to address the latter argument still remains an open problem. In this paper, we present a general framework called Coo with the capability to systematically define data anomalies. Under this framework, we show that existing reported data anomalies are only a small portion. While we theoretically prove that Coo is complete to mathematically formalize data anomalies, we employ a novel method to classify infinite data anomalies. In addition, we use this framework to define new isolation levels and quantitatively describe the concurrency and rollback rate of mainstream concurrency control algorithms. These works show that the C and I of ACID can be quantitatively analyzed based on all data anomalies.


title: Conditional Synthetic Data Generation for Robust Machine Learning Applications with Limited Pandemic Data

abstract: $\textbf{Background:}$ At the onset of a pandemic, such as COVID-19, data with proper labeling/attributes corresponding to the new disease might be unavailable or sparse. Machine Learning (ML) models trained with the available data, which is limited in quantity and poor in diversity, will often be biased and inaccurate. At the same time, ML algorithms designed to fight pandemics must have good performance and be developed in a time-sensitive manner. To tackle the challenges of limited data, and label scarcity in the available data, we propose generating conditional synthetic data, to be used alongside real data for developing robust ML models. $\textbf{Methods:}$ We present a hybrid model consisting of a conditional generative flow and a classifier for conditional synthetic data generation. The classifier decouples the feature representation for the condition, which is fed to the flow to extract the local noise. We generate synthetic data by manipulating the local noise with fixed conditional feature representation. We also propose a semi-supervised approach to generate synthetic samples in the absence of labels for a majority of the available data. $\textbf{Results:}$ We performed conditional synthetic generation for chest computed tomography (CT) scans corresponding to normal, COVID-19, and pneumonia afflicted patients. We show that our method significantly outperforms existing models both on qualitative and quantitative performance, and our semi-supervised approach can efficiently synthesize conditional samples under label scarcity. As an example of downstream use of synthetic data, we show improvement in COVID-19 detection from CT scans with conditional synthetic data augmentation.


title: D-module approach to Liouville's Theorem for difference operators

abstract: We establish analogues of Liouville's theorem in the complex function theory, with the differential operator replaced by various difference operators. This is done generally by the extraction of (formal) Taylor coefficients using a residue map which measures the obstruction having local "anti-derivative". The residue map is based on a Weyl algebra or $q$-Weyl algebra structure satisfied by each corresponding operator. This explains the different senses of "boundedness" required by the respective analogues of Liouville's theorem in this article.


title: Multilevel profiling of situation and dialogue-based deep networks for movie genre classification using movie trailers

abstract: Automated movie genre classification has emerged as an active and essential area of research and exploration. Short duration movie trailers provide useful insights about the movie as video content consists of the cognitive and the affective level features. Previous approaches were focused upon either cognitive or affective content analysis. In this paper, we propose a novel multi-modality: situation, dialogue, and metadata-based movie genre classification framework that takes both cognition and affect-based features into consideration. A pre-features fusion-based framework that takes into account: situation-based features from a regular snapshot of a trailer that includes nouns and verbs providing the useful affect-based mapping with the corresponding genres, dialogue (speech) based feature from audio, metadata which together provides the relevant information for cognitive and affect based video analysis. We also develop the English movie trailer dataset (EMTD), which contains 2000 Hollywood movie trailers belonging to five popular genres: Action, Romance, Comedy, Horror, and Science Fiction, and perform cross-validation on the standard LMTD-9 dataset for validating the proposed framework. The results demonstrate that the proposed methodology for movie genre classification has performed excellently as depicted by the F1 scores, precision, recall, and area under the precision-recall curves.


title: Instance-wise Graph-based Framework for Multivariate Time Series Forecasting

abstract: The multivariate time series forecasting has attracted more and more attention because of its vital role in different fields in the real world, such as finance, traffic, and weather. In recent years, many research efforts have been proposed for forecasting multivariate time series. Although some previous work considers the interdependencies among different variables in the same timestamp, existing work overlooks the inter-connections between different variables at different time stamps. In this paper, we propose a simple yet efficient instance-wise graph-based framework to utilize the inter-dependencies of different variables at different time stamps for multivariate time series forecasting. The key idea of our framework is aggregating information from the historical time series of different variables to the current time series that we need to forecast. We conduct experiments on the Traffic, Electricity, and Exchange-Rate multivariate time series datasets. The results show that our proposed model outperforms the state-of-the-art baseline methods.


title: An Accurate Comprehensive Approach to Substructure: II. Stripped Subhaloes

abstract: In Paper I we used the CUSP formalism to derive from first principles and no single free parameter the accurate abundance and radial distribution of both diffuse DM (dDM) and subhaloes accreted onto haloes and their progenitors at all previous times. Here we use those results as initial conditions for the monitoring of the evolution of subhaloes and dDM within the host haloes. Specifically, neglecting dynamical friction, we accurately calculate the effects of repetitive tidal stripping and heating on subhaloes as they orbit inside the host halo and infer the amount of dDM and subsubhaloes they release into the intra-halo medium. We then calculate the expected abundance and radial distribution of stripped subhaloes and dDM. This derivation clarifies the role of halo concentration in substructure and unravels the origin of some key features found in simulations including the dependence of substructure on halo mass. In addition, it unveils the specific effects of dynamical friction on substructure. The results derived here are for purely accreting haloes. In Paper III we complete the study by addressing the case of low-mass subhaloes, unaffected by dynamical friction, in ordinary haloes having suffered major mergers.


title: A CMOS compatible platform for high impedance superconducting quantum circuits

abstract: Aluminium based platforms have allowed to reach major milestones for superconducting quantum circuits. For the next generation of devices, materials that are able to maintain low microwave losses while providing new functionalities, such as large kinetic inductance or compatibility with CMOS platform are sought for. Here we report on a combined direct current (DC) and microwave investigation of titanium nitride lms of dierent thicknesses grown using CMOS compatible methods. For microwave resonators made of TiN lm of thickness $\sim$3 nm, we measured large kinetic inductance LK $\sim$ 240 pH/sq, high mode impedance of $\sim$ 4.2 k$\Omega$ while maintaining microwave quality factor $\sim$ 10^5 in the single photon limit. We present an in-depth study of the microwave loss mechanisms in these devices that indicates the importance of quasiparticles and provide insights for further improvement.


title: Imprint of planet formation in the deep interior of the Sun

abstract: Stars grow by accreting gas that has an evolving composition owing to the growth and inward drift of dust (pebble wave), the formation of planetesimals and planets, and the selective removal of hydrogen and helium by disk winds. We investigated how the formation of the Solar System may have affected the composition and structure of the Sun, and whether it plays any role in solving the solar abundance problem. We simulated the evolution of the Sun from the protostellar phase to the present age and attempted to reproduce spectroscopic and helioseismic constraints. We performed chi-squared tests to optimize our input parameters. We confirmed that, for realistic models, planet formation occurs when the solar convective zone is still massive; thus, the overall changes due to planet formation are too small to significantly improve the chi-square fits. We found that solar models with up-to-date abundances require an opacity increase of 12% to 18% centered at $T=10^{6.4}$ K to reproduce the available observational constraints. This is slightly higher than, but is qualitatively in good agreement with, recent measurements of higher iron opacities. These models result in better fits to the observations than those using old abundances; therefore, they are a promising solution to the solar abundance problem. Using these improved models, we found that planet formation processes leave a small imprint in the solar core, whose metallicity is enhanced by up to 5%. This result can be tested by accurately measuring the solar neutrino flux. In the improved models, the protosolar molecular cloud core is characterized by a primordial metallicity in the range 0.0127-0.0157 and a helium mass fraction in the range 0.268-0.274. (abridged)


title: Formal Methods for Quantum Programs: A Survey

abstract: While recent progress in quantum hardware open the door for significant speedup in certain key areas (cryptography, biology, chemistry, optimization, machine learning, etc), quantum algorithms are still hard to implement right, and the validation of such quantum programs is achallenge. Moreover, importing the testing and debugging practices at use in classical programming is extremely difficult in the quantum case, due to the destructive aspect of quantum measurement. As an alternative strategy, formal methods are prone to play a decisive role in the emerging field of quantum software. Recent works initiate solutions for problems occurring at every stage of the development process: high-level program design, implementation, compilation, etc. We review the induced challenges for an efficient use of formal methods in quantum computing and the current most promising research directions.


title: Mathematical Modeling of Cell Collective Motion Triggered By Self-Generated Gradients

abstract: Self-generated gradients have atttracted a lot of attention in the recent biological literature. It is considered as a robust strategy for a group of cells to find its way during a long journey. This note is intended to discuss various scenarios for modeling traveling waves of cells that constantly deplete a chemical cue, and so create their own signaling gradient all along the way. We begin with one famous model by Keller and Segel for bacterial chemotaxis. We present the model and the construction of the traveling wave solutions. We also discuss the limitation of this approach, and review some subsequent work addressing stability issues. Next, we review two relevant extensions, which are supported by biological experiments. They both admit traveling wave solutions with an explicit value for the wave speed. We conclude by discussing some open problems and perspectives, and particularly a striking mechanism of speed determinacy occurring at the back of the wave. All the results presented in this note are illustrated by numerical simulations.


title: Error analysis for 2D stochastic Navier--Stokes equations in bounded domains with Dirichlet data

abstract: We study a finite-element based space-time discretisation for the 2D stochastic Navier-Stokes equations in a bounded domain supplemented with no-slip boundary conditions. We prove optimal convergence rates in the energy norm with respect to convergence in probability, that is convergence of order (almost) 1/2 in time and 1 in space. This was previously only known in the space-periodic case, where higher order energy estimates for any given (deterministic) time are available. In contrast to this, in the Dirichlet-case estimates are only known for a (possibly large) stopping time. We overcome this problem by introducing an approach based on discrete stopping times. This replaces the localised estimates (with respect to the sample space) from earlier contributions.


title: Electron--electron scattering and conductivity of disordered systems with Galilean-invariant spectrum

abstract: The electron--electron scattering does not affect the electrical current in Galilean--invariant systems. We show that nevertheless electron--electron collisions may contribute to the electric resistivity of systems with parabolic spectrum provided that they have multiply connected Fermi surface and there is an additional mechanism of scattering. To this end, we calculate the resistivity of a two-dimensional electron gas with two filled transverse subbands in a presence of electron--electron and impurity scattering. Though the collisions between the electrons do not directly affect the current in such systems, they cause a redistribution of the electrons between the Fermi contours, which results in a noticeable change of resistivity for realistic mechanisms of impurity scattering.


title: The young protostellar disk in IRAS16293-2422 B is hot and shows signatures of gravitational instability

abstract: Deeply embedded protostars are actively fed from their surrounding envelopes through their protostellar disk. The physical structure of such early disks might be different from that of more evolved sources due to the active accretion. We present 1.3 and 3\,mm ALMA continuum observations at resolutions of 6.5\,au and 12\,au respectively, towards the Class 0 source IRAS 16293-2422 B. The resolved brightness temperatures appear remarkably high, with $T_{\rm b} >$ 100\,K within $\sim$30\,au and $T_{\rm b}$ peak over 400\,K at 3\,mm. Both wavelengths show a lopsided emission with a spectral index reaching values less than 2 in the central $\sim$ 20\,au region. We compare these observations with a series of radiative transfer calculations and synthetic observations of magnetohydrodynamic and radiation hydrodynamic protostellar disk models formed after the collapse of a dense core. Based on our results, we argue that the gas kinematics within the disk may play a more significant role in heating the disk than the protostellar radiation. In particular, our radiation hydrodynamic simulation of disk formation, including heating sources associated with gravitational instabilities, is able to generate the temperatures necessary to explain the high fluxes observed in IRAS 16293B. Besides, the low spectral index values are naturally reproduced by the high optical depth and high inner temperatures of the protostellar disk models. The high temperatures in IRAS 16293B imply that volatile species are mostly in the gas phase, suggesting that a self-gravitating disk could be at the origin of a hot corino.


title: Extension of the Hoff solutions framework to cover Navier-Stokes equations for a compressible fluid with anisotropic viscous-stress tensor

abstract: This paper deals with the Navier-Stokes system governing the evolution of a compressible barotropic fluid. We extend D. Hoff's intermediate regularity solutions framework by relaxing the integrability needed for the initial density which is usually assumed to be $L^{\infty}$. By achieving this, we are able to take into account general fourth order symmetric viscous-stress tensors with coefficients depending smoothly on the time-space variables. More precisely, in space dimensions $d=2,3$, under periodic boundary conditions, considering a pressure law $p(\rho)=a\rho^{\gamma}$ whith $a>0$ respectively $\gamma\geq d/(4-d)$) and under the assumption that the norms of the initial data $\left( \rho_{0}-M,u_{0}\right) \in L^{2\gamma}\left(\mathbb{T}^{d}\right) \times(H^{1}(\mathbb{T}^{d}))^{d}$ are sufficiently small, we are able to construct global weak solutions. Above, $M$ denotes the total mass of the fluid while $\mathbb{T}$ with $d=2,3$ stands for periodic box. When comparing to the results known for the global weak solutions \`{a} la Leray, i.e. constructed assuming only the basic energy bounds, we obtain a relaxed condition on the range of admissible adiabatic coefficients $\gamma$.


title: On-Surface Decarboxylation Coupling Facilitated by Lock-to-Unlock Variation of Molecules upon the Reaction

abstract: On-surface synthesis (OSS) involving relatively high energy barriers remains challenging due to a typical dilemma: firm molecular anchor is required to prevent molecular desorption upon the reaction, whereas sufficient lateral mobility is crucial for subsequent coupling and assembly. By locking the molecular precursors on the substrate then unlocking them during the reaction, we present a strategy to address this challenge. High-yield synthesis based on well-defined decarboxylation, intermediate transition and hexamerization is demonstrated, resulting in an extended and ordered network exclusively composed of the newly-synthesized macrocyclic compound. Thanks to the steric hindrance of its maleimide group, we attain a preferential selection of the coupling. This work unlocks a promising path to enrich the reaction types and improve the coupling selectivity hence the structual homogeneity of the final product for OSS.


title: The Dean-Kawasaki equation and the structure of density fluctuations in systems of diffusing particles

abstract: The Dean-Kawasaki equation - a strongly singular SPDE - is a basic equation of fluctuating hydrodynamics; it has been proposed in the physics literature to describe the fluctuations of the density of $N$ independent diffusing particles in the regime of large particle numbers $N\gg 1$. The singular nature of the Dean-Kawasaki equation presents a substantial challenge for both its analysis and its rigorous mathematical justification. Besides being non-renormalisable by the theory of regularity structures by Hairer et al., it has recently been shown to not even admit nontrivial martingale solutions. In the present work, we give a rigorous and fully quantitative justification of the Dean-Kawasaki equation by considering the natural regularisation provided by standard numerical discretisations: We show that structure-preserving discretisations of the Dean-Kawasaki equation may approximate the density fluctuations of $N$ non-interacting diffusing particles to arbitrary order in $N^{-1}$ (in suitable weak metrics). In other words, the Dean-Kawasaki equation may be interpreted as a "recipe" for accurate and efficient numerical simulations of the density fluctuations of independent diffusing particles.


title: conSultantBERT: Fine-tuned Siamese Sentence-BERT for Matching Jobs and Job Seekers

abstract: In this paper we focus on constructing useful embeddings of textual information in vacancies and resumes, which we aim to incorporate as features into job to job seeker matching models alongside other features. We explain our task where noisy data from parsed resumes, heterogeneous nature of the different sources of data, and crosslinguality and multilinguality present domain-specific challenges. We address these challenges by fine-tuning a Siamese Sentence-BERT (SBERT) model, which we call conSultantBERT, using a large-scale, real-world, and high quality dataset of over 270,000 resume-vacancy pairs labeled by our staffing consultants. We show how our fine-tuned model significantly outperforms unsupervised and supervised baselines that rely on TF-IDF-weighted feature vectors and BERT embeddings. In addition, we find our model successfully matches cross-lingual and multilingual textual content.


title: Subsurface Carbon-Induced Local Charge of Copper for On-Surface Displacement Reaction

abstract: Transition metal carbides have sparked unprecedented enthusiasm as high-performance catalysts in recent years. Still, the catalytic properties of copper (Cu) carbide remain unexplored. By introducing subsurface carbon (C) to Cu(111), displacement reaction of proton in carboxyl acid group with single Cu atom is demonstrated at the atomic scale and room temperature. Its occurrence is attributed to the C-doping induced local charge of surface Cu atoms (up to +0.30 e/atom), which accelerates the rate of on-surface deprotonation via reduction of the corresponding energy barrier, thus enabling the instant displacement of a proton with a Cu atom when the molecules land on the surface. Such well-defined and robust Cu$^{\delta +}$ surface based on the subsurface C doping offers a novel catalytic platform for on-surface synthesis.


title: Beam halo from Touschek scattering in the KEK Accelerator Test Facility

abstract: Beam halo is one of the crucial issues limiting the machine performance and causing radioactivation in high-intensity accelerators. A clear picture of beam-halo formation is of great importance for successful suppression of the undesired beam loss. We present numerical and experimental studies of transverse and longitudinal halos in the KEK Accelerator Test Facility. The fair accordance between predictions and observations in various conditions indicates that the Touschek scattering is the dominant mechanism forming the horizontal and momentum halos.


title: Nonlinear Robust Periodic Output Regulation of Minimum Phase Systems

abstract: In linear systems theory it's a well known fact that a regulator given by the cascade of an oscillatory dynamics, driven by some regulated variables, and of a stabiliser stabilising the cascade of the plant and of the oscillators has the ability of blocking on the steady state of the regulated variables any harmonics matched with the ones of the oscillators. This is the well-celebrated internal model principle. In this paper we are interested to follow the same design route for a controlled plant that is a nonlinear and periodic system with period T : we add a bunch of linear oscillators, embedding n o harmonics that are multiple of 2$\pi$/T , driven by a "regulated variable" of the nonlinear system, we look for a stabiliser for the nonlinear cascade of the plant and the oscillators, and we study the asymptotic properties of the resulting closedloop regulated variable. In this framework the contributions of the paper are multiple: for specific class of minimum-phase systems we present a systematic way of designing a stabiliser, which is uniform with respect to n o , by using a mix of high-gain and forwarding techniques; we prove that the resulting closed-loop system has a periodic steady state with period T with a domain of attraction not shrinking with n o ; similarly to the linear case, we also show that the spectrum of the steady state closed-loop regulated variable does not contain the n harmonics embedded in the bunch of oscillators and that the L 2 norm of the regulated variable is a monotonically decreasing function of n o. The results are robust, namely the asymptotic properties on the regulated variable hold also in presence of any uncertainties in the controlled plant not destroying closed-loop stability.


title: Optimal To-Do List Gamification for Long Term Planning

abstract: Most people struggle with prioritizing work. While inexact heuristics have been developed over time, there is still no tractable principled algorithm for deciding which of the many possible tasks one should tackle in any given day, month, week, or year. Additionally, some people suffer from cognitive biases such as the present bias, leading to prioritization of their immediate experience over long-term consequences which manifests itself as procrastination and inefficient task prioritization. Our method utilizes optimal gamification to help people overcome these problems by incentivizing each task by a number of points that convey how valuable it is in the long-run. We extend the previous version of our optimal gamification method with added services for helping people decide which tasks should and should not be done when there is not enough time to do everything. To improve the efficiency and scalability of the to-do list solver, we designed a hierarchical procedure that tackles the problem from the top-level goals to fine-grained tasks. We test the accuracy of the incentivised to-do list by comparing the performance of the strategy with the points computed exactly using Value Iteration for a variety of case studies. These case studies were specifically designed to cover the corner cases to get an accurate judge of performance. Our method yielded the same performance as the exact method for all case studies. To demonstrate its functionality, we released an API that makes it easy to deploy our method in Web and app services. We assessed the scalability of our method by applying it to to-do lists with increasingly larger numbers of goals, sub-goals per goal, hierarchically nested levels of subgoals. We found that the method provided through our API is able to tackle fairly large to-do lists having a 576 tasks. This indicates that our method is suitable for real-world applications.


title: Radiogenic neutron background in reactor neutrino experiments

abstract: We report a novel correlated background in the antineutrino detection using the inverse beta decay reaction. Spontaneous fissions and $(\alpha,n)$ reactions in peripheral materials of the antineutrino detector, such as borosilicate glass of photomultipliers, produce fast neutrons and prompt gamma rays. If the shielding from the material to the detector target were not thick enough, neutrons and gammas could enter the target volume and mimic antineutrino signals. This paper revisits the yields and energy spectra of neutrons produced in B$(\alpha,n)$N and F$(\alpha,n)$Na reactions. A Geant4 based simulation has been carried out using a simplified detector geometry for the present generation reactor neutrino experiments. The background rates in these experiments are estimated. If this background was not taken into account, the value of the neutrino mixing angle $\sin^22\theta_{13}$ would be underestimated. We recommend that Daya Bay, RENO, Double Chooz, and JUNO, carefully examine the masses and radiopurity levels of detector materials that are close to the target and rich in boron and fluorine.


title: On a Runge Theorem over $\mathbb{R}_3$

abstract: In this paper we investigate a topological characterization of the Runge theorem in the Clifford algebra $ \mathbb{R}_3$ via the description of the homology groups of axially symmetric open subsets of the quadratic cone in $\mathbb{R}_3$.


title: Tribrid: Stance Classification with Neural Inconsistency Detection

abstract: We study the problem of performing automatic stance classification on social media with neural architectures such as BERT. Although these architectures deliver impressive results, their level is not yet comparable to the one of humans and they might produce errors that have a significant impact on the downstream task (e.g., fact-checking). To improve the performance, we present a new neural architecture where the input also includes automatically generated negated perspectives over a given claim. The model is jointly learned to make simultaneously multiple predictions, which can be used either to improve the classification of the original perspective or to filter out doubtful predictions. In the first case, we propose a weakly supervised method for combining the predictions into a final one. In the second case, we show that using the confidence scores to remove doubtful predictions allows our method to achieve human-like performance over the retained information, which is still a sizable part of the original input.


title: GSP-spec line list for the parametrisation of Gaia -RVS stellar spectra

abstract: The Gaia mission is a magnitude-limited whole-sky survey that collects an impressive quantity of astrometric, spectro-photometric and spectroscopic data. Among all the on-board instruments, the Radial Velocity Spectrometer (RVS) produces millions of spectra up to a magnitude of G$_{RVS} \sim 16$. For the brightest RVS targets, stellar atmospheric parameters and individual chemical abundances are automatically estimated by the Generalized Stellar Parametriser - spectroscopy group (GSP-Spec). These data will be published with the third Gaia Data Release. Some major ingredients of the determination of these stellar parameters include the atomic and molecular line lists that are adopted to compute reference synthetic spectra, on which the parametrisation methods rely. We aim to build such a specific line list optimised for the analysis of RVS late-type star spectra. Starting from the Gaia-ESO line lists, we first compared the observed and synthetic spectra of six well-known reference late-type stars in the wavelength range covered by the RVS instrument. We then improved the quality of the atomic data for the transitions presenting the largest mismatches. The new line list is found to produce very high-quality synthetic spectra for the tested reference stars and has thus been adopted within GSP-Spec.


title: On the bilateral preconditioning for an L2-type all-at-once system arising from time-space fractional Bloch-Torrey equations

abstract: Time-space fractional Bloch-Torrey equations (TSFBTEs) are developed by some researchers to investigate the relationship between diffusion and fractional-order dynamics. In this paper, we first propose a second-order implicit difference scheme for TSFBTEs by employing the recently proposed L2-type formula [A.~A.~Alikhanov, C.~Huang, Appl.~Math.~Comput.~(2021) 126545]. Then, we prove the stability and the convergence of the proposed scheme. Based on such a numerical scheme, an L2-type all-at-once system is derived. In order to solve this system in a parallel-in-time pattern, a bilateral preconditioning technique is designed to accelerate the convergence of Krylov subspace solvers according to the special structure of the coefficient matrix of the system. We theoretically show that the condition number of the preconditioned matrix is uniformly bounded by a constant for the time fractional order $\alpha \in (0,0.3624)$. Numerical results are reported to show the efficiency of our method.


title: Geometric analysis of gaits and optimal control for three-link kinematic swimmers

abstract: Many robotic systems locomote using gaits - periodic changes of internal shape, whose mechanical interaction with the robot's environment generate characteristic net displacements. Prominent examples with two shape variables are the low Reynolds number 3-link "Purcell swimmer" with inputs of 2 joint angles and the "ideal fluid" swimmer. Gait analysis of these systems allows for intelligent decisions to be made about the swimmer's locomotive properties, increasing the potential for robotic autonomy. In this work, we present comparative analysis of gait optimization using two different methods. The first method is variational approach of "Pontryagin's maximum principle" (PMP) from optimal control theory. We apply PMP for several variants of 3-link swimmers, with and without incorporation of bounds on joint angles. The second method is differential-geometric analysis of the gaits based on curvature (total Lie bracket) of the local connection for 3-link swimmers. Using optimized body-motion coordinates, contour plots of the curvature in shape space give visualization that enables identifying distance-optimal gaits as zero level sets. Combining and comparing results of the two methods enables better understanding of changes in existence, shape and topology of distance-optimal gait trajectories, depending on the swimmers' parameters.


title: Integrable Abel equation and asymptotics of symmetry solutions of Korteweg-de Vries equation

abstract: We provide a general solution for a first order ordinary differential equation with a rational right-hand side, which arises in constructing asymptotics for large time of simultaneous solutions of the Korteweg-de Vries equation and the stationary part of its higher non-autonomous symmetry. This symmetry is determined by a linear combination of the first higher autonomous symmetry of the Korteweg-de Vries equation and of its classical Galileo symmetry. This general solution depends on an arbitrary parameter. By the implicit function theorem, locally it is determined by the first integral explicitly written in terms of hypergeometric functions. A particular case of the general solution defines self-similar solutions of the Whitham equations, found earlier by G.V. Potemin in 1988. In the well-known works by A.V. Gurevich and L.P. Pitaevsky in early 1970s, it was established that these solutions of the Whitham equations describe the origination in the leading term of non-damping oscillating waves in a wide range of problems with a small dispersion. The result of this article supports once again an empirical rule saying that under various passages to the limits, integrable equations can produce only integrable, in certain sense, equations. We propose a general conjecture: integrable ordinary differential equations similar to that considered in the present paper should also arise in describing the asymptotics at large times for other symmetry solutions to evolution equations admitting the application of the method of inverse scattering problem.


title: Exploring Prompt-based Few-shot Learning for Grounded Dialog Generation

abstract: Dialog models can be greatly strengthened through grounding on various external information, but grounded dialog corpora are usually not naturally accessible. In this work, we focus on the few-shot learning for grounded dialog generation (GDG). We first propose a simple prompting method for GDG tasks, where different constructs of model input, such as the grounding source and the conversation context, are distinguished through continuous or discrete prompts. On three typical GDG tasks, we empirically demonstrate and analyze in-depth the effectiveness of our method. We then conduct extensive experiments to thoroughly investigate how our prompting method works with different pre-trained models. We show that prompted language models perform superiorly to conversational models, and further analyze various factors that influence the effects of prompting. Overall, our work introduces a prompt-based perspective to the few-shot learning for GDG tasks, and provides valuable findings and insights for future research.


title: Vision Transformer for Learning Driving Policies in Complex Multi-Agent Environments

abstract: Driving in a complex urban environment is a difficult task that requires a complex decision policy. In order to make informed decisions, one needs to gain an understanding of the long-range context and the importance of other vehicles. In this work, we propose to use Vision Transformer (ViT) to learn a driving policy in urban settings with birds-eye-view (BEV) input images. The ViT network learns the global context of the scene more effectively than with earlier proposed Convolutional Neural Networks (ConvNets). Furthermore, ViT's attention mechanism helps to learn an attention map for the scene which allows the ego car to determine which surrounding cars are important to its next decision. We demonstrate that a DQN agent with a ViT backbone outperforms baseline algorithms with ConvNet backbones pre-trained in various ways. In particular, the proposed method helps reinforcement learning algorithms to learn faster, with increased performance and less data than baselines.


title: Netmarble AI Center's WMT21 Automatic Post-Editing Shared Task Submission

abstract: This paper describes Netmarble's submission to WMT21 Automatic Post-Editing (APE) Shared Task for the English-German language pair. First, we propose a Curriculum Training Strategy in training stages. Facebook Fair's WMT19 news translation model was chosen to engage the large and powerful pre-trained neural networks. Then, we post-train the translation model with different levels of data at each training stages. As the training stages go on, we make the system learn to solve multiple tasks by adding extra information at different training stages gradually. We also show a way to utilize the additional data in large volume for APE tasks. For further improvement, we apply Multi-Task Learning Strategy with the Dynamic Weight Average during the fine-tuning stage. To fine-tune the APE corpus with limited data, we add some related subtasks to learn a unified representation. Finally, for better performance, we leverage external translations as augmented machine translation (MT) during the post-training and fine-tuning. As experimental results show, our APE system significantly improves the translations of provided MT results by -2.848 and +3.74 on the development dataset in terms of TER and BLEU, respectively. It also demonstrates its effectiveness on the test dataset with higher quality than the development dataset.


title: Designing Multi-Stage Coupled Convex Programming with Data-Driven McCormick Envelope Relaxations for Motion Planning

abstract: For multi-limbed robots, motion planning with posture and force constraints tends to be a difficult optimization problem due to nonlinearities, which also present extended solve times. We propose a multi-stage optimization framework with data-driven inter-stage coupling constraints to address the nonlinearity. Both clustering and evolutionary approaches to find the McCormick envelope relaxations are used to find the problem-specific parameters. The learned constraints are then used in the prior stages, which provides advanced knowledge of the following stages. This leads to improved solve times and interpretability of the results. The planner is validated through multiple walking and climbing tasks on a 10 kg hexapod robot.


title: On a general variational framework for existence and uniqueness in Differential Equations

abstract: Starting from the classic contraction mapping principle, we establish a general, flexible, variational setting that turns out to be applicable to many situations of existence in Differential Equations. We show its potentiality with some selected examples including initial-value, Cauchy problems for ODEs; non-linear, monotone PDEs; linear and non-linear hyperbolic problems; and steady Navier-Stokes systems.


title: Magnon Condensation in Dimerized Antiferromagnets with Spin-Orbit Coupling

abstract: Bose-Einstein condensation (BEC) of triplet excitations triggered by a magnetic field, sometimes called magnon BEC, in dimerized antiferromagnets gives rise to a long-range antiferromagnetic order in the plane perpendicular to the applied magnetic field. To explore the effects of spin-orbit coupling on magnon condensation, we study a spin model on a distorted honeycomb lattice with dimerized Heisenberg exchange ($J$ terms) and uniform off-diagonal exchange ($\Gamma'$ terms) interactions. Via variational Monte Carlo calculations and spin-wave theory, we find that an out-of-plane magnetic field can induce different types of long-range magnetic orders, no matter if the ground state is a non-magnetic dimerized state or an ordered N\'{e}el state. Furthermore, the critical properties of field-driven phase transitions in the presence of spin-orbit couplings, as illustrated from spin-wave spectrum and interpreted by effective field theory, can be different from the conventional magnon BEC. Our study is helpful to understand the rich phases of spin-orbit coupled antiferromagnets induced by magnetic fields.


title: PRETUS: A plug-in based platform for real-time ultrasound imaging research

abstract: We present PRETUS -a Plugin-based Real Time UltraSound software platform for live ultrasound image analysis and operator support. The software is lightweight; functionality is brought in via independent plug-ins that can be arranged in sequence. The software allows to capture the real-time stream of ultrasound images from virtually any ultrasound machine, applies computational methods and visualises the results on-the-fly. Plug-ins can run concurrently without blocking each other. They can be implemented in C ++ and Python. A graphical user interface can be implemented for each plug-in, and presented to the user in a compact way. The software is free and open source, and allows for rapid prototyping and testing of real-time ultrasound imaging methods in a manufacturer-agnostic fashion. The software is provided with input, output and processing plug-ins, as well as with tutorials to illustrate how to develop new plug-ins for PRETUS.


title: A Double-Linked Blockchain Approach Based on Proof-of-Refundable-Tax Consensus Algorithm

abstract: In this paper we propose a double-linked blockchain data structure that greatly improves blockchain performance and guarantees single chain with no forks. Additionally, with the proposed proof-of-refundable-tax (PoRT) consensus algorithm, our approach can construct highly reliable, efficient, fair and stable blockchain operations. The PoRT algorithm adopts a verifiable random function instead of mining to select future block maintainers with the probability proportional to each participant's personal refundable tax. The individual refundable tax serves as an index of the activeness of participation and hence PoRT can effectively prevent Sybil attacks. Also, with the block-completion reward deducted from each maintainer's refundable tax, our blockchain system maintains a stable wealth distribution and avoids the "rich become richer" problem. We have implemented the approach and tested with very promising results.


title: Efficient Sampling of Dependency Structures

abstract: Probabilistic distributions over spanning trees in directed graphs are a fundamental model of dependency structure in natural language processing, syntactic dependency trees. In NLP, dependency trees often have an additional root constraint: only one edge may emanate from the root. However, no sampling algorithm has been presented in the literature to account for this additional constraint. In this paper, we adapt two spanning tree sampling algorithms to faithfully sample dependency trees from a graph subject to the root constraint. Wilson (1996)'s sampling algorithm has a running time of $\mathcal{O}(H)$ where $H$ is the mean hitting time of the graph. Colbourn (1996)'s sampling algorithm has a running time of $\mathcal{O}(N^3)$, which is often greater than the mean hitting time of a directed graph. Additionally, we build upon Colbourn's algorithm and present a novel extension that can sample $K$ trees without replacement in $\mathcal{O}(K N^3 + K^2 N)$ time. To the best of our knowledge, no algorithm has been given for sampling spanning trees without replacement from a directed graph.


title: New Extremal Binary Self-Dual Codes of Length 72 from $M_6(\mathbb{F}_2)G$ - Group Matrix Rings by a Hybrid Search Technique Based on a Neighbourhood-Virus Optimisation Algorithm

abstract: In this paper, a new search technique based on the virus optimisation algorithm is proposed for calculating the neighbours of binary self-dual codes. The aim of this new technique is to calculate neighbours of self-dual codes without reducing the search field in the search process (this is a known in the literature approach due to the computational time constraint) but still obtaining results in a reasonable time (significantly faster when compared to the standard linear computational search). We employ this new search algorithm to the well-known neighbour method and its extension, the $k^{th}$-range neighbours and search for binary $[72,36,12]$ self-dual codes. In particular, we present six generator matrices of the form $[I_{36} \ | \ \tau_6(v)],$ where $I_{36}$ is the $36 \times 36$ identity matrix, $v$ is an element in the group matrix ring $M_6(\mathbb{F}_2)G$ and $G$ is a finite group of order 6, which we then employ to the proposed algorithm and search for binary $[72,36,12]$ self-dual codes directly over the finite field $\mathbb{F}_2$. We construct 1471 new Type I binary $[72, 36, 12]$ self-dual codes with the rare parameters $\gamma=11, 13, 14, 15, 17, 19, 20, 21, 22, 23, 25, 26, 28, 29, 30, 31, 32$ in their weight enumerators.


title: Dependability Analysis of Deep Reinforcement Learning based Robotics and Autonomous Systems through Probabilistic Model Checking

abstract: While Deep Reinforcement Learning (DRL) provides transformational capabilities to the control of Robotics and Autonomous Systems (RAS), the black-box nature of DRL and uncertain deployment environments of RAS pose new challenges on its dependability. Although existing works impose constraints on the DRL policy to ensure successful completion of the mission, it is far from adequate to assess the DRL-driven RAS in a holistic way considering all dependability properties. In this paper, we formally define a set of dependability properties in temporal logic and construct a Discrete-Time Markov Chain (DTMC) to model the dynamics of risk/failures of a DRL-driven RAS interacting with the stochastic environment. We then conduct Probabilistic Model Checking (PMC) on the designed DTMC to verify those properties. Our experimental results show that the proposed method is effective as a holistic assessment framework while uncovering conflicts between the properties that may need trade-offs in training. Moreover, we find that the standard DRL training cannot improve dependability properties, thus requiring bespoke optimisation objectives. Finally, our method offers sensitivity analysis of dependability properties to disturbance levels from environments, providing insights for the assurance of real RAS.


title: Different Strokes for Different Folks: Investigating Appropriate Further Pre-training Approaches for Diverse Dialogue Tasks

abstract: Loading models pre-trained on the large-scale corpus in the general domain and fine-tuning them on specific downstream tasks is gradually becoming a paradigm in Natural Language Processing. Previous investigations prove that introducing a further pre-training phase between pre-training and fine-tuning phases to adapt the model on the domain-specific unlabeled data can bring positive effects. However, most of these further pre-training works just keep running the conventional pre-training task, e.g., masked language model, which can be regarded as the domain adaptation to bridge the data distribution gap. After observing diverse downstream tasks, we suggest that different tasks may also need a further pre-training phase with appropriate training tasks to bridge the task formulation gap. To investigate this, we carry out a study for improving multiple task-oriented dialogue downstream tasks through designing various tasks at the further pre-training phase. The experiment shows that different downstream tasks prefer different further pre-training tasks, which have intrinsic correlation and most further pre-training tasks significantly improve certain target tasks rather than all. Our investigation indicates that it is of great importance and effectiveness to design appropriate further pre-training tasks modeling specific information that benefit downstream tasks. Besides, we present multiple constructive empirical conclusions for enhancing task-oriented dialogues.


title: Effective Mathematical Modelling of Health Passes during a Pandemic

abstract: We study the impact on the epidemiological dynamics of a class of restrictive measures that are aimed at reducing the number of contacts of individuals who have a higher risk of being infected with a transmittable disease. Such measures are currently either implemented or at least discussed in numerous countries worldwide to ward off a potential new wave of COVID-19 across Europe. They come in the form of Health Passes (HP), which grant full access to public life only to individuals with a certificate that proves that they have either been fully vaccinated, have recovered from a previous infection or have recently tested negative to SARS-Cov-19 . We develop both a compartmental model as well as an epidemic Renormalisation Group approach, which is capable of describing the dynamics over a longer period of time, notably an entire epidemiological wave. Introducing different versions of HPs in this model, we are capable of providing quantitative estimates on the effectiveness of the underlying measures as a function of the fraction of the population that is vaccinated and the vaccination rate. We apply our models to the latest COVID-19 wave in several European countries, notably Germany and Austria, which validate our theoretical findings.


title: Image-Based Alignment of 3D Scans

abstract: Full 3D scanning can efficiently be obtained using structured light scanning combined with a rotation stage. In this setting it is, however, necessary to reposition the object and scan it in different poses in order to cover the entire object. In this case, correspondence between the scans is lost, since the object was moved. In this paper, we propose a fully automatic method for aligning the scans of an object in two different poses. This is done by matching 2D features between images from two poses and utilizing correspondence between the images and the scanned point clouds. To demonstrate the approach, we present the results of scanning three dissimilar objects.


title: Learning Bill Similarity with Annotated and Augmented Corpora of Bills

abstract: Bill writing is a critical element of representative democracy. However, it is often overlooked that most legislative bills are derived, or even directly copied, from other bills. Despite the significance of bill-to-bill linkages for understanding the legislative process, existing approaches fail to address semantic similarities across bills, let alone reordering or paraphrasing which are prevalent in legal document writing. In this paper, we overcome these limitations by proposing a 5-class classification task that closely reflects the nature of the bill generation process. In doing so, we construct a human-labeled dataset of 4,721 bill-to-bill relationships at the subsection-level and release this annotated dataset to the research community. To augment the dataset, we generate synthetic data with varying degrees of similarity, mimicking the complex bill writing process. We use BERT variants and apply multi-stage training, sequentially fine-tuning our models with synthetic and human-labeled datasets. We find that the predictive performance significantly improves when training with both human-labeled and synthetic data. Finally, we apply our trained model to infer section- and bill-level similarities. Our analysis shows that the proposed methodology successfully captures the similarities across legal documents at various levels of aggregation.


title: Fundamental transfer matrix and dynamical formulation of stationary scattering in two and three dimensions

abstract: We offer a consistent dynamical formulation of stationary scattering in two and three dimensions that is based on a suitable multidimensional generalization of the transfer matrix. This is a linear operator acting in an infinite-dimensional function space which we can represent as a $2\times 2$ matrix with operator entries. This operator encodes the information about the scattering properties of the potential and enjoys an analog of the composition property of its one-dimensional ancestor. Our results improve an earlier attempt in this direction [Phys. Rev. A 93, 042707 (2016)] by elucidating the role of the evanescent waves. In particular, we show that a proper formulation of this approach requires the introduction of a pair of intertwined transfer matrices each related to the time-evolution operator for an effective non-unitary quantum system. We study the application of our findings in the treatment of the scattering problem for delta-function potentials in two and three dimensions and clarify its implicit regularization property which circumvents the singular terms appearing in the standard treatments of these potentials. We also discuss the utility of our approach in characterizing invisible (scattering-free) potentials and potentials for which the first Born approximation provides the exact expression for the scattering amplitude.


title: A probabilistic point of view for the Kolmogorov hypoelliptic equations

abstract: In this work, we propose a method for solving Kolmogorov hypoelliptic equations based on Fourier transform and Feynman-Kac formula. We first explain how the Feynman-Kac formula can be used to compute the fundamental solution to parabolic equations with linear or quadratic potential. Then applying these results after a Fourier transform we deduce the computation of the solution to a a first class of Kolmogorov hypoelliptic equations. Then we solve partial differential equations obtained via Feynman-Kac formula from the Ornstein-Uhlenbeck generator. Also, a new small time approximation of the solution to Kolmogorov hypoelliptic equations is provided. We finally present the results of numerical experiments to check the practical efficiency of this approximation.