title: Local origins of quantum correlations rooted in geometric algebra

abstract: In previous publications I have proposed a geometrical framework underpinning the local, realistic, and deterministic origins of the strong quantum correlations observed in Nature, without resorting to superdeterminism, retrocausality, or other conspiracy loopholes usually employed to circumvent Bell's argument against such a possibility. The geometrical framework I have proposed is based on a Clifford-algebraic interplay between the quaternionic 3-sphere, or $S^3$, which I have taken to model the geometry of the three-dimensional physical space in which we are confined to perform all our physical experiments, and an octonion-like 7-sphere, or $S^7$, which arises as an algebraic representation space of this quaternionic 3-sphere. In this paper I first review the above geometrical framework, then strengthen its Clifford-algebraic foundations employing the language of geometric algebra, and finally refute some of its critiques.


title: User Clustering for Rate Splitting using Machine Learning

abstract: Hierarchical Rate Splitting (HRS) schemes proposed in recent years have shown to provide significant improvements in exploiting spatial diversity in wireless networks and provide high throughput for all users while minimising interference among them. Hence, one of the major challenges for such HRS schemes is the necessity to know the optimal clustering of these users based only on their Channel State Information (CSI). This clustering problem is known to be NP hard and, to deal with the unmanageable complexity of finding an optimal solution, in this work a scalable and much lighter clustering mechanism based on Neural Network (NN) is proposed. The accuracy and performance metrics show that the NN is able to learn and cluster the users based on the noisy channel response and is able to achieve a rate comparable to other more complex clustering schemes from the literature.


title: Looking for a Handsome Carpenter! Debiasing GPT-3 Job Advertisements

abstract: The growing capability and availability of generative language models has enabled a wide range of new downstream tasks. Academic research has identified, quantified and mitigated biases present in language models but is rarely tailored to downstream tasks where wider impact on individuals and society can be felt. In this work, we leverage one popular generative language model, GPT-3, with the goal of writing unbiased and realistic job advertisements. We first assess the bias and realism of zero-shot generated advertisements and compare them to real-world advertisements. We then evaluate prompt-engineering and fine-tuning as debiasing methods. We find that prompt-engineering with diversity-encouraging prompts gives no significant improvement to bias, nor realism. Conversely, fine-tuning, especially on unbiased real advertisements, can improve realism and reduce bias.


title: Exploring the limits of multifunctionality across different reservoir computers

abstract: Multifunctional neural networks are capable of performing more than one task without changing any network connections. In this paper we explore the performance of a continuous-time, leaky-integrator, and next-generation `reservoir computer' (RC), when trained on tasks which test the limits of multifunctionality. In the first task we train each RC to reconstruct a coexistence of chaotic attractors from different dynamical systems. By moving the data describing these attractors closer together, we find that the extent to which each RC can reconstruct both attractors diminishes as they begin to overlap in state space. In order to provide a greater understanding of this inhibiting effect, in the second task we train each RC to reconstruct a coexistence of two circular orbits which differ only in the direction of rotation. We examine the critical effects that certain parameters can have in each RC to achieve multifunctionality in this extreme case of completely overlapping training data.


title: Learned Digital Back-Propagation for Dual-Polarization Dispersion Managed Systems

abstract: Digital back-propagation (DBP) and learned DBP (LDBP) are proposed for nonlinearity mitigation in WDM dual-polarization dispersion-managed systems. LDBP achieves Q-factor improvement of 1.8 dB and 1.2 dB, respectively, over linear equalization and a variant of DBP adapted to DM systems.


title: Detecting the impact of nuclear reactions on neutron star mergers through gravitational waves

abstract: Nuclear reactions may affect gravitational-wave signals from neutron-star mergers, but the impact is uncertain. In order to quantify the effect, we compare two numerical simulations representing intuitive extremes. In one case reactions happen instantaneously. In the other case, they occur on timescales much slower than the evolutionary timescale. We show that, while the differences in the two gravitational-wave signals are small, they should be detectable by third-generation observatories. To avoid systematic errors in equation of state parameters inferred from observed signals, we need to accurately implement nuclear reactions in future simulations.


title: Markedness in Visual Semantic AI

abstract: We evaluate the state-of-the-art multimodal "visual semantic" model CLIP ("Contrastive Language Image Pretraining") for biases related to the marking of age, gender, and race or ethnicity. Given the option to label an image as "a photo of a person" or to select a label denoting race or ethnicity, CLIP chooses the "person" label 47.9% of the time for White individuals, compared with 5.0% or less for individuals who are Black, East Asian, Southeast Asian, Indian, or Latino or Hispanic. The model is more likely to rank the unmarked "person" label higher than labels denoting gender for Male individuals (26.7% of the time) vs. Female individuals (15.2% of the time). Age affects whether an individual is marked by the model: Female individuals under the age of 20 are more likely than Male individuals to be marked with a gender label, but less likely to be marked with an age label, while Female individuals over the age of 40 are more likely to be marked based on age than Male individuals. We also examine the self-similarity (mean pairwise cosine similarity) for each social group, where higher self-similarity denotes greater attention directed by CLIP to the shared characteristics (age, race, or gender) of the social group. As age increases, the self-similarity of representations of Female individuals increases at a higher rate than for Male individuals, with the disparity most pronounced at the "more than 70" age range. All ten of the most self-similar social groups are individuals under the age of 10 or over the age of 70, and six of the ten are Female individuals. Existing biases of self-similarity and markedness between Male and Female gender groups are further exacerbated when the groups compared are individuals who are White and Male and individuals who are Black and Female. Results indicate that CLIP reflects the biases of the language and society which produced its training data.


title: Fractional SEIR Model and Data-Driven Predictions of COVID-19 Dynamics of Omicron Variant

abstract: We study the dynamic evolution of COVID-19 cased by the Omicron variant via a fractional susceptible-exposedinfected-removed (SEIR) model. Preliminary data suggest that the symptoms of Omicron infection are not prominent and the transmission is therefore more concealed, which causes a relatively slow increase in the detected cases of the new infected at the beginning of the pandemic. To characterize the specific dynamics, the Caputo-Hadamard fractional derivative is adopted to refined the classical SEIR model. Based on the reported data, we infer the fractional order, timedependent parameters, as well as unobserved dynamics of the fractional SEIR model via fractional physics-informed neural networks (fPINNs). Then, we make short-time predictions using the learned fractional SEIR model.


title: Outliers Dimensions that Disrupt Transformers Are Driven by Frequency

abstract: While Transformer-based language models are generally very robust to pruning, there is the recently discovered outlier phenomenon: disabling only 48 out of 110M parameters in BERT-base drops its performance by nearly 30% on MNLI. We replicate the original evidence for the outlier phenomenon and we link it to the geometry of the embedding space. We find that in both BERT and RoBERTa the magnitude of hidden state coefficients corresponding to outlier dimensions correlates with the frequency of encoded tokens in pre-training data, and it also contributes to the "vertical" self-attention pattern enabling the model to focus on the special tokens. This explains the drop in performance from disabling the outliers, and it suggests that to decrease anisotropicity in future models we need pre-training schemas that would better take into account the skewed token distributions.


title: Vibronic branching ratios for nearly-closed rapid photon cycling of SrOH

abstract: The vibrational branching ratios of SrOH for radiative decay to the ground electronic state, $X^{2}\Sigma^{+}$, from the first two electronically excited states, $A^{2}\Pi$ and $B^{2}\Sigma^{+}$, are determined experimentally at the $\sim10^{-5}$ level. The observed small branching ratios enable the design of a full, practical laser-cooling scheme, including magneto-optical trapping and sub-Doppler laser cooling, with $>10^4$ photon scatters per molecule. Ab initio calculations sensitive to weak vibronic transitions are performed to facilitate the experimental measurement and analysis, and show good agreement with experiment.


title: Initial performance of the GlueX DIRC detector

abstract: The GlueX experiment at Jefferson Laboratory aims to perform quantitative tests of non-perturbative QCD by studying the spectrum of light-quark mesons and baryons. A Detector of Internally Reflected Cherenkov light (DIRC) was installed to enhance the particle identification (PID) capability of the GlueX experiment by providing clean $\pi$/K separation up to 3.7 GeV/$c$ momentum in the forward region ($\theta<11^{\circ}$), which will allow the study of hybrid mesons decaying into kaon final states with significantly higher efficiency and purity. The new PID system is constructed with radiators from the decommissioned BaBar DIRC counter, combined with new compact photon cameras based on the SuperB FDIRC concept. The full system was successfully installed and commissioned with beam during 2019/2020. The initial PID performance of the system was evaluated and compared to one from Geant4 simulation.


title: Probing the phase transition to a coherent 2D Kondo lattice

abstract: Strongly correlated materials exhibit exotic electronic states arising from the strong correlation between electrons. Dimensionality provides a tuning knob because thinning down to atomic thickness reduces screening effects and enhances electron correlations. In this work, a 2D Kondo lattice has been created by stacking a layer of 1T-TaS2 on a 2H-TaS2 crystal, which are bound by weak van der Waals interactions. By using high-resolution scanning tunnelling spectroscopy and density functional theory, we unambiguously demonstrate the formation of a 2D Kondo lattice from an ensemble of independent Kondo impurities present at higher temperatures. The possibility to create 2D Kondo lattices in van der Waals heterostructures paves the way for the exploration of unconventional metallic, magnetic and superconducting states not present in more standard correlated materials.


title: Learning Long-Horizon Robot Exploration Strategies for Multi-Object Search in Continuous Action Spaces

abstract: Recent advances in vision-based navigation and exploration have shown impressive capabilities in photorealistic indoor environments. However, these methods still struggle with long-horizon tasks and require large amounts of data to generalize to unseen environments. In this work, we present a novel reinforcement learning approach for multi-object search that combines short-term and long-term reasoning in a single model while avoiding the complexities arising from hierarchical structures. In contrast to existing multi-object search methods that act in granular discrete action spaces, our approach achieves exceptional performance in continuous action spaces. We perform extensive experiments and show that it generalizes to unseen apartment environments with limited data. Furthermore, we demonstrate zero-shot transfer of the learned policies to an office environment in real world experiments.


title: Refined Bobtcheva-Messia Invariants of 4-Dimensional 2-Handlebodies

abstract: In this paper we refine our recently constructed invariants of $4$-dimensional $2$-handlebodies up to $2$-deformations. More precisely, we define invariants of pairs of the form $(W,\omega)$, where $W$ is a $4$-dimensional $2$-handlebody, $\omega$ is a relative cohomology class in $H^2(W,\partial W;G)$, and $G$ is an abelian group. The algebraic input required for this construction is a unimodular ribbon Hopf $G$-coalgebra. We study these refined invariants for the restricted quantum group $U = U_q \mathfrak{sl}_2$ at a root of unity $q$ of even order, and for its braided extension $\tilde{U} = \tilde{U}_q \mathfrak{sl}_2$, which fits in this framework for $G=\mathbb{Z}/2\mathbb{Z}$, and we relate them to our original invariant. We deduce decomposition formulas for the original invariants in terms of the refined ones, generalizing splittings of the Witten-Reshetikhin-Turaev invariants with respect to spin structures and cohomology classes. Moreover, we identify our non-refined invariant associated with the small quantum group $\bar{U} = \bar{U}_q \mathfrak{sl}_2$ at a root of unity $q$ whose order is divisible by 4 with the refined one associated with the restricted quantum group $U$ for the trivial cohomology class $\omega=0$.


title: Boltzmann-Poisson-like approach to simulating the galactic halo response to satellite accretion Dependence on the halo density profile

abstract: Recent studies have reported the detection of the galactic stellar halo wake and dipole triggered by the Large Magellanic Cloud (LMC), mirroring the corresponding response from dark matter (DM). These studies open up the possibility of adding constraints on the global mass distribution of the Milky Way (MW), and even on the nature of DM itself, with current and upcoming stellar surveys reigniting the discussion on response modes in dynamical friction. However, the simulation of such features remains computationally challenging. We used a collisionless Boltzmann equation (CBE)+Poisson solver based on an existing method from the literature. We investigated the density and velocity response modes in simulations of Galactic-type DM halos accreting LMC-sized satellites, including the dependence on the halo density profile. We successfully captured both the local wake and the global over- and underdensity induced in the host halo. We also captured the velocity response. In line with previous studies, we find that the code can reproduce the core formation in the cuspy profile and the satellite core stalling. The angular power spectrum (APS) response is shown to be sensitive to each density profile. The cored Plummer density profile seems the most responsive, displaying a richness of modes. At the end of the simulation, the central halo acquires cylindrical rotation. The CBE description makes it tenable to capture the response modes with a better handling of noise in comparison to traditional N-body simulations. Hence, given a certain noise level, BPM has a lower computational cost than N-body simulations, making it feasible to explore large parameter sets. We anticipate that stellar spheroids in the MW or external galaxies could show central cylindrical rotation if they underwent a massive accretion event. The code can be adjusted to include a variety of DM physics.


title: Robust Constrained Multi-objective Evolutionary Algorithm based on Polynomial Chaos Expansion for Trajectory Optimization

abstract: An integrated optimization method based on the constrained multi-objective evolutionary algorithm (MOEA) and non-intrusive polynomial chaos expansion (PCE) is proposed, which solves robust multi-objective optimization problems under time-series dynamics. The constraints in such problems are difficult to handle, not only because the number of the dynamic constraints is multiplied by the discretized time steps but also because each of them is probabilistic. The proposed method rewrites a robust formulation into a deterministic problem via the PCE, and then sequentially processes the generated constraints in population generation, trajectory generation, and evaluation by the MOEA. As a case study, the landing trajectory design of supersonic transport (SST) with wind uncertainty is optimized. Results demonstrate the quantitative influence of the constraint values over the optimized solution sets and corresponding trajectories, proposing robust flight controls.


title: StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models

abstract: Knowledge and language understanding of models evaluated through question answering (QA) has been usually studied on static snapshots of knowledge, like Wikipedia. However, our world is dynamic, evolves over time, and our models' knowledge becomes outdated. To study how semi-parametric QA models and their underlying parametric language models (LMs) adapt to evolving knowledge, we construct a new large-scale dataset, StreamingQA, with human written and generated questions asked on a given date, to be answered from 14 years of time-stamped news articles. We evaluate our models quarterly as they read new articles not seen in pre-training. We show that parametric models can be updated without full retraining, while avoiding catastrophic forgetting. For semi-parametric models, adding new articles into the search space allows for rapid adaptation, however, models with an outdated underlying LM under-perform those with a retrained LM. For questions about higher-frequency named entities, parametric updates are particularly beneficial. In our dynamic world, the StreamingQA dataset enables a more realistic evaluation of QA models, and our experiments highlight several promising directions for future research.


title: Fictitious Play in Markov Games with Single Controller

abstract: Certain but important classes of strategic-form games, including zero-sum and identical-interest games, have the fictitious-play-property (FPP), i.e., beliefs formed in fictitious play dynamics always converge to a Nash equilibrium (NE) in the repeated play of these games. Such convergence results are seen as a (behavioral) justification for the game-theoretical equilibrium analysis. Markov games (MGs), also known as stochastic games, generalize the repeated play of strategic-form games to dynamic multi-state settings with Markovian state transitions. In particular, MGs are standard models for multi-agent reinforcement learning -- a reviving research area in learning and games, and their game-theoretical equilibrium analyses have also been conducted extensively. However, whether certain classes of MGs have the FPP or not (i.e., whether there is a behavioral justification for equilibrium analysis or not) remains largely elusive. In this paper, we study a new variant of fictitious play dynamics for MGs and show its convergence to an NE in n-player identical-interest MGs in which a single player controls the state transitions. Such games are of interest in communications, control, and economics applications. Our result together with the recent results in [Sayin et al. 2020] establishes the FPP of two-player zero-sum MGs and n-player identical-interest MGs with a single controller (standing at two different ends of the MG spectrum from fully competitive to fully cooperative).


title: Novel algorithm for the computation of group and energy velocities of Lamb waves

abstract: A new solution strategy for quadratic eigenvalue problems, and the derivatives of the eigenvalues, is proposed, by combining the generalized reduction method with dual numbers. To demonstrate the method, we use the quadratic eigenvalue problem encountered in the semi-analytical finite element method (SAFE) as a guiding example. The SAFE method is designed to calculate the spectrum of Lamb wave phase, group and energy velocities in (visco)elastic orthotropic media, over a wide frequency range. It was found that the new approach essentially doubles the computational speed and efficiency, without sacrificing accuracy.


title: The codimension 2 null cut locus with applications to spacetime topology

abstract: In this paper we review and extend some results in the literature pertaining to spacetime topology while naturally utilizing properties of the codimension 2 null cut locus. Our results fall into two classes, depending on whether or not one assumes the presence of horizons. Included among the spacetimes we consider are those that apply to the asymptotically (locally) AdS setting.


title: Beam Squint Assisted User Localization in Near-Field Communications Systems

abstract: The beam squint phenomenon in massive multi-input and multi-output wideband communications has been widely concerned recently, which generally deteriorates the beamforming performance. In this paper, we find that with the aid of the time-delay lines (TDs), the range and trajectory of the beam squint of a near-field communications system can be freely controlled, and hence it is possible to reversely utilize the beam squint for user localization. We derive the trajectory equation for near-field beam squint points and design a way to control the trajectory of these beam squint points. With the proposed design, beamforming from different subcarriers would purposely point to different angles and different distances such that users from different positions would receive the maximum power at different subcarriers. Hence, one can simply find the different users' position from the beam squint effect. Simulation results demonstrate the effectiveness of the proposed scheme.


title: Generic bounds on the approximation error for physics-informed (and) operator learning

abstract: We propose a very general framework for deriving rigorous bounds on the approximation error for physics-informed neural networks (PINNs) and operator learning architectures such as DeepONets and FNOs as well as for physics-informed operator learning. These bounds guarantee that PINNs and (physics-informed) DeepONets or FNOs will efficiently approximate the underlying solution or solution operator of generic partial differential equations (PDEs). Our framework utilizes existing neural network approximation results to obtain bounds on more involved learning architectures for PDEs. We illustrate the general framework by deriving the first rigorous bounds on the approximation error of physics-informed operator learning and by showing that PINNs (and physics-informed DeepONets and FNOs) mitigate the curse of dimensionality in approximating nonlinear parabolic PDEs.


title: Detection of Fights in Videos: A Comparison Study of Anomaly Detection and Action Recognition

abstract: Detection of fights is an important surveillance application in videos. Most existing methods use supervised binary action recognition. Since frame-level annotations are very hard to get for anomaly detection, weakly supervised learning using multiple instance learning is widely used. This paper explores the detection of fights in videos as one special type of anomaly detection and as binary action recognition. We use the UBI-Fight and NTU-CCTV-Fight datasets for most of the study since they have frame-level annotations. We find that the anomaly detection has similar or even better performance than the action recognition. Furthermore, we study to use anomaly detection as a toolbox to generate training datasets for action recognition in an iterative way conditioned on the performance of the anomaly detection. Experiment results should show that we achieve state-of-the-art performance on three fight detection datasets.


title: Multi-Temporal Spatial-Spectral Comparison Network for Hyperspectral Anomalous Change Detection

abstract: Hyperspectral anomalous change detection has been a challenging task for its emphasis on the dynamics of small and rare objects against the prevalent changes. In this paper, we have proposed a Multi-Temporal spatial-spectral Comparison Network for hyperspectral anomalous change detection (MTC-NET). The whole model is a deep siamese network, aiming at learning the prevalent spectral difference resulting from the complex imaging conditions from the hyperspectral images by contrastive learning. A three-dimensional spatial spectral attention module is designed to effectively extract the spatial semantic information and the key spectral differences. Then the gaps between the multi-temporal features are minimized, boosting the alignment of the semantic and spectral features and the suppression of the multi-temporal background spectral difference. The experiments on the "Viareggio 2013" datasets demonstrate the effectiveness of proposed MTC-NET.


title: Cross-mode Stabilized Stochastic Shallow Water Systems Using Stochastic Finite Element Methods

abstract: The development of surrogate models to study uncertainties in hydrologic systems requires significant effort in the development of sampling strategies and forward model simulations. Furthermore, in applications where prediction time is critical, such as prediction of hurricane storm surge, the predictions of system response and uncertainties can be required within short time frames. Here, we develop an efficient stochastic shallow water model to address these issues. To discretize the physical and probability spaces we use a Stochastic Galerkin method and a Incremental Pressure Correction scheme to advance the solution in time. To overcome discrete stability issues, we propose cross-mode stabilization methods which employs existing stabilization methods in the probability space by adding stabilization terms to every stochastic mode in a modes-coupled way. We extensively verify the developed method for both idealized shallow water test cases and hindcasting of past hurricanes. We subsequently use the developed and verified method to perform a comprehensive statistical analysis of the established shallow water surrogate models. Finally, we propose a predictor for hurricane storm surge under uncertain wind drag coefficients and demonstrate its effectivity for Hurricanes Ike and Harvey.


title: Super Vision Transformer

abstract: We attempt to reduce the computational costs in vision transformers (ViTs), which increase quadratically in the token number. We present a novel training paradigm that trains only one ViT model at a time, but is capable of providing improved image recognition performance with various computational costs. Here, the trained ViT model, termed super vision transformer (SuperViT), is empowered with the versatile ability to solve incoming patches of multiple sizes as well as preserve informative tokens with multiple keeping rates (the ratio of keeping tokens) to achieve good hardware efficiency for inference, given that the available hardware resources often change from time to time. Experimental results on ImageNet demonstrate that our SuperViT can considerably reduce the computational costs of ViT models with even performance increase. For example, we reduce 2x FLOPs of DeiT-S while increasing the Top-1 accuracy by 0.2% and 0.7% for 1.5x reduction. Also, our SuperViT significantly outperforms existing studies on efficient vision transformers. For example, when consuming the same amount of FLOPs, our SuperViT surpasses the recent state-of-the-art (SOTA) EViT by 1.1% when using DeiT-S as their backbones. The project of this work is made publicly available at https://github.com/lmbxmu/SuperViT.


title: Fine-Grained Counting with Crowd-Sourced Supervision

abstract: Crowd-sourcing is an increasingly popular tool for image analysis in animal ecology. Computer vision methods that can utilize crowd-sourced annotations can help scale up analysis further. In this work we study the potential to do so on the challenging task of fine-grained counting. As opposed to the standard crowd counting task, fine-grained counting also involves classifying attributes of individuals in dense crowds. We introduce a new dataset from animal ecology to enable this study that contains 1.7M crowd-sourced annotations of 8 fine-grained classes. It is the largest available dataset for fine-grained counting and the first to enable the study of the task with crowd-sourced annotations. We introduce methods for generating aggregate "ground truths" from the collected annotations, as well as a counting method that can utilize the aggregate information. Our method improves results by 8% over a comparable baseline, indicating the potential for algorithms to learn fine-grained counting using crowd-sourced supervision.


title: Energy Efficiency of Web Browsers in the Android Ecosystem

abstract: This paper presents an empirical study regarding the energy consumption of the most used web browsers on the Android ecosystem. In order to properly compare the web browsers in terms of energy consumption, we defined a set of typical usage scenarios to be replicated in the different browsers, executed in the same testing environment and conditions. The results of our study show that there are significant differences in terms of energy consumption among the considered browsers. Furthermore, we conclude that some browsers are energy efficient in several user actions, but energy greedy in other ones, allowing us to conclude that no browser is universally more efficient for all usage scenarios.


title: Model Predictive Control of Non-Holonomic Vehicles: Beyond Differential-Drive

abstract: Non-holonomic vehicles are of immense practical value and increasingly subject to automation. However, controlling them accurately, e.g., when parking, is known to be challenging for automatic control methods, including model predictive control (MPC). Combining results from MPC theory and sub-Riemannian geometry in the form of homogeneous nilpotent system approximations, this paper proposes a comprehensive, ready-to-apply design procedure for MPC controllers to steer controllable, driftless non-holonomic vehicles into given setpoints. It can be ascertained that the resulting controllers nominally asymptotically stabilize the setpoint for a large-enough prediction horizon. The design procedure is exemplarily applied to four vehicles, including the kinematic car and a differentially driven mobile robot with up to two trailers. The controllers use a non-quadratic cost function tailored to the non-holonomic kinematics. Novelly, for the considered example vehicles, it is proven that a quadratic cost employed in an otherwise similar controller is insufficient to reliably asymptotically stabilize the closed loop. Since quadratic costs are the conventional choice in control, this highlights the relevance of the findings. To the knowledge of the authors, it is the first time that MPC controllers of the proposed structure are applied to non-holonomic vehicles beyond very simple ones, in particular (partly) on hardware.


title: The partial Bondi gauge: Further enlarging the asymptotic structure of gravity

abstract: We present a detailed analysis of gravity in a partial Bondi gauge, where only the three conditions $g_{rr}=0=g_{rA}$ are fixed. We relax in particular the so-called determinant condition on the transverse metric, which is only assumed to admit a polyhomogeneous radial expansion. This is sufficient in order to build the solution space, which here includes a cosmological constant, time-dependent sources in the boundary metric, logarithmic branches, and an extra trace mode at subleading order in the transverse metric. The evolution equations are studied using the Newman-Penrose formalism in terms of covariant functionals identified from the Weyl scalars, and we build the explicit dictionary between this formalism and the tensorial Einstein equations. This provides in particular a new derivation of the (A)dS mass loss formula. We then study the holographic renormalisation of the symplectic potential, and the transformation laws under residual asymptotic symmetries. The advantage of the partial Bondi gauge is that it allows to contrast and treat in a unified manner the Bondi-Sachs and Newman-Unti gauges, which can each be reached upon imposing a further specific gauge condition. The differential determinant condition leads to the $\Lambda$-BMSW gauge, while a differential condition on $g_{ur}$ leads to a generalized Newman-Unti gauge. This latter gives access to a new asymptotic symmetry which acts on the asymptotic shear and further extends the $\Lambda$-BMSW group by an extra abelian radial translation. This generalizes results which we have recently obtained in three dimensions.


title: Causal Machine Learning for Healthcare and Precision Medicine

abstract: Causal machine learning (CML) has experienced increasing popularity in healthcare. Beyond the inherent capabilities of adding domain knowledge into learning systems, CML provides a complete toolset for investigating how a system would react to an intervention (e.g.\ outcome given a treatment). Quantifying effects of interventions allows actionable decisions to be made whilst maintaining robustness in the presence of confounders. Here, we explore how causal inference can be incorporated into different aspects of clinical decision support (CDS) systems by using recent advances in machine learning. Throughout this paper, we use Alzheimer's disease (AD) to create examples for illustrating how CML can be advantageous in clinical scenarios. Furthermore, we discuss important challenges present in healthcare applications such as processing high-dimensional and unstructured data, generalisation to out-of-distribution samples, and temporal relationships, that despite the great effort from the research community remain to be solved. Finally, we review lines of research within causal representation learning, causal discovery and causal reasoning which offer the potential towards addressing the aforementioned challenges.


title: Fusions of tensor powers of Johnson schemes

abstract: This paper is a follow-up to (arXiv:2203.03687), in which the first author studied primitive association schemes lying between a tensor power $\mathcal{T}_m^d$ of the trivial association scheme and the Hamming scheme $\mathcal{H}(m,d)$. A question which arose naturally in that study was whether all primitive fusions of $\mathcal{T}_m^d$ lie between $\mathcal{T}_{m^e}^{d/e}$ and $\mathcal{H}(m^d, d/e)$ for some $e \mid d$. This note answers this question positively provided that $m$ is large enough. We similarly classify primitive fusions of the $d$th tensor power of a Johnson scheme on $\binom{m}{k}$ points provided $m$ is large enough in terms of $k$ and $d$.


title: Variable-Input Deep Operator Networks

abstract: Existing architectures for operator learning require that the number and locations of sensors (where the input functions are evaluated) remain the same across all training and test samples, significantly restricting the range of their applicability. We address this issue by proposing a novel operator learning framework, termed Variable-Input Deep Operator Network (VIDON), which allows for random sensors whose number and locations can vary across samples. VIDON is invariant to permutations of sensor locations and is proved to be universal in approximating a class of continuous operators. We also prove that VIDON can efficiently approximate operators arising in PDEs. Numerical experiments with a diverse set of PDEs are presented to illustrate the robust performance of VIDON in learning operators.


title: Almost complete solution for the NP-hard separability problem of Bell diagonal qutrits

abstract: With a probability of success of $95 \%$ we solve the separability problem for Bell diagonal qutrit states with positive partial transposition (PPT). The separability problem, i.e. distinguishing separable and entangled states, generally lacks an efficient solution due to the existence of bound entangled states. In contrast to free entangled states that can be used for entanglement distillation via local operations and classical communication, these states cannot be detected by the Peres-Horodecki criterion or PPT criterion. We analyze a large family of bipartite qutrit states that can be separable, free entangled or bound entangled. Leveraging a geometrical representation of these states in Euclidean space, novel methods are presented that allow the classification of separable and bound entangled Bell diagonal states in an efficient way. Moreover, the classification allows the precise determination of relative volumes of the classes of separable, free and bound entangled states. In detail, out of all Bell diagonal PPT states $81.0 \%\pm0.1\%$ are determined to be separable while $13.9\pm0.1\%$ are bound entangled and only $5.1\pm0.1\%$ remain unclassified. Moreover, our applied criteria are compared for their effectiveness and relation as detectors of bound entanglement, which reveals that not a single criterion is capable to detect all bound entangled states.


title: A Model-Driven-Engineering Approach for Detecting Privilege Escalation in IoT Systems

abstract: Software vulnerabilities in access control models can represent a serious threat in a system. In fact, OWASP lists broken access control as number 5 in severity among the top 10 vulnerabilities. In this paper, we study the permission model of an emerging Smart-Home platform, SmartThings, and explore an approach that detects privilege escalation in its permission model. Our approach is based on Model Driven Engineering (MDE) in addition to static analysis. This approach allows for better coverage of privilege escalation detection than static analysis alone, and takes advantage of analyzing free-form text that carries extra permissions details. Our experimental results demonstrate a very high accuracy for detecting over-privilege vulnerabilities in IoT applications


title: Deep-learning-based prediction of nanoparticle phase transitions during in situ transmission electron microscopy

abstract: We develop the machine learning capability to predict a time sequence of in-situ transmission electron microscopy (TEM) video frames based on the combined long-short-term-memory (LSTM) algorithm and the features de-entanglement method. We train deep learning models to predict a sequence of future video frames based on the input of a sequence of previous frames. This unique capability provides insight into size dependent structural changes in Au nanoparticles under dynamic reaction condition using in-situ environmental TEM data, informing models of morphological evolution and catalytic properties. The model performance and achieved accuracy of predictions are desirable based on, for scientific data characteristic, based on limited size of training data sets. The model convergence and values for the loss function mean square error show dependence on the training strategy, and structural similarity measure between predicted structure images and ground truth reaches the value of about 0.7. This computed structural similarity is smaller than values obtained when the deep learning architecture is trained using much larger benchmark data sets, it is sufficient to show the structural transition of Au nanoparticles. While performance parameters of our model applied to scientific data fall short of those achieved for the non-scientific big data sets, we demonstrate model ability to predict the evolution, even including the particle structural phase transformation, of Au nano particles as catalyst for CO oxidation under the chemical reaction conditions. Using this approach, it may be possible to anticipate the next steps of a chemical reaction for emerging automated experimentation platforms.


title: Zeros of dynamical zeta functions for hyperbolic quadradic maps

abstract: We prove that the dynamical zeta function $Z(s)$ associated to $z^2 + c$ with $c < -3.75$ has essential zero-free strips of size $1/2 +$, that is, for every $\epsilon > 0$, there exist only finitely many zeros in the strip $\mathrm{Re}(s) > 1/2 + \epsilon$. We also present some numerical plots of zeros of $Z(s)$ using the method proposed in Jenkinson-Pollicott.


title: Many-Class Text Classification with Matching

abstract: In this work, we formulate \textbf{T}ext \textbf{C}lassification as a \textbf{M}atching problem between the text and the labels, and propose a simple yet effective framework named TCM. Compared with previous text classification approaches, TCM takes advantage of the fine-grained semantic information of the classification labels, which helps distinguish each class better when the class number is large, especially in low-resource scenarios. TCM is also easy to implement and is compatible with various large pretrained language models. We evaluate TCM on 4 text classification datasets (each with 20+ labels) in both few-shot and full-data settings, and this model demonstrates significant improvements over other text classification paradigms. We also conduct extensive experiments with different variants of TCM and discuss the underlying factors of its success. Our method and analyses offer a new perspective on text classification.


title: Searches for Neutrinos from Gamma-Ray Bursts using the IceCube Neutrino Observatory

abstract: Gamma-ray bursts (GRBs) are considered as promising sources of ultra-high-energy cosmic rays (UHECRs) due to their large power output. Observing a neutrino flux from GRBs would offer evidence that GRBs are hadronic accelerators of UHECRs. Previous IceCube analyses, which primarily focused on neutrinos arriving in temporal coincidence with the prompt gamma rays, found no significant neutrino excess. The four analyses presented in this paper extend the region of interest to 14 days before and after the prompt phase, including generic extended time windows and targeted precursor searches. GRBs were selected between May 2011 and October 2018 to align with the data set of candidate muon-neutrino events observed by IceCube. No evidence of correlation between neutrino events and GRBs was found in these analyses. Limits are set to constrain the contribution of the cosmic GRB population to the diffuse astrophysical neutrino flux observed by IceCube. Prompt neutrino emission from GRBs is limited to $\lesssim$1% of the observed diffuse neutrino flux, and emission on timescales up to $10^4$ s is constrained to 24% of the total diffuse flux.


title: Comment on "Thermodynamic Principle for Quantum Metrology"

abstract: In Phys. Rev. Lett. 128, 200501 (2022) the authors consider the thermodynamic cost of quantum metrology. One of the main results is $\mathcal{S} \geq \log(2) \| h_\lambda \|^{-2} F_Q [\psi_\lambda]$, which purports to relate the Shannon entropy $\mathcal{S}$ of an optimal measurement (i.e., in the basis of the symmetric logarithmic derivative) to the quantum Fisher information $F_Q$ of the pure state $|\psi_\lambda\rangle$. However, we show that in the setting considered by the authors we have $\mathcal{S} = \log(2)$ and $\| h_\lambda \|^{2} = \max_{\psi_\lambda} F_Q[\psi_\lambda]$, so that their inequality reduces to the trivial inequality $\max_{\psi_\lambda} F_Q[\psi_\lambda] \geq F_Q[\psi_\lambda]$, and does not in fact relate the entropy $\mathcal{S}$ to the quantum Fisher information. Moreover, for pure state quantum metrology, there exist optimal measurements (though not in the basis of the symmetric logarithmic derivative) for which $0 \leq \mathcal{S} \leq \log(2)$, leading to violations of the inequality for some states $|\psi_\lambda\rangle$.


title: Instance-Based Uncertainty Estimation for Gradient-Boosted Regression Trees

abstract: Gradient-boosted regression trees (GBRTs) are hugely popular for solving tabular regression problems, but provide no estimate of uncertainty. We propose Instance-Based Uncertainty estimation for Gradient-boosted regression trees (IBUG), a simple method for extending any GBRT point predictor to produce probabilistic predictions. IBUG computes a non-parametric distribution around a prediction using the $k$-nearest training instances, where distance is measured with a tree-ensemble kernel. The runtime of IBUG depends on the number of training examples at each leaf in the ensemble, and can be improved by sampling trees or training instances. Empirically, we find that IBUG achieves similar or better performance than the previous state-of-the-art across 22 benchmark regression datasets. We also find that IBUG can achieve improved probabilistic performance by using different base GBRT models, and can more flexibly model the posterior distribution of a prediction than competing methods. We also find that previous methods suffer from poor probabilistic calibration on some datasets, which can be mitigated using a scalar factor tuned on the validation data. Source code is available at https://www.github.com/jjbrophy47/ibug.


title: QASem Parsing: Text-to-text Modeling of QA-based Semantics

abstract: Several recent works have suggested to represent semantic relations with questions and answers, decomposing textual information into separate interrogative natural language statements. In this paper, we consider three QA-based semantic tasks - namely, QA-SRL, QANom and QADiscourse, each targeting a certain type of predication - and propose to regard them as jointly providing a comprehensive representation of textual information. To promote this goal, we investigate how to best utilize the power of sequence-to-sequence (seq2seq) pre-trained language models, within the unique setup of semi-structured outputs, consisting of an unordered set of question-answer pairs. We examine different input and output linearization strategies, and assess the effect of multitask learning and of simple data augmentation techniques in the setting of imbalanced training data. Consequently, we release the first unified QASem parsing tool, practical for downstream applications who can benefit from an explicit, QA-based account of information units in a text.


title: Signal Restoration and Channel Estimation for Channel Sounding with SDRs

abstract: In this paper, the task of channel sounding using software defined radios (SDRs) is considered. In contrast to classical channel sounding equipment, SDRs are general purpose devices and require additional steps to be implemented when employed for this task. On top of this, SDRs may exhibit quirks causing signal artefacts that obstruct the effective collection of channel estimation data. Based on these considerations, in this work, a practical algorithm is devised to compensate for the drawbacks of using SDRs for channel sounding encountered in a concrete setup. The proposed approach utilises concepts from time series and Fourier analysis and comprises a signal restoration routine for mitigating artefacts within the recorded signals and an encompassing channel sounding process. The efficacy of the algorithm is evaluated on real measurements generated within the given setup. The empirical results show that the proposed method is able to counteract the shortcomings of the equipment and deliver reasonable channel estimates.


title: Divisibility by 2 on quartic models of elliptic curves and rational Diophantine $D(q)$-quintuples

abstract: Let $C$ be a smooth genus one curve described by a quartic polynomial equation over the rational field $\mathbb Q$ with $P\in C(\mathbb Q)$. We give an explicit criterion for the divisibility-by-$2$ of a rational point on the elliptic curve $(C,P)$. This provides an analogue to the classical criterion of the divisibility-by-$2$ on elliptic curves described by Weierstrass equations. We employ this criterion to investigate the question of extending a rational $D(q)$-quadruple to a quintuple. We give concrete examples to which we can give an affirmative answer. One of these results implies that although the rational $ D(16t+9) $-quadruple $\{t, 16t+8,2 25t+14, 36t+20 \}$ can not be extended to a polynomial $ D(16t+9) $-quintuple using a linear polynomial, there are infinitely many rational values of $t$ for which the aforementioned rational $ D(16t+9) $-quadruple can be extended to a rational $ D(16t+9) $-quintuple. Moreover, these infinitely many values of $t$ are parametrized by the rational points on a certain elliptic curve of positive Mordell-Weil rank.


title: The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains

abstract: Recent model pruning methods have demonstrated the ability to remove redundant parameters without sacrificing model performance. Common methods remove redundant parameters according to the parameter sensitivity, a gradient-based measure reflecting the contribution of the parameters. In this paper, however, we argue that redundant parameters can be trained to make beneficial contributions. We first highlight the large sensitivity (contribution) gap among high-sensitivity and low-sensitivity parameters and show that the model generalization performance can be significantly improved after balancing the contribution of all parameters. Our goal is to balance the sensitivity of all parameters and encourage all of them to contribute equally. We propose a general task-agnostic method, namely intra-distillation, appended to the regular training loss to balance parameter sensitivity. Moreover, we also design a novel adaptive learning method to control the strength of intra-distillation loss for faster convergence. Our experiments show the strong effectiveness of our methods on machine translation, natural language understanding, and zero-shot cross-lingual transfer across up to 48 languages, e.g., a gain of 3.54 BLEU on average across 8 language pairs from the IWSLT'14 translation dataset.


title: Domain Wall Skyrmions in Chiral Magnets

abstract: Domain wall skyrmions are skyrmions trapped inside a domain wall. We investigate domain wall skyrmions in chiral magnets using a fully analytic approach. Treating the Dzyaloshinskii-Moriya (DM) interaction perturbatively, we construct the low-energy effective theory of a magnetic domain wall in an $O(3)$ sigma model with the DM interaction and an easy-axis potential term, yielding a sine-Gordon model. We then construct domain wall skyrmions as sine-Gordon solitons along the domain wall. We also construct domain wall skyrmions on top of a pair of a domain wall and an anti-domain wall. One of characteristic feature of domain wall skyrmions is that both skyrmions and anti-skyrmions are equally stable inside the domain wall, unlike the bulk in which only one of them is stable.


title: On non-monomial APcN permutations over finite fields of even characteristic

abstract: Recently, a new concept called the $c$-differential uniformity was proposed by Ellingsen et al. (2020), which allows to simplify some types of differential cryptanalysis. Since then, finding functions having low $c$-differential uniformity has attracted the attention of many researchers. However it seems that, at this moment, there are not many non-monomial permutations having low $c$-differential uniformity. In this paper, we propose new classes of almost perfect $c$-nonlinear non-monomial permutations over a binary field.


title: Enhanced Prototypical Learning for Unsupervised Domain Adaptation in LiDAR Semantic Segmentation

abstract: Despite its importance, unsupervised domain adaptation (UDA) on LiDAR semantic segmentation is a task that has not received much attention from the research community. Only recently, a completion-based 3D method has been proposed to tackle the problem and formally set up the adaptive scenarios. However, the proposed pipeline is complex, voxel-based and requires multi-stage inference, which inhibits it for real-time inference. We propose a range image-based, effective and efficient method for solving UDA on LiDAR segmentation. The method exploits class prototypes from the source domain to pseudo label target domain pixels, which is a research direction showing good performance in UDA for natural image semantic segmentation. Applying such approaches to LiDAR scans has not been considered because of the severe domain shift and lack of pre-trained feature extractor that is unavailable in the LiDAR segmentation setup. However, we show that proper strategies, including reconstruction-based pre-training, enhanced prototypes, and selective pseudo labeling based on distance to prototypes, is sufficient enough to enable the use of prototypical approaches. We evaluate the performance of our method on the recently proposed LiDAR segmentation UDA scenarios. Our method achieves remarkable performance among contemporary methods.


title: LILA-BOTI : Leveraging Isolated Letter Accumulations By Ordering Teacher Insights for Bangla Handwriting Recognition

abstract: Word-level handwritten optical character recognition (OCR) remains a challenge for morphologically rich languages like Bangla. The complexity arises from the existence of a large number of alphabets, the presence of several diacritic forms, and the appearance of complex conjuncts. The difficulty is exacerbated by the fact that some graphemes occur infrequently but remain indispensable, so addressing the class imbalance is required for satisfactory results. This paper addresses this issue by introducing two knowledge distillation methods: Leveraging Isolated Letter Accumulations By Ordering Teacher Insights (LILA-BOTI) and Super Teacher LILA-BOTI. In both cases, a Convolutional Recurrent Neural Network (CRNN) student model is trained with the dark knowledge gained from a printed isolated character recognition teacher model. We conducted inter-dataset testing on \emph{BN-HTRd} and \emph{BanglaWriting} as our evaluation protocol, thus setting up a challenging problem where the results would better reflect the performance on unseen data. Our evaluations achieved up to a 3.5% increase in the F1-Macro score for the minor classes and up to 4.5% increase in our overall word recognition rate when compared with the base model (No KD) and conventional KD.


title: Transference for loose Hamilton cycles in random $3$-uniform hypergraphs

abstract: A loose Hamilton cycle in a hypergraph is a cyclic sequence of edges covering all vertices in which only every two consecutive edges intersect and do so in exactly one vertex. With Dirac's theorem in mind, it is natural to ask what minimum $d$-degree condition guarantees the existence of a loose Hamilton cycle in a $k$-uniform hypergraph. For $k=3$ and each $d \in \{1,2\}$, the necessary and sufficient such condition is known precisely. We show that these results adhere to a `transference principle' to their sparse random analogues. The proof combines several ideas from the graph setting and relies on the absorbing method. In particular, we employ a novel approach of Kwan and Ferber for finding absorbers in subgraphs of sparse hypergraphs via a contraction procedure. In the case of $d = 2$, our findings are asymptotically optimal.


title: The SOFIA Massive (SOMA) Star Formation Survey. IV. Isolated Protostars

abstract: We present $\sim10-40\,\mu$m SOFIA-FORCAST images of 11 isolated protostars as part of the SOFIA Massive (SOMA) Star Formation Survey, with this morphological classification based on 37 $\mu$m imaging. We develop an automated method to define source aperture size using the gradient of its background-subtracted enclosed flux and apply this to build spectral energy distributions (SEDs). We fit the SEDs with radiative transfer models, developed within the framework of turbulent core accretion (TCA) theory, to estimate key protostellar properties. Here, we release the sedcreator python package that carries out these methods. The SEDs are generally well fitted by the TCA models, from which we infer initial core masses $M_c$ ranging from $20-430\:M_\odot$, clump mass surface densities $\Sigma_{\rm cl}\sim0.3-1.7\:{\rm{g\:cm}}^{-2}$ and current protostellar masses $m_*\sim3-50\:M_\odot$. From a uniform analysis of the 40 sources in the full SOMA survey to date, we find that massive protostars form across a wide range of clump mass surface density environments, placing constraints on theories that predict a minimum threshold $\Sigma_{\rm cl}$ for massive star formation. However, the upper end of the $m_*-\Sigma_{\rm cl}$ distribution follows trends predicted by models of internal protostellar feedback that find greater star formation efficiency in higher $\Sigma_{\rm cl}$ conditions. We also investigate protostellar far-IR variability by comparison with IRAS data, finding no significant variation over an $\sim$40 year baseline.


title: Decoder Denoising Pretraining for Semantic Segmentation

abstract: Semantic segmentation labels are expensive and time consuming to acquire. Hence, pretraining is commonly used to improve the label-efficiency of segmentation models. Typically, the encoder of a segmentation model is pretrained as a classifier and the decoder is randomly initialized. Here, we argue that random initialization of the decoder can be suboptimal, especially when few labeled examples are available. We propose a decoder pretraining approach based on denoising, which can be combined with supervised pretraining of the encoder. We find that decoder denoising pretraining on the ImageNet dataset strongly outperforms encoder-only supervised pretraining. Despite its simplicity, decoder denoising pretraining achieves state-of-the-art results on label-efficient semantic segmentation and offers considerable gains on the Cityscapes, Pascal Context, and ADE20K datasets.


title: Propagating Quantum Microwaves: Towards Applications in Communication and Sensing

abstract: The field of propagating quantum microwaves has started to receive considerable attention in the past few years. Motivated at first by the lack of an efficient microwave-to-optical platform that could solve the issue of secure communication between remote superconducting chips, current efforts are starting to reach other areas, from quantum communications to sensing. Here, we attempt at giving a state-of-the-art view of the two, pointing at some of the technical and theoretical challenges we need to address, and while providing some novel ideas and directions for future research. Hence, the goal of this paper is to provide a bigger picture, and -- we hope -- to inspire new ideas in quantum communications and sensing: from open-air microwave quantum key distribution to direct detection of dark matter, we expect that the recent efforts and results in quantum microwaves will soon attract a wider audience, not only in the academic community, but also in an industrial environment.


title: Water, hydrogen cyanide, carbon monoxide, and dust production from distant comet 29P/Schwassmann-Wachmann 1

abstract: 29P/Schwassmann-Wachmann 1 is a distant Centaur/comet, showing persistent CO-driven activity and frequent outbursts. We used the Herschel space observatory in 2010, 2011, and 2013 to observe H$_2$O and NH$_3$ and to image the dust coma. Observations with the IRAM 30 m were undertaken in 2007, 2010, 2011, and 2021 to monitor the CO production rate and to search for HCN. Modeling was performed to constrain the size of the sublimating icy grains and to derive the dust production rate. HCN is detected for the first time in comet 29P (at 5$\sigma$ in the line area). H$_2$O is detected as well, but not NH$_3$. H$_2$O and HCN line shapes differ strongly from the CO line shape, indicating that these two species are released from icy grains. CO production rates are in the range (2.9-5.6) $\times$ 10$^{28}$ s$^{-1}$ (1400--2600 kg s$^{-1}$). A correlation between the CO production rate and coma brightness is observed, as is a correlation between CO and H$_2$O production. The correlation obtained between the excess of CO production and excess of dust brightness with respect to the quiescent state is similar to that established for the continuous activity of comet Hale-Bopp. The measured $Q$(H$_2$O)/$Q$(CO) and $Q$(HCN)/$Q$(CO) production rate ratios are 10.0 $\pm$ 1.5 % and 0.12 $\pm$ 0.03 %, respectively, averaging the April-May 2010 measurements ($Q$(H$_2$O) = (4.1 $\pm$ 0.6) $\times$ 10$^{27}$ s$^{-1}$, $Q$(HCN) = (4.8 $\pm$ 1.1) $\times$ 10$^{25}$ s$^{-1}$). We derive three independent and similar values of the effective radius of the nucleus, $\sim$ 31 $\pm$ 3 km. The inferred dust mass-loss rates during quiescent phases are in the range 30-120 kg s$^{-1}$, indicating a dust-to-gas mass ratio $<$ 0.1 during quiescent activity. We conclude that strong local heterogeneities exist on the surface of 29P, with quenched dust activity from most of the surface, but not in outbursting regions.


title: Transverse Mass Distribution and Charge Asymmetry in W Boson Production to Third Order in QCD

abstract: Charged gauge boson production at hadron colliders is a fundamental benchmark for the extraction of electroweak parameters and the understanding of the proton structure. To enable precision phenomenology for this process, we compute the third-order (N$^3$LO) QCD corrections to the rapidity distribution and charge asymmetry in W boson production and to the transverse mass distribution of its decay products. Our results display substantial QCD corrections in kinematic regions relevant for Tevatron and LHC measurements. We compare the numerical magnitude of the N$^3$LO corrections with uncertainties from electroweak input parameters and quantify their potential impact on the determination of the W boson mass.


title: Classically optimized Hamiltonian simulation

abstract: Hamiltonian simulation is a promising application for quantum computers to achieve a quantum advantage. We present classical algorithms based on tensor network methods to optimize quantum circuits for this task. We show that, compared to Trotter product formulas, the classically optimized circuits can be orders of magnitude more accurate and significantly extend the total simulation time.


title: Spreading Factor assisted LoRa Localization with Deep Reinforcement Learning

abstract: Most of the developed localization solutions rely on RSSI fingerprinting. However, in the LoRa networks, due to the spreading factor (SF) in the network setting, traditional fingerprinting may lack representativeness of the radio map, leading to inaccurate position estimates. As such, in this work, we propose a novel LoRa RSSI fingerprinting approach that takes into account the SF. The performance evaluation shows the prominence of our proposed approach since we achieved an improvement in localization accuracy by up to 6.67% compared to the state-of-the-art methods. The evaluation has been done using a fully connected deep neural network (DNN) set as the baseline. To further improve the localization accuracy, we propose a deep reinforcement learning model that captures the ever-growing complexity of LoRa networks and copes with their scalability. The obtained results show an improvement of 48.10% in the localization accuracy compared to the baseline DNN model.


title: Average Evolution and Size-Topology Relations for Coarsening 2d Dry Foams

abstract: Two-dimensional dry foams coarsen according to the von Neumann law as $dA/dt \propto (n-6)$ where $n$ is the number of sides of a bubble with area $A$. Such foams reach a self-similar scaling state where area and side-number distributions are stationary. Combining self-similarity with the von Neumann law, we derive time derivatives of moments of the bubble area distribution and a relation connecting area moments with averages of the side-number distribution that are weighted by powers of bubble area. To test these predictions, we collect and analyze high precision image data for a large number of bubbles squashed between parallel acrylic plates and allowed to coarsen into the self-similar scaling state. We find good agreement for moments ranging from two to twenty.


title: Conjectures on the Khovanov Homology of Legendrian and Transversely Simple Knots

abstract: A theorem of Kronheimer and Mrowka states that Khovanov homology is able to detect the unknot. That is, if a knot has the Khovanov homology of the unknot, then it is equivalent to it. Similar results hold for the trefoils and the figure-eight knot. These are the simplest of the Legendrian simple knots. We conjecture that Khovanov homology is able to distinguish Legendrian and Transversely simple knots. Using the torus and twist knots, numerical evidence is provided for all prime knots up to 19 crossings. The conjectured Legendrian simple knots from the Legendrian knot atlas have also been included, and no knots with identical Khovanov polynomials were found.


title: Connections between commutative rings and some algebras of logic

abstract: In this paper using the connections between some subvarieties of residuated lattices, we investigated some properties of the lattice of ideals in commutative and unitary rings. We give new characterizations for commutative rings $A$ in which $Id(A)$ is an MV-algebra, a Heyting algebra or a Boolean algebra and we establish connections between these types of rings. We are very interested in the finite case and we present summarizing statistics. We show that the lattice of ideals in a finite commutative ring of the form $A=% \mathbb{Z}_{k_{1}}\times \mathbb{Z}_{k_{2}}\times ...\times \mathbb{Z}% _{k_{r}},$ where $k_{i}=p_{i}^{\alpha _{i}}$ and $p_{i}$ a prime number, for all $i\in \{1,2,...,r\},$ \ is a Boolean algebra or an MV-algebra (which is not Boolean). Using this result we generate the binary block codes associated to the lattice of ideals in finite commutative rings and we present a new way to generate all (up to an isomorphism) finite MV-algebras using rings.


title: Logical Reasoning with Span-Level Predictions for Interpretable and Robust NLI Models

abstract: Current Natural Language Inference (NLI) models achieve impressive results, sometimes outperforming humans when evaluating on in-distribution test sets. However, as these models are known to learn from annotation artefacts and dataset biases, it is unclear to what extent the models are learning the task of NLI instead of learning from shallow heuristics in their training data. We address this issue by introducing a logical reasoning framework for NLI, creating highly transparent model decisions that are based on logical rules. Unlike prior work, we show that improved interpretability can be achieved without decreasing the predictive accuracy. We almost fully retain performance on SNLI, while also identifying the exact hypothesis spans that are responsible for each model prediction. Using the e-SNLI human explanations, we verify that our model makes sensible decisions at a span level, despite not using any span labels during training. We can further improve model performance and span-level decisions by using the e-SNLI explanations during training. Finally, our model is more robust in a reduced data setting. When training with only 1,000 examples, out-of-distribution performance improves on the MNLI matched and mismatched validation sets by 13% and 16% relative to the baseline. Training with fewer observations yields further improvements, both in-distribution and out-of-distribution.


title: Informed Pre-Training on Prior Knowledge

abstract: When training data is scarce, the incorporation of additional prior knowledge can assist the learning process. While it is common to initialize neural networks with weights that have been pre-trained on other large data sets, pre-training on more concise forms of knowledge has rather been overlooked. In this paper, we propose a novel informed machine learning approach and suggest to pre-train on prior knowledge. Formal knowledge representations, e.g. graphs or equations, are first transformed into a small and condensed data set of knowledge prototypes. We show that informed pre-training on such knowledge prototypes (i) speeds up the learning processes, (ii) improves generalization capabilities in the regime where not enough training data is available, and (iii) increases model robustness. Analyzing which parts of the model are affected most by the prototypes reveals that improvements come from deeper layers that typically represent high-level features. This confirms that informed pre-training can indeed transfer semantic knowledge. This is a novel effect, which shows that knowledge-based pre-training has additional and complementary strengths to existing approaches.


title: SiSPRNet: End-to-End Learning for Single-Shot Phase Retrieval

abstract: With the success of deep learning methods in many image processing tasks, deep learning approaches have also been introduced to the phase retrieval problem recently. These approaches are different from the traditional iterative optimization methods in that they usually require only one intensity measurement and can reconstruct phase images in real-time. However, because of tremendous domain discrepancy, the quality of the reconstructed images given by these approaches still has much room to improve to meet the general application requirements. In this paper, we design a novel deep neural network structure named SiSPRNet for phase retrieval based on a single Fourier intensity measurement. To effectively utilize the spectral information of the measurements, we propose a new feature extraction unit using the Multi-Layer Perceptron (MLP) as the front end. It allows all pixels of the input intensity image to be considered together for exploring their global representation. The size of the MLP is carefully designed to facilitate the extraction of the representative features while reducing noises and outliers. A dropout layer is also equipped to mitigate the possible overfitting problem in training the MLP. To promote the global correlation in the reconstructed images, a self-attention mechanism is introduced to the Up-sampling and Reconstruction (UR) blocks of the proposed SiSPRNet. These UR blocks are inserted into a residual learning structure to prevent the weak information flow and vanishing gradient problems due to their complex layer structure. Extensive evaluations of the proposed model are performed using different testing datasets of phase-only images and images with linearly related magnitude and phase. Experiments were conducted on an optical experimentation platform to understand the performance of different deep learning methods when working in a practical environment.


title: Accretion variability of the multiple T Tauri system VW Cha

abstract: Classical T Tauri stars are low-mass objects, which are still accreting material from the surrounding circumstellar disk. The accretion process is essential in the formation of Sun-like stars and in setting the properties of the disk at the time when planet formation occurs. We constructed a complex dataset in order to examine the accretion process of VW Cha, a classical T Tauri multiple system with the aim of studying the physical origin of the photometric and spectroscopic variability of the system. The TESS Space Telescope observed VW Cha between 2019 April 22 and June 19, and we complemented these data with contemporaneous ground-based $I_CJHK$ band photometric measurements. In addition, we obtained high-resolution optical spectra with the VLT/ESPRESSO and the 2.2\,m/FEROS instruments. Analyzing these data, we found that the TESS light curve shows photometric variations on timescales from minutes to weeks with a peak-to-peak amplitude of $\sim$0.8 mag. The near-infrared light curves follow the shape of the optical measurements, however, the peak-to-peak amplitudes are slightly increasing towards the longer wavelengths. We took spectra in both fainter and brighter photometric states of the system, allowing us to examine the origin of a photometric brightening event. Our results show that this brightening event can be explained by increased accretion. In addition, our spectroscopic data also suggest that the primary component of VW Cha is a spectroscopic binary, as it was proposed in earlier works.


title: Pion damping width and pion spectral function in hot pion gas

abstract: The temperature behaviour of the pion width in the hadronic phase is investigated in the framework of the NJL model. The contribution to the width from the pion-pion collision is considered with a scalar sigma-meson as an intermediate state. It is shown that the pion width significantly broadens at $T>0.1$ GeV. Using the two-step iteration method, suggested by Kadanoff and Baym, the pion spectral function in a hot pion gas is calculated at different temperatures.


title: Self-intersection of the relative dualizing sheaf on modular curves X(N)

abstract: Let $N\geq 3$ be a composite, odd, and square-free integer and let $\Gamma$ be the principal congruence subgroup of level $N$. Let $X(N)$ be the modular curve of genus $g_{\Gamma}$ associated to $\Gamma$. In this article, we study the Arakelov invariant $e(\Gamma)=\bar{\omega}^2/\varphi(N)$, with $\bar{\omega}^2$ denoting the self-intersection of the relative dualizing sheaf for the minimal regular model of $X(N)$, equipped with the Arakelov metric, and $\varphi(N)$ is the Euler's phi function. Our main result is the asymptotics $e(\Gamma) = 2g_{\Gamma}\log(N) + o(g_{\Gamma}\log(N))$, as the level $N$ tends to infinity.


title: Contrastive Representation Learning for Cross-Document Coreference Resolution of Events and Entities

abstract: Identifying related entities and events within and across documents is fundamental to natural language understanding. We present an approach to entity and event coreference resolution utilizing contrastive representation learning. Earlier state-of-the-art methods have formulated this problem as a binary classification problem and leveraged large transformers in a cross-encoder architecture to achieve their results. For large collections of documents and corresponding set of $n$ mentions, the necessity of performing $n^{2}$ transformer computations in these earlier approaches can be computationally intensive. We show that it is possible to reduce this burden by applying contrastive learning techniques that only require $n$ transformer computations at inference time. Our method achieves state-of-the-art results on a number of key metrics on the ECB+ corpus and is competitive on others.


title: Probabilistic forecasting of German electricity imbalance prices

abstract: The exponential growth of renewable energy capacity has brought much uncertainty to electricity prices and to electricity generation. To address this challenge, the energy exchanges have been developing further trading possibilities, especially the intraday and balancing markets. For an energy trader participating in both markets, the forecasting of imbalance prices is of particular interest. Therefore, in this manuscript we conduct a very short-term probabilistic forecasting of imbalance prices, contributing to the scarce literature in this novel subject. The forecasting is performed 30 minutes before the delivery, so that the trader might still choose the trading place. The distribution of the imbalance prices is modelled and forecasted using methods well-known in the electricity price forecasting literature: lasso with bootstrap, gamlss, and probabilistic neural networks. The methods are compared with a naive benchmark in a meaningful rolling window study. The results provide evidence of the efficiency between the intraday and balancing markets as the sophisticated methods do not substantially overperform the intraday continuous price index. On the other hand, they significantly improve the empirical coverage. The analysis was conducted on the German market, however it could be easily applied to any other market of similar structure.


title: Federated Distillation based Indoor Localization for IoT Networks

abstract: Federated distillation (FD) paradigm has been recently proposed as a promising alternative to federated learning (FL) especially in wireless sensor networks with limited communication resources. However, all state-of-the art FD algorithms are designed for only classification tasks and less attention has been given to regression tasks. In this work, we propose an FD framework that properly operates on regression learning problems. Afterwards, we present a use-case implementation by proposing an indoor localization system that shows a good trade-off communication load vs. accuracy compared to federated learning (FL) based indoor localization. With our proposed framework, we reduce the number of transmitted bits by up to 98%. Moreover, we show that the proposed framework is much more scalable than FL, thus more likely to cope with the expansion of wireless networks.


title: Line Profile Studies of Coronal Active Regions in Fe XII {\lambda}195.12 Using Hinode/EIS

abstract: Coronal active regions are studied using Hinode/EIS observations in the EUV line Fe XII {\lambda}195.12 by analyzing their line profiles from 2006 December to 2019 December. The period covers the last 2 yr of solar cycle 23 and solar cycle 24 fully. Active regions are the main source of magnetic field in the solar atmosphere, important in its heating and dynamics. Line profiles were obtained from various active regions spread across the Sun on a monthly basis from which we obtained the intensity, line width, Doppler velocity, and centroid and examined their variation during the solar cycle. The histograms of the Doppler velocity and centroid show that they behave in six different ways with respect to the position of rest wavelength. In addition, the shifts in the centroid were found to be more compared to the Doppler velocity. The variation of the line width with respect to the Doppler velocity or the centroid mostly follows a second-degree polynomial. A multicomponent line profile is simulated to explain the difference in the behavior of the Doppler velocity and the centroid with respect to the line width. We also find that the intensity and the line width of the different data sets show a global dependence on the solar cycle with a good correlation. The implications of the results for the coronal heating and dynamics are pointed out.


title: Wiggle Island

abstract: A wiggle is an embedded curve in the plane that is the attractor of an iterated function system associated to a complex parameter z. We show the space of wiggles is disconnected -- i.e. there is a wiggle island.


title: Unsupervised Tokenization Learning

abstract: In the presented study, we discover that the so-called "transition freedom" metric appears superior for unsupervised tokenization purposes in comparison to statistical metrics such as mutual information and conditional probability, providing F-measure scores in range from 0.71 to 1.0 across explored multilingual corpora. We find that different languages require different offshoots of that metric (such as derivative, variance, and "peak values") for successful tokenization. Larger training corpora do not necessarily result in better tokenization quality, while compressing the models by eliminating statistically weak evidence tends to improve performance. The proposed unsupervised tokenization technique provides quality better than or comparable to lexicon-based ones, depending on the language.


title: Determination of Multi-mode Motional Quantum States in a Trapped Ion System

abstract: Trapped atomic ions are a versatile platform for studying interactions between spins and bosons by coupling the internal states of the ions to their motion. Measurement of complex motional states with multiple modes is challenging, because all motional state populations can only be measured indirectly through the spin state of ions. Here we present a general method to determine the Fock state distributions and to reconstruct the density matrix of an arbitrary multi-mode motional state. We experimentally verify the method using different entangled states of multiple radial modes in a 5-ion chain. This method can be extended to any system with Jaynes-Cummings type interactions.


title: New models and Big Bang Nucleosynthesis constraints in $f(Q)$ gravity

abstract: The $f(Q)$ theories of modified gravity arise from the consideration of non-metricity as the basic geometric quantity, and have been proven to be very efficient in describing the late-time Universe. We use the Big Bang Nucleosynthesis (BBN) formalism and observations in order to extract constraints on various classes of f(Q) models. In particular, we calculate the deviations that f(Q) terms bring on the freeze-out temperature in comparison to that of the standard $\Lambda CDM$ evolution, and then we impose the observational bound on $ |\frac{\delta {T}_f}{{T}_f}|$ to extract constraints on the involved parameters of the considered models. Concerning the polynomial model, we show that the exponent parameter should be negative, while for the power-exponential model and the new hyperbolic tangent - power model we find that they pass the BBN constraints trivially. Finally, we examine two DGP-like $f(Q)$ models, and we extract the bounds on their model parameters. Since many gravitational modifications, although able to describe the late-time evolution of the Universe, produce too-much modification at early times and thus fall to pass the BBN confrontation, the fact that $f(Q)$ gravity can safely pass the BBN constraints is an important advantage of this modified gravity class.


title: Overfitting in quantum machine learning and entangling dropout

abstract: The ultimate goal in machine learning is to construct a model function that has a generalization capability for unseen dataset, based on given training dataset. If the model function has too much expressibility power, then it may overfit to the training data and as a result lose the generalization capability. To avoid such overfitting issue, several techniques have been developed in the classical machine learning regime, and the dropout is one such effective method. This paper proposes a straightforward analogue of this technique in the quantum machine learning regime, the entangling dropout, meaning that some entangling gates in a given parametrized quantum circuit are randomly removed during the training process to reduce the expressibility of the circuit. Some simple case studies are given to show that this technique actually suppresses the overfitting.


title: Scaling relations of convective granulation noise across the HR diagram from 3D stellar atmosphere models

abstract: High-precision photometric data from space missions have improved our understanding of stellar granulation. These observations have shown with precision the stochastic brightness fluctuations of stars across the HR diagram, allowing us to better understand how stellar surface convection reacts to a change in stellar parameters. These fluctuations need to be understood and quantified in order to improve the detection and characterization of exoplanets. In this work, we provide new scaling relations of two characteristic properties of the brightness fluctuations time series, the standard deviation ($\sigma$) and the auto-correlation time ($\tau\rm_{eff}$). This was done by using long time series of 3D stellar atmosphere models at different metallicities and across the HR diagram, generated with a 3D radiative hydrodynamical code: the STAGGER code. We compared our synthetic granulation properties with the values of a large sample of Kepler stars, and analyzed selected stars with accurate stellar parameters from the Kepler LEGACY sample. Our 3D models showed that $\sigma\propto\nu\rm_{max}^{-0.567\pm0.012}$ and $\tau\rm_{eff}\propto\nu\rm_{max}^{-0.997\pm0.018}$ for stars at solar metallicity. We showed that both $\sigma$ and $\tau\rm_{eff}$ decrease with metallicity, although the metallicity dependence is more significant on $\sigma$. Unlike previous studies, we found very good agreement between $\sigma$ from Kepler targets and the 3D models at $\log{g}\leq3.5$, and a good correlation between the stars and models with $\log{g}\geq3.5$. For $\tau\rm_{eff}$, we found that the 3D models reproduced well the Kepler LEGACY star values. Overall, this study shows that 3D stellar atmosphere models reproduce the granulation properties of stars across the HR diagram.


title: Data augmentation for efficient learning from parametric experts

abstract: We present a simple, yet powerful data-augmentation technique to enable data-efficient learning from parametric experts for reinforcement and imitation learning. We focus on what we call the policy cloning setting, in which we use online or offline queries of an expert or expert policy to inform the behavior of a student policy. This setting arises naturally in a number of problems, for instance as variants of behavior cloning, or as a component of other algorithms such as DAGGER, policy distillation or KL-regularized RL. Our approach, augmented policy cloning (APC), uses synthetic states to induce feedback-sensitivity in a region around sampled trajectories, thus dramatically reducing the environment interactions required for successful cloning of the expert. We achieve highly data-efficient transfer of behavior from an expert to a student policy for high-degrees-of-freedom control problems. We demonstrate the benefit of our method in the context of several existing and widely used algorithms that include policy cloning as a constituent part. Moreover, we highlight the benefits of our approach in two practically relevant settings (a) expert compression, i.e. transfer to a student with fewer parameters; and (b) transfer from privileged experts, i.e. where the expert has a different observation space than the student, usually including access to privileged information.


title: Nancy: An efficient parallel Network Calculus library

abstract: This paper describes Nancy, a Network Calculus (NC) library that allows users to perform complex min-plus and max-plus algebra operations efficiently. To the best of our knowledge, Nancy is the only open-source library that implements operations working on arbitrary piecewise affine functions, as well as to implement some of them (e.g. sub-additive closure and function composition). Nancy allows researchers to compute NC results using a straightforward syntax, which matches the algebraic one. Moreover, it is designed having computational efficiency in mind: it exploits optimizations of data structures, it uses inheritance to allow for faster algorithms when they are available (e.g., for specific subclasses of functions), and it is natively parallel, thus reaping the benefit of multicore hardware. This makes it usable to solve NC problems which were previously considered beyond the realm of tractable.


title: Cosmological parameters from Planck data in SU(2)$_{\rm CMB}$, their local $\Lambda$CDM values, and the modified photon Boltzmann equation

abstract: A review of the spatially flat cosmological model SU(2)$_{\rm CMB}$, minimally induced by the postulate that the Cosmic Microwave Background (CMB) is subject to an SU(2) rather than a U(1) gauge principle, is given. Cosmological parameter values, which are determined from the Planck CMB power spectra at small angular scales, are compared to their values in spatially flat $\Lambda$CDM from both local and global extractions. As a global model SU(2)$_{\rm CMB}$ leans towards local $\Lambda$CDM cosmology and is in tension with some global $\Lambda$CDM parameter values. We present spectral antiscreening / screening effects in SU(2)$_{\rm CMB}$ radiance within the Rayleigh-Jeans regime in dependence on temperature and frequency. Such radiance anomalies can cause CMB large-angle anomalies. Therefore, it is pointed out how SU(2)$_{\rm CMB}$ modifies the Boltzmann equation for the perturbations of the photon phase space distribution at low redshift and why this requires to the solve the $\ell$-hierarchy on a comoving momentum grid ($q$-grid) for all $z$.


title: Systematic shell model study for $N=82$ and $N=126$ isotones and nuclear isomers

abstract: In the present work, we have done a systematic shell model study of $N=82$ and $N=126$ isotones. For the $N=82$ isotones, we have performed calculations using SN100PN interaction, while for $N=126$ isotones, we have used KHPE interaction. Similarities between these two isotonic chains have been reported, using the strong resemblance between the high-$j$ orbitals. Apart from the nuclear spectroscopic properties, we have also explained different isomeric states in these two regions. In the $N$ =82 region, we have mainly discussed the properties of the $6^+$ and $17/2^+$ isomers, while in the $N=126$ region for $8^+$, $11^-$, $21/2^-$ and $29/2^+$ isomers. We have reported $B(E2)$, $B(E3)$, $g$-factor, and quadrupole moments of the isomeric states for comparison in these two isotonic chains.


title: Infinite Dimensional Piecewise Deterministic Markov Processes

abstract: In this paper we aim to construct infinite dimensional versions of well established Piecewise Deterministic Monte Carlo methods, such as the Bouncy Particle Sampler, the Zig-Zag Sampler and the Boomerang Sampler. In order to do so we provide an abstract infinite-dimensional framework for Piecewise Deterministic Markov Processes (PDMPs) with unbounded event intensities. We further develop exponential convergence to equilibrium of the infinite dimensional Boomerang Sampler, using hypocoercivity techniques. Furthermore we establish how the infinite dimensional Boomerang Sampler admits a finite dimensional approximation, rendering it suitable for computer simulation.


title: Quasi-invariance of Gaussian measures of negative regularity for fractional nonlinear Schr\"odinger equations

abstract: We consider the Cauchy problem for the fractional nonlinear Schr\"{o}dinger equation (FNLS) on the one-dimensional torus with cubic nonlinearity and high dispersion parameter $\alpha > 1$, subject to a Gaussian random initial data of negative Sobolev regularity $\sigma<s-\frac{1}{2}$, for $s \le \frac 12$. We show that for all $s_{*}(\alpha) <s\leq \frac{1}{2}$, the equation is almost surely globally well-posed. Moreover, the associated Gaussian measure supported on $H^{s}(\mathbb T)$ is quasi-invariant under the flow of the equation. For $\alpha < \frac{1}{20}(17 + 3\sqrt{21}) \approx 1.537$, the regularity of the initial data is lower than the one provided by the deterministic well-posedness theory. We obtain this result by following the approach of DiPerna-Lions (1989); first showing global-in-time bounds for the solution of the infinite-dimensional Liouville equation for the transport of the Gaussian measure, and then transferring these bounds to the solution of the equation by adapting Bourgain's invariant measure argument to the quasi-invariance setting. This allows us to bootstrap almost sure global bounds for the solution of (FNLS) from its probabilistic local well-posedness theory.


title: What is Your Metric Telling You? Evaluating Classifier Calibration under Context-Specific Definitions of Reliability

abstract: Classifier calibration has received recent attention from the machine learning community due both to its practical utility in facilitating decision making, as well as the observation that modern neural network classifiers are poorly calibrated. Much of this focus has been towards the goal of learning classifiers such that their output with largest magnitude (the "predicted class") is calibrated. However, this narrow interpretation of classifier outputs does not adequately capture the variety of practical use cases in which classifiers can aid in decision making. In this work, we argue that more expressive metrics must be developed that accurately measure calibration error for the specific context in which a classifier will be deployed. To this end, we derive a number of different metrics using a generalization of Expected Calibration Error (ECE) that measure calibration error under different definitions of reliability. We then provide an extensive empirical evaluation of commonly used neural network architectures and calibration techniques with respect to these metrics. We find that: 1) definitions of ECE that focus solely on the predicted class fail to accurately measure calibration error under a selection of practically useful definitions of reliability and 2) many common calibration techniques fail to improve calibration performance uniformly across ECE metrics derived from these diverse definitions of reliability.


title: Microwave detection of gliding Majorana zero modes in nanowires

abstract: We study a topological superconducting nanowire that hosts gliding Majorana zero modes in the presence of a microwave cavity field. We show that the cavity decay rate depends on both the parity encoded by the Majorana zero modes and their motion, in the absence of any direct overlap of their wavefunctions. That is because the extended bulk states that overlap with both Majorana states, facilitate their momentum-resolved microwave spectroscopy, with the gliding acting as to modify the interference pattern via a momentum boost. Moreover, we demonstrate that these non-local effects are robust against moderate disorder in the chemical potential, and confirm the numerical calculations with an analytical low-energy model. Our approach offers an alternative to tunneling spectroscopy to probe non-local features associated with the Majorana zero modes in nanowires.


title: Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers

abstract: Recognizing and categorizing lexical collocations in context is useful for language learning, dictionary compilation and downstream NLP. However, it is a challenging task due to the varying degrees of frozenness lexical collocations exhibit. In this paper, we put forward a sequence tagging BERT-based model enhanced with a graph-aware transformer architecture, which we evaluate on the task of collocation recognition in context. Our results suggest that explicitly encoding syntactic dependencies in the model architecture is helpful, and provide insights on differences in collocation typification in English, Spanish and French.


title: Poisson geometry around Poisson submanifolds

abstract: We construct a first order local model for Poisson manifolds around a large class of Poisson submanifolds and we give conditions under which this model is a local normal form. The resulting linearization theorem includes as special cases all the known linearization theorems for fixed points and symplectic leaves. The symplectic groupoid version of these results gives a solution to the groupoid coisotropic embedding problem.


title: Groundhog: Efficient Request Isolation in FaaS

abstract: Security is a core responsibility for Function-as-a-Service (FaaS) providers. The prevailing approach has each function execute in its own container to isolate concurrent executions of different functions. However, successive invocations of the same function commonly reuse the runtime state of a previous invocation in order to avoid container cold-start delays when invoking a function. Although efficient, this container reuse has security implications for functions that are invoked on behalf of differently privileged users or administrative domains: bugs in a function's implementation, third-party library, or the language runtime may leak private data from one invocation of the function to subsequent invocations of the same function. Groundhog isolates sequential invocations of a function by efficiently reverting to a clean state, free from any private data, after each invocation. The system exploits two properties of typical FaaS platforms: each container executes at most one function at a time and legitimate functions do not retain state across invocations. This enables Groundhog to efficiently snapshot and restore function state between invocations in a manner that is independent of the programming language/runtime and does not require any changes to existing functions, libraries, language runtimes, or OS kernels. We describe the design of Groundhog and its implementation in OpenWhisk, a popular production-grade open-source FaaS framework. On three existing benchmark suites, Groundhog isolates sequential invocations with modest overhead on end-to-end latency (median: 1.5%, 95p: 7%) and throughput (median: 2.5%, 95p: 49.6%), relative to an insecure baseline that reuses the container and runtime state.


title: CELEST: Federated Learning for Globally Coordinated Threat Detection

abstract: The cyber-threat landscape has evolved tremendously in recent years, with new threat variants emerging daily, and large-scale coordinated campaigns becoming more prevalent. In this study, we propose CELEST (CollaborativE LEarning for Scalable Threat detection, a federated machine learning framework for global threat detection over HTTP, which is one of the most commonly used protocols for malware dissemination and communication. CELEST leverages federated learning in order to collaboratively train a global model across multiple clients who keep their data locally, thus providing increased privacy and confidentiality assurances. Through a novel active learning component integrated with the federated learning technique, our system continuously discovers and learns the behavior of new, evolving, and globally-coordinated cyber threats. We show that CELEST is able to expose attacks that are largely invisible to individual organizations. For instance, in one challenging attack scenario with data exfiltration malware, the global model achieves a three-fold increase in Precision-Recall AUC compared to the local model. We also design a poisoning detection and mitigation method, DTrust, specifically designed for federated learning in the collaborative threat detection domain. DTrust successfully detects poisoning clients using the feedback from participating clients to investigate and remove them from the training process. We deploy CELEST on two university networks and show that it is able to detect the malicious HTTP communication with high precision and low false positive rates. Furthermore, during its deployment, CELEST detected a set of previously unknown 42 malicious URLs and 20 malicious domains in one day, which were confirmed to be malicious by VirusTotal.