title: Audio-based Musical Version Identification: Elements and Challenges

abstract: In this article, we aim to provide a review of the key ideas and approaches proposed in 20 years of scientific literature around musical version identification (VI) research and connect them to current practice. For more than a decade, VI systems suffered from the accuracy-scalability trade-off, with attempts to increase accuracy that typically resulted in cumbersome, non-scalable systems. Recent years, however, have witnessed the rise of deep learning-based approaches that take a step toward bridging the accuracy-scalability gap, yielding systems that can realistically be deployed in industrial applications. Although this trend positively influences the number of researchers and institutions working on VI, it may also result in obscuring the literature before the deep learning era. To appreciate two decades of novel ideas in VI research and to facilitate building better systems, we now review some of the successful concepts and applications proposed in the literature and study their evolution throughout the years.


title: A Robust Cybersecurity Topic Classification Tool

abstract: In this research, we use user defined labels from three internet text sources (Reddit, Stackexchange, Arxiv) to train 21 different machine learning models for the topic classification task of detecting cybersecurity discussions in natural text. We analyze the false positive and false negative rates of each of the 21 model's in a cross validation experiment. Then we present a Cybersecurity Topic Classification (CTC) tool, which takes the majority vote of the 21 trained machine learning models as the decision mechanism for detecting cybersecurity related text. We also show that the majority vote mechanism of the CTC tool provides lower false negative and false positive rates on average than any of the 21 individual models. We show that the CTC tool is scalable to the hundreds of thousands of documents with a wall clock time on the order of hours.


title: TraverseNet: Unifying Space and Time in Message Passing for Traffic Forecasting

abstract: This paper aims to unify spatial dependency and temporal dependency in a non-Euclidean space while capturing the inner spatial-temporal dependencies for traffic data. For spatial-temporal attribute entities with topological structure, the space-time is consecutive and unified while each node's current status is influenced by its neighbors' past states over variant periods of each neighbor. Most spatial-temporal neural networks for traffic forecasting study spatial dependency and temporal correlation separately in processing, gravely impaired the spatial-temporal integrity, and ignore the fact that the neighbors' temporal dependency period for a node can be delayed and dynamic. To model this actual condition, we propose TraverseNet, a novel spatial-temporal graph neural network, viewing space and time as an inseparable whole, to mine spatial-temporal graphs while exploiting the evolving spatial-temporal dependencies for each node via message traverse mechanisms. Experiments with ablation and parameter studies have validated the effectiveness of the proposed TraverseNet, and the detailed implementation can be found from https://github.com/nnzhan/TraverseNet.


title: Recommendation System Simulations: A Discussion of Two Key Challenges

abstract: As recommendation systems become increasingly standard for online platforms, simulations provide an avenue for understanding the impacts of these systems on individuals and society. When constructing a recommendation system simulation, there are two key challenges: first, defining a model for users selecting or engaging with recommended items and second, defining a mechanism for users encountering items that are not recommended to the user directly by the platform, such as by a friend sharing specific content. This paper will delve into both of these challenges, reviewing simulation assumptions from existing research and proposing alternative assumptions. We also include a broader discussion of the limitations of simulations and outline of open questions in this area.


title: Ferroptosis as a Biological Phase Transition I: avascular and vascular tumor growth

abstract: Herewith we discuss a network model of the ferroptosis avascular and vascular tumor growth based on our previous proposed framework. Chiefly, ferroptosis should be viewed as a first order phase transition characterized by a supercritical Andronov Hopf bifurcation, with the emergence of limit cycle. The increase of the population of the oxidized PUFA fragments, take as the control parameter, involves an inverse Feigenbaum, (a cascade of saddle foci Shilnikov's bifurcations) scenario, which results in the stabilization of the dynamics and in a decrease of complexity.

categories: physics.bio-ph nlin.CD q-bio.BM q-bio.QM


title: Direct verification of the kinetic description of wave turbulence for finite-size systems dominated by interactions among groups of 6 waves

abstract: The present work considers systems whose dynamics are governed by the nonlinear interactions among groups of 6 nonlinear waves, such as those described by the unforced quintic nonlinear Schr\"odinger equation. Specific parameter regimes in which ensemble-averaged dynamics of such systems with finite size are accurately described by a wave kinetic equation, as used in wave turbulence theory, are theoretically predicted. In addition, the underlying reasons that the wave kinetic equation may be a poor predictor of wave dynamics outside these regimes are also discussed. These theoretical predictions are directly verified by comparing ensemble averages of solutions to the dynamical equation with corresponding solutions of the wave kinetic equation.


title: Very high frequency probes for atomic force microscopy with silicon optomechanics

abstract: Atomic force microscopy (AFM) has been constantly supporting nanosciences and nanotechnologies for over 30 years, being present in many fields from condensed matter physics to biology. It enables measuring very weak forces at the nanoscale, thus elucidating interactions at play in fundamental processes. Here we leverage the combined benefits of micro/nanoelectromechanical systems and cavity optomechanics to fabricate a sensor for dynamic mode AFM at a frequency above 100 MHz. This is two decades above the fastest commercial AFM probes, suggesting opportunity for measuring forces at timescales unexplored so far. The fabrication is achieved using very-large scale integration technologies inherited from photonic silicon circuits. The probe's ring optomechanical cavity is coupled to a 1.55 um laser light and features a 130 MHz mechanical resonance mode with a quality factor of 900 in air. A limit of detection in displacement of 3.10-16 m/sqrt(Hz) is obtained, enabling the detection of the Brownian motion of the probe and paving the way for force sensing experiments in the dynamic mode with a working vibration amplitude in the picometer range. Inserted in a custom AFM instrument embodiment, this optomechanical sensor demonstrates the capacity to perform force-distance measurements and to maintain a constant interaction strength between tip and sample, an essential requirement for AFM applications. Experiments show indeed a stable closed-loop operation with a setpoint of 4 nN/nm for an unprecedented sub-picometer vibration amplitude, where the tip-sample interaction is mediated by a stretched water meniscus.


title: Experimental study to optimise the treatment efficacy of pharmaceutical effluents by combining electron beam irradiation with conventional techniques

abstract: The inability of conventional methods to completely remove the contaminants from pharmaceutical effluents led us to study the effect of Electron Beam (EB) irradiation on real pharmaceutical wastewater. In this paper, the samples from different stages of existing treatment facilities of industry are irradiated with varying doses from 25 to 200 kGy. The study aimed to find a suitable combination of EB and conventional treatments for efficient degradation of complex pharmaceutical effluent. It has been successfully demonstrated that electron beam irradiation when combined with conventional techniques like coagulation before or after the irradiation improves the efficiency of the process, resulting in lower Chemical Oxygen Demand (COD). In this investigation, the maximum COD reduction was found to be around 65 percent.


title: Feasibility of Proof of Authority as a Consensus Protocol Model

abstract: Blockchain is a type of decentralized distributed network which acts as an immutable digital ledger. Despite the absence of any central governing authority to validate the blocks in the ledger, it is considered secure and immutable due to the consensus protocol among various nodes of the network. A consensus algorithm is a mechanism that guarantees the reliability of the blockchain and helps all connected nodes or peers to reach common ground regarding the present state of the blockchain network thus an ideal consensus algorithm must be secure, reliable, and fast. There are several different algorithms to reach a consensus among the nodes thus this article seeks to test the practicality of Proof of Authority in the blockchain network as a consensus algorithm and its comparison with current mainstream consensus algorithms.


title: Large-scale flow in a cubic Rayleigh-B\'{e}nard cell: Long-term turbulence statistics and Markovianity of macrostate transitions

abstract: We investigate the large-scale circulation (LSC) in a turbulent Rayleigh-B\'enard convection flow in a cubic closed convection cell by means of direct numerical simulations at a Rayleigh number $Ra=10^6$. The numerical studies are conducted for single flow trajectories up to $10^5$ convective free-fall times to obtain a sufficient sampling of the four discrete LSC states, which can be summarized to one macrostate, and the two crossover configurations which are taken by the flow in between for short periods. We find that large-scale dynamics depends strongly on the Prandtl number $Pr$ of the fluid which has values of 0.1, 0.7, and 10. Alternatively, we run an ensemble of 3600 short-term direct numerical simulations to study the transition probabilities between the discrete LSC states. This second approach is also used to probe the Markov property of the dynamics. Our ensemble analysis gave strong indication of Markovianity of the transition process from one LSC state to another, even though the data are still accompanied by considerable noise. It is based on the eigenvalue spectrum of the transition probability matrix, further on the distribution of persistence times and the joint distribution of two successive macrostate persistence times.


title: Direct statistical simulation of the Lorenz63 system

abstract: We use direct statistical simulation (DSS) to find the low-order statistics of the well-known dynamical system, the Lorenz63 model. Instead of accumulating statistics from numerical simulation of the dynamical systems, we solve the equations of motion for the statistics themselves after closing them by making several different choices for the truncation. Fixed points of the statistics are obtained either by time evolving, or by iterative methods. Statistics so obtained are compared to those found by the traditional approach.


title: Minimal hypersurfaces in manifolds of Ricci curvature bounded below

abstract: In this paper, we study the angle estimate of distance functions from minimal hypersurfaces in manifolds of Ricci curvature bounded from below using Colding's method in [13]. With Cheeger-Colding theory, we obtain the Laplacian comparison for limits of distance functions from minimal hypersurfaces in the version of Ricci limit space. As an application, if a sequence of minimal hypersurfaces converges to a metric cone $CY\times\mathbb{R}^{n-k}(2\leq k\leq n)$ in a non-collapsing metric cone $CX\times\mathbb{R}^{n-k}$ obtained from ambient manifolds of almost nonnegative Ricci curvature, then we can prove a Frankel property for the cross section $Y$ of $CY$. Namely, $Y$ has only one connected component in $X$.


title: Compiler-Driven FPGA Virtualization with SYNERGY

abstract: FPGAs are increasingly common in modern applications, and cloud providers now support on-demand FPGA acceleration in data centers. Applications in data centers run on virtual infrastructure, where consolidation, multi-tenancy, and workload migration enable economies of scale that are fundamental to the provider's business. However, a general strategy for virtualizing FPGAs has yet to emerge. While manufacturers struggle with hardware-based approaches, we propose a compiler/runtime-based solution called Synergy. We show a compiler transformation for Verilog programs that produces code able to yield control to software at sub-clock-tick granularity according to the semantics of the original program. Synergy uses this property to efficiently support core virtualization primitives: suspend and resume, program migration, and spatial/temporal multiplexing, on hardware which is available today. We use Synergy to virtualize FPGA workloads across a cluster of Altera SoCs and Xilinx FPGAs on Amazon F1. The workloads require no modification, run within 3-4x of unvirtualized performance, and incur a modest increase in FPGA fabric utilization.


title: Severity and Mortality Prediction Models to Triage Indian COVID-19 Patients

abstract: As the second wave in India mitigates, COVID-19 has now infected about 29 million patients countrywide, leading to more than 350 thousand people dead. As the infections surged, the strain on the medical infrastructure in the country became apparent. While the country vaccinates its population, opening up the economy may lead to an increase in infection rates. In this scenario, it is essential to effectively utilize the limited hospital resources by an informed patient triaging system based on clinical parameters. Here, we present two interpretable machine learning models predicting the clinical outcomes, severity, and mortality, of the patients based on routine non-invasive surveillance of blood parameters from one of the largest cohorts of Indian patients at the day of admission. Patient severity and mortality prediction models achieved 86.3% and 88.06% accuracy, respectively, with an AUC-ROC of 0.91 and 0.92. We have integrated both the models in a user-friendly web app calculator, https://triage-COVID-19.herokuapp.com/, to showcase the potential deployment of such efforts at scale.


title: Voxel selection framework based on meta-heuristic search and mutual information for brain decoding

abstract: Visual stimulus decoding is an increasingly important challenge in neuroscience. The goal is to classify the activity patterns from the human brain; during the sighting of visual objects. One of the crucial problems in the brain decoder is the selecting informative voxels. We propose a meta-heuristic voxel selection framework for brain decoding. It is composed of four phases: preprocessing of fMRI data; filtering insignificant voxels; postprocessing; and meta-heuristics selection. The main contribution is benefiting a meta-heuristics search algorithm to guide a wrapper voxel selection. The main criterion to nominate a voxel is based on its mutual information with the provided stimulus label. The results show impressive accuracy rates which are 90.66 +/- 3.66 and 91.61 +/- 8.24 for DS105 and DS107, respectively. This outperforms the most of existing brain decoders in similar validation conditions. The experimental results are very encouraging which can be successfully useId in the brain-computer interface.


title: Robust Narrowest Significance Pursuit: Inference for multiple change-points in the median

abstract: We propose Robust Narrowest Significance Pursuit (RNSP), a methodology for detecting localized regions in data sequences which each must contain a change-point in the median, at a prescribed global significance level. RNSP works by fitting the postulated constant model over many regions of the data using a new sign-multiresolution sup-norm-type loss, and greedily identifying the shortest intervals on which the constancy is significantly violated. By working with the signs of the data around fitted model candidates, RNSP fulfils its coverage promises under minimal assumptions, requiring only sign-symmetry and serial independence of the signs of the true residuals. In particular, it permits their heterogeneity and arbitrarily heavy tails. The intervals of significance returned by RNSP have a finite-sample character, are unconditional in nature and do not rely on any assumptions on the true signal. Code implementing RNSP is available at https://github.com/pfryz/nsp.


title: Numerical experiments to help understand cause and effect in massive star evolution

abstract: The evolution of massive stars is affected by a variety of physical processes including convection, rotation, mass loss and binary interaction. Because these processes modify the internal chemical abundance profiles in multiple ways simultaneously, it can be challenging to determine which properties of the stellar interior are primarily driving the overall evolution. Building on previous work, we develop a new modelling approach called SNAPSHOT that allows us to isolate the key features of the internal abundance profile that drive the evolution of massive stars. Using our approach, we compute numerical stellar structure models in thermal equilibrium covering key phases of stellar evolution. For the main sequence, we demonstrate that models with the same mass and very similar surface properties can have different internal distributions of hydrogen and convective core masses. We discuss why massive stars expand after the main sequence and the fundamental reasons for why they become red, blue or yellow supergiants. For the post-main sequence, we demonstrate that small changes in the abundance profile can cause very large effects on the surface properties. We also discuss the effects that produce blue supergiants and the cause of blue loops. Our models show that massive stars with lower metallicity tend to be more compact due to the combined effect of lower CNO abundances in the burning regions and lower opacity in the envelope.


title: Normal form coordinates for the Benjamin-Ono equation having expansions in terms of pseudo-differential operators

abstract: Near an arbitrary finite gap potential we construct real analytic, canonical coordinates for the Benjamin-Ono equation on the torus having the following two main properties: (1) up to a remainder term, which is smoothing to any given order, the coordinate transformation is a pseudo-differential operator of order 0 with principal part given by a modified Fourier transform (modification by a phase factor) and (2) the pullback of the Hamiltonian of the Benjamin-Ono is in normal form up to order three and the corresponding Hamiltonian vector field admits an expansion in terms of para-differential operators. Such coordinates are a key ingredient for studying the stability of finite gap solutions of the Benjamin-Ono equation under small, quasi-linear perturbations.


title: Learning Interpretable Representations of Entanglement in Quantum Optics Experiments using Deep Generative Models

abstract: Quantum physics experiments produce interesting phenomena such as interference or entanglement, which are core properties of numerous future quantum technologies. The complex relationship between the setup structure of a quantum experiment and its entanglement properties is essential to fundamental research in quantum optics but is difficult to intuitively understand. We present a deep generative model of quantum optics experiments where a variational autoencoder is trained on a dataset of quantum optics experimental setups. In a series of computational experiments, we investigate the learned representation of our Quantum Optics Variational Auto Encoder (QOVAE) and its internal understanding of the quantum optics world. We demonstrate that the QOVAE learns an interpretable representation of quantum optics experiments and the relationship between experiment structure and entanglement. We show the QOVAE is able to generate novel experiments for highly entangled quantum states with specific distributions that match its training data. The QOVAE can learn to generate specific entangled states and efficiently search the space of experiments that produce highly entangled quantum states. Importantly, we are able to interpret how the QOVAE structures its latent space, finding curious patterns that we can explain in terms of quantum physics. The results demonstrate how we can use and understand the internal representations of deep generative models in a complex scientific domain. The QOVAE and the insights from our investigations can be immediately applied to other physical systems.


title: High fidelity entanglement of neutral atoms via a Rydberg-mediated single-modulated-pulse controlled-PHASE gate

abstract: Neutral atom platform has become an attractive choice to study the science of quantum information and quantum simulation, where intense efforts have been devoted to the entangling processes between individual atoms. For the development of this area, two-qubit controlled-PHASE gate via Rydberg blockade is one of the most essential elements. Recent theoretical studies have suggested the advantages of introducing non-trivial waveform modulation into the gate protocol, which is anticipated to improve its performance towards the next stage. We report our recent experimental results in realizing a two-qubit controlled-PHASE($C_Z$) gate via off-resonant modulated driving(ORMD) embedded in two-photon transition for Rb atoms. It relies upon a single modulated driving pulse with a carefully calculated smooth waveform to gain the appropriate phase accumulations required by the two-qubit gate. Combining this $C_Z$ gate with global microwave pulses, two-atom entanglement is generated with the raw fidelity of 0.945(6). Accounting for state preparation and measurement (SPAM) errors, we extract the entanglement operation fidelity to be 0.980(7). Our work features completing the $C_Z$ gate operation within a single pulse to avoid shelved Rydberg population, thus demonstrate another promising route for realizing high-fidelity two-qubit gate for neutral atom platform.


title: DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization

abstract: Dialogue is an essential part of human communication and cooperation. Existing research mainly focuses on short dialogue scenarios in a one-on-one fashion. However, multi-person interactions in the real world, such as meetings or interviews, are frequently over a few thousand words. There is still a lack of corresponding research and powerful tools to understand and process such long dialogues. Therefore, in this work, we present a pre-training framework for long dialogue understanding and summarization. Considering the nature of long conversations, we propose a window-based denoising approach for generative pre-training. For a dialogue, it corrupts a window of text with dialogue-inspired noise, and guides the model to reconstruct this window based on the content of the remaining conversation. Furthermore, to process longer input, we augment the model with sparse attention which is combined with conventional attention in a hybrid manner. We conduct extensive experiments on five datasets of long dialogues, covering tasks of dialogue summarization, abstractive question answering and topic segmentation. Experimentally, we show that our pre-trained model DialogLM significantly surpasses the state-of-the-art models across datasets and tasks. Source code and all the pre-trained models are available on our GitHub repository (https://github.com/microsoft/DialogLM).


title: Kantorovich-Rubinstein Distance and Approximation for Non-local Fokker-Planck Equations

abstract: This work is devoted to studying complex dynamical systems under non-Gaussian fluctuations. We first estimate the Kantorovich-Rubinstein distance for solutions of non-local Fokker-Planck equations associated with stochastic differential equations with non-Gaussian Levy noise. This is then applied to establish weak convergence of the corresponding probability distributions. Furthermore, this leads to smooth approximation for non-local Fokker-Planck equations, as illustrated in an example.


title: Stable Gabor phase retrieval in Gaussian shift-invariant spaces via biorthogonality

abstract: We study the phase reconstruction of signals $f$ belonging to complex Gaussian shift-invariant spaces $V^\infty(\varphi)$ from spectrogram measurements $|\mathcal{G} f(X)|$ where $\mathcal{G}$ is the Gabor transform and $X \subseteq \mathbb{R}^2$. An explicit reconstruction formula will demonstrate that such signals can be recovered from measurements located on parallel lines in the time-frequency plane by means of a Riesz basis expansion. Moreover, connectedness assumptions on $|f|$ result in stability estimates in the situation where one aims to reconstruct $f$ on compact intervals. Driven by a recent observation that signals in Gaussian shift-invariant spaces are determined by lattice measurements [Grohs, P., Liehr, L., Injectivity of Gabor phase retrieval from lattice measurements, Appl. Comput. Harmon. Anal. 62 (2023), pp. 173-193] we prove a sampling result on the stable approximation from finitely many spectrogram samples. The resulting algorithm provides a provably stable and convergent approximation technique. In addition, it constitutes a method of approximating signals in function spaces beyond $V^\infty(\varphi)$, such as Paley-Wiener spaces.


title: Gravitational Lensing By a Massive Object in a Dark Matter Halo. II. Shear, Phase, and Image Geometry

abstract: We study the gravitational lensing influence of a massive object in a dark matter halo, using a simple model of a point mass embedded in a spherical Navarro--Frenk--White halo. Building on the analysis of critical curves and caustics presented in the first part of this work, we proceed to explore the geometry of images formed by the lens. First, we analyze several lensing quantities including shear, phase, and their weak-lensing approximations, illustrating the results with image-plane maps. We derive formulae and present a geometric interpretation for the shear and phase of a combination of two axially symmetric mass distributions. In the case of our lens model, we describe the occurrence of zero-shear points and specify the conditions under which they become umbilic points. Second, we use the eigenvalue decomposition of the inverse of the lens-equation Jacobian matrix to compute the magnification and flattening of lensed images. Based on this, we introduce the convergence--shear diagram, a novel and compact way of visualizing the properties of images formed by a particular gravitational lens. We inspect relative deviations of the analyzed lensing quantities in order to evaluate the perturbing effect of the point mass and the applicability of the weak-lensing approximation. We explore the dependence of the results on the point-mass parameters by studying grids of plots for different combinations of its position and mass. We provide analytical explanations for important patterns arising in these plots and discuss the implications for the lensing influence of isolated compact bodies in dark matter halos.


title: Statistical Privacy Guarantees of Machine Learning Preprocessing Techniques

abstract: Differential privacy provides strong privacy guarantees for machine learning applications. Much recent work has been focused on developing differentially private models, however there has been a gap in other stages of the machine learning pipeline, in particular during the preprocessing phase. Our contributions are twofold: we adapt a privacy violation detection framework based on statistical methods to empirically measure privacy levels of machine learning pipelines, and apply the newly created framework to show that resampling techniques used when dealing with imbalanced datasets cause the resultant model to leak more privacy. These results highlight the need for developing private preprocessing techniques.


title: Voxel Transformer for 3D Object Detection

abstract: We present Voxel Transformer (VoTr), a novel and effective voxel-based Transformer backbone for 3D object detection from point clouds. Conventional 3D convolutional backbones in voxel-based 3D detectors cannot efficiently capture large context information, which is crucial for object recognition and localization, owing to the limited receptive fields. In this paper, we resolve the problem by introducing a Transformer-based architecture that enables long-range relationships between voxels by self-attention. Given the fact that non-empty voxels are naturally sparse but numerous, directly applying standard Transformer on voxels is non-trivial. To this end, we propose the sparse voxel module and the submanifold voxel module, which can operate on the empty and non-empty voxel positions effectively. To further enlarge the attention range while maintaining comparable computational overhead to the convolutional counterparts, we propose two attention mechanisms for multi-head attention in those two modules: Local Attention and Dilated Attention, and we further propose Fast Voxel Query to accelerate the querying process in multi-head attention. VoTr contains a series of sparse and submanifold voxel modules and can be applied in most voxel-based detectors. Our proposed VoTr shows consistent improvement over the convolutional baselines while maintaining computational efficiency on the KITTI dataset and the Waymo Open dataset.


title: Low-energy monopole strength in spherical and deformed nuclei : cluster and soft modes

abstract: Background : Several recent experiments report significant low-energy isoscalar monopole strength, below the giant resonance, in various nuclei. In light $\alpha$-conjugate nuclei, these low-energy resonances were recently interpreted as cluster vibration modes. However, the nature of these excitations in neutron-rich nuclei remain elusive. Purpose : The present work provides a systematic analysis of the low-energy monopole strength in isotopic chains, from Neon to Germanium, in order to monitor and understand its nature and conditions of emergence. Methods : We perform covariant quasiparticle random phase approximation (QRPA) calculations, formulated within the finite amplitude method (FAM), on top of constrained relativistic Hartree-Bogoliubov (RHB) reference states. Results : Neutron excess leads to the appearance of low-energy excitations according to a systematic pattern reflecting the single-particle features of the underlying RHB reference state. With the onset of deformation, these low-energy resonances get split and give rise to more complex patterns, with possible mixing with the giant resonance. At lower energy, cluster-like excitations found in $N=Z$ systems survive in neutron-rich nuclei, with valence neutrons arranging in molecular-like orbitals. Finally, at very low energy, pair excitations are also found in superfluid nuclei, but remain negligible in most of the cases. Conclusions : The low-energy part of the monopole strength exhibits various modes, from cluster vibrations ($\sim$ 5-10 MeV) to components of the giant resonance downshifted by the onset of deformation, including soft modes ($\sim$ 10-15 MeV) as well as pair excitation ($<$ 5 MeV), with possible mixing, depending on neutron-excess, deformation, and pairing energy.


title: Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detection

abstract: We present a flexible and high-performance framework, named Pyramid R-CNN, for two-stage 3D object detection from point clouds. Current approaches generally rely on the points or voxels of interest for RoI feature extraction on the second stage, but cannot effectively handle the sparsity and non-uniform distribution of those points, and this may result in failures in detecting objects that are far away. To resolve the problems, we propose a novel second-stage module, named pyramid RoI head, to adaptively learn the features from the sparse points of interest. The pyramid RoI head consists of three key components. Firstly, we propose the RoI-grid Pyramid, which mitigates the sparsity problem by extensively collecting points of interest for each RoI in a pyramid manner. Secondly, we propose RoI-grid Attention, a new operation that can encode richer information from sparse points by incorporating conventional attention-based and graph-based point operators into a unified formulation. Thirdly, we propose the Density-Aware Radius Prediction (DARP) module, which can adapt to different point density levels by dynamically adjusting the focusing range of RoIs. Combining the three components, our pyramid RoI head is robust to the sparse and imbalanced circumstances, and can be applied upon various 3D backbones to consistently boost the detection performance. Extensive experiments show that Pyramid R-CNN outperforms the state-of-the-art 3D detection models by a large margin on both the KITTI dataset and the Waymo Open dataset.


title: $q$-type Lidstone expansions and an interpolation problem for entire functions

abstract: In this paper, we expand functions of specific $q$-exponential growth in terms of its even (odd) Askey- Wilson $q$-derivatives at $0$ and $\eta=(q^{1/4}+q^{-1/4})/2$. This expansion is a $q$-version of the celebrated Lidstone expansion theorem, where we expand the function in $q$-analogs of Lidstone polynomials, i.e., q-Bernoulli and $q$-Euler polynomials as in the classical case. We also raise and solve a $q$-extension of the problem of representing an entire function of the form $f(z)=g(z+1)-g(z)$, where $g(z)$ is also an entire function of the same order as $f(z)$.


title: Proceedings of the 9th International Symposium on Symbolic Computation in Software Science

abstract: This volume contains papers presented at the Ninth International Symposium on Symbolic Computation in Software Science, SCSS 2021. Symbolic Computation is the science of computing with symbolic objects (terms, formulae, programs, representations of algebraic objects, etc.). Powerful algorithms have been developed during the past decades for the major subareas of symbolic computation: computer algebra and computational logic. These algorithms and methods are successfully applied in various fields, including software science, which covers a broad range of topics about software construction and analysis. Meanwhile, artificial intelligence methods and machine learning algorithms are widely used nowadays in various domains and, in particular, combined with symbolic computation. Several approaches mix artificial intelligence and symbolic methods and tools deployed over large corpora to create what is known as cognitive systems. Cognitive computing focuses on building systems that interact with humans naturally by reasoning, aiming at learning at scale. The purpose of SCSS is to promote research on theoretical and practical aspects of symbolic computation in software science, combined with modern artificial intelligence techniques. These proceedings contain the keynote paper by Bruno Buchberger and ten contributed papers. Besides, the conference program included three invited talks, nine short and work-in-progress papers, and a special session on computer algebra and computational logic. Due to the COVID-19 pandemic, the symposium was held completely online. It was organized by the Research Institute for Symbolic Computation (RISC) of the Johannes Kepler University Linz on September 8--10, 2021.


title: Jammer Mitigation via Beam-Slicing for Low-Resolution mmWave Massive MU-MIMO

abstract: Millimeter-wave (mmWave) massive multi-user multiple-input multiple-output (MU-MIMO) promises unprecedented data rates for next-generation wireless systems. To be practically viable, mmWave massive MU-MIMO basestations (BSs) must rely on low-resolution data converters which leaves them vulnerable to jammer interference. This paper proposes beam-slicing, a method that mitigates the impact of a permanently transmitting jammer during uplink transmission for BSs equipped with low-resolution analog-to-digital converters (ADCs). Beam-slicing is a localized analog spatial transform that focuses the jammer energy onto few ADCs, so that the transmitted data can be recovered based on the outputs of the interference-free ADCs. We demonstrate the efficacy of beam-slicing in combination with two digital jammer-mitigating data detectors: SNIPS and CHOPS. Soft-Nulling of Interferers with Partitions in Space (SNIPS) combines beam-slicing with a soft-nulling data detector that exploits knowledge of the ADC contamination; projeCtion onto ortHOgonal complement with Partitions in Space (CHOPS) combines beam-slicing with a linear projection that removes all signal components co-linear to an estimate of the jammer channel. Our results show that beam-slicing enables SNIPS and CHOPS to successfully serve 65% of the user equipments (UEs) for scenarios in which their antenna-domain counterparts that lack beam-slicing are only able to serve 2% of the UEs.


title: Investigating Deep Learning Methods for Obtaining Photometric Redshift Estimations from Images

abstract: Knowing the redshift of galaxies is one of the first requirements of many cosmological experiments, and as it's impossible to perform spectroscopy for every galaxy being observed, photometric redshift (photo-z) estimations are still of particular interest. Here, we investigate different deep learning methods for obtaining photo-z estimates directly from images, comparing these with traditional machine learning algorithms which make use of magnitudes retrieved through photometry. As well as testing a convolutional neural network (CNN) and inception-module CNN, we introduce a novel mixed-input model which allows for both images and magnitude data to be used in the same model as a way of further improving the estimated redshifts. We also perform benchmarking as a way of demonstrating the performance and scalability of the different algorithms. The data used in the study comes entirely from the Sloan Digital Sky Survey (SDSS) from which 1 million galaxies were used, each having 5-filter (ugriz) images with complete photometry and a spectroscopic redshift which was taken as the ground truth. The mixed-input inception CNN achieved a mean squared error (MSE)=0.009, which was a significant improvement (30%) over the traditional Random Forest (RF), and the model performed even better at lower redshifts achieving a MSE=0.0007 (a 50% improvement over the RF) in the range of z<0.3. This method could be hugely beneficial to upcoming surveys such as the Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) which will require vast numbers of photo-z estimates produced as quickly and accurately as possible.


title: Topological chiral edge states in deep-subwavelength valley photonic metamaterials

abstract: Topological valley photonics has emerged as a new frontier in photonics with many promising applications. Previous valley boundary transport relies on kink states at internal boundaries between two topologically distinct domains. However, recent studies have revealed a novel class of topological chiral edge states (CESs) at external boundaries of valley materials, which have remained elusive in photonics. Here, we propose and experimentally demonstrate the topological CESs in valley photonic metamaterials (VPMMs) by accurately tuning on-site edge potentials. Moreover, the VPMMs work at deep-subwavelength scales. Thus, the supported CESs are highly confined and self-guiding without relying on a cladding layer to prevent leakage radiation. Via direct near-field measurements, we observe the bulk bandgap, the edge dispersions, and the robust edge transport passing through sharp corners, which are hallmarks of the CESs. Our work paves a way to explore novel topological edge states in valley photonics and sheds light on robust and miniaturized photonic devices.


title: Probing phase transitions in non-Hermitian systems with Multiple Quantum Coherences

abstract: Understanding the interplay between quantum coherence and non-Hermitian features would enable the devising of quantum technologies based on dissipative systems. In turn, quantum coherence can be characterized in terms of the language of multiple quantum coherences (MQCs) originally developed in solid-state nuclear magnetic resonance (NMR), nowadays applied to the detection of quantum chaos, and to the study of criticality in many-body quantum systems. Here we show the usefulness of MQCs for probing equilibrium phase transitions in non-Hermitian systems. To do so, we investigate the connection of quantum coherences and critical points for several paradigmatic non-Hermitian Hamiltonians. For a non-Hermitian two-level system, MQCs witness the parity-symmetry breaking phase transition from the unbroken to the broken phase. Furthermore, for the non-Hermitian transverse field Ising model, MQCs capture the Yang-Lee phase transition in which the ground state energy acquires a nonzero imaginary component. For the disordered Hatano-Nelson (HN) model with periodic boundary conditions, MQCs testify the emergence of mobility edges in the spectrum of this model. In addition, MQCs signal the topological phase transition exhibited by the complex energy spectra of the disorder-free HN model. Finally, we comment on experimentally probing phase transitions in NMR systems realizing non-Hermitian Hamiltonians. Our results have applications to non-Hermitian quantum sensing, quantum thermodynamics, and in the study of the non-Hermitian skin effect.


title: Studies of a muon-based mass sensitive parameter for the IceTop surface array

abstract: IceTop is the surface instrumentation of the IceCube Neutrino Observatory at the South Pole. It is designed to measure extensive air showers of cosmic rays in the primary energy range from PeV to EeV. Air showers induced by heavier primary particles develop earlier in the atmosphere and produce more muons observable at ground level than lighter cosmic rays with the same primary energy. Therefore, the fraction of muons to all charged particles measured by IceTop characterizes the mass of primary particles. This analysis seeks a muon-based mass sensitive parameter by using the charge signal distribution for each individual cosmic ray event. In this contribution we present the analysis method for the mass-sensitive parameter and our studies of its possible application to the measurement of cosmic ray mass composition with the IceTop surface array.


title: Experimental violations of Leggett-Garg's inequalities on a quantum computer

abstract: Leggett-Garg's inequalities predict sharp bounds for some classical correlation functions that address the quantum or classical nature of real-time evolutions. We experimentally observe the violations of these bounds on single- and multi-qubit systems, in different settings, exploiting the IBM Quantum platform. In the multi-qubit case we introduce the Leggett-Garg-Bell's inequalities as an alternative to the previous ones. Measuring these correlation functions, we find quantum error mitigation to be essential to spot inequalities violations. Accessing only two qubit readouts, we assess Leggett-Garg-Bell's inequalities to emerge as the most efficient quantum coherence witnesses to be used for investigating quantum hardware, as the complexity of their calculation does not scale with the number of constituents of the system. Our analysis highlights the limits of nowadays quantum platforms, showing that the above-mentioned correlation functions deviate from theoretical prediction as the number of qubits and the depth of the circuit grow.


title: Uniform Manifold Approximation and Projection (UMAP) and its Variants: Tutorial and Survey

abstract: Uniform Manifold Approximation and Projection (UMAP) is one of the state-of-the-art methods for dimensionality reduction and data visualization. This is a tutorial and survey paper on UMAP and its variants. We start with UMAP algorithm where we explain probabilities of neighborhood in the input and embedding spaces, optimization of cost function, training algorithm, derivation of gradients, and supervised and semi-supervised embedding by UMAP. Then, we introduce the theory behind UMAP by algebraic topology and category theory. Then, we introduce UMAP as a neighbor embedding method and compare it with t-SNE and LargeVis algorithms. We discuss negative sampling and repulsive forces in UMAP's cost function. DensMAP is then explained for density-preserving embedding. We then introduce parametric UMAP for embedding by deep learning and progressive UMAP for streaming and out-of-sample data embedding.


title: Dynamical ejecta of neutron star mergers with nucleonic weak processes I: Nucleosynthesis

abstract: We present a coherent study of the impact of neutrino interactions on the r-process element nucleosynthesis and the heating rate produced by the radioactive elements synthesised in the dynamical ejecta of neutron star-neutron star (NS-NS) mergers. We have studied the material ejected from four NS-NS merger systems based on hydrodynamical simulations which handle neutrino effects in an elaborate way by including neutrino equilibration with matter in optically thick regions and re-absorption in optically thin regions. We find that the neutron richness of the dynamical ejecta is significantly affected by the neutrinos emitted by the post-merger remnant, in particular when compared to a case neglecting all neutrino interactions. Our nucleosynthesis results show that a solar-like distribution of r- process elements with mass numbers $A \gtrsim 90$ is produced, including a significant enrichment in Sr and a reduced production of actinides compared to simulations without inclusion of the nucleonic weak processes. The composition of the dynamically ejected matter as well as the corresponding rate of radioactive decay heating are found to be rather independent of the system mass asymmetry and the adopted equation of state. This approximate degeneracy in abundance pattern and heating rates can be favourable for extracting the ejecta properties from kilonova observations, at least if the dynamical component dominates the overall ejecta. Part II of this work will study the light curve produced by the dynamical ejecta of our four NS merger models.


title: An Axiomatic Perspective on the Performance Effects of End-Host Path Selection

abstract: In various contexts of networking research, end-host path selection has recently regained momentum as a design principle. While such path selection has the potential to increase performance and security of networks, there is a prominent concern that it could also lead to network instability (i.e., flow-volume oscillation) if paths are selected in a greedy, load-adaptive fashion. However, the extent and the impact vectors of instability caused by path selection are rarely concretized or quantified, which is essential to discuss the merits and drawbacks of end-host path selection. In this work, we investigate the effect of end-host path selection on various metrics of networks both qualitatively and quantitatively. To achieve general and fundamental insights, we leverage the recently introduced axiomatic perspective on congestion control and adapt it to accommodate joint algorithms for path selection and congestion control, i.e., multi-path congestion-control protocols. Using this approach, we identify equilibria of the multi-path congestion-control dynamics and analytically characterize these equilibria with respect to important metrics of interest in networks (the 'axioms') such as efficiency, fairness, and loss avoidance. Moreover, we analyze how these axiomatic ratings for a general network change compared to a scenario without path selection, thereby obtaining an interpretable and quantititative formalization of the performance impact of end-host path-selection. Finally, we show that there is a fundamental trade-off in multi-path congestion-control protocol design between efficiency, stability, and loss avoidance on one side and fairness and responsiveness on the other side.


title: Settling an old story: solution of the Thirring model in thimble regularization

abstract: Thimble regularisation of lattice field theories has been proposed as a solution to the infamous sign problem. It is conceptually very clean and powerful, but it is in practice limited by a potentially very serious issue: in general many thimbles can contribute to the computation of the functional integrals. Semiclassical arguments would suggest that the fundamental thimble could be sufficient to get the correct answer, but this hypothesis has been proven not to hold true in general. A first example of this failure has been put forward in the context of the Thirring model: the dominant thimble approximation is valid only in given regions of the parameter space of the theory. Since then a complete solution of this (simple) model in thimble regularisation has been missing. In this paper we show that a full solution (taking the continuum limit) is indeed possible. It is possible thanks to a method we recently proposed which de facto evades the need to simulate on many thimbles.


title: Optimal Lockdown Strategy in a Pandemic: An Exploratory Analysis for Covid-19

abstract: The paper addresses the question of lives versus livelihood in an SIRD model augmented with a macroeconomic structure. The constraints on the availability of health facilities - both infrastructure and health workers determine the probability of receiving treatment which is found to be higher for the patients with severe infection than the patients with mild infection for the specific parametric configuration of the paper. Distinguishing between two types of direct intervention policy - hard lockdown and soft lockdown, the study derives alternative policy options available to the government. The study further indicates that the soft lockdown policy is optimal from a public policy perspective under the specific parametric configuration considered in this paper.

categories: math.DS cs.SY econ.GN eess.SY math.OC q-fin.EC


title: Proto: A Neural Cocktail for Generating Appealing Conversations

abstract: In this paper, we present our Alexa Prize Grand Challenge 4 socialbot: Proto. Leveraging diverse sources of world knowledge, and powered by a suite of neural and rule-based natural language understanding modules, state-of-the-art neural generators, novel state-based deterministic generators, an ensemble of neural re-rankers, a robust post-processing algorithm, and an efficient overall conversation strategy, Proto strives to be able to converse coherently about a diverse range of topics of interest to humans, and provide a memorable experience to the user. In this paper we dissect and analyze the different components and conversation strategies implemented by our socialbot, which enables us to generate colloquial, empathetic, engaging, self-rectifying, factually correct, and on-topic response, which has helped us achieve consistent scores throughout the competition.


title: Parsimonious Edge Computing to Reduce Microservice Resource Usage

abstract: Cloud Computing (CC) is the most prevalent paradigm under which services are provided over the Internet. The most relevant feature for its success is its capability to promptly scale service based on user demand. When scaling, the main objective is to maximize as much as possible service performance. Moreover, resources in the Cloud are usually so abundant, that they can be assumed infinite from the service point of view: an application provider can have as many servers it wills, as long it pays for it. This model has some limitations. First, energy efficiency is not among the first criteria for scaling decisions, which has raised concerns about the environmental effects of today's wild computations in the Cloud. Moreover, it is not viable for Edge Computing (EC), a paradigm in which computational resources are distributed up to the very edge of the network, i.e., co-located with base stations or access points. In edge nodes, resources are limited, which imposes different parsimonious scaling strategies to be adopted. In this work, we design a scaling strategy aimed to instantiate, parsimoniously, a number of microservices sufficient to guarantee a certain Quality of Service (QoS) target. We implement such a strategy in a Kubernetes/Docker environment. The strategy is based on a simple Proportional-Integrative-Derivative (PID) controller. In this paper we describe the system design and a preliminary performance evaluation.


title: Efficient diagonalization of symmetric matrices associated with graphs of small treewidth

abstract: Let $M=(m_{ij})$ be a symmetric matrix of order $n$ whose elements lie in an arbitrary field $\mathbb{F}$, and let $G$ be the graph with vertex set $\{1,\ldots,n\}$ such that distinct vertices $i$ and $j$ are adjacent if and only if $m_{ij} \neq 0$. We introduce a dynamic programming algorithm that finds a diagonal matrix that is congruent to $M$. If $G$ is given with a tree decomposition $\mathcal{T}$ of width $k$, then this can be done in time $O(k|\mathcal{T}| + k^2 n)$, where $|\mathcal{T}|$ denotes the number of nodes in $\mathcal{T}$. Among other things, this allows one to compute the determinant, the rank and the inertia of a symmetric matrix in time $O(k|\mathcal{T}| + k^2 n)$.


title: Binomial confidence intervals for rare events: importance of defining margin of error relative to magnitude of proportion

abstract: Confidence interval performance is typically assessed in terms of two criteria: coverage probability and interval width (or margin of error). In this paper, we assess the performance of four common proportion interval estimators: the Wald, Clopper-Pearson (exact), Wilson and Agresti-Coull, in the context of rare-event probabilities. We define the interval precision in terms of a relative margin of error which ensures consistency with the magnitude of the proportion. Thus, confidence interval estimators are assessed in terms of achieving a desired coverage probability whilst simultaneously satisfying the specified relative margin of error. We illustrate the importance of considering both coverage probability and relative margin of error when estimating rare-event proportions, and show that within this framework, all four interval estimators perform somewhat similarly for a given sample size and confidence level. We identify relative margin of error values that result in satisfactory coverage whilst being conservative in terms of sample size requirements, and hence suggest a range of values that can be adopted in practice. The proposed relative margin of error scheme is evaluated analytically, by simulation, and by application to a number of recent studies from the literature.


title: Error Controlled Actor-Critic

abstract: On error of value function inevitably causes an overestimation phenomenon and has a negative impact on the convergence of the algorithms. To mitigate the negative effects of the approximation error, we propose Error Controlled Actor-critic which ensures confining the approximation error in value function. We present an analysis of how the approximation error can hinder the optimization process of actor-critic methods.Then, we derive an upper boundary of the approximation error of Q function approximator and find that the error can be lowered by restricting on the KL-divergence between every two consecutive policies when training the policy. The results of experiments on a range of continuous control tasks demonstrate that the proposed actor-critic algorithm apparently reduces the approximation error and significantly outperforms other model-free RL algorithms.


title: Results from the KASCADE-Grande Data Analysis

abstract: KASCADE-Grande and its original array of KASCADE were dedicated to measure individual air showers of cosmic rays with great detail in the primary energy range of 100 TeV up to 1 EeV. The experiment has significantly contributed to investigations of the energy spectrum and chemical composition of cosmic rays in the transition region from galactic to extragalactic origin of cosmic rays as well as to the further development of hadronic interaction models through validity tests using the multi-detector information from KASCADE-Grande. Though the data accumulation was completed in 2013, the data analysis is still continuing. Recently, we investigate the reliability of the new hadronic interactions model of the Sibyll version 2.3d with the combined data from KASCADE and KASCADE-Grande, and compare it to the predictions of different hadronic interaction models. In addition, we update the web-based platform of the KASCADE Cosmic Ray Data Centre (KCDC), where now full datasets from KASCADE and KASCADE-Grande and the corresponding Monte-Carlo simulated events are available.


title: Online Learning of Independent Cascade Models with Node-level Feedback

abstract: We propose a detailed analysis of the online-learning problem for Independent Cascade (IC) models under node-level feedback. These models have widespread applications in modern social networks. Existing works for IC models have only shed light on edge-level feedback models, where the agent knows the explicit outcome of every observed edge. Little is known about node-level feedback models, where only combined outcomes for sets of edges are observed; in other words, the realization of each edge is censored. This censored information, together with the nonlinear form of the aggregated influence probability, make both parameter estimation and algorithm design challenging. We establish the first confidence-region result under this setting. We also develop an online algorithm achieving a cumulative regret of $\mathcal{O}( \sqrt{T})$, matching the theoretical regret bound for IC models with edge-level feedback.


title: Unified Equation of State for Neutron Stars Based on the Gogny Interaction

abstract: The most popular Gogny parametrizations, namely D1S, D1N and D1M, describe accurately the ground-state properties of spherical and deformed finite nuclei all across the mass table obtained with Hartree--Fock--Bogoliubov (HFB) calculations. However, these forces produce a rather soft equation of state (EoS) in neutron matter, which leads to predict maximum masses of neutron stars well below the observed value of two solar masses. To remove this limitation, we built new Gogny parametrizations by modifying the density dependence of the symmetry energy predicted by the force in such a way that they can be applied to the neutron star domain and can also reproduce the properties of finite nuclei as good as their predecessors. These new parametrizations allow us to obtain stiffer EoS's based on the Gogny interactions, which predict maximum masses of neutron stars around two solar masses. Moreover, other global properties of the star, such as the moment of inertia and the tidal deformability, are in harmony with those obtained with other well tested EoSs based on the SLy4 Skyrme force or the Barcelona--Catania--Paris--Madrid (BCPM) energy density functional. Properties of the core-crust transition predicted by these Gogny EoSs are also analyzed. Using these new Gogny forces, the EoS in the inner crust is obtained with the Wigner--Seitz approximation in the Variational Wigner--Kirkwood approach along with the Strutinsky integral method, which allows one to estimate in a perturbative way the proton shell and pairing corrections. For the outer crust, the EoS is determined basically by the nuclear masses, which are taken from the experiments, wherever they are available, or by HFB calculations performed with these new forces if the experimental masses are not known.


title: Estimation of Bivariate Structural Causal Models by Variational Gaussian Process Regression Under Likelihoods Parametrised by Normalising Flows

abstract: One major drawback of state-of-the-art artificial intelligence is its lack of explainability. One approach to solve the problem is taking causality into account. Causal mechanisms can be described by structural causal models. In this work, we propose a method for estimating bivariate structural causal models using a combination of normalising flows applied to density estimation and variational Gaussian process regression for post-nonlinear models. It facilitates causal discovery, i.e. distinguishing cause and effect, by either the independence of cause and residual or a likelihood ratio test. Our method which estimates post-nonlinear models can better explain a variety of real-world cause-effect pairs than a simple additive noise model. Though it remains difficult to exploit this benefit regarding all pairs from the T\"ubingen benchmark database, we demonstrate that combining the additive noise model approach with our method significantly enhances causal discovery.


title: On signed graphs with at most two eigenvalues unequal to $\pm 1$

abstract: We present the first steps towards the determination of the signed graphs for which the adjacency matrix has all but at most two eigenvalues equal to 1 or -1. Here we deal with the disconnected, the bipartite and the complete signed graphs. In addition, we present many examples which cannot be obtained from an unsigned graph or its negative by switching.


title: Modeling high-speed gas-particle flows relevant to spacecraft landings: A review and perspectives

abstract: The interactions between rocket exhaust plumes and the surface of extraterrestrial bodies during spacecraft landings involve complex multiphase flow dynamics that pose significant risk to space exploration missions. The two-phase flow is characterized by high Reynolds and Mach number conditions with particle concentrations ranging from dilute to close-packing. Low atmospheric pressure and gravity typically encountered in landing environments combined with reduced optical access by the granular material pose significant challenges for experimental investigations. Consequently, numerical modeling is expected to play an increasingly important role for future missions. This article presents a review and perspectives on modeling high-speed disperse two-phase flows relevant to plume-surface interactions (PSI). We present an overview of existing drag laws, with origins from 18th-century cannon fire experiments and new insights from particle-resolved numerical simulations. While the focus here is on multiphase flows relevant to PSI, much of the same physics are shared by other compressible gas-particle flows, such as coal-dust explosions, volcanic eruptions, and detonation of solid material.


title: Magnetic loading of magnetars' flares

abstract: Magnetars, the likely sources of Fast Radio Bursts (FRBs), produce both steady highly relativistic magnetized winds, and occasional ejection events. We demonstrate that the requirement of conservation of the magnetic flux dominates the overall dynamics of magnetic explosions. This is missed in conventional hydrodynamic models of the ejections as expanding shell with parametrically added magnetic field, as well as one-dimensional models of magnetic disturbances. Most of the initial free energy of an explosion is actually spent on stretching its own internal magnetic field, while doing minimal $pdV$ work against the surrounding. Magnetic explosions from magnetars come into force balance with the pre-flares wind close to the light cylinder. They are then advected quietly with the wind, or propagate as electromagnetic disturbances. No powerful shock waves are generated in the wind.


title: Comments on "Y.-Q. Wang, et al., Commun. Nonlinear Sci. Numer. Simul. 103:105981 (2021)"

abstract: With regard to the recently published article, ``Y.-Q. Wang, et al., Physical mechanism of equiprobable exclusion network with heterogeneous interactions in phase transitions: Analytical analyses of steady state evolving from initial state, Commun. Nonlinear Sci. Numer. Simul. 103:105981 (2021)'', the following concerns are raised. First, the given steady-state solution of the system, its proof, and derivation of relevant physical quantities are incorrect. Second, the presented simulation results were not replicated and significantly deviated from their analytical predictions. Finally, the second part of the article is irrelevant in the context of equiprobable exclusion networks because the examined system in this part does not possess equiprobable properties.


title: Teachers Without Borders

abstract: An educator who is also known as a lecturer in the university system has three main areas of focus, which include learning that is helping students to acquire knowledge, competence and virtue, research, implying developing new knowledge, breaking new grounds and community service, by focusing on applying the knowledge to real life situations to improve life and living conditions of the society. As the worlds geographical boundaries keep getting redefined in the context of a global village, the constituency of teachers keeps getting redefined as well. This essay aims to address issues about modern constituent and platform of teachers in Nigeria for service delivery in the context of a globalised world. It also focuses on how to reach out to these new set of communities brought about by globalisation to remain relevant, effective and efficient alongside their perceived challenges and possible solutions in Nigerian context.


title: VulSPG: Vulnerability detection based on slice property graph representation learning

abstract: Vulnerability detection is an important issue in software security. Although various data-driven vulnerability detection methods have been proposed, the task remains challenging since the diversity and complexity of real-world vulnerable code in syntax and semantics make it difficult to extract vulnerable features with regular deep learning models, especially in analyzing a large program. Moreover, the fact that real-world vulnerable codes contain a lot of redundant information unrelated to vulnerabilities will further aggravate the above problem. To mitigate such challenges, we define a novel code representation named Slice Property Graph (SPG), and then propose VulSPG, a new vulnerability detection approach using the improved R-GCN model with triple attention mechanism to identify potential vulnerabilities in SPG. Our approach has at least two advantages over other methods. First, our proposed SPG can reflect the rich semantics and explicit structural information that may be relevance to vulnerabilities, while eliminating as much irrelevant information as possible to reduce the complexity of graph. Second, VulSPG incorporates triple attention mechanism in R-GCNs to achieve more effective learning of vulnerability patterns from SPG. We have extensively evaluated VulSPG on two large-scale datasets with programs from SARD and real-world projects. Experimental results prove the effectiveness and efficiency of VulSPG.


title: Individual causal effects from observational longitudinal studies with time-varying exposures

abstract: Causal effects may vary among individuals and can even be of opposite signs. When significant effect heterogeneity exists, the population average causal effect might be uninformative for an individual. Due to the fundamental problem of causality, individual causal effects (ICEs) cannot be retrieved from cross-sectional data. However, in crossover studies, it is accepted that ICEs can be estimated under the assumptions of no carryover effects and time invariance of potential outcomes. A generic potential-outcome formulation with appropriate statistical assumptions to identify ICEs is lacking for other longitudinal data with time-varying exposures. We present a general framework for causal effect heterogeneity in which individual-specific effect modification is parameterized with a latent variable, the receptiveness factor. If the exposure varies over time, then the repeated measurements contain information on an individual's level of this receptiveness factor. Therefore, we study the conditional distribution of the ICE given all an individual's factual information. This novel conditional random variable is called the cross-world causal effect (CWCE). For known causal structures and time-varying exposures, the variability of the CWCE reduces with an increasing number of repeated measurements. The CWCE becomes identifiable from observational data under the causal assumption of cross-world similarity of individual-effect modification (i.e. there exists an exposure strategy whose effect is affected by all latent causes). We illustrate the theory with examples in which the cause-effect relations can be parameterized as generalized linear mixed assignments.


title: ViSTA: a Framework for Virtual Scenario-based Testing of Autonomous Vehicles

abstract: In this paper, we present ViSTA, a framework for Virtual Scenario-based Testing of Autonomous Vehicles (AV), developed as part of the 2021 IEEE Autonomous Test Driving AI Test Challenge. Scenario-based virtual testing aims to construct specific challenges posed for the AV to overcome, albeit in virtual test environments that may not necessarily resemble the real world. This approach is aimed at identifying specific issues that arise safety concerns before an actual deployment of the AV on the road. In this paper, we describe a comprehensive test case generation approach that facilitates the design of special-purpose scenarios with meaningful parameters to form test cases, both in automated and manual ways, leveraging the strength and weaknesses of either. Furthermore, we describe how to automate the execution of test cases, and analyze the performance of the AV under these test cases.


title: Continuum covariance propagation for understanding variance loss in advective systems

abstract: Motivated by the spurious variance loss encountered during covariance propagation in atmospheric and other large-scale data assimilation systems, we consider the problem for state dynamics governed by the continuity and related hyperbolic partial differential equations. This loss of variance is often attributed to reduced-rank representations of the covariance matrix, as in ensemble methods for example, or else to the use of dissipative numerical methods. Through a combination of analytical work and numerical experiments, we demonstrate that significant variance loss, as well as gain, typically occurs during covariance propagation, even at full rank. The cause of this unusual behavior is a discontinuous change in the continuum covariance dynamics as correlation lengths become small, for instance in the vicinity of sharp gradients in the velocity field. This discontinuity in the covariance dynamics arises from hyperbolicity: the diagonal of the kernel of the covariance operator is a characteristic surface for advective dynamics. Our numerical experiments demonstrate that standard numerical methods for evolving the state are not adequate for propagating the covariance, because they do not capture the discontinuity in the continuum covariance dynamics as correlations lengths tend to zero. Our analytical and numerical results demonstrate in the context of mass conservation that this leads to significant, spurious variance loss in regions of mass convergence and gain in regions of mass divergence. The results suggest that developing local covariance propagation methods designed specifically to capture covariance evolution near the diagonal may prove a useful alternative to current methods of covariance propagation.


title: Hadronic molecule interpretation of $T^+_{cc}$ and its beauty-partners

abstract: Motivated by the latest discovery of a new tetraquark $T_{cc}^+$ with two charm quarks and two light antiquarks by LHCb Collaboration, we investigated the $DD^*$ hadronic molecule interpretation of $T_{cc}^+$. By calculation, the mass and the decay width of this new structure $T_{cc}^+$ can be understood in one-meson exchange potential model. The binding energies for these $DD^*$ hadronic molecules with $J^P=1^+$ are around $1MeV$. Besides, we also studied the possible beauty-partners $T_{bb}(10598)$ of hadronic molecule $T^+_{cc}$, which may be feasible in future LHCb experiments.


title: Automated Robustness with Adversarial Training as a Post-Processing Step

abstract: Adversarial training is a computationally expensive task and hence searching for neural network architectures with robustness as the criterion can be challenging. As a step towards practical automation, this work explores the efficacy of a simple post processing step in yielding robust deep learning model. To achieve this, we adopt adversarial training as a post-processing step for optimised network architectures obtained from a neural architecture search algorithm. Specific policies are adopted for tuning the hyperparameters of the different steps, resulting in a fully automated pipeline for generating adversarially robust deep learning models. We evidence the usefulness of the proposed pipeline with extensive experimentation across 11 image classification and 9 text classification tasks.


title: Neural Ensemble Search via Bayesian Sampling

abstract: Recently, neural architecture search (NAS) has been applied to automate the design of neural networks in real-world applications. A large number of algorithms have been developed to improve the search cost or the performance of the final selected architectures in NAS. Unfortunately, these NAS algorithms aim to select only one single well-performing architecture from their search spaces and thus have overlooked the capability of neural network ensemble (i.e., an ensemble of neural networks with diverse architectures) in achieving improved performance over a single final selected architecture. To this end, we introduce a novel neural ensemble search algorithm, called neural ensemble search via Bayesian sampling (NESBS), to effectively and efficiently select well-performing neural network ensembles from a NAS search space. In our extensive experiments, NESBS algorithm is shown to be able to achieve improved performance over state-of-the-art NAS algorithms while incurring a comparable search cost, thus indicating the superior performance of our NESBS algorithm over these NAS algorithms in practice.


title: Anomalous Optical Drag

abstract: A moving dielectric medium can displace the optical path of light passing through it, a phenomenon known as the Fresnel-Fizeau optical drag effect. The resulting displacement is proportional to the medium's velocity. In this article, we report on an anomalous optical drag effect, where the displacement is still proportional to the medium's speed but along the direction opposite to the medium's movement. We conduct an optical drag experiment under conditions of electromagnetically-induced transparency and observe the transition from normal, to null, to anomalous optical drag by modification of the two-photon detuning.


title: On the order and the type of an entire function

abstract: In this short article we present some properties regarding the order and the type of an entire function.


title: Image In painting Applied to Art Completing Escher's Print Gallery

abstract: This extended abstract presents the first stages of a research on in-painting suited for art reconstruction. We introduce M.C Eschers Print Gallery lithography as a use case example. This artwork presents a void on its center and additionally, it follows a challenging mathematical structure that needs to be preserved by the in-painting method. We present our work so far and our future line of research.


title: Robust Control Barrier Functions with Sector-Bounded Uncertainties

abstract: This paper focuses on safety critical control with sector-bounded uncertainties at the plant input. The uncertainties can represent nonlinear and/or time-varying components. We propose a new robust control barrier function (RCBF) approach to enforce safety requirements in the presence of these uncertainties. The primary objective is to minimally alter the given baseline control command to guarantee safety in the presence of modeled uncertainty. The resulting min-norm optimization problem can be recast as a Second-Order Cone Program (SOCP) to enable online implementation. Properties of this controller are studied and a numerical example is provided to illustrate the effectiveness of this approach.


title: Bounding Means of Discrete Distributions

abstract: We introduce methods to bound the mean of a discrete distribution (or finite population) based on sample data, for random variables with a known set of possible values. In particular, the methods can be applied to categorical data with known category-based values. For small sample sizes, we show how to leverage the knowledge of the set of possible values to compute bounds that are stronger than for general random variables such as standard concentration inequalities.


title: Heavy quark spin partners of the $Y(4260)$ in coupled-channel formalism

abstract: The charmoniumlike state $Y(4260)$ is described as predominantly a $D_1 \bar{D}$ molecule in a coupled-channel quark model [Phys.\,Rev.\,D\,\textbf{96},\,114022\,(2017)]. The heavy quark spin symmetry (HQSS) thus implies the possible emergence of its heavy quark spin partners with molecular configuration as $D_1 \bar{D}^*$ and $D_2^* \bar{D}^*$ below these charmed mesons' thresholds. We analyze the probabilities of various intermediate charmed meson loops for $J^{PC}=1^{--}$ exotic state $Y(4360)$ and find that the channel $D_1 \bar{D}^*$ couples more strongly around its mass regime, and the coupling behavior remains the same even if the mass of $Y(4360)$ is pushed closer to $D_1 \bar{D}^*$ threshold. This enlightens that the most favorable molecular scenario for the $Y(4360)$ could be $D_1 \bar{D}^*$, and hence it can be interpreted as HQSS partner of the $Y(4260)$. We also find the strong coupling behavior of $D_2^* \bar{D}^*$ channel with the $\psi(4415)$, which makes it a good candidate for a dominant $D_2^* \bar{D}^*$ molecule. We discuss the important decay patterns of these resonances to disentangle their long- and short-distance structures.


title: Towards API Testing Across Cloud and Edge

abstract: API economy is driving the digital transformation of business applications across the hybrid Cloud and edge environments. For such transformations to succeed, end-to-end testing of the application API composition is required. Testing of API compositions, even in centralized Cloud environments, is challenging as it requires coverage of functional as well as reliability requirements. The combinatorial space of scenarios is huge, e.g., API input parameters, order of API execution, and network faults. Hybrid Cloud and edge environments exacerbate the challenge of API testing due to the need to coordinate test execution across dynamic wide-area networks, possibly across network boundaries. To handle this challenge, we envision a test framework named Distributed Software Test Kit (DSTK). The DSTK leverages Combinatorial Test Design (CTD) to cover the functional requirements and then automatically covers the reliability requirements via under-the-hood closed loop between test execution feedback and AI based search algorithms. In each iteration of the closed loop, the search algorithms generate more reliability test scenarios to be executed next. Specifically, five kinds of reliability tests are envisioned: out-of-order execution of APIs, network delays and faults, API performance and throughput, changes in API call graph patterns, and changes in application topology.


title: Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning

abstract: It is challenging for a mobile robot to navigate through human crowds. Existing approaches usually assume that pedestrians follow a predefined collision avoidance strategy, like social force model (SFM) or optimal reciprocal collision avoidance (ORCA). However, their performances commonly need to be further improved for practical applications, where pedestrians follow multiple different collision avoidance strategies. In this paper, we propose a map-based deep reinforcement learning approach for crowd-aware robot navigation with various pedestrians. We use the sensor map to represent the environmental information around the robot, including its shape and observable appearances of obstacles. We also introduce the pedestrian map that specifies the movements of pedestrians around the robot. By applying both maps as inputs of the neural network, we show that a navigation policy can be trained to better interact with pedestrians following different collision avoidance strategies. We evaluate our approach under multiple scenarios both in the simulator and on an actual robot. The results show that our approach allows the robot to successfully interact with various pedestrians and outperforms compared methods in terms of the success rate.


title: Singularly perturbed dynamics of the tippedisk

abstract: The tippedisk is a mathematical-mechanical archetype for a peculiar friction-induced instability phenomenon leading to the inversion of an unbalanced spinning disk, being reminiscent to (but different from) the well-known inversion of the tippetop. A reduced model of the tippedisk, in the form of a three-dimensional ordinary differential equation, has been derived recently, followed by a preliminary local stability analysis of stationary spinning solutions. In the current paper, a global analysis of the reduced system is pursued using the framework of singular perturbation theory. It is shown how the presence of friction leads to slow-fast dynamics and the creation of a two-dimensional slow manifold. Furthermore, it is revealed that a bifurcation scenario involving a homoclinic bifurcation and a Hopf bifurcation leads to an explanation of the inversion phenomenon. In particular, a closed-form condition for the critical spinning speed for the inversion phenomenon is derived. Hence, the tippedisk forms an excellent mathematical-mechanical problem for the analysis of global bifurcations in singularly perturbed dynamics.

categories: physics.class-ph math-ph math.DS math.MP physics.app-ph


title: Generation of Synthetic Electronic Health Records Using a Federated GAN

abstract: Sensitive medical data is often subject to strict usage constraints. In this paper, we trained a generative adversarial network (GAN) on real-world electronic health records (EHR). It was then used to create a data-set of "fake" patients through synthetic data generation (SDG) to circumvent usage constraints. This real-world data was tabular, binary, intensive care unit (ICU) patient diagnosis data. The entire data-set was split into separate data silos to mimic real-world scenarios where multiple ICU units across different hospitals may have similarly structured data-sets within their own organisations but do not have access to each other's data-sets. We implemented federated learning (FL) to train separate GANs locally at each organisation, using their unique data silo and then combining the GANs into a single central GAN, without any siloed data ever being exposed. This global, central GAN was then used to generate the synthetic patients data-set. We performed an evaluation of these synthetic patients with statistical measures and through a structured review by a group of medical professionals. It was shown that there was no significant reduction in the quality of the synthetic EHR when we moved between training a single central model and training on separate data silos with individual models before combining them into a central model. This was true for both the statistical evaluation (Root Mean Square Error (RMSE) of 0.0154 for single-source vs. RMSE of 0.0169 for dual-source federated) and also for the medical professionals' evaluation (no quality difference between EHR generated from a single source and EHR generated from multiple sources).


title: Intrusion Detection using Network Traffic Profiling and Machine Learning for IoT

abstract: The rapid increase in the use of IoT devices brings many benefits to the digital society, ranging from improved efficiency to higher productivity. However, the limited resources and the open nature of these devices make them vulnerable to various cyber threats. A single compromised device can have an impact on the whole network and lead to major security and physical damages. This paper explores the potential of using network profiling and machine learning to secure IoT against cyber-attacks. The proposed anomaly-based intrusion detection solution dynamically and actively profiles and monitors all networked devices for the detection of IoT device tampering attempts as well as suspicious network transactions. Any deviation from the defined profile is considered to be an attack and is subject to further analysis. Raw traffic is also passed on to the machine learning classifier for examination and identification of potential attacks. Performance assessment of the proposed methodology is conducted on the Cyber-Trust testbed using normal and malicious network traffic. The experimental results show that the proposed anomaly detection system delivers promising results with an overall accuracy of 98.35% and 0.98% of false-positive alarms.


title: The Giant Graviton Expansion

abstract: We propose and test a novel conjectural relation satisfied by the superconformal index of maximally supersymmetric $U(N)$ gauge theory in four dimensions. Analogous relations appear to be also valid for the superconformal indices of a large collection of other gauge theories, as well as for a broad class of index-like generating functions. The relation expresses the finite $N$ index as a systematic series of corrections to a large $N$ answer. Individual corrections have an holographic interpretation as the analytic continuation of contributions from "giant graviton" branes fixed by a specific symmetry generator.


title: Derivation of an Improved Semi-empirical Expression for the Re-ionisation Background in Low Energy Ion Scattering Spectra

abstract: Low energy ion scattering is a technique to detect the energy of ions which are scattered from a surface. For noble gas ions, it is predominantly sensitive to the topmost surface layer due to strong neutralisation processes. Depending on the combination of projectile ion and target material, the scattering spectra can exhibit contributions resulting from multiple scattering processes in deeper layers when probing ions are re-ionised on the exiting trajectory. These events cause a pronounced continuum located toward lower scattering energies with respect to the direct scattering peak. In a previous work a semi-empirical formula has been given which allows fitting and derivation of quantitative information from the measured spectra [Nelson 1986 J. Vac. Sci. Technol. A 4 1567-1569]. Based on the former work an improved formula is derived which has less numerical artefacts and is numerically more stable.


title: K-median: exact recovery in the extended stochastic ball model

abstract: We study exact recovery conditions for the linear programming relaxation of the k-median problem in the stochastic ball model (SBM). In Awasthi et al. (2015), the authors give a tight result for the k-median LP in the SBM, saying that exact recovery can be achieved as long as the balls are pairwise disjoint. We give a counterexample to their result, thereby showing that the k-median LP is not tight in low dimension. Instead, we give a near optimal result showing that the k-median LP in the SBM is tight in high dimension. We also show that, if the probability measure satisfies some concentration assumptions, then the k-median LP in the SBM is tight in every dimension. Furthermore, we propose a new model of data called extended stochastic ball model (ESBM), which significantly generalizes the well-known SBM. We then show that exact recovery can still be achieved in the ESBM.


title: Finitely Axiomatized Theories Lack Self-Comprehension

abstract: In this paper we prove that no consistent finitely axiomatized theory one-dimensionally interprets its own extension with predicative comprehension. This constitutes a result with the flavor of the Second Incompleteness Theorem whose formulation is completely arithmetic-free. Probably the most important novel feature that distinguishes our result from the previous results of this kind is that it is applicable to arbitrary weak theories, rather than to extensions of some base theory. The methods used in the proof of the main result yield a new perspective on the notion of sequential theory, in the setting of forcing-interpretations.


title: XMUSPEECH System for VoxCeleb Speaker Recognition Challenge 2021

abstract: This paper describes the XMUSPEECH speaker recognition and diarisation systems for the VoxCeleb Speaker Recognition Challenge 2021. For track 2, we evaluate two systems including ResNet34-SE and ECAPA-TDNN. For track 4, an important part of our system is VAD module which greatly improves the performance. Our best submission on the track 4 obtained on the evaluation set DER 5.54% and JER 27.11%, while the performance on the development set is DER 2.92% and JER 20.84%.


title: You should evaluate your language model on marginal likelihood over tokenisations

abstract: Neural language models typically tokenise input text into sub-word units to achieve an open vocabulary. The standard approach is to use a single canonical tokenisation at both train and test time. We suggest that this approach is unsatisfactory and may bottleneck our evaluation of language model performance. Using only the one-best tokenisation ignores tokeniser uncertainty over alternative tokenisations, which may hurt model out-of-domain performance. In this paper, we argue that instead, language models should be evaluated on their marginal likelihood over tokenisations. We compare different estimators for the marginal likelihood based on sampling, and show that it is feasible to estimate the marginal likelihood with a manageable number of samples. We then evaluate pretrained English and German language models on both the one-best-tokenisation and marginal perplexities, and show that the marginal perplexity can be significantly better than the one best, especially on out-of-domain data. We link this difference in perplexity to the tokeniser uncertainty as measured by tokeniser entropy. We discuss some implications of our results for language model training and evaluation, particularly with regard to tokenisation robustness.


title: AtlFast3: the next generation of fast simulation in ATLAS

abstract: The ATLAS experiment at the Large Hadron Collider has a broad physics programme ranging from precision measurements to direct searches for new particles and new interactions, requiring ever larger and ever more accurate datasets of simulated Monte Carlo events. Detector simulation with GEANT4 is accurate but requires significant CPU resources. Over the past decade, ATLAS has developed and utilized tools that replace the most CPU-intensive component of the simulation -- the calorimeter shower simulation -- with faster simulation methods. Here, AtlFast3, the next generation of high-accuracy fast simulation in ATLAS is introduced. AtlFast3 combines parameterized approaches with machine-learning techniques and is deployed to meet current and future computing challenges and simulation needs of the ATLAS experiment. With highly accurate performance and a new ability to model substructure within jets, AtlFast3 is designed to be used to simulate large numbers of events for a wide range of physics processes.


title: Joint Multi-User Communication and Sensing Exploiting Both Signal and Environment Sparsity

abstract: As a potential technology feature for 6G wireless networks, the idea of sensing-communication integration requires the system not only to complete reliable multi-user communication but also to achieve accurate environment sensing. In this paper, we consider such a joint communication and sensing (JCAS) scenario, in which multiple users use the sparse code multiple access (SCMA) scheme to communicate with the wireless access point (AP). Part of the user signals are scattered by the environment object and reflected by an intelligent reflective surface (IRS) before they arrive at the AP. We exploit the sparsity of both the structured user signals and the unstructured environment and propose an iterative and incremental joint multi-user communication and environment sensing scheme, in which the two processes, i.e., multi-user information detection and environment object detection, interweave with each other thanks to their intrinsic mutual dependence. The proposed algorithm is sliding-window based and also graph based, which can keep on sensing the environment as long as there are illuminating user signals. The trade-off relationship between the key system parameters is analyzed, and the simulation result validates the convergence and effectiveness of the proposed algorithm.


title: Broken-FEEC discretizations and Hodge Laplace problems

abstract: This article studies structure-preserving discretizations of Hilbert complexes with nonconforming spaces that rely on projections onto an underlying conforming subcomplex. This approach follows the conforming/nonconforming Galerkin (CONGA) method introduced in [doi.org/10.1090/mcom/3079, doi.org/10.5802/smai-jcm.20, doi.org/10.5802/smai-jcm.21] to derive efficient structure-preserving finite element schemes for the time-dependent Maxwell and Maxwell-Vlasov systems by relaxing the curl-conforming constraint in finite element exterior calculus (FEEC) spaces. Here, it is extended to the discretization of full Hilbert complexes with possibly nontrivial harmonic fields, and the properties of the CONGA Hodge Laplacian operator are investigated. By using block-diagonal mass matrices which may be locally inverted, this framework possesses a canonical sequence of dual commuting projection operators which are local, and it naturally yields local discrete coderivative operators, in contrast to conforming FEEC discretizations. The resulting CONGA Hodge Laplacian operator is also local, and its kernel consists of the same discrete harmonic fields as the underlying conforming operator, provided that a symmetric stabilization term is added to handle the space nonconformities. Under the assumption that the underlying conforming subcomplex admits a bounded cochain projection, and that the conforming projections are stable with moment-preserving properties, a priori convergence results are established for both the CONGA Hodge Laplace source and eigenvalue problems. Our theory is finally illustrated with a spectral element method, and numerical experiments are performed which corroborate our results. Applications to spline finite elements on multi-patch mapped domains are described in a related article [arXiv:2208.05238] for which the present work provides a theoretical background.


title: Job Posting-Enriched Knowledge Graph for Skills-based Matching

abstract: The labor market is constantly evolving. Occupations are changing, being added, or disappearing to fit the needs of today's market. In recent years the pace of this change has accelerated, due to factors such as globalization, digitization, and the shift to working from home. Different factors are relevant when selecting employment, e.g., cultural fit, compensation, provided degree of freedom. To successfully fulfill an occupation the gap between required (by the job) and possessed (by the job seeker) skills needs to be as small as possible. Decreasing this skill-gap improves the fit between a job candidate and occupation. In this paper we propose a custom-built Skills & Occupation Knowledge Graph (KG) that fits the above described dynamic nature of the labor market, by leveraging existing skills and occupation taxonomies enriched with external job posting data. We leverage this KG and explore several applications for skills-based matching of jobs to job seekers. First, we study link prediction as a means to quantify relevance of skills to occupations, which can help in prioritizing learning and development of employees. Next, we study node similarity methods and shortest path algorithms for career pathfinding. Finally, we leverage a term weighting method for identifying which skills are most "distinctive" for different (types of) occupations.


title: GPT-3 Models are Poor Few-Shot Learners in the Biomedical Domain

abstract: Deep neural language models have set new breakthroughs in many tasks of Natural Language Processing (NLP). Recent work has shown that deep transformer language models (pretrained on large amounts of texts) can achieve high levels of task-specific few-shot performance comparable to state-of-the-art models. However, the ability of these large language models in few-shot transfer learning has not yet been explored in the biomedical domain. We investigated the performance of two powerful transformer language models, i.e. GPT-3 and BioBERT, in few-shot settings on various biomedical NLP tasks. The experimental results showed that, to a great extent, both the models underperform a language model fine-tuned on the full training data. Although GPT-3 had already achieved near state-of-the-art results in few-shot knowledge transfer on open-domain NLP tasks, it could not perform as effectively as BioBERT, which is orders of magnitude smaller than GPT-3. Regarding that BioBERT was already pretrained on large biomedical text corpora, our study suggests that language models may largely benefit from in-domain pretraining in task-specific few-shot learning. However, in-domain pretraining seems not to be sufficient; novel pretraining and few-shot learning strategies are required in the biomedical NLP domain.