title: Performance Assessment of OpenMP Compilers Targeting NVIDIA V100 GPUs

abstract: Heterogeneous systems are becoming increasingly prevalent. In order to exploit the rich compute resources of such systems, robust programming models are needed for application developers to seamlessly migrate legacy code from today's systems to tomorrow's. Over the past decade and more, directives have been established as one of the promising paths to tackle programmatic challenges on emerging systems. This work focuses on applying and demonstrating OpenMP offloading directives on five proxy applications. We observe that the performance varies widely from one compiler to the other; a crucial aspect of our work is reporting best practices to application developers who use OpenMP offloading compilers. While some issues can be worked around by the developer, there are other issues that must be reported to the compiler vendors. By restructuring OpenMP offloading directives, we gain an 18x speedup for the su3 proxy application on NERSC's Cori system when using the Clang compiler, and a 15.7x speedup by switching max reductions to add reductions in the laplace mini-app when using the Cray-llvm compiler on Cori.


title: On the width of the $K^-$D atom ground state

abstract: Experiments at DA$\Phi$NE-Frascati and at J-PARC are scheduled to produce $K^-$D atoms and observe their X-ray cascade down to the 1$S$ ground state (g.s.), thereby measuring its strong-interaction width and shift away from a purely Coulomb state. A width $\Gamma_{1S}\lesssim 1$ keV will ensure good resolution of the X-ray transitions feeding the 1$S$ g.s. Here we study the expected $K^-$D 1$S$ g.s. width from the perspective of global fits to level shifts and widths in heavier kaonic atoms across the periodic table, using $K^-$ nuclear optical potentials constructed from $\bar K N$ chiral interaction models. Special attention is paid to the subthreshold energy at which the $\bar K N$ subsystem interacts in the $K^-$D atomic g.s. Within this approach we predict strong-interaction upward level shift of close to 700 eV and width of about 1.2 to 1.3 keV for the $K^-$D atom 1$S$ g.s., in fair agreement with genuinely three-body $K^-$D atom calculations. Comparison is made with $\pi^-$D atom phenomenology.


title: GASNet: Weakly-supervised Framework for COVID-19 Lesion Segmentation

abstract: Segmentation of infected areas in chest CT volumes is of great significance for further diagnosis and treatment of COVID-19 patients. Due to the complex shapes and varied appearances of lesions, a large number of voxel-level labeled samples are generally required to train a lesion segmentation network, which is a main bottleneck for developing deep learning based medical image segmentation algorithms. In this paper, we propose a weakly-supervised lesion segmentation framework by embedding the Generative Adversarial training process into the Segmentation Network, which is called GASNet. GASNet is optimized to segment the lesion areas of a COVID-19 CT by the segmenter, and to replace the abnormal appearance with a generated normal appearance by the generator, so that the restored CT volumes are indistinguishable from healthy CT volumes by the discriminator. GASNet is supervised by chest CT volumes of many healthy and COVID-19 subjects without voxel-level annotations. Experiments on three public databases show that when using as few as one voxel-level labeled sample, the performance of GASNet is comparable to fully-supervised segmentation algorithms trained on dozens of voxel-level labeled samples.


title: Closed-Loop Neural Interfaces with Embedded Machine Learning

abstract: Neural interfaces capable of multi-site electrical recording, on-site signal classification, and closed-loop therapy are critical for the diagnosis and treatment of neurological disorders. However, deploying machine learning algorithms on low-power neural devices is challenging, given the tight constraints on computational and memory resources for such devices. In this paper, we review the recent developments in embedding machine learning in neural interfaces, with a focus on design trade-offs and hardware efficiency. We also present our optimized tree-based model for low-power and memory-efficient classification of neural signal in brain implants. Using energy-aware learning and model compression, we show that the proposed oblique trees can outperform conventional machine learning models in applications such as seizure or tremor detection and motor decoding.


title: Review and Comparison of Commonly Used Activation Functions for Deep Neural Networks

abstract: The primary neural networks decision-making units are activation functions. Moreover, they evaluate the output of networks neural node; thus, they are essential for the performance of the whole network. Hence, it is critical to choose the most appropriate activation function in neural networks calculation. Acharya et al. (2018) suggest that numerous recipes have been formulated over the years, though some of them are considered deprecated these days since they are unable to operate properly under some conditions. These functions have a variety of characteristics, which are deemed essential to successfully learning. Their monotonicity, individual derivatives, and finite of their range are some of these characteristics (Bach 2017). This research paper will evaluate the commonly used additive functions, such as swish, ReLU, Sigmoid, and so forth. This will be followed by their properties, own cons and pros, and particular formula application recommendations.


title: Unsupervised Expressive Rules Provide Explainability and Assist Human Experts Grasping New Domains

abstract: Approaching new data can be quite deterrent; you do not know how your categories of interest are realized in it, commonly, there is no labeled data at hand, and the performance of domain adaptation methods is unsatisfactory. Aiming to assist domain experts in their first steps into a new task over a new corpus, we present an unsupervised approach to reveal complex rules which cluster the unexplored corpus by its prominent categories (or facets). These rules are human-readable, thus providing an important ingredient which has become in short supply lately - explainability. Each rule provides an explanation for the commonality of all the texts it clusters together. We present an extensive evaluation of the usefulness of these rules in identifying target categories, as well as a user study which assesses their interpretability.


title: Maps for Learning Indexable Classes

abstract: We study learning of indexed families from positive data where a learner can freely choose a hypothesis space (with uniformly decidable membership) comprising at least the languages to be learned. This abstracts a very universal learning task which can be found in many areas, for example learning of (subsets of) regular languages or learning of natural languages. We are interested in various restrictions on learning, such as consistency, conservativeness or set-drivenness, exemplifying various natural learning restrictions. Building on previous results from the literature, we provide several maps (depictions of all pairwise relations) of various groups of learning criteria, including a map for monotonicity restrictions and similar criteria and a map for restrictions on data presentation. Furthermore, we consider, for various learning criteria, whether learners can be assumed consistent.


title: Normal Forms for (Semantically) Witness-Based Learners in Inductive Inference

abstract: We study learners (computable devices) inferring formal languages, a setting referred to as language learning in the limit or inductive inference. In particular, we require the learners we investigate to be witness-based, that is, to justify each of their mind changes. Besides being a natural requirement for a learning task, this restriction deserves special attention as it is a specialization of various important learning paradigms. In particular, with the help of witness-based learning, explanatory learners are shown to be equally powerful under these seemingly incomparable paradigms. Nonetheless, until now, witness-based learners have only been studied sparsely. In this work, we conduct a thorough study of these learners both when requiring syntactic and semantic convergence and obtain normal forms thereof. In the former setting, we extend known results such that they include witness-based learning and generalize these to hold for a variety of learners. Transitioning to behaviourally correct learning, we also provide normal forms for semantically witness-based learners. Most notably, we show that set-driven globally semantically witness-based learners are equally powerful as their Gold-style semantically conservative counterpart. Such results are key to understanding the, yet undiscovered, mutual relation between various important learning paradigms when learning behaviourally correctly.


title: Graphene-Based Couplers: A Brief Review

abstract: Graphene is an interesting debated topic between scientists because of its unique properties such as tunable conductivity. Graphene conductivity can be varied by either electrostatic or magnetostatic gating or via chemical doping, which leads to the design of various photonic and electronic devices. Among various graphene-based structures, plasmonic graphene couplers have attracted the attention of many researchers because of their fascinating applications in the THz frequencies. There are four main types of graphene couplers proposed in the literature, which are: 1- directional, 2- non-reciprocal, 3- dielectric, and 4- nano-ribbon couplers. This paper aims to study and investigate the various types of graphene-based couplers published in the literature.


title: 6G in the Sky: On-Demand Intelligence at the Edge of 3D Networks

abstract: 6G will exploit satellite, aerial and terrestrial platforms jointly to improve radio access capability and to unlock the support of on-demand edge cloud services in the three dimensional space (3D) by incorporating Mobile Edge Computing (MEC) functionalities on aerial platforms and low orbit satellites. This will extend the MEC support to devices and network elements in the sky and will forge a space borne MEC enabling intelligent personalized and distributed on demand services. 3D end users will experience the impression of being surrounded by a distributed computer fulfilling their requests in apparently zero latency. In this paper, we consider an architecture providing communication, computation, and caching (C3) services on demand, anytime and everywhere in 3D space, building on the integration of conventional ground (terrestrial) base stations and flying (non-terrestrial) nodes. Given the complexity of the overall network, the C3 resources and the management of the aerial devices need to be jointly orchestrated via AI-based algorithms, exploiting virtualized networks functions dynamically deployed in a distributed manner across terrestrial and non-terrestrial nodes.


title: Mapping Monotonic Restrictions in Inductive Inference

abstract: In language learning in the limit we investigate computable devices (learners) learning formal languages. Through the years, many natural restrictions have been imposed on the studied learners. As such, monotonic restrictions always enjoyed particular attention as, although being a natural requirement, monotonic learners show significantly diverse behaviour when studied in different settings. A recent study thoroughly analysed the learning capabilities of strongly monotone learners imposed with memory restrictions and various additional requirements. The unveiled differences between explanatory and behaviourally correct such learners motivate our studies of monotone learners dealing with the same restrictions. We reveal differences and similarities between monotone learners and their strongly monotone counterpart when studied with various additional restrictions. In particular, we show that explanatory monotone learners, although known to be strictly stronger, do (almost) preserve the pairwise relation as seen in strongly monotone learning. Contrasting this similarity, we find substantial differences when studying behaviourally correct monotone learners. Most notably, we show that monotone learners, as opposed to their strongly monotone counterpart, do heavily rely on the order the information is given in, an unusual result for behaviourally correct learners.


title: A Nesterov's Accelerated quasi-Newton method for Global Routing using Deep Reinforcement Learning

abstract: Deep Q-learning method is one of the most popularly used deep reinforcement learning algorithms which uses deep neural networks to approximate the estimation of the action-value function. Training of the deep Q-network (DQN) is usually restricted to first order gradient based methods. This paper attempts to accelerate the training of deep Q-networks by introducing a second order Nesterov's accelerated quasi-Newton method. We evaluate the performance of the proposed method on deep reinforcement learning using double DQNs for global routing. The results show that the proposed method can obtain better routing solutions compared to the DQNs trained with first order Adam and RMSprop methods.


title: Noisy-LSTM: Improving Temporal Awareness for Video Semantic Segmentation

abstract: Semantic video segmentation is a key challenge for various applications. This paper presents a new model named Noisy-LSTM, which is trainable in an end-to-end manner, with convolutional LSTMs (ConvLSTMs) to leverage the temporal coherency in video frames. We also present a simple yet effective training strategy, which replaces a frame in video sequence with noises. This strategy spoils the temporal coherency in video frames during training and thus makes the temporal links in ConvLSTMs unreliable, which may consequently improve feature extraction from video frames, as well as serve as a regularizer to avoid overfitting, without requiring extra data annotation or computational costs. Experimental results demonstrate that the proposed model can achieve state-of-the-art performances in both the CityScapes and EndoVis2018 datasets.


title: ARENA: A Data-driven Radio Access Networks Analysis of Football Events

abstract: Mass events represent one of the most challenging scenarios for mobile networks because, although their date and time are usually known in advance, the actual demand for resources is difficult to predict due to its dependency on many different factors. Based on data provided by a major European carrier during mass events in a football stadium comprising up to 30.000 people, 16 base station sectors and $1$Km$^2$ area, we performed a data-driven analysis of the radio access network infrastructure dynamics during such events. Given the insights obtained from the analysis, we developed ARENA, a model-free deep learning Radio Access Network (RAN) capacity forecasting solution that, taking as input past network monitoring data and events context information, provides guidance to mobile operators on the expected RAN capacity needed during a future event. Our results, validated against real events contained in the dataset, illustrate the effectiveness of our proposed solution.


title: Chance-Constrained Control with Lexicographic Deep Reinforcement Learning

abstract: This paper proposes a lexicographic Deep Reinforcement Learning (DeepRL)-based approach to chance-constrained Markov Decision Processes, in which the controller seeks to ensure that the probability of satisfying the constraint is above a given threshold. Standard DeepRL approaches require i) the constraints to be included as additional weighted terms in the cost function, in a multi-objective fashion, and ii) the tuning of the introduced weights during the training phase of the Deep Neural Network (DNN) according to the probability thresholds. The proposed approach, instead, requires to separately train one constraint-free DNN and one DNN associated to each constraint and then, at each time-step, to select which DNN to use depending on the system observed state. The presented solution does not require any hyper-parameter tuning besides the standard DNN ones, even if the probability thresholds changes. A lexicographic version of the well-known DeepRL algorithm DQN is also proposed and validated via simulations.


title: A Point-Cloud Deep Learning Framework for Prediction of Fluid Flow Fields on Irregular Geometries

abstract: We present a novel deep learning framework for flow field predictions in irregular domains when the solution is a function of the geometry of either the domain or objects inside the domain. Grid vertices in a computational fluid dynamics (CFD) domain are viewed as point clouds and used as inputs to a neural network based on the PointNet architecture, which learns an end-to-end mapping between spatial positions and CFD quantities. Using our approach, (i) the network inherits desirable features of unstructured meshes (e.g., fine and coarse point spacing near the object surface and in the far field, respectively), which minimizes network training cost; (ii) object geometry is accurately represented through vertices located on object boundaries, which maintains boundary smoothness and allows the network to detect small changes between geometries; and (iii) no data interpolation is utilized for creating training data; thus accuracy of the CFD data is preserved. None of these features are achievable by extant methods based on projecting scattered CFD data into Cartesian grids and then using regular convolutional neural networks. Incompressible laminar steady flow past a cylinder with various shapes for its cross section is considered. The mass and momentum of predicted fields are conserved. We test the generalizability of our network by predicting the flow around multiple objects as well as an airfoil, even though only single objects and no airfoils are observed during training. The network predicts the flow fields hundreds of times faster than our conventional CFD solver, while maintaining excellent to reasonable accuracy.


title: Dos and Don'ts of Machine Learning in Computer Security

abstract: With the growing processing power of computing systems and the increasing availability of massive datasets, machine learning algorithms have led to major breakthroughs in many different areas. This development has influenced computer security, spawning a series of work on learning-based security systems, such as for malware detection, vulnerability discovery, and binary code analysis. Despite great potential, machine learning in security is prone to subtle pitfalls that undermine its performance and render learning-based systems potentially unsuitable for security tasks and practical deployment. In this paper, we look at this problem with critical eyes. First, we identify common pitfalls in the design, implementation, and evaluation of learning-based security systems. We conduct a study of 30 papers from top-tier security conferences within the past 10 years, confirming that these pitfalls are widespread in the current security literature. In an empirical analysis, we further demonstrate how individual pitfalls can lead to unrealistic performance and interpretations, obstructing the understanding of the security problem at hand. As a remedy, we propose actionable recommendations to support researchers in avoiding or mitigating the pitfalls where possible. Furthermore, we identify open problems when applying machine learning in security and provide directions for further research.


title: Finding Cut-Offs in Leaderless Rendez-Vous Protocols is Easy

abstract: In rendez-vous protocols an arbitrarily large number of indistinguishable finite-state agents interact in pairs. The cut-off problem asks if there exists a number $B$ such that all initial configurations of the protocol with at least $B$ agents in a given initial state can reach a final configuration with all agents in a given final state. In a recent paper (Horn and Sangnier, CONCUR 2020), Horn and Sangnier proved that the cut-off problem is decidable (and at least as hard as the Petri net reachability problem) for protocols with a leader, and in EXPSPACE for leaderless protocols. Further, for the special class of symmetric protocols they reduce these bounds to PSPACE and NP, respectively. The problem of lowering these upper bounds or finding matching lower bounds was left open. We show that the cut-off problem is P-complete for leaderless protocols and in NC for leaderless symmetric protocols. Further, we also consider a variant of the cut-off problem suggested in (Horn and Sangnier, CONCUR 2020), which we call the bounded-loss cut-off problem and prove that this problem is P-complete for leaderless protocols and NL-complete for leaderless symmetric protocols. Finally, by reusing some of the techniques applied for the analysis of leaderless protocols, we show that the cut-off problem for symmetric protocols with a leader is NP-complete, thereby improving upon all the elementary upper bounds of (Horn and Sangnier, CONCUR 2020).


title: SPECT Imaging Reconstruction Method Based on Deep Convolutional Neural Network

abstract: In this paper, we explore a novel method for tomographic image reconstruction in the field of SPECT imaging. Deep Learning methodologies and more specifically deep convolutional neural networks (CNN) are employed in the new reconstruction method, which is referred to as "CNN Reconstruction - CNNR". For training of the CNNR Projection data from software phantoms were used. For evaluation of the efficacy of the CNNR method, both software and hardware phantoms were used. The resulting tomographic images are compared to those produced by filtered back projection (FBP) [1], the "Maximum Likelihood Expectation Maximization" (MLEM) [1] and ordered subset expectation maximization (OSEM) [2].


title: Double-Linear Thompson Sampling for Context-Attentive Bandits

abstract: In this paper, we analyze and extend an online learning framework known as Context-Attentive Bandit, motivated by various practical applications, from medical diagnosis to dialog systems, where due to observation costs only a small subset of a potentially large number of context variables can be observed at each iteration;however, the agent has a freedom to choose which variables to observe. We derive a novel algorithm, called Context-Attentive Thompson Sampling (CATS), which builds upon the Linear Thompson Sampling approach, adapting it to Context-Attentive Bandit setting. We provide a theoretical regret analysis and an extensive empirical evaluation demonstrating advantages of the proposed approach over several baseline methods on a variety of real-life datasets


title: It's the Best Only When It Fits You Most: Finding Related Models for Serving Based on Dynamic Locality Sensitive Hashing

abstract: In recent, deep learning has become the most popular direction in machine learning and artificial intelligence. However, preparation of training data is often a bottleneck in the lifecycle of deploying a deep learning model for production or research. Reusing models for inferencing a dataset can greatly save the human costs required for training data creation. Although there exist a number of model sharing platform such as TensorFlow Hub, PyTorch Hub, DLHub, most of these systems require model uploaders to manually specify the details of each model and model downloaders to screen keyword search results for selecting a model. They are in lack of an automatic model searching tool. This paper proposes an end-to-end process of searching related models for serving based on the similarity of the target dataset and the training datasets of the available models. While there exist many similarity measurements, we study how to efficiently apply these metrics without pair-wise comparison and compare the effectiveness of these metrics. We find that our proposed adaptivity measurement which is based on Jensen-Shannon (JS) divergence, is an effective measurement, and its computation can be significantly accelerated by using the technique of locality sensitive hashing.


title: Aerodynamic Data Predictions Based on Multi-task Learning

abstract: The quality of datasets is one of the key factors that affect the accuracy of aerodynamic data models. For example, in the uniformly sampled Burgers' dataset, the insufficient high-speed data is overwhelmed by massive low-speed data. Predicting high-speed data is more difficult than predicting low-speed data, owing to that the number of high-speed data is limited, i.e. the quality of the Burgers' dataset is not satisfactory. To improve the quality of datasets, traditional methods usually employ the data resampling technology to produce enough data for the insufficient parts in the original datasets before modeling, which increases computational costs. Recently, the mixtures of experts have been used in natural language processing to deal with different parts of sentences, which provides a solution for eliminating the need for data resampling in aerodynamic data modeling. Motivated by this, we propose the multi-task learning (MTL), a datasets quality-adaptive learning scheme, which combines task allocation and aerodynamic characteristics learning together to disperse the pressure of the entire learning task. The task allocation divides a whole learning task into several independent subtasks, while the aerodynamic characteristics learning learns these subtasks simultaneously to achieve better precision. Two experiments with poor quality datasets are conducted to verify the data quality-adaptivity of the MTL to datasets. The results show than the MTL is more accurate than FCNs and GANs in poor quality datasets.


title: Characterising arbitrary dark solitons in trapped one-dimensional Bose-Einstein condensates

abstract: We present a method to detect the presence and depth of dark solitons within repulsive one-dimensional harmonically trapped Bose-Einstein condensates. For a system with one soliton, we prove that the shift of the density in Fourier space directly maps onto the depth of the soliton. For multi-soliton systems, combining our spectral method with established imaging techniques, the character of the solitons present in the condensate can be determined. We verify that the detection of solitons by the spectral shift works in the presence of waves induced by density engineering methods. Finally we discuss implications for vortex detection in three dimensional Bose-Einstein condensates.


title: L2-Relaxation: With Applications to Forecast Combination and Portfolio Analysis

abstract: This paper tackles forecast combination with many forecasts or minimum variance portfolio selection with many assets. A novel convex problem called L2-relaxation is proposed. In contrast to standard formulations, L2-relaxation minimizes the squared Euclidean norm of the weight vector subject to a set of relaxed linear inequality constraints. The magnitude of relaxation, controlled by a tuning parameter, balances the bias and variance. When the variance-covariance (VC) matrix of the individual forecast errors or financial assets exhibits latent group structures -- a block equicorrelation matrix plus a VC for idiosyncratic noises, the solution to L2-relaxation delivers roughly equal within-group weights. Optimality of the new method is established under the asymptotic framework when the number of the cross-sectional units $N$ potentially grows much faster than the time dimension $T$. Excellent finite sample performance of our method is demonstrated in Monte Carlo simulations. Its wide applicability is highlighted in three real data examples concerning empirical applications of microeconomics, macroeconomics, and finance.


title: Multi-Armed Bandits with Dependent Arms

abstract: We study a variant of the classical multi-armed bandit problem (MABP) which we call as Multi-Armed Bandits with dependent arms. More specifically, multiple arms are grouped together to form a cluster, and the reward distributions of arms belonging to the same cluster are known functions of an unknown parameter that is a characteristic of the cluster. Thus, pulling an arm $i$ not only reveals information about its own reward distribution, but also about all those arms that share the same cluster with arm $i$. This "correlation" amongst the arms complicates the exploration-exploitation trade-off that is encountered in the MABP because the observation dependencies allow us to test simultaneously multiple hypotheses regarding the optimality of an arm. We develop learning algorithms based on the UCB principle which utilize these additional side observations appropriately while performing exploration-exploitation trade-off. We show that the regret of our algorithms grows as $O(K\log T)$, where $K$ is the number of clusters. In contrast, for an algorithm such as the vanilla UCB that is optimal for the classical MABP and does not utilize these dependencies, the regret scales as $O(M\log T)$ where $M$ is the number of arms.


title: Integrated photonic interposers for processing octave-spanning microresonator frequency combs

abstract: Microcombs - optical frequency combs generated in microresonators - have advanced tremendously in the last decade, and are advantageous for applications in frequency metrology, navigation, spectroscopy, telecommunications, and microwave photonics. Crucially, microcombs offer the prospect of fully integrated miniaturized optical systems with unprecedented reductions in cost, size, weight, and power. However, this goal has been consistently hindered by the use of bulk free-space and fiber-optic components to process microcombs, limiting form factors to the table-top. Here, we address this challenge by introducing an integrated photonics interposer architecture to process microcombs and replace discrete components. Taking microcomb-based optical frequency synthesis in the telecom C-band around 1550 nm as our target application, we develop an interposer architecture that collects, routes, and interfaces octave-wide optical signals between photonic chiplets and heterogeneously integrated devices that constitute the synthesizer. We have implemented the octave spanning spectral filtering of a microcomb, central to the interposer, in the popular silicon nitride photonic platform, and have confirmed the requisite performance of the individual elements of the interposer. Moreover, we show that the thick silicon nitride needed for bright dissipative Kerr soliton generation can be integrated with the comparatively thin silicon nitride interposer layer through octave-bandwidth adiabatic evanescent coupling, indicating a path towards future system-level consolidation. Our interposer architecture addresses the immediate need for on-chip microcomb processing to successfully miniaturize microcomb systems. As microcombs and integrated devices evolve, our approach can be readily adapted to other metrology-grade applications based on optical atomic clocks and high-precision navigation and spectroscopy.


title: Characterization of Anomalous Forces in Dielectric Rotors

abstract: We performed several measurements of anomalous forces on a dielectric rotor in operation, subjected to high voltage. The device operated under constant and intense angular velocity for each high voltage applied. The measurements were made in the similar way than an analogue magnetic gyroscope, by considering clockwise and counterclockwise rotations. We found that there are significant weight reduction on the device in the clockwise case, with one order of magnitude higher than the magnetic case. In addition, we detected a similar asymmetry in the observation of the effect, that is, there are smaller results for the anomalous forces in counterclockwise rotation. We also propose a theoretical model to explain the quantitative effect based on average values of macroscopic observables of the device rotation and concluded that it is consistent with the experimental results.


title: Radiative Penrose process: Energy Gain by a Single Radiating Charged Particle in the Ergosphere of Rotating Black Hole

abstract: We demonstrate an extraordinary effect of energy gain by a single radiating charged particle inside the ergosphere of a Kerr black hole in presence of magnetic field. We solve numerically the covariant form of the Lorentz-Dirac equation reduced from the DeWitt-Brehme equation and analyze energy evolution of the radiating charged particle inside the ergosphere, where the energy of emitted radiation can be negative with respect to a distant observer in dependence on the relative orientation of the magnetic field, black hole spin and the direction of the charged particle motion. Consequently, the charged particle can leave the ergosphere with energy greater than initial in expense of black hole's rotational energy. In contrast to the original Penrose process and its various modification, the new process does not require the interactions (collisions or decay) with other particles and consequent restrictions on the relative velocities between fragments. We show that such a Radiative Penrose effect is potentially observable and discuss its possible relevance in formation of relativistic jets and in similar high-energy astrophysical settings.


title: Diving Deep into Context-Aware Neural Machine Translation

abstract: Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various architectures and analyses, the effectiveness of different context-aware NMT models is not well explored yet. This paper analyzes the performance of document-level NMT models on four diverse domains with a varied amount of parallel document-level bilingual data. We conduct a comprehensive set of experiments to investigate the impact of document-level NMT. We find that there is no single best approach to document-level NMT, but rather that different architectures come out on top on different tasks. Looking at task-specific problems, such as pronoun resolution or headline translation, we find improvements in the context-aware systems, even in cases where the corpus-level metrics like BLEU show no significant improvement. We also show that document-level back-translation significantly helps to compensate for the lack of document-level bi-texts.


title: Mycorrhiza: Genotype Assignment usingPhylogenetic Networks

abstract: Motivation The genotype assignment problem consists of predicting, from the genotype of an individual, which of a known set of populations it originated from. The problem arises in a variety of contexts, including wildlife forensics, invasive species detection and biodiversity monitoring. Existing approaches perform well under ideal conditions but are sensitive to a variety of common violations of the assumptions they rely on. Results In this article, we introduce Mycorrhiza, a machine learning approach for the genotype assignment problem. Our algorithm makes use of phylogenetic networks to engineer features that encode the evolutionary relationships among samples. Those features are then used as input to a Random Forests classifier. The classification accuracy was assessed on multiple published empirical SNP, microsatellite or consensus sequence datasets with wide ranges of size, geographical distribution and population structure and on simulated datasets. It compared favorably against widely used assessment tests or mixture analysis methods such as STRUCTURE and Admixture, and against another machine-learning based approach using principal component analysis for dimensionality reduction. Mycorrhiza yields particularly significant gains on datasets with a large average fixation index (FST) or deviation from the Hardy-Weinberg equilibrium. Moreover, the phylogenetic network approach estimates mixture proportions with good accuracy.


title: Information-Theoretic Bounds on Transfer Generalization Gap Based on Jensen-Shannon Divergence

abstract: In transfer learning, training and testing data sets are drawn from different data distributions. The transfer generalization gap is the difference between the population loss on the target data distribution and the training loss. The training data set generally includes data drawn from both source and target distributions. This work presents novel information-theoretic upper bounds on the average transfer generalization gap that capture $(i)$ the domain shift between the target data distribution $P'_Z$ and the source distribution $P_Z$ through a two-parameter family of generalized $(\alpha_1,\alpha_2)$-Jensen-Shannon (JS) divergences; and $(ii)$ the sensitivity of the transfer learner output $W$ to each individual sample of the data set $Z_i$ via the mutual information $I(W;Z_i)$. For $\alpha_1 \in (0,1)$, the $(\alpha_1,\alpha_2)$-JS divergence can be bounded even when the support of $P_Z$ is not included in that of $P'_Z$. This contrasts the Kullback-Leibler (KL) divergence $D_{KL}(P_Z||P'_Z)$-based bounds of Wu et al. [1], which are vacuous under this assumption. Moreover, the obtained bounds hold for unbounded loss functions with bounded cumulant generating functions, unlike the $\phi$-divergence based bound of Wu et al. [1]. We also obtain new upper bounds on the average transfer excess risk in terms of the $(\alpha_1,\alpha_2)$-JS divergence for empirical weighted risk minimization (EWRM), which minimizes the weighted average training losses over source and target data sets. Finally, we provide a numerical example to illustrate the merits of the introduced bounds.


title: Determination of the Interface between Amorphous Insulator and Crystalline 4H-SiC in Transmission Electron Microscope Image by using Convolutional Neural Network

abstract: A rough interface seems to be one of the possible reasons for low channel mobility (conductivity) in SiC MOSFETs. To evaluate the mobility by interface roughness, we drew a boundary line between amorphous insulator and crystalline 4H-SiC in a cross-sectional image obtained by a transmission electron microscope (TEM), by using the deep learning approach of convolutional neural network (CNN). We show that the CNN model recognizes the interface very well, even when the interface is too rough to draw the boundary line manually. Power spectral density of interface roughness was calculated.


title: Origins of anomalously low Raman exponents in single-molecule magnets

abstract: The Raman exponent of single-molecular magnetic relaxation may take various unexpected values because of rich phonon spectrum and spin-phonon coupling of molecular crystals. We systematically examine the origins of different abnormalities, and clarify misunderstandings in the past, particularly the appropriateness of the fitting procedures for the exponents. We find that exponential laws raised by optical phonons can yield spurious power laws with low exponents. This observation indicates long-standing misunderstandings for origins of low Raman exponents in a large bulk of single-molecule magnets. Resulting from spin-lattice coupling with optical modes, presence of these exponents suggests the importance of the local dynamical environment for the magnetic relaxation in this regime.


title: Application of Quaternion Neural Network to Time Reversal Based Nonlinear Elastic Wave Spectroscopy

abstract: Identification of crack positions or anomalies in materials using the time reversal based nonlinear elastic wave spectroscopy (TR-NEWS) is an established method. We propose a system using transducers which emit forward propagating solitonic wave and time-reversed propagating solitonic wave produced by memristers placed on a side of a rectangle and scattered by cracks in the material and received by receivers which are placed on the opposite side of the rectangle. By minimizing the difference of the scattered forward propagating wave and the scattered TR wave, we get information of the position of the crack by using the neural network technique. Route of the solitons are expressed by 2 dimensional projective quaternion functions, and parameters for getting the optimal route from signals are expected to be reduced. We consider the wave is expressed by a soliton which is conformal, and discuss symmetry protected topological impurities and gravitational effects using the Atiyah-Patodi-Singer's index theorem.


title: Users Perceptions about Teleconferencing Applications Collected through Twitter

abstract: The COVID-19 outbreak disrupted different organizations, employees and students, who turned to teleconference applications to collaborate and socialize even during the quarantine. Thus, the demand of teleconferencing applications surged with mobile application downloads reaching the highest number ever seen. However, some of the teleconference applications recently suffered from several issues such as security, privacy, media quality, reliability, capacity and technical difficulties. Thus, in this work, we explore the opinions of different users towards different teleconference applications. Firstly, posts on Twitter, known as tweets, about remote working and different teleconference applications are extracted using different keywords. Then, the extracted tweets are passed to sentiment classifier to classify the tweets into positive and negative. Afterwards, the most important features of different teleconference applications are extracted and analyzed. Finally, we highlight the main strengths, drawbacks and challenges of different teleconference applications.


title: Hit Song Prediction Based on Early Adopter Data and Audio Features

abstract: Billions of USD are invested in new artists and songs by the music industry every year. This research provides a new strategy for assessing the hit potential of songs, which can help record companies support their investment decisions. A number of models were developed that use both audio data, and a novel feature based on social media listening behaviour. The results show that models based on early adopter behaviour perform well when predicting top 20 dance hits.


title: Regular multihorizon black holes in General Relativity

abstract: In this work, new solutions for regular black holes that have multihorizons are proposed. These are formed by the direct product of solutions already published in the literature, which are described through the coupling of gravity with nonlinear electrodynamics. We analyze the regularity of the spacetime, the electric field, and the energy conditions of each solution. The strong energy condition is always violated within the event horizon in all solutions, while other energy conditions depend on the ratio between extreme charges of isolated solutions. For solutions with four horizons, we present two examples, Bardeen-Culetu and Balart-Culetu. Both solutions are regular, but the first do not satisfy all the energy conditions, except the strong, because it has an extreme charge ratio of 1.57581, great value. The second solution, on the other hand, can satisfy all other energy conditions, except the SEC, and has an extreme charge ratio of 1.09915, a value that allows this feature. It's also proposed a regular solution with up to six horizons, Balart-Culetu-Dymnikova, where, for a given charge value, we can verify that it satisfies all energy conditions, except the strong one. This was possible due to the ratio between extreme charges that are neither too high nor too close. We propose solutions with any number of horizons. We show that points where $-F(r)$ has a non null minimum represent a cusp in the Lagrangian $-L(F)$. We also show an example of multihorizon solution with magnetic charge. Multihorizon solutions may exhibit exotic properties, such as negative energy density, or violation of energy conditions, but which can be circumvented with a selected choice of customized solutions and extreme charge values, resulting in regular black hole solutions that satisfy all energy conditions, less the strong.


title: On a Lusin theorem for capacities

abstract: Let $X$ be a compact metric space and let $v$ be a sub-additive capacity defined on $X$. We show that Lusin's theorem with respect to $v$ holds if and only if $v$ is continuous from above.


title: Examples on the sharpness of an inequality about multiplicities over hyperfields

abstract: In this paper, the author introduces hyperfields and give some facts about the roots and multiplicities of polynomials over hyperfield based on \cite{2} and \cite{3}. Then he tests the sharpness of an inequality in Baker's former work \cite{2} about the behavior of multiplicities under homomorphisms between hyperfields and show that the inequality is not sharp under the natural homomorphisms $\mathbb{C}\rightarrow\mathbb{P}$ and $\mathbb{C}\rightarrow\mathbb{V}$ while it is sharp under the natural homomorphisms $\mathbb{C}\rightarrow\mathbb{K}$, $\mathbb{R}\rightarrow\mathbb{S}$ and $\mathbb{R}\rightarrow\mathbb{T}$ according to the previous work \cite{2} of Baker and Lorscheid.


title: Two Restricted ABC Conjectures

abstract: Ellenberg proved that the abc conjecture would follow if this conjecture were known for sums $a+b=c$ such that $D\mid abc$ for some integer~$D$. Mochizuki proved a theorem with an opposite restriction, that the full abc conjecture would follow if it were known for abc sums that are not highly divisible. We prove both theorems for general number fields.


title: Stationary Activations for Uncertainty Calibration in Deep Learning

abstract: We introduce a new family of non-linear neural network activation functions that mimic the properties induced by the widely-used Mat\'ern family of kernels in Gaussian process (GP) models. This class spans a range of locally stationary models of various degrees of mean-square differentiability. We show an explicit link to the corresponding GP models in the case that the network consists of one infinitely wide hidden layer. In the limit of infinite smoothness the Mat\'ern family results in the RBF kernel, and in this case we recover RBF activations. Mat\'ern activation functions result in similar appealing properties to their counterparts in GP models, and we demonstrate that the local stationarity property together with limited mean-square differentiability shows both good performance and uncertainty calibration in Bayesian deep learning tasks. In particular, local stationarity helps calibrate out-of-distribution (OOD) uncertainty. We demonstrate these properties on classification and regression benchmarks and a radar emitter classification task.


title: Blending Search and Discovery: Tag-Based Query Refinement with Contextual Reinforcement Learning

abstract: We tackle tag-based query refinement as a mobile-friendly alternative to standard facet search. We approach the inference challenge with reinforcement learning, and propose a deep contextual bandit that can be efficiently scaled in a multi-tenant SaaS scenario.


title: Limit Behavior and the Role of Augmentation in Projected Saddle Flows for Convex Optimization

abstract: In this paper, we study the stability and convergence of continuous-time Lagrangian saddle flows to solutions of a convex constrained optimization problem. Convergence of these flows is well-known when the underlying saddle function is either strictly convex in the primal or strictly concave in the dual variables. In this paper, we show convergence under non-strict convexity when a simple, unilateral augmentation term is added. For this purpose, we establish a novel, non-trivial characterization of the limit set of saddle-flow trajectories that allows us to preclude limit cycles. With our presentation we try to unify several existing problem formulations as a projected dynamical system that allows projection of both the primal and dual variables, thus complementing results available in the recent literature.


title: Machine Learning with bond information for local structure optimizations in surface science

abstract: Local optimization of adsorption systems inherently involves different scales: within the substrate, within the molecule, and between molecule and substrate. In this work, we show how the explicit modeling of the different character of the bonds in these systems improves the performance of machine learning methods for optimization. We introduce an anisotropic kernel in the Gaussian process regression framework that guides the search for the local minimum, and we show its overall good performance across different types of atomic systems. The method shows a speed-up of up to a factor two compared with the fastest standard optimization methods on adsorption systems. Additionally, we show that a limited memory approach is not only beneficial in terms of overall computational resources, but can result in a further reduction of energy and force calculations.


title: Softer Pruning, Incremental Regularization

abstract: Network pruning is widely used to compress Deep Neural Networks (DNNs). The Soft Filter Pruning (SFP) method zeroizes the pruned filters during training while updating them in the next training epoch. Thus the trained information of the pruned filters is completely dropped. To utilize the trained pruned filters, we proposed a SofteR Filter Pruning (SRFP) method and its variant, Asymptotic SofteR Filter Pruning (ASRFP), simply decaying the pruned weights with a monotonic decreasing parameter. Our methods perform well across various networks, datasets and pruning rates, also transferable to weight pruning. On ILSVRC-2012, ASRFP prunes 40% of the parameters on ResNet-34 with 1.63% top-1 and 0.68% top-5 accuracy improvement. In theory, SRFP and ASRFP are an incremental regularization of the pruned filters. Besides, We note that SRFP and ASRFP pursue better results while slowing down the speed of convergence.


title: Computable classifications of continuous, transducer, and regular functions

abstract: We develop a systematic algorithmic framework that unites global and local classification problems for functional separable spaces and apply it to attack classification problems concerning the Banach space C[0,1] of real-valued continuous functions on the unit interval. We prove that the classification problem for continuous (binary) regular functions among almost everywhere linear, pointwise linear-time Lipshitz functions is $\Sigma^0_2$-complete. We show that a function $f\colon [0,1] \rightarrow \mathbb{R}$ is (binary) transducer if and only if it is continuous regular; interestingly, this peculiar and nontrivial fact was overlooked by experts in automata theory. As one of many consequences, our $\Sigma^0_2$-completeness result covers the class of transducer functions as well. Finally, we show that the Banach space $C[0,1]$ of real-valued continuous functions admits an arithmetical classification among separable Banach spaces. Our proofs combine methods of abstract computability theory, automata theory, and functional analysis.


title: On the Identification of Coherent Structures in Space Plasmas: the Magnetic Helicity-PVI Method

abstract: Plasma turbulence can be viewed as a magnetic landscape populated by large and small scale coherent structures. In this complex network, large helical magnetic tubes might be separated by small scale magnetic reconnection events (current sheets). However, the identification of these magnetic structures in a continuous stream of data has always been a challenging task. Here we present a method that is able to characterize both the large and small scale structures of the turbulent solar wind, based on the combined use of a filtered magnetic helicity ($H_m$) and the Partial Variance of Increments (PVI). This simple, single-spacecraft technique, has been validated first via direct numerical simulations of plasma turbulence and then applied to data from the Parker Solar Probe (PSP) mission. This novel analysis, combining $H_m$&PVI methods, reveals that a large number of flux tubes populate the solar wind and continuously merge in contact regions where magnetic reconnection and particle acceleration may occur.


title: A Backbone Replaceable Fine-tuning Framework for Stable Face Alignment

abstract: Heatmap regression based face alignment has achieved prominent performance on static images. However, the stability and accuracy are remarkably discounted when applying the existing methods on dynamic videos. We attribute the degradation to random noise and motion blur, which are common in videos. The temporal information is critical to address this issue yet not fully considered in the existing works. In this paper, we visit the video-oriented face alignment problem in two perspectives: detection accuracy prefers lower error for a single frame, and detection consistency forces better stability between adjacent frames. On this basis, we propose a Jitter loss function that leverages temporal information to suppress inaccurate as well as jittered landmarks. The Jitter loss is involved in a novel framework with a fine-tuning ConvLSTM structure over a backbone replaceable network. We further demonstrate that accurate and stable landmarks are associated with different regions with overlaps in a canonical coordinate, based on which the proposed Jitter loss facilitates the optimization process during training. The proposed framework achieves at least 40% improvement on stability evaluation metrics while enhancing detection accuracy versus state-of-the-art methods. Generally, it can swiftly convert a landmark detector for facial images to a better-performing one for videos without retraining the entire model.


title: Discrete index transformations with squares of Bessel functions

abstract: Discrete analogs of the index transforms with squares of Bessel functions of the first and second kind $J_\nu(z),\ Y_\nu(z)$ are introduced and investigated. The corresponding inversion theorems for suitable classes of functions and sequences are established.


title: Directed polymers on infinite graphs

abstract: We study the directed polymer model for general graphs (beyond $\mathbb Z^d$) and random walks. We provide sufficient conditions for the existence or non-existence of a weak disorder phase, of an $L^2$ region, and of very strong disorder, in terms of properties of the graph and of the random walk. We study in some detail (biased) random walk on various trees including the Galton Watson trees, and provide a range of other examples that illustrate counter-examples to intuitive extensions of the $\mathbb Z^d$/SRW result.


title: Covariance spectroscopy of molecular gases using fs pulse bursts created by modulational instability in gas-filled hollow-core fiber

abstract: We present a technique that uses noisy broadband pulse bursts generated by modulational instability to probe nonlinear processes, including infrared-inactive Raman transitions, in molecular gases. These processes imprint correlations between different regions of the noisy spectrum, which can be detected by acquiring single shot spectra and calculating the Pearson correlation coefficient between the different frequency components. Numerical simulations verify the experimental measurements and are used to further understand the system and discuss methods to improve the signal strength and the spectral resolution of the technique.


title: Gray codes for Fibonacci q-decreasing words

abstract: An $n$-length binary word is $q$-decreasing, $q\geq 1$, if every of its length maximal factor of the form $0^a1^b$ satisfies $a=0$ or $q\cdot a > b$.We show constructively that these words are in bijection with binary words having no occurrences of $1^{q+1}$, and thus they are enumerated by the $(q+1)$-generalized Fibonacci numbers. We give some enumerative results and reveal similarities between $q$-decreasing words and binary words having no occurrences of $1^{q+1}$ in terms of frequency of $1$ bit. In the second part of our paper, we provide an efficient exhaustive generating algorithm for $q$-decreasing words in lexicographic order, for any $q\geq 1$, show the existence of 3-Gray codes and explain how a generating algorithm for these Gray codes can be obtained. Moreover, we give the construction of a more restrictive 1-Gray code for $1$-decreasing words, which in particular settles a conjecture stated recently in the context of interconnection networks by E\u{g}ecio\u{g}lu and Ir\v{s}i\v{c}.


title: Completing bases in four dimensions

abstract: Criteria and constructive methods for the completion of an incomplete basis of, or context in, a four-dimensional Hilbert space by (in)decomposable vectors are given.


title: GUP effects on Hawking temperature in Riemann space-time

abstract: In this paper, the modified Hawking temperature of a static Riemann space-time is studied using the generalized Klein-Gordon equation and the generalized Dirac equation. Applying the Kerner-Mann quantum tunneling method, the modified Hawking temperature for scalar particle and fermions that crosses the event horizon of the black hole have been derived. We observe that the quantum gravity effect reduces the rise of thermal radiation temperature of the black hole.


title: Approaching a large deviation theory for complex systems

abstract: The standard Large Deviation Theory (LDT) is mathematically illustrated by the Boltzmann-Gibbs factor which describes the thermal equilibrium of short-range-interacting many-body Hamiltonian systems, the velocity distribution of which is Maxwellian. It is generically applicable to systems satisfying the Central Limit Theorem (CLT). When we focus instead on stationary states of typical complex systems (e.g., classical long-range-interacting many-body Hamiltonian systems, such as self-gravitating ones), the CLT, and possibly also the LDT, need to be generalised. Specifically, when the $N\to\infty$ attractor ($N$ being the number of degrees of freedom) in the space of distributions is a $Q$-Gaussian (a nonadditive $q$-entropy-based generalisation of the standard Gaussian case, which is recovered for $Q=1$) related to a $Q$-generalised CLT, we expect the LDT probability distribution to asymptotically approach a power law. Consistently with available strong numerical indications for probabilistic models, this behaviour possibly is that associated to a $q$-exponential (defined as $e_q^x\equiv\left[1+(1-q)x\right]^{1/(1-q)}$, which is the generalisation of the standard exponential form, straightforwardly recovered for $q=1$); $q$ and $Q$ are expected to be simply connected, including the particular case $q=Q=1$. The argument of such $q$-exponential would be expected to be proportional to $N$, analogously to the thermodynamical entropy of many-body Hamiltonian systems. We provide here numerical evidence supporting the asymptotic power-law by analysing the standard map, the coherent noise model for biological extinctions and earthquakes, the Ehrenfest dog-flea model, and the random-walk avalanches.


title: The high energy spectrum of internal positrons from radiative muon capture on nuclei

abstract: The Mu2e and COMET collaborations will search for nucleus-catalyzed muon conversion to positrons ($\mu^-\rightarrow e^+$) as a signal of lepton number violation. A key background for this search is radiative muon capture where either: 1) a real photon converts to an $e^+ e^-$ pair "externally" in surrounding material, or 2) a virtual photon mediates the production of an $e^+e^-$ pair "internally". If the $e^+$ has an energy approaching the signal region then it can serve as an irreducible background. In this work we describe how the near end-point internal positron spectrum can be related to the real photon spectrum from the same nucleus, which encodes all non-trivial nuclear physics.


title: Anderson localization transition in a robust $\mathcal{PT}$-symmetric phase of a generalized Aubry-Andre model

abstract: We study a generalized Aubry-Andre model that obeys $\mathcal{PT}$-symmetry. We observe a robust $\mathcal{PT}$-symmetric phase with respect to system size and disorder strength, where all eigenvalues are real despite the Hamiltonian being non-hermitian. This robust $\mathcal{PT}$-symmetric phase can support an Anderson localization transition, giving a rich phase diagram as a result of the interplay between disorder and $\mathcal{PT}$-symmetry. Our model provides a perfect platform to study disorder-driven localization phenomena in a $\mathcal{PT}$-symmetric system.


title: Analog de Sitter space in a controlled Coulomb explosion

abstract: The Coulomb explosion of an atomic gas steered by laser-controlled time-dependent charging can be modeled by a macroscopic system of identical charges whose number is not conserved. We show that such a system can evolve in the spatially homogeneous and isotropic fashion that mimics accelerating cosmic expansions. Specifically, for a constant rate of charge production, the resulting Friedmann-Coulomb equations have a stable fixed point corresponding to an analog of de Sitter space.


title: Hector: Using Untrusted Browsers to Provision Web Applications

abstract: Web applications are on the rise and rapidly evolve into more and more mature replacements for their native counterparts. This disruptive trend is mainly driven by the attainment of platform-independence and instant deployability. On top of this, web browsers offer the opportunity for seamless browser-to-browser communication for distributed interaction. In this paper, we present Hector, a novel web application framework that transforms web browsers into a distributed application-centric computing platform. Hector enables offloading application logic to users, thereby improving user experience with lower latencies while generating less costs for service providers. Following the programming paradigm of Function-as-a-Service, applications are decomposed into functions so they can be managed efficiently and deployed in a responsive, scalable and lightweight fashion. In case of client-side resource shortage or unresponsive clients, execution falls back to a traditional cloud-based infrastructure. Hector combines WebAssembly for multi-language computations at near-native speed, WebRTC for browser-to-browser communication and trusted execution as provided by the Intel Software Guard Extensions so browsers can trust each other's computations. We evaluate Hector by implementing a digital assistant as well as a recommendation system. Our evaluation shows that Hector achieves lower end-user latencies while generating less costs than traditional deployments. Additionally, we show that Hector scales linearly with increasing client numbers and can cope well with unresponsive clients.


title: Eulerian pairs and Eulerian recurrence systems

abstract: In this paper, we characterize a duality relation between Eulerian recurrences and Eulerian recurrence systems, which generalizes and unifies Hermite-Biehler decompositions of several enumerative polynomials, including flag descent polynomials for hyperoctahedral group, flag ascent-plateau polynomials for Stirling permutations, up-down run polynomials for symmetric group and alternating run polynomials for hyperoctahedral group. As applications, we derive some properties of associated enumerative polynomials. In particular, we find that both the ascent-plateau polynomials and left ascent-plateau polynomials for Stirling permutations are alternatingly increasing, and so they are unimodal with modes in the middle.


title: No-regret learning and mixed Nash equilibria: They do not mix

abstract: Understanding the behavior of no-regret dynamics in general $N$-player games is a fundamental question in online learning and game theory. A folk result in the field states that, in finite games, the empirical frequency of play under no-regret learning converges to the game's set of coarse correlated equilibria. By contrast, our understanding of how the day-to-day behavior of the dynamics correlates to the game's Nash equilibria is much more limited, and only partial results are known for certain classes of games (such as zero-sum or congestion games). In this paper, we study the dynamics of "follow-the-regularized-leader" (FTRL), arguably the most well-studied class of no-regret dynamics, and we establish a sweeping negative result showing that the notion of mixed Nash equilibrium is antithetical to no-regret learning. Specifically, we show that any Nash equilibrium which is not strict (in that every player has a unique best response) cannot be stable and attracting under the dynamics of FTRL. This result has significant implications for predicting the outcome of a learning process as it shows unequivocally that only strict (and hence, pure) Nash equilibria can emerge as stable limit points thereof.


title: Improving Transformation Invariance in Contrastive Representation Learning

abstract: We propose methods to strengthen the invariance properties of representations obtained by contrastive learning. While existing approaches implicitly induce a degree of invariance as representations are learned, we look to more directly enforce invariance in the encoding process. To this end, we first introduce a training objective for contrastive learning that uses a novel regularizer to control how the representation changes under transformation. We show that representations trained with this objective perform better on downstream tasks and are more robust to the introduction of nuisance transformations at test time. Second, we propose a change to how test time representations are generated by introducing a feature averaging approach that combines encodings from multiple transformations of the original input, finding that this leads to across the board performance gains. Finally, we introduce the novel Spirograph dataset to explore our ideas in the context of a differentiable generative process with multiple downstream tasks, showing that our techniques for learning invariance are highly beneficial.


title: Gyrokinetic investigation of Alfv\'en instabilities in the presence of turbulence

abstract: The nonlinear dynamics of beta-induced Alfv\'en Eigenmodes (BAE) driven by energetic particles (EP) in the presence of ion-temperature-gradient (ITG) turbulence is investigated, by means of selfconsistent global gyrokinetic simulations and analytical theory. A tokamak magnetic equilibrium with large aspect ratio and reversed shear is considered. A previous study of this configuration has shown that the electron species plays an important role in determining the nonlinear saturation level of a BAE in the absence of turbulence [A. Biancalani, et al., J. Plasma Phys. (2020)]. Here, we extend the study to a turbulent plasma. The EPs are found modify the heat fluxes by introducing energy at the large spatial scales, mainly at the toroidal mode number of the dominant BAE and its harmonics. In this regime, BAEs are found to carry a strong electron heat flux. The feed-back of the global relaxation of the temperature profiles induced by the BAE, and on the turbulence dynamics, is also discussed.


title: Heads-up! Unsupervised Constituency Parsing via Self-Attention Heads

abstract: Transformer-based pre-trained language models (PLMs) have dramatically improved the state of the art in NLP across many tasks. This has led to substantial interest in analyzing the syntactic knowledge PLMs learn. Previous approaches to this question have been limited, mostly using test suites or probes. Here, we propose a novel fully unsupervised parsing approach that extracts constituency trees from PLM attention heads. We rank transformer attention heads based on their inherent properties, and create an ensemble of high-ranking heads to produce the final tree. Our method is adaptable to low-resource languages, as it does not rely on development sets, which can be expensive to annotate. Our experiments show that the proposed method often outperform existing approaches if there is no development set present. Our unsupervised parser can also be used as a tool to analyze the grammars PLMs learn implicitly. For this, we use the parse trees induced by our method to train a neural PCFG and compare it to a grammar derived from a human-annotated treebank.


title: Dualizing spheres for compact $p$-adic analytic groups and duality in chromatic homotopy

abstract: The primary goal of this paper is to study Spanier-Whitehead duality in the $K(n)$-local category. One of the key players in the $K(n)$-local category is the Lubin-Tate spectrum $E_n$, whose homotopy groups classify deformations of a formal group law of height $n$, in the implicit characteristic $p$. It is known that $E_n$ is self-dual up to a shift; however, that does not fully take into account the action of the Morava stabilizer group $\mathbb{G}_n$, or even its subgroup of automorphisms of the formal group in question. In this paper we find that the $\mathbb{G}_n$-equivariant dual of $E_n$ is in fact $E_n$ twisted by a sphere with a non-trivial (when $n>1$) action by $\mathbb{G}_n$. This sphere is a dualizing module for the group $\mathbb{G}_n$, and we construct and study such an object $I_{\mathcal{G}}$ for any compact $p$-adic analytic group $\mathcal{G}$. If we restrict the action of $\mathcal{G}$ on $I_{\mathcal{G}}$ to certain type of small subgroups, we identify $I_{\mathcal{G}}$ with a specific representation sphere coming from the Lie algebra of $\mathcal{G}$. This is done by a classification of $p$-complete sphere spectra with an action by an elementary abelian $p$-group in terms of characteristic classes, and then a specific comparison of the characteristic classes in question. The setup makes the theory quite accessible for computations, as we demonstrate in the later sections of this paper, determining the $K(n)$-local Spanier-Whitehead duals of $E_n^{hH}$ for select choices of $p$ and $n$ and finite subgroups $H$ of $\mathbb{G}_n$.


title: Optimal quantum channels

abstract: A method to optimize the cost of a quantum channel is developed. The goal is to determine the cheapest channel that produces prescribed output states for a given set of input states. This is essentially a quantum version of optimal transport. To attach a clear conceptual meaning to the cost, channels are viewed in terms of what we call elementary transitions, which are analogous to point-to-point transitions between classical systems. The role of entanglement in optimization of cost is emphasized. We also show how our approach can be applied to theoretically search for channels performing a prescribed set of tasks on the states of a system, while otherwise disturbing the state as little as possible.


title: COSEA: Convolutional Code Search with Layer-wise Attention

abstract: Semantic code search, which aims to retrieve code snippets relevant to a given natural language query, has attracted many research efforts with the purpose of accelerating software development. The huge amount of online publicly available code repositories has prompted the employment of deep learning techniques to build state-of-the-art code search models. Particularly, they leverage deep neural networks to embed codes and queries into a unified semantic vector space and then use the similarity between code's and query's vectors to approximate the semantic correlation between code and the query. However, most existing studies overlook the code's intrinsic structural logic, which indeed contains a wealth of semantic information, and fails to capture intrinsic features of codes. In this paper, we propose a new deep learning architecture, COSEA, which leverages convolutional neural networks with layer-wise attention to capture the valuable code's intrinsic structural logic. To further increase the learning efficiency of COSEA, we propose a variant of contrastive loss for training the code search model, where the ground-truth code should be distinguished from the most similar negative sample. We have implemented a prototype of COSEA. Extensive experiments over existing public datasets of Python and SQL have demonstrated that COSEA can achieve significant improvements over state-of-the-art methods on code search tasks.


title: Capillary-Gravity Water Waves: Modified Flow Force Formulation

abstract: The classical irrotational capillary-gravity water wave problem described by the Euler equations with a nonlinear free surface boundary condition over a flat bed is considered. A modified flow force has been defined and a new formulation of capillary-gravity waves in the framework of the modified flow force function has been developed. Using bifurcation theory, the local existence of waves of small amplitude is proved.


title: Multimodal Research in Vision and Language: A Review of Current and Emerging Trends

abstract: Deep Learning and its applications have cascaded impactful research and development with a diverse range of modalities present in the real-world data. More recently, this has enhanced research interests in the intersection of the Vision and Language arena with its numerous applications and fast-paced growth. In this paper, we present a detailed overview of the latest trends in research pertaining to visual and language modalities. We look at its applications in their task formulations and how to solve various problems related to semantic perception and content generation. We also address task-specific trends, along with their evaluation strategies and upcoming challenges. Moreover, we shed some light on multi-disciplinary patterns and insights that have emerged in the recent past, directing this field towards more modular and transparent intelligent systems. This survey identifies key trends gravitating recent literature in VisLang research and attempts to unearth directions that the field is heading towards.


title: Luminous solar neutrinos II: Mass-mixing portals

abstract: Solar neutrinos can be efficiently upscattered to MeV scale heavy neutral leptons (HNLs) within the Earth's mantle. HNLs can then decay to electron-positron pairs leading to energy deposition inside large-volume detectors. In this paper we consider mass-portal upscattering of solar neutrinos to HNLs of mass 20 MeV $\geq m_N \geq 2 m_e$. The large volume of the Earth compensates for the long decay-length of the HNLs leading to observable rates of $N\rightarrow \nu_\alpha e^+e^-$ in large volume detectors. We find that searches for mantle-upscattered HNLs can set the novel limits on mixing with third generation leptons, $|U_{\tau N}|$ for masses in the MeV regime; sensitivity to mixing with first- and second-generation leptons is not competitive with existing search strategies.


title: Deep Multi-path Network Integrating Incomplete Biomarker and Chest CT Data for Evaluating Lung Cancer Risk

abstract: Clinical data elements (CDEs) (e.g., age, smoking history), blood markers and chest computed tomography (CT) structural features have been regarded as effective means for assessing lung cancer risk. These independent variables can provide complementary information and we hypothesize that combining them will improve the prediction accuracy. In practice, not all patients have all these variables available. In this paper, we propose a new network design, termed as multi-path multi-modal missing network (M3Net), to integrate the multi-modal data (i.e., CDEs, biomarker and CT image) considering missing modality with multiple paths neural network. Each path learns discriminative features of one modality, and different modalities are fused in a second stage for an integrated prediction. The network can be trained end-to-end with both medical image features and CDEs/biomarkers, or make a prediction with single modality. We evaluate M3Net with datasets including three sites from the Consortium for Molecular and Cellular Characterization of Screen-Detected Lesions (MCL) project. Our method is cross validated within a cohort of 1291 subjects (383 subjects with complete CDEs/biomarkers and CT images), and externally validated with a cohort of 99 subjects (99 with complete CDEs/biomarkers and CT images). Both cross-validation and external-validation results show that combining multiple modality significantly improves the predicting performance of single modality. The results suggest that integrating subjects with missing either CDEs/biomarker or CT imaging features can contribute to the discriminatory power of our model (p < 0.05, bootstrap two-tailed test). In summary, the proposed M3Net framework provides an effective way to integrate image and non-image data in the context of missing information.


title: Weakly-supervised Learning For Catheter Segmentation in 3D Frustum Ultrasound

abstract: Accurate and efficient catheter segmentation in 3D ultrasound (US) is essential for cardiac intervention. Currently, the state-of-the-art segmentation algorithms are based on convolutional neural networks (CNNs), which achieved remarkable performances in a standard Cartesian volumetric data. Nevertheless, these approaches suffer the challenges of low efficiency and GPU unfriendly image size. Therefore, such difficulties and expensive hardware requirements become a bottleneck to build accurate and efficient segmentation models for real clinical application. In this paper, we propose a novel Frustum ultrasound based catheter segmentation method. Specifically, Frustum ultrasound is a polar coordinate based image, which includes same information of standard Cartesian image but has much smaller size, which overcomes the bottleneck of efficiency than conventional Cartesian images. Nevertheless, the irregular and deformed Frustum images lead to more efforts for accurate voxel-level annotation. To address this limitation, a weakly supervised learning framework is proposed, which only needs 3D bounding box annotations overlaying the region-of-interest to training the CNNs. Although the bounding box annotation includes noise and inaccurate annotation to mislead to model, it is addressed by the proposed pseudo label generated scheme. The labels of training voxels are generated by incorporating class activation maps with line filtering, which is iteratively updated during the training. Our experimental results show the proposed method achieved the state-of-the-art performance with an efficiency of 0.25 second per volume. More crucially, the Frustum image segmentation provides a much faster and cheaper solution for segmentation in 3D US image, which meet the demands of clinical applications.


title: A novel smoothed particle hydrodynamics and finite element coupling scheme for fluid-structure interaction: the sliding boundary particle approach

abstract: A novel numerical formulation for solving fluid-structure interaction (FSI) problems is proposed where the fluid field is spatially discretized using smoothed particle hydrodynamics (SPH) and the structural field using the finite element method (FEM). As compared to fully mesh- or grid-based FSI frameworks, due to the Lagrangian nature of SPH this framework can be easily extended to account for more complex fluids consisting of multiple phases and dynamic phase transitions. Moreover, this approach facilitates the handling of large deformations of the fluid domain respectively the fluid-structure interface without additional methodological and computational efforts. In particular, to achieve an accurate representation of interaction forces between fluid particles and structural elements also for strongly curved interface geometries, the novel sliding boundary particle approach is proposed to ensure full support of SPH particles close to the interface. The coupling of the fluid and the structural field is based on a Dirichlet-Neumann partitioned approach, where the fluid field is the Dirichlet partition with prescribed interface displacements and the structural field is the Neumann partition subject to interface forces. To overcome instabilities inherent to weakly coupled schemes an iterative fixed-point coupling scheme is employed. Several numerical examples in form of well-known benchmark tests are considered to validate the accuracy, stability, and robustness of the proposed formulation. Finally, the filling process of a highly flexible thin-walled balloon-like container is studied, representing a model problem close to potential application scenarios of the proposed scheme in the field of biomechanics.


title: Parametric non-interference in timed automata

abstract: We consider a notion of non-interference for timed automata (TAs) that allows to quantify the frequency of an attack; that is, we infer values of the minimal time between two consecutive actions of the attacker, so that (s)he disturbs the set of reachable locations. We also synthesize valuations for the timing constants of the TA (seen as parameters) guaranteeing non-interference. We show that this can reduce to reachability synthesis in parametric timed automata. We apply our method to a model of the Fischer mutual exclusion protocol and obtain preliminary results.


title: Probabilistic small data global well-posedness of the energy-critical Maxwell-Klein-Gordon equation

abstract: We establish probabilistic small data global well-posedness of the energy-critical Maxwell-Klein-Gordon equation relative to the Coulomb gauge for scaling super-critical random initial data. The proof relies on an induction on frequency procedure and a modified linear-nonlinear decomposition furnished by a delicate "probabilistic" parametrix construction. This is the first global existence result for a geometric wave equation for random initial data at scaling super-critical regularity.


title: 6TiSCH++ with Bluetooth 5 and Concurrent Transmissions

abstract: Targeting dependable communications for industrial Internet of Things applications, IETF 6TiSCH provides mechanisms for efficient scheduling, routing, and forwarding of IPv6 traffic across low-power mesh networks. Yet, despite an overwhelming body of literature covering both centralized and distributed scheduling schemes for 6TiSCH, an effective control solution for large-scale multi-hop mesh networks remains an open challenge. This paper addresses this with a novel approach that eliminates much of the routing and link-layer overhead incurred by centralized schedulers, and provides a robust mechanism for data dissemination synchronization within 6TiSCH. Specifically, we leverage the physical layer (PHY) switching capabilities of modern low-power wireless platforms to build on recent work demonstrating the viability of Concurrent Transmission (CT)-based flooding protocols across the Bluetooth 5 (BT 5) PHYs. By switching the PHY and MAC layer at runtime, we inject a BT 5-based CT flood within a standard IEEE 802.15.4 TSCH slotframe, thereby providing a reliable, low-latency scheme for 6TiSCH control messaging. We present an analytical model and experimental evaluation showing how our solution not only exploits the BT 5 high data-rate PHY layers for rapid data dissemination, but can also provide reliable 6TiSCH association and synchronization even under external radio interference. We further discuss how the proposed technique can be used to address other open challenges within the standard.


title: Explicit Burgess Bound for Composite Moduli

abstract: We prove an explicit version of Burgess' bound on character sums for composite moduli.


title: Learning Locomotion Skills in Evolvable Robots

abstract: The challenge of robotic reproduction -- making of new robots by recombining two existing ones -- has been recently cracked and physically evolving robot systems have come within reach. Here we address the next big hurdle: producing an adequate brain for a newborn robot. In particular, we address the task of targeted locomotion which is arguably a fundamental skill in any practical implementation. We introduce a controller architecture and a generic learning method to allow a modular robot with an arbitrary shape to learn to walk towards a target and follow this target if it moves. Our approach is validated on three robots, a spider, a gecko, and their offspring, in three real-world scenarios.


title: Band structure of a HgTe-based three-dimensional topological insulator

abstract: From the analysis of the cyclotron resonance, we experimentally obtain the band structure of the three-dimensional topological insulator based on a HgTe thin film. Top gating was used to shift the Fermi level in the film, allowing us to detect separate resonance modes corresponding to the surface states at two opposite film interfaces, the bulk conduction band, and the valence band. The experimental band structure agrees reasonably well with the predictions of the $\mathbf{k\cdot p}$ model. Due to the strong hybridization of the surface and bulk bands, the dispersion of the surface states is close to parabolic in the broad range of the electron energies.


title: A Learning-based Discretionary Lane-Change Decision-Making Model with Driving Style Awareness

abstract: Discretionary lane change (DLC) is a basic but complex maneuver in driving, which aims at reaching a faster speed or better driving conditions, e.g., further line of sight or better ride quality. Although many DLC decision-making models have been studied in traffic engineering and autonomous driving, the impact of human factors, which is an integral part of current and future traffic flow, is largely ignored in the existing literature. In autonomous driving, the ignorance of human factors of surrounding vehicles will lead to poor interaction between the ego vehicle and the surrounding vehicles, thus, a high risk of accidents. The human factors are also a crucial part to simulate a human-like traffic flow in the traffic engineering area. In this paper, we integrate the human factors that are represented by driving styles to design a new DLC decision-making model. Specifically, our proposed model takes not only the contextual traffic information but also the driving styles of surrounding vehicles into consideration and makes lane-change/keep decisions. Moreover, the model can imitate human drivers' decision-making maneuvers to the greatest extent by learning the driving style of the ego vehicle. Our evaluation results show that the proposed model almost follows the human decision-making maneuvers, which can achieve 98.66% prediction accuracy with respect to human drivers' decisions against the ground truth. Besides, the lane-change impact analysis results demonstrate that our model even performs better than human drivers in terms of improving the safety and speed of traffic.


title: Proximal-ADMM Decoder for Nonbinary LDPC Codes

abstract: In this paper, we develop an efficient decoder via the proximal alternating direction method of multipliers (proximal-ADMM) technique for nonbinary linear block codes in the Galois field. Its main contents are as follows: first, exploiting the decomposition technique based on the three-variables check equation, we formulate the maximum likelihood (ML) decoding problem approximately to a non-convex quadratic program; second, an efficient algorithm based on the proximal-ADMM technique is proposed to solve the formulated QP problem. Exploiting the QP problem's inherent structures, its variables can be updated in parallel; third, we prove that the proposed decoding algorithm can converge to some stationary point of the formulated QP problem. Moreover, we also show, for nonbinary low-density parity-check (LDPC) codes, its computational complexity in each proximal-ADMM iteration scales linearly with block length and the size of the considered Galois field. Simulation results demonstrate that the proposed proximal-ADMM decoder outperforms state-of-the-art nonbinary LDPC decoders in terms of either error correction performance or computational complexity.


title: Cold-start Active Learning through Self-supervised Language Modeling

abstract: Active learning strives to reduce annotation costs by choosing the most critical examples to label. Typically, the active learning strategy is contingent on the classification model. For instance, uncertainty sampling depends on poorly calibrated model confidence scores. In the cold-start setting, active learning is impractical because of model instability and data scarcity. Fortunately, modern NLP provides an additional source of information: pre-trained language models. The pre-training loss can find examples that surprise the model and should be labeled for efficient fine-tuning. Therefore, we treat the language modeling loss as a proxy for classification uncertainty. With BERT, we develop a simple strategy based on the masked language modeling loss that minimizes labeling costs for text classification. Compared to other baselines, our approach reaches higher accuracy within less sampling iterations and computation time.


title: What About Inputing Policy in Value Function: Policy Representation and Policy-extended Value Function Approximator

abstract: We study Policy-extended Value Function Approximator (PeVFA) in Reinforcement Learning (RL), which extends conventional value function approximator (VFA) to take as input not only the state (and action) but also an explicit policy representation. Such an extension enables PeVFA to preserve values of multiple policies at the same time and brings an appealing characteristic, i.e., \emph{value generalization among policies}. We formally analyze the value generalization under Generalized Policy Iteration (GPI). From theoretical and empirical lens, we show that generalized value estimates offered by PeVFA may have lower initial approximation error to true values of successive policies, which is expected to improve consecutive value approximation during GPI. Based on above clues, we introduce a new form of GPI with PeVFA which leverages the value generalization along policy improvement path. Moreover, we propose a representation learning framework for RL policy, providing several approaches to learn effective policy embeddings from policy network parameters or state-action pairs. In our experiments, we evaluate the efficacy of value generalization offered by PeVFA and policy representation learning in several OpenAI Gym continuous control tasks. For a representative instance of algorithm implementation, Proximal Policy Optimization (PPO) re-implemented under the paradigm of GPI with PeVFA achieves about 40\% performance improvement on its vanilla counterpart in most environments.


title: Geometrical Hall effect and momentum-space Berry curvature from spin-reversed band pairs

abstract: When nanometric, noncoplanar spin textures with scalar spin chirality (SSC) are coupled to itinerant electrons, they endow the quasiparticle wavefunctions with a gauge field, termed Berry curvature, in a way that bears analogy to relativistic spin-orbit coupling (SOC). The resulting deflection of moving charge carriers is termed geometrical (or topological) Hall effect. Previous experimental studies modeled this signal as a real-space motion of wavepackets under the influence of a quantum-mechanical phase. In contrast, we here compare the modification of Bloch waves themselves, and of their energy dispersion, due to SOC and SSC. Using the canted pyrochlore ferromagnet Nd$_2$Mo$_2$O$_7$ as a model compound, our transport experiments and first-principle calculations show that SOC impartially mixes electronic bands with equal or opposite spin, while SSC is much more effective for opposite spin band pairs.

categories: cond-mat.str-el cond-mat.mtrl-sci physics.app-ph physics.comp-ph quant-ph


title: Electron-stimulated desorption from molecular ices in the sub-keV regime

abstract: Electron-stimulated desorption (ESD) of cryosorbed molecules on surfaces is a process of relevance to fields as varied as vacuum dynamics in accelerators and astrochemistry. While desorption from such molecular systems induced by keV electrons and fast ions has been extensively studied, the sub-keV electron regime is comparatively little known. We measured and quantified electron-stimulated desorption from molecular ice systems (layers of N$_2$, CO, CO$_2$, Ar and H$_2$O/D$_2$O condensed at cryogenic temperatures) in the 150-2000 eV electron energy range. In this regime stopping power is no longer sufficient to explain the electron energy dependence of ESD yields. We introduce the notion of desorption-relevant depth, which characterizes the transition between two energy deposition regimes near the surface. We then apply this notion to the different systems, showing how ESD in the sub-keV regime can for example reveal the differences in species diffusion in crystalline and porous amorphous CO$_2$ ices.


title: The renormalised $\mathrm{O}(a)$ improved vector current in three-flavour lattice QCD with Wilson quarks

abstract: We present the results of a non-perturbative determination of the improvement coefficient $c_\mathrm{V}$ and the renormalisation factor $Z_\mathrm{V}$, which define the renormalised vector current in three-flavour $\mathrm{O}(a)$ improved lattice QCD with Wilson quarks and tree-level Symanzik-improved gauge action. In case of the improvement coefficient, we consider both lattice descriptions of the vector current, the local as well as the conserved (i.e., point-split) one. Our improvement and normalisation conditions are based on massive chiral Ward identities and numerically evaluated in the Schr\"odinger functional setup, which allows to eliminate finite quark mass effects in a controlled way. In order to ensure a smooth dependence of the renormalisation constant and improvement coefficients on the bare gauge coupling, our computation proceeds along a line of constant physics, covering the typical range of lattice spacings $0.04\,\mathrm{fm}\lesssim a\lesssim 0.1\,\mathrm{fm}$ that is useful for phenomenological applications. Especially for the improvement coefficient of the local vector current, we report significant differences between the one-loop perturbative estimates and our non-perturbative results.


title: Statistical Guarantees and Algorithmic Convergence Issues of Variational Boosting

abstract: We provide statistical guarantees for Bayesian variational boosting by proposing a novel small bandwidth Gaussian mixture variational family. We employ a functional version of Frank-Wolfe optimization as our variational algorithm and study frequentist properties of the iterative boosting updates. Comparisons are drawn to the recent literature on boosting, describing how the choice of the variational family and the discrepancy measure affect both convergence and finite-sample statistical properties of the optimization routine. Specifically, we first demonstrate stochastic boundedness of the boosting iterates with respect to the data generating distribution. We next integrate this within our algorithm to provide an explicit convergence rate, ending with a result on the required number of boosting updates.


title: On the Difficulty of Unbiased Alpha Divergence Minimization

abstract: Several approximate inference algorithms have been proposed to minimize an alpha-divergence between an approximating distribution and a target distribution. Many of these algorithms introduce bias, the magnitude of which becomes problematic in high dimensions. Other algorithms are unbiased. These often seem to suffer from high variance, but little is rigorously known. In this work we study unbiased methods for alpha-divergence minimization through the Signal-to-Noise Ratio (SNR) of the gradient estimator. We study several representative scenarios where strong analytical results are possible, such as fully-factorized or Gaussian distributions. We find that when alpha is not zero, the SNR worsens exponentially in the dimensionality of the problem. This casts doubt on the practicality of these methods. We empirically confirm these theoretical results.


title: CLAR: Contrastive Learning of Auditory Representations

abstract: Learning rich visual representations using contrastive self-supervised learning has been extremely successful. However, it is still a major question whether we could use a similar approach to learn superior auditory representations. In this paper, we expand on prior work (SimCLR) to learn better auditory representations. We (1) introduce various data augmentations suitable for auditory data and evaluate their impact on predictive performance, (2) show that training with time-frequency audio features substantially improves the quality of the learned representations compared to raw signals, and (3) demonstrate that training with both supervised and contrastive losses simultaneously improves the learned representations compared to self-supervised pre-training followed by supervised fine-tuning. We illustrate that by combining all these methods and with substantially less labeled data, our framework (CLAR) achieves significant improvement on prediction performance compared to supervised approach. Moreover, compared to self-supervised approach, our framework converges faster with significantly better representations.


title: Quaternionic Step Derivative: Machine Precision Differentiation of Holomorphic Functions using Complex Quaternions

abstract: The known Complex Step Derivative (CSD) method allows easy and accurate differentiation up to machine precision of real analytic functions by evaluating them a small imaginary step next to the real number line. The current paper proposes that derivatives of holomorphic functions can be calculated in a similar fashion by taking a small step in a quaternionic direction instead. It is demonstrated that in so doing the CSD properties of high accuracy and convergence are carried over to derivatives of holomorphic functions. To demonstrate the ease of implementation, numerical experiments were performed using complex quaternions, the geometric algebra of space, and a $2 \times 2$ matrix representation thereof.


title: Beam spin asymmetry in semi-inclusive electroproduction of a hadron pair

abstract: A first measurement of the longitudinal beam spin asymmetry ALU in the semi-inclusive electroproduction of pairs of charged pions is reported. ALU is a higher-twist observable and offers the cleanest access to the nucleon twist-3 parton distribution function e(x). Data have been collected in the Hall-B at Jefferson Lab by impinging a 5.498 GeV electron beam on a liquid-hydrogen target, and reconstructing the scattered electron and the pion pair with the CLAS detector. One-dimensional projections of the sin(phiR) moments of ALU are extracted for the kinematic variables of interest in the valence quark region. The understanding of di-hadron production is essential for the interpretation of observables in single hadron production in semi-inclusive DIS, and pioneering measurements of single spin asymmetries in di-hadron production open a new avenue in studies of QCD dynamics.