title: Tug-of-war with Kolmogorov

abstract: We introduce a new class of strongly degenerate nonlinear parabolic PDEs $$((p-2)\Delta_{\infty,X}^N+\Delta_X)u(X,Y,t)+(m+p)(X\cdot\nabla_Yu(X,Y,t)-\partial_tu(X,Y,t))=0,$$ $(X,Y,t)\in\mathbb R^m\times \mathbb R^m\times \mathbb R$, $p\in (1,\infty)$, combining the classical PDE of Kolmogorov and the normalized $p$-Laplace operator. We characterize solutions in terms of an asymptotic mean value property and the results are connected to the analysis of certain tug-of-war games with noise. The value functions for the games introduced approximate solutions to the stated PDE when the parameter that controls the size of the possible steps goes to zero. Existence and uniqueness of viscosity solutions to the Dirichlet problem is established. The asymptotic mean value property, the associated games and the geometry underlying the Dirichlet problem, all reflect the family of dilation and the Lie group underlying operators of Kolmogorov type and this makes our setting different from the context of standard parabolic dilations and Euclidean translations applicable in the context of the heat operator and the normalized parabolic infinity Laplace operator.


title: Fairness of Machine Learning Algorithms in Demography

abstract: The paper is devoted to the study of the model fairness and process fairness of the Russian demographic dataset by making predictions of divorce of the 1st marriage, religiosity, 1st employment and completion of education. Our goal was to make classifiers more equitable by reducing their reliance on sensitive features while increasing or at least maintaining their accuracy. We took inspiration from "dropout" techniques in neural-based approaches and suggested a model that uses "feature drop-out" to address process fairness. To evaluate a classifier's fairness and decide the sensitive features to eliminate, we used "LIME Explanations". This results in a pool of classifiers due to feature dropout whose ensemble has been shown to be less reliant on sensitive features and to have improved or no effect on accuracy. Our empirical study was performed on four families of classifiers (Logistic Regression, Random Forest, Bagging, and Adaboost) and carried out on real-life dataset (Russian demographic data derived from Generations and Gender Survey), and it showed that all of the models became less dependent on sensitive features (such as gender, breakup of the 1st partnership, 1st partnership, etc.) and showed improvements or no impact on accuracy


title: Effective single component description of steady state structures of passive particles in an active bath

abstract: We model a binary mixture of passive and active Brownian particles in two dimensions using the effective interaction between passive particles in the active bath. The activity of active particles and the size ratio of two types of particles are two control parameters in the system. The effective interaction is calculated from the average force on two particles generated by the active particles. The effective interaction can be attractive or repulsive, depending on the system parameters. The passive particles form four distinct structural orders for different system parameters viz; disorder (D), disordered cluster (DC), ordered cluster (OC), and poly-crystalline order (P C). The change in structure is dictated by the change in nature of the effective interaction. We further confirm the four structures using full microscopic simulation of active and passive mixture. Our study is useful to understand the different collective behaviour in non-equilibrium systems.


title: Comment on "Greybody radiation and quasinormal modes of Kerr-like black hole in Bumblebee gravity model"

abstract: It is shown that the paper "Greybody radiation and quasinormal modes of Kerr-like black hole in Bumblebee gravity model", Eur. Phys. J. C 81, 501 (2021). arXiv:2102.06303, recently published in this journal is based on an incorrect result obtained by Ding et al., Eur. Phys. J. C 80, 178 (2020). arXiv:1910.02674, for a Kerr-like black hole solution.


title: Nuclear matter in 1+1 dimensions

abstract: We review the solution of QCD in two spacetime dimensions. Following the analysis of Baluni, for a single flavor the model can be analyzed using Abelian bosonization. The theory can be analyzed in strong coupling, when the quarks are much lighter than the gauge coupling. In this limit, the theory is given by a Luttinger liquid.


title: Multi-Task Learning as a Bargaining Game

abstract: In Multi-task learning (MTL), a joint model is trained to simultaneously make predictions for several tasks. Joint training reduces computation costs and improves data efficiency; however, since the gradients of these different tasks may conflict, training a joint model for MTL often yields lower performance than its corresponding single-task counterparts. A common method for alleviating this issue is to combine per-task gradients into a joint update direction using a particular heuristic. In this paper, we propose viewing the gradients combination step as a bargaining game, where tasks negotiate to reach an agreement on a joint direction of parameter update. Under certain assumptions, the bargaining problem has a unique solution, known as the Nash Bargaining Solution, which we propose to use as a principled approach to multi-task learning. We describe a new MTL optimization procedure, Nash-MTL, and derive theoretical guarantees for its convergence. Empirically, we show that Nash-MTL achieves state-of-the-art results on multiple MTL benchmarks in various domains.


title: \'Equations pour le premier rev\^etement de l'espace sym\'etrique de Drinfeld

abstract: The goal of this work is to study some aspects of the geometry of the first cover $\Sigma^1$ in the Drinfeld tower over $\mathbb{H}^d_K$ the Drinfeld symmetric space over $K$ a finite extension of $\mathbb{Q}_p$. It is a cyclic \'etale cover of order prime to $p$ and even of Kummer type from the vanishing of the Picard group of $\mathbb{H}^d_K$ shown in a previous work of the author. It is then completely described by a certain class of invertible functions on $\mathbb{H}^d_K$ via the Kummer exact sequence and the main result of this article gives an explicit description of this class thus providing "equations" for $\Sigma^1$. This statement extends and uses crucially the local description over a vertex obtained by Wang (and originally by Teitelbaum in dimension 1). One of the main consequence of our global equation is the description of invertible functions of $\Sigma^1$ in terms of the invertible functions of $\mathbb{H}^d_K$.


title: An improved Coupled Level Set and Volume of Fluid (i-CLSVoF) framework for droplet evaporation

abstract: Surface-tension-dominant droplet evaporation is ubiquitous and of importance to many applications. We present an improved Coupled Level Set and Volume of Fluid (i-CLSVoF) framework without explicit interface reconstruction for modelling micro-sized droplets with and without evaporation. In the i-CLSVoF framework, an improved surface tension force model with additional filtering steps to filter un-physical spurious velocities is developed and implemented. A simple, yet efficient, velocity-potential based approach is proposed to reconstruct a divergence-free velocity field for the advection of the free surface during droplet evaporation. This approach fixes the numerical issues resulting from the evaporation-induced velocity jump at the interface. The smeared mass source term approach incorporated in this work guarantees greater numerical stability than the non-smeared approach. Three different evaporation models (constant mass flux, thermally driven evaporation and droplet evaporation at room temperature) are implemented in the i-CLSVoF. Corresponding numerical benchmark cases (dam break, droplet relaxation and droplet evaporation subjected to different evaporation models) are conducted to validate the surface tension and the evaporation models. Good agreement between the numerical and corresponding analytical solutions is found. The model developed in this work shows convincing performance in modelling surface-tension-dominant flow with and without evaporation.


title: MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-ray

abstract: Computed tomography (CT) is an effective medical imaging modality, widely used in the field of clinical medicine for the diagnosis of various pathologies. Advances in Multidetector CT imaging technology have enabled additional functionalities, including generation of thin slice multiplanar cross-sectional body imaging and 3D reconstructions. However, this involves patients being exposed to a considerable dose of ionising radiation. Excessive ionising radiation can lead to deterministic and harmful effects on the body. This paper proposes a Deep Learning model that learns to reconstruct CT projections from a few or even a single-view X-ray. This is based on a novel architecture that builds from neural radiance fields, which learns a continuous representation of CT scans by disentangling the shape and volumetric depth of surface and internal anatomical structures from 2D images. Our model is trained on chest and knee datasets, and we demonstrate qualitative and quantitative high-fidelity renderings and compare our approach to other recent radiance field-based methods. Our code and link to our datasets are available at https://github.com/abrilcf/mednerf


title: Grammars for Free: Toward Grammar Inference for Ad Hoc Parsers

abstract: Ad hoc parsers are everywhere: they appear any time a string is split, looped over, interpreted, transformed, or otherwise processed. Every ad hoc parser gives rise to a language: the possibly infinite set of input strings that the program accepts without going wrong. Any language can be described by a formal grammar: a finite set of rules that can generate all strings of that language. But programmers do not write grammars for ad hoc parsers -- even though they would be eminently useful. Grammars can serve as documentation, aid program comprehension, generate test inputs, and allow reasoning about language-theoretic security. We propose an automatic grammar inference system for ad hoc parsers that would enable all of these use cases, in addition to opening up new possibilities in mining software repositories and bi-directional parser synthesis.


title: Rotation signature of TESS B-type stars. A comprehensive analysis

abstract: Stellar rotation is a fundamental observable that drives different aspects of stellar and planetary evolution. In this work, we present an unprecedented manifold analysis of 160 B-type stars with light curves collected by the TESS space mission using three different procedures (Fast Fourier Transform, Lomb-Scargle, and wavelet techniques), accompanied by rigorous visual inspection in the search for rotation periodicities. This effort provides rotational periodicities for 6 new TESS B-type stars and confirmed periodicities for 22 targets with rotation periods previously listed in the literature. For other 61 stars, already classified as possible rotational variables, we identify noisy, pulsational, binarity, or ambiguous variability behavior rather than rotation signatures. The total sample of 28 potential rotators shows an overlap of different classes of rotational variables, composed of $\alpha^2$ Canum Venaticorum, rotating ellipsoidal and SX Arietis stars. The combination of the three techniques applied in our analysis offers a solid path to overcome the challenges in the discrimination of rotation from other variabilities in stellar light curves, such as pulsation, binarity or other effects that have no physical meaning. Finally, the rotational periodicities reported in the present study may represent important constraints for improving stellar evolution models with rotation, as well as asteroseismic studies of hot stars.


title: Investigation of the Lorentz invariance violation in two-neutrino double-beta decay

abstract: We make a comprehensive investigation of the Lorentz invariance violation (LIV) effects that may occur in two-neutrino double-beta ($2\nu\beta\beta$) decay for all the experimentally interesting nuclei. We deduce the formulas for the LIV deviations and provide single and summed energy electron spectra and angular correlation between electrons with and without LIV contributions, to be used for constraining the LIV coefficient $\mathring{a}_{\text{of}}^{(3)}$. First, we confirm the shifting of the electron spectra to higher electron energies due to LIV for all nuclei. Next, we analyze other LIV signatures that can be used in LIV investigations. Thus, from the comparison of the electron and angular correlation spectra calculated with the inclusion of the LIV contributions, with their standard forms, information can be obtained about the strength versus observability of the LIV effects in the current experimental statistics. Then, we present the alternative method of constraining $\mathring{a}_{\text{of}}^{(3)}$ from the measurement of the angular correlation coefficient and estimate the statistics that different double-beta decay experiments should reach to constrain the LIV coefficient at the level of the current beta decay experiments. We hope that our work will improve the theoretical support and further stimulate the search for LIV in double-beta decay.


title: Microfluidic osmotic compression of a charge-stabilized colloidal dispersion: Equation of state and collective diffusion coefficient

abstract: We show, using a model coupling mass transport and liquid theory calculations for a charge-stabilized colloidal dispersion, that diffusion significantly limits measurement times of its Equation Of State (EOS), osmotic pressure vs composition, using the osmotic compression technique. Following this result, we present a microfluidic chip allowing one to measure the entire EOS of a charged dispersion at the nanoliter scale in a few hours. We also show that time-resolved analyses of relaxation to equilibrium in this microfluidic experiment lead to direct estimates of the collective diffusion coefficient of the dispersion in Donnan equilibrium with a salt reservoir.


title: Enhancing coherent energy transfer between quantum devices via a mediator

abstract: We investigate the coherent energy transfer between two quantum systems mediated by a quantum bus. In particular, we consider the energy transfer process between two qubits, and how it can be influenced by using a third qubit or photons in a resonant cavity as mediators. Inspecting different figures of merit and considering both on and off-resonance configurations, we characterize the energy transfer performances. We show that, while the qubit-mediated transfer shows no advantages with respect to a direct coupling case, the cavity-mediated one is progressively more and more efficient as function of the number of photons stored in the cavity that acts as a quantum bus. The speeding-up of the energy transfer time, due to a quantum mediator paves the way for new architecture designs in quantum technologies and energy based quantum logics.


title: A perturbation result for a Neumann problem in a periodic domain

abstract: We consider a Neumann problem for the Laplace equation in a periodic domain. We prove that the solution depends real analytically on the shape of the domain, on the periodicity parameters, on the Neumann datum, and on its boundary integral.


title: A semi-static replication approach to efficient hedging and pricing of callable IR derivatives

abstract: We present a semi-static hedging algorithm for callable interest rate derivatives under an affine, multi-factor term-structure model. With a traditional dynamic hedge, the replication portfolio needs to be updated continuously through time as the market moves. In contrast, we propose a semi-static hedge that needs rebalancing on just a finite number of instances. We show, taking as an example Bermudan swaptions, that callable interest rate derivatives can be replicated with an options portfolio written on a basket of discount bonds. The static portfolio composition is obtained by regressing the target option's value using an interpretable, artificial neural network. Leveraging on the approximation power of neural networks, we prove that the hedging error can be arbitrarily small for a sufficiently large replication portfolio. A direct, a lower bound, and an upper bound estimator for the risk-neutral Bermudan swaption price is inferred from the hedging algorithm. Additionally, closed-form error margins to the price statistics are determined. We practically demonstrate the hedging and pricing performance through several numerical experiments.


title: Simulation of Primordial Black Holes with large negative non-Gaussianity

abstract: In this work, we have performed numerical simulations of primordial black hole (PBH) formation in the Friedman-Lema\^itre-Robertson-Walker universe filled by radiation fluid, introducing the local-type non-Gaussianity to the primordial curvature fluctuation. We have compared the numerical results from simulations with previous analytical estimations on the threshold value for PBH formation done in the previous paper arXiv:2109.00791, particularly for negative values of the non-linearity parameter $f_{\rm NL}$. Our numerical results show the existence of PBH formation of (the so-called) type I also in the case $f_{\rm NL} \lesssim -0.336$, which was not found in the previous analytical expectations using the critical averaged compaction function. In particular, although the universal value for the averaged critical compaction function $\bar{\mathcal{C}}_{c}=2/5$ found previously in the literature is not satisfied for all the profiles considered in this work, an alternative direct analytical estimate has been found to be roughly accurate to estimate the thresholds, which gives the value of the critical averaged density with a few $\%$ deviation from the numerical one for $f_{\rm NL}\gtrsim -1$.


title: Topological Floquet-bands in a circularly shaken dice lattice

abstract: The hoppings of non-interacting particles in the optical dice lattice result in the gapless dispersions in the band structure formed by the three lowest minibands. In our research, we find that once a periodic driving force is applied to this optical dice lattice, the original spectral characteristics could be changed, forming three gapped quasi-energy bands in the quasi-energy Brillouin zone. The topological phase diagram containing the Chern number of the lowest quasi-energy band shows that when the hopping strengths of the nearest-neighboring hoppings are isotropic, the system persists in the topologically non-trivial phases with Chern number $C=2$ within a wide range of the driving strength. Accompanied by the anisotropic nearest-neighboring hopping strengths, a topological phase transition occurs, making Chern number change from $C=2$ to $C=1$. This transition is further verified by our analytical method. Our theoretical work implies that it is feasible to realize the non-trivially topological characteristics of optical dice lattices by applying the periodic shaking, and that topological phase transition can be observed by independently tuning the strength of a type of nearest-neighbor hopping.


title: Too much information: why CDCL solvers need to forget learned clauses

abstract: Conflict-driven clause learning (CDCL) is a remarkably successful paradigm for solving the satisfiability problem of propositional logic. Instead of a simple depth-first backtracking approach, this kind of solver learns the reason behind occurring conflicts in the form of additional clauses. However, despite the enormous success of CDCL solvers, there is still only a limited understanding of what influences the performance of these solvers in what way. Considering different measures, this paper demonstrates, quite surprisingly, that clause learning (without being able to get rid of some clauses) can not only help the solver but can oftentimes deteriorate the solution process dramatically. By conducting extensive empirical analysis, we furthermore find that the runtime distributions of CDCL solvers are multimodal. This multimodality can be seen as a reason for the deterioration phenomenon described above. Simultaneously, it also gives an indication of why clause learning in combination with clause deletion is virtually the de facto standard of SAT solving, in spite of this phenomenon. As a final contribution, we show that Weibull mixture distributions can accurately describe the multimodal distributions. Thus, adding new clauses to a base instance has an inherent effect of making runtimes long-tailed. This insight provides an explanation as to why the technique of forgetting clauses is useful in CDCL solvers apart from the optimization of unit propagation speed.


title: MMSys'22 Grand Challenge on AI-based Video Production for Soccer

abstract: Soccer has a considerable market share of the global sports industry, and the interest in viewing videos from soccer games continues to grow. In this respect, it is important to provide game summaries and highlights of the main game events. However, annotating and producing events and summaries often require expensive equipment and a lot of tedious, cumbersome, manual labor. Therefore, automating the video production pipeline providing fast game highlights at a much lower cost is seen as the "holy grail". In this context, recent developments in Artificial Intelligence (AI) technology have shown great potential. Still, state-of-the-art approaches are far from being adequate for practical scenarios that have demanding real-time requirements, as well as strict performance criteria (where at least the detection of official events such as goals and cards must be 100% accurate). In addition, event detection should be thoroughly enhanced by annotation and classification, proper clipping, generating short descriptions, selecting appropriate thumbnails for highlight clips, and finally, combining the event highlights into an overall game summary, similar to what is commonly aired during sports news. Even though the event tagging operation has by far received the most attention, an end-to-end video production pipeline also includes various other operations which serve the overall purpose of automated soccer analysis. This challenge aims to assist the automation of such a production pipeline using AI. In particular, we focus on the enhancement operations that take place after an event has been detected, namely event clipping (Task 1), thumbnail selection (Task 2), and game summarization (Task 3). Challenge website: https://mmsys2022.ie/authors/grand-challenge.


title: Understanding O-RAN: Architecture, Interfaces, Algorithms, Security, and Research Challenges

abstract: The Open Radio Access Network (RAN) and its embodiment through the O-RAN Alliance specifications are poised to revolutionize the telecom ecosystem. O-RAN promotes virtualized RANs where disaggregated components are connected via open interfaces and optimized by intelligent controllers. The result is a new paradigm for the RAN design, deployment, and operations: O-RAN networks can be built with multi-vendor, interoperable components, and can be programmatically optimized through a centralized abstraction layer and data-driven closed-loop control. Therefore, understanding O-RAN, its architecture, its interfaces, and workflows is key for researchers and practitioners in the wireless community. In this article, we present the first detailed tutorial on O-RAN. We also discuss the main research challenges and review early research results. We provide a deep dive of the O-RAN specifications, describing its architecture, design principles, and the O-RAN interfaces. We then describe how the O-RAN RAN Intelligent Controllers (RICs) can be used to effectively control and manage 3GPP-defined RANs. Based on this, we discuss innovations and challenges of O-RAN networks, including the Artificial Intelligence (AI) and Machine Learning (ML) workflows that the architecture and interfaces enable, security and standardization issues. Finally, we review experimental research platforms that can be used to design and test O-RAN networks, along with recent research results, and we outline future directions for O-RAN development.


title: On a Computationally Ill-Behaved Bilevel Problem with a Continuous and Nonconvex Lower Level

abstract: It is well known that bilevel optimization problems are hard to solve both in theory and practice. In this paper, we highlight a further computational difficulty when it comes to solving bilevel problems with continuous but nonconvex lower levels. Even if the lower-level problem is solved to $\varepsilon$-feasibility regarding its nonlinear constraints for an arbitrarily small but positive $\varepsilon$, the obtained bilevel solution as well as its objective value may be arbitrarily far away from the actual bilevel solution and its actual objective value. This result even holds for bilevel problems for which the nonconvex lower level is uniquely solvable, for which the strict complementarity condition holds, for which the feasible set is convex, and for which Slater's constraint qualification is satisfied for all feasible upper-level decisions. Since the consideration of $\varepsilon$-feasibility cannot be avoided when solving nonconvex problems to global optimality, our result shows that computational bilevel optimization with continuous and nonconvex lower levels needs to be done with great care. Finally, we illustrate that the nonlinearities in the lower level are the key reason for the observed bad behavior by showing that linear bilevel problems behave much better at least on the level of feasible solutions.


title: Diagnosing failures of fairness transfer across distribution shift in real-world medical settings

abstract: Diagnosing and mitigating changes in model fairness under distribution shift is an important component of the safe deployment of machine learning in healthcare settings. Importantly, the success of any mitigation strategy strongly depends on the structure of the shift. Despite this, there has been little discussion of how to empirically assess the structure of a distribution shift that one is encountering in practice. In this work, we adopt a causal framing to motivate conditional independence tests as a key tool for characterizing distribution shifts. Using our approach in two medical applications, we show that this knowledge can help diagnose failures of fairness transfer, including cases where real-world shifts are more complex than is often assumed in the literature. Based on these results, we discuss potential remedies at each step of the machine learning pipeline.


title: Detecting Privacy Requirements from User Stories with NLP Transfer Learning Models

abstract: To provide privacy-aware software systems, it is crucial to consider privacy from the very beginning of the development. However, developers do not have the expertise and the knowledge required to embed the legal and social requirements for data protection into software systems. Objective: We present an approach to decrease privacy risks during agile software development by automatically detecting privacy-related information in the context of user story requirements, a prominent notation in agile Requirement Engineering (RE). Methods: The proposed approach combines Natural Language Processing (NLP) and linguistic resources with deep learning algorithms to identify privacy aspects into User Stories. NLP technologies are used to extract information regarding the semantic and syntactic structure of the text. This information is then processed by a pre-trained convolutional neural network, which paved the way for the implementation of a Transfer Learning technique. We evaluate the proposed approach by performing an empirical study with a dataset of 1680 user stories. Results: The experimental results show that deep learning algorithms allow to obtain better predictions than those achieved with conventional (shallow) machine learning methods. Moreover, the application of Transfer Learning allows to considerably improve the accuracy of the predictions, ca. 10%. Conclusions: Our study contributes to encourage software engineering researchers in considering the opportunities to automate privacy detection in the early phase of design, by also exploiting transfer learning models.


title: A pedagagical introduction to the Lifshitz regime

abstract: We give an elementary and pedagogical review of the phase diagrams which are possible in Quantum ChromoDynamics (QCD). Currently, the emphasis is upon the appearance of a critical endpoint, where disordered and ordered phases meet. In many models, though, a Lifshitz point also arises. At a Lifshitz point, three phases meet: disordered, ordered, and one where spatially inhomogeneous phases arise. At the level of mean field theory, the appearance of a Lifshitz point does not dramatically affect the phase diagram. We argue, however, that fluctuations about the Lifshitz point are very strong in the infrared, and significantly alter the phase diagram. We discuss at length the analogy to inhomogenous polymers, where the Lifshitz regime produces a bicontinuous microemulsion. We briefly mention the possible relevance to the phase diagram of QCD.


title: RoboKrill : a metachronal drag-based swimmer robot

abstract: Marine exploration is essential to understanding ocean processes and organisms. While the use of current unmanned underwater vehicles has enabled many discoveries, there are still plenty of limitations toward exploring complex environments. Bio-inspired robots are a promising solution for highly maneuverable underwater swimming at moderate speeds. Krill, especially, are efficient swimmers in the intermediate Reynolds number regime and can inform engineering solutions for ocean exploration. In this paper, we present the design, manufacture, and validation of a new krill-inspired, metachronal, drag-based robotic system. By combining active and passive actuation of the joints with 3D printed parts, our unique design recreates the swimming kinematics of Euphausia superba in a compact and reproducible robotic platform. The motion of the anterior and posterior appendage segments is achieved using servo motors and a multi-link mechanism, while the out-of-plane motion of the biramous distal segments is attained via fluid-structure interactions. Going forward, our platform will be leveraged to study metachronal, drag-based swimmers across taxa to identify unifying success mechanisms at different scales, facilitating the development of a new generation of underwater robots.


title: Using Ballistocardiography for Sleep Stage Classification

abstract: A practical way of detecting sleep stages has become more necessary as we begin to learn about the vast effects that sleep has on people's lives. The current methods of sleep stage detection are expensive, invasive to a person's sleep, and not practical in a modern home setting. While the method of detecting sleep stages via the monitoring of brain activity, muscle activity, and eye movement, through electroencephalogram in a lab setting, provide the gold standard for detection, this paper aims to investigate a new method that will allow a person to gain similar insight and results with no obtrusion to their normal sleeping habits. Ballistocardiography (BCG) is a non-invasive sensing technology that collects information by measuring the ballistic forces generated by the heart. Using features extracted from BCG such as time of usage, heart rate, respiration rate, relative stroke volume, and heart rate variability, we propose to implement a sleep stage detection algorithm and compare it against sleep stages extracted from a Fitbit Sense Smart Watch. The accessibility, ease of use, and relatively-low cost of the BCG offers many applications and advantages for using this device. By standardizing this device, people will be able to benefit from the BCG in analyzing their own sleep patterns and draw conclusions on their sleep efficiency. This work demonstrates the feasibility of using BCG for an accurate and non-invasive sleep monitoring method that can be set up in the comfort of a one's personal sleep environment.


title: Impact of Free Energy of Polymers on Polymorphism of Polymer-Grafted Nanoparticles

abstract: We focus on polymer-grafted nanoparticles (PGNP). A PGNP is composed of two different layers: the hard core of a nanoparticle and the soft corona of grafted polymers on the surface. It is predicted that PGNPs with these two distinct layers will have similar behaviors as star polymers and hard spheres. The interaction between PGNPs strongly depend upon their grafting density and the length of the grafted polymer chains, N. Thus, PGNP may exhibit polymorphism. Moreover, it is expected that crystals made from PGNPs will be structurally tough due to the entanglement of grafted polymers. The crystal polymorph of PGNP is explored using molecular dynamics simulations. We succeeded in finding FCC/HCP and BCC crystals depending on the length of the grafted polymer chain. When N is small, PGNPs behave like hard spheres. The crystals formed are arranged in FCC/HCP structure, much like the phase transition observed in an Alder transition. When N is large enough, the increase in the free energy of grafted polymers can no longer be neglected. Thus, the crystals formed in these systems are arranged in BCC structure, which has a lower density than FCC/HCP. When N is not too small or large, FCC/HCP structures are observed when the concentration of PGNPs is low, but a phase transition occurs when the concentration of PGNPs becomes higher with the compression of the system. Again, the increase in free energy of grafted polymers can no longer be neglected and the crystals arrange themselves in a BCC structure. Also, it can be revealed that the lattice spacing of PGNP crystals can be controlled easily and widely by the chain length. These results should play an important role in many future simulations and experimental studies of PGNP crystals.


title: Knowledge Engineering in the Long Game of Artificial Intelligence: The Case of Speech Acts

abstract: This paper describes principles and practices of knowledge engineering that enable the development of holistic language-endowed intelligent agents that can function across domains and applications, as well as expand their ontological and lexical knowledge through lifelong learning. For illustration, we focus on dialog act modeling, a task that has been widely pursued in linguistics, cognitive modeling, and statistical natural language processing. We describe an integrative approach grounded in the OntoAgent knowledge-centric cognitive architecture and highlight the limitations of past approaches that isolate dialog from other agent functionalities.


title: Cyclic sums of comparative indices and their applications

abstract: In this paper we generalize the notion of the comparative index for the pair of Lagrangian subspaces which has fundamental applications in oscillation theory of symplectic difference systems and linear differential Hamiltonian systems. We introduce cyclic sums $\mu_c^{\pm}(Y_1,Y_2,\dots,Y_m),\,m\ge 2$ of the comparative indices for the set of $n-$ dimensional Lagrangian subspaces. We formulate and prove main properties of the cyclic sums, in particular, we state connections of the cyclic sums with the Kashiwara index. The main results of the paper connect the cyclic sums of the comparative indices with the number of positive and negative eigenvalues of $mn\times mn$ symmetric matrices defined in terms of the Wronskians $Y_i^T \,J\, Y_j,$ $i,j=1,\dots,m.$ We also present first applications of the cyclic sums of the comparative indices in the oscillation theory of the discrete symplectic systems connecting the number of focal points of their principal solutions with the negative and positive inertia of symmetric matrices.


title: Machine Learning for Exploring Small Polaron Configurational Space

abstract: Polaron defects are ubiquitous in materials and play an important role in many processes involving carrier mobility, charge transfer and surface reactivity. Determining the spatial distribution of small polarons is essential to understand materials properties and functionalities. This requires an exploration of the configurational space, which is computationally demanding when using standard first principles methods, and technically prohibitive for many-polaron systems. Here, we propose a machine-learning (ML) accelerated search that compares the energy stability of different polaron patterns and determines the ground state configuration. The kernel-regression based ML model is trained on databases generated by density functional theory (DFT) calculations on a minimal set of initial polaron patterns, obtained by using either molecular dynamics simulations or a random sampling approach. To establish an efficient mapping between training data and configuration stability we designed simple descriptors that model the interactions among polarons and charged point defects. The proposed DFT+ML protocol is used here to explore millions of polaron configurations for two different systems, oxygen defective rutile TiO$_2$(110) and Nb-doped SrTiO$_3$(001). Our data shows that the ML-aided search correctly individuates the ground-state polaron patterns, proposes polaronic configurations not visited in the training and can be used to efficiently determine the optimal distribution of polarons at any charge concentration.


title: 2T-POT Hawkes model for left- and right-tail conditional quantile forecasts of financial log-returns: out-of-sample comparison of conditional EVT models

abstract: Conditional extreme value theory (EVT) methods promise enhanced forecasting of the extreme tail events that often dominate systemic risk. We present an improved two-tailed peaks-over-threshold (2T-POT) Hawkes model that is adapted for conditional quantile forecasting in both the left and right tails of a univariate time series. This is applied to the daily log-returns of six large cap indices. We also take the unique step of fitting the model at multiple exceedance thresholds (from the 1.25% to 25.00% mirrored quantiles). Quantitatively similar asymmetries in Hawkes parameters are found across all six indices, adding further empirical support to a temporal leverage effect in financial price time series in which the impact of losses is not only larger but also more immediate. Out-of-sample backtests find that our 2T-POT Hawkes model is more reliably accurate than the GARCH-EVT model when forecasting (mirrored) value-at-risk and expected shortfall at the 5% coverage level and below. This suggests that asymmetric Hawkes-type arrival dynamics are a better approximation of the true data generating process for extreme daily log-returns than GARCH-type conditional volatility; our 2T-POT Hawkes model therefore presents a better performing alternative for financial risk modelling.


title: Spectral Rank Monotonicity on Undirected Networks

abstract: We study the problem of score and rank monotonicity for spectral ranking methods, such as eigenvector centrality and PageRank, in the case of undirected networks. Score monotonicity means that adding an edge increases the score at both ends of the edge. Rank monotonicity means that adding an edge improves the relative position of both ends of the edge with respect to the remaining nodes. It is known that common spectral rankings are both score and rank monotone on directed, strongly connected graphs. We show that, surprisingly, the situation is very different for undirected graphs, and in particular that PageRank is neither score nor rank monotone.


title: Metrics for Evaluating Social Conformity of Crowd Navigation Algorithms

abstract: Recent protocols and metrics for training and evaluating autonomous robot navigation through crowds are inconsistent due to diversified definitions of "social behavior". This makes it difficult, if not impossible, to effectively compare published navigation algorithms. Furthermore, with the lack of a good evaluation protocol, resulting algorithms may fail to generalize, due to lack of diversity in training. To address these gaps, this paper facilitates a more comprehensive evaluation and objective comparison of crowd navigation algorithms by proposing a consistent set of metrics that accounts for both efficiency and social conformity, and a systematic protocol comprising multiple crowd navigation scenarios of varying complexity for evaluation. We tested four state-of-the-art algorithms under this protocol. Results revealed that some state-of-the-art algorithms have much challenge in generalizing, and using our protocol for training, we were able to improve the algorithm's performance. We demonstrate that the set of proposed metrics provides more insight and effectively differentiates the performance of these algorithms with respect to efficiency and social conformity.


title: Towards High-Payload Admittance Control for Manual Guidance with Environmental Contact

abstract: Force control enables hands-on teaching and physical collaboration, with the potential to improve ergonomics and flexibility of automation. Established methods for the design of compliance, impedance control, and \rev{collision response} can achieve free-space stability and acceptable peak contact force on lightweight, lower payload robots. Scaling collaboration to higher payloads can allow new applications, but introduces challenges due to the more significant payload dynamics and the use of higher-payload industrial robots. To achieve high-payload manual guidance with contact, this paper proposes and validates new mechatronic design methods: standard admittance control is extended with damping feedback, compliant structures are integrated to the environment, and a contact response method which allows continuous admittance control is proposed. These methods are compared with respect to free-space stability, contact stability, and peak contact force. The resulting methods are then applied to realize two contact-rich tasks on a 16 kg payload (peg in hole and slot assembly) and free-space co-manipulation of a 50 kg payload.


title: Fractional double phase Robin problem involving variable order-exponents and Logarithm-type nonlinearity

abstract: In this paper, we study the existence of solutions for the new fractinal Robin equations with variable exponents. Moreover, we deal with the logarithm-type nonlinearity. In particular, we consider two cases: critical and subcritical cases.


title: A cubical Rips construction

abstract: Given a finitely presented group $Q$ and a compact special cube complex $X$ with non-elementary hyperbolic fundamental group, we produce a non-elementary, torsion-free, cocompactly cubulated hyperbolic group $\Gamma$ that surjects onto $Q$, with kernel isomorphic to a quotient of $G=\pi_1 X$ and such that $max\{cd(G),2\}\geq cd(\Gamma)\geq cd(G)-1$.


title: How two-way coupling modifies the multiscale preferential sweeping mechanism

abstract: For one-way coupled (1WC) flows, Tom & Bragg (J. Fluid Mech., 871, pp. 244-270, 2019) advanced the analysis of Maxey (J. Fluid Mech., 174, pp. 441-465, 1987), which applied to weakly inertial particles, to particles of arbitrary inertia, and the new theoretical result revealed the role that different scales play in the preferential sweeping mechanism that leads to enhanced particle settling in turbulent flows. Monchaux & Dejoan (Phys. Rev. Fluids, 2, 104302, 2017) showed using direct numerical simulations (DNS) that while for low particle loading the effect of two-way coupling (2WC) on the global flow statistics is weak, 2WC enables the particles to drag the fluid in their vicinity down with them, significantly enhancing their settling, and they argued that 2WC suppresses the preferential sweeping mechanism. We explore this further by considering the impact of 2WC on the contribution made by eddies of different sizes on the particle settling. In agreement with Monchaux & Dejoan, we show that even for low loading, 2WC strongly enhances particle settling, and we show how 2WC modifies the contribution from different flow scales. However, contrary to their study, we show that preferential sweeping remains important in 2WC flows. In particular, for both 1WC and 2WC flows, the settling enhancement due to turbulence is dominated by contributions from particles in straining regions of the flow, but for the 2WC case, the particles in these regions also drag the fluid down with them, leading to an enhancement of their settling compared to the 1WC case.


title: Optical detection of long electron spin transport lengths in a monolayer semiconductor

abstract: Using a spatially-resolved optical pump-probe experiment, we measure the lateral transport of spin/valley polarized electrons over very long distances (tens of micrometers) in a single WSe2 monolayer. By locally pumping the Fermi sea of 2D electrons to a high degree of spin/valley polarization (up to 75%) using circularly-polarized light, the lateral diffusion of the electron polarization can be mapped out via the photoluminescence induced by a spatially-separated and linearly-polarized probe laser. Up to 25% spin-valley polarization is observed at pump-probe separations up to 20 microns. Characteristic spin/valley diffusion lengths of 18 +/- 3 um are revealed at low temperatures. The dependence on temperature, pump helicity, pump intensity, and electron density highlight the key roles played by spin relaxation time and pumping efficiency on polarized electron transport in monolayer semiconductors possessing spin-valley locking.


title: Element selection for functional materials discovery by integrated machine learning of elemental contributions to properties

abstract: Fundamental differences between materials originate from the unique nature of their constituent chemical elements. Before specific differences emerge according to the precise ratios of elements in a given crystal structure, a material can be represented by the set of its constituent chemical elements. By working at the level of the periodic table, assessment of materials at the level of their phase fields reduces the combinatorial complexity to accelerate screening, and circumvents the challenges associated with composition-level approaches such as poor extrapolation within phase fields, and the impossibility of exhaustive sampling. This early stage discrimination combined with evaluation of novelty of phase fields aligns with the outstanding experimental challenge of identifying new areas of chemistry to investigate, by prioritising which elements to combine in a reaction. Here, we demonstrate that phase fields can be assessed with respect to the maximum expected value of a target functional property and ranked according to chemical novelty. We develop and present PhaseSelect, an end-to-end machine learning model that combines the representation, classification, regression and ranking of phase fields. First, PhaseSelect constructs elemental characteristics from the co-occurrence of chemical elements in computationally and experimentally reported materials, then it employs attention mechanisms to learn representation for phase fields and assess their functional performance. At the level of the periodic table, PhaseSelect quantifies the probability of observing a functional property, estimates its value within a phase field and also ranks a phase field novelty, which we demonstrate with significant accuracy for three avenues of materials applications for high-temperature superconductivity, high-temperature magnetism, and targeted bandgap energy.


title: $\ell$-away ACM Bundles on Fano Surfaces

abstract: We propose the definition of $\ell$-away ACM bundle on a polarized variety $(X, \mathcal{O}_{X}(h))$. Then we give constructions of $\ell$-away ACM bundles on $(\mathbb{P}^2 , \mathcal{O}_{\mathbb{P}^2}(1))$, $(\mathbb{P}^1 \times \mathbb{P}^1, \mathcal{O}_{\mathbb{P}^1 \times \mathbb{P}^1}(1,1))$ and the anticanonically polarized blow up of $\mathbb{P}^2$ up to three non collinear points. Also, we give the complete classification of $\ell$-away ACM bundles $\mathcal{E}$ of rank 2 for values $1 \leq \ell \leq 2$ on $(\mathbb{P}^2 , \mathcal{O}_{\mathbb{P}^2}(1))$. Similarly, on $(\mathbb{P}^1 \times \mathbb{P}^1, \mathcal{O}_{\mathbb{P}^1 \times \mathbb{P}^1}(1,1))$, we give such a classification if $\mathrm{det}(\mathcal{E}) = \mathcal{O}_{\mathbb{P}^1 \times \mathbb{P}^1}(a,a)$ for some $a \in \mathbb{Z}$. Moreover, we prove that the corresponding graded module $\mathrm{H}_*^1 ( \mathcal{E}) = \underset{{t \in \mathbb{Z} }}{\bigoplus} \mathrm{H}^1 (\mathcal{E} (th))$ is connected, extending the similar result for bundles on $\mathbb{P}^2$.


title: Square cylinder in the interface of two different-velocity streams

abstract: We investigate the incompressible flow past a square cylinder immersed in the wake of an upstream nearby splitter plate separating two streams of different velocity. The bottom stream Reynolds number, based on the square side, $Re_B=56$ is kept constant while the top-to-bottom Reynolds numbers ratio $R\equiv Re_T/Re_B$ is increased in the range $R\in[1,6.5]$, corresponding to a coupled variation of the bulk Reynolds number $Re\equiv(Re_T+Re_B)/2\in[56,210]$ and an {\it equivalent} nondimensional shear parameter $K\equiv2(R-1)/(R+1)\in[0,1.4667]$. The onset of vortex-shedding, at $R=2.1\pm0.1$ (corresponding to $Re=86.8\pm2.8$, $K=0.71\pm0.04$), is pushed to higher $Re$ as compared to the square cylinder in the classic configuration. The advent of three-dimensionality is triggered by a mode-C-type instability at $R\simeq3.1$ ($Re\simeq115$, $K\simeq1.02$) with wavelength $\lambda_z\simeq2.4$, much as reported for open circular rings and square cylinders placed at an incidence. The resulting solution is period-doubled and exhibits a triad of spanwise symmetries: a mirror reflection and two spatiotemporal symmetries involving the evolution by half a period (two vortex-shedding cycles) followed by either specular reflection or a half-wavelength shift. The path towards spatio-temporal chaos is initiated thereafter with a modulational period-doubling tertiary bifurcation at $R\in(3.4,3.8)$ that also doubles the spanwise periodicity. The ensuing nonlinear solution repeats only after four vortex shedding periods and retains only a spatiotemporal invariance consisting in the evolution by half a period (two vortex-shedding cycles) followed by mirror reflection about a streamwise-cross-stream plane. At slighlty higher values of $R\geq4$, the flow has become spatio-temporally chaotic, but the main features of mode C are still clearly distinguishable.


title: Improved quantum algorithms for linear and nonlinear differential equations

abstract: We present substantially generalized and improved quantum algorithms over prior work for inhomogeneous linear and nonlinear ordinary differential equations (ODE). Specifically, we show how the norm of the matrix exponential characterizes the run time of quantum algorithms for linear ODEs opening the door to an application to a wider class of linear and nonlinear ODEs. In Berry et al., (2017), a quantum algorithm for a certain class of linear ODEs is given, where the matrix involved needs to be diagonalizable. The quantum algorithm for linear ODEs presented here extends to many classes of non-diagonalizable matrices. The algorithm here is also exponentially faster than the bounds derived in Berry et al., (2017) for certain classes of diagonalizable matrices. Our linear ODE algorithm is then applied to nonlinear differential equations using Carleman linearization (an approach taken recently by us in Liu et al., (2021)). The improvement over that result is two-fold. First, we obtain an exponentially better dependence on error. This kind of logarithmic dependence on error has also been achieved by Xue et al., (2021), but only for homogeneous nonlinear equations. Second, the present algorithm can handle any sparse, invertible matrix (that models dissipation) if it has a negative log-norm (including non-diagonalizable matrices), whereas Liu et al., (2021) and Xue et al., (2021) additionally require normality.


title: Nonlinear deformation and elasticity of BCC refractory metals and alloys

abstract: Application of isotropic pressure or uniaxial strain alters the elastic properties of materials; sufficiently large strains can drive structural transformations. Linear elasticity describes stability against infinitesimal strains, while nonlinear elasticity describes the response to finite deformations. It was previously shown that uniaxial strain along [100] drives refractory metals and alloys towards mechanical instabilities. These include an extensional instability, and a symmetry-breaking orthorhombic distortion caused by a Jahn-Teller-Peierls instability that splays the cubic lattice vectors. Here, we analyze these transitions in depth. Eigenvalues and eigenvectors of the Wallace tensor identify and classify linear instabilities in the presence of strain. We show that both instabilities are discontinuous, leading to discrete jumps in the lattice parameters. We provide physical intuition for the instabilities by analyzing the changes in first principles energy, stress, bond lengths and angles upon application of strain. Electronic band structure calculations show differential occupation of bonding and anti-bonding orbitals, driven by the changing bond lengths and leading to the structural transformations. Strain thresholds for these instabilities depend on the valence electron count.


title: Analysis of the size of Solar system close to the state with zero total angular momentum via Sundman inequality

abstract: In this paper, we present a new mathematical approach or solving procedure for analysis of the Sundman inequality (for estimating the moment of inertia of the Solar system configuration) with the help of Lagrange-Jacobi relation, under additional assumption of decreasing of the total angular momentum close to the zero absolute magnitude in the final state of Solar system in a future. By assuming such the final state for Solar system, we have estimated the mean-size of Solar system R via analysis of the Sundman inequality. So, to answer the question "Does the ninth planet exist in Solar system?", one should meet the two mandatory criteria for such the ninth planet, first is that it should have the negligible magnitude of inclination of its orbit with respect to the invariable plane. The second condition is that the orbit of the ninth planet should be located within the estimation for the mean-size of Solar system R.


title: Rod-ring collision paradox

abstract: A new apparent relativistic paradox is presented involving only one space-time event. This is different from earlier relativistic paradoxes involving extended bodies or events at different positions. A collision between a rod and a ring impacting at an oblique angle to each other is considered in the context of the special theory relativity. A question arises as to where along the length of the rod the point of impact will be according to two observers following the rod and the ring, respectively. The observers argue from a purely kinematical point of view in favor of two different points of impact along the rod. However there can only exist one point of impact. In order to solve this apparent paradox we use the asynchronous formulation of relativistic kinematics in which the consequences of the relativity of simultaneity are built into the formalism. We show that this reconciles the descriptions from the two frames of reference, and hence that the new paradox leads to a strong argument for the relevance of the asynchronous formulation of relativistic kinematics.


title: Entropic extensivity and large deviations in the presence of strong correlations

abstract: The standard Large Deviation Theory (LDT) mirrors the Boltzmann-Gibbs (BG) factor which describes the thermal equilibrium of short-range Hamiltonian systems, the velocity distribution of which is Maxwellian. It is generically applicable to systems satisfying the Central Limit Theorem (CLT), among others. When we focus instead on stationary states of typical complex systems (e.g., classical long-range Hamiltonian systems), both the CLT and LDT need to be generalized. We focus here on a scale-invariant stochastic process involving strongly-correlated exchangeable random variables which, through the Laplace-de Finetti theorem, is known to yield a long-tailed $Q$-Gaussian $N\to\infty$ attractor in the space of distributions ($1 < Q<3)$. We present strong numerical indications that the corresponding LDT probability distribution is given by $P(N,z)=P_0\,e_q^{-r_q(z)N}=P_0[1-(1-q)r_q(z)N]^{1/(1-q)}$ with $q=2-1/Q \in (1,5/3)$. The rate function $r_q(z)$ seemingly equals the relative nonadditive $q_r$-entropy per particle, with $q_r \simeq \frac{7}{10} + \frac{6}{10}\frac{1}{Q-1}$, thus exhibiting a singularity at $Q=1$ and recovering the BG value $q_r=1$ in the $Q \to 3$ limit. Let us emphasize that the extensivity of $r_q(z)N$ appears to be verified, consistently with what is expected, from the Legendre structure of thermodynamics, for a total entropy. The present analysis of a relatively simple model somewhat mirroring spin-1/2 long-range-interacting ferromagnets (e.g., with strongly anisotropic XY coupling) might be helpful for a deeper understanding of nonequilibrium systems with global correlations and other complex systems.


title: PINNs and GaLS: A Priori Error Estimates for Shallow Physics Informed Neural Networks Applied to Elliptic Problems

abstract: Physics Informed Neural Networks (PINNs) have recently gained popularity for solving partial differential equations, given the fact they escape the curse of dimensionality. In this paper, we present Physics Informed Neural Networks as an underdetermined point matching collocation method then expose the connection between Galerkin Least Square (GALS) and PINNs, to develop an a priori error estimate, in the context of elliptic problems. In particular, techniques that belong to the realm of least square finite elements and Rademacher complexity analysis are used to obtain the error estimate.


title: The Schwarzschild black hole in f(R) can exist superradiation phenomenon

abstract: For the relationship of the limit $y$ of the incident particle under the superradiance of the preset boundary (${\mu} = {y}{\omega}$),we find the relationship between black hole thermodynamics and superradiation, and use boundary conditions to establish the relationship between y and R. One of the modes under f(R) gravity,there is a possible solution.When r tends to infinity, as a coordinate transformation, y tends to 0. At that time, there is a potential barrier near the event horizon, that is, the Schwarzschild black hole under f(R) gravitation has superradiation at that time.


title: A Direct Proof of the 2nd Atiyah-Sutcliffe Conjecture for Convex Quadrilaterals

abstract: We present a direct proof of the second conjecture made by M. Atiyah and P. Sutcliffe for the case of convex quadrilaterals. Unlike previous work on this conjecture, our proof does not require any computer aided computations. The new proof relies on a new geometric inequality proved recently by the author.


title: Primes dividing values of a given Polynomial

abstract: Let $P(x) \in \mathbb{Z}[x]$ be a polynomial. We give an easy and new proof of the fact that the set of primes $p$ such that $p \mid P(n)$, for some $n \in \mathbb{Z}$, is infinite. We also get analog of this result for some special domains.


title: Ethical Considerations on Nanotechnology

abstract: Since a significant time ago, although time runs very fast,nanotechnology transformed from one of the most promising scientific hopes in uncountable human domains into a marvelous certainty. Innumerable scientific studies in several areas of knowledge were made since nanoscale emergence, carrying their contribution to the nanoscience development, leading to a great development of technical and scientific knowledge but also raising numerous problems in the ethical field. In this work, nanotechnology is discussed both in terms of ethics and in terms of borders that nanotechnology applications must satisfy and concluding notes are presented, highlighting the results of the analysis. Significant considerations are made on the close connection between ethics and the nanotechnology and the effects over the society and values.


title: A Dynamical Systems Framework for Generating the Riemann Zeta Function and Dirichlet L-functions

abstract: We first construct a dynamical systems model which in its steady-state serves as an analytic continuation of the completed Riemann zeta function over the entire critical strip. The resulting mathematical construct involves a linear interpolation of two symmetric generator functions which can be used to infer the global properties of the non-trivial zeros of the Riemann zeta function using concentration bounds. The proposed dynamical systems framework thus provides an alternative method for investigating the celebrated Riemann Hypothesis which is shown in this paper to be almost surely true. We also show that the framework is general enough to study the non-trivial zeros of the Dirichlet L-functions and in this paper we show that under specific conditions, the generalized Riemann Hypothesis is also almost surely true.


title: Direct observation of the perpendicular shape anisotropy and thermal stability of p-STT-MRAM nano-pillars

abstract: Perpendicular shape anisotropy (PSA) offers a practical solution to downscale spin-transfer torque Magnetic Random-Access Memory (STT-MRAM) beyond the sub-20 nm technology node whilst retaining thermal stability of the storage layer magnetization. However, our understanding of the thermomagnetic behavior of PSA-STT-MRAM is often indirect, relying on magnetoresistance measurements and micromagnetic modelling. Here, the magnetism of a FeCoB / NiFe PSA-STT-MRAM nano-pillar is investigated using off-axis electron holography, providing spatially resolved magnetic information as a function of temperature, which has been previously inaccessible. Magnetic induction maps reveal the micromagnetic configuration of the NiFe storage layer (60 nm high, 20 nm diameter), confirming the PSA induced by its 3:1 aspect ratio. In-situ heating demonstrates that the PSA of the FeCoB / NiFe composite storage layer is maintained up to at least 250 degrees centigrade, and direct quantitative measurements reveal the very moderate decrease of magnetic induction with temperature. Hence, this study shows explicitly that PSA provides significant stability in STT-MRAM applications that require reliable performance over a range of operating temperatures.


title: Point-Set Topology

abstract: This is a review of the fundamental concepts of general topology.


title: A generalization of Kannan and Fisher fixed point theorems with an application to Volterra type integral equations

abstract: In this paper, we discuss about the independent types of infinite extensions to a general version of Kannan [5] and Fisher [3] of which the well-known Kannan and Fisher theorems come as a corollaries. We also provide a strong connection between continuous Kannan operator and Fisher operator in a restricted type of metric space. We also provide an application of the main theorem of this paper, in the field of integral equations.


title: Searching exotic Higgs bosons at the LHC

abstract: We analyse in a model independent way the possibilities of digging out neutral exotic Higgs states, should they exist endowed with unconventional couplings with ordinary matter and gauge fields, at the 14 TeV run of the Large Hadron Collider (LHC), adding some comparative studies for 13.6 and 13 TeV runs. Flavor models, based on some discrete symmetry groups, with extended scalar sectors are known to yield exotic spin-0 states, both CP-even and CP-odd, with purely flavor off-diagonal Yukawa couplings. The gauge interaction of one such CP-even state is also unusual that, unlike the Standard Model Higgs boson, it does not couple to gauge boson pairs. Such unconventional properties immune these exotic states from receiving traditional collider and electroweak constraints, and hence those states could be light. Without committing to any specific model, exploiting their peculiar Yukawa and gauge properties, we explore the discovery potential of those exotic Higgs states through some interesting topologies by figuring out some specific kinematic variables that suppress the backgrounds.


title: Image-based Navigation in Real-World Environments via Multiple Mid-level Representations: Fusion Models, Benchmark and Efficient Evaluation

abstract: Navigating complex indoor environments requires a deep understanding of the space the robotic agent is acting into to correctly inform the navigation process of the agent towards the goal location. In recent learning-based navigation approaches, the scene understanding and navigation abilities of the agent are achieved simultaneously by collecting the required experience in simulation. Unfortunately, even if simulators represent an efficient tool to train navigation policies, the resulting models often fail when transferred into the real world. One possible solution is to provide the navigation model with mid-level visual representations containing important domain-invariant properties of the scene. But, what are the best representations that facilitate the transfer of a model to the real-world? How can they be combined? In this work we address these issues by proposing a benchmark of Deep Learning architectures to combine a range of mid-level visual representations, to perform a PointGoal navigation task following a Reinforcement Learning setup. All the proposed navigation models have been trained with the Habitat simulator on a synthetic office environment and have been tested on the same real-world environment using a real robotic platform. To efficiently assess their performance in a real context, a validation tool has been proposed to generate realistic navigation episodes inside the simulator. Our experiments showed that navigation models can benefit from the multi-modal input and that our validation tool can provide good estimation of the expected navigation performance in the real world, while saving time and resources. The acquired synthetic and real 3D models of the environment, together with the code of our validation tool built on top of Habitat, are publicly available at the following link: https://iplab.dmi.unict.it/EmbodiedVN/


title: An infinitary Zero sum theorem

abstract: Erd\H{o}s-Ginzburg-Ziv theorem says that if there are 2n-1 number is given, then there are n numbers such that their sum is divided by n. We will connect this theorem with the Ramsey theoretic large sets and will prove an infinitary version of this theorem. In our proof we will use the methods of ultrafilters. But one may proceed using methods of Topological dynamics.


title: Autocorrelation of the Mobius Function

abstract: Let $x\geq 1$ be a large integer, and let $\mu:\mathbb{N}\longrightarrow\{-1,0,1\}$ be the Mobius function. This article proposes an effective asymptotic result for the autocorrelation function $\sum_{n \leq x} \mu(n) \mu(n+t) =O\left( e^{-c\sqrt{\log x}}\right) $, where $t\ne 0$ be a small fixed integer, and $c>0$ is a constant.


title: Interpretability for Multimodal Emotion Recognition using Concept Activation Vectors

abstract: Multimodal Emotion Recognition refers to the classification of input video sequences into emotion labels based on multiple input modalities (usually video, audio and text). In recent years, Deep Neural networks have shown remarkable performance in recognizing human emotions, and are on par with human-level performance on this task. Despite the recent advancements in this field, emotion recognition systems are yet to be accepted for real world setups due to the obscure nature of their reasoning and decision-making process. Most of the research in this field deals with novel architectures to improve the performance for this task, with a few attempts at providing explanations for these models' decisions. In this paper, we address the issue of interpretability for neural networks in the context of emotion recognition using Concept Activation Vectors (CAVs). To analyse the model's latent space, we define human-understandable concepts specific to Emotion AI and map them to the widely-used IEMOCAP multimodal database. We then evaluate the influence of our proposed concepts at multiple layers of the Bi-directional Contextual LSTM (BC-LSTM) network to show that the reasoning process of neural networks for emotion recognition can be represented using human-understandable concepts. Finally, we perform hypothesis testing on our proposed concepts to show that they are significant for interpretability of this task.


title: Photochemical Anisotropy and Direction-dependent Optical Absorption in Semiconductors

abstract: Photochemical reactions on semiconductors are anisotropic, since they occur with different rates on surfaces of different orientation. Understanding the origin of this anisotropy is crucial to engineering more efficient photocatalysts. In this work, we use hybrid density functional theory (DFT) to identify the surfaces associated with the largest number of photo-generated carriers in different semiconductors. For each material we create a spherical heat map of the probability of optical transitions at different wave vectors. These maps allow to identify the directions associated with the majority of the photo-generated carriers and can thus be used to make predictions about the most reactive surfaces for photochemical applications. Results indicate that it is generally possible to correlate the heat maps with the anisotropy of the bands observed in conventional band-structure plots, as previously suggested. However, we also demonstrate that conventional bands-structure plots do not always provide all the informations and that taking into account the contribution of all possible transitions weighted by their transition dipole moments is crucial to obtain a complete picture.


title: Proton-PDF uncertainties in extracting nuclear PDFs from $W^\pm$ production in p+Pb collisions

abstract: We discuss the recent CMS Collaboration measurement of $W^\pm$ boson production in p+Pb collisions at 8.16 TeV in terms of the constraining power on nuclear parton distribution functions (PDFs). The impact of the free-proton PDF uncertainties on the nuclear PDF extraction is quantified by using a theoretical covariance-matrix method and Hessian PDF reweighting. We discuss different ways to mitigate these theoretical uncertainties, including self-normalization, forward-to-backward ratios and nuclear-modification ratios. It is found that none of these methods offer perfect cancellation of the free-proton PDFs but, with the present data uncertainties, the residual free-proton-PDF dependence has, conveniently for the global analyses, little effect on the extraction of the nuclear modifications. Based on a simple estimate of obtainable statistics at the LHC Run 3, we argue that this will change in the near future and it becomes more important to propagate the proton-PDF uncertainties accordingly. Using the obtained information on the correlations of the free-proton uncertainties, we also identify a new charge asymmetry ratio, where the cancellation of the proton-PDF uncertainties is found to be extremely good.


title: Importance of accurate consideration of the electron inertia in hybrid-kinetic simulations of collisionless plasma turbulence: 1. The 2D limit

abstract: The dissipation mechanism of the magnetic energy in turbulent collisionless space and astrophysical plasmas is still not well understood. Its investigation requires efficient kinetic simulations of the energy transfer in collisionless plasma turbulence. In this respect, hybrid-kinetic simulations, in which ions are treated as particles and electrons as an inertial fluid, have begun to attract a significant interest recently. Hybrid-kinetic models describe both ion- and electron scale processes by ignoring electron kinetic effects so that they are computationally much less demanding compared to fully kinetic plasma models. Hybrid-kinetic codes solve either the Vlasov equation for the ions (Eulerian Vlasov-hybrid codes) or the equations of motion of the ions as macro-particles (Lagrangian Particle-in-Cell (PIC)-hybrid codes). They consider the inertia of the electron fluid using different approximations. We check the validity of these approximations by employing our recently massively parallelized three-dimensional PIC-hybrid code CHIEF which considers the electron inertia without any of the common approximations. In particular we report the results of simulations of two-dimensional collisionless plasma turbulence. We conclude that the simulation results obtained using hybrid-kinetic codes which use approximations to describe the electron inertia need to be interpreted with caution. We also discuss the parallel scalability of CHIEF, to the best of our knowledge, the first PIC-hybrid code which without approximations describes the inertial electron fluid.


title: Quantum tunneling in graphene Corbino disk in a solenoid magnetic potential with wedge disclination

abstract: We investigate the wedge disclination effect on quantum tunneling of a Corbino disk in gapped-graphene of inner $R_1$ and outer $R_2$ radii in the presence of magnetic flux $\Phi_i$. We solve Dirac equation for different regions and obtain the solutions of energy spectrum in terms of Hankel functions. The asymptotic behaviors for large arguments allow us to determine the transmission, Fano factor and conductance. We establish the case where the crystal symmetry is modified locally by replacing a hexagon by pentagon, square, heptagon or octagon. We show that the wedge disclination $n$ modifies the amplitude of transmission oscillations. We find that the period of Fano factor oscillations is of the Aharonov-Bohm type, which strongly depends on $n$ where intense peaks are observed. As another result, $n$ changes the minimum and period of conductance oscillations of the Aharonov-Bohm type. We show that $n$ minimizes the effect of resonance and decreases the amplitude of conductance magnitude $\Delta G$ oscillations.


title: Experimental Investigation of Trust in Anthropomorphic Agents as Task Partners

abstract: This study investigated whether human trust in a social robot with anthropomorphic physicality is similar to that in an AI agent or in a human in order to clarify how anthropomorphic physicality influences human trust in an agent. We conducted an online experiment using two types of cognitive tasks, calculation and emotion recognition tasks, where participants answered after referring to the answers of an AI agent, a human, or a social robot. During the experiment, the participants rated their trust levels in their partners. As a result, trust in the social robot was basically neither similar to that in the AI agent nor in the human and instead settled between them. The results showed a possibility that manipulating anthropomorphic features would help assist human users in appropriately calibrating trust in an agent.


title: Melody Extraction from Polyphonic Music by Deep Learning Approaches: A Review

abstract: Melody extraction is a vital music information retrieval task among music researchers for its potential applications in education pedagogy and the music industry. Melody extraction is a notoriously challenging task due to the presence of background instruments. Also, often melodic source exhibits similar characteristics to that of the other instruments. The interfering background accompaniment with the vocals makes extracting the melody from the mixture signal much more challenging. Until recently, classical signal processing-based melody extraction methods were quite popular among melody extraction researchers. The ability of the deep learning models to model large-scale data and the ability of the models to learn automatic features by exploiting spatial and temporal dependencies inspired many researchers to adopt deep learning models for melody extraction. In this paper, an attempt has been made to review the up-to-date data-driven deep learning approaches for melody extraction from polyphonic music. The available deep models have been categorized based on the type of neural network used and the output representation they use for predicting melody. Further, the architectures of the 25 melody extraction models are briefly presented. The loss functions used to optimize the model parameters of the melody extraction models are broadly categorized into four categories and briefly describe the loss functions used by various melody extraction models. Also, the various input representations adopted by the melody extraction models and the parameter settings are deeply described. A section describing the explainability of the block-box melody extraction deep neural networks is included. The performance of 25 melody extraction methods is compared. The possible future directions to explore/improve the melody extraction methods are also presented in the paper.


title: AlphaDesign: A graph protein design method and benchmark on AlphaFoldDB

abstract: While DeepMind has tentatively solved protein folding, its inverse problem -- protein design which predicts protein sequences from their 3D structures -- still faces significant challenges. Particularly, the lack of large-scale standardized benchmark and poor accuray hinder the research progress. In order to standardize comparisons and draw more research interest, we use AlphaFold DB, one of the world's largest protein structure databases, to establish a new graph-based benchmark -- AlphaDesign. Based on AlphaDesign, we propose a new method called ADesign to improve accuracy by introducing protein angles as new features, using a simplified graph transformer encoder (SGT), and proposing a confidence-aware protein decoder (CPD). Meanwhile, SGT and CPD also improve model efficiency by simplifying the training and testing procedures. Experiments show that ADesign significantly outperforms previous graph models, e.g., the average accuracy is improved by 8\%, and the inference speed is 40+ times faster than before.


title: Understanding European Integration with Bipartite Networks of Comparative Advantage

abstract: Core objectives of European common market integration are convergence and economic growth, but these are hampered by redundancy, and value chain asymmetries. The challenge is how to harmonize labor division to reach global competitiveness, meanwhile bridging productivity differences across the EU. We develop a bipartite network approach to trace pairwise co-specialization, by applying the Revealed Comparative Advantage method, within and between EU15 and Central and Eastern European (CEE). This approach assesses redundancies and division of labor in the EU at the level of industries and countries. We find significant co-specialization among CEE countries but a diverging specialization between EU15 and CEE. Productivity increases in those CEE industries that have co-specialized with other CEE countries after EU accession, while co-specialization across CEE and EU15 countries is less related to productivity growth. These results show that a division of sectoral specialization can lead to productivity convergence between EU15 and CEE countries.


title: The interplay between compact and molecular structures in tetraquarks

abstract: Due to the cluster reducibility of multiquark operators, a strong interplay exists in tetraquarks between the compact structure, resulting from the direct confining forces acting on quarks and gluons, and the molecular structure, dominated by the mesonic clusters. This issue is studied within an effective field theory approach, where the compact tetraquark is treated as an elementary particle. The key ingredient of the analysis is provided by the primary coupling constant of the compact tetraquark to the two mesonic clusters. Under the influence of this coupling, an initially formed compact tetraquark bound state evolves towards a new structure, where a molecular configuration is also present. In the strong-coupling limit, the evolution may end with a shallow bound state of the molecular type. The strong-coupling regime is also favored by the large-$N_c$ properties of QCD. The interplay between compact and molecular structures may provide a natural explanation of the existence of many shallow bound states.


title: Combining N3LO QCD calculations and parton showers for hadronic collision events

abstract: Detailed and precise background predictions are the backbone of large parts of high-energy collider phenomenology. This requires to embed precision QCD calculations into detailed event generators, to produce comprehensive software simulations. Only continued progress in this direction will allow us to exploit the full potential of measurements at the Large Hadron Collider, or at a future Electron-Ion Collider. This work presents a method to combine third-order QCD calculations for hadronic scattering processes with Monte-Carlo event generators, thus enabling a new generation of precision predictions.


title: Control of Parasitism in Variational Integrators for Degenerate Lagrangian Systems

abstract: This paper deals with the control of parasitism in variational integrators for degenerate Lagrangian systems by writing them as general linear methods. This enables us to calculate their parasitic growth parameters which are responsible for the loss of long-time energy conservation properties of these algorithms. As a remedy and to offset the effects of parasitism, the standard projection technique is then applied to the general linear methods to numerically preserve the invariants of the degenerate Lagrangian systems by projecting the solution onto the desired manifold.


title: Towards a portable high-resolution muon detector based on Resistive Plate Chambers

abstract: The use of conventional imaging techniques becomes problematic when faced with challenging logistics and confined environments. In particular, such scenarios are not unusual in the field of archaeological and mining explorations as well as for nuclear waste characterization. For these applications, even the use of muography is complicated since the detectors have to be deployed in difficult areas with limited room for instrumentation, e.g., narrow tunnels. To address this limitation, we have developed a portable muon detector (muoscope) based on glass Resistive Plate Chambers (RPC) with an active area of 16 $\times$ 16 cm$^{2}$. The specific design goals taken into consideration while developing our first prototype are portability, robustness, autonomy, versatility, safety and low cost. To help further improve our design goals, we are currently studying the possibility to switch the sensitive units from strips in the old prototype to pixels for the new one However, for performing high resolution muography, the number of readout units per layer will also need to increase significantly, leading to increase in the overall cost and power consumption of the muoscope. To mitigate these issues, we are developing a novel 2D multiplexing algorithm for reading out several pixels with a single electronic channel. In this article, we give an overview of the detector development, focusing mainly on the design goals and the choice of detector technology. Furthermore, we present the details of the expected changes in the new prototype as well as a simulated 2D multiplexing study based on general principles.


title: Giga-scale Kernel Matrix Vector Multiplication on GPU

abstract: Kernel matrix-vector multiplication (KMVM) is a foundational operation in machine learning and scientific computing. However, as KMVM tends to scale quadratically in both memory and time, applications are often limited by these computational constraints. In this paper, we propose a novel approximation procedure coined \textit{Faster-Fast and Free Memory Method} ($\fthreem$) to address these scaling issues of KMVM for tall~($10^8\sim 10^9$) and skinny~($D\leq7$) data. Extensive experiments demonstrate that $\fthreem$ has empirical \emph{linear time and memory} complexity with a relative error of order $10^{-3}$ and can compute a full KMVM for a billion points \emph{in under a minute} on a high-end GPU, leading to a significant speed-up in comparison to existing CPU methods. We demonstrate the utility of our procedure by applying it as a drop-in for the state-of-the-art GPU-based linear solver FALKON, \emph{improving speed 1.5-5.5 times} at the cost of $<1\%$ drop in accuracy. We further demonstrate competitive results on \emph{Gaussian Process regression} coupled with significant speedups on a variety of real-world datasets.


title: How an $\omega_0$ condensate can spike the speed of sound in cold quarkyonic matter

abstract: I describe a novel mechanism where the variation of an $\omega_0$ condensate can generate a "spike" in the speed of sound in hadronic matter. An $\omega_0$ condensate naturally increases the speed of sound; the real problem is how to get the speed of sound to decrease. I suggest this can happen through the appearance of a Quantum Pion Liquid.


title: Communication Efficient Federated Learning for Generalized Linear Bandits

abstract: Contextual bandit algorithms have been recently studied under the federated learning setting to satisfy the demand of keeping data decentralized and pushing the learning of bandit models to the client side. But limited by the required communication efficiency, existing solutions are restricted to linear models to exploit their closed-form solutions for parameter estimation. Such a restricted model choice greatly hampers these algorithms' practical utility. In this paper, we take the first step to addressing this challenge by studying generalized linear bandit models under the federated learning setting. We propose a communication-efficient solution framework that employs online regression for local update and offline regression for global update. We rigorously proved, though the setting is more general and challenging, our algorithm can attain sub-linear rate in both regret and communication cost, which is also validated by our extensive empirical evaluations.


title: Status and perspectives of Continuous Gravitational Wave searches

abstract: The birth of gravitational wave astronomy was triggered by the first detection of a signal produced by the merger of two compact objects (also known as a compact binary coalescence event). The following detections made by the Earth-based network of advanced interferometers had a significant impact in many fields of science: astrophysics, cosmology, nuclear physics and fundamental physics. However, compact binary coalescence signals are not the only type of gravitational waves potentially detectable by LIGO, Virgo, and KAGRA. An interesting family of still undetected signals, and the ones that are considered in this review, are the so-called continuous waves, paradigmatically exemplified by the gravitational radiation emitted by galactic, fast-spinning isolated neutron stars with a certain degree of asymmetry in their mass distribution. In this work, I will review the status and the latest results from the analyses of advanced detector data, including searches for dark matter signatures.


title: Hypothesis-Driven Automated Experiment in Scanning Probe Microscopy: Exploring the Domain Growth Laws in Ferroelectric Materials

abstract: We report the development and implementation of a hypothesis learning based automated experiment, in which the microscope operating in the autonomous mode identifies the physical laws behind the material's response. Specifically, we explore the bias induced transformations that underpin the functionality of broad classes of devices and functional materials from batteries and memristors to ferroelectrics and antiferroelectrics. Optimization and design of these materials require probing the mechanisms of these transformations on the nanometer scale as a function of the broad range of control parameters such as applied potential and time, often leading to experimentally intractable scenarios. At the same time, often the behaviors of these systems are understood within potentially competing theoretical models, or hypotheses. Here, we develop a hypothesis list that covers the possible limiting scenarios for the domain growth, including thermodynamic, domain wall pinning, and screening limited. We further develop and experimentally implement the hypothesis driven automated experiment in Piezoresponse Force Microscopy, autonomously identifying the mechanisms of the bias induced domain switching. This approach can be applied for a broad range of physical and chemical experiments with relatively low dimensional control parameter space and for which the possible competing models of the system behavior that ideally cover the full range of physical eventualities are known or can be created. These include other scanning probe microscopy modalities such as force distance curve measurements and nanoindentation, as well as materials synthesis and optimization.


title: Exact gap-ratio results for mixed Wigner surmises of up to 4 eigenvalues

abstract: We compute some exact results for the gap-ratio of mixed Wigner surmises for up to four eigenvalues and $0\leq\beta\leq4$. The main results concern equal mixtures of the GOE, GUE, and GSE random matrix classes. These give rise to $2\times$GOE, $2\times$GUE, and $2\times$GSE~distributions. We find that $2\times$GOE, $2\times$GUE are well approximated by the surmises of only 2+2 eigenvalues that are GOE and GUE distributed, respectively. The same is not valid for $2\times$GSE, which is well estimated, by coincidence, by 2+2 eigenvalues of statistics intermediate between GUE and GSE.


title: Ergodic descriptors of nonergodic stochastic processes

abstract: The stochastic processes underlying the growth and stability of biological and psychological systems reveal themselves when far from equilibrium. Far from equilibrium, nonergodicity reigns. Nonergodicity implies that the average outcome for a group/ensemble (i.e., of representative organisms/minds) is not necessarily a reliable estimate of the average outcome for an individual over time. However, the scientific interest in causal inference suggests that we somehow aim at stable estimates of the cause that will generalize to new individuals in the long run. Therefore, the valid analysis must extract an ergodic stationary measure from fluctuating physiological data. So the challenge is to extract statistical estimates that may describe or quantify some of this nonergodicity (i.e., of the raw measured data) without themselves (i.e., the estimates) being nonergodic. We show that traditional linear statistics such as the standard deviation (SD), coefficient of variation (CV), and root mean square (RMS) can show nonstationarity, violating the ergodic assumption. Time series of statistics addressing sequential structure and its potential nonlinearity: fractality and multifractality, change in a time-independent way and fulfill the ergodic assumption. Complementing traditional linear indices with fractal and multifractal indices would empower the study of stochastic far-from-equilibrium biological and psychological dynamics.


title: The CORAL++ Algorithm for Unsupervised Domain Adaptation of Speaker Recogntion

abstract: State-of-the-art speaker recognition systems are trained with a large amount of human-labeled training data set. Such a training set is usually composed of various data sources to enhance the modeling capability of models. However, in practical deployment, unseen condition is almost inevitable. Domain mismatch is a common problem in real-life applications due to the statistical difference between the training and testing data sets. To alleviate the degradation caused by domain mismatch, we propose a new feature-based unsupervised domain adaptation algorithm. The algorithm we propose is a further optimization based on the well-known CORrelation ALignment (CORAL), so we call it CORAL++. On the NIST 2019 Speaker Recognition Evaluation (SRE19), we use SRE18 CTS set as the development set to verify the effectiveness of CORAL++. With the typical x-vector/PLDA setup, the CORAL++ outperforms the CORAL by 9.40% relatively on EER.


title: A weighted analysis to improve the X-ray polarization sensitivity of IXPE

abstract: IXPE is a Small Explorer mission that was launched at the end of 2021 to measure the polarization of X-ray emission from tens of astronomical sources. Its focal plane detectors are based on the Gas Pixel Detector, which measures the polarization by imaging photoelectron tracks in a gas mixture and reconstructing their initial directions. The quality of the single track, and then the capability of correctly determining the original direction of the photoelectron, depends on many factors, e.g., whether the photoelectron is emitted at low or high inclination with respect to the collection plane or the occurrence of a large Coulomb scattering close to the generation point. The reconstruction algorithm used by IXPE to obtain the photoelectron emission direction, also calculates several properties of the shape of the tracks which characterize the process. In this paper we compare several such properties and identify the best one to weight each track on the basis of the reconstruction accuracy. We demonstrate that significant improvement in sensitivity can be achieved with this approach and for this reason it will be the baseline for IXPE data analysis.


title: RescoreBERT: Discriminative Speech Recognition Rescoring with BERT

abstract: Second-pass rescoring is an important component in automatic speech recognition (ASR) systems that is used to improve the outputs from a first-pass decoder by implementing a lattice rescoring or $n$-best re-ranking. While pretraining with a masked language model (MLM) objective has received great success in various natural language understanding (NLU) tasks, it has not gained traction as a rescoring model for ASR. Specifically, training a bidirectional model like BERT on a discriminative objective such as minimum WER (MWER) has not been explored. Here we show how to train a BERT-based rescoring model with MWER loss, to incorporate the improvements of a discriminative loss into fine-tuning of deep bidirectional pretrained models for ASR. Specifically, we propose a fusion strategy that incorporates the MLM into the discriminative training process to effectively distill knowledge from a pretrained model. We further propose an alternative discriminative loss. This approach, which we call RescoreBERT, reduces WER by 6.6%/3.4% relative on the LibriSpeech clean/other test sets over a BERT baseline without discriminative objective. We also evaluate our method on an internal dataset from a conversational agent and find that it reduces both latency and WER (by 3 to 8% relative) over an LSTM rescoring model.


title: Minimizing Expected Intrusion Detection Time in Adversarial Patrolling

abstract: In adversarial patrolling games, a mobile Defender strives to discover intrusions at vulnerable targets initiated by an Attacker. The Attacker's utility is traditionally defined as the probability of completing an attack, possibly weighted by target costs. However, in many real-world scenarios, the actual damage caused by the Attacker depends on the \emph{time} elapsed since the attack's initiation to its detection. We introduce a formal model for such scenarios, and we show that the Defender always has an \emph{optimal} strategy achieving maximal protection. We also prove that \emph{finite-memory} Defender's strategies are sufficient for achieving protection arbitrarily close to the optimum. Then, we design an efficient \emph{strategy synthesis} algorithm based on differentiable programming and gradient descent.


title: Identifying Suitable Tasks for Inductive Transfer Through the Analysis of Feature Attributions

abstract: Transfer learning approaches have shown to significantly improve performance on downstream tasks. However, it is common for prior works to only report where transfer learning was beneficial, ignoring the significant trial-and-error required to find effective settings for transfer. Indeed, not all task combinations lead to performance benefits, and brute-force searching rapidly becomes computationally infeasible. Hence the question arises, can we predict whether transfer between two tasks will be beneficial without actually performing the experiment? In this paper, we leverage explainability techniques to effectively predict whether task pairs will be complementary, through comparison of neural network activation between single-task models. In this way, we can avoid grid-searches over all task and hyperparameter combinations, dramatically reducing the time needed to find effective task pairs. Our results show that, through this approach, it is possible to reduce training time by up to 83.5% at a cost of only 0.034 reduction in positive-class F1 on the TREC-IS 2020-A dataset.


title: Spectral and Energy Efficiency of DCO-OFDM in Visible Light Communication Systems with Finite-Alphabet Inputs

abstract: The bound of the information transmission rate of direct current biased optical orthogonal frequency division multiplexing (DCO-OFDM) for visible light communication (VLC) with finite-alphabet inputs is yet unknown, where the corresponding spectral efficiency (SE) and energy efficiency (EE) stems out as the open research problems. In this paper, we derive the exact achievable rate of {the} DCO-OFDM system with finite-alphabet inputs for the first time. Furthermore, we investigate SE maximization problems of {the} DCO-OFDM system subject to both electrical and optical power constraints. By exploiting the relationship between the mutual information and the minimum mean-squared error, we propose a multi-level mercury-water-filling power allocation scheme to achieve the maximum SE. Moreover, the EE maximization problems of {the} DCO-OFDM system are studied, and the Dinkelbach-type power allocation scheme is developed for the maximum EE. Numerical results verify the effectiveness of the proposed theories and power allocation schemes.