title: Restructuring Graph for Higher Homophily via Adaptive Spectral Clustering

abstract: While a growing body of literature has been studying new Graph Neural Networks (GNNs) that work on both homophilic and heterophilic graphs, little has been done on adapting classical GNNs to less-homophilic graphs. Although the ability to handle less-homophilic graphs is restricted, classical GNNs still stand out in several nice properties such as efficiency, simplicity, and explainability. In this work, we propose a novel graph restructuring method that can be integrated into any type of GNNs, including classical GNNs, to leverage the benefits of existing GNNs while alleviating their limitations. Our contribution is threefold: a) learning the weight of pseudo-eigenvectors for an adaptive spectral clustering that aligns well with known node labels, b) proposing a new density-aware homophilic metric that is robust to label imbalance, and c) reconstructing the adjacency matrix based on the result of adaptive spectral clustering to maximize the homophilic scores. The experimental results show that our graph restructuring method can significantly boost the performance of six classical GNNs by an average of 25% on less-homophilic graphs. The boosted performance is comparable to state-of-the-art methods.


title: Determination of hydrogen concentration in solids by transmission ERDA under nuclear-elastically enhanced recoiling of H by 8 and 9 MeV He

abstract: Hydrogen concentrations in thin self-supporting samples of polyphenylene sulfide and muscovite have been determined by nuclear-elastic recoil detection analysis of transmission layout. The analysis procedure is based only on the database of stopping power and recoil cross section for material analysis, without using any reference sample of known H content. For the polyphenylene sulfide sample, the determined value of $(2.87\pm 0.26)\times 10^{22}\,{\rm H}/$cm$^{3}$ is in good agreement with the calculated value of $3.01 \times 10^{22}\,{\rm H}/$cm$^{3}$. For the muscovite sample, the H concentration originating each from bound water and absorbed water is uniform over the entire thickness of the sample. The determined concentration $(9.43 \pm 0.75) \times 10^{21}$ H$/$cm$^{3}$ of the muscovite agrees excellently with the value of $9.36 \times 10^{21}$ H$/$cm$^{3}$ obtained from other quantitative analyses typically applied for minerals. The present results demonstrate the capability of accurate determination of H contents in materials and minerals by transmission ERDA.


title: Extracting electronic many-body correlations from local measurements with artificial neural networks

abstract: The characterization of many-body correlations provides a powerful tool for analyzing correlated quantum materials. However, experimental extraction of quantum entanglement in correlated electronic systems remains an open problem in practice. In particular, the correlation entropy quantifies the strength of quantum correlations in interacting electronic systems, yet it requires measuring all the single-particle correlators of a macroscopic sample. To circumvent this bottleneck, we introduce a strategy to obtain the correlation entropy of electronic systems solely from a set of local measurements. We demonstrate that by combining local particle-particle and density-density correlations with a neural-network algorithm, the correlation entropy can be predicted accurately. Specifically, we show that for a generalized interacting fermionic model, our algorithm yields an accurate prediction of the correlation entropy from a set of noisy local correlators. Our work demonstrates that the correlation entropy in interacting electron systems can be reconstructed from local measurements, providing a starting point to experimentally extract many-body correlations with local probes.


title: A sentiment analysis model for car review texts based on adversarial training and whole word mask BERT

abstract: In the field of car evaluation, more and more netizens choose to express their opinions on the Internet platform, and these comments will affect the decision-making of buyers and the trend of car word-of-mouth. As an important branch of natural language processing (NLP), sentiment analysis provides an effective research method for analyzing the sentiment types of massive car review texts. However, due to the lexical professionalism and large text noise of review texts in the automotive field, when a general sentiment analysis model is applied to car reviews, the accuracy of the model will be poor. To overcome these above challenges, we aim at the sentiment analysis task of car review texts. From the perspective of word vectors, pre-training is carried out by means of whole word mask of proprietary vocabulary in the automotive field, and then training data is carried out through the strategy of an adversarial training set. Based on this, we propose a car review text sentiment analysis model based on adversarial training and whole word mask BERT(ATWWM-BERT).


title: Entanglement at the Soft-Hair Horizon

abstract: We study entanglement between two modes of a free bosonic and fermionic field as seen by two relatively accelerating observers at the soft-hair horizon of a four-dimensional supertranslated Schwarzschild black hole. First, we associate the shock wave to the near horizon geometry by explicit construction of map between their metric as well as relation between wave form factor and soft hair function. We then compute mutual information and entanglement negativity as a measure of entanglement between these two observers and show that their angular dependence at the soft-hair horizon. We also show that for vanishing soft hair function our results are equal to that of an ordinary Schwarzschild black hole case.


title: Automated Circuit Sizing with Multi-objective Optimization based on Differential Evolution and Bayesian Inference

abstract: With the ever increasing complexity of specifications, manual sizing for analog circuits recently became very challenging. Especially for innovative, large-scale circuits designs, with tens of design variables, operating conditions and conflicting objectives to be optimized, design engineers spend many weeks, running time-consuming simulations, in their attempt at finding the right configuration. Recent years brought machine learning and optimization techniques to the field of analog circuits design, with evolutionary algorithms and Bayesian models showing good results for circuit sizing. In this context, we introduce a design optimization method based on Generalized Differential Evolution 3 (GDE3) and Gaussian Processes (GPs). The proposed method is able to perform sizing for complex circuits with a large number of design variables and many conflicting objectives to be optimized. While state-of-the-art methods reduce multi-objective problems to single-objective optimization and potentially induce a prior bias, we search directly over the multi-objective space using Pareto dominance and ensure that diverse solutions are provided to the designers to choose from. To the best of our knowledge, the proposed method is the first to specifically address the diversity of the solutions, while also focusing on minimizing the number of simulations required to reach feasible configurations. We evaluate the introduced method on two voltage regulators showing different levels of complexity and we highlight that the proposed innovative candidate selection method and survival policy leads to obtaining feasible solutions, with a high degree of diversity, much faster than with GDE3 or Bayesian Optimization-based algorithms.


title: Semi-Supervised Segmentation of Mitochondria from Electron Microscopy Images Using Spatial Continuity

abstract: Morphology of mitochondria plays critical roles in mediating their physiological functions. Accurate segmentation of mitochondria from 3D electron microscopy (EM) images is essential to quantitative characterization of their morphology at the nanometer scale. Fully supervised deep learning models developed for this task achieve excellent performance but require substantial amounts of annotated data for training. However, manual annotation of EM images is laborious and time-consuming because of their large volumes, limited contrast, and low signal-to-noise ratios (SNRs). To overcome this challenge, we propose a semi-supervised deep learning model that segments mitochondria by leveraging the spatial continuity of their structural, morphological, and contextual information in both labeled and unlabeled images. We use random piecewise affine transformation to synthesize comprehensive and realistic mitochondrial morphology for augmentation of training data. Experiments on the EPFL dataset show that our model achieves performance similar as that of state-of-the-art fully supervised models but requires only ~20% of their annotated training data. Our semi-supervised model is versatile and can also accurately segment other spatially continuous structures from EM images. Data and code of this study are openly accessible at https://github.com/cbmi-group/MPP.


title: Deep learning assisted jet tomography for the study of Mach cones in QGP

abstract: Mach cones are expected to form in the expanding quark-gluon plasma (QGP) when energetic quarks and gluons (called jets) traverse the hot medium at a velocity faster than the speed of sound in high-energy heavy-ion collisions. The shape of the Mach cone and the associated diffusion wake are sensitive to the initial jet production location and the jet propagation direction relative to the radial flow because of the distortion by the collective expansion of the QGP and large density gradient. The shape of jet-induced Mach cones and their distortions in heavy-ion collisions provide a unique and direct probe of the dynamical evolution and the equation of state of QGP. However, it is difficult to identify the Mach cone and the diffusion wake in current experimental measurements of final hadron distributions because they are averaged over all possible initial jet production locations and propagation directions. To overcome this difficulty, we develop a deep learning assisted jet tomography which uses the full information of the final hadrons from jets to localize the initial jet production positions. This method can help to constrain the initial regions of jet production in heavy-ion collisions and enable a differential study of Mach-cones with different jet path length and orientation relative to the radial flow of the QGP in heavy-ion collisions.


title: An Estimation Framework for Passerby Engagement Interacting with Social Robots

abstract: Social robots are expected to be a human labor support technology, and one application of them is an advertising medium in public spaces. When social robots provide information, such as recommended shops, adaptive communication according to the user's state is desired. User engagement, which is also defined as the level of interest in the robot, is likely to play an important role in adaptive communication. Therefore, in this paper, we propose a new framework to estimate user engagement. The proposed method focuses on four unsolved open problems: multi-party interactions, process of state change in engagement, difficulty in annotating engagement, and interaction dataset in the real world. The accuracy of the proposed method for estimating engagement was evaluated using interaction duration. The results show that the interaction duration can be accurately estimated by considering the influence of the behaviors of other people; this also implies that the proposed model accurately estimates the level of engagement during interaction with the robot.


title: Product structure of graph classes with bounded treewidth

abstract: We show that many graphs with bounded treewidth can be described as subgraphs of the strong product of a graph with smaller treewidth and a bounded-size complete graph. To this end, define the "underlying treewidth" of a graph class $\mathcal{G}$ to be the minimum non-negative integer $c$ such that, for some function $f$, for every graph ${G \in \mathcal{G}}$ there is a graph $H$ with ${\text{tw}(H) \leq c}$ such that $G$ is isomorphic to a subgraph of ${H \boxtimes K_{f(\text{tw}(G))}}$. We introduce disjointed coverings of graphs and show they determine the underlying treewidth of any graph class. Using this result, we prove that the class of planar graphs has underlying treewidth 3; the class of $K_{s,t}$-minor-free graphs has underlying treewidth $s$ (for ${t \geq \max\{s,3\}}$); and the class of $K_t$-minor-free graphs has underlying treewidth ${t-2}$. In general, we prove that a monotone class has bounded underlying treewidth if and only if it excludes some fixed topological minor. We also study the underlying treewidth of graph classes defined by an excluded subgraph or excluded induced subgraph. We show that the class of graphs with no $H$ subgraph has bounded underlying treewidth if and only if every component of $H$ is a subdivided star, and that the class of graphs with no induced $H$ subgraph has bounded underlying treewidth if and only if every component of $H$ is a star.


title: Large $k$-gons in a 1.5D Terrain

abstract: Given is a 1.5D terrain $\mathcal{T}$, i.e., an $x$-monotone polygonal chain in $\mathbb{R}^2$. For a given $2\le k\le n$, our objective is to approximate the largest area or perimeter convex polygon of exactly or at most $k$ vertices inside $\mathcal{T}$. For a constant $k>3$, we design an FPTAS that efficiently approximates the largest convex polygons with at most $k$ vertices, within a factor $(1-\epsilon)$. For the case where $k=2$, we design an $O(n)$ time exact algorithm for computing the longest line segment in $\mathcal{T}$, and for $k=3$, we design an $O(n \log n)$ time exact algorithm for computing the largest-perimeter triangle that lies within $\mathcal{T}$.


title: Projectile motion in a medium with quadratic drag at constant horizontal wind

abstract: A classic problem of the motion of a projectile thrown at an angle to the horizon is studied. Air resistance force is taken into account with the use of the quadratic resistance law. The action of the wind is also taken into account, which is considered constant and horizontal. The projectile velocity hodograph equation is used to account for the effect of wind. Comparatively simple analytical approximations are proposed for the main variables of motion (cartesian projectile coordinates and time). All obtained formulas contain only elementary functions. The proposed formulas are universal, that is, they can be used for any initial conditions of throwing. In addition, they have acceptable accuracy over a wide range of the change of parameters. The motion of a golf ball, a tennis ball and shuttlecock of badminton are presented as examples. The calculation results show good agreement between the proposed analytical solutions and numerical solutions. The proposed analytical formulas can be useful for all researchers of this classical problem.


title: Interference Management for Over-the-Air Federated Learning in Multi-Cell Wireless Networks

abstract: Federated learning (FL) over resource-constrained wireless networks has recently attracted much attention. However, most existing studies consider one FL task in single-cell wireless networks and ignore the impact of downlink/uplink inter-cell interference on the learning performance. In this paper, we investigate FL over a multi-cell wireless network, where each cell performs a different FL task and over-the-air computation (AirComp) is adopted to enable fast uplink gradient aggregation. We conduct convergence analysis of AirComp-assisted FL systems, taking into account the inter-cell interference in both the downlink and uplink model/gradient transmissions, which reveals that the distorted model/gradient exchanges induce a gap to hinder the convergence of FL. We characterize the Pareto boundary of the error-induced gap region to quantify the learning performance trade-off among different FL tasks, based on which we formulate an optimization problem to minimize the sum of error-induced gaps in all cells. To tackle the coupling between the downlink and uplink transmissions as well as the coupling among multiple cells, we propose a cooperative multi-cell FL optimization framework to achieve efficient interference management for downlink and uplink transmission design. Results demonstrate that our proposed algorithm achieves much better average learning performance over multiple cells than non-cooperative baseline schemes.


title: Wigner time for electromagnetic radiation in plasma

abstract: Wave tunneling is an intriguing phenomenon spanning different branches of physics, from quantum mechanics to classical electrodynamics and optics. The Wigner (or phase) time is proved to be an adequate measure to describe wave transit through a potential barrier or material layer in the tunneling regime. Here, we analytically and numerically calculate the Wigner time for electromagnetic-radiation propagation through the layer of both lossless and lossy plasmas. It is shown that the plasma frequency is the key parameter governing the value of Wigner time allowing us to interpret tunneling as due to the reaction of plasma as a whole. We analyze the Wigner time for obliquely incident waves of TE and TM polarizations and discuss the meaning of negative Wigner times appearing in the lossy case in the low-frequency range and close to the plasma frequency. The results show that plasma deserves attention as a perspective object for tunneling studies.


title: Isospectrum of non-self-adjoint almost-periodic Schrodinger operators

abstract: For non-self-adjoint almost-periodic Schr\"odinger operators, a criterion is given to guarantee that they have both the same spectrum and same Lyapunov exponents with the discrete free Laplacian. As a byproduct, we show that the Moser-P\"oschel argument for opening gaps may not be valid for non-self-adjoint operators.


title: Ramification theory from homotopical point of view, I

abstract: We prove the compatibility of pushforward along a proper morphism of an \'{e}tale constructible sheaf and the pushforward of its characteristic cycle up to $p$-torsion. This was conjectured by Takeshi Saito. For this, we revisit the construction of the characteristic cycle, due to Saito and Beilinson, from more homotopical point of view. In particular, the language of $\infty$-categories is indispensable to carry this out.


title: Ramification theory from homotopical point of view, II

abstract: This is the second part of the paper which proves the compatibility of pushforward along a proper morphism of an \'{e}tale constructible sheaf and the pushforward of its characteristic cycle up to $p$-torsion. In this second part, we show a result which is postponed from the first part because the technique of the proof is different. Especially, we use Zariski-Riemann spaces to show a certain alteration process terminates.


title: On left spectrum of a split quaternionic matrix

abstract: In noncommutative and nondivision algebra, left spectrum of matrices are less known and is not easy to handle. Split quaternion algebra is a noncommutative and nondivision algebra. In this paper, by the formulas of solving the equations $ax=b$ and $ax^2+bx+c=0$ over split quaternions, we make an attempt to understand the left spectrum of a split quaternion matrix of order 2.


title: A Simple yet Effective Method for Graph Classification

abstract: In deep neural networks, better results can often be obtained by increasing the complexity of previously developed basic models. However, it is unclear whether there is a way to boost performance by decreasing the complexity of such models. Intuitively, given a problem, a simpler data structure comes with a simpler algorithm. Here, we investigate the feasibility of improving graph classification performance while simplifying the learning process. Inspired by structural entropy on graphs, we transform the data sample from graphs to coding trees, which is a simpler but essential structure for graph data. Furthermore, we propose a novel message passing scheme, termed hierarchical reporting, in which features are transferred from leaf nodes to root nodes by following the hierarchical structure of coding trees. We then present a tree kernel and a convolutional network to implement our scheme for graph classification. With the designed message passing scheme, the tree kernel and convolutional network have a lower runtime complexity of $O(n)$ than Weisfeiler-Lehman subtree kernel and other graph neural networks of at least $O(hm)$. We empirically validate our methods with several graph classification benchmarks and demonstrate that they achieve better performance and lower computational consumption than competing approaches.


title: Image Protection for Robust Cropping Localization and Recovery

abstract: Existing image cropping detection schemes ignore that recovering the cropped-out contents can unveil the purpose of the behaved cropping attack. This paper presents \textbf{CLR}-Net, a novel image protection scheme addressing the combined challenge of image \textbf{C}ropping \textbf{L}ocalization and \textbf{R}ecovery. We first protect the original image by introducing imperceptible perturbations. Then, typical image post-processing attacks are simulated to erode the protected image. On the recipient's side, we predict the cropping mask and recover the original image. Besides, we propose a novel \textbf{F}ine-\textbf{G}rained generative \textbf{JPEG} simulator (FG-JPEG) as well as a feature alignment network to improve the real-world robustness. Comprehensive experiments prove that the quality of the recovered image and the accuracy of crop localization are both satisfactory.


title: Isothermal compressibility and effects of multi-body molecular interactions in a strongly interacting ultracold Fermi gas

abstract: We theoretically investigate the isothermal compressibility $\kappa_{T}$ in the normal state of an ultracold Fermi gas. Including pairing fluctuations, as well as preformed-pair formations, within the framework of the self-consistent $T$-matrix approximation (SCTMA), we evaluate the temperature dependence of this thermodynamic quantity over the entire BCS (Bardeen-Cooper-Schrieffer)-BEC (Bose-Einstein condensation) crossover region. While $\kappa_T$ in the weak-coupling BCS regime is dominated by Fermi atoms near the Fermi surface, correlations between tightly bound Cooper-pair molecules are found to play crucial roles in the strong-coupling BEC regime. In the latter region, besides a two-body molecular interaction, a three-body one is shown to sizably affect $\kappa_T$ near the superfluid phase transition temperature. Our results indicate that the strong-coupling BEC regime of an ultracold Fermi gas would provide a unique opportunity to study multi-body correlations between Cooper-pair molecules.


title: Green Interference Based Symbiotic Security in Integrated Satellite-terrestrial Communications

abstract: In this paper, we investigate secure transmissions in integrated satellite-terrestrial communications and the green interference based symbiotic security scheme is proposed. Particularly, the co-channel interference induced by the spectrum sharing between satellite and terrestrial networks and the inter-beam interference due to frequency reuse among satellite multi-beam serve as the green interference to assist the symbiotic secure transmission, where the secure transmissions of both satellite and terrestrial links are guaranteed simultaneously. Specifically, to realize the symbiotic security, we formulate a problem to maximize the sum secrecy rate of satellite users by cooperatively beamforming optimizing and a constraint of secrecy rate of each terrestrial user is guaranteed. Since the formulated problem is non-convex and intractable, the Taylor expansion and semi-definite relaxation (SDR) are adopted to further reformulate this problem, and the successive convex approximation (SCA) algorithm is designed to solve it. Finally, the tightness of the relaxation is proved. In addition, numerical results verify the efficiency of our proposed approach.


title: Tensor join of hypergraphs and its spectra

abstract: In this paper, we introduce three operations on hypergraphs by using tensors. We show that these three formulations are equivalent and we commonly call them as the tensor join. We show that any hypergraph can be viewed as a tensor join of hypergraphs. Tensor join enable us to obtain several existing and new classes of operations on hypergraphs. We compute the adjacency, the Laplacian, the normalized Laplacian spectrum of weighted hypergraphs constructed by this tensor join. Also we deduce some results on the spectra of hypergraphs in the literature. As an application, we construct several pairs of the adjacency, the Laplacian, the normalized Laplacian cospectral hypergraphs by using the tensor join.


title: Is More Data All You Need? A Causal Exploration

abstract: Curating a large scale medical imaging dataset for machine learning applications is both time consuming and expensive. Balancing the workload between model development, data collection and annotations is difficult for machine learning practitioners, especially under time constraints. Causal analysis is often used in medicine and economics to gain insights about the effects of actions and policies. In this paper we explore the effect of dataset interventions on the output of image classification models. Through a causal approach we investigate the effects of the quantity and type of data we need to incorporate in a dataset to achieve better performance for specific subtasks. The main goal of this paper is to highlight the potential of causal analysis as a tool for resource optimization for developing medical imaging ML applications. We explore this concept with a synthetic dataset and an exemplary use-case for Diabetic Retinopathy image analysis.


title: Load Balancing Using Sparse Communication

abstract: Load balancing across parallel servers is an important class of congestion control problems that arises in service systems. An effective load balancer relies heavily on accurate, real-time congestion information to make routing decisions. However, obtaining such information can impose significant communication overheads, especially in demanding applications like those found in modern data centers. We introduce a framework for communication-aware load balancing and design new load balancing algorithms that perform exceptionally well even in scenarios with sparse communication patterns. Central to our approach is state approximation, where the load balancer first estimates server states through a communication protocol. Subsequently, it utilizes these approximate states within a load balancing algorithm to determine routing decisions. We demonstrate that by using a novel communication protocol, one can achieve accurate queue length approximation with sparse communication: for a maximal approximation error of x, the communication frequency only needs to be O(1/x^2). We further show, via a diffusion analysis, that a constant maximal approximation error is sufficient for achieving asymptotically optimal performance. Taken together, these results therefore demonstrate that highly performant load balancing is possible with very little communication. Through simulations, we observe that the proposed designs match or surpass the performance of state-of-the-art load balancing algorithms while drastically reducing communication rates by up to 90%.


title: Integral topological Hochschild homology of connective complex K-theory

abstract: We compute the homotopy groups of $\mathrm{THH}(\mathrm{ku})$ as a $\mathrm{ku}_\ast$-module using the descent spectral sequence for the map $\mathrm{THH}(\mathrm{ku})\to\mathrm{THH}(\mathrm{ku}/\mathrm{MU})$, which is the motivic spectral sequence for $\mathrm{THH}(\mathrm{ku})$ in the sense of Hahn-Raksit-Wilson. We compute the $E_2$-page using an algebraic Bockstein spectral sequence, which is an approximation to the topological Bockstein spectral sequence computing $\mathrm{THH}(\mathrm{ku})$ from $\mathrm{THH}(\mathrm{ku})/(p,\beta)$, where $\beta$ is the Bott element. Then, we show that the descent spectral sequence degenerates at the $E_2$-page.


title: Efficient and Scalable Parametric High-Order Portfolios Design via the Skew-t Distribution

abstract: Since Markowitz's mean-variance framework, optimizing a portfolio that maximizes the profit and minimizes the risk has been ubiquitous in the financial industry. Initially, profit and risk were measured by the first two moments of the portfolio's return, a.k.a. the mean and variance, which are sufficient to characterize a Gaussian distribution. However, it is broadly believed that the first two moments are not enough to capture the characteristics of the returns' behavior, which have been recognized to be asymmetric and heavy-tailed. Although there is ample evidence that portfolio designs involving the third and fourth moments, i.e., skewness and kurtosis, will outperform the conventional mean-variance framework, they are non-trivial. Specifically, in the classical framework, the memory and computational cost of computing the skewness and kurtosis grow sharply with the number of assets. To alleviate the difficulty in high-dimensional problems, we consider an alternative expression for high-order moments based on parametric representations via a generalized hyperbolic skew-t distribution. Then, we reformulate the high-order portfolio optimization problem as a fixed-point problem and propose a robust fixed-point acceleration algorithm that solves the problem in an efficient and scalable manner. Empirical experiments also demonstrate that our proposed high-order portfolio optimization framework is of low complexity and significantly outperforms the state-of-the-art methods by 2 to 4 orders of magnitude.


title: Foundations of Convection with Density Stratification

abstract: The phenomenon of thermal and compositional (chemical) convection is very common in nature and therefore of great importance from the point of view of understanding of many fundamental aspects of the environment and universe. A number of books have been written on the topic, such as e.g. the seminal work of Chandrasekhar (1961) on Hydrodynamic and Hydromagnetic Stability, a large portion of which is devoted to the convective instability near its onset or the outstanding book of Getling (1998) where systematization of the knowledge on convection has been continued with a thorough description of the weakly nonlinear stages. Most of the works, however, considered weakly stratified, that is the so-called Boussinesq convection. It is the aim of this book to continue the process of systematization. It seems important to put the current knowledge on weakly and strongly stratified convection in order and provide a comprehensive description of the marginal, weakly nonlinear and fully developed stages of convective flow in both cases. To that end the book provides a short compendium of knowledge on the linear and weakly nonlinear limits of the Boussinesq convection, as a useful reference for a reader and than proceeds with a review of the theory on fully developed, weakly stratified convection. The entire third chapter is devoted to a detailed derivation and a study of the three aforementioned stages of stratified (anelastic) convection. The description of stratified convection requires extreme care, since many aspects have to be considered simultaneously for full consistency. Detailed and systematic explanations are therefore provided. This book is meant as a textbook for courses on hydrodynamics and convective flows, for the use of lecturers and students, however, it may also be of use for the entire scientific community as a practical reference.


title: Nonexpansive directions in the Jeandel-Rao Wang shift

abstract: We show that $\{0,\varphi+3,-3\varphi+2,-\varphi+\frac{5}{2}\}$ is the set of slopes of nonexpansive directions for a minimal subshift in the Jeandel-Rao Wang shift, where $\varphi=(1+\sqrt{5})/2$ is the golden mean. This set is a topological invariant allowing to distinguish the Jeandel-Rao Wang shift from other subshifts. Moreover, we describe the combinatorial structure of the two resolutions of the Conway worms along the nonexpansive directions in terms of irrational rotations of the unit interval. The introduction finishes with pictures of nonperiodic Wang tilings corresponding to what Conway called the cartwheel tiling in the context of Penrose tilings. The article concludes with open questions regarding the description of octopods and essential holes in the Jeandel-Rao Wang shift.


title: Quantitative theory of magnetic interactions in solids

abstract: In this report we review the method of explicit calculations of interatomic exchange interactions of magnetic materials. This involves exchange mechanisms normally referred to as Heisenberg exchange, Dzyaloshinskii-Moriya interaction and anisotropic symmetric exchange. The connection between microscopic theories of the electronic structure, such as density functional theory or dynamical mean field theory, and interatomic exchange, is given in detail. The different aspects of extracting information for an effective spin Hamiltonian that involves thousands of atoms, from electronic structure calculations considering significantly fewer atoms (1-50) is highlighted. Examples of exchange interactions of a large group of materials is presented, which involves heavy elements of the 3d period, alloys between transition metals, Heusler compounds, multilayer systems as well as overlayers and adatoms on a substrate, transition metal oxides, 4f elements, magnetic materials in two dimensions and molecular magnets. Where possible, a comparison to experimental data is made, that naturally becomes focused on the magnon dispersion. The influence of relativity is reviewed for a few cases, as is the importance of dynamical correlations. Development to theories that handle out of equilibrium conditions is also described here. The review ends with a short description of extensions of the theories behind explicit calculations of interatomic exchange, to non-magnetic situations, e.g. that describe chemical (charge) order and superconductivity.


title: Embrace the Gap: VAEs Perform Independent Mechanism Analysis

abstract: Variational autoencoders (VAEs) are a popular framework for modeling complex data distributions; they can be efficiently trained via variational inference by maximizing the evidence lower bound (ELBO), at the expense of a gap to the exact (log-)marginal likelihood. While VAEs are commonly used for representation learning, it is unclear why ELBO maximization would yield useful representations, since unregularized maximum likelihood estimation cannot invert the data-generating process. Yet, VAEs often succeed at this task. We seek to elucidate this apparent paradox by studying nonlinear VAEs in the limit of near-deterministic decoders. We first prove that, in this regime, the optimal encoder approximately inverts the decoder -- a commonly used but unproven conjecture -- which we refer to as {\em self-consistency}. Leveraging self-consistency, we show that the ELBO converges to a regularized log-likelihood. This allows VAEs to perform what has recently been termed independent mechanism analysis (IMA): it adds an inductive bias towards decoders with column-orthogonal Jacobians, which helps recovering the true latent factors. The gap between ELBO and log-likelihood is therefore welcome, since it bears unanticipated benefits for nonlinear representation learning. In experiments on synthetic and image data, we show that VAEs uncover the true latent factors when the data generating process satisfies the IMA assumption.


title: Fast Adversarial Training with Adaptive Step Size

abstract: While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of recent works to accelerate adversarial training is to substitute multi-step attacks (e.g., PGD) with single-step attacks (e.g., FGSM). However, these single-step methods suffer from catastrophic overfitting, where the accuracy against PGD attack suddenly drops to nearly 0% during training, destroying the robustness of the networks. In this work, we study the phenomenon from the perspective of training instances. We show that catastrophic overfitting is instance-dependent and fitting instances with larger gradient norm is more likely to cause catastrophic overfitting. Based on our findings, we propose a simple but effective method, Adversarial Training with Adaptive Step size (ATAS). ATAS learns an instancewise adaptive step size that is inversely proportional to its gradient norm. The theoretical analysis shows that ATAS converges faster than the commonly adopted non-adaptive counterparts. Empirically, ATAS consistently mitigates catastrophic overfitting and achieves higher robust accuracy on CIFAR10, CIFAR100 and ImageNet when evaluated on various adversarial budgets.


title: Tunable nonlinear coherent perfect absorption and reflection in cavity QED

abstract: We propose and analyze a scheme for realizing tunable coherent perfect absorption (CPA) and reflection (CPR) in a three-level $\Lambda$-type atom-cavity system. With EIT-type interference induced by a coherent coupling laser, the scheme provides a new method of attaining tunable near CPR at two-photon resonance. By different coupling strength, the system can be excited from linear CPA regime into nonlinear even bistable CPA regime without changing the frequency of the probe field, where the hysteresis cycle of the bistability is controllable. In addition, the CPA regime can be transferred into the near CPR regime with controllable atomic coherence and linear absorption induced by an incoherent pump field. Our work suggests a mechanism for manipulation on extreme absorption (0% and 100%), which can potentially be applied in logical gates and optical switches for coherent optical computing and communication.


title: Towards Responsible AI for Financial Transactions

abstract: The application of AI in finance is increasingly dependent on the principles of responsible AI. These principles - explainability, fairness, privacy, accountability, transparency and soundness form the basis for trust in future AI systems. In this study, we address the first principle by providing an explanation for a deep neural network that is trained on a mixture of numerical, categorical and textual inputs for financial transaction classification. The explanation is achieved through (1) a feature importance analysis using Shapley additive explanations (SHAP) and (2) a hybrid approach of text clustering and decision tree classifiers. We then test the robustness of the model by exposing it to a targeted evasion attack, leveraging the knowledge we gained about the model through the extracted explanation.


title: Revisiting Atiyah-Hitchin manifold in the generalized Legendre transform

abstract: We revisit construction of the Atiyah-Hitchin manifold in the generalized Legendre transform approach. This is originally studied by Ivanov and Rocek and is subsequently investigated more by Ionas, in the latter of which the explicit forms of the K\"ahler potential and the K\"ahler metric are calculated. There is a difference between the former and the latter. In the generalized Legendre transform approach, a K\"ahler potential is constructed from the contour integration of one function with holomorphic coordinates. The choice of the contour in the latter is different from the former's one, whose difference may yield a discrepancy in the K\"ahler potential and eventually in the K\"ahler metric. We show that the former only gives the real K\"ahler potential, which is consistent with its definition, while the latter yields the complex one. We derive the K\"ahler potential and the metric for the Atiyah-Hitchin manifold in terms of holomorphic coordinates for the contour considered by Ivanov and Ro\v{c}ek for the first time.


title: MorisienMT: A Dataset for Mauritian Creole Machine Translation

abstract: In this paper, we describe MorisienMT, a dataset for benchmarking machine translation quality of Mauritian Creole. Mauritian Creole (Morisien) is the lingua franca of the Republic of Mauritius and is a French-based creole language. MorisienMT consists of a parallel corpus between English and Morisien, French and Morisien and a monolingual corpus for Morisien. We first give an overview of Morisien and then describe the steps taken to create the corpora and, from it, the training and evaluation splits. Thereafter, we establish a variety of baseline models using the created parallel corpora as well as large French--English corpora for transfer learning. We release our datasets publicly for research purposes and hope that this spurs research for Morisien machine translation.


title: Ego Network Structure in Online Social Networks and its Impact on Information Diffusion

abstract: In the last few years, Online Social Networks (OSNs) attracted the interest of a large number of researchers, thanks to their central role in the society. Through the analysis of OSNs, many social phenomena have been studied, such as the viral diffusion of information amongst people. What is still unclear is the relation between micro-level structural properties of OSNs (i.e. the properties of the personal networks of the users, also known as ego networks) and the emergence of such phenomena. A better knowledge of this relation could be essential for the creation of services for the Future Internet, such as highly personalised advertisements fitted on users' needs and characteristics. In this paper, we contribute to bridge this gap by analysing the ego networks of a large sample of Facebook and Twitter users. Our results indicate that micro-level structural properties of OSNs are interestingly similar to those found in social networks formed offline. In particular, online ego networks show the same structure found offline, with social contacts arranged in layers with compatible size and composition. From the analysis of Twitter ego networks, we have been able to find a direct impact of tie strength and ego network circles on the diffusion of information in the network. Specifically, there is a high correlation between the frequency of direct contact between users and her friends in Twitter (a proxy for tie strength), and the frequency of retweets made by the users from tweets generated by their friends. We analysed the correlation for each ego network layer identified in Twitter, discovering their role in the diffusion of information.


title: Evaluating the Predictive Performance of Positive-Unlabelled Classifiers: a brief critical review and practical recommendations for improvement

abstract: Positive-Unlabelled (PU) learning is a growing area of machine learning that aims to learn classifiers from data consisting of labelled positive and unlabelled instances. Whilst much work has been done proposing methods for PU learning, little has been written on the subject of evaluating these methods. Many popular standard classification metrics cannot be precisely calculated due to the absence of fully labelled data, so alternative approaches must be taken. This short commentary paper critically reviews the main PU learning evaluation approaches and the choice of predictive accuracy measures in 51 articles proposing PU classifiers and provides practical recommendations for improvements in this area.


title: Slim-neck by GSConv: A better design paradigm of detector architectures for autonomous vehicles

abstract: Object detection is a significant downstream task in computer vision. For the on-board edge computing platforms, a giant model is difficult to achieve the real-time detection requirement. And, a lightweight model built from a large number of the depth-wise separable convolution layers cannot achieve the sufficient accuracy. We introduce a new lightweight convolution technique, GSConv, to lighten the model but maintain the accuracy. The GSConv accomplishes an excellent trade-off between the model's accuracy and speed. And, we provide a design paradigm, slim-neck, to achieve a higher computational cost-effectiveness of the detectors. The effectiveness of our approach was robustly demonstrated in over twenty sets comparative experiments. In particular, the detectors of ameliorated by our approach obtains state-of-the-art results (e.g. 70.9% mAP0.5 for the SODA10M at a speed of ~ 100FPS on a Tesla T4 GPU) compared with the originals. Code is available at https://github.com/alanli1997/slim-neck-by-gsconv


title: mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation

abstract: Accurate brain tumor segmentation from Magnetic Resonance Imaging (MRI) is desirable to joint learning of multimodal images. However, in clinical practice, it is not always possible to acquire a complete set of MRIs, and the problem of missing modalities causes severe performance degradation in existing multimodal segmentation methods. In this work, we present the first attempt to exploit the Transformer for multimodal brain tumor segmentation that is robust to any combinatorial subset of available modalities. Concretely, we propose a novel multimodal Medical Transformer (mmFormer) for incomplete multimodal learning with three main components: the hybrid modality-specific encoders that bridge a convolutional encoder and an intra-modal Transformer for both local and global context modeling within each modality; an inter-modal Transformer to build and align the long-range correlations across modalities for modality-invariant features with global semantics corresponding to tumor region; a decoder that performs a progressive up-sampling and fusion with the modality-invariant features to generate robust segmentation. Besides, auxiliary regularizers are introduced in both encoder and decoder to further enhance the model's robustness to incomplete modalities. We conduct extensive experiments on the public BraTS $2018$ dataset for brain tumor segmentation. The results demonstrate that the proposed mmFormer outperforms the state-of-the-art methods for incomplete multimodal brain tumor segmentation on almost all subsets of incomplete modalities, especially by an average 19.07% improvement of Dice on tumor segmentation with only one available modality. The code is available at https://github.com/YaoZhang93/mmFormer.


title: Vacuum Cherenkov radiation at finite temperature

abstract: In this paper we examine the thermal effects of the vacuum Cherenkov radiation in a Lorentz- and CPT-violating electrodynamics. We compute the thermal contribution to the Cherenkov radiation rate within the Thermofield Dynamics approach. Since the model under consideration possess a consistent canonical quantization and also fulfils the physical constraints in order to this vacuum process to happen, it is a perfect candidate to implement the study at finite temperature. We evaluate in details the instantaneous rate of energy loss for a charge, and show that the radiation rate is significantly modified at very high temperatures. Intriguingly, we further observe that when the temperature goes to infinity the radiation rate goes to zero even if the process is kinematically allowed.


title: Evidence of Spin Frustration in Vanadium Diselenide Monolayer Magnet

abstract: Monolayer VSe2, featuring both charge density wave and magnetism phenomena, represents a unique van der Waals magnet in the family of metallic two-dimensional transition-metal dichalcogenides (2D-TMDs). Herein, by means of in-situ microscopic and spectroscopic techniques, including scanning tunneling microscopy/spectroscopy, synchrotron X-ray and angle-resolved photoemission, and X-ray absorption, direct spectroscopic signatures are established, that identify the metallic 1T-phase and vanadium 3d1 electronic configuration in monolayer VSe2 grown on graphite by molecular-beam epitaxy. Element-specific X-ray magnetic circular dichroism, complemented with magnetic susceptibility measurements, further reveals monolayer VSe2 as a frustrated magnet, with its spins exhibiting subtle correlations, albeit in the absence of a long-range magnetic order down to 2 K and up to a 7 T magnetic field. This observation is attributed to the relative stability of the ferromagnetic and antiferromagnetic ground states, arising from its atomic-scale structural features, such as rotational disorders and edges. The results of this study extend the current understanding of metallic 2D-TMDs in the search for exotic low-dimensional quantum phenomena, and stimulate further theoretical and experimental studies on van der Waals monolayer magnets.


title: Domain-specific Language Pre-training for Dialogue Comprehension on Clinical Inquiry-Answering Conversations

abstract: There is growing interest in the automated extraction of relevant information from clinical dialogues. However, it is difficult to collect and construct large annotated resources for clinical dialogue tasks. Recent developments in natural language processing suggest that large-scale pre-trained language backbones could be leveraged for such machine comprehension and information extraction tasks. Yet, due to the gap between pre-training and downstream clinical domains, it remains challenging to exploit the generic backbones for domain-specific applications. Therefore, in this work, we propose a domain-specific language pre-training, to improve performance on downstream tasks like dialogue comprehension. Aside from the common token-level masking pre-training method, according to the nature of human conversations and interactive flow of multi-topic inquiry-answering dialogues, we further propose sample generation strategies with speaker and utterance manipulation. The conversational pre-training guides the language backbone to reconstruct the utterances coherently based on the remaining context, thus bridging the gap between general and specific domains. Experiments are conducted on a clinical conversation dataset for symptom checking, where nurses inquire and discuss symptom information with patients. We empirically show that the neural model with our proposed approach brings improvement in the dialogue comprehension task, and can achieve favorable results in the low resource training scenario.


title: Magnetic Transition in Monolayer VSe2 via Interface Hybridization

abstract: Magnetism in monolayer (ML) VSe2 has attracted broad interest in spintronics while existing reports have not reached consensus. Using element-specific X-ray magnetic circular dichroism, a magnetic transition in ML VSe2 has been demonstrated at the contamination-free interface between Co and VSe2. Via interfacial hybridization with Co atomic overlayer, a magnetic moment of about 0.4 uB per V atom in ML VSe2 is revealed, approaching values predicted by previous theoretical calculations. Promotion of the ferromagnetism in ML VSe2 is accompanied by its antiferromagnetic coupling to Co and a reduction in the spin moment of Co. In comparison to the absence of this interface-induced ferromagnetism at the Fe/MLMoSe2 interface, these findings at the Co/ML-VSe2 interface provide clear proof that the ML VSe2, initially with magnetic disorder, is on the verge of magnetic transition.


title: Gauss-Prym maps on Enriques surfaces

abstract: We prove that the $k$-th Gaussian map $\gamma^k_{H}$ is surjective on a polarized unnodal Enriques surface $(S, H)$ with $\phi(H)>2k+4$. In particular, as a consequence, when $\phi(H)>4(k+2)$, we obtain the surjectivity of the $k$-th Gauss-Prym map $\gamma^k_{\omega_C\otimes\alpha}$ on smooth hyperplane sections $C\in \vert H\vert.$ In case $k=1$ it is sufficient to ask $\phi(H)>6$.


title: Connected and Disconnected Sea Partons from CT18 Parametrization of PDFs

abstract: The separation of the connected and disconnected sea partons, which were uncovered in the Euclidean path-integral formulation of the hadronic tensor, is accommodated with an alternative parametrization of the non-perturbative parton distribution functions in the CT18 global analysis. This is achieved with the help of the distinct small $x$ behaviours of these two sea partons and the constraint from the lattice calculation of the ratio of the strange momentum fraction to that of the $\bar u$ or $\bar d$ in the disconnected insertion. The whole dataset of CT18 is used in this CT18CS fit. The impact of the recent SeaQuest data on the $\bar{d}(x)-\bar{u}(x)$ distribution of CT18CS is also discussed. The separate momentum fractions for the valence, the connected sea and disconnected sea of $u$ and $d$, the strange and the gluon partons are presented at $\mu =1.3$ GeV for the first time. They can be compared term-by-term with systematic error controlled lattice calculations.


title: Online Neural Diarization of Unlimited Numbers of Speakers Using Global and Local Attractors

abstract: A method to perform offline and online speaker diarization for an unlimited number of speakers is described in this paper. End-to-end neural diarization (EEND) has achieved overlap-aware speaker diarization by formulating it as a multi-label classification problem. It has also been extended for a flexible number of speakers by introducing speaker-wise attractors. However, the output number of speakers of attractor-based EEND is empirically capped; it cannot deal with cases where the number of speakers appearing during inference is higher than that during training because its speaker counting is trained in a fully supervised manner. Our method, EEND-GLA, solves this problem by introducing unsupervised clustering into attractor-based EEND. In the method, the input audio is first divided into short blocks, then attractor-based diarization is performed for each block, and finally, the results of each block are clustered on the basis of the similarity between locally-calculated attractors. While the number of output speakers is limited within each block, the total number of speakers estimated for the entire input can be higher than the limitation. To use EEND-GLA in an online manner, our method also extends the speaker-tracing buffer, which was originally proposed to enable online inference of conventional EEND. We introduce a block-wise buffer update to make the speaker-tracing buffer compatible with EEND-GLA. Finally, to improve online diarization, our method improves the buffer update method and revisits the variable chunk-size training of EEND. The experimental results demonstrate that EEND-GLA can perform speaker diarization of an unseen number of speakers in both offline and online inferences.


title: Continuous and Distribution-free Probabilistic Wind Power Forecasting: A Conditional Normalizing Flow Approach

abstract: We present a data-driven approach for probabilistic wind power forecasting based on conditional normalizing flow (CNF). In contrast with the existing, this approach is distribution-free (as for non-parametric and quantile-based approaches) and can directly yield continuous probability densities, hence avoiding quantile crossing. It relies on a base distribution and a set of bijective mappings. Both the shape parameters of the base distribution and the bijective mappings are approximated with neural networks. Spline-based conditional normalizing flow is considered owing to its non-affine characteristics. Over the training phase, the model sequentially maps input examples onto samples of base distribution, given the conditional contexts, where parameters are estimated through maximum likelihood. To issue probabilistic forecasts, one eventually maps samples of the base distribution into samples of a desired distribution. Case studies based on open datasets validate the effectiveness of the proposed model, and allows us to discuss its advantages and caveats with respect to the state of the art.


title: Shear Measurement with Poorly Resolved Images

abstract: Weak lensing studies typically require excellent seeing conditions for the purpose of maximizing the number density of well-resolved galaxy images. It is interesting to ask to what extent the seeing size limits the usefulness of the astronomical images in weak lensing. In this work, we study this issue with the data of the DECam Legacy Survey (DECaLS), which is a part of the target selection program for the Dark Energy Spectroscopic Instrument (DESI). Using the Fourier Quad shear measurement pipeline, we demonstrate that images with relatively poor seeing conditions (around 1.5 arcsec) can still yield accurate shear estimators. We do not find any correlation between systematic shear error and the image resolution.


title: Tackling covariate shift with node-based Bayesian neural networks

abstract: Bayesian neural networks (BNNs) promise improved generalization under covariate shift by providing principled probabilistic representations of epistemic uncertainty. However, weight-based BNNs often struggle with high computational complexity of large-scale architectures and datasets. Node-based BNNs have recently been introduced as scalable alternatives, which induce epistemic uncertainty by multiplying each hidden node with latent random variables, while learning a point-estimate of the weights. In this paper, we interpret these latent noise variables as implicit representations of simple and domain-agnostic data perturbations during training, producing BNNs that perform well under covariate shift due to input corruptions. We observe that the diversity of the implicit corruptions depends on the entropy of the latent variables, and propose a straightforward approach to increase the entropy of these variables during training. We evaluate the method on out-of-distribution image classification benchmarks, and show improved uncertainty estimation of node-based BNNs under covariate shift due to input perturbations. As a side effect, the method also provides robustness against noisy training labels.


title: Detecting Interlocutor Confusion in Situated Human-Avatar Dialogue: A Pilot Study

abstract: In order to enhance levels of engagement with conversational systems, our long term research goal seeks to monitor the confusion state of a user and adapt dialogue policies in response to such user confusion states. To this end, in this paper, we present our initial research centred on a user-avatar dialogue scenario that we have developed to study the manifestation of confusion and in the long term its mitigation. We present a new definition of confusion that is particularly tailored to the requirements of intelligent conversational system development for task-oriented dialogue. We also present the details of our Wizard-of-Oz based data collection scenario wherein users interacted with a conversational avatar and were presented with stimuli that were in some cases designed to invoke a confused state in the user. Post study analysis of this data is also presented. Here, three pre-trained deep learning models were deployed to estimate base emotion, head pose and eye gaze. Despite a small pilot study group, our analysis demonstrates a significant relationship between these indicators and confusion states. We understand this as a useful step forward in the automated analysis of the pragmatics of dialogue.


title: Information-theoretic Inducing Point Placement for High-throughput Bayesian Optimisation

abstract: Sparse Gaussian Processes are a key component of high-throughput Bayesian optimisation (BO) loops -- an increasingly common setting where evaluation budgets are large and highly parallelised. By using representative subsets of the available data to build approximate posteriors, sparse models dramatically reduce the computational costs of surrogate modelling by relying on a small set of pseudo-observations, the so-called inducing points, in lieu of the full data set. However, current approaches to design inducing points are not appropriate within BO loops as they seek to reduce global uncertainty in the objective function. Thus, the high-fidelity modelling of promising and data-dense regions required for precise optimisation is sacrificed and computational resources are instead wasted on modelling areas of the space already known to be sub-optimal. Inspired by entropy-based BO methods, we propose a novel inducing point design that uses a principled information-theoretic criterion to select inducing points. By choosing inducing points to maximally reduce both global uncertainty and uncertainty in the maximum value of the objective function, we build surrogate models able to support high-precision high-throughput BO.


title: Body schema or the body as its own best model

abstract: Rodney Brooks (1991) put forth the idea that during an agent's interaction with its environment, representations of the world often stand in the way. Instead, using the world as its own best model, i.e. interacting with it directly without making models, often leads to better and more natural behavior. The same perspective can be applied to representations of the agent's body. I analyze different examples from biology -- octopus and humans in particular -- and compare them with robots and their body models. At one end of the spectrum, the octopus, a highly intelligent animal, largely relies on the mechanical properties of its arms and peripheral nervous system. No central representations or maps of its body were found in its central nervous system. Primate brains do contain areas dedicated to processing body-related information and different body maps were found. Yet, these representations are still largely implicit and distributed and some functionality is also offloaded to the periphery. Robots, on the other hand, rely almost exclusively on their body models when planning and executing behaviors. I analyze the pros and cons of these different approaches and propose what may be the best solution for robots of the future.


title: Charged Higgs contribution to rare top-quark decay

abstract: The calculation of the rare $t$-quark decay $t \to b W b \bar{b}$ within the Standard Model as well as the charged Higgs contribution to this decay is presented. The role of possible background processes is discussed. It is shown that this decay provides an additional possibility for charged Higgs searches.


title: A computational psycholinguistic evaluation of the syntactic abilities of Galician BERT models at the interface of dependency resolution and training time

abstract: This paper explores the ability of Transformer models to capture subject-verb and noun-adjective agreement dependencies in Galician. We conduct a series of word prediction experiments in which we manipulate dependency length together with the presence of an attractor noun that acts as a lure. First, we evaluate the overall performance of the existing monolingual and multilingual models for Galician. Secondly, to observe the effects of the training process, we compare the different degrees of achievement of two monolingual BERT models at different training points. We also release their checkpoints and propose an alternative evaluation metric. Our results confirm previous findings by similar works that use the agreement prediction task and provide interesting insights into the number of training steps required by a Transformer model to solve long-distance dependencies.


title: Analytic smoothing effect of the time variable for the spatially homogeneous Landau equation

abstract: In this work, we study the Cauchy problem of the spatially homogeneous Landau equation with hard potentials in a close-to-quilibrium framework. We prove that the solution to the Cauchy problem enjoys the analytic regularizing effect of the time variable with an L2 initial datum for positive time. So that the smoothing effect of Cauchy problem for the spatially homogeneous Landau equation with hard potentials is exactly same as heat equation.


title: Pervasive wireless channel modeling theory and applications to 6G GBSMs for all frequency bands and all scenarios

abstract: In this paper, a pervasive wireless channel modeling theory is first proposed, which uses a unified channel modeling method and a unified equation of channel impulse response (CIR), and can integrate important channel characteristics at different frequency bands and scenarios. Then, we apply the proposed theory to a three dimensional (3D) space-time-frequency (STF) non-stationary geometry-based stochastic model (GBSM) for the sixth generation (6G) wireless communication systems. The proposed 6G pervasive channel model (6GPCM) can characterize statistical properties of channels at all frequency bands from sub-6 GHz to visible light communication (VLC) bands and all scenarios such as unmanned aerial vehicle (UAV), maritime, (ultra-)massive multiple-input multiple-output (MIMO), reconfigurable intelligent surface (RIS), and industry Internet of things (IIoT) scenarios. By adjusting channel model parameters, the 6GPCM can be reduced to various simplified channel models for specific frequency bands and scenarios. Also, it includes standard fifth generation (5G) channel models as special cases. In addition, key statistical properties of the proposed 6GPCM are derived, simulated, and verified by various channel measurement results, which clearly demonstrates its accuracy, pervasiveness, and applicability.


title: Spam Detection Using BERT

abstract: Emails and SMSs are the most popular tools in today communications, and as the increase of emails and SMSs users are increase, the number of spams is also increases. Spam is any kind of unwanted, unsolicited digital communication that gets sent out in bulk, spam emails and SMSs are causing major resource wastage by unnecessarily flooding the network links. Although most spam mail originate with advertisers looking to push their products, some are much more malicious in their intent like phishing emails that aims to trick victims into giving up sensitive information like website logins or credit card information this type of cybercrime is known as phishing. To countermeasure spams, many researches and efforts are done to build spam detectors that are able to filter out messages and emails as spam or ham. In this research we build a spam detector using BERT pre-trained model that classifies emails and messages by understanding to their context, and we trained our spam detector model using multiple corpuses like SMS collection corpus, Enron corpus, SpamAssassin corpus, Ling-Spam corpus and SMS spam collection corpus, our spam detector performance was 98.62%, 97.83%, 99.13% and 99.28% respectively. Keywords: Spam Detector, BERT, Machine learning, NLP, Transformer, Enron Corpus, SpamAssassin Corpus, SMS Spam Detection Corpus, Ling-Spam Corpus.


title: Change of superconducting character in UTe2induced by magnetic field

abstract: UTe2 is a recently discovered spin-triplet superconductor. One of the characteristic features of UTe2 is a magnetic field (H)-boosted superconductivity above 16 T when H is applied exactly parallel to the b axis. To date, this superconducting (SC) state has not been thoroughly investigated, and the SC properties as well as the spin state of this high-H SC (HHSC) phase are not well understood. In this study, we performed AC magnetic susceptibility and nuclear magnetic resonance (NMR) measurements and found that, up to 24.8 T, the HHSC state is intrinsic to UTe2 and quite sensitive to the H angle, and that its SC character is different from that in the low-H SC (LHSC) state. The dominant spin component of the spin-triplet pair is along the a axis in the LHSC state but is changed in the HHSC state along the b axis. Our results indicate that H-induced multiple SC states originate from the remaining spin degrees of freedom.


title: A ghost perturbation scheme to solve ordinary differential equations

abstract: We propose an algebraic method that finds a sequence of functions that exponentially approach the solution of any second-order ordinary differential equation (ODE) with any boundary conditions. We define an extended ODE (eODE) composed of a linear generic differential operator that depends on free parameters, $p$, plus an $\epsilon$ perturbation formed by the original ODE minus the same linear term. After the eODE's formal $\epsilon$ expansion of the solution, we can solve order by order a hierarchy of linear ODEs, and we get a sequence of functions $y_n(x;\epsilon,p)$ where $n$ indicates the number of terms that we keep in the $\epsilon$-expansion. We fix the parameters to the optimal values $p^*(n)$ by minimizing a distance function of $y_n$ to the ODE's solution, $y$, over a given $x$-interval. We see that the eODE's perturbative solution converges exponentially fast in $n$ to the ODE solution when $\epsilon=1$: $\vert y_n(x;\epsilon=1,p^*(n))-y(x)\vert<C\delta^{n+1}$ with $\delta<1$. The method permits knowing the number of solutions for Boundary Value Problems just by looking at the number of minima of the distance function at each order in $n$, $p^{*,\alpha}(n)$, where each $\alpha$ defines a sequence of functions $y_n$ that converges to one of the ODE's solutions. We present the method by its application to several cases where we discuss its properties, benefits and shortcomings, and some practical algorithmic improvements.


title: MADYS: the Manifold Age Determination for Young Stars

abstract: The unrivalled astrometric and photometric capabilities of the Gaia mission have given new impetus to the study of young stars: both from an environmental perspective, as members of comoving star-forming regions, and from an individual perspective, as targets amenable to planet-hunting direct-imaging observations. In view of the large availability of theoretical evolutionary models, both fields would benefit from a unified framework that allows a straightforward comparison of physical parameters obtained by different stellar and substellar models. To this aim, we developed the Manifold Age Determination for Young Stars (MADYS), a flexible Python tool for the age and mass determination of young stellar and substellar objects. In this first release, MADYS automatically retrieves and crossmatches photometry from several catalogs, estimates interstellar extinction, and derives age and mass estimates for individual objects through isochronal fitting. Harmonizing the heterogeneity of publicly available isochrone grids, the tool allows one to choose amongst 17 models, many of which with customizable astrophysical parameters, for a total of $\sim 110$ isochrone grids. Several dedicated plotting functions are provided to allow for an intuitive visual perception of the numerical output. After extensive testing, we have made the tool publicly available. Here, we demonstrate the capabilities of MADYS, summarizing previously published results as well providing several new examples.

categories: astro-ph.SR astro-ph.EP astro-ph.GA astro-ph.IM


title: Model predictive eco-driving control for heavy-duty trucks using Branch and Bound optimization

abstract: Eco-driving (ED) can be used for fuel savings in existing vehicles, requiring only a few hardware modifications. For this technology to be successful in a dynamic environment, ED requires an online real-time implementable policy. In this work, a dedicated Branch and Bound (BnB) model predictive control (MPC) algorithm is proposed to solve the optimization part of an ED optimal control problem. The developed MPC solution for ED is based on the following ingredients. As a prediction model, the velocity dynamics as a function of distance is modeled by a finite number of driving modes and gear positions. Then we formulate an optimization problem that minimizes a cost function with two terms: one penalizing the fuel consumption and one penalizing the trip duration. We exploit contextual elements and use a warm-started solution to make the BnB solver run in real-time. The results are evaluated in numerical simulations on two routes in Israel and France and the long haul cycle of the Vehicle Energy consumption Calculation Tool (VECTO). In comparison with a human driver and a Pontryagin's Minimum Principle (PMP) solution, 25.8% and 12.9% fuel savings, respectively, are achieved on average.


title: Car-Sharing Subscription Preferences: The Case of Copenhagen, Munich, and Tel Aviv-Yafo

abstract: Car-sharing services have been providing short-term car access to their users, contributing to sustainable urban mobility and generating positive societal and often environmental impacts. As car-sharing business models vary, it is important to understand what features drive the attraction and retention of its members in different contexts. For that, it is essential to examine individuals preferences for subscriptions to different business models and what they perceive as most relevant, as well as understand what could be attractive incentives. This study aims precisely to examine individuals preferences for the subscription of different car-sharing services in different cities. We designed a stated preference experiment and collected data from three different urban car-sharing settings, namely Copenhagen, Munich, and Tel Aviv-Yafo. Then a mixed logit model was estimated to uncover car-sharing plan subscription and incentives preferences. The results improve our understanding of how both the features of the car-sharing business model and the provision of incentives can maintain and attract members to the system. The achieved insights pave the road for the actual design of car-sharing business models and incentives that can be offered by existing and future car-sharing companies in the studied or similar cities.


title: Class Prior Estimation under Covariate Shift: No Problem?

abstract: We show that in the context of classification the property of source and target distributions to be related by covariate shift may be lost if the information content captured in the covariates is reduced, for instance by dropping components or mapping into a lower-dimensional or finite space. As a consequence, under covariate shift simple approaches to class prior estimation in the style of classify and count with or without adjustment are infeasible. We prove that transformations of the covariates that preserve the covariate shift property are necessarily sufficient in the statistical sense for the full set of covariates. A probing algorithm as alternative approach to class prior estimation under covariate shift is proposed.


title: Optimization-based Block Coordinate Gradient Coding for Mitigating Partial Stragglers in Distributed Learning

abstract: Gradient coding schemes effectively mitigate full stragglers in distributed learning by introducing identical redundancy in coded local partial derivatives corresponding to all model parameters. However, they are no longer effective for partial stragglers as they cannot utilize incomplete computation results from partial stragglers. This paper aims to design a new gradient coding scheme for mitigating partial stragglers in distributed learning. Specifically, we consider a distributed system consisting of one master and N workers, characterized by a general partial straggler model and focuses on solving a general large-scale machine learning problem with L model parameters using gradient coding. First, we propose a coordinate gradient coding scheme with L coding parameters representing L possibly different diversities for the L coordinates, which generates most gradient coding schemes. Then, we consider the minimization of the expected overall runtime and the maximization of the completion probability with respect to the L coding parameters for coordinates, which are challenging discrete optimization problems. To reduce computational complexity, we first transform each to an equivalent but much simpler discrete problem with N\llL variables representing the partition of the L coordinates into N blocks, each with identical redundancy. This indicates an equivalent but more easily implemented block coordinate gradient coding scheme with N coding parameters for blocks. Then, we adopt continuous relaxation to further reduce computational complexity. For the resulting minimization of expected overall runtime, we develop an iterative algorithm of computational complexity O(N^2) to obtain an optimal solution and derive two closed-form approximate solutions both with computational complexity O(N). For the resultant maximization of the completion probability, we develop an iterative algorithm of...


title: Component-wise iterative ensemble Kalman inversion for static Bayesian models with unknown measurement error covariance

abstract: The ensemble Kalman filter (EnKF) is a Monte Carlo approximation of the Kalman filter for high dimensional linear Gaussian state space models. EnKF methods have also been developed for parameter inference of static Bayesian models with a Gaussian likelihood, in a way that is analogous to likelihood tempering sequential Monte Carlo (SMC). These methods are commonly referred to as ensemble Kalman inversion (EKI). Unlike SMC, the inference from EKI is only asymptotically unbiased if the likelihood is linear Gaussian and the priors are Gaussian. However, EKI is significantly faster to run. Currently, a large limitation of EKI methods is that the covariance of the measurement error is assumed to be fully known. We develop a new method, which we call component-wise iterative ensemble Kalman inversion (CW-IEKI), that allows elements of the covariance matrix to be inferred alongside the model parameters at negligible extra cost. This novel method is compared to SMC on three different application examples: a model of nitrogen mineralisation in soil that is based on the Agricultural Production Systems Simulator (APSIM), a model predicting seagrass decline due to stress from water temperature and light, and a model predicting coral calcification rates. On all of these examples, we find that CW-IEKI has relatively similar predictive performance to SMC, albeit with greater uncertainty, and it has a significantly faster run time.


title: Universal Photometric Stereo Network using Global Lighting Contexts

abstract: This paper tackles a new photometric stereo task, named universal photometric stereo. Unlike existing tasks that assumed specific physical lighting models; hence, drastically limited their usability, a solution algorithm of this task is supposed to work for objects with diverse shapes and materials under arbitrary lighting variations without assuming any specific models. To solve this extremely challenging task, we present a purely data-driven method, which eliminates the prior assumption of lighting by replacing the recovery of physical lighting parameters with the extraction of the generic lighting representation, named global lighting contexts. We use them like lighting parameters in a calibrated photometric stereo network to recover surface normal vectors pixelwisely. To adapt our network to a wide variety of shapes, materials and lightings, it is trained on a new synthetic dataset which simulates the appearance of objects in the wild. Our method is compared with other state-of-the-art uncalibrated photometric stereo methods on our test data to demonstrate the significance of our method.


title: Hamiltonian Formalism for dynamics of particles in MOG

abstract: MOG as a modified gravity theory is designed to be replaced with dark matter. In this theory, in addition to the metric tensor, a massive vector is a gravity field where each particle has a charge proportional to the inertial mass and couples to the vector field through the four-velocity of a particle. In this work, we present the Hamiltonian formalism for the dynamics of particles in this theory. The advantage of Hamiltonian formalism is a better understanding and analyzing the dynamics of massive and massless particles. The massive particles deviate from the geodesics of space-time and photons follow the geodesics. We also study the dynamics of particles in the Newtonian and post-Newtonian regimes for observational purposes. An important result of Hamiltonian formalism is that while lensing on large scales is compatible with the observations, however the deflection angle from stellar size lensing is larger than General Relativity. This result can rule out this theory unless we introduce a screening mechanism to change the effective gravitational constant near compact objects like stars.


title: What do CNNs Learn in the First Layer and Why? A Linear Systems Perspective

abstract: It has previously been reported that the representation that is learned in the first layer of deep Convolutional Neural Networks (CNNs) is highly consistent across initializations and architectures. In this work, we quantify this consistency by considering the first layer as a filter bank and measuring its energy distribution. We find that the energy distribution is very different from that of the initial weights and is remarkably consistent across random initializations, datasets, architectures and even when the CNNs are trained with random labels. In order to explain this consistency, we derive an analytical formula for the energy profile of linear CNNs and show that this profile is mostly dictated by the second order statistics of image patches in the training set and it will approach a whitening transformation when the number of iterations goes to infinity. Finally, we show that this formula for linear CNNs also gives an excellent fit for the energy profiles learned by commonly used nonlinear CNNs such as ResNet and VGG, and that the first layer of these CNNs indeed perform approximate whitening of their inputs.


title: Mean Estimation in High-Dimensional Binary Markov Gaussian Mixture Models

abstract: We consider a high-dimensional mean estimation problem over a binary hidden Markov model, which illuminates the interplay between memory in data, sample size, dimension, and signal strength in statistical inference. In this model, an estimator observes $n$ samples of a $d$-dimensional parameter vector $\theta_{*}\in\mathbb{R}^{d}$, multiplied by a random sign $ S_i $ ($1\le i\le n$), and corrupted by isotropic standard Gaussian noise. The sequence of signs $\{S_{i}\}_{i\in[n]}\in\{-1,1\}^{n}$ is drawn from a stationary homogeneous Markov chain with flip probability $\delta\in[0,1/2]$. As $\delta$ varies, this model smoothly interpolates two well-studied models: the Gaussian Location Model for which $\delta=0$ and the Gaussian Mixture Model for which $\delta=1/2$. Assuming that the estimator knows $\delta$, we establish a nearly minimax optimal (up to logarithmic factors) estimation error rate, as a function of $\|\theta_{*}\|,\delta,d,n$. We then provide an upper bound to the case of estimating $\delta$, assuming a (possibly inaccurate) knowledge of $\theta_{*}$. The bound is proved to be tight when $\theta_{*}$ is an accurately known constant. These results are then combined to an algorithm which estimates $\theta_{*}$ with $\delta$ unknown a priori, and theoretical guarantees on its error are stated.


title: Noise-induced quantum synchronization

abstract: Synchronization is a widespread phenomenon in science and technology. We here study noise-induced synchronization in a quantum spin chain subjected to local Gaussian white noise. We demonstrate stable (anti)synchronization between the endpoint magnetizations of a quantum $XY$ model with transverse field of arbitrary length. Remarkably, we show that noise applied to a single spin suffices to reach stable (anti)synchronization, and demonstrate that the two synchronized end spins are entangled. We additionally determine the optimal noise amplitude that leads to the fastest synchronization along the chain, and further compare the optimal synchronization speed to the fundamental Lieb-Robinson bound for information propagation.


title: Improving Contrastive Learning of Sentence Embeddings with Case-Augmented Positives and Retrieved Negatives

abstract: Following SimCSE, contrastive learning based methods have achieved the state-of-the-art (SOTA) performance in learning sentence embeddings. However, the unsupervised contrastive learning methods still lag far behind the supervised counterparts. We attribute this to the quality of positive and negative samples, and aim to improve both. Specifically, for positive samples, we propose switch-case augmentation to flip the case of the first letter of randomly selected words in a sentence. This is to counteract the intrinsic bias of pre-trained token embeddings to frequency, word cases and subwords. For negative samples, we sample hard negatives from the whole dataset based on a pre-trained language model. Combining the above two methods with SimCSE, our proposed Contrastive learning with Augmented and Retrieved Data for Sentence embedding (CARDS) method significantly surpasses the current SOTA on STS benchmarks in the unsupervised setting.


title: The fundamental metallicity relation from SDSS (z~0) to VIPERS (z~0.7) Data selection or evolution

abstract: Aims. We focus on how to homogenize the comparison between galaxy samples having different characteristics. We check the projections of the fundamental metallicity relation (FMR) and the evolution of these projections between a sample selected at $z\sim0$ (SDSS) and $z\sim0.7$ (VIPERS). We check, in particular, whether and to what extent selection criteria can affect the results. Methods. We checked the influence of different biases introduced either by physical constraints (evolution of the luminosity function and differences in the fraction of blue galaxies) or data selection (the signal-to-noise ratio and quality of the spectra) on the FMR and its projections. To separate the differences occurring due to the physical evolution of galaxies with redshift from the false evolution mimed by these biases, we first analyzed the effects of these biases individually on the SDSS sample, and next, starting from the SDSS data, we built a VIPERS-equivalent $z \sim 0$ sample, replicating the main characteristics of VIPERS sample at $z\sim0.7$ for a fair comparison. Results. We found that the FMR projections are all sensitive to biases introduced by the selection on S/N and the quality flags of the emission line measurements in the spectra, especially the $\left[\text{O{\,\sc{iii}}}\right]\lambda 4959$ line. The exception is the metallicity versus the sSFR plane which is insensitive to these biases. The evolution of the luminosity function introduces a bias only in the plane metallicity versus the star formation rate (SFR) while the fraction of blue galaxies has no impact on results.


title: A bit better: Variants of duality in geometric algebras with degenerate metrics

abstract: Multiplication by the pseudoscalar $\mathbf{I}$ has been traditionally used in geometric algebra to perform non-metric operations such as calculating coordinates and the regressive product. In algebras with degenerate metrics, such as euclidean PGA $P(\mathbb{R}^*_{3,0,1})$, this approach breaks down, leading to a search for non-metric forms of duality. The article compares the dual coordinate map $J: G \rightarrow G^*$, a double algebra duality, and Hodge duality $H: G \rightarrow G $, a single algebra duality for this purpose. While the two maps are computationally identical, only $J$ is coordinate-free and provides direct support for geometric duality, whereby every geometric primitive appears twice, once as a point-based and once as a plane-based form, an essential feature not only of projective geometry but also of euclidean kinematics and dynamics. Our analysis concludes with a proposed duality-neutral software implementation, requiring a single bit field per multi-vector.


title: Probing spin dynamics of ultra-thin van der Waals magnets via photon-magnon coupling

abstract: Layered van der Waals (vdW) magnets can maintain a magnetic order even down to the single-layer regime and hold promise for integrated spintronic devices. While the magnetic ground state of vdW magnets was extensively studied, key parameters of spin dynamics, like the Gilbert damping, crucial for designing ultra-fast spintronic devices, remains largely unexplored. Despite recent studies by optical excitation and detection, achieving spin wave control with microwaves is highly desirable, as modern integrated information technologies predominantly are operated with these. The intrinsically small numbers of spins, however, poses a major challenge to this. Here, we present a hybrid approach to detect spin dynamics mediated by photon-magnon coupling between high-Q superconducting resonators and ultra-thin flakes of Cr$_2$Ge$_2$Te$_6$ (CGT) as thin as 11\,nm. We test and benchmark our technique with 23 individual CGT flakes and extract an upper limit for the Gilbert damping parameter. These results are crucial in designing on-chip integrated circuits using vdW magnets and offer prospects for probing spin dynamics of monolayer vdW magnets.


title: Multiwavelength observations of MAXI J1820+070 during its outburst decay and subsequent mini-outburst

abstract: We present results from quasi-simultaneous multiwavelength observations of the Galactic black hole X-ray transient MAXI J1820$+$070 during the decay of the 2018 outburst and its entire subsequent mini-outburst in March 2019. We fit the X-ray spectra with phenomenological and Comptonizaton models and discuss the X-ray spectral evolution comparing with the multiwavelength behaviour of the system. The system showed a rebrightening in UV/Optical/NIR bands 7-days after the soft-to-hard transition during the main outburst decay while it was fading in X-rays and radio. In contrast, the mini-outburst occurred 165-days after the hard state transition of the initial outburst decay and was detected in all wavelengths. For both events, the measured timescales are consistent with those observed in other black hole systems. Contemporaneous hard X-ray/soft $\gamma$-ray observations indicate a non-thermal electron energy distribution at the beginning of the UV/Optical/NIR rebrightening, whereas a thermal distribution can fit the data during the hard mini-outburst activity. The broadband spectral energy distributions until the rebrightening are consistent with the irradiated outer accretion disc model. However, both the SEDs produced for the peak of rebrightening and close to the peak of mini-outburst provided good fits only with an additional power-law component in the UV/Optical/NIR frequency ranges which is often interpreted with a jet origin.


title: Achieving Goals using Reward Shaping and Curriculum Learning

abstract: Real-time control for robotics is a popular research area in the reinforcement learning community. Through the use of techniques such as reward shaping, researchers have managed to train online agents across a multitude of domains. Despite these advances, solving goal-oriented tasks still requires complex architectural changes or hard constraints to be placed on the problem. In this article, we solve the problem of stacking multiple cubes by combining curriculum learning, reward shaping, and a high number of efficiently parallelized environments. We introduce two curriculum learning settings that allow us to separate the complex task into sequential sub-goals, hence enabling the learning of a problem that may otherwise be too difficult. We focus on discussing the challenges encountered while implementing them in a goal-conditioned environment. Finally, we extend the best configuration identified on a higher complexity environment with differently shaped objects.


title: Approximation with Independent Variables

abstract: Given a square integrable m-dimensional random variable $X$ on a probability space $(\Omega.\mathcal F,\Pr)$ and a sub sigma algebra $\mathcal A$, we show that there exists another m-dimensional random variable $Y$, independent of $\mathcal A$ and minimising the $L^2$ distance to $X$. Such results have an importance to fairness and bias reduction in Artificial Intelligence, Machine Learning and Network Theory.


title: Powerful laser-produced quasi-half-cycle THz pulses

abstract: The Maxwell equations based 3D analytical solution for the terahertz half-cycle electromagnetic wave transition radiation pulse has been found. This solution describes generation and propagation of transition radiation into free space from laser-produced relativistic electron bunch crossing a target-vacuum interface as a result of ultrashort laser pulse interaction with a thin high-conductivity target. The analytical solution found complements the theory of laser initiated transition radiation by describing the generated THz wave shape at the arbitrary distance from the generating target surface domain including near-field zone rather than the standard far-field characterization. The analytical research has also been supplemented with the 3D simulations using the finite-diference time-domain (FDTD) method, which makes it possible for description of much wider spatial domain as compared to that from the particle-in-cell (PIC) approach. The results reported fundamentally shed light on the interfere of an electron bunch field and THz field of broadband transition radiation from laser-plasma interaction studied for a long time in the experiments with solid density plasma and may in future inspire them to targeted measurements and investigations of unique super intense half-cycle THz radiation waves near the laser target.


title: Virtual Homogeneity Learning: Defending against Data Heterogeneity in Federated Learning

abstract: In federated learning (FL), model performance typically suffers from client drift induced by data heterogeneity, and mainstream works focus on correcting client drift. We propose a different approach named virtual homogeneity learning (VHL) to directly "rectify" the data heterogeneity. In particular, VHL conducts FL with a virtual homogeneous dataset crafted to satisfy two conditions: containing no private information and being separable. The virtual dataset can be generated from pure noise shared across clients, aiming to calibrate the features from the heterogeneous clients. Theoretically, we prove that VHL can achieve provable generalization performance on the natural distribution. Empirically, we demonstrate that VHL endows FL with drastically improved convergence speed and generalization performance. VHL is the first attempt towards using a virtual dataset to address data heterogeneity, offering new and effective means to FL.


title: Exclusive Lepton Pair Production at the Electron-Ion Collider -- A Powerful Research Tool

abstract: The two-photon exclusive production of lepton pairs at the Electron-Ion Collider will open interesting research directions thanks to a very high luminosity and clean experimental conditions. A survey of the scientific potential of such studies is reported. In particular, we consider unique measurements of the proton elastic electromagnetic form-factors and a possibility of studying the anomalous electromagnetic dipole moments of $\tau$ leptons.


title: Neural network model for imprecise regression with interval dependent variables

abstract: This paper presents a computationally feasible method to compute rigorous bounds on the interval-generalisation of regression analysis to account for epistemic uncertainty in the output variables. The new iterative method uses machine learning algorithms to fit an imprecise regression model to data that consist of intervals rather than point values. The method is based on a single-layer interval neural network which can be trained to produce an interval prediction. It seeks parameters for the optimal model that minimizes the mean squared error between the actual and predicted interval values of the dependent variable using a first-order gradient-based optimization and interval analysis computations to model the measurement imprecision of the data. An additional extension to a multi-layer neural network is also presented. We consider the explanatory variables to be precise point values, but the measured dependent values are characterized by interval bounds without any probabilistic information. The proposed iterative method estimates the lower and upper bounds of the expectation region, which is an envelope of all possible precise regression lines obtained by ordinary regression analysis based on any configuration of real-valued points from the respective y-intervals and their x-values.


title: An Optimal Transport Approach to Personalized Federated Learning

abstract: Federated learning is a distributed machine learning paradigm, which aims to train a model using the local data of many distributed clients. A key challenge in federated learning is that the data samples across the clients may not be identically distributed. To address this challenge, personalized federated learning with the goal of tailoring the learned model to the data distribution of every individual client has been proposed. In this paper, we focus on this problem and propose a novel personalized Federated Learning scheme based on Optimal Transport (FedOT) as a learning algorithm that learns the optimal transport maps for transferring data points to a common distribution as well as the prediction model under the applied transport map. To formulate the FedOT problem, we extend the standard optimal transport task between two probability distributions to multi-marginal optimal transport problems with the goal of transporting samples from multiple distributions to a common probability domain. We then leverage the results on multi-marginal optimal transport problems to formulate FedOT as a min-max optimization problem and analyze its generalization and optimization properties. We discuss the results of several numerical experiments to evaluate the performance of FedOT under heterogeneous data distributions in federated learning problems.


title: Complete hyperentangled Greenberger-Horne-Zeilinger state analysis for polarization and time-bin hyperentanglement

abstract: We present an efficient scheme for the complete analysis of hyperentangled Greenberger-Horne-Zeilinger (GHZ) state in polarization and time-bin degrees of freedom with two steps. First, the polarization GHZ state is distinguished completely and nondestructively, resorting to the controlled phase flip (CPF) gate constructed by the cavity-assisted interaction. Subsequently, the time-bin GHZ state is analyzed by using the preserved polarization entanglement. With the help of CPF gate and self-assisted mechanism, our scheme can be directly generalized to the complete N-photon hyperentangled GHZ state analysis, and it may have potential applications in the hyperentanglement-based quantum communication.