title: NEWTS: A Corpus for News Topic-Focused Summarization

abstract: Text summarization models are approaching human levels of fidelity. Existing benchmarking corpora provide concordant pairs of full and abridged versions of Web, news or, professional content. To date, all summarization datasets operate under a one-size-fits-all paradigm that may not reflect the full range of organic summarization needs. Several recently proposed models (e.g., plug and play language models) have the capacity to condition the generated summaries on a desired range of themes. These capacities remain largely unused and unevaluated as there is no dedicated dataset that would support the task of topic-focused summarization. This paper introduces the first topical summarization corpus NEWTS, based on the well-known CNN/Dailymail dataset, and annotated via online crowd-sourcing. Each source article is paired with two reference summaries, each focusing on a different theme of the source document. We evaluate a representative range of existing techniques and analyze the effectiveness of different prompting methods.


title: Summary of Working Group 4: Mixing and mixing-related $CP$ violation in the $B$ system: $\Delta m$, $\Delta \Gamma$, $\phi_s$, $\phi_{1}/\beta$, $\phi_{2}/\alpha$, $\phi_{3}/\gamma$

abstract: This summary reviews contributions to the CKM 2021 workshop in Working Group 4. In particular, theoretical and experimental progress in determining $B$ meson mixing properties are discussed.


title: Multi-task Optimization Based Co-training for Electricity Consumption Prediction

abstract: Real-world electricity consumption prediction may involve different tasks, e.g., prediction for different time steps ahead or different geo-locations. These tasks are often solved independently without utilizing some common problem-solving knowledge that could be extracted and shared among these tasks to augment the performance of solving each task. In this work, we propose a multi-task optimization (MTO) based co-training (MTO-CT) framework, where the models for solving different tasks are co-trained via an MTO paradigm in which solving each task may benefit from the knowledge gained from when solving some other tasks to help its solving process. MTO-CT leverages long short-term memory (LSTM) based model as the predictor where the knowledge is represented via connection weights and biases. In MTO-CT, an inter-task knowledge transfer module is designed to transfer knowledge between different tasks, where the most helpful source tasks are selected by using the probability matching and stochastic universal selection, and evolutionary operations like mutation and crossover are performed for reusing the knowledge from selected source tasks in a target task. We use electricity consumption data from five states in Australia to design two sets of tasks at different scales: a) one-step ahead prediction for each state (five tasks) and b) 6-step, 12-step, 18-step, and 24-step ahead prediction for each state (20 tasks). The performance of MTO-CT is evaluated on solving each of these two sets of tasks in comparison to solving each task in the set independently without knowledge sharing under the same settings, which demonstrates the superiority of MTO-CT in terms of prediction accuracy.


title: Qualitative properties of solutions to a nonlinear time-space fractional diffusion equation

abstract: In the present paper, we study the Cauchy-Dirichlet problem to the nonlocal nonlinear diffusion equation with polynomial nonlinearities $$\mathcal{D}_{0|t}^{\alpha }u+(-\Delta)^s_pu=\gamma|u|^{m-1}u+\mu|u|^{q-2}u,\,\gamma,\mu\in\mathbb{R},\,m>0,q>1,$$ involving time-fractional Caputo derivative $\mathcal{D}_{0|t}^{\alpha}$ and space-fractional $p$-Laplacian operator $(-\Delta)^s_p$. We give a simple proof of the comparison principle for the considered problem using purely algebraic relations, for different sets of $\gamma,\mu,m$ and $q$. The Galerkin approximation method is used to prove the existence of a local weak solution. The blow-up phenomena, existence of global weak solutions and asymptotic behavior of global solutions are classified using the comparison principle.


title: Pitfalls in gpr data interpretation: false reflectors detected in lunar radar cross sections by Chang'e-3

abstract: Chang'e-3(CE-3) has been the first spacecraft to soft-land on the Moon since the Soviet Union's Luna 24 in 1976. The spacecraft arrived at Mare Imbrium on December 14, 2013 and the same day, Yutu lunar rover separated from lander to start its exploration of the surface and the subsurface around the landing site. The rover was equipped, among other instruments, with two Lunar Penetrating Radar systems (LPR) having a working frequency of 60 and 500 MHz. The radars acquired data for about two weeks while the rover was slowly moving along a path of about 114 m. At Navigation point N0209 the rover got stacked into the lunar soil and after that only data at fixed position could be collected. The low frequency radar data have been analyzed by different authors and published in two different papers, which reported totally controversial interpretations of the radar cross sections. The present study is devoted to resolve such controversy carefully analyzing and comparing the data collected on the Moon by Yutu rover and on Earth by a prototype of LRP mounted onboard a model of the CE-3 lunar rover. Such analysis demonstrates that the deep radar features previously ascribed to the lunar shallow stratigraphy are not real reflectors, rather they are signal artefacts probably generated by the system and its electromagnetic interaction with the metallic rover.


title: TIC: A Stokes inversion code for scattering polarization with partial frequency redistribution and arbitrary magnetic fields

abstract: We present the Tenerife Inversion Code (TIC), which has been developed to infer the magnetic and plasma properties of the solar chromosphere and transition region via full-Stokes inversion of polarized spectral lines. The code is based on the HanleRT forward engine, which takes into account many of the physical mechanisms that are critical for a proper modeling of the Stokes profiles of spectral lines originating in the tenuous and highly dynamic plasmas of the chromosphere and transition region: quantum level population imbalance and interference (atomic polarization), frequency coherence effects in polarized resonance scattering (partial frequency redistribution), and the impact of arbitrary magnetic fields on the atomic polarization and the radiation field. We present first results of atmospheric and magnetic inversions, and discuss future developments for the project.


title: ViT-BEVSeg: A Hierarchical Transformer Network for Monocular Birds-Eye-View Segmentation

abstract: Generating a detailed near-field perceptual model of the environment is an important and challenging problem in both self-driving vehicles and autonomous mobile robotics. A Bird Eye View (BEV) map, providing a panoptic representation, is a commonly used approach that provides a simplified 2D representation of the vehicle surroundings with accurate semantic level segmentation for many downstream tasks. Current state-of-the art approaches to generate BEV-maps employ a Convolutional Neural Network (CNN) backbone to create feature-maps which are passed through a spatial transformer to project the derived features onto the BEV coordinate frame. In this paper, we evaluate the use of vision transformers (ViT) as a backbone architecture to generate BEV maps. Our network architecture, ViT-BEVSeg, employs standard vision transformers to generate a multi-scale representation of the input image. The resulting representation is then provided as an input to a spatial transformer decoder module which outputs segmentation maps in the BEV grid. We evaluate our approach on the nuScenes dataset demonstrating a considerable improvement in the performance relative to state-of-the-art approaches.


title: On the Steady-State Behavior of Finite-Control-Set MPC with an Application to High-Precision Power Amplifiers

abstract: Motivated by increasing precision requirements for switched power amplifiers, this paper addresses the problem of model predictive control (MPC) design for discrete-time linear systems with a finite control set (FCS). Typically, existing solutions for FCS-MPC penalize the output tracking error and the control input rate of change, which can lead to arbitrary switching among the available discrete control inputs and unpredictable steady-state behavior. To improve the steady-state behavior of FCS-MPC, in this paper we design a cost function that penalizes the tracking error with respect to a state and input steady-state limit cycle. We prove that if a suitable terminal cost is added to the FCS-MPC algorithm convergence to the limit cycle is ensured. The developed methodology is validated in direct switching control of a power amplifier for high-precision motion systems, where it significantly improves the steady-state output current ripple.


title: Decentralized Convex Optimization on Time-Varying Networks with Application to Wasserstein Barycenters

abstract: Inspired by recent advances in distributed algorithms for approximating Wasserstein barycenters, we propose a novel distributed algorithm for this problem. The main novelty is that we consider time-varying computational networks, which are motivated by examples when only a subset of sensors can make an observation at each time step, and yet, the goal is to average signals (e.g., satellite pictures of some area) by approximating their barycenter. We embed this problem into a class of non-smooth dual-friendly distributed optimization problems over time-varying networks, and develop a first-order method for this class. We prove non-asymptotic accelerated in the sense of Nesterov convergence rates and explicitly characterise their dependence on the parameters of the network and its dynamics. In the experiments, we demonstrate the efficiency of the proposed algorithm when applied to the Wasserstein barycenter problem.


title: REF: A Rapid Exploration Framework for Deploying Autonomous MAVs in Unknown Environments

abstract: Exploration and mapping of unknown environments is a fundamental task in applications for autonomous robots. In this article, we present a complete framework for deploying MAVs in autonomous exploration missions in unknown subterranean areas. The main motive of exploration algorithms is to depict the next best frontier for the robot such that new ground can be covered in a fast, safe yet efficient manner. The proposed framework uses a novel frontier selection method that also contributes to the safe navigation of autonomous robots in obstructed areas such as subterranean caves, mines, and urban areas. The framework presented in this work bifurcates the exploration problem in local and global exploration. The proposed exploration framework is also adaptable according to computational resources available onboard the robot which means the trade-off between the speed of exploration and the quality of the map can be made. Such capability allows the proposed framework to be deployed in a subterranean exploration, mapping as well as in fast search and rescue scenarios. The overall system is considered a low-complexity and baseline solution for navigation and object localization in tunnel-like environments. The performance of the proposed framework is evaluated in detailed simulation studies with comparisons made against a high-level exploration-planning framework developed for the DARPA Sub-T challenge as it will be presented in this article.


title: Dark boson mediation of the $\pi^0\rightarrow \gamma e^+ e^-$ decay

abstract: The phenomenological implications to the decay of the neutral pion from the introduction of new dark particles are discussed. We calculate the contribution to the $\pi^0$ decay width and then we extend the theory by adding dark sector vector particles which interact through $\gamma^\mu$, $\sigma^{\mu\nu}$ and $\sigma^{\mu\nu}\gamma^5$. We calculate the total decay width of $\pi^0\rightarrow \gamma e^+ e^-$ where the electron-positron pair is produced through a decay of a dark meson. The implication of the presented model on the present and future searches for new dark particles is also discussed.


title: Intrinsic shapes of Brightest Cluster Galaxies

abstract: We discuss the statistical distribution of galaxy shapes and viewing angles under the assumption of triaxiality by deprojecting observed Surface Brightness (SB) profiles of 56 Brightest Cluster Galaxies coming from a recently published large deep-photometry sample. For the first time, we address this issue by directly measuring axis ratio profiles without limiting ourselves to a statistical analysis of average ellipticities. We show that these objects are strongly triaxial, with triaxiality parameters 0.39 $ \leq T \leq $ 0.72, have on average axis ratios $< p(r) > = $ 0.84 and $< q(r) > =$ 0.68, and are more spherical in the central regions but flatten out at large radii. Measured shapes in the outskirts agree well with the shapes found for simulated massive galaxies and their dark matter halos from both the IllustrisTNG and the Magneticum simulations, possibly probing the nature of dark matter. In contrast, both simulations fail to reproduce the observed inner regions of BCGs, producing too flattened objects.


title: Dynamic interventions with limited knowledge in network games

abstract: This paper studies the problem of intervention design for steering the actions of noncooperative players in quadratic network games to the social optimum. The players choose their actions with the aim of maximizing their individual payoff functions, while a central regulator uses interventions to modify their marginal returns and maximize the social welfare function. This work builds on the key observation that the solution to the steering problem depends on the knowledge of the regulator on the players' parameters and the underlying network. We, therefore, consider different scenarios based on limited knowledge and propose suitable static, dynamic and adaptive intervention protocols. We formally prove convergence to the social optimum under the proposed mechanisms. We demonstrate our theoretical findings on a case study of Cournot competition with differentiated goods.


title: Generalised Implicit Neural Representations

abstract: We consider the problem of learning implicit neural representations (INRs) for signals on non-Euclidean domains. In the Euclidean case, INRs are trained on a discrete sampling of a signal over a regular lattice. Here, we assume that the continuous signal exists on some unknown topological space from which we sample a discrete graph. In the absence of a coordinate system to identify the sampled nodes, we propose approximating their location with a spectral embedding of the graph. This allows us to train INRs without knowing the underlying continuous domain, which is the case for most graph signals in nature, while also making the INRs independent of any choice of coordinate system. We show experiments with our method on various real-world signals on non-Euclidean domains.


title: Contrastive Representation Learning for 3D Protein Structures

abstract: Learning from 3D protein structures has gained wide interest in protein modeling and structural bioinformatics. Unfortunately, the number of available structures is orders of magnitude lower than the training data sizes commonly used in computer vision and machine learning. Moreover, this number is reduced even further, when only annotated protein structures can be considered, making the training of existing models difficult and prone to over-fitting. To address this challenge, we introduce a new representation learning framework for 3D protein structures. Our framework uses unsupervised contrastive learning to learn meaningful representations of protein structures, making use of proteins from the Protein Data Bank. We show, how these representations can be used to solve a large variety of tasks, such as protein function prediction, protein fold classification, structural similarity prediction, and protein-ligand binding affinity prediction. Moreover, we show how fine-tuned networks, pre-trained with our algorithm, lead to significantly improved task performance, achieving new state-of-the-art results in many tasks.


title: Quantum phase transition in skewed ladders: an entanglement entropy and fidelity study

abstract: Entanglement entropy (EE) of a state is a measure of correlation or entanglement between two parts of a composite system and it may show appreciable change when the ground state (GS) undergoes a qualitative change in a quantum phase transition (QPT). Therefore, the EE has been extensively used to characterise the QPT in various correlated Hamiltonians. Similarly fidelity also shows sharp changes at a QPT. We characterized the QPT of frustrated antiferromagnetic Heisenberg spin-1/2 systems on 3/4, 3/5 and 5/7 skewed ladders using the EE and fidelity analysis. It is noted that all the non-magnetic to magnetic QPT boundary in these systems can be accurately determined using the EE and fidelity, and the EE exhibits a discontinuous change, whereas fidelity shows a sharp dip at the transition points. It is also noted that in case of the degenerate GS, the unsymmetrized calculations show wild fluctuations in the EE and fidelity even without actual phase transition, however, this problem is resolved by calculating the EE and the fidelity in the lowest energy state of the symmetry subspaces, to which the degenerate states belong.


title: Augmentation-Aware Self-Supervision for Data-Efficient GAN Training

abstract: Training generative adversarial networks (GANs) with limited data is challenging because the discriminator is prone to overfitting. Previously proposed differentiable augmentation demonstrates improved data efficiency of training GANs. However, the augmentation implicitly introduces undesired invariance to augmentation for the discriminator since it ignores the change of semantics in the label space caused by data transformation, which may limit the representation learning ability of the discriminator and ultimately affect the generative modeling performance of the generator. To mitigate the negative impact of invariance while inheriting the benefits of data augmentation, we propose a novel augmentation-aware self-supervised discriminator that predicts the augmentation parameter of the augmented data. Particularly, the prediction targets of real data and generated data are required to be distinguished since they are different during training. We further encourage the generator to adversarially learn from the self-supervised discriminator by generating augmentation-predictable real and not fake data. This formulation connects the learning objective of the generator and the arithmetic $-$ harmonic mean divergence under certain assumptions. We compare our method with state-of-the-art (SOTA) methods using the class-conditional BigGAN and unconditional StyleGAN2 architectures on data-limited CIFAR-10, CIFAR-100, FFHQ, LSUN-Cat, and five low-shot datasets. Experimental results demonstrate significant improvements of our method over SOTA methods in training data-efficient GANs.


abstract: Graph neural architecture search has sparked much attention as Graph Neural Networks (GNNs) have shown powerful reasoning capability in many relational tasks. However, the currently used graph search space overemphasizes learning node features and neglects mining hierarchical relational information. Moreover, due to diverse mechanisms in the message passing, the graph search space is much larger than that of CNNs. This hinders the straightforward application of classical search strategies for exploring complicated graph search space. We propose Automatic Relation-aware Graph Network Proliferation (ARGNP) for efficiently searching GNNs with a relation-guided message passing mechanism. Specifically, we first devise a novel dual relation-aware graph search space that comprises both node and relation learning operations. These operations can extract hierarchical node/relational information and provide anisotropic guidance for message passing on a graph. Second, analogous to cell proliferation, we design a network proliferation search paradigm to progressively determine the GNN architectures by iteratively performing network division and differentiation. The experiments on six datasets for four graph learning tasks demonstrate that GNNs produced by our method are superior to the current state-of-the-art hand-crafted and search-based GNNs. Codes are available at https://github.com/phython96/ARGNP.


title: Existence and construction of voting situations concordant with ranking patterns

abstract: Referring to a standard context of voting theory, and to the classic notion of voting situation, here we show that it is possible to observe any arbitrary set of elections' outcomes, no matter how paradoxical it may appear. On this purpose we use results, presented in a recent paper of us, that hinge on the concept of ranking pattern concordant with a probability model for non-negative random variables and on a related role of special load-sharing models. Our results here will be obtained by suitably extending those therein, and by converting them into the context of voting.


title: Simulator-Based Inference with Waldo: Confidence Regions by Leveraging Prediction Algorithms and Posterior Estimators for Inverse Problems

abstract: Prediction algorithms, such as deep neural networks (DNNs), are used in many domain sciences to directly estimate internal parameters of interest in simulator-based models, especially in settings where the observations include images or complex high-dimensional data. In parallel, modern neural density estimators, such as normalizing flows, are becoming increasingly popular for uncertainty quantification, especially when both parameters and observations are high-dimensional. However, parameter inference is an inverse problem and not a prediction task; thus, an open challenge is to construct conditionally valid and precise confidence regions, with a guaranteed probability of covering the true parameters of the data-generating process, no matter what the (unknown) parameter values are, and without relying on large-sample theory. Many simulator-based inference (SBI) methods are indeed known to produce biased or overly confident parameter regions, yielding misleading uncertainty estimates. This paper presents WALDO, a novel method to construct confidence regions with finite-sample conditional validity by leveraging prediction algorithms or posterior estimators that are currently widely adopted in SBI. WALDO reframes the well-known Wald test statistic, and uses a computationally efficient regression-based machinery for classical Neyman inversion of hypothesis tests. We apply our method to a recent high-energy physics problem, where prediction with DNNs has previously led to estimates with prediction bias. We also illustrate how our approach can correct overly confident posterior regions computed with normalizing flows.


title: The role of multi-parton interactions in doubly-heavy hadron production

abstract: Beauty and charm quarks are ideal probes of pertubative Quantum Chromodymanics in proton-proton collisions, owing to their large masses. In this paper the role of multi-parton interactions in the production of doubly-heavy hadrons is studied using simulation samples generated with Pythia, a Monte Carlo event generator. Comparisons are made to the stand-alone generators BcVegPy and GenXicc. New methods of speeding up Pythia simulations for events containing heavy quarks are described, enabling the production of large samples with multiple heavy-quark pairs. We show that significantly higher production rates of doubly-heavy hadrons are predicted in models that allow heavy quarks originating from different parton-parton interactions (within the same hadron-hadron collision) to combine to form such hadrons. Quantitative predictions are sensitive to the modelling of colour reconnections. We suggest a set of experimental measurements capable of differentiating these additional contributions.


title: Solutions of the matrix equation $p(X)=A$, with polynomial function $p(\lambda)$ over field extensions of $\mathbb{Q}$

abstract: Let $\mathbb{H}$ be a field with $\mathbb{Q}\subset\mathbb{H}\subset\mathbb{C}$, and let $p(\lambda)$ be a polynomial in $\mathbb{H}[\lambda]$, and let $A\in\mathbb{H}^{n\times n}$ be nonderogatory. In this paper we consider the problem of finding a solution $X\in\mathbb{H}^{n\times n}$ to $p(X)=A$. A necessary condition for this to be possible is already known from a paper by M.P. Drazin. Under an additional condition we provide an explicit construction of such solutions. The similarities and differences with the derogatory case will be discussed as well. One of the tools needed in the paper is a new canonical form, which may be of independent interest. It combines elements of the rational canonical form with elements of the Jordan canonical form.


title: Why are NLP Models Fumbling at Elementary Math? A Survey of Deep Learning based Word Problem Solvers

abstract: From the latter half of the last decade, there has been a growing interest in developing algorithms for automatically solving mathematical word problems (MWP). It is a challenging and unique task that demands blending surface level text pattern recognition with mathematical reasoning. In spite of extensive research, we are still miles away from building robust representations of elementary math word problems and effective solutions for the general task. In this paper, we critically examine the various models that have been developed for solving word problems, their pros and cons and the challenges ahead. In the last two years, a lot of deep learning models have recorded competing results on benchmark datasets, making a critical and conceptual analysis of literature highly useful at this juncture. We take a step back and analyse why, in spite of this abundance in scholarly interest, the predominantly used experiment and dataset designs continue to be a stumbling block. From the vantage point of having analyzed the literature closely, we also endeavour to provide a road-map for future math word problem research.


title: All-optical Quantum Vacuum Signals in Two-Beam Collision

abstract: The fundamental theory of quantum electrodynamics predicts the vacuum to resemble a polarizable medium. This gives rise to effective nonlinear interactions between electromagnetic fields and light-by-light scattering phenomena. We study the collision of two optical laser pulses in a pump-probe setup using beams with circular and elliptic cross section and estimate the number of discernible signal photons induced by quantum vacuum nonlinearities. In this analysis we study strategies to optimize the quantum vacuum signal discernible from the background of the driving lasers. One of the main results is that the collision of two maximally focused lasers does not lead to the best discernible signal. Instead, widening the focus typically improves the signal to background separation in the far field.


title: Distance between exceptional points and diabolic points and its implication for the response strength of non-Hermitian systems

abstract: Exceptional points are non-Hermitian degeneracies in open quantum and wave systems at which not only eigenenergies but also the corresponding eigenstates coalesce. This is in strong contrast to degeneracies known from conservative systems, so-called diabolic points, at which only eigenenergies degenerate. Here we connect these two kinds of degeneracies by introducing the concept of the distance of a given exceptional point in matrix space to the set of diabolic points. We prove that this distance determines an upper bound for the response strength of a non-Hermitian system with this exceptional point. A small distance therefore implies a weak spectral response to perturbations and a weak intensity response to excitations. This finding has profound consequences for physical realizations of exceptional points that rely on perturbing a diabolic point. Moreover, we exploit this concept to analyze the limitations of the spectral response strength in passive systems. A number of optical and photonics systems are investigated to illustrate the theory.


title: The NOMAD Artificial-Intelligence Toolkit: Turning materials-science data into knowledge and understanding

abstract: We present the Novel-Materials-Discovery (NOMAD) Artificial-Intelligence (AI) Toolkit, a web-browser-based infrastructure for the interactive AI-based analysis of materials-science findable, accessible, interoperable, and reusable (FAIR) data. The AI Toolkit readily operates on the FAIR data stored in the central server of the NOMAD Archive, the largest database of materials-science data worldwide, as well as locally stored, users' owned data. The NOMAD Oasis, a local, stand alone server can be also used to run the AI Toolkit. By using Jupyter notebooks that run in a web-browser, the NOMAD data can be queried and accessed; data mining, machine learning, and other AI techniques can be then applied to analyse them. This infrastructure brings the concept of reproducibility in materials science to the next level, by allowing researchers to share not only the data contributing to their scientific publications, but also all the developed methods and analytics tools. Besides reproducing published results, users of the NOMAD AI toolkit can modify the Jupyter notebooks towards their own research work.


title: Plug-&-play generation of non-Gaussian states of light at a telecom wavelength

abstract: This work marks an important progress towards practical quantum optical technologies in the continuous variable regime, as it shows the feasibility of experiments where non-Gaussian state generation entirely relies on plug-&-play components from guided-wave optics technologies. This strategy is demonstrated experimentally with the heralded preparation of low amplitude Schr\"odinger cat states based on single-photon subtraction from a squeezed vacuum. All stages of the experiment are based on off-the-shelf fiber components. This leads to a stable, compact, and easily re-configurable realization, fully compatible with existing fibre networks and, more in general, with future out-of-the-laboratory applications.


title: Self-Supervised Learning for Building Damage Assessment from Large-scale xBD Satellite Imagery Benchmark Datasets

abstract: In the field of post-disaster assessment, for timely and accurate rescue and localization after a disaster, people need to know the location of damaged buildings. In deep learning, some scholars have proposed methods to make automatic and highly accurate building damage assessments by remote sensing images, which are proved to be more efficient than assessment by domain experts. However, due to the lack of a large amount of labeled data, these kinds of tasks can suffer from being able to do an accurate assessment, as the efficiency of deep learning models relies highly on labeled data. Although existing semi-supervised and unsupervised studies have made breakthroughs in this area, none of them has completely solved this problem. Therefore, we propose adopting a self-supervised comparative learning approach to address the task without the requirement of labeled data. We constructed a novel asymmetric twin network architecture and tested its performance on the xBD dataset. Experiment results of our model show the improvement compared to baseline and commonly used methods. We also demonstrated the potential of self-supervised methods for building damage recognition awareness.


title: Spin alignment of vector mesons in heavy-ion collisions

abstract: Polarized quarks and antiquarks in high-energy heavy-ion collisions can lead to the spin alignment of vector mesons formed by quark coalescence. Using the relativistic spin Boltzmann equation for vector mesons derived from Kadanoff-Baym equations with an effective quark-meson model for strong interaction and quark coalescence model for hadronizaton, we calculate the spin density matrix element $\rho_{00}$ for $\phi$ mesons and show that anisotropies of local field correlations or fluctuations with respect to the spin quantization direction lead to $\phi$ meson's spin alignment. We propose that the local correlation or fluctuation of $\phi$ fields is the dominant mechanism for the observed the $\phi$ meson's spin alignment and its strength can be extracted from experimental data as functions of collision energies. The calculated transverse momentum dependence of $\rho_{00}$ agrees with STAR's data. We further predict the azimuthal angle dependence of $\rho_{00}$ which can be tested in future experiments.


title: Control of Andreev bound states using superconducting phase texture

abstract: Andreev bound states with opposite phase-inversion asymmetries are observed in local and non-local tunneling spectra at the two ends of a superconductor-semiconductor-superconductor planar Josephson junction in the presence of a perpendicular magnetic field. Spectral signatures agree with a theoretical model, yielding a physical picture in which phase textures in superconducting leads localize and control the position of Andreev bound states in the junction, demonstrating a simple means of controlling the position and size of Andreev states within a planar junction.


title: Fast-Spanning Ant Colony Optimisation (FaSACO) for Mobile Robot Coverage Path Planning

abstract: Coverage Path Planning (CPP) aims at finding an optimal path that covers the whole given space. Due to the NP-hard nature, CPP remains a challenging problem. Bio-inspired algorithms such as Ant Colony Optimisation (ACO) have been exploited to solve the problem because they can utilise heuristic information to mitigate the path planning complexity. This paper proposes the Fast-Spanning Ant Colony Optimisation (FaSACO), where ants can explore the environment with various velocities. By doing so, ants with higher velocities can find destinations or obstacles faster and keep lower velocity ants informed by communicating such information via pheromone trails on the path. This mechanism ensures that the (sub-)~optimal path is found while reducing the overall path planning time. Experimental results show that FaSACO is $19.3-32.3\%$ more efficient than ACO in terms of CPU time, and re-covers $6.9-12.5\%$ less cells than ACO. This makes FaSACO appealing in real-time and energy-limited applications.


title: A class of multidimensional nonlinear diffusions with the Feller property

abstract: In this note we consider a family of nonlinear (conditional) expectations that can be understood as a multidimensional diffusion with uncertain drift and certain volatility. Here, the drift is prescribed by a set-valued function that depends on time and path in a Markovian way. We establish the Feller property for the associated sublinear Markovian semigroup and we observe a smoothing effect as our framework carries enough randomness. Furthermore, we link the corresponding value function to a semilinear Kolmogorov equation.


title: Early dark energy and the screening mechanism

abstract: In the early Universe, dark energy may have a non-negligible contribution. If this dark energy corresponds to an early cosmological constant, it leads to a late-time huge dark energy density which is much larger than what is expected for the current expansion of the Universe. Using a conformal coupling of the quintessence to the dark matter, and based on the screening models, we propose a process to reduce the early dark energy to its ultimate value in the late time. Early and late time dark energies can be unified in a single component, in this way.


title: Data-driven Reference Trajectory Optimization for Precision Motion Systems

abstract: We propose a data-driven optimization-based pre-compensation method to improve the contour tracking performance of precision motion stages by modifying the reference trajectory and without modifying any built-in low-level controllers. The position of the precision motion stage is predicted with data-driven models, a linear low-fidelity model is used to optimize traversal time, by changing the path velocity and acceleration profiles then a non-linear high-fidelity model is used to refine the previously found time-optimal solution. We experimentally demonstrate that the proposed method is capable of simultaneously improving the productivity and accuracy of a high precision motion stage. Given the data-based nature of the models, the proposed method can easily be adapted to a wide family of precision motion systems.


title: On Preemption and Learning in Stochastic Scheduling

abstract: We study single-machine scheduling of jobs, each belonging to a job type that determines its duration distribution. We start by analyzing the scenario where the type characteristics are known and then move to two learning scenarios where the types are unknown: non-preemptive problems, where each started job must be completed before moving to another job; and preemptive problems, where job execution can be paused in the favor of moving to a different job. In both cases, we design algorithms that achieve sublinear excess cost, compared to the performance with known types, and prove lower bounds for the non-preemptive case. Notably, we demonstrate, both theoretically and through simulations, how preemptive algorithms can greatly outperform non-preemptive ones when the durations of different job types are far from one another, a phenomenon that does not occur when the type durations are known.


title: An Informational Space Based Semantic Analysis for Scientific Texts

abstract: One major problem in Natural Language Processing is the automatic analysis and representation of human language. Human language is ambiguous and deeper understanding of semantics and creating human-to-machine interaction have required an effort in creating the schemes for act of communication and building common-sense knowledge bases for the 'meaning' in texts. This paper introduces computational methods for semantic analysis and the quantifying the meaning of short scientific texts. Computational methods extracting semantic feature are used to analyse the relations between texts of messages and 'representations of situations' for a newly created large collection of scientific texts, Leicester Scientific Corpus. The representation of scientific-specific meaning is standardised by replacing the situation representations, rather than psychological properties, with the vectors of some attributes: a list of scientific subject categories that the text belongs to. First, this paper introduces 'Meaning Space' in which the informational representation of the meaning is extracted from the occurrence of the word in texts across the scientific categories, i.e., the meaning of a word is represented by a vector of Relative Information Gain about the subject categories. Then, the meaning space is statistically analysed for Leicester Scientific Dictionary-Core and we investigate 'Principal Components of the Meaning' to describe the adequate dimensions of the meaning. The research in this paper conducts the base for the geometric representation of the meaning of texts.


title: A multiwavelength study of the W33 Main ultracompact HII region

abstract: The dynamics of ionized gas around the W33 Main ultracompact HII region is studied using observations of hydrogen radio recombination lines and a detailed multiwavelength characterization of the massive star-forming region W33 Main is performed. We used the Giant Meterwave Radio Telescope (GMRT) to observe the H167$\alpha$ recombination line at 1.4 GHz at an angular resolution of 10 arcsec, and Karl. G. Jansky Very Large Array (VLA) data acquired in the GLOSTAR survey to study the dynamics of ionized gas. We also observed the radio continuum at 1.4 GHz and 610 MHz with the GMRT and used GLOSTAR 4$-$8 GHz continuum data to characterize the nature of the radio emission. In addition, archival data from submillimeter to near-infrared wavelengths were used to study the dust emission and identify YSOs in the W33 Main star-forming region. The radio recombination lines were detected at good signal to noise in the GLOSTAR data, while the H167$\alpha$ radio recombination line was marginally detected with the GMRT. The spectral index of radio emission in the region determined from GMRT and GLOSTAR shows the emission to be thermal in the entire region. Along with W33 Main, an arc-shaped diffuse continuum source, G12.81$-$0.22, was detected with the GMRT data. The GLOSTAR recombination line data reveal a velocity gradient across W33 Main and G12.81$-$0.22. The electron temperature is found to be 6343 K and 4843 K in W33 Main and G12.81$-$0.22, respectively. The physical properties of the W33 Main molecular clump were derived by modeling the dust emission using data from the ATLASGAL and Hi-GAL surveys and they are consistent with the region being a relatively evolved site of massive star formation. The gas dynamics and physical properties of G12.81$-$0.22 are consistent with the HII region being in an evolved phase and its expansion on account of the pressure difference is slowing down.


title: Entangled biphoton enhanced double quantum coherence signal as a probe for cavity polariton correlations in presence of phonon induced dephasing

abstract: We theoretically propose a biphoton entanglement-enhanced multidimensional spectroscopic technique as a probe for the dissipative polariton dynamics in the ultrafast regime. It is applied to the cavity-confined monomeric photosynthetic complex that represents a prototypical multi-site excitonic quantum aggregate. The proposed technique is shown to be particularly sensitive to inter-manifold polariton coherence between the two and one-excitation subspaces. It is demonstrated to be able to monitor the dynamical role of cavity-mediated excitonic correlations, and dephasing in the presence of phonon-induced dissipation. The non-classicality of the entangled biphoton sources is shown to enhance the ultra-fast and broadband correlation features of the signal, giving an indication about the underlying state correlations responsible for long-range cavity-assisted exciton migration.


title: A novel approach to rating transition modelling via Machine Learning and SDEs on Lie groups

abstract: In this paper, we introduce a novel methodology to model rating transitions with a stochastic process. To introduce stochastic processes, whose values are valid rating matrices, we noticed the geometric properties of stochastic matrices and its link to matrix Lie groups. We give a gentle introduction to this topic and demonstrate how It\^o-SDEs in R will generate the desired model for rating transitions. To calibrate the rating model to historical data, we use a Deep-Neural-Network (DNN) called TimeGAN to learn the features of a time series of historical rating matrices. Then, we use this DNN to generate synthetic rating transition matrices. Afterwards, we fit the moments of the generated rating matrices and the rating process at specific time points, which results in a good fit. After calibration, we discuss the quality of the calibrated rating transition process by examining some properties that a time series of rating matrices should satisfy, and we will see that this geometric approach works very well.


title: Conversational Speech Separation: an Evaluation Study for Streaming Applications

abstract: Continuous speech separation (CSS) is a recently proposed framework which aims at separating each speaker from an input mixture signal in a streaming fashion. Hereafter we perform an evaluation study on practical design considerations for a CSS system, addressing important aspects which have been neglected in recent works. In particular, we focus on the trade-off between separation performance, computational requirements and output latency showing how an offline separation algorithm can be used to perform CSS with a desired latency. We carry out an extensive analysis on the choice of CSS processing window size and hop size on sparsely overlapped data. We find out that the best trade-off between computational burden and performance is obtained for a window of 5 s.


title: Provable General Function Class Representation Learning in Multitask Bandits and MDPs

abstract: While multitask representation learning has become a popular approach in reinforcement learning (RL) to boost the sample efficiency, the theoretical understanding of why and how it works is still limited. Most previous analytical works could only assume that the representation function is already known to the agent or from linear function class, since analyzing general function class representation encounters non-trivial technical obstacles such as generalization guarantee, formulation of confidence bound in abstract function space, etc. However, linear-case analysis heavily relies on the particularity of linear function class, while real-world practice usually adopts general non-linear representation functions like neural networks. This significantly reduces its applicability. In this work, we extend the analysis to general function class representations. Specifically, we consider an agent playing $M$ contextual bandits (or MDPs) concurrently and extracting a shared representation function $\phi$ from a specific function class $\Phi$ using our proposed Generalized Functional Upper Confidence Bound algorithm (GFUCB). We theoretically validate the benefit of multitask representation learning within general function class for bandits and linear MDP for the first time. Lastly, we conduct experiments to demonstrate the effectiveness of our algorithm with neural net representation.


title: New theoretical insights in the decomposition and time-frequency representation of nonstationary signals: the IMFogram algorithm

abstract: The analysis of the time-frequency content of a signal is a classical problem in signal processing, with a broad number of applications in real life. Many different approaches have been developed over the decades, which provide alternative time-frequency representations of a signal each with its advantages and limitations. In this work, following the success of nonlinear methods for the decomposition of signals into intrinsic mode functions (IMFs), we first provide more theoretical insights into the so-called Iterative Filtering decomposition algorithm, proving an energy conservation result for the derived decompositions. Furthermore, we present a new time-frequency representation method based on the IMF decomposition of a signal, which is called IMFogram. We prove theoretical results regarding this method, including its convergence to the spectrogram representation for a certain class of signals, and we present a few examples of applications, comparing results with some of the most well know approaches available in the literature.


title: Lessons Learned from Data-Driven Building Control Experiments: Contrasting Gaussian Process-based MPC, Bilevel DeePC, and Deep Reinforcement Learning

abstract: This manuscript offers the perspective of experimentalists on a number of modern data-driven techniques: model predictive control relying on Gaussian processes, adaptive data-driven control based on behavioral theory, and deep reinforcement learning. These techniques are compared in terms of data requirements, ease of use, computational burden, and robustness in the context of real-world applications. Our remarks and observations stem from a number of experimental investigations carried out in the field of building control in diverse environments, from lecture halls and apartment spaces to a hospital surgery center. The final goal is to support others in identifying what technique is best suited to tackle their own problems.


title: Mitigating Dataset Bias by Using Per-sample Gradient

abstract: The performance of deep neural networks is strongly influenced by the training dataset setup. In particular, when attributes having a strong correlation with the target attribute are present, the trained model can provide unintended prejudgments and show significant inference errors (i.e., the dataset bias problem). Various methods have been proposed to mitigate dataset bias, and their emphasis is on weakly correlated samples, called bias-conflicting samples. These methods are based on explicit bias labels involving human or empirical correlation metrics (e.g., training loss). However, such metrics require human costs or have insufficient theoretical explanation. In this study, we propose a debiasing algorithm, called PGD (Per-sample Gradient-based Debiasing), that comprises three steps: (1) training a model on uniform batch sampling, (2) setting the importance of each sample in proportion to the norm of the sample gradient, and (3) training the model using importance-batch sampling, whose probability is obtained in step (2). Compared with existing baselines for various synthetic and real-world datasets, the proposed method showed state-of-the-art accuracy for a the classification task. Furthermore, we describe theoretical understandings about how PGD can mitigate dataset bias.


title: High-quality 8-fold self-compression of ultrashort near-UV pulses in Ar-filled ultrathin-walled photonic crystal fiber

abstract: We demonstrate generation of 7.6 fs near-UV pulses centered at 400 nm via 8-fold soliton-effect self-compression in an Ar-filled hollow-core kagom\'e-style photonic crystal fiber with ultrathin core walls. Analytical calculations of the effective compression length and soliton order permit adjustment of the experimental parameters, and numerical modelling of the nonlinear pulse dynamics in the fiber accurately predict the spectro-temporal profiles of the self-compressed pulses. After compensation of phase distortion introduced by the optical elements along the beam path from the fiber to the diagnostics, 71% of the pulse energy was in the main temporal lobe, with peak powers in excess of 0.2 GW. The convenient set-up opens up new opportunities for time-resolved studies in spectroscopy, chemistry and materials science.


title: Dualities of Adjoint QCD$_3$ from Branes

abstract: We consider an 'electric' $U(N)$ level $k$ QCD$_3$ theory with one adjoint Majorana fermion. Inspired by brane dynamics, we suggest that for $k \ge N/2$ the massive $m<0$ theory, in the vicinity of the supersymmetric point, admits a $U(k-\frac{N}{2})_{-(\frac{1}{2}k+\frac{3}{4}N),-(k+\frac{N}{2})}$ 'magnetic' dual with one adjoint Majorana fermion. The magnetic theory flows in the IR to a topological $U(k-\frac{N}{2})_{-N,-(k+\frac{N}{2})}$ pure Chern-Simons theory in agreement with the dynamics of the electric theory. When $k<N/2$ the magnetic dual is $U(\frac{N}{2}-k)_{\frac{1}{2}k+\frac{3}{4}N,N}$ with one adjoint Majorana fermion. Depending on the sign of the fermion mass, the magnetic theory flows to either $U(\frac{N}{2}-k)_{N,N}$ or $U(\frac{N}{2}-k)_{\frac{1}{2}N+k,N}$ TQFT. A second magnetic theory, $U(N/2+k)_{\frac{1}{2}k-\frac{3}{4}N,-N}$, flows to either $U(\frac{N}{2}+k)_{-N,-N}$ or $U(\frac{N}{2}+k)_{-(\frac{1}{2}N-k),-N}$ TQFT. Dualities for $SO$ and $USp$ theories with one adjoint fermion are also discussed.


title: CALEB: A Conditional Adversarial Learning Framework to Enhance Bot Detection

abstract: The high growth of Online Social Networks (OSNs) over the last few years has allowed automated accounts, known as social bots, to gain ground. As highlighted by other researchers, most of these bots have malicious purposes and tend to mimic human behavior, posing high-level security threats on OSN platforms. Moreover, recent studies have shown that social bots evolve over time by reforming and reinventing unforeseen and sophisticated characteristics, making them capable of evading the current machine learning state-of-the-art bot detection systems. This work is motivated by the critical need to establish adaptive bot detection methods in order to proactively capture unseen evolved bots towards healthier OSNs interactions. In contrast with most earlier supervised ML approaches which are limited by the inability to effectively detect new types of bots, this paper proposes CALEB, a robust end-to-end proactive framework based on the Conditional Generative Adversarial Network (CGAN) and its extension, Auxiliary Classifier GAN (AC-GAN), to simulate bot evolution by creating realistic synthetic instances of different bot types. These simulated evolved bots augment existing bot datasets and therefore enhance the detection of emerging generations of bots before they even appear! Furthermore, we show that our augmentation approach overpasses other earlier augmentation techniques which fail at simulating evolving bots. Extensive experimentation on well established public bot datasets, show that our approach offers a performance boost of up to 10% regarding the detection of new unseen bots. Finally, the use of the AC-GAN Discriminator as a bot detector, has outperformed former ML approaches, showcasing the efficiency of our end to end framework.


title: Bifurcation results for quasi-linear operators from the Fucik spectrum of the Laplacian

abstract: In this paper, we analyze an eigenvalue problem for a quasi-linear elliptic operators involving Dirichlet boundary condition in an open smooth bounded set of $\mathbb{R}^N$. We investigate a bifurcation results (from trivial solution and from infinity) of an eigenvalue problem involving the $(p,2)$-Laplace operator, from the Fu\v cik spectrum of the Laplacian.


title: Radio-Frequency Sweeps at {\mu}T Fields for Parahydrogen-Induced Polarization of Biomolecules

abstract: Magnetic resonance imaging of $^{13}$C-labeled metabolites enhanced by parahydrogen-induced polarization (PHIP) can enable real-time monitoring of processes within the body. We introduce a robust, easily implementable technique for transferring parahydrogen-derived singlet order into 13C magnetization using adiabatic radio-frequency sweeps at $\mu$T fields. We experimentally demonstrate the applicability of this technique to several molecules, including some molecules relevant for metabolic imaging, where we show significant improvements in the achievable polarization, in some cases reaching above 60%. Furthermore, we introduce a site-selective deuteration scheme, where deuterium is included in the coupling network of a pyruvate ester to enhance the efficiency of the polarization transfer. These improvements are enabled by the fact that the transfer protocol avoids relaxation induced by strongly coupled quadrupolar nuclei.


title: Coverage Probability of STAR-RIS assisted Massive MIMO systems with Correlation and Phase Errors

abstract: In this paper, we investigate a simultaneous transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) assisting a massive multiple-input multiple-output (mMIMO) system. In particular, we derive a closed-form expression for the coverage probability of a STAR-RIS assisted mMIMO system while accounting for correlated fading and phase-shift errors. Notably, the phase configuration takes place at every several coherence intervals by optimizing the coverage probability since the latter depends on statistical channel state information (CSI) in terms of large-scale statistics. As a result, we achieve a reduced complexity and overhead for the optimization of passive beamforming, which are increased in the case of STAR-RIS networks with instantaneous CSI. Numerical results corroborate our analysis, shed light on interesting properties such as the impact of the number of RIS elements and the effect of phase errors, along with affirming the superiority of STAR-RIS against reflective-only RIS.


title: Search for electroweak production of charginos and neutralinos in all hadronic final states at the CMS experiment

abstract: The results from a search for chargino-neutralino or chargino pair production via electroweak interactions are summarized. The results are based on a sample of $\sqrt{s}=13~\mathrm{TeV}$ proton-proton collisions from the LHC, recorded with the CMS detector~\cite{cms} and corresponding to an integrated luminosity of $137~\mathrm{fb}^{-1}$. The search considers final states with large missing transverse momentum and pairs of hadronically decaying bosons WW, WZ, and WH, which are identified using novel algorithms. No significant excess of events is observed relative to the expectation from the standard model. Limits at the $95\%$ confidence level are placed on the cross-section for production of mass-degenerate wino-like superpartners of SU(2) gauge bosons, $\widetilde{\chi}_{1}^{\pm}$/$\widetilde{\chi}_{2}^{0}$. In the limit of nearly-massless neutralinos $\widetilde{\chi}_{1}^{0}$, $\widetilde{\chi}_{1}^{\pm}$ and $\widetilde{\chi}_{2}^{0}$ with masses up to 870 and $960~\mathrm{GeV}$ are excluded for $\widetilde{\chi}_{2}^{0}\to\mathrm{Z}\widetilde{\chi}_{1}^{0}$ and $\widetilde{\chi}_{2}^{0}\to\mathrm{H}\widetilde{\chi}_{1}^{0}$, respectively. Interpretations for other models are also presented.


title: Multilingual Transformers for Product Matching -- Experiments and a New Benchmark in Polish

abstract: Product matching corresponds to the task of matching identical products across different data sources. It typically employs available product features which, apart from being multimodal, i.e., comprised of various data types, might be non-homogeneous and incomplete. The paper shows that pre-trained, multilingual Transformer models, after fine-tuning, are suitable for solving the product matching problem using textual features both in English and Polish languages. We tested multilingual mBERT and XLM-RoBERTa models in English on Web Data Commons - training dataset and gold standard for large-scale product matching. The obtained results show that these models perform similarly to the latest solutions tested on this set, and in some cases, the results were even better. Additionally, we prepared a new dataset entirely in Polish and based on offers in selected categories obtained from several online stores for the research purpose. It is the first open dataset for product matching tasks in Polish, which allows comparing the effectiveness of the pre-trained models. Thus, we also showed the baseline results obtained by the fine-tuned mBERT and XLM-RoBERTa models on the Polish datasets.


title: Don't Forget Cheap Training Signals Before Building Unsupervised Bilingual Word Embeddings

abstract: Bilingual Word Embeddings (BWEs) are one of the cornerstones of cross-lingual transfer of NLP models. They can be built using only monolingual corpora without supervision leading to numerous works focusing on unsupervised BWEs. However, most of the current approaches to build unsupervised BWEs do not compare their results with methods based on easy-to-access cross-lingual signals. In this paper, we argue that such signals should always be considered when developing unsupervised BWE methods. The two approaches we find most effective are: 1) using identical words as seed lexicons (which unsupervised approaches incorrectly assume are not available for orthographically distinct language pairs) and 2) combining such lexicons with pairs extracted by matching romanized versions of words with an edit distance threshold. We experiment on thirteen non-Latin languages (and English) and show that such cheap signals work well and that they outperform using more complex unsupervised methods on distant language pairs such as Chinese, Japanese, Kannada, Tamil, and Thai. In addition, they are even competitive with the use of high-quality lexicons in supervised approaches. Our results show that these training signals should not be neglected when building BWEs, even for distant languages.


title: Attribute Exploration with Multiple Contradicting Partial Experts

abstract: Attribute exploration is a method from Formal Concept Analysis (FCA) that helps a domain expert discover structural dependencies in knowledge domains which can be represented as formal contexts (cross tables of objects and attributes). In this paper we present an extension of attribute exploration that allows for a group of domain experts and explores their shared views. Each expert has their own view of the domain and the views of multiple experts may contain contradicting information.


title: Carrier dynamics in quantum-dot tunnel-injection structures: microscopic theory and experiment

abstract: Tunneling-injection structures are incorporated in semiconductor lasers in order to overcome the fundamental dynamical limitation due to hot carrier injection by providing a carrier transport path from a cold carrier reservoir. The tunneling process itself depends on band alignment between quantum-dot levels and the injector quantum well, especially as in these devices LO-phonon scattering is dominant. Quantum dots with their first excited state near the quantum well bottom profit most from tunnel coupling. As inhomogeneous broadening is omnipresent in quantum dot structures, this implies that individual members of the ensemble couple differently to the injector quantum well. Quantum dots with higher energy profit less, as the phonon couples to higher, less occupied states. Likewise, if the energy difference between ground state and quantum well exceeds the LO phonon energy, scattering becomes increasingly inefficient. Therefore, within 20-30meV we find Quantum Dots that benefit substantially different from the tunnel coupling. Furthermore, in quantum dots with increasing confinement depth, excited states become sucessively confined. Here, scattering gets more efficient again, as subsequent excited states reach the phonon resonance with the quantum well bottom. Our results provide guidelines for the optimization of tunnel-injection lasers. Theoretical results for electronic state caluluations in connection with carrier-phonon and carrier-carrier scattering are compared to experimental results of the temporal gain recovery after a short pulse perturbation.


title: Multi-Agent Learning of Numerical Methods for Hyperbolic PDEs with Factored Dec-MDP

abstract: Factored decentralized Markov decision process (Dec-MDP) is a framework for modeling sequential decision making problems in multi-agent systems. In this paper, we formalize the learning of numerical methods for hyperbolic partial differential equations (PDEs), specifically the Weighted Essentially Non-Oscillatory (WENO) scheme, as a factored Dec-MDP problem. We show that different reward formulations lead to either reinforcement learning (RL) or behavior cloning, and a homogeneous policy could be learned for all agents under the RL formulation with a policy gradient algorithm. Because the trained agents only act on their local observations, the multi-agent system can be used as a general numerical method for hyperbolic PDEs and generalize to different spatial discretizations, episode lengths, dimensions, and even equation types.


title: Estimating a density near an unknown manifold: a Bayesian nonparametric approach

abstract: We study the Bayesian density estimation of data living in the offset of an unknown submanifold of the Euclidean space. In this perspective, we introduce a new notion of anisotropic H\"older for the underlying density and obtain posterior rates that are minimax optimal and adaptive to the regularity of the density, to the intrinsic dimension of the manifold, and to the size of the offset, provided that the latter is not too small -- while still allowed to go to zero. Our Bayesian procedure, based on location-scale mixtures of Gaussians, appears to be convenient to implement and yields good practical results, even for quite singular data.


title: On the Role of Spatial Effects in Early Estimates of Disease Infectiousness: A Second Quantization Approach

abstract: With the covid-19 pandemic still ongoing and an enormous amount of test data available, the lessons learned over the last two years need to be developed to a point where they can provide understanding for tackling new variants and future diseases. The SIR-model commonly used to model disease spread, predicts exponential initial growth, which helps establish the infectiousness of a disease in the early days of an outbreak. Unfortunately, the exponential growth becomes muddied by spatial, finite-size, and non-equilibrium effects in realistic systems, and robust estimates that may be used in prediction and description are still lacking. I here establish a second quantization framework that allows introduction of arbitrarily complicated spatial behavior, and I show that a simplified version of this model is in good agreement with both the growth of different covid-19 variants in Denmark and analytical results from the theory of branched polymers. Denmark is well-suited for comparison, because the number of tests with variant information in early December 2021 is very high, so the spread of a single variant can be followed. I expect this model to build bridges between the epidemic modeling and solid state communities. The long-term goal of the particular analysis in this paper is to establish priors that allow better early estimates for the infectiousness of a new disease.


title: Existence and non-degeneracy of positive multi-bubbling solutions to critical elliptic systems of Hamiltonian type

abstract: This paper deals with the following critical elliptic systems of Hamiltonian type, which are variants of the critical Lane-Emden systems and analogous to the prescribed curvature problem: \begin{equation*} \begin{cases} -\Delta u_1=K_1(y)u_2^{p},\ y\in \mathbb{R}^N,\\ -\Delta u_2=K_2(y)u_1^{q}, \ y\in \mathbb{R}^N,\\ u_1,u_2>0, \end{cases} \end{equation*} where $N\geq 5, p,q\in(1,\infty)$ with $\frac1{p+1}+\frac1{q+1}=\frac{N-2}N$, $K_1(y)$ and $K_2(y)$ are positive radial potentials. At first, under suitable conditions on $K_1,K_2$ and the certain range of the exponents $p,q$, we construct an unbounded sequence of non-radial positive vector solutions, whose energy can be made arbitrarily large. Moreover, we prove a type of non-degeneracy result by use of various Pohozaev identities, which is of great interest independently. The indefinite linear operator and strongly coupled nonlinearities make the Hamiltonian-type systems in stark contrast both to the systems of Gradient type and to the single critical elliptic equations in the study of the prescribed curvature problems. It is worth noting that, in higher-dimensional cases $(N\geq5)$, there have been no results on the existence of infinitely many bubbling solutions to critical elliptic systems, either of Hamiltonian or Gradient type.


title: Progressive Multi-scale Consistent Network for Multi-class Fundus Lesion Segmentation

abstract: Effectively integrating multi-scale information is of considerable significance for the challenging multi-class segmentation of fundus lesions because different lesions vary significantly in scales and shapes. Several methods have been proposed to successfully handle the multi-scale object segmentation. However, two issues are not considered in previous studies. The first is the lack of interaction between adjacent feature levels, and this will lead to the deviation of high-level features from low-level features and the loss of detailed cues. The second is the conflict between the low-level and high-level features, this occurs because they learn different scales of features, thereby confusing the model and decreasing the accuracy of the final prediction. In this paper, we propose a progressive multi-scale consistent network (PMCNet) that integrates the proposed progressive feature fusion (PFF) block and dynamic attention block (DAB) to address the aforementioned issues. Specifically, PFF block progressively integrates multi-scale features from adjacent encoding layers, facilitating feature learning of each layer by aggregating fine-grained details and high-level semantics. As features at different scales should be consistent, DAB is designed to dynamically learn the attentive cues from the fused features at different scales, thus aiming to smooth the essential conflicts existing in multi-scale features. The two proposed PFF and DAB blocks can be integrated with the off-the-shelf backbone networks to address the two issues of multi-scale and feature inconsistency in the multi-class segmentation of fundus lesions, which will produce better feature representation in the feature space. Experimental results on three public datasets indicate that the proposed method is more effective than recent state-of-the-art methods.


title: One Loss for Quantization: Deep Hashing with Discrete Wasserstein Distributional Matching

abstract: Image hashing is a principled approximate nearest neighbor approach to find similar items to a query in a large collection of images. Hashing aims to learn a binary-output function that maps an image to a binary vector. For optimal retrieval performance, producing balanced hash codes with low-quantization error to bridge the gap between the learning stage's continuous relaxation and the inference stage's discrete quantization is important. However, in the existing deep supervised hashing methods, coding balance and low-quantization error are difficult to achieve and involve several losses. We argue that this is because the existing quantization approaches in these methods are heuristically constructed and not effective to achieve these objectives. This paper considers an alternative approach to learning the quantization constraints. The task of learning balanced codes with low quantization error is re-formulated as matching the learned distribution of the continuous codes to a pre-defined discrete, uniform distribution. This is equivalent to minimizing the distance between two distributions. We then propose a computationally efficient distributional distance by leveraging the discrete property of the hash functions. This distributional distance is a valid distance and enjoys lower time and sample complexities. The proposed single-loss quantization objective can be integrated into any existing supervised hashing method to improve code balance and quantization error. Experiments confirm that the proposed approach substantially improves the performance of several representative hashing~methods.


title: The effect of longitudinal spin-fluctuations on high temperature properties of Co$_3$Mn$_2$Ge

abstract: It is demonstrated that thermally induced longitudinal spin fluctuations (LSF) play an important role in itinerant Co$_3$Mn$_2$Ge at an elevated temperature. The effect of LSF is taken into account during {\it ab initio} calculations via a simple model for the corresponding entropy contribution. We show that the magnetic entropy leads to the appearance of a medium size local moment on Co atoms. As a consequence, this leads to a renormalization of the magnetic exchange interactions with a quite substantial impact upon the calculated Curie temperature. Taking LSF into account, the calculated Curie temperature can be brought to be in good agreement with the experimental value.


title: DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes

abstract: Modeling dynamic scenes is important for many applications such as virtual reality and telepresence. Despite achieving unprecedented fidelity for novel view synthesis in dynamic scenes, existing methods based on Neural Radiance Fields (NeRF) suffer from slow convergence (i.e., model training time measured in days). In this paper, we present DeVRF, a novel representation to accelerate learning dynamic radiance fields. The core of DeVRF is to model both the 3D canonical space and 4D deformation field of a dynamic, non-rigid scene with explicit and discrete voxel-based representations. However, it is quite challenging to train such a representation which has a large number of model parameters, often resulting in overfitting issues. To overcome this challenge, we devise a novel static-to-dynamic learning paradigm together with a new data capture setup that is convenient to deploy in practice. This paradigm unlocks efficient learning of deformable radiance fields via utilizing the 3D volumetric canonical space learnt from multi-view static images to ease the learning of 4D voxel deformation field with only few-view dynamic sequences. To further improve the efficiency of our DeVRF and its synthesized novel view's quality, we conduct thorough explorations and identify a set of strategies. We evaluate DeVRF on both synthetic and real-world dynamic scenes with different types of deformation. Experiments demonstrate that DeVRF achieves two orders of magnitude speedup (100x faster) with on-par high-fidelity results compared to the previous state-of-the-art approaches. The code and dataset will be released in https://github.com/showlab/DeVRF.


title: MOND and asymptotic safe gravity

abstract: The modified Newtonian dynamics (MOND) paradigm is discussed in the context of asymptotic safe gravity. We estimate quantum correction to the logarithmic potential which is well known to account for the constancy of the circular velocity $v$ of the spiral galaxies. We determine plausible bounds on $v$.


title: On the self-consistent time-dependent linearized response of stellar discs to external perturbations

abstract: We study the explicitly time-dependent response of a razor-thin axisymmetric disc to externally imposed perturbations by recasting the linearized Collisionless Boltzmann equation as an integral equation and applying Kalnajs' matrix method. As an application we consider the idealized problem of calculating the dynamical friction torque on a steadily rotating, two-dimensional bar. We consider two choices of basis functions in the matrix method, showing that both lead to comparable results. The torques from our linearised calculation are in excellent agreement with those measured from $N$-body simulation, as long as the bar perturbation does not resonate with a significant fraction of the disc's stars.


title: CONNECT: A neural network based framework for emulating cosmological observables and cosmological parameter inference

abstract: Bayesian parameter inference is an essential tool in modern cosmology, and typically requires the calculation of $10^5$--$10^6$ theoretical models for each inference of model parameters for a given dataset combination. Computing these models by solving the linearised Einstein-Boltzmann system usually takes tens of CPU core-seconds per model, making the entire process very computationally expensive. In this paper we present \textsc{connect}, a neural network framework emulating \textsc{class} computations as an easy-to-use plug-in for the popular sampler \textsc{MontePython}. \textsc{connect} uses an iteratively trained neural network which emulates the observables usually computed by \textsc{class}. The training data is generated using \textsc{class}, but using a novel algorithm for generating favourable points in parameter space for training data, the required number of \textsc{class}-evaluations can be reduced by two orders of magnitude compared to a traditional inference run. Once \textsc{connect} has been trained for a given model, no additional training is required for different dataset combinations, making \textsc{connect} many orders of magnitude faster than \textsc{class} (and making the inference process entirely dominated by the speed of the likelihood calculation). For the models investigated in this paper we find that cosmological parameter inference run with \textsc{connect} produces posteriors which differ from the posteriors derived using \textsc{class} by typically less than $0.01$--$0.1$ standard deviations for all parameters. We also stress that the training data can be produced in parallel, making efficient use of all available compute resources. The \textsc{connect} code is publicly available for download at \url{https://github.com/AarhusCosmology}.


title: Analysis of a quasilinear coupled magneto-quasistatic model: solvability and regularity of solutions

abstract: We consider a~quasilinear model arising from dynamical magnetization. This model is described by a~magneto-quasistatic (MQS) approximation of Maxwell's equations. Assuming that the medium consists of a~conducting and a~non-conducting part, the derivative with respect to time is not fully entering, whence the system can be described by an abstract differential-algebraic equation. Furthermore, via magnetic induction, the system is coupled with an equation which contains the induced electrical currents along the associated voltages, which form the input of the system. The aim of this paper is to study well-posedness of the coupled MQS system and regularity of its solutions. Thereby, we rely on the classical theory of gradient systems on Hilbert spaces combined with the concept of $\mathcal{E}$-subgradients using in particular the magnetic energy. The coupled MQS system precisely fits into this general framework.


title: Multiplicative Maps on Generalized n-matrix Rings

abstract: Let $\mathfrak{R}$ and $\mathfrak{R}'$ be two associative rings (not necessarily with the identity elements). A bijective map $\varphi$ of $\mathfrak{R}$ onto $\mathfrak{R}'$ is called a \textit{$m$-multiplicative isomorphism} if {$\varphi (x_{1} \cdots x_{m}) = \varphi(x_{1}) \cdots \varphi(x_{m})$} for all $x_{1}, \cdots ,x_{m}\in \mathfrak{R}.$ In this article, we establish a condition on generalized $n$-matrix rings, that assures that multiplicative maps are additive on generalized $n$-matrix rings under certain restrictions. And then, we apply our result for study of $m$-multiplicative isomorphism and $m$-multiplicative derivation on generalized $n$-matrix rings.


abstract: Bell's theorem revealed that a local hidden-variable model cannot completely reproduce the quantum mechanical predictions. Bell's inequality provides an upper bound under the locality and reality assumptions that can be violated by correlated measurement statistics of quantum mechanics. Greenberger, Horne, and Zeilinger (GHZ) gave a more compelling proof of Bell's theorem without inequalities by considering perfect correlations rather than statistical correlations. This work presents a temporal analog of the GHZ argument that establishes Bell's theorem in time without inequalities.


title: Transformers for Multi-Object Tracking on Point Clouds

abstract: We present TransMOT, a novel transformer-based end-to-end trainable online tracker and detector for point cloud data. The model utilizes a cross- and a self-attention mechanism and is applicable to lidar data in an automotive context, as well as other data types, such as radar. Both track management and the detection of new tracks are performed by the same transformer decoder module and the tracker state is encoded in feature space. With this approach, we make use of the rich latent space of the detector for tracking rather than relying on low-dimensional bounding boxes. Still, we are able to retain some of the desirable properties of traditional Kalman-filter based approaches, such as an ability to handle sensor input at arbitrary timesteps or to compensate frame skips. This is possible due to a novel module that transforms the track information from one frame to the next on feature-level and thereby fulfills a similar task as the prediction step of a Kalman filter. Results are presented on the challenging real-world dataset nuScenes, where the proposed model outperforms its Kalman filter-based tracking baseline.


title: ViNNPruner: Visual Interactive Pruning for Deep Learning

abstract: Neural networks grow vastly in size to tackle more sophisticated tasks. In many cases, such large networks are not deployable on particular hardware and need to be reduced in size. Pruning techniques help to shrink deep neural networks to smaller sizes by only decreasing their performance as little as possible. However, such pruning algorithms are often hard to understand by applying them and do not include domain knowledge which can potentially be bad for user goals. We propose ViNNPruner, a visual interactive pruning application that implements state-of-the-art pruning algorithms and the option for users to do manual pruning based on their knowledge. We show how the application facilitates gaining insights into automatic pruning algorithms and semi-automatically pruning oversized networks to make them more efficient using interactive visualizations.


title: Dynamics or Geysers and tracer transport over the south pole of Enceladus

abstract: Over the south pole of Enceladus, an icy moon of Saturn, geysers eject water into space in a striped pattern, making Enceladus one of the most attractive destinations in the search for extraterrestrial life. We explore the ocean dynamics and tracer/heat transport associated with geysers as a function of the assumed salinity of the ocean and various core-shell heat partitions and bottom heating patterns. We find that, even if heating is concentrated into a narrow band on the seafloor directly beneath the south pole, the warm fluid becomes quickly mixed with its surroundings due to baroclinic instability. The warming signal beneath the ice is diffuse and insufficient to prevent the geyser from freezing over. Instead, if heating is assumed to be local to the geyser, emanating from tidal dissipation in the ice itself, the geyser can be sustained. In this case, the upper ocean beneath the ice becomes stably stratified and thus a barrier to vertical communication, leading to transit timescales from the core to the ice shell of hundreds of years.


title: Template based Graph Neural Network with Optimal Transport Distances

abstract: Current Graph Neural Networks (GNN) architectures generally rely on two important components: node features embedding through message passing, and aggregation with a specialized form of pooling. The structural (or topological) information is implicitly taken into account in these two steps. We propose in this work a novel point of view, which places distances to some learnable graph templates at the core of the graph representation. This distance embedding is constructed thanks to an optimal transport distance: the Fused Gromov-Wasserstein (FGW) distance, which encodes simultaneously feature and structure dissimilarities by solving a soft graph-matching problem. We postulate that the vector of FGW distances to a set of template graphs has a strong discriminative power, which is then fed to a non-linear classifier for final predictions. Distance embedding can be seen as a new layer, and can leverage on existing message passing techniques to promote sensible feature representations. Interestingly enough, in our work the optimal set of template graphs is also learnt in an end-to-end fashion by differentiating through this layer. After describing the corresponding learning procedure, we empirically validate our claim on several synthetic and real life graph classification datasets, where our method is competitive or surpasses kernel and GNN state-of-the-art approaches. We complete our experiments by an ablation study and a sensitivity analysis to parameters.


title: Measurement and completely decoherence

abstract: By virtue of quantum coherence resource measure, we show that the dephasing measurement on a coherence basis can transfer the coherence contained in system into environment totally, which gives a quantification of decoherence.


title: A dynamical system representation of generalized Rastall gravity

abstract: In this work we study the phase-space analysis of generalized Rastall gravity (GRG) which has recently been introduced as a modification to the original version of Rastall gravity (RG). In GRG, the coupling parameter assumes a dynamical feature and may play the role of dark energy (DE) which is responsible for the present accelerating expansion of the Universe. Our investigation shows that such a modification of General Relativity (GR) admits a stable critical point corresponding to the late time accelerated expansion of the Universe. Assuming both dark matter (DM) and an ultra-relativistic perfect fluid (radiation) as the cosmic ingredients, we find that the underlying model presents a viable sequence of cosmic evolution, beginning from radiation dominated era passing then through DM domination and finally reaches the late time DE dominated era. Moreover, taking into account the contribution due to the spatial curvature within the total energy density leads to a growing mode for it in such a way that its present values are consistent with those reported in recent observations. We also present a numerical simulation of the model which particularizes our dynamical system representation. These studies demonstrate the ability of GRG to describe the present accelerated expansion of the Universe.


title: Discovery of an asteroid family linked to (22) Kalliope and its moon Linus

abstract: According to adaptive-optics observations by Ferrais et al., (22) Kalliope is a 150-km, dense and differentiated body. Here, we interpret (22) Kalliope in the context of bodies in its surroundings. While there is a known moon Linus, with a 5:1 size ratio, no family has been reported in the literature, which is in contradiction with the existence of the moon. Using the hierarchical clustering method (HCM) along with physical data, we identified the Kalliope family. Previously, it was associated to (7481) San Marcello. We then used various models (N-body, Monte-Carlo, SPH) of its orbital and collisional evolution, including the break-up of the parent body, to estimate the dynamical age of the family and address its link to Linus. The best-fit age is (900+-100) My according to our collisional model, in agreement with the position of (22) Kalliope, which was modified by chaotic diffusion due to 4-1-1 three-body resonance with Jupiter and Saturn. It seems possible to create Linus and the Kalliope family at the same time, although our SPH simulations show a variety of outcomes, for both satellite size and the family size-frequency distribution. The shape of (22) Kalliope itself was most likely affected by gravitational reaccumulation of `streams', which creates characteristic hills observed on the surface. If the body was differentiated, its internal structure is surely asymmetric.


title: A Compensation Mechanism for EV Flexibility Services using Discrete Utility Functions

abstract: Compensation mechanisms are used to counterbalance the discomfort suffered by users due to quality service issues. Such mechanisms are currently used for different purposes in the electrical power and energy sector, e.g., power quality and reliability. This paper proposes a compensation mechanism using EV flexibility management of a set of charging sessions managed by a charging point operator (CPO). Users' preferences and bilateral agreements with the CPO are modelled via discrete utility functions for the energy not served. A mathematical proof of the proposed compensation mechanism is given and applied to a test scenario using historical data from an office building with a parking lot in the Netherlands. Synthetic data for 400 charging sessions was generated using multivariate elliptical copulas to capture the complex dependency structures in EV charging data. Numerical results validate the usefulness of the proposed compensation mechanism as an attractive measure both for the CPO and the users in case of energy not served.


title: Estimating spot volatility under infinite variation jumps with dependent market microstructure noise

abstract: Jumps and market microstructure noise are stylized features of high-frequency financial data. It is well known that they introduce bias in the estimation of volatility (including integrated and spot volatilities) of assets, and many methods have been proposed to deal with this problem. When the jumps are intensive with infinite variation, the efficient estimation of spot volatility under serially dependent noise is not available and is thus in need. For this purpose, we propose a novel estimator of spot volatility with a hybrid use of the pre-averaging technique and the empirical characteristic function. Under mild assumptions, the results of consistency and asymptotic normality of our estimator are established. Furthermore, we show that our estimator achieves an almost efficient convergence rate with optimal variance when the jumps are either less active or active with symmetric structure. Simulation studies verify our theoretical conclusions. We apply our proposed estimator to empirical analyses, such as estimating the weekly volatility curve using second-by-second transaction price data.


title: Topological states and continuum model for swarmalators without force reciprocity

abstract: Swarmalators are systems of agents which are both self-propelled particles and oscillators. Each particle is endowed with a phase which modulates its interaction force with the other particles. In return, relative positions modulate phase synchronization between interacting particles. In the present model, there is no force reciprocity: when a particle attracts another one, the latter repels the former. This results in a pursuit behavior. In this paper, we derive a hydrodynamic model of this swarmalator system and show that it has explicit doubly-periodic travelling-wave solutions in two space dimensions. These special solutions enjoy non-trivial topology quantified by the index of the phase vector along a period in either dimension. Stability of these solutions is studied by investigating the conditions for hyperbolicity of the model. Numerical solutions of both the particle and hydrodynamic models are shown. They confirm the consistency of the hydrodynamic model with the particle one for small times or large phase-noise but also reveal the emergence of intriguing patterns in the case of small phase-noise.


title: The Reidemeister spectrum of finite abelian groups

abstract: For a finite abelian group $A$, the Reidemeister number of an endomorphism $\varphi$ equals the size of $\mathrm{Fix}(\varphi)$, the set of fixed points of $\varphi$. Consequently, the Reidemeister spectrum of $A$ is a subset of the set of divisors of $|A|$. We fully determine the Reidemeister spectrum of $|A|$, that is, which divisors of $|A|$ occur as the Reidemeister number of an automorphism. To do so, we discuss and prove a more general result providing upper and lower bounds on the number of fixed points of automorphisms related to a given automorphism $\varphi$.


title: Central AdS Generalized Ay{\'o}n-Beato-Garc{\'\i}a Black Holes and Joule-Thomson Expansion

abstract: In this paper, the Joule-Thomson (JT) adiabatic expansion is investigated for generalized Ayon-Beato-Garcia (ABG) regular black hole. It has a magnetic charge which makes central region of the black hole metric to be AdS spacetime and so become non singular. Thus we not need to use an additional cosmological parameter coming from ADS/CFT correspondence for production of pressure coordinate in the black hole equation of state. Form this point of view our work is a new approach versus to conventional methods which are addressed in the references of this paper. However we will see important behavior of parameters of this modified ABG black hole on possibility of being of JT adiabatic expansion. This black hole is characterized by five parameters including mass $m$, magnetic charge $q$, and three other parameters related to form of used nonlinear electromagnetic interaction fields. Inversion points are in fact a particular T-P curve at constant enthalpy and it separates cooling and heating phase of the modified AdS ABG black hole.


title: Bidiagonal decompositions and total positivity of some special matrices

abstract: The matrix $S = [1+x_i y_j]_{i,j=1}^{n}, 0<x_1<\cdots<x_n,\, 0<y_1<\cdots<y_n$, has gained importance lately due to its role in powers preserving total nonnegativity. We give an explicit decomposition of $S$ in terms of elementary bidiagonal matrices, which is analogous to the Neville decomposition. We give a bidiagonal decomposition of $S^{\circ m}=[(1+x_iy_j)^m]$ for positive integers $1\leq m \leq n-1$. We also explore the total positivity of Hadamard powers of another important class of matrices called mean matrices.


title: Mixture GAN For Modulation Classification Resiliency Against Adversarial Attacks

abstract: Automatic modulation classification (AMC) using the Deep Neural Network (DNN) approach outperforms the traditional classification techniques, even in the presence of challenging wireless channel environments. However, the adversarial attacks cause the loss of accuracy for the DNN-based AMC by injecting a well-designed perturbation to the wireless channels. In this paper, we propose a novel generative adversarial network (GAN)-based countermeasure approach to safeguard the DNN-based AMC systems against adversarial attack examples. GAN-based aims to eliminate the adversarial attack examples before feeding to the DNN-based classifier. Specifically, we have shown the resiliency of our proposed defense GAN against the Fast-Gradient Sign method (FGSM) algorithm as one of the most potent kinds of attack algorithms to craft the perturbed signals. The existing defense-GAN has been designed for image classification and does not work in our case where the above-mentioned communication system is considered. Thus, our proposed countermeasure approach deploys GANs with a mixture of generators to overcome the mode collapsing problem in a typical GAN facing radio signal classification problem. Simulation results show the effectiveness of our proposed defense GAN so that it could enhance the accuracy of the DNN-based AMC under adversarial attacks to 81%, approximately.


title: EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learning

abstract: Massively multilingual sentence representation models, e.g., LASER, SBERT-distill, and LaBSE, help significantly improve cross-lingual downstream tasks. However, the use of a large amount of data or inefficient model architectures results in heavy computation to train a new model according to our preferred languages and domains. To resolve this issue, we introduce efficient and effective massively multilingual sentence embedding (EMS), using cross-lingual token-level reconstruction (XTR) and sentence-level contrastive learning as training objectives. Compared with related studies, the proposed model can be efficiently trained using significantly fewer parallel sentences and GPU computation resources. Empirical results showed that the proposed model significantly yields better or comparable results with regard to cross-lingual sentence retrieval, zero-shot cross-lingual genre classification, and sentiment classification. Ablative analyses demonstrated the efficiency and effectiveness of each component of the proposed model. We release the codes for model training and the EMS pre-trained sentence embedding model, which supports 62 languages ( https://github.com/Mao-KU/EMS ).


title: HyperMAML: Few-Shot Adaptation of Deep Models with Hypernetworks

abstract: The aim of Few-Shot learning methods is to train models which can easily adapt to previously unseen tasks, based on small amounts of data. One of the most popular and elegant Few-Shot learning approaches is Model-Agnostic Meta-Learning (MAML). The main idea behind this method is to learn the general weights of the meta-model, which are further adapted to specific problems in a small number of gradient steps. However, the model's main limitation lies in the fact that the update procedure is realized by gradient-based optimisation. In consequence, MAML cannot always modify weights to the essential level in one or even a few gradient iterations. On the other hand, using many gradient steps results in a complex and time-consuming optimization procedure, which is hard to train in practice, and may lead to overfitting. In this paper, we propose HyperMAML, a novel generalization of MAML, where the training of the update procedure is also part of the model. Namely, in HyperMAML, instead of updating the weights with gradient descent, we use for this purpose a trainable Hypernetwork. Consequently, in this framework, the model can generate significant updates whose range is not limited to a fixed number of gradient steps. Experiments show that HyperMAML consistently outperforms MAML and performs comparably to other state-of-the-art techniques in a number of standard Few-Shot learning benchmarks.


abstract: Unsupervised/self-supervised graph representation learning is critical for downstream node- and graph-level classification tasks. Global structure of graphs helps discriminating representations and existing methods mainly utilize the global structure by imposing additional supervisions. However, their global semantics are usually invariant for all nodes/graphs and they fail to explicitly embed the global semantics to enrich the representations. In this paper, we propose Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (OEPG). Specifically, we introduce instance-adaptive global-aware ego-semantic descriptors, leveraging the first- and second-order feature differences between each node/graph and hierarchical global clusters of the entire graph dataset. The descriptors can be explicitly integrated into local graph convolution as new neighbor nodes. Besides, we design an omni-granular normalization on the whole scales and hierarchies of the ego-semantic to assign attentional weight to each descriptor from an omni-granular perspective. Specialized pretext tasks and cross-iteration momentum update are further developed for local-global mutual adaptation. In downstream tasks, OEPG consistently achieves the best performance with a 2%~6% accuracy gain on multiple datasets cross scales and domains. Notably, OEPG also generalizes to quantity- and topology-imbalance scenarios.