title: Searching for vector boson-star mergers within LIGO-Virgo intermediate-mass black-hole merger candidates

abstract: We present the first systematic search for exotic compact mergers in Advanced LIGO and Virgo events. We compare the short gravitational-wave signals GW190521, GW190426$\_$190642, GW200220$\_$061928 and the trigger 200114$\_$020818 (or S200114f) to a new catalogue of 759 numerical simulations of head-on mergers of horizonless exotic compact objects known as Proca stars, interpreted as self-gravitating lumps of (fuzzy) dark matter sourced by an ultralight (vector) bosonic particle. The Proca-star merger hypothesis is strongly rejected with respect to the black hole merger one by GW190426, weakly rejected by GW200220 and weakly favoured by GW190521 and S200114f. GW190521 and GW200220 yield highly consistent boson masses of $\mu_{\rm B} = 8.69^{+0.61}_{-0.75}\times10^{-13}$ eV and $\mu_{\rm B} = 9.13^{+1.18}_{-1.30}\times10^{-13}$ eV at the $90\%$ credible level. We conduct a preliminary population study of the compact binaries behind these events. Excluding (including) S200114f as a real event, and ignoring boson-mass consistencies across events, we estimate a fraction of Proca-star mergers of $\zeta = 0.27^{+0.43}_{-0.25} \ (0.39^{+0.38}_{-0.33})$. We discuss the impact of boson-mass consistency across events in such estimates. Our results maintain GW190521 as a Proca-star merger candidate and pave the way towards population studies considering exotic compact objects.


title: An UWB Hemispherical Vivaldi Array

abstract: We report the first conformal ultra-wide band (UWB) array on a doubly curved surface for wide angle electronic scanning. We use a quadrilateral mesh as the basis for systematically arraying UWB radiators on arbitrary surfaces. A prototype consisting of a 52 element, dual-polarized Vivaldi array arranged over a 181 mm diameter hemisphere is developed. The antennas and SMP connectors are 3D printed out of titanium to allow for simple fabrication and assembly. We derive the theoretical gain of a hemispherical array based on the antenna size and number of elements. The measured realized gain of the prototype array is within 2 dB of the theoretical value from 2-18 GHz and scan angles out to 120{\deg} from the z-axis. This field of view is twice that of a planar array with the same diameter in agreement with theory. This work provides a baseline performance for larger conformal arrays that have more uniform meshes. Furthermore, the basic concept can be extended to other UWB radiating elements.


title: Quantum Nonlocality -- Possible Cosmophysical Effects

abstract: Mutiple experimental results indicate the existence of cosmophysical effects which influence parameters of nuclear decays and chemical reactions in lab. conditions. In particular, variations of nucleus alpha-,beta-decay parameters with amplitudes of the order $10^{-3}$ and periods of one year and solar day were detected. Significant influence of solar activity on nuclear decay and chemical reaction parameters also was reported. We argue that such deviations from radioactive decay law and other similar effects can be described by novel quantum nonlocality mechanism, which differs from EPR-Bohm nonlocality. Doebner-Goldin nonlinear Hamiltonian applied for the description of nuclear decay parameter variations.


title: Complete Performance Analysis of Underwater VLC Diffusion Adaptive Networks

abstract: In this paper, we simulated a diffusion adaptive network in the underwater environment. The communication method between the nodes of this network is assumed to be the visible light communication technology (VLC) which in the underwater condition is known as the UVLC. The links between the nodes in this case are contaminated with the optical noise and turbulence. These contaminations are modeled with the proper statistical distributions depending on the underwater conditions. The optical turbulence modeling link coefficients are shown to be following the Log-normal distribution which its mean and variance are directly dependent on the temperature and the salinity of the simulated water and the assumed distance between the diffusion network nodes. The performance of the diffusion network in using UVLC technology is then analyzed both with simulations and theoretical calculations and the results are presented using the steady-state error metrics. Our analysis showed that the diffusion network can be implemented underwater with the VLC technology providing that the distance between the network nodes is less than 10 meters. Also, in order to guarantee the convergence of the adaptive network, the water salinity level and temperature must not exceed the values that are presented in our simulations.


title: Dynaformer: A Deep Learning Model for Ageing-aware Battery Discharge Prediction

abstract: Electrochemical batteries are ubiquitous devices in our society. When they are employed in mission-critical applications, the ability to precisely predict the end of discharge under highly variable environmental and operating conditions is of paramount importance in order to support operational decision-making. While there are accurate predictive models of the processes underlying the charge and discharge phases of batteries, the modelling of ageing and its effect on performance remains poorly understood. Such a lack of understanding often leads to inaccurate models or the need for time-consuming calibration procedures whenever the battery ages or its conditions change significantly. This represents a major obstacle to the real-world deployment of efficient and robust battery management systems. In this paper, we propose for the first time an approach that can predict the voltage discharge curve for batteries of any degradation level without the need for calibration. In particular, we introduce Dynaformer, a novel Transformer-based deep learning architecture which is able to simultaneously infer the ageing state from a limited number of voltage/current samples and predict the full voltage discharge curve for real batteries with high precision. Our experiments show that the trained model is effective for input current profiles of different complexities and is robust to a wide range of degradation levels. In addition to evaluating the performance of the proposed framework on simulated data, we demonstrate that a minimal amount of fine-tuning allows the model to bridge the simulation-to-real gap between simulations and real data collected from a set of batteries. The proposed methodology enables the utilization of battery-powered systems until the end of discharge in a controlled and predictable way, thereby significantly prolonging the operating cycles and reducing costs.


title: Ultrafast Electron Microscopy of Nanoscale Charge Dynamics in Semiconductors

abstract: The ultrafast dynamics of charge carriers in solids plays a pivotal role in emerging optoelectronics, photonics, energy harvesting, and quantum technology applications. However, the investigation and direct visualization of such non-equilibrium transport phenomena remains as a long-standing challenge, owing to the nanometer-femtosecond spatio-temporal scales at which the charge carriers evolve. Here, we propose and demonstrate a novel interaction mechanism enabling nanoscale imaging of the femtosecond dynamics of charge carriers in solids. This imaging modality, which we name charge dynamics electron microscopy (CDEM), exploits the strong interaction between terahertz (THz) electromagnetic near fields produced by the moving charges and synchronized free-electron pulses in an ultrafast scanning transmission electron microscope. The measured free-electron energy at different spatio-temporal coordinates allows us to directly retrieve the THz near-field amplitude and phase, from which we reconstruct movies of the generated charges by comparison with microscopic theory. The introduced CDEM technique thus allows us to investigate previously inaccessible spatio-temporal regimes of charge dynamics in solids, for example revealing new insight into the photo-Dember effect, showing oscillations of photo-generated electron-hole distributions inside a semiconductor. Our work lays the foundation for exploring a wide range of previously inaccessible charge-transport phenomena in condensed matter using ultrafast electron microscopy.


title: The Three Faces of $U(3)$

abstract: $U(n)$ is a semi-direct product group that is characterized by non-trivial homomorphisms mapping $U(1)$ into the automorphism group of $SU(n)$. For $U(3)$, there are three non-trivial homomorphisms that induce three separate defining representations. In a toy model of $U(3)$ Yang-Mills (endowed with a suitable inner product) coupled to massive fermions, this renders three distinct covariant derivatives acting on a single matter field. By employing a $\mathrm{mod}\,3$ permutation of the vector space carrying the defining representation induced by a ``large'' gauge transformation, the three covariant derivatives and one matter field can alternatively be expressed as a single covariant derivative acting on three distinct species of matter fields possessing the same $U(3)$ quantum numbers. One can interpret this as three species of matter fields in the defining representation.


title: Binding Dancers Into Attractors

abstract: To effectively perceive and process observations in our environment, feature binding and perspective taking are crucial cognitive abilities. Feature binding combines observed features into one entity, called a Gestalt. Perspective taking transfers the percept into a canonical, observer-centered frame of reference. Here we propose a recurrent neural network model that solves both challenges. We first train an LSTM to predict 3D motion dynamics from a canonical perspective. We then present similar motion dynamics with novel viewpoints and feature arrangements. Retrospective inference enables the deduction of the canonical perspective. Combined with a robust mutual-exclusive softmax selection scheme, random feature arrangements are reordered and precisely bound into known Gestalt percepts. To corroborate evidence for the architecture's cognitive validity, we examine its behavior on the silhouette illusion, which elicits two competitive Gestalt interpretations of a rotating dancer. Our system flexibly binds the information of the rotating figure into the alternative attractors resolving the illusion's ambiguity and imagining the respective depth interpretation and the corresponding direction of rotation. We finally discuss the potential universality of the proposed mechanisms.


title: Conversation Group Detection With Spatio-Temporal Context

abstract: In this work, we propose an approach for detecting conversation groups in social scenarios like cocktail parties and networking events, from overhead camera recordings. We posit the detection of conversation groups as a learning problem that could benefit from leveraging the spatial context of the surroundings, and the inherent temporal context in interpersonal dynamics which is reflected in the temporal dynamics in human behavior signals, an aspect that has not been addressed in recent prior works. This motivates our approach which consists of a dynamic LSTM-based deep learning model that predicts continuous pairwise affinity values indicating how likely two people are in the same conversation group. These affinity values are also continuous in time, since relationships and group membership do not occur instantaneously, even though the ground truths of group membership are binary. Using the predicted affinity values, we apply a graph clustering method based on Dominant Set extraction to identify the conversation groups. We benchmark the proposed method against established methods on multiple social interaction datasets. Our results showed that the proposed method improves group detection performance in data that has more temporal granularity in conversation group labels. Additionally, we provide an analysis in the predicted affinity values in relation to the conversation group detection. Finally, we demonstrate the usability of the predicted affinity values in a forecasting framework to predict group membership for a given forecast horizon.


title: Neighbors and arithmetic of isogenous K3 surfaces

abstract: We use lattice theory to study the isogeny class of a K3 surface. Starting from isotropic Brauer classes, we construct isogenies via Kneser method of neighboring lattices. We also determine the fields of definition of isogenous K3 surfaces, and study Kneser construction over number fields. We then apply our results to relate conjectures about the finiteness of Brauer groups and N\'{e}ron-Severi lattices of K3 surfaces.


title: Maximum softly-penalized likelihood for mixed effects logistic regression

abstract: Maximum likelihood estimation in logistic regression with mixed effects is known to often result in estimates on the boundary of the parameter space. Such estimates, which include infinite values for fixed effects and singular or infinite variance components, can cause havoc to numerical estimation procedures and inference. We introduce an appropriately scaled additive penalty to the log-likelihood function, or an approximation thereof, which penalizes the fixed effects by the Jeffreys' invariant prior for the model with no random effects and the variance components by a composition of negative Huber loss functions. The resulting maximum penalized likelihood estimates are shown to lie in the interior of the parameter space. Appropriate scaling of the penalty guarantees that the penalization is soft enough to preserve the optimal asymptotic properties expected by the maximum likelihood estimator, namely consistency, asymptotic normality, and Cram\'er-Rao efficiency. Our choice of penalties and scaling factor preserves equivariance of the fixed effects estimates under linear transformation of the model parameters, such as contrasts. Maximum softly-penalized likelihood is compared to competing approaches on two real-data examples, and through comprehensive simulation studies that illustrate its superior finite sample performance.


title: floodlight -- A high-level, data-driven sports analytics framework

abstract: The present work introduces floodlight, an open source Python package built to support and automate team sport data analysis. It is specifically designed for the scientific analysis of spatiotemporal tracking data, event data, and game codes in disciplines such as match and performance analysis, exercise physiology, training science, and collective movement behavior analysis. It is completely provider- and sports-independent and includes a high-level interface suitable for programming beginners. The package includes routines for most aspects of the data analysis process, including dedicated data classes, file parsing functionality, public dataset APIs, pre-processing routines, common data models and several standard analysis algorithms previously used in the literature, as well as basic visualization functionality. The package is intended to make team sport data analysis more accessible to sport scientists, foster collaborations between sport and computer scientists, and strengthen the community's culture of open science and inclusion of previous works in future works.


title: Learning "best" kernels from data in Gaussian process regression. With application to aerodynamics

abstract: This paper introduces algorithms to select/design kernels in Gaussian process regression/kriging surrogate modeling techniques. We adopt the setting of kernel method solutions in ad hoc functional spaces, namely Reproducing Kernel Hilbert Spaces (RKHS), to solve the problem of approximating a regular target function given observations of it, i.e. supervised learning. A first class of algorithms is kernel flow, which was introduced in the context of classification in machine learning. It can be seen as a cross-validation procedure whereby a "best" kernel is selected such that the loss of accuracy incurred by removing some part of the dataset (typically half of it) is minimized. A second class of algorithms is called spectral kernel ridge regression, and aims at selecting a "best" kernel such that the norm of the function to be approximated is minimal in the associated RKHS. Within Mercer's theorem framework, we obtain an explicit construction of that "best" kernel in terms of the main features of the target function. Both approaches of learning kernels from data are illustrated by numerical examples on synthetic test functions, and on a classical test case in turbulence modeling validation for transonic flows about a two-dimensional airfoil.


title: Machine Learning for Detection of 3D Features using sparse X-ray data

abstract: In many inertial confinement fusion experiments, the neutron yield and other parameters cannot be completely accounted for with one and two dimensional models. This discrepancy suggests that there are three dimensional effects which may be significant. Sources of these effects include defects in the shells and shell interfaces, the fill tube of the capsule, and the joint feature in double shell targets. Due to their ability to penetrate materials, X-rays are used to capture the internal structure of objects. Methods such as Computational Tomography use X-ray radiographs from hundreds of projections in order to reconstruct a three dimensional model of the object. In experimental environments, such as the National Ignition Facility and Omega-60, the availability of these views is scarce and in many cases only consist of a single line of sight. Mathematical reconstruction of a 3D object from sparse views is an ill-posed inverse problem. These types of problems are typically solved by utilizing prior information. Neural networks have been used for the task of 3D reconstruction as they are capable of encoding and leveraging this prior information. We utilize half a dozen different convolutional neural networks to produce different 3D representations of ICF implosions from the experimental data. We utilize deep supervision to train a neural network to produce high resolution reconstructions. We use these representations to track 3D features of the capsules such as the ablator, inner shell, and the joint between shell hemispheres. Machine learning, supplemented by different priors, is a promising method for 3D reconstructions in ICF and X-ray radiography in general.


title: Variational properties of the abstract subdifferential operator

abstract: Abstract convexity generalises classical convexity by considering the suprema of functions taken from an arbitrarily defined set of functions. These are called the abstract linear (abstract affine) functions. The purpose of this paper is to study the abstract subdifferential. We obtain a number of results on the calculus of this subdifferential: summation and composition rules, and prove that under some reasonable conditions the subdifferential is a maximal abstract monotone operator. Another contribution of this paper is a counterexample that demonstrates that the separation theorem between two abstract convex sets is generally not true. The lack of the extension of separation results to the case of abstract convexity is one of the obstacles in the development of abstract convexity based numerical methods.


title: Towards Group Learning: Distributed Weighting of Experts

abstract: Aggregating signals from a collection of noisy sources is a fundamental problem in many domains including crowd-sourcing, multi-agent planning, sensor networks, signal processing, voting, ensemble learning, and federated learning. The core question is how to aggregate signals from multiple sources (e.g. experts) in order to reveal an underlying ground truth. While a full answer depends on the type of signal, correlation of signals, and desired output, a problem common to all of these applications is that of differentiating sources based on their quality and weighting them accordingly. It is often assumed that this differentiation and aggregation is done by a single, accurate central mechanism or agent (e.g. judge). We complicate this model in two ways. First, we investigate the setting with both a single judge, and one with multiple judges. Second, given this multi-agent interaction of judges, we investigate various constraints on the judges' reporting space. We build on known results for the optimal weighting of experts and prove that an ensemble of sub-optimal mechanisms can perform optimally under certain conditions. We then show empirically that the ensemble approximates the performance of the optimal mechanism under a broader range of conditions.


title: A Monotonous Intuitionistic Fuzzy TOPSIS Method under General Linear Orders via Admissible Distance Measures

abstract: All intuitionistic fuzzy TOPSIS methods contain two key elements: (1) the order structure, which can affect the choices of positive ideal-points and negative ideal-points, and construction of admissible distance/similarity measures; (2) the distance/similarity measure, which is closely related to the values of the relative closeness degrees and determines the accuracy and rationality of decision-making. For the order structure, many efforts are devoted to constructing some score functions, which can strictly distinguish different intuitionistic fuzzy values (IFVs) and preserve the natural partial order for IFVs.This paper proves that such a score function does not exist, namely the application of a single monotonous and continuous function does not distinguish all IFVs. For the distance or similarity measure, some examples are given to show that classical similarity measures based on the normalized Euclidean distance and normalized Minkowski distance do not meet the axiomatic definition of intuitionistic fuzzy similarity measures. Moreover,some illustrative examples are given to show that classical intuitionistic fuzzy TOPSIS methods do not ensure the monotonicity with the natural partial order or linear orders, which may yield some counter-intuitive results. To overcome the limitation of non-monotonicity, we propose a novel intuitionistic fuzzy TOPSIS method,using three new admissible distances with the linear orders measured by a score degree/similarity function and accuracy degree, or two aggregation functions, and prove that the proposed TOPSIS method is monotonous under these three linear orders.} This is the first result with a strict mathematical proof on the monotonicity with the linear orders for the intuitionistic fuzzy TOPSIS method.


title: A Deep Reinforcement Learning Framework For Column Generation

abstract: Column Generation (CG) is an iterative algorithm for solving linear programs (LPs) with an extremely large number of variables (columns). CG is the workhorse for tackling large-scale \textit{integer} linear programs, which rely on CG to solve LP relaxations within a branch and price algorithm. Two canonical applications are the Cutting Stock Problem (CSP) and Vehicle Routing Problem with Time Windows (VRPTW). In VRPTW, for example, each binary variable represents the decision to include or exclude a \textit{route}, of which there are exponentially many; CG incrementally grows the subset of columns being used, ultimately converging to an optimal solution. We propose RLCG, the first Reinforcement Learning (RL) approach for CG. Unlike typical column selection rules which myopically select a column based on local information at each iteration, we treat CG as a sequential decision-making problem: the column selected in a given iteration affects subsequent column selections. This perspective lends itself to a Deep Reinforcement Learning approach that uses Graph Neural Networks (GNNs) to represent the variable-constraint structure in the LP of interest. We perform an extensive set of experiments using the publicly available BPPLIB benchmark for CSP and Solomon benchmark for VRPTW. RLCG converges faster and reduces the number of CG iterations by 22.4\% for CSP and 40.9\% for VRPTW on average compared to a commonly used greedy policy. Our code is available at https://github.com/chichengmessi/reinforcement-learning-for-column-generation.git.


title: Neutrino Rocket Jet Model: An Explanation of High-velocity Pulsars and their Spin-down Evolution

abstract: The fact that the spatial velocity of pulsars is generally higher than that of their progenitor stars has bothered astronomers for nearly 50 years. It has been extensively argued that the high pulsar velocity should be acquired during a natal kick process on a timescale of 100ms - 10s in the supernova explosion, in which some asymmetrical dynamical mechanism plays a key role. However, a satisfactory picture generally is still lacking. In this study, it is argued that the neutrino rocket model can well account for the high speed as well as the long-term evolution behaviors of pulsars. The neutrinos are emitted from superfluid vortex neutrons through the neutrino cyclotron radiation mechanism. The unique characters of left-handed neutrinos and right-handed antineutrinos resulting from the nonconservation of parity in weak interactions play a major role in the spatial asymmetry. The continuous acceleration of pulsars can be naturally explained by this model, which yields a maximum velocity surpassing 1000 km s$^{-1}$. The alignment between the spinning axis and the direction of motion observed for the Crab pulsar (PSR 0531) and the Vela pulsar (PSR 0833) can be well accounted for. The observed correlation between the spin-down rate and the period of long-period pulsars with $P \gtrsim 0.5$s can also be satisfactorily explained.


title: RODIAN: Robustified Median

abstract: We propose a robust method for averaging numbers contaminated by a large proportion of outliers. Our method, dubbed RODIAN, is inspired by the key idea of MINPRAN [1]: We assume that the outliers are uniformly distributed within the range of the data and we search for the region that is least likely to contain outliers only. The median of the data within this region is then taken as RODIAN. Our approach can accurately estimate the true mean of data with more than 50% outliers and runs in time $O(n\log n)$. Unlike other robust techniques, it is completely deterministic and does not rely on a known inlier error bound. Our extensive evaluation shows that RODIAN is much more robust than the median and the least-median-of-squares. This result also holds in the case of non-uniform outlier distributions.


title: Wigner-Smith Time Delay Matrix for Electromagnetics: Guiding and Periodic Systems with Evanescent Modes

abstract: The Wigner-Smith (WS) time delay matrix relates an electromagnetic system's scattering matrix and its frequency derivative. Previous work showed that the entries of WS time delay matrices of systems excited by propagating waves consist of volume integrals of energy-like field quantities. This paper introduces a generalized WS relationship that applies to systems excited by mixtures of propagating and evanescent fields. Just like its predecessor, the generalized WS relationship allows for the identification of so-called WS modes that interact with the system with well-defined time delays. Furthermore, a technique is developed to compute the WS time delay matrix of a composite system from the WS time delay matrices of its subsystems. Numerical examples demonstrate the usefulness of the generalized WS method when characterizing time delays experienced by fields interacting with guiding and periodic structures that have ports supporting evanescent modes.


title: Automated visual inspection of silicon detectors in CMS experiment

abstract: In the CMS experiment at CERN, Geneva, a large number of HGCAL sensor modules are fabricated in advanced laboratories around the world. Each sensor module contains about 700 checkpoints for visual inspection thus making it almost impossible to carry out such inspection manually. As artificial intelligence is more and more widely used in manufacturing, traditional detection technologies are gradually being intelligent. In order to more accurately evaluate the checkpoints, we propose to use deep learning-based object detection techniques to detect manufacturing defects in testing large numbers of modules automatically.


title: Team VI-I2R Technical Report on EPIC-KITCHENS-100 Unsupervised Domain Adaptation Challenge for Action Recognition 2021

abstract: In this report, we present the technical details of our approach to the EPIC-KITCHENS-100 Unsupervised Domain Adaptation (UDA) Challenge for Action Recognition. The EPIC-KITCHENS-100 dataset consists of daily kitchen activities focusing on the interaction between human hands and their surrounding objects. It is very challenging to accurately recognize these fine-grained activities, due to the presence of distracting objects and visually similar action classes, especially in the unlabelled target domain. Based on an existing method for video domain adaptation, i.e., TA3N, we propose to learn hand-centric features by leveraging the hand bounding box information for UDA on fine-grained action recognition. This helps reduce the distraction from background as well as facilitate the learning of domain-invariant features. To achieve high quality hand localization, we adopt an uncertainty-aware domain adaptation network, i.e., MEAA, to train a domain-adaptive hand detector, which only uses very limited hand bounding box annotations in the source domain but can generalize well to the unlabelled target domain. Our submission achieved the 1st place in terms of top-1 action recognition accuracy, using only RGB and optical flow modalities as input.


title: On the duality between contrastive and non-contrastive self-supervised learning

abstract: Recent approaches in self-supervised learning of image representations can be categorized into different families of methods and, in particular, can be divided into contrastive and non-contrastive approaches. While differences between the two families have been thoroughly discussed to motivate new approaches, we focus more on the theoretical similarities between them. By designing contrastive and covariance based non-contrastive criteria that can be related algebraically and shown to be equivalent under limited assumptions, we show how close those families can be. We further study popular methods and introduce variations of them, allowing us to relate this theoretical result to current practices and show the influence (or lack thereof) of design choices on downstream performance. Motivated by our equivalence result, we investigate the low performance of SimCLR and show how it can match VICReg's with careful hyperparameter tuning, improving significantly over known baselines. We also challenge the popular assumption that non-contrastive methods need large output dimensions. Our theoretical and quantitative results suggest that the numerical gaps between contrastive and non-contrastive methods in certain regimes can be closed given better network design choices and hyperparameter tuning. The evidence shows that unifying different SOTA methods is an important direction to build a better understanding of self-supervised learning.


title: Constraints on parameter choices for successful reservoir computing

abstract: Echo-state networks are simple models of discrete dynamical systems driven by a time series. By selecting network parameters such that the dynamics of the network is contractive, characterized by a negative maximal Lyapunov exponent, the network may synchronize with the driving signal. Exploiting this synchronization, the echo-state network may be trained to autonomously reproduce the input dynamics, enabling time-series prediction. However, while synchronization is a necessary condition for prediction, it is not sufficient. Here, we study what other conditions are necessary for successful time-series prediction. We identify two key parameters for prediction performance, and conduct a parameter sweep to find regions where prediction is successful. These regions differ significantly depending on whether full or partial phase space information about the input is provided to the network during training. We explain how these regions emerge.


title: Strongly maximal matchings and strongly minimal covers

abstract: This is a not-to-be-journal-published paper, aimed to serve as reference. It is a summary of the main ideas on the topic appearing in the title, and an opportunity to state correctly the main conjecture in the field.


title: Effects of Auxiliary Knowledge on Continual Learning

abstract: In Continual Learning (CL), a neural network is trained on a stream of data whose distribution changes over time. In this context, the main problem is how to learn new information without forgetting old knowledge (i.e., Catastrophic Forgetting). Most existing CL approaches focus on finding solutions to preserve acquired knowledge, so working on the past of the model. However, we argue that as the model has to continually learn new tasks, it is also important to put focus on the present knowledge that could improve following tasks learning. In this paper we propose a new, simple, CL algorithm that focuses on solving the current task in a way that might facilitate the learning of the next ones. More specifically, our approach combines the main data stream with a secondary, diverse and uncorrelated stream, from which the network can draw auxiliary knowledge. This helps the model from different perspectives, since auxiliary data may contain useful features for the current and the next tasks and incoming task classes can be mapped onto auxiliary classes. Furthermore, the addition of data to the current task is implicitly making the classifier more robust as we are forcing the extraction of more discriminative features. Our method can outperform existing state-of-the-art models on the most common CL Image Classification benchmarks.


title: Operative and Procedural Cooperative Training in Marine Ports

abstract: This article faces the problem of operative and procedural cooperative training in marine ports with particular attention to harbour pilots and port traffic controller. The design and development of an advanced system, equipped with dedicated hardware in the loop, for cooperative training of operators involved in the last mile of navigation is presented. Indeed, the article describes the software and hardware development of a distributed and interoperable system composed by two simulators (the bridge ship simulator and control tower simulator). Multiple problems are faced and solved including (i) the motion of the ship at sea that is based on a 6 Degree Of Freedom (DOF) model for surge, sway and yaw and closed form expressions for pitch, roll and heave and its validation; (ii) the development of the 3D geometric models and related virtual environments of a real marine port and vessel (to provide the trainees with the sensation to experience a real port and ship environment); (iii) the design of a bridge ship replica, the bridge hardware integration and the design of the visualization system; (iv) the design and development of the control tower simulator; (v) the integration of the bridge ship simulator and control tower simulator through the IEEE 1516 High Level Architecture standard for distributed simulation.


title: On the three-point order parameters of chiral symmetry breaking

abstract: The nonlocal order parameters of the QCD chiral symmetry breaking, namely the nonanomalous three-point Green functions of the quark bilinears belonging to the odd intrinsic parity sector, are studied within the framework of the Resonance chiral theory. The general form of these correlators is then matched with various high energy constraints: the leading and sub-leading OPE for all three momenta simultaneously large, the leading OPE for two momenta large and the leading and sub-leading Brodsky-Lepage limit for the corresponding transition form factor. In order to satisfy these constraints, the Resonance chiral theory has to be enlarged with additional resonance multiplets and with higher derivative operators as well. We discuss a minimal extension of this kind in detail and present corresponding correlators in a closed form. The remaining free parameters are then constrained from lattice data. As a phenomenological application, we discuss the pion-pole contribution to the muon $g-2$ and the decay $\pi^0\to e^+e^-$.


title: Bulk evidence of anisotropic $s$-wave pairing with no sign change in the kagome superconductor CsV$_3$Sb$_5$

abstract: The recently discovered kagome superconductors $A$V$_3$Sb$_5$ ($A$ = K, Rb, Cs) possess a unique band structure with van Hove singularities and Dirac dispersions, in which unusual charge-density-wave (CDW) orders with time-reversal and rotational symmetry breaking have been reported. One of the most crucial unresolved issues is identifying the symmetry of the superconductivity that develops inside the CDW phase. Theory predicts a variety of unconventional superconducting symmetries, including exotic states with chiral and topological properties accompanied by a sign-changing superconducting gap. Experimentally, however, the phase information on the superconducting gap in $A$V$_3$Sb$_5$ is still lacking. Here we report the electron irradiation effects in CsV$_3$Sb$_5$ using introduced impurities as a phase-sensitive probe of superconductivity. Our magnetic penetration depth measurements reveal that with increasing impurities, a highly anisotropic fully-gapped state changes gradually to an isotropic full-gap state without passing through a nodal state. Furthermore, transport measurements under high pressure show that the double superconducting dome in the pressure-temperature phase diagram survives against sufficient impurities. These results are strong bulk evidence that CsV$_3$Sb$_5$ is a non-chiral, anisotropic $s$-wave superconductor with no sign change both at ambient and high pressure, which provides a clue to understanding the relationship between CDW and superconductivity in kagome superconductors.


title: Quantum Contextuality in Time without Inequality

abstract: Bell-Kochen-Specker theorem states that a non-contextual hidden-variable theory cannot completely reproduce the predictions of quantum mechanics. Asher Peres gave a remarkably simple proof of quantum contextuality in a four-dimensional Hilbert space of two spin-1/2 particles. Peres's argument is enormously simpler than that of Kochen and Specker. Peres contextuality demonstrates a logical contradiction between quantum mechanics and the noncontextual hidden variable models by showing an inconsistency when assigning noncontextual definite values to a certain set of quantum observables. In this work, we present a proof of quantum contextuality in time using the temporal version of Peres's contextuality argument. In analogy with the two-particle version of Peres's contextuality argument in the context of spin measurements at two different locations, we consider here single-particle spin measurements at two different times t=t1 and t=t2 where the context is provided through the time separation. Our results can be experimentally verified with the present quantum technology.


title: Making heads or tails of systemic risk measures

abstract: This paper shows that the CoVaR,$\Delta$-CoVaR,CoES,$\Delta$-CoES and MES systemic risk measures can be represented in terms of the univariate risk measure evaluated at a quantile determined by the copula. The result is applied to derive empirically relevant properties of these measures concerning their sensitivity to power-law tails, outliers and their properties under aggregation. Furthermore, a novel empirical estimator for the CoES is proposed. The power-law result is applied to derive a novel empirical estimator for the power-law coefficient which depends on $\Delta\text{-CoVaR}/\Delta\text{-CoES}$. To show empirical performance simulations and an application of the methods to a large dataset of financial institutions are used. This paper finds that the MES is not suitable for measuring extreme risks. Also, the ES-based measures are more sensitive to power-law tails and large losses. This makes these measures more useful for measuring network risk but less so for systemic risk. The robustness analysis also shows that all $\Delta$ measures can underestimate due to the occurrence of intermediate losses. Lastly, it is found that the power-law tail coefficient estimator can be used as an early-warning indicator of systemic risk.


title: Consensus Learning for Cooperative Multi-Agent Reinforcement Learning

abstract: Almost all multi-agent reinforcement learning algorithms without communication follow the principle of centralized training with decentralized execution. During centralized training, agents can be guided by the same signals, such as the global state. During decentralized execution, however, agents lack the shared signal. Inspired by viewpoint invariance and contrastive learning, we propose consensus learning for cooperative multi-agent reinforcement learning in this paper. Although based on local observations, different agents can infer the same consensus in discrete space. During decentralized execution, we feed the inferred consensus as an explicit input to the network of agents, thereby developing their spirit of cooperation. Our proposed method can be extended to various multi-agent reinforcement learning algorithms with small model changes. Moreover, we carry out them on some fully cooperative tasks and get convincing results.


title: Urban Road Safety Prediction: A Satellite Navigation Perspective

abstract: Predicting the safety of urban roads for navigation via global navigation satellite systems (GNSS) signals is considered. To ensure safe driving of automated vehicles, the vehicle must plan its trajectory to avoid navigating on unsafe roads (e.g., icy conditions, construction zones, narrow streets, etc.). Such information can be derived from the roads' physical properties, vehicle's capabilities, and weather conditions. From a GNSS-based navigation perspective, the reliability of GNSS signals in different locales, which is heavily dependent on the road layout within the surrounding environment, is crucial to ensure safe automated driving. An urban road environment surrounded by tall objects can significantly degrade the accuracy and availability of GNSS signals. This article proposes an approach to predict the reliability of GNSS-based navigation to ensure safe urban navigation. Satellite navigation reliability at a given location and time on a road is determined based on the probabilistic position error bound of the vehicle-mounted GNSS receiver. A metric for GNSS reliability for ground vehicles is suggested, and a method to predict the conservative probabilistic error bound of the GNSS navigation solution is proposed. A satellite navigation reliability map is generated for various navigation applications. As a case study, the reliability map is used in the proposed optimization problem formulation for automated ground vehicle safety-constrained path planning.


title: On the Origins of Objects by Means of Careful Selection

abstract: We introduce a taxonomy of objects for EO programming language. This taxonomy is designed with a few principles in mind: non-redundancy, simplicity, and so on. The taxonomy is supposed to be used as a navigation map by EO programmers. It may also be helpful as a guideline for designers of other object-oriented languages or libraries for them.


title: Monoidally graded manifolds

abstract: We give a generalization of the theory of $\mathbb{Z}_2$-graded manifolds to a theory of $\mathcal{I}$-graded manifolds, where $\mathcal{I}$ is a commutative semi-ring with some additional properties. We prove Batchelor's theorem in this generalized setting. To our knowledge, such a proof is still missing except for some special cases.


title: Spectral Metric and Einstein Functionals

abstract: We define bilinear functionals of vector fields and differential forms, the densities of which yield the metric and Einstein tensors on even-dimensional Riemannian manifolds. We generalise these concepts in non-commutative geometry and, in particular, we prove that for the conformally rescaled geometry of the noncommutative two-torus the Einstein functional vanishes.

categories: math.DG gr-qc math-ph math.MP math.OA math.QA


title: Coding of volumetric content with MIV using VVC subpictures

abstract: Storage and transport of six degrees of freedom (6DoF) dynamic volumetric visual content for immersive applications requires efficient compression. ISO/IEC MPEG has recently been working on a standard that aims to efficiently code and deliver 6DoF immersive visual experiences. This standard is called the MIV. MIV uses regular 2D video codecs to code the visual data. MPEG jointly with ITU-T VCEG, has also specified the VVC standard. VVC introduced recently the concept of subpicture. This tool was specifically designed to provide independent accessibility and decodability of sub-bitstreams for omnidirectional applications. This paper shows the benefit of using subpictures in the MIV use-case. While different ways in which subpictures could be used in MIV are discussed, a particular case study is selected. Namely, subpictures are used for parallel encoding and to reduce the number of decoder instances. Experimental results show that the cost of using subpictures in terms of bitrate overhead is negligible (0.1% to 0.4%), when compared to the overall bitrate. The number of decoder instances on the other hand decreases by a factor of two.


title: Proof of a conjecture involving derangements and roots of unity

abstract: Let $n>1$ be an odd integer. For any primitive $n$-th root $\zeta$ of unity in the complex field. Via the Engenvector-eigenvalue Identity, we show that $$\sum_{\tau\in D(n-1)}\mathrm{sign}(\tau)\prod_{j=1}^{n-1}\frac{1+\zeta^{j-\tau(j)}}{1-\zeta^{j-\tau(j)}} =(-1)^{\frac{n-1}{2}}\frac{((n-2)!!)^2}{n}, $$ where $D(n-1)$ is the set of all derangements of $1,\ldots,n-1$. This confirms a previous conjecture of Z.-W. Sun. Moreover, for each $\delta=0,1$ we determine the value of $\det[x+m_{jk}]_{1\le j,k\le n}$ completely, where $$m_{jk}=\begin{cases}(1+\zeta^{j-k})/(1-\zeta^{j-k})&\text{if}\ j\not=k,\\\delta&\text{if}\ j=k. \end{cases}$$


title: Preparing Maximally Entangled States By Monitoring the Environment-System Interaction In Open Quantum Systems

abstract: A common assumption in open quantum systems in general is that the noise induced by the environment, due to the continuous interaction between a quantum system and its environment, is responsible for the disappearance of quantum properties of this quantum system. Interestingly, we show that an environment can be engineered and controlled to direct an arbitrary quantum system towards a maximally entangled state and thus can be considered as a resource for quantum information processing. Barreiro et.al. [Nature 470, 486 (2011)] demonstrated this idea experimentally using an open-system quantum simulator up to five trapped ions . In this paper, we direct an arbitrary initial mixed state of two and four qubits, which is interacting with its environment, into a maximally entangled state . We use QASM simulator and also an IBM Q real processor, with and without errors mitigating, to investigate the effect of the noise on the preparation of the initial mixed state of the qubits in addition to the population of the target state.


title: Interaction confinement and electronic screening in two-dimensional nanofluidic channels

abstract: The transport of fluids at the nanoscale is fundamental to manifold biological and industrial processes, ranging from neurotransmission to ultrafiltration. Yet, it is only recently that well-controlled channels with cross-sections as small as a few molecular diameters became an experimental reality. When aqueous electrolytes are confined within such channels, the Coulomb interactions between the dissolved ions are reinforced due to dielectric contrast at the channel walls: we dub this effect `interaction confinement'. Yet, no systematic way of computing these confined interactions has been proposed beyond the limiting cases of perfectly metallic or perfectly insulating channel walls. Here, we introduce a new formalism, based on the so-called surface response functions, that expresses the effective Coulomb interactions within a two-dimensional channel in terms of the wall's electronic structure, described to any desired level of precision. We use it to demonstrate that in few-nanometer-wide channels, the ionic interactions can be tuned by the wall material's screening length. We illustrate this approach by implementing these interactions in brownian dynamics simulations of a strongly confined electrolyte, and show that the resulting ionic conduction can be adjusted between Ohm's law and a Wien effect behavior. Our results provide a quantitative approach to tuning nanoscale ion transport through the electronic properties of the channel wall material.

categories: cond-mat.mes-hall cond-mat.soft cond-mat.stat-mech physics.chem-ph


title: The eigenvectors-eigenvalues identity and Sun's conjectures on determinants and permanents

abstract: In this paper, we prove a conjecture raised by Zhi-Wei Sun in 2018 by the eigenvectors-eigenvalues identity found by Denton, Parke, Tao and X. Zhang in 2019.


title: Pessimistic Off-Policy Optimization for Learning to Rank

abstract: Off-policy learning is a framework for optimizing policies without deploying them, using data collected by another policy. In recommender systems, this is especially challenging due to the imbalance in logged data: some items are recommended and thus logged more frequently than others. This is further perpetuated when recommending a list of items, as the action space is combinatorial. To address this challenge, we study pessimistic off-policy optimization for learning to rank. The key idea is to compute lower confidence bounds on parameters of click models and then return the list with the highest pessimistic estimate of its value. This approach is computationally efficient and we analyze it. We study its Bayesian and frequentist variants, and overcome the limitation of unknown prior by incorporating empirical Bayes. To show the empirical effectiveness of our approach, we compare it to off-policy optimizers that use inverse propensity scores or neglect uncertainty. Our approach outperforms all baselines, is robust, and is also general.


title: Non-Standard Interaction of atmospheric neutrino in future experiments

abstract: We show the prospects of probing neutral-current non-standard interaction (NSI) in the propagation of atmospheric neutrinos in future large-volume neutrino experiments including DUNE, HK, KNO, and ORCA. For DUNE, we utilize its ability of identifying the tau neutrino event and combine the $\nu_\tau$ appearance with the $\nu_\mu$ disappearance. Based on our simulated results, the ten years of data taking of the atmospheric neutrinos can enormously improve the bounds on the NSI parameters $\varepsilon_{\mu \tau}, | \varepsilon_{\mu \mu} - \varepsilon_{\tau \tau} |$, $\varepsilon_{e \mu }$, $\varepsilon_{e \tau}$ and $| \varepsilon_{\mu \mu} - \varepsilon_{e e} |$ by a couple of orders of magnitudes. In addition, we show the expected correlations between the CP-violation phase $\delta_{CP}$ and the NSI parameters $\varepsilon_{e\mu}, \varepsilon_{e\tau}$, and $|\varepsilon_{ee} - \varepsilon_{\mu \mu}|$ and confirm the potentials of DUNE, HK, KNO (combined with HK) in excluding the "No CP violation" hypothesis at 1$\sigma$, 2$\sigma$, and 3$\sigma$, respectively.


title: Mapping the direction of electron ionization to phase delay between VUV and IR laser pulses

abstract: We theoretically demonstrate a one-to-one mapping between the direction of electron ionization and the phase delay between a linearly polarized VUV and a circular IR laser pulse. To achieve this, we use an ultrashort VUV pulse that defines the moment in time and space when an above threshold electron is released in the IR pulse. The electron can then be accelerated to high velocities escaping in a direction completely determined by the phase delay between the two pulses. The dipole matrix element to transition from an initial bound state of the N$_2$ molecule, considered in this work, to the continuum is obtained using quantum mechanical techniques that involve computing accurate continuum molecular states. Following release of the electron in the IR pulse, we evolve classical trajectories, neglecting the Coulomb potential and accounting for quantum interference, to compute the distribution of the direction and magnitude of the final electron momentum. The concept we theoretically develop can be implemented to produce nanoscale ring currents that generate large magnetic fields.


title: A Robust Deep Learning Enabled Semantic Communication System for Text

abstract: With the advent of the 6G era, the concept of semantic communication has attracted increasing attention. Compared with conventional communication systems, semantic communication systems are not only affected by physical noise existing in the wireless communication environment, e.g., additional white Gaussian noise, but also by semantic noise due to the source and the nature of deep learning-based systems. In this paper, we elaborate on the mechanism of semantic noise. In particular, we categorize semantic noise into two categories: literal semantic noise and adversarial semantic noise. The former is caused by written errors or expression ambiguity, while the latter is caused by perturbations or attacks added to the embedding layer via the semantic channel. To prevent semantic noise from influencing semantic communication systems, we present a robust deep learning enabled semantic communication system (R-DeepSC) that leverages a calibrated self-attention mechanism and adversarial training to tackle semantic noise. Compared with baseline models that only consider physical noise for text transmission, the proposed R-DeepSC achieves remarkable performance in dealing with semantic noise under different signal-to-noise ratios.


title: No GPU? No problem: an ultra fast 3D detection of road users with a simple proposal generator and energy-based out-of-distribution PointNets

abstract: This paper presents a novel architecture for point cloud road user detection, which is based on a classical point cloud proposal generator approach, that utilizes simple geometrical rules. New methods are coupled with this technique to achieve extremely small computational requirement, and mAP that is comparable to the state-of-the-art. The idea is to specifically exploit geometrical rules in hopes of faster performance. The typical downsides of this approach, e.g. global context loss, are tackled in this paper, and solutions are presented. This approach allows real-time performance on a single core CPU, which is not the case with end-to-end solutions presented in the state-of-the-art. We have evaluated the performance of the method with the public KITTI dataset, and with our own annotated dataset collected with a small mobile robot platform. Moreover, we also present a novel ground segmentation method, which is evaluated with the public SemanticKITTI dataset.


title: [Reproducibility Report] Explainable Deep One-Class Classification

abstract: Fully Convolutional Data Description (FCDD), an explainable version of the Hypersphere Classifier (HSC), directly addresses image anomaly detection (AD) and pixel-wise AD without any post-hoc explainer methods. The authors claim that FCDD achieves results comparable with the state-of-the-art in sample-wise AD on Fashion-MNIST and CIFAR-10 and exceeds the state-of-the-art on the pixel-wise task on MVTec-AD. We reproduced the main results of the paper using the author's code with minor changes and provide runtime requirements to achieve if (CPU memory, GPU memory, and training time). We propose another analysis methodology using a critical difference diagram, and further investigate the test performance of the model during the training phase.


title: Essential convergence rate of ordinary differential equations appearing in optimization

abstract: Some continuous optimization methods can be connected to ordinary differential equations (ODEs) by taking continuous limits, and their convergence rates can be explained by the ODEs. However, since such ODEs can achieve any convergence rate by time scaling, the correspondence is not as straightforward as usually expected, and deriving new methods through ODEs is not quite direct. In this letter, we pay attention to stability restriction in discretizing ODEs and show that acceleration by time scaling basically implies deceleration in discretization; they balance out so that we can define an attainable unique convergence rate which we call an "essential convergence rate".


title: Magnitude and Holmes-Thompson intrinsic volumes of convex bodies

abstract: Magnitude is a numerical invariant of compact metric spaces, originally inspired by category theory and now known to be related to myriad other geometric quantities. Generalizing earlier results in $\ell_1^n$ and Euclidean space, we prove an upper bound for the magnitude of a convex body in a hypermetric normed space in terms of its Holmes-Thompson intrinsic volumes. As applications of this bound, we give short new proofs of Mahler's conjecture in the case of a zonoid, and Sudakov's minoration inequality.


title: Inflation, SUSY breaking, and primordial black holes in modified supergravity coupled to chiral matter

abstract: We propose a novel model of the modified (Starobinsky-like) old-minimal-type supergravity coupled to a chiral matter superfield, that can {\it simultaneously} describe multi-field inflation, primordial black hole (PBH) formation, dark matter (DM), and spontaneous supersymmetry (SUSY) breaking after inflation in a Minkowski vacuum. The PBH masses in our supergravity model of double slow-roll inflation, with a short phase of "ultra-slow-roll" between two slow-roll phases, are close to $10^{18}$ g. We find that a significant PBH fraction in the allowed mass window can be supplemented by spontaneous SUSY breaking in the vacuum with the gravitino mass close to the scalaron (inflaton) mass M of the order $10^{13}$ GeV. Our supergravity model favors the {\it composite} nature of DM as a mixture of PBH and heavy gravitinos as the lightest SUSY particles. The composite DM significantly relaxes fine-tuning needed for the whole PBH-DM. The PBH-DM fraction is derived, and the second-order gravitational wave background induced by the enhanced scalar perturbations is calculated. Those gravitational waves may be accessible by the future space-based gravitational interferometers.


title: LIN-MM: Multiplexed Message Authentication Code for Local Interconnect Network message authentication in road vehicles

abstract: The automotive market is profitable for cyberattacks with the constant shift toward interconnected vehicles. Electronic Control Units (ECUs) installed on cars often operate in a critical and hostile environment. Hence, both carmakers and governments have supported initiatives to mitigate risks and threats belonging to the automotive domain. The Local Interconnect Network (LIN) is one of the most used communication protocols in the automotive field. Today's LIN buses have just a few light security mechanisms to assure integrity through Message Authentication Codes (MAC). However, several limitations with strong constraints make applying those techniques to LIN networks challenging, leaving several vehicles still unprotected. This paper presents LIN Multiplexed MAC (LINMM), a new approach for exploiting signal modulation to multiplex MAC data with standard LIN communication. LINMM allows for transmitting MAC payloads, maintaining fullback compatibility with all versions of the standard LIN protocol.


title: CAN-MM: Multiplexed Message Authentication Code for Controller Area Network message authentication in road vehicles

abstract: The automotive market is increasingly profitable for cyberattacks with the constant shift toward fully interconnected vehicles. Electronic Control Units (ECUs) installed on cars often operate in a critical and hostile environment. Hence, both carmakers and governments have decided to support a series of initiatives to mitigate risks and threats belonging to the automotive domain. The Controller Area Network (CAN) is the primary communication protocol in the automotive field, and the integrity of the communication over this network is assured through Message Authentication Codes (MAC). However, limitations in throughput and frame size limit the application of this technique to specific versions of the CAN protocol, leaving several vehicles still unprotected. This paper presents CAN Multiplexed MAC (CAN-MM), a new approach exploiting frequency modulation to multiplex MAC data with standard CAN communication. CAN-MM allows transmitting MAC payloads maintaining full-back compatibility with all versions of the standard CAN protocol. Moreover, multiplexing allows sending DATA and MAC simultaneously.


title: Rate-Distortion Theoretic Bounds on Generalization Error for Distributed Learning

abstract: In this paper, we use tools from rate-distortion theory to establish new upper bounds on the generalization error of statistical distributed learning algorithms. Specifically, there are $K$ clients whose individually chosen models are aggregated by a central server. The bounds depend on the compressibility of each client's algorithm while keeping other clients' algorithms un-compressed, and leverage the fact that small changes in each local model change the aggregated model by a factor of only $1/K$. Adopting a recently proposed approach by Sefidgaran et al., and extending it suitably to the distributed setting, this enables smaller rate-distortion terms which are shown to translate into tighter generalization bounds. The bounds are then applied to the distributed support vector machines (SVM), suggesting that the generalization error of the distributed setting decays faster than that of the centralized one with a factor of $\mathcal{O}(\log(K)/\sqrt{K})$. This finding is validated also experimentally. A similar conclusion is obtained for a multiple-round federated learning setup where each client uses stochastic gradient Langevin dynamics (SGLD).


title: Convergence in Total Variation for nonlinear functionals of random hyperspherical harmonics

abstract: Random hyperspherical harmonics are Gaussian Laplace eigenfunctions on the unit $d$-dimensional sphere ($d\ge 2$). We study the convergence in Total Variation distance for their nonlinear statistics in the high energy limit, i.e., for diverging sequences of Laplace eigenvalues. Our approach takes advantage of a recent result by Bally, Caramellino and Poly (2020): combining the Central Limit Theorem in Wasserstein distance obtained by Marinucci and Rossi (2015) for Hermite-rank $2$ functionals with new results on the asymptotic behavior of their Malliavin-Sobolev norms, we are able to establish second order Gaussian fluctuations in this stronger probability metric as soon as the functional is regular enough. Our argument requires some novel estimates on moments of products of Gegenbauer polynomials that may be of independent interest, which we prove via the link between graph theory and diagram formulas.


title: Verifying generalised and structural soundness of workflow nets via relaxations

abstract: Workflow nets are a well-established mathematical formalism for the analysis of business processes arising from either modeling tools or process mining. The central decision problems for workflow nets are $k$-soundness, generalised soundness and structural soundness. Most existing tools focus on $k$-soundness. In this work, we propose novel scalable semi-procedures for generalised and structural soundness. This is achieved via integral and continuous Petri net reachability relaxations. We show that our approach is competitive against state-of-the-art tools.


title: CROM: Continuous Reduced-Order Modeling of PDEs Using Implicit Neural Representations

abstract: The long runtime of high-fidelity partial differential equation (PDE) solvers makes them unsuitable for time-critical applications. We propose to accelerate PDE solvers using reduced-order modeling (ROM). Whereas prior ROM approaches reduce the dimensionality of discretized vector fields, our continuous reduced-order modeling (CROM) approach builds a low-dimensional embedding of the continuous vector fields themselves, not their discretization. We represent this reduced manifold using continuously differentiable neural fields, which may train on any and all available numerical solutions of the continuous system, even when they are obtained using diverse methods or discretizations. We validate our approach on an extensive range of PDEs with training data from voxel grids, meshes, and point clouds. Compared to prior discretization-dependent ROM methods, such as linear subspace proper orthogonal decomposition (POD) and nonlinear manifold neural-network-based autoencoders, CROM features higher accuracy, lower memory consumption, dynamically adaptive resolutions, and applicability to any discretization. For equal latent space dimension, CROM exhibits 79$\times$ and 49$\times$ better accuracy, and 39$\times$ and 132$\times$ smaller memory footprint, than POD and autoencoder methods, respectively. Experiments demonstrate 109$\times$ and 89$\times$ wall-clock speedups over unreduced models on CPUs and GPUs, respectively. Videos and codes are available on the project page: https://crom-pde.github.io

categories: cs.LG cs.CE cs.GR cs.NA math.NA physics.comp-ph


title: What do tokens know about their characters and how do they know it?

abstract: Pre-trained language models (PLMs) that use subword tokenization schemes can succeed at a variety of language tasks that require character-level information, despite lacking explicit access to the character composition of tokens. Here, studying a range of models (e.g., GPT- J, BERT, RoBERTa, GloVe), we probe what word pieces encode about character-level information by training classifiers to predict the presence or absence of a particular alphabetical character in a token, based on its embedding (e.g., probing whether the model embedding for "cat" encodes that it contains the character "a"). We find that these models robustly encode character-level information and, in general, larger models perform better at the task. We show that these results generalize to characters from non-Latin alphabets (Arabic, Devanagari, and Cyrillic). Then, through a series of experiments and analyses, we investigate the mechanisms through which PLMs acquire English-language character information during training and argue that this knowledge is acquired through multiple phenomena, including a systematic relationship between particular characters and particular parts of speech, as well as natural variability in the tokenization of related strings.


title: Real-World Image Super-Resolution by Exclusionary Dual-Learning

abstract: Real-world image super-resolution is a practical image restoration problem that aims to obtain high-quality images from in-the-wild input, has recently received considerable attention with regard to its tremendous application potentials. Although deep learning-based methods have achieved promising restoration quality on real-world image super-resolution datasets, they ignore the relationship between L1- and perceptual- minimization and roughly adopt auxiliary large-scale datasets for pre-training. In this paper, we discuss the image types within a corrupted image and the property of perceptual- and Euclidean- based evaluation protocols. Then we propose a method, Real-World image Super-Resolution by Exclusionary Dual-Learning (RWSR-EDL) to address the feature diversity in perceptual- and L1- based cooperative learning. Moreover, a noise-guidance data collection strategy is developed to address the training time consumption in multiple datasets optimization. When an auxiliary dataset is incorporated, RWSR-EDL achieves promising results and repulses any training time increment by adopting the noise-guidance data collection strategy. Extensive experiments show that RWSR-EDL achieves competitive performance over state-of-the-art methods on four in-the-wild image super-resolution datasets.


title: Atmospheric Newtonian noise modeling for third-generation gravitational wave detectors

abstract: The sensitivity and the frequency bandwidth of third-generation gravitational-wave (GW) detectors are such that the Newtonian noise (NN) signals produced by atmospheric turbulence could become relevant. We build models for atmospheric NN that take into account finite correlation times and inhomogeneity along the vertical direction, and are therefore accurate enough to represent a reliable reference tool for evaluating this kind of noise. We compute the NN spectral density from our models and compare it with the expected sensitivity curve of the Einstein Telescope (ET) with the xylophone design. The noise signal decays exponentially for small values of the frequency and the detector's depth, followed by a power-law for large values of the parameters. We find that, when the detector is built at the earth's surface, the NN contribution in the low-frequency band is above the ET sensitivity curve for strong wind. Building the detector underground is sufficient to push the noise signal under the ET sensitivity curve, but the decrement is close to marginal for strong wind. In light of the slow decay with depth of the NN, building the detector underground could be only partially effective as passive noise mitigation.


title: Condensation inversion and Witt equivalence via generalised orbifolds

abstract: In Mulevi\v{c}ius-Runkel, arXiv:2002.00663, it was shown how a so-called orbifold datum $\mathbb{A}$ in a given modular fusion category (MFC) $\mathcal{C}$ produces a new MFC $\mathcal{C}_{\mathbb{A}}$. Examples of these associated MFCs include condensations, i.e. the categories $\mathcal{C}_B^\circ$ of local modules of a separable commutative algebra $B\in\mathcal{C}$. In this paper we prove that the relation $\mathcal{C} \sim \mathcal{C}_{\mathbb{A}}$ on MFCs is the same as Witt equivalence. This is achieved in part by providing one with an explicit construction for inverting condensations, i.e. finding an orbifold datum $\mathbb{A}$ in $\mathcal{C}_B^\circ$ whose associated MFC is equivalent to $\mathcal{C}$. As a tool used in this construction we also explore what kinds of functors $F\colon\mathcal{C}\rightarrow\mathcal{D}$ between MFCs preserve orbifold data. It turns out that $F$ need not necessarily be strong monoidal, but rather a `ribbon Frobenius' functor, which has weak monoidal and weak comonoidal structures, related by a Frobenius-like property.


title: Towards the Deep Riemann Hypothesis for $\mathrm{GL}_{n}$

abstract: We explicate the deep Riemann hypothesis for the general linear group $\mathrm{GL}_{n}$ on the convergence of normalised Euler products of standard $L$-functions on the critical line. It conditionally improves upon the error term in the prime number theorem beyond what the grand Riemann hypothesis predicts. Furthermore, we discuss the Chebyshev bias for Satake parameters on $\mathrm{GL}_{n}$ from the perspective of the deep Riemann hypothesis.


title: Interlayer Coupling and Strain Localization in Small-Twist-Angle Graphene Flakes

abstract: Twisted bilayer graphene (TBG) exhibits a wide range of intriguing physical properties, such as superconductivity, ferromagnetism, and superlubricity. Depending on the twist angle, periodic moir\'e superlattices form in twisted bilayer graphene, with inhomogeneous interlayer coupling and lattice deformation. For a small twist angle (typically <2{\deg}), each moir\'e supercell contains a large number of atoms (>10,000), making it computationally expensive for first-principles and atomistic modeling. In this work, a finite element method based on a continuum model is used to simulate the inhomogeneous interlayer and intralayer deformations of twisted graphene flakes on a rigid graphene substrate. The van der Waals interactions between the graphene layers are described by a periodic potential energy function, whereas the graphene flake is treated as a continuum membrane with effective elastic properties. Our simulations show that structural relaxation and the induced strain localization are most significant in a relatively large graphene flake at small twist angles, where the strain distribution is highly localized as shear strain solitons along the boundaries between neighboring domains of commensurate AB stacking. Moreover, it is found that there exist many metastable equilibrium configurations at particular twist angles, depending on the flake size. The nonlinear mechanics of twisted bilayer graphene is thus expected to be essential for understanding the strain distributions in the moir\'e superlattices and the strain effects on other physical properties.


title: Phase separation kinetics of block copolymer melts confined under moving parallel walls: a DPD study

abstract: We use dissipative particle dynamics (DPD) simulations to study the effect of shear on domain morphology and kinetics of microphase separating critical diblock copolymer (BCP) bulk melts. The melt is confined within two parallel solid walls at the top and bottom of the simulation box. The shear is induced by allowing the walls to move in a direction with a specific velocity. We explore the following cases: (i) walls are fixed, (ii) only the top wall moves, (iii) both walls move in the same direction, and (iv) both walls move in opposite directions. After the temperature quench, we monitor the effect of shear on evolution morphology, the scaling behavior of the system, and the characteristic length scale and growth. The characteristic length scale follows typical power-law behavior at early times and saturates at late times when both walls are fixed. The length scale changes significantly with shear caused by wall velocities. The usual lamellar morphology, which is not achieved for case 1 within the considered simulation time steps, is noticed much earlier for the nonzero wall velocity cases. Specifically, it is seen much before in case 4 than in the other cases. We find that the shear viscosity decreases (shear-thinning) with wall velocity (shear rate) for all the cases at a given coarsening time. Overall, we report the influence rule of shear rates on microphase separation kinetics of BCP melts. This study can provide a scheme to anticipate and design anisotropic microstructures under the application of externally controlled wall shear that may further guide in producing the various composite materials with superior mechanical and physical properties.


title: Measurement of Low-Activity Uranium Contamination using Bayesian Statistical Decision Theory

abstract: Amongst the various technical challenges in the field of radiation detection is the need to carry out accurate low-level radioactivity measurements in the presence of large fluctuations in the natural radiation background, while lowering the false alarm rates. Several studies, using statistical inference, have been proposed to overcome this challenge. This work presents an advanced statistical approach for decision-making in the field of nuclear decommissioning. The results indicate that the proposed method allows to adjust the confidence degree in the stationarity of the background signal. It also ensures an acceptable tradeoff between the True Detection Rate (TDR), the False Alarm Rate (FAR) and the response time, and is consistent with the users requirements.


title: Did the Milky Way just light up? The recent star formation history of the Galactic disc

abstract: [Abridged] We map the stellar age distribution ($\lesssim 1$ Gyr) across a 6kpc$\,\times\,$6kpc area of the Galactic disc to constrain our Galaxy's recent star-formation history. Our modelling draws on the sample of Zari et al. (2021) that encompasses all presumed disc OBA stars ($\sim 500,000$ sources) with $G<16$. To be less sensitive to reddening, we do not forward model the detailed CMD distribution of these stars, but instead the K-band absolute magnitude distribution, $n(M_K)$, among stars with $M_K<0$ and $T_{\mathrm{eff}} > 7000$K at a certain positions $\vec{x}$ in the disc as a step function with five age bins, $b(\tau~|~\vec{x}, \vec{\alpha})$, logarithmically-spaced in age from $\tau = 5$ Myr to $\tau = 1$ Gyr. Given a set of isochrones and a Kroupa (2001) initial mass function, we sample $b(\tau\,|\,\vec{x}, \vec{\alpha})$ to maximize the likelihood of the data, accounting for the selection function. This results in a set of mono-age stellar density maps across a sizeable portion of the Galactic disc. These maps show that some, but not all, spiral arms are reflected in overdensities of stars younger than 500 Myr. The maps of the youngest stars ($<10$ Myr) trace major star forming regions. The maps at all ages exhibit an outward density gradient and distinct spiral-like spatial structure, which is qualitatively similar on large scales among all age intervals. When summing over the maps' area and extrapolating to the whole disc, we find an effective star-formation rate over the last 10 Myr of $\approx 3.3 \mathrm{M_{\odot}/yr}$, higher than previously published estimates. Remarkably, our stellar age distribution implies that the star-formation rate has been three times lower throughout most of the last Gyr, having risen distinctly only in the very recent past.


title: Individual Privacy Accounting for Differentially Private Stochastic Gradient Descent

abstract: Differentially private stochastic gradient descent (DP-SGD) is the workhorse algorithm for recent advances in private deep learning. It provides a single privacy guarantee to all datapoints in the dataset. We propose output-specific $(\varepsilon,\delta)$-DP to characterize privacy guarantees for individual examples when releasing models trained by DP-SGD. We also design an efficient algorithm to investigate individual privacy across a number of datasets. We find that most examples enjoy stronger privacy guarantees than the worst-case bound. We further discover that the training loss and the privacy parameter of an example are well-correlated. This implies groups that are underserved in terms of model utility simultaneously experience weaker privacy guarantees. For example, on CIFAR-10, the average $\varepsilon$ of the class with the lowest test accuracy is 44.2\% higher than that of the class with the highest accuracy.


title: Generalized Federated Learning via Sharpness Aware Minimization

abstract: Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes efficient optimization difficult. To tackle this problem, many FL algorithms focus on mitigating the effects of data heterogeneity across clients by increasing the performance of the global model. However, almost all algorithms leverage Empirical Risk Minimization (ERM) to be the local optimizer, which is easy to make the global model fall into a sharp valley and increase a large deviation of parts of local clients. Therefore, in this paper, we revisit the solutions to the distribution shift problem in FL with a focus on local learning generality. To this end, we propose a general, effective algorithm, \texttt{FedSAM}, based on Sharpness Aware Minimization (SAM) local optimizer, and develop a momentum FL algorithm to bridge local and global models, \texttt{MoFedSAM}. Theoretically, we show the convergence analysis of these two algorithms and demonstrate the generalization bound of \texttt{FedSAM}. Empirically, our proposed algorithms substantially outperform existing FL studies and significantly decrease the learning deviation.


title: VPIT: Real-time Embedded Single Object 3D Tracking Using Voxel Pseudo Images

abstract: In this paper, we propose a novel voxel-based 3D single object tracking (3D SOT) method called Voxel Pseudo Image Tracking (VPIT). VPIT is the first method that uses voxel pseudo images for 3D SOT. The input point cloud is structured by pillar-based voxelization, and the resulting pseudo image is used as an input to a 2D-like Siamese SOT method. The pseudo image is created in the Bird's-eye View (BEV) coordinates, and therefore the objects in it have constant size. Thus, only the object rotation can change in the new coordinate system and not the object scale. For this reason, we replace multi-scale search with a multi-rotation search, where differently rotated search regions are compared against a single target representation to predict both position and rotation of the object. Experiments on KITTI Tracking dataset show that VPIT is the fastest 3D SOT method and maintains competitive Success and Precision values. Application of a SOT method in a real-world scenario meets with limitations such as lower computational capabilities of embedded devices and a latency-unforgiving environment, where the method is forced to skip certain data frames if the inference speed is not high enough. We implement a real-time evaluation protocol and show that other methods lose most of their performance on embedded devices, while VPIT maintains its ability to track the object.


title: ResAct: Reinforcing Long-term Engagement in Sequential Recommendation with Residual Actor

abstract: Long-term engagement is preferred over immediate engagement in sequential recommendation as it directly affects product operational metrics such as daily active users (DAUs) and dwell time. Meanwhile, reinforcement learning (RL) is widely regarded as a promising framework for optimizing long-term engagement in sequential recommendation. However, due to expensive online interactions, it is very difficult for RL algorithms to perform state-action value estimation, exploration and feature extraction when optimizing long-term engagement. In this paper, we propose ResAct which seeks a policy that is close to, but better than, the online-serving policy. In this way, we can collect sufficient data near the learned policy so that state-action values can be properly estimated, and there is no need to perform online exploration. ResAct optimizes the policy by first reconstructing the online behaviors and then improving it via a Residual Actor. To extract long-term information, ResAct utilizes two information-theoretical regularizers to confirm the expressiveness and conciseness of features. We conduct experiments on a benchmark dataset and a large-scale industrial dataset which consists of tens of millions of recommendation requests. Experimental results show that our method significantly outperforms the state-of-the-art baselines in various long-term engagement optimization tasks.


title: Ricci flow on surfaces along the standard lightcone in the $3+1$-Minkowski spacetime

abstract: Identifying any conformally round metric on the $2$-sphere with a unique cross section on the standard lightcone in the $3+1$-Minkowski spacetime, we gain a new perspective on $2d$-Ricci flow on topological spheres. It turns out that in this setting, Ricci flow is equivalent to a null mean curvature flow first studied by Roesch--Scheuer along null hypersurfaces. Exploiting this equivalence, we can translate well-known results from $2d$-Ricci flow first proven by Hamilton into a full classification of the singularity models for null mean curvature flow in the Minkowski lightcone. Conversely, we obtain a new proof of Hamilton's classical result using only the maximum principle.


title: Hardware-accelerated Mars Sample Localization via deep transfer learning from photorealistic simulations

abstract: The goal of the Mars Sample Return campaign is to collect soil samples from the surface of Mars and return them to Earth for further study. The samples will be acquired and stored in metal tubes by the Perseverance rover and deposited on the Martian surface. As part of this campaign, it is expected that the Sample Fetch Rover will be in charge of localizing and gathering up to 35 sample tubes over 150 Martian sols. Autonomous capabilities are critical for the success of the overall campaign and for the Sample Fetch Rover in particular. This work proposes a novel system architecture for the autonomous detection and pose estimation of the sample tubes. For the detection stage, a Deep Neural Network and transfer learning from a synthetic dataset are proposed. The dataset is created from photorealistic 3D simulations of Martian scenarios. Additionally, the sample tubes poses are estimated using Computer Vision techniques such as contour detection and line fitting on the detected area. Finally, laboratory tests of the Sample Localization procedure are performed using the ExoMars Testing Rover on a Mars-like testbed. These tests validate the proposed approach in different hardware architectures, providing promising results related to the sample detection and pose estimation.


title: Generalized free energy landscape of black hole phase transition

abstract: Recently, the stochastic dynamical model based on the free energy landscape was proposed to quantify the kinetics of the black hole phase transition. An essential concept is the generalized free energy of the fluctuating black hole, which was defined in terms of the thermodynamic relation previously. In this work, by employing the Gibbons-Hawking path integral approach to black hole thermodynamics, we show that the generalized free energy can be derived from the Einstein-Hilbert action of the Euclidean gravitational instanton with the conical singularity. This work provides a concrete and solid foundation for the free energy landscape formalism of black hole phase transition.


title: Band width estimates of CMC initial data sets

abstract: We generalize a band width estimate of Gromov to CMC initial data sets. We give three independent proofs: via the stability of a hypersurface with prescribed null expansion, via a perturbation of the spacetime harmonic function and via the Dirac operator.


title: Study of transfer learning from 2D supercritical airfoils to 3D transonic swept wings

abstract: Machine learning has been widely utilized in fluid mechanics studies and aerodynamic optimizations. However, most applications, especially flow field modeling and inverse design, involve two-dimensional flows and geometries. The dimensionality of three-dimensional problems is so high that it is too difficult and expensive to prepare sufficient samples. Therefore, transfer learning has become a promising approach to reuse well-trained two-dimensional models and greatly reduce the need for samples for three-dimensional problems. This paper proposes to reuse the baseline models trained on supercritical airfoils to predict finite-span swept supercritical wings, where the simple swept theory is embedded to improve the prediction accuracy. Two baseline models for transfer learning are investigated: one is commonly referred to as the forward problem of predicting the pressure coefficient distribution based on the geometry, and the other is the inverse problem that predicts the geometry based on the pressure coefficient distribution. Two transfer learning strategies are compared for both baseline models. The transferred models are then tested on the prediction of complete wings. The results show that transfer learning requires only approximately 500 wing samples to achieve good prediction accuracy on different wing planforms and different free stream conditions. Compared to the two baseline models, the transferred models reduce the prediction error by 60% and 80%, respectively.


title: Infinite Recommendation Networks: A Data-Centric Approach

abstract: We leverage the Neural Tangent Kernel and its equivalence to training infinitely-wide neural networks to devise $\infty$-AE: an autoencoder with infinitely-wide bottleneck layers. The outcome is a highly expressive yet simplistic recommendation model with a single hyper-parameter and a closed-form solution. Leveraging $\infty$-AE's simplicity, we also develop Distill-CF for synthesizing tiny, high-fidelity data summaries which distill the most important knowledge from the extremely large and sparse user-item interaction matrix for efficient and accurate subsequent data-usage like model training, inference, architecture search, etc. This takes a data-centric approach to recommendation, where we aim to improve the quality of logged user-feedback data for subsequent modeling, independent of the learning algorithm. We particularly utilize the concept of differentiable Gumbel-sampling to handle the inherent data heterogeneity, sparsity, and semi-structuredness, while being scalable to datasets with hundreds of millions of user-item interactions. Both of our proposed approaches significantly outperform their respective state-of-the-art and when used together, we observe 96-105% of $\infty$-AE's performance on the full dataset with as little as 0.1% of the original dataset size, leading us to explore the counter-intuitive question: Is more data what you need for better recommendation?


title: DCAN: Diversified News Recommendation with Coverage-Attentive Networks

abstract: Self-attention based models are widely used in news recommendation tasks. However, previous Attention architecture does not constrain repeated information in the user's historical behavior, which limits the power of hidden representation and leads to some problems such as information redundancy and filter bubbles. To solve this problem, we propose a personalized news recommendation model called DCAN.It captures multi-grained user-news matching signals through news encoders and user encoders. We keep updating a coverage vector to track the history of news attention and augment the vector in 4 types of ways. Then we fed the augmented Coverage vector into the Multi-headed Self-attention model to help adjust the future attention and added the Coverage regulation to the loss function(CRL), which enabled the recommendation system to consider more about differentiated information. Extensive experiments on Microsoft News Recommendation Dataset (MIND) show that our model significantly improve the diversity of news recommendations with minimal sacrifice in accuracy.


title: HYCEDIS: HYbrid Confidence Engine for Deep Document Intelligence System

abstract: Measuring the confidence of AI models is critical for safely deploying AI in real-world industrial systems. One important application of confidence measurement is information extraction from scanned documents. However, there exists no solution to provide reliable confidence score for current state-of-the-art deep-learning-based information extractors. In this paper, we propose a complete and novel architecture to measure confidence of current deep learning models in document information extraction task. Our architecture consists of a Multi-modal Conformal Predictor and a Variational Cluster-oriented Anomaly Detector, trained to faithfully estimate its confidence on its outputs without the need of host models modification. We evaluate our architecture on real-wold datasets, not only outperforming competing confidence estimators by a huge margin but also demonstrating generalization ability to out-of-distribution data.


title: Backpropagation at the Infinitesimal Inference Limit of Energy-Based Models: Unifying Predictive Coding, Equilibrium Propagation, and Contrastive Hebbian Learning

abstract: How the brain performs credit assignment is a fundamental unsolved problem in neuroscience. Many `biologically plausible' algorithms have been proposed, which compute gradients that approximate those computed by backpropagation (BP), and which operate in ways that more closely satisfy the constraints imposed by neural circuitry. Many such algorithms utilize the framework of energy-based models (EBMs), in which all free variables in the model are optimized to minimize a global energy function. However, in the literature, these algorithms exist in isolation and no unified theory exists linking them together. Here, we provide a comprehensive theory of the conditions under which EBMs can approximate BP, which lets us unify many of the BP approximation results in the literature (namely, predictive coding, equilibrium propagation, and contrastive Hebbian learning) and demonstrate that their approximation to BP arises from a simple and general mathematical property of EBMs at free-phase equilibrium. This property can then be exploited in different ways with different energy functions, and these specific choices yield a family of BP-approximating algorithms, which both includes the known results in the literature and can be used to derive new ones.


title: Improving Ads-Profitability Using Traffic-Fingerprints

abstract: This paper introduces the concept of traffic-fingerprints, i.e., normalized 24-dimensional vectors representing a distribution of daily traffic on a web page. Using k-means clustering we show that similarity of traffic-fingerprints is related to the similarity of profitability time patterns for ads shown on these pages. In other words, these fingerprints are correlated with the conversions rates, thus allowing us to argue about conversion rates on pages with negligible traffic. By blocking or unblocking whole clusters of pages we were able to increase the revenue of online campaigns by more than 50%.


title: Contemporary Recommendation Systems on Big Data and Their Applications: A Survey

abstract: This survey paper conducts a comprehensive analysis of the evolution and contemporary landscape of recommendation systems, which have been extensively incorporated across a myriad of web applications. It delves into the progression of personalized recommendation methodologies tailored for online products or services, organizing the array of recommendation techniques into four main categories: content-based, collaborative filtering, knowledge-based, and hybrid approaches, each designed to cater to specific contexts. The document provides an in-depth review of both the historical underpinnings and the cutting-edge innovations in the domain of recommendation systems, with a special focus on implementations leveraging big data analytics. The paper also highlights the utilization of prominent datasets such as MovieLens, Amazon Reviews, Netflix Prize, Last.fm, and Yelp in evaluating recommendation algorithms. It further outlines and explores the predominant challenges encountered in the current generation of recommendation systems, including issues related to data sparsity, scalability, and the imperative for diversified recommendation outputs. The survey underscores these challenges as promising directions for subsequent research endeavors within the discipline. Additionally, the paper examines various real-life applications driven by recommendation systems, addressing the hurdles involved in seamlessly integrating these systems into everyday life. Ultimately, the survey underscores how the advancements in recommendation systems, propelled by big data technologies, have the potential to significantly enhance real-world experiences.


title: Contextualization for the Organization of Text Documents Streams

abstract: There has been a significant effort by the research community to address the problem of providing methods to organize documentation with the help of information Retrieval methods. In this report paper, we present several experiments with some stream analysis methods to explore streams of text documents. We use only dynamic algorithms to explore, analyze, and organize the flux of text documents. This document shows a case study with developed architectures of a Text Document Stream Organization, using incremental algorithms like Incremental TextRank, and IS-TFIDF. Both these algorithms are based on the assumption that the mapping of text documents and their document-term matrix in lower-dimensional evolving networks provides faster processing when compared to batch algorithms. With this architecture, and by using FastText Embedding to retrieve similarity between documents, we compare methods with large text datasets and ground truth evaluation of clustering capacities. The datasets used were Reuters and COVID-19 emotions. The results provide a new view for the contextualization of similarity when approaching flux of documents organization tasks, based on the similarity between documents in the flux, and by using mentioned algorithms.


title: Towards Fair Federated Recommendation Learning: Characterizing the Inter-Dependence of System and Data Heterogeneity

abstract: Federated learning (FL) is an effective mechanism for data privacy in recommender systems by running machine learning model training on-device. While prior FL optimizations tackled the data and system heterogeneity challenges faced by FL, they assume the two are independent of each other. This fundamental assumption is not reflective of real-world, large-scale recommender systems -- data and system heterogeneity are tightly intertwined. This paper takes a data-driven approach to show the inter-dependence of data and system heterogeneity in real-world data and quantifies its impact on the overall model quality and fairness. We design a framework, RF^2, to model the inter-dependence and evaluate its impact on state-of-the-art model optimization techniques for federated recommendation tasks. We demonstrate that the impact on fairness can be severe under realistic heterogeneity scenarios, by up to 15.8--41x compared to a simple setup assumed in most (if not all) prior work. It means when realistic system-induced data heterogeneity is not properly modeled, the fairness impact of an optimization can be downplayed by up to 41x. The result shows that modeling realistic system-induced data heterogeneity is essential to achieving fair federated recommendation learning. We plan to open-source RF^2 to enable future design and evaluation of FL innovations.


title: On a Twisted Jacquet module of GL(6) over a finite field

abstract: Let F be a finite field and G=GL(6,F). In this paper, we explicitly describe a certain twisted Jacquet module of an irreducible cuspidal representation of G.